Not living in or near the Tenderloin helps avoid the big one, which is the homeless/drug/petty crime issue. But yes, the city and the whole Bay Area have some amazingly beautiful places, and there are no hot summers or cold winters. If you like temps in the 55-70 degree range, it's just about ideal.