My brother lives in Visalia and the weather is not my style.. though the relatively close proximity to the mountains is nice. He can go up skiing for the day and still come home in the evening.
That could pretty much be all of California, although central valley is obviously closer. The best place to live in the central valley(weatherwise) might be Sacramento since the delta is located to the west and they get the delta breeze on even the hottest days. So Sacramento is closer to 90 everyday in the summer rather than the 100-105 degree heat in Fresno and Bakersfield.