Summer
Generally flat and dismal, although this can be good for the beachbreaks north of Point Arguello, most of which are only surfable when they're small and clean. The fog can hamper onshore breezes, but persistent wind in the outer waters often makes for junky conditions, despite calm air at the beach. Lower Santa Barbara County is just plain depressing this time of year, and it's no surprise many locals travel elsewhere for a month or two. Jalama's really the only call.
Fall
This is when you want to be here. Oily glass, long-interval west swells, neoprene-warming sunshine all day -- yeah, it happens, usually in September and October. Autumn is a transitional period, so you should expect the best and the worst. However, the tourist influx subsides dramatically after the Labor Day weekend, so fewer gawkers translates into more quality exploration room for you. Autumn is also the time of year when lower Santa Barbara County awakens from its summer hibernation, and those fabled right points can become downright magical.
Winter
This is hands-down the most consistent time of year for the pointbreaks. Aleutian storms can turn everywhere north of Point Conception into a rowdy mess, but once the swells start filtering around the corner, the whole area turns into a thigh-burning pointbreak wonderland.
Spring
Sucks. Minimal swell and mucho northwest wind translates to flat, onshore surf. Plus, the NW winds create upwelling, so the water's as cold as it gets all year.