When it is 20 degrees outside, if you have a swimsuit on it is so much colder when you get out. Your suit practically turns to instant ice cold. If you don't have a suit on, you wrap your towel around your body, and it is cold, but not bad.
Then again, winter or summer, it is the same for me.
Of course, only if it is private.