You’re going to pay less for airline and accommodations; the weather is pretty nice - not frigid nor extremely hot. The kids are already out of school, so they’re not missing anything in that front. And lastly, your destination is not overcrowded by the summer rush.
To me, that’s plenty of appeal.
Downside - there may be attractions that are only available during the summer months, so you could potentially miss out on some things.