But has some semblance of small town, however there's a ton of people moving in and it's getting busier all the time.

I'd have zero reservations moving to somewhere smaller/remote if I could continue to work from home.