But if I moved back home my wife wouldn't like it and would probably make us visit her family more to counterbalance seeing my family so often and honestly that isn't worth it.

I am open to moving to just about anywhere as long as it isn't near the in laws. Also living somewhere boring would probably be a plus because they wouldn't visit so moving back home would check that box.