It would take me way off my family focus.
You describe the exact situation i wouldn't want.
Plus leaving Good people to join their competition who you say don't respect you.
Id push for a third option with more upside from your current company or better hours/understanding with your new one.