Being away from them was a good experience for me. Now they were a lot closer to BYU than New York (they’re in Vegas) so I could see them every couple of months. But I wouldn’t have been a big fan of them moving within an hour of me at BYU. Not sure if that applies to your situation one bit. But if you are confident you can fly to Utah semi regularly and still see them, New York sounds great.
But I’m extremely biased.