Other things you mentioned have any long term consequences. If anything, expansion has helped the conference. Utah and to a lesser extent Colorado have out performed several of the “original” members.
Payouts would not be significantly higher with 2 fewer members.