Sunday play is clearly an issue. I don't know why people can't accept that. We aren't Notre Dame or Texas. We aren't the big dogs anymore. We can't expect big dogs to cave to accommodate us.
Baylor and TCU are no BYU. Not a fair comparison. Sure, they may be "Christian" institutions, but BYU is on an entirely different level. I think most of the country would be more sympathetic to the Kabul University of Jihad than to BYU.
Travel is a less of an issue, but is to some degree. (Thanks West Virginia)