By my count, the current P5 has exactly 64 teams. And, that doesn't even include Notre Dame. So, if the P5 condsolidated down to a P4 with 64 teams, that would likely mean someone gets kicked out in favor of Notre Dame, and BYU's fate is sealed, forever on the outside.