Because there's already not enough games between P5 conferences.
The last thing that's needed is another reason for teams to not schedule out of conference P5 teams. I'd like to not have to wait till bowl season to find out if a conference was any good.