That idea has been suggested and proposed by the media, bracketologists, and
fans in general for years. Out would decrease the number of mediocre power conference teams and give more mid major teams a shot. However, it's not something I ever see being adopted because it will only hurt the conferences that have the power.