Perception is important. Quality wins in the eyes of some (including some committee members) means beating top 50 RPI teams. So while beating 51 instead of 52 doesn't matter, beating #50 instead of #51 does matter. Is it fair? No. Is it right? No. Is it reality? Yes. It has everything to do with how the info is summarized.

Record against Top 25 RPI
Record against Top 50 RPI
Record against Top 100 RPI

If you don't have much in the first two categories, many minds go to "they haven't really beaten anybody". Sure they beat Gonzaga, but who else? No other top 50 teams? Gee, that resume is looking kind of thin.