In many years Gonzaga gets to the Sweet 16 without beating a ranked team in the tournament. And that’s due to a high seed that is part deserved and part not because of an inflated regular season record.
You’re right that sometimes top seeds don’t make the Sweet 16. But beating unranked teams in the tournament is what it is. It’s better than losing to unranked teams in the tournament, but let’s not get carried away.