As an example, let's look at Utah since they had an anomalous huge rating in a regular season game, drawing 4.8M against Oregon last year, when they haven't drawn over 3M in any other regular season games from 2018 on.
Their 5-year V-Score is 1.04. Without that Oregon game it would be 0.95. So it certainly helped them... but it doesn't carry enough weight to drastically alter the score.
But in a 5 game sample, everything naturally carries a lot more weight, so that Wyoming game will hurt us for now. If we get better numbers against ND and Arkansas the impact will be blunted. If we get bad numbers against those teams (unlikely) then the positive impact of Oregon and Baylor will be decreased.