The USU game you refer to that we "only won by 3"? The final score was 6-3. Yeah, the defense did its job.
The defense had one bad game against a top 10 team with two NFL WR (Oregon State) and a really good RB. Score was tied going into the the quarter but Reilly threw two picks. BYU wins every game on that schedule with a competent offense.