I don't think a loss to USU would cause panic, unless BYU was blown out
USU is a ranked team, they'll be pretty much at full strength, and it's a neutral court. Losing to ranked teams away from home isn't going to ruin a season, even if it would suck to lose to two (three, BSU) rivals.