I am a Bronco fan. I loved how he tried to turn the HC and other issues often viewed as barriers to getting players into a strength for the program.
I do think there were fans who were ready for Bronco to leave. I don't think they drove him away - they had no power over him. I think Bronco was a bit too sensitive to fan reactions, which was dumb, as seen by him referring to the first game when he was booed. While I didn't think Bronco needed to go, I was OK than he went.
And as much as I like Bronco and would love to have him win at Virginia - there is ALWAYS one team I'll want any team he coaches to lose to. BYU. I'm a BYU fan. I became a Bronco fan because I am a BYU fan. But my BYU fandom predates and supersedes any Bronco fandom.
Your premise is flawed. I don't know any BYU fans who love Bronco and want him to succeed at the expense of BYU.