I'll also say that BYU certainly had their chance and more or less blew it in 2011. After overestimating their value (and the appeal of BYUtv) or perhaps underestimating the strength of the Big XII, BYU allowed themselves to get scooped by TCU.
Time and again, BYU has been a poor negotiator (Notre Dame series; Arizona series; Big XII expansion) and has been difficult to work with (leaving WAC in shambles to form MWC; leaving MWC for "greener pastures"; playing hard to get with the Big XII). That, in and of itself, may be reason enough for BYU to not be "deserving" of P5 membership.