The BCS era really hurt BYU. The P5 era is hurting even worse. Fewer and fewer of the high quality LDS recruits are choosing to come to BYU. We simply don't have the quality of player that we did during the 80's and 90's.
BYU is also out of phase with regards to demographics, the honor code, geographic location, etc.