Georgia's athletic budget for 2019-2020 was $143M, BYU's was $50M. Georgia's Football-Only Budget ($35M) was nearly as high as BYU's TOTAL.
Not to mention that BYU came in $20M short of that last year and needed to raise donations. So if BYU wants to compete with the Georgia's of the world, and have a $3M recruiting budget, they could do that. But they'd have to spend $35M/yr (probably more than that actually since they'd have to make up ground).
So if BYU is spending $40M/yr on football every year, that leaves $10M for everything else. And men's basketball takes up the majority of that, so nothing left for every other sport and student-athlete, no scholarships, no travel, nothing, those sports just no longer exist. Given the budget, BYU has to choose whether to compete in football or whether to go a little low there and compete in the lower-profile sports.