The AP poll in football includes non-fbs schools as well so the number is actually much bigger. Occasionally you’ll see FCS teams getting votes.
In basketball, there are well over a hundred teams that are essentially FCS or division 2 quality programs that aren’t actually competing with BYU for a ranking.
With all that said, there are still probably more teams in basketball than in football with a legit shot at being ranked, so your point still stands. And Coach Pope has done a fantastic job.