Most people would look at the LDS college experience and say "No thanks."
Those who might see its appeal, particularly if it included paid education to be part of a very competitive athletic team, might still pass based on the rigidity of the BYU's rules (both real, perceived, and based on impressions planted by competing schools, etc.). It doesn't click for a lot of prospective athletes and their families, including many LDS.
Just saying it's tough. We're a niche school within a niche. Good players exist there, and we have our appeal, but it takes a skilled and dedicated recruiting effort along with a steady flow of top talent within our core demographic.