If you don't have classes with or are in the same classes as those athletes. Then there is not a natural opportunity to start talking to them.
The alternative would be to go to games and try to create opportunities.
That could get a bit on the stalker ish side. Don't know those single girls would want that either.
But I agree with the sentiment that generally tall girls Don't date shorter guys.
I'm sure it's a combination of the guys not asking and the girls preferring taller.
I'm 6'3" and my wife is 5'10". She always had a preference of guys taller than her.