When people look at the numbers and say only 15-20 make money that is misleading. Only 15-20 athletic departments make a profit, but far more football teams do. That money is then used to subsidize the rest of the athletic department. Without that money you would have to shut down everything else.
This is where people see the racism. The predominately black sports that make money are used to pay scholarships for the majority white sports.