... small time sports seem to fit them better. Plus, everyone knows "Ivy League" as elite for academics so they don't have to work to keep their name recognition or reputations up as much.
Stanford's as elite as any Ivy League school now and their sports programs have definitely helped them build brand name/value. Duke is similar.