many other teams have successfully done it as well.
The season that Washington State went the Rose Bowl a few years back it was mentioned quite often in their games that I watched that their coaching philosophy was to put their best athletes on defense and develop them. They did have an amazing defense for a couple of years with that philosophy.
Impact players on defense are harder to find than impact players on offense.