If Clowney is a bust, you can replace him with an adequate backup. Sure the defense will suffer, but they'll be okay.
With the QB, it's boom or bust. A great QB can really take you places. Anything less and you're toast unless you have an amazing defense. If Manzel doesn't work out, the team that drafted him better have a really, really good backup or they'll be missing the playoffs.