as crazy as it sounds, he is used to developing athletes into top players. Not developing top players into athletes. Say what you want about the condition of the Texas program, they still out recruit the majority of schools.
Also TCU the bad stuff is more under the table vs the visibility of Texas. The scandals that have rocked TCU are a blip on the radar. Those same scandals would be major news at Texas.
I am not sure Patterson could handle Texas. The Icarus effect would be in play here I am thinking.