I just don't think he would leave TCU for Texas unless Texas offered him a ridiculous amount of money.
Patterson has a pretty good gig in Fort Worth. They just finished their tremendous capital campaign to upgrade the stadium and facilities and at TCU, Patterson pretty much has a lifetime contract. Being the TCU coach, Patterson is the anti-Longhorn and pretty much despises Texas. Same thing with Briles. Either of those two to Texas is a non-starter IMHO.