Granted, if the Big 12 goes East and tries to only poach the best of the ACC, then I think they have a shot.
But seriously, what kind of TV draw do most of those Big 12 schools have? It can be argued that Houston=Baylor and SMU=TCU — particularly with Houston being a larger school in one of the largest metro areas in the US, and SMU in the "big city" half of the DFW metroplex.
Again, I think a major issue is what kind of money the "new" Big 12 will be offered for TV contracts and, with no real TV markets (aside from TCU and the little they control DFW), I'm not sure the 8 left over teams are worth much to TV (aside from Kansas for Basketball, and they'll likely be exploring moves to the Big 10).