...he was not far removed from his NFL days and wasn't looking to coach at the time. (Timing as Donnerstag said)
The second time was at the advent of Anae 2.0 and he wasn't interested as he had philosophical differences with the scheme.
The shame of BYU and Ty is that they should have:
1. Ponied up the dough they did for Grimes and allowed him to hire real coaches instead of a group of guys with limited to no experience.
2. Ponied up the dough for a guy like Grimes, who obviously views his time at BYU as a stepping stone, and paid Ty real money to be the QB coach and OC in waiting...allowing him a few years to reacquaint himself with the college game.
However, you want to look at Ty and his tenure as OC, the fact is he is a legend and knows his stuff and would have been a great long term addition for the school, but shortsightedness from all parties has now made that a near impossibility.