I do when in SoCal, and don't when in Utah. Just like I speak French in France.
Just like you're annoyed at people doing it, someone in SoCal would think you're slow if you don't. I-15 becomes "the 15" somewhere around San Bernardino and if you want to be understood, use words others will understand.