I have been twice. You will definitely get Utah fans around you saying things,
but I have never felt threatened. I just gave them a little friendly smack talk back and it was all good. Then again I was with a good sized group of BYU fans. So it might be different for fans that are by themselves.