He is upset because they treated him like everybody else instead of bending over backwards to compliment him constantly like in season one.

And then Roy not seeing him as a that confirmed all his worst fears