Which is why I say "I think this all comes down to an evaluation..."
I think you have to decide if your boss is being unreasonable, or what your expectations are. If they can be talked out, that's great. If your boss isn't someone you can talk things out with, and the nature of the relationship is having an overall negative impact on you - then maybe it's best to move on.