You walk away pretty sure they were joking, but in the moment, you’re pretty sure you’ve offended them. And the problem becomes that you don’t know which of your own self to believe is right.
Either way, it usually leads to wanting to interact with that person less, which is probably what they were going for in the first place.