Should people use offensive (unintended or not) language? Probably not. Will they? Inevitably so. It is up to us whether we decide we want to be offended or not. Our culture today has become more and more sensitive about offending others; and more quick to feel or be offended by a word that someone says, or a phrase. I mean, there are people now who have nothing better to do than complain about pronouns that people use around them; He/She/Him/Her/They/Them/Ziz/Zur etc.
Words can hurt, especially if they are directed towards us, or someone we love and intentionally used with malice. I think the situation that words are said in are of the utmost importance.
Sitting at a sporting event and someone you don't even know uses a word you don't like, not directed towards you or someone you care about - then I wouldn't even give it a second thought.
Someone uses a word you don't like, and it is just you and that person in a 1 on 1 situation, I don't see anything wrong with communicating your displeasure or offense to the word and asking them nicely to not use that word in your presence.
but I don't ever think we should start a large altercation due to words. Move on, forgive and forget IMO.