If you call it, the defender's coach doesn't have any argument, because the rules are clear and are designed to protect the players.
If you don't call that one, the shooter's coach is going to go insane about how you need to protect his guys and you can't let that kind of crap slide. Even though it's clear that the defender didn't do it intentionally, you HAVE to make that call.