You make a good point: because it is so easy to annoy grammar Nazis, there are many simple ways to accomplish that objective. The Oxford comma is merely one of them.
My point was that since using the Oxford comma only costs a single extra key-stroke, there is essentially no downside to employing it frequently in one's efforts to tweak the English major types.