Most fan bases will ride the refs pretty consistently.
I don't mind. Anyone who visits another stadium and gets bugged by booing fans is too sensitive. As long as it stops at that and not heckling players, insulting other fans, etc, Booing is pretty harmless.
I always laugh at the fans in my general area who feel compelled to remind me that when I boo a ref, that the ref can't hear me.