You need to play hostess, yet you want to watch the game.
My advice is for you to play hostess this once, but let hubby know in no uncertain terms that the next time he pulls that trick, HE'S going to be the one entertaining the non-football fans, not you. YOU'RE going to be the one enjoying the game.
The worst, the absolute worst thing you can do is just steam about it and not let him know why you're steamed. Don't assume he'll figure it out on his own. Chances are he won't. Men and women are just wired differently that way.