If it were my wife and I wanted a romantic week(end) I'd stay in Cambria or Cayucos, then stay in Pasadena the night before the game.
If you're stuck on Southern California I like the idea of Laguna Beach or San Clemente or even further south in Carlsbad. But if you really just want to chill out with your wife think about the Central Coast - it is so much nicer than LA/OC/SD. You could maybe do southern Big Sur and do some hiking if you like that, or just drive the coast. It's 2H further from Provo but a million times nicer for time with your wife.
If you want Disneyland more power to you. I'm a season pass holder but I stay as far away from that place as possible when I don't have my kids.