the visitor brings their color jerseys. Home wears their color jerseys, visitors wear their whites. Shoot, as long as they weren't the same color, you could both wear your darks.
I'm actually a bit surprised pro sports haven't gone this route already. Wouldn't be much more logistically difficult, and I bet it would sell even more jerseys.