So it can be done...but we only stayed in once place and then took night trains out of Switzerland to elsewhere in Europe.
Driving in Europe is fun and I think I'd do it in your situation.
Plus as a bonus you can pretend like you're in the Bourne Identity driving away from Zurich.
Or James Bond driving towards Auric Goldfinger's plant.