My wife and I both use the mirrors this way. I only have to make the same minor adjustments that I would otherwise.
But even if she didn't I could still get them adjusted just fine. Once you've used them that way it's not hard to get them pretty close. It's the first thing I do any time I get into a rental car. If it's an unfamiliar car I usually do a little fine tuning on the road.
I'm amazed at your skepticism here. Just try it! If it sucks, then change back.