I can remove either one of the people and the sentence still makes sense. Similar with, "My wife and I went..." not "My wife and me went..."