they weren't flying a computer- we put three guys at the top of a 36 story building full of 6 million pounds of fuel and lit it on fire. That's gonna move those guys really fast and really far. the hard math wasn't getting them to the moon, it was getting them back home.
BTW, you should go watch the movie Hidden Figures. great job of presenting the brain power behind early NASA.