I grew up shooting rifles and shotguns. Don't think I fired a handgun until I was in my 30s. Despite owning and using long-guns my whole life (but I would say I am not an enthusiast), handguns struck me as "squirrly" and felt dangerous.
I'm sure with some caution and practice, I would feel different about handguns.