for that many years, it is completely understandable.
When I was the YMP, I went through and asked all my unit leaders and assistants how they were doing, and if they needed a reprieve or were good to go with monthly campouts etc still. Our troop does campouts half the year in our Scoutmaster's back yard (he's got like 5-6 acres and a big field in the back with a firepit etc for the kids to use). They still cook just like if they were in the mountains, but the location is very close in town it is not as stressful for the leaders in my opinion.
I'm in the same boat as you; I started serving in scouts 9 years ago as a cubmaster; then 11 yr old scout leader, then scoutmaster, then YMP, now dual-role as committee chair and 11yr-old scoutleader. My oldest boy is turning 8 in 6 months; so I've been doing this for that long not having a child in the scouting program yet.
Yes, it is incredibly time consuming, and difficult to stay positive all the time about. It causes alot of frustration from my wife due to why I am being asked to do all of this when there are so many fathers of kids in the program that aren't involved etc. She has been so supportive, but with 4 young ones at home myself, it makes it hard for her to have me gone every week for scouts, plus on weekends multiple times a month for service projects, campouts, trainings (some trainings are 2-3 days in length including overnighters for adults)etc. Then there is high-adventure and scout camp, which are a week-long trips, where leaders are using vacation from work, not seeing family for a week or more (if they go to both outings; we have multiple leaders that do) - so yes, it can be alot of training and alot of time.
I do believe in the scouting program though and feel it is the best program at the moment to provide the young men with what they NEED. Does that mean every young man MUST be an active scout and do merit badges etc or they won't turn out to be a good young man? - No, but it sure helps and is more than worth the sacrifice for me.