Building character. I could reference thousands of church talks and plenty of secular advice on the matter that would state the same.
Doing hard things is what stretches and helps people to grow.
I never said that remembering is looking back with fondness (although it does happen for some) but you do remember things when they are difficult and that is the point.
Incidentally, I couldn't care less if this is the reason scouting numbers are dwindling. Society is getting too soft and it is my belief that it is a direct result of taking away hard things. Just my opinion.