Here is something to consider. If you are 40 right now, you have probably 50 good years left in you.
50 years ago (1971) the average home cost $25,200.
The average car cost $3700.
A gallon of gas cost 0.36
Insurance Premiums? 59.57
We all know Social Security and Medicare are on the verge of bankruptcy. The US is increasingly going more and more in debt. Taxes will go up, cost of living will go up, and the older you get the sicker you become. So costs of healthcare will go up.
Personally my goal is to get as much passive income as I can, but to still maximize all the healthy working years I can. If I had 96k a year in passive income right now, I would still work, invest in businesses, real estate, and the market, and keep working to build that nest egg.