I don't abuse it either.
With my Tesla trunk liner I'd have no issue throwing 2x4s into mine. I throw bags of salt into the trunk all the time. Again I'd want that liner if I were hauling trash or gravel.
As for rattling over gravel roads, that's where the suspension comes in. Comments about the suspension on the Y are true up until the 2023 model, at which point Tesla apparently improved things. Suspension was the main thing I improved on my 3 by adding an after-market solution, so mine's great.
We just bought my wife a car and she wanted another maker's plug in hybrid instead. I wish she'd bought the Y, but it was her call. She does haul stuff all the time, but I'll miss the accelaration and usefulness of the all electric when I have to drive hers.
It's also true you're at risk of depreciation if Tesla continues to lower the price on the new ones, but based on today's already reduced pricing I think buyers of Y's are getting a great deal.