If something goes wrong, no amount of money you save could compensate your loss.
We didn't have insurance for our second about 10 years ago. We worked out a payment plan in advance with the hospital, and it wasn't really all that expensive. I think about $2500 altogether.