Even if you can accurately overcome this bias by being as logical and scientific about the real risk, here are a couple of things you may not be able to avoid:
1. If someone close to you, like your spouse, can't overcome the fear and the recency bias, then you might have a hard time enjoying yourself.
2. Other people around you who you don't know may also be over-indexing on this issue (commenting, obsessively discussing, etc.), which could similarly affect your ability to relax and enjoy yourself.