What do you have to worry about? how does my choice to not vaccinate my child against the chickenpox hurt your vaccinated child. If the vaccine works it doesn't.
There is a small subset of people with allergies to vaccine ingredients who can't get those specific ones. There are also kids who aren't to that point on the schedule yet. Those are the populations you're hurting by not vaccinating.