It doesn't take away from veterans to remember other loved ones--it is not a zero sum game. Remembering our deceased loved ones is always a good thing, even if we celebrate a grandmother who was never in the military. Remembering is a spiritual thing. It humbles us and brings reverence.
This doesn't take away from those who gave their lives, or put them on the line for us, to protect our freedoms. We are especially humbled by them.
We also have Veteran's Day in the Fall. We should take every opportunity to honor those who died in the military.
I just don't think it is a problem to reflect on loved ones who have passed.