Your action says "go ahead of me" but then you are expecting them not to go ahead of you. Seems odd. Are you trying to be courteous or not really?
I for one hate it when people hold open doors for me. Invariably they are like 15 steps ahead of me and now it feels like I'm inconveniencing them because they are standing there waiting for me.