Legally, your options are very limited. Try talking to him.
If you can reason with him, maybe you’ll work something out.
If not, be glad you live in a free country and try not to be passive aggressive. You don’t own the street. And it sounds like you’re not being very kind.