unless you move them around.

Get a bee bee gun. If you don't want to kill them get an air pump and pump it up just enough to sting a little. They will stop coming after a few weeks.