All drones over .55lb are registered with the FAA. If you shoot it down, you are in violation of 18 USC 32. Even though it is a drone, it is considered an aircraft according to the code.
I don't know of a drone that can record sound (all you'd hear is buzzing). I doubt the drone operator heard anyone yelling at it. I'm sure they saw the gesturing, though.
In this type of situation, it is probably best to just find the guy and beat the snot out of him. It carries less penalties than destroying an aircraft. 🙂 If it happens to crash as it takes evasive action, you can track it back to the owner with the registration #. Thats how we busted a ring of train robbers. They crashed their drone in our train yard. I looked at the pictures, and it was all rail car serial #s. We contacted the FAA and traced it back to the owner. Police watched him for a while and caught him in the act.
Seriously, though. It's drone operators like that guy who give the rest of us a bad name.
-Part 107 Certified Drone Operator