Please make sure to report any misbehaving ads using the "Report problem with this ad" link, so that I know if what I've done is effective. Thanks!
For those that care about technical details, someone tipped me off to a "sandbox" feature that my ad server has that should (in theory) prevent those kinds of things from happening. It should also prevent redirect ads, where you get redirected to another site or the app store.