You either are or you aren't. Once you are no longer passing a slower car, you should safely move to the right and let him pass.
That said, I'm not a fan of flashing lights at people, either, unless I'm driving my pregnant wife to the hospital. Both drivers in this situation are being dumb.