If I have the legal right to pass in the left lane, and I am in fact passing someone in the next lane to the right, I'm not under any obligation to stop passing just so someone behind me can pass at a faster speed. When I'm done passing, I'll get over.