If he has cars on his right, and he is moving faster than they are, he is not impeding the flow of traffic -- it doesn't matter if he has a car in front of him or not. Your desire to go faster does not require him to speed up to the rate you desire to travel -- it merely requires him to move over to the lane to the right when it is safe to do so.