If there is a line of 5 cars, all only a few car-lengths apart, and I'm going 10 miles over the flow of traffic of the middle lane, I am going to pass all 5 cars, even if it's technically possible to get into the middle lane if I squeeze in between two of those cars. I shouldn't have to get over, slow down 10 MPH, wait for someone to pass, and then get back over to finish passing the last 2 cars.
Of course if there is a 100 yard gap, I'm going to get over. In that situation, it's more than possible to get over, let someone pass, then get back in the passing lane when you come up to pass the next car that was 100 yards ahead.
But the "I NEED TO PASS YOU RIGHT NOW" crowd is almost (key word - almost) as ridiculous as the left lane speed limit enforcers.