You're definitely not wrong. People religiously doing the zipper merge, when traffic is going at normal speeds,
end up slowing traffic way down. It's because the person that is in the lane already ends up slowing down while the putz in the lane that ends takes their time to move over.
Zipper merge is only effective when traffic is beginning to back up or is already backed up.