I think a lot of it also comes from the fact people view surgery sodas as bad. When confronted with diet sodas, they try to lump it in as the same vice. I've heard lots of arguments that, while technically it has zero calories, your body is tricked into thinking it has calories and treats it the same.
The studies I've seen, like you stated, have a difficult time parsing out the causation vs correlation of negative impacts.