Content of the message itself, sending system’s reputation, SPF match or mismatch, etc.

And sometimes it stops happening because enough people have marked it as ‘not spam’ that the system catches on that messages are valid.