I agree. Ejections should happen for actions with clear malicious intent.
Very few of the H2H hits I've seen would be classified as such. Normally, the players are just flying around and occasionally a player makes a mistake or coincidence leads to H2H contact.