If there is contact away from the ball it is usually the responsibility of the other two refs.
However, I do agree with you about the need for a fast shot clock. And I was kidding with you about church ball because of all the soft zone defense with zero ball pressure you find in church ball.