Even under the basket, if your arms aren't straight up, they will call a foul if contact is made, regardless of who is initiating contact.