It's a game and it isn't life or death. Once upon several years ago, I walked away from playing basketball because I didn't like who I became when playing. I tried to be cool-headed and wanted to be, but my competitive drive resulted in outbursts unbecoming of the person I wanted to consistently be. While I wasn't violent, I said some things to good friends I regretted.
I looked at it this way: I guess it's time to let go of a favorite sin to be a better me...
I believe it's a healthy, grown-up decision to walk away from something that constantly results in you acting like a child. I've been there. I hope you can find peace too.