regardless of their affiliation with the Church of Jesus Christ of Latter Day Saints. I don't think any BYU fan dispises (the word used in the question) anyone that doesn't stomp on what they love/enjoy.
Sorry to hear of your struggles. Had some myself. Have family that has left the church and religion. I'm sure that there is some 'persecution' or unfair judgements made. It happens when people leave any close-knit group. My sentiment is that you're an adult and are responsible for your own life and decsions. Good luck out there.