Seems to me you would want to include a team in your group if you think you can beat them, and have the benefit of not actually including them in your group.

What is the downside to the SEC of calling BYU a P5 opponent?

Seems to me we are a dream opponent for SEC schools - a team with a solid national brand that is very beatable (at least in their minds).