I don't think they care enough about the 4th SEC team to pass on an 11-1 BYU
By the time they start considering 3 loss teams they are looking at resumes with pretty big flaws. Blowout losses, bad losses, etc. are on everyone's resume. So it'd be very difficult to pass on an 11-1 team with a decent schedule in this scenario.