Okay, I'll agree with you that the emphasized phrase does not mean
Bronco was blaming the loss on fans leaving early. However, Bronco was clearly chastising fans for leaving early, in my opinion. There is simply no other reason for him to bring that up and make an issue of it. None.