I am not complaining or making excuses for anything, because obviously the game hasn't happened yet. But when I was a player, I was very visual. As a QB I often made read purely off of color differences. Or stepped up because I caught something in my peripheral vision. In fact I often struggled in practice when our D only had the red caps on, because it took me longer to see the play develop and make a quick read with out the contrast. It didn't matter to me as much on defense. But as a qb who is trying to see the whole field, predict where people are headed, and detect if someone is coming at your sides. blending in would definitely makes things harder.
Not saying all Qbs rely on the visual contrast as much as I did. But it is definitely a factor.