The discussion of how many teams from a conference deserve to get in NEVER is a point of discussion among the committee as per their rules and procedures. All they do is vote on who they think are the best remaining available teams and the leading vote getters get slotted in to the tournament 3 or 4 at a time (it's slightly more complex than that but that is basically what they do). Conference affiliation rarely comes up outside of placing the teams in the bracket.