The groups. If the uber wealthy can lock it and prevent people from ever entering that group that is the ultimate problem. We aren't there but you can see hints of what it does to a society when you think of the old English elite etc.