Forget the negative connotation of racism which is what you probably disagree with and I'm okay with that stance. As hard as it is for many to understand in modern society, it is nonetheless possible that the ban was not motivated by hatred of blacks (we frankly don't know the reason).
But (and this is important) the ban was definitionally racist.