Yes, and you remind me that I forgot to link to my article on the role of recognition norms in injustice: https://medium.com/p/b67447b200ea. Recognition norms supply the labels and stereotypes that justify personal bigotries and structural racism.
The reason I am making the distinction between bigotry and racism is that hierarchical structures of power do indeed restrict the actions of people, and it restricts to a greater degree the actions of subaltern people. That a couple of Black people can at times commit acts of interpersonal violence does not mean they have significant social power, as proven by what disparities between how the legal system treats Black-on-white and white-on-Black violence.