I do not think that would happen only because of skin color. I believe it happens to all of us who carry because of the indoctrination by the anti-gun crowd from a young age. Several of my inlaws would probably call the police and report me if I open carried in their presence.
The misunderstanding and ignorance of antis is a part of their nature and they have an intense fear that a gun has a mind of its own and can discharge itself at will. This is all that is required in their view.
I agree with you about keeping a low profile to avoid unnecessary confrontations. That has been my way of life for many many years because I have learned early in life that the satisfaction of being Hi Profile has not been worth the aftermath misery that always accompanies it.