The problem appears to be that for a lot of people the mere presence of a black person leads them to conclude that a place is not safe!!
This is true, but is unavoidable. Generalising:
If I am walking with my family, I will be tense if I passed a gang of black street youths – they may all be members of the church choir and be talking about their next good deed. Yet, if I passed a gang of white street youths - they may all have prison convictions and be talking about their next robbery, I would feel less tense. Just the way things are in SA.