Ultimately then your fear is race-based and irrational. Not all white people are the same, we're not all to blame for Apartheid. We didn't all support Apartheid. Heck I was still learning to add when Apartheid ended. I doubt I could even have written the word if asked, let alone understood what it was.
I for example don't distrust black leadership. I just want a president that will do his job effectively. I don't care what colour he/she is. That is largely irrelevant to whether or not he/she can do the job.
If you irrationally fear giving white people control of anything because you think they'll abuse you and hurt you then frankly that sounds racist.
It is not fear, but mistrust. I have heard few experiences with whites people that suggested that some are still entrenched I their old ways and do not see a black person as an equal.