Whether it pales in significance alongside the oppression of millions is a matter of opinion I suppose. I'm sure if you'd asked the people that lived under that sort of oppression whether they'd prefer their freedom over infrastructure it is hardly beyond the realm of possibility that they would choose their freedom. I think I might've done.
Agreed, no disputing that.
However, history and facts have shown us that colonialism has brought significant advancements to colonies. If I sitting here now, was to think about all the Boer families who died in concentration camps fighting the English, I cherish their memory. But I'm glad the English did come here, else we'd probably still be living in houses with cow dung floors and riding on horse draw carriages.
Nothing wrong with remembering what happened and being grateful for what it has brought us. People suffered, people were enslaved, people died. That is all in the past, we're here now, reaping the benefits of those who sacrificed so much. One can't just focus on the positive or the negative. In context we're better off now.