I can deal with people who inherited privilege. And that's coming from somebody who was born into a financially struggling family.
Privilege is not a sin to me. If it was honestly gained originally (a rarity to be sure).
It's when they use said privilege to rig the system to benefit themselves even more and into perpetuity with no further real effort that I get annoyed.
They make the laws that suit them, but minimally constrains them, and then expect everybody they see as beneath them, who are by and large disadvantaged by said laws, to abide by it without complaint.