if the noise is very very very faint, then it's most likely capacitors making that noise, from my experience. If the noise is a bit louder, then ingnore the rest of this post.
do you have a tft screen? if so, it is more likely to be the electrolytic capacitors in the invertor making the noise. Replacing them with tantalum should solve the problem. Yes, I know, not exactly a DIY job.
If you dont have a tft screen then probably it is the mobo/gfx card...same thing...electrolytics vs tantalum.
BTW, the noise I am talking about is very very faint, much easier to hear on notebooks (at 2a.m. in the morning in the bushveld), but depending on how quiet your fans in your desktop are then you may be hearing them also. Just learn to live with it.