Similarly, during apartheid days, you didn't see 99% of whites protesting against the racist policies of the then government, at every opportunity.... 
i dont think the problem is really the fact that say 1% are extremists (and 1% of 1.5 billion is still a lot) rather the deafening silence of the remaining 99% to the actions of the 1%.