I remember being in JHB once a few years ago and rinsing my mouth after brushing my teeth. It was as though I stuffed bag of chlorine in my mouth. Was definitely not one of the most pleasant experiences I've had in my life.
I'll say this much though, I filter my water before I drink it. You should break a filter open and see what it looks like after 3 months - it aint perdy.
Sounds wise This might seem a bit neurotic, but I also filter my ice I have a (probably bad) habit of chewing ice after I finish whatever I was drinking, and I'm not fond of the taste of tap-water - the chlorine/metallic taste, specifically. I find it nauseating