MTN Business Data Centre outage

[jannievanzyl]

The Gallo Manor Datacentre in Joburg experienced a utility power outage at approximately 15h45 today. Shortly after this the standby power generators experienced a mechanical problem which resulted in power being lost to JNB DC2. Power was restored around 16h30 and the servers are being booted up in sequence.

We are aware that some CPT clients may have been affected during this time as MTN Business' national network was also impacted by the outage. We sincerely apologise for the inconvenience caused. UPDATE: At approximately 18h00 MTN Business again lost power to JHB DC2. It was restored at 18h15. Servers are being booted up in sequence.

Yup, we were down again.

 

[BBSA]

How often must this happen before companies move their business away from MTN data centers?

 

[jannievanzyl]

How often must this happen before companies is move their business away from MTN data centers?

We were two days away from turning on our own data centre.

 

[czc]

We were two days away from turning on our own data centre.

This must have convinced you that it was the right decision.

 

[Sting]

We were two days away from turning on our own data centre.

Switch to Cybernest??

The enemy of my enemy is my friend...

 

[gregmcc]

MTN...up and down....up and down....worse than a prawn movie!

 

[bekdik]

MTN...up and down....up and down....worse than a prawn movie!

Nope, it's MTN who're

 

[BBSA]

We were two days away from turning on our own data centre.

Damn Murphy

Hopefully a certain technology site will also see the light

 

[packetloss]

MTN has got a thing for power in December. Last year the also had a power problem when lightning caused an outage at Gallo Manor on he 24th of December. there goes my uptime.....

 

[native]

Cost cutting?

 

[jannievanzyl]

This must have convinced you that it was the right decision.

Indeed. Intially I was not happy about the couple of bar this took, but clearly it's needed.

 

[h0ll0w]

Could the MTN and IS outages have caused severe degradation of service on a SAIX gold diginet line ?

Doesn't really make sense to me, but then again I dont know much about stuff like route servers :S

 

[Sting]

Could the MTN and IS outages have caused severe degradation of service on a SAIX gold diginet line ?

Doesn't really make sense to me, but then again I dont know much about stuff like route servers :S

Seriously doubt it.

 

[rpm]

Could the MTN and IS outages have caused severe degradation of service on a SAIX gold diginet line ? Doesn't really make sense to me, but then again I dont know much about stuff like route servers :S

The IS DC downtime was caused by fibre link problems, but I don't think degredation is at play here. MTN Business' Gallo Manor DC downtime is purely due to electricity problems (Eskom problems and then Generator failure).

 

[marine1]

Very disturbing that we rely so heavily on one provider.

 

[KERU]

How about hiring a greybeard who's actually designed a working system before, instead of some wet behind the ears BEE appointment without a clue.

Totally uncalled for. Mistakes are made by people of all colour.

 

[LazyLion]

haha... I can't wait for something like this to happen during the world cup final!

 

[Sting]

haha... I can't wait for something like this to happen during the world cup final!

Believe it or not, but the primary source of power for the SWC transmissions will be off generators with Eskom/Metro power as the backup!!!!

 

[semiautomatix]

yea it was a combination of the IS outage and the MTN outage that caused it to appear offline for longer. Especially if you're on IS bandwidth (like Afrihost for example)

IS uncapped

But I noticed iol.co.za was back up but still no MyBB... A perfect storm, I guess.

 

[cavedog]

What is the chances that 2 major DC's will fail just minutes apart and leave SA web in utter darkness!