Telkom ADSL downtime explained

“Unfortunately a problem occurred immediately after commencing the planned maintenance and this resulted in all live ADSL sessions being ‘reset’; commencing approximately 15h49.”

Can't be. Mine died, according to my DSL logs, at 15:15:57. I had emailed support (not knowing the cause of the problem) at 15:40.

Planned maintenance gone wrong.... something only Telkom can get right :D
 
Can't be. Mine died, according to my DSL logs, at 15:15:57. I had emailed support (not knowing the cause of the problem) at 15:40.

Planned maintenance gone wrong.... something only Telkom can get right :D

Not actually - planned maintenance in the IT world is one of the most vulnerable times. Unfortunately, the complexity of our IT systems means that anytime you change anything you face the reality of an unforeseeable breakdown.

Reality of IT systems - it ain't pretty behind the scenes.
 
I guess when you run a network that spans the length of an entire country, troubleshooting things tend to get a little complicated.
 
Things like this happen and given the size and complexity of their network I'm impressed it came up as quickly as it did.
 
Guess they have a problem with their clocks as well as it went down at 15:16 in my area of PE:

Telkom Outage.png

As a matter of interest whilst 10210 faults died the SMS fault report system was running. Scary actually as I now have a fault number and, knowing Telkom, I can expect some disconnects before someone phones to clear the fault.
 
Not actually - planned maintenance in the IT world is one of the most vulnerable times. Unfortunately, the complexity of our IT systems means that anytime you change anything you face the reality of an unforeseeable breakdown.

Reality of IT systems - it ain't pretty behind the scenes.

Write it up as a bit of sarcasm from my side :p
 
Why did they not do the planned maintenance after business hours or during the weekend?
 
Why did they not do the planned maintenance after business hours or during the weekend?
Did you not read the article? It is considered non-invasive maintenance that doesn't affect customers and happens on a regular basis, ie. it can be done during the day when you have most of your staff on hand.

Some people, expect unicorns for nothing.
 
Credit where credit is due. In less than 24hrs Telkom has issued an official explanation. As dodgy as Telkom's reputation is, I am impressed. Compare this to RIM / BLACKBERRY outages where head in sand tactics reign supreme!
 
Im pretty sure the part that isnt mentioned is that there was some human fault in all of it. Someone issuing a disconnect by mistake or something along those lines. It happens all the time in IT and gets blamed on "something went wrong with the system"
Still it didnt take that long for the radius to pick up and start getting people back online. The load must have been massive though, I cant recall any time where this has happened on such a large scale in the past.
 
Authentication servers must've been GLOWING!! Imagine how long the outage would've been if they had fallen over from the load....
 
Im pretty sure the part that isnt mentioned is that there was some human fault in all of it. Someone issuing a disconnect by mistake or something along those lines. It happens all the time in IT and gets blamed on "something went wrong with the system"
Still it didnt take that long for the radius to pick up and start getting people back online. The load must have been massive though, I cant recall any time where this has happened on such a large scale in the past.

Yup - been my experience as well. Human factor a lot of the time.
 
As a matter of interest whilst 10210 faults died the SMS fault report system was running. Scary actually as I now have a fault number and, knowing Telkom, I can expect some disconnects before someone phones to clear the fault.

A freezing morning in PE and Telkom just pitched to repair my "fault" (I got an SMS saying it was in-hand at 08:06) - hats off to the PE techies, surprised they didn't phone first though :)
 
Top
Sign up to the MyBroadband newsletter
X