SAIX Internation (ADSL only) Down.

Karnaugh

Banned
Joined
Jul 23, 2003
Messages
1,575
Reaction score
4
Location
Durban, South Africa
Hi

We've been on the phone for much of today since our own scheduled system upgrade has been completely snarfed by a breakage of what Telkom claims is the cable from Hong Kong to India. Fun to loose a few thousand rand an hour - thanks Telkom.

Evidently they are not interested in routing ADSL traffic to Ashburn via SAT-3 for some reason, infact none of their reasoning makes sense, because its all just haywire at the moment and there is packet loss left right and center.

Will keep this posted if anything at all comes of it.
 
Sorry for x-posting but I just posted the following on this thread. Your post makes me thing that Telkom may be having problems all over the place.

----------

I just called Telkom's ADSL technical support line (0800 375 375) and I was told that the line connecting Rosebank to NY is down and that they are working on it. The people who connect through this line (e.g. users in Pretoria and Joburg) will experience limited or no international connectivity.
 
SAIX Network Notice Update
----------------------------------------------------------------------

Reference ID : STT000000004231
Failure Type : Network Failure
Problem Description : New York to Rosebank-Link down
Impact : Customers will experience intermittent connectivity to
international sites
Time Down : 20 Aug, 2005 at 07:00:00 (SAT)
Time Up : None
Sites : New York
Services Affected : International
Update Description : Lands slide overseas has impacted the restoration of
our link. Overseas technicians are waiting for permission for access from
the Government as this is a disaster area.
 
Jeezuz yeah - is it ever fixed now - sudden burst of speed on a torrent that's been crawling along. From 0-2k to 25k.
 
UUNET seems to be up I am using my NukeCap VPN connection without any problems...
 
bb_matt said:
Jeezuz yeah - is it ever fixed now - sudden burst of speed on a torrent that's been crawling along. From 0-2k to 25k.

yeah your torrents sure are helping us who are trying to do real work while the lines are saturated and dying.
 
SAIX Network Notice Update
----------------------------------------------------------------------

Reference ID : STT000000004231
Failure Type : Network Failure
Problem Description : New York to Rosebank-Link down
Impact : Customers will experience intermittent connectivity to international sites
Time Down : 20 Aug, 2005 at 07:00:00 (SAT)
Time Up : None
Sites : New York
Services Affected : International
Update Description : Overseas technicians have indicated that they will have access to the site after 15 hours after which they will investigate the damage and also the restoration of this link.Major impact was to our adsl service and we have rerouted the majority of our adsl traffic to minimise the impact to our adsl service.
 
Karnaugh said:
yeah your torrents sure are helping us who are trying to do real work while the lines are saturated and dying.

Yow, someone got out of bed on the wrong side this morning - and to think, I considered you a person of great integrity and merit. Guess I was wrong. Mental note made. How the f@ck do you know what I'm downloading and what the f@ck I'm doing - your not the only one who works for a living, china.
 
definitely not fixed on my side. still getting pings/tracerts of over 1000ms internationally.
 
bb_matt said:
Yow, someone got out of bed on the wrong side this morning - and to think, I considered you a person of great integrity and merit. Guess I was wrong. Mental note made. How the f@ck do you know what I'm downloading and what the f@ck I'm doing - your not the only one who works for a living, china.

:P

Thanks "china" I've been at work since 7am with a hangover till now twideling my thumbs and listening to people screaming at SAIX over the phone (and listening to them scream back) because it took them about 12 hours to actualy perform corrective rerouting so we could do what we planned to do.
 
I dont understand this "broken cable" crap. Its the same bit of fibre that IS and UUnet uses but those have been hundreds all day.

SAIX have very much not been forthcoming on information here - I can respect that they play broken telephone with various techies along the way but its no excuse for the rudeness my colegues encountered when trying to get to the bottom of it.
 
The break was on the US side of the link between the landing point and the point of presence in the US. It was due to mother nature and the US gov't was restricting access to the area due to safety and security concerns. UUNET actually breaks out of Portugal and routes via Miami on the Columbus cable I think.. Depending on the peering partner in London, the route to the US is different and could be several hundred miles or more apart. Since the SAT3 in theory ends in Portugal, any thought that it is the same cable that IS and others use is incorrect. Do you think IS and UUNET would want to piggy back on Telkom any further than they had to?

They could have found an alternate route earlier though..

They should also not have been rude to anyone on the phone.. But you can imagine by most of the complaining people out there (we see them here all the time) that they were tired (and possibly hungover as well) of all the rude customers calling..
 
Last edited:
Karnaugh
Take a look at http://www.safe-sat3.co.za/ you'll see the cable doesnt go all the way to the USA. Probable another cable system was effected by the failure.

I suspect that this was also not on a link going via SAT3 cause SAT3 goes via the west coast of africa while SAFE goes directly to the east. Check the link below you'll see SAIX has some links via SAFE. My guess is that the pink link (on the saix topology diagram) failed since that goes directly from rosebank to new york
http://www.saix.net/diagrams/ipnet_jul05.pdf
 
I really know squat about routing etc, but if the break was on the US mainland why were my pings to www.bbc.co.uk equally as poor as any ping to a us server? I would guess to get to the UK we would go SA-Portugal on SAT3 and then on to London, or is all saix international bandwidth routed via the states?
 
Daveogg said:
I really know squat about routing etc, but if the break was on the US mainland why were my pings to www.bbc.co.uk equally as poor as any ping to a us server? I would guess to get to the UK we would go SA-Portugal on SAT3 and then on to London, or is all saix international bandwidth routed via the states?

According to neo trace:
NeoTrace Trace Version 3.25 Results
Target: www.bbc.co.uk
Date: 2005/08/20 (Saturday), 08:46:56 PM
Nodes: 9


Node Data
Node Net Reg IP Address Location Node Name
1 - - 192.xxx.xxx.xxx PRETORIA xxx
2 1 - 155.239.169.254 CAPE TOWN
3 2 - 196.43.14.241 CAPE TOWN tpr-er-1-fe-0-0-0-7.telkom-ipnet.co.za
4 2 - 196.43.9.50 CAPE TOWN lon-ip-dir-telecity-pos-6-0.telkom-ipnet.co.za
5 3 1 63.218.52.17 Southwark pos2-1.cr02.ldn01.pccwbtn.net
6 3 1 63.218.12.54 Southwark ge2-4.br02.ldn01.pccwbtn.net
7 4 2 195.66.224.103 Kingston upon Tha bbc-gw0-linx.prt0.thdoe.bbc.co.uk
8 5 - 212.58.238.129 Reigate and Banst
9 6 2 212.58.224.88 Kingston upon Tha www51.thdo.bbc.co.uk


Packet Data
Node High Low Avg Tot Lost
1 0 0 0 1 0
2 57 57 57 1 0
3 67 67 67 1 0
4 312 312 312 1 0
5 313 313 313 2 1
6 685 685 685 1 0
7 563 563 563 1 0
8 363 363 363 2 1
9 361 361 361 1 0


Network Data
Network id#: 1

OrgName: African Network Information Center
OrgID: AFRINIC
Address: CSIR/icomtek
Address: 43A
Address: PO Box 395
City: Pretoria
StateProv: Gauteng
PostalCode: 0001
Country: ZA

Network id#: 2

OrgName: African Network Information Center
OrgID: AFRINIC
Address: CSIR/icomtek
Address: 43A
Address: PO Box 395
City: Pretoria
StateProv: Gauteng
PostalCode: 0001
Country: ZA

Network id#: 3

OrgName: Beyond The Network America, Inc.
OrgID: BNA-42
Address: Reston Executive Center
Address: 12100 Sunset Hills Road, Suite 300
City: Reston
StateProv: VA
PostalCode: 20190
Country: US

Network id#: 4
London Internet Exchange
2nd Floor
92-94 Tooley Street
London SE1 2TH
ENGLAND

Network id#: 5
British Broadcasting Corporation
Kingswood Warren
Tadworth
Surrey
KT20 6NP
England, GB

Network id#: 6
BBC Internet Services RIPE Role Contact
Maiden House, Maidenhead, Berkshire, SL6 4UB.
 
Hi

I'm fully aware of the SAT3's structure, however connections were getting packet loss all over the place, even when routed via Amsterdam. There are also lots of peers out of London, which should have automaticly sorted them self out when the US point broke down - yet this took from 7:00 till around 17:00.

Yeah, I'm sure Telkoms day was as bad as mine if not worse but they sounded like they had zero clue what was going on. An amazing network as they boast shouldnt fall over with a single dead link.

Anyway, the day is over.
 
Defender said:
I suspect that this was also not on a link going via SAT3 cause SAT3 goes via the west coast of africa while SAFE goes directly to the east. Check the link below you'll see SAIX has some links via SAFE. My guess is that the pink link (on the saix topology diagram) failed since that goes directly from rosebank to new york
http://www.saix.net/diagrams/ipnet_jul05.pdf

Yeah? So what was wrong with the rest of those "links". SAIX claimed they could ping our servers fine from their NOC, yet ADSL couldnt... WTF-HAI2U on that one...
 
Top
Sign up to the MyBroadband newsletter
X