Web sQuad ISP - Feedback Thread #2

anyone else seeing some funkyness?

1744443164390.png

playing games this morning is a bit hard with timeouts happening the whole time, even tried fornite, and packet loss is through the roof

@websquadza , hoping this is a simple "me" issue to solve :D
 
BouncyNinja said:
anyone else seeing some funkyness?

View attachment 1812200

playing games this morning is a bit hard with timeouts happening the whole time, even tried fornite, and packet loss is through the roof

@websquadza , hoping this is a simple "me" issue to solve :D
Click to expand...
Saw some weirdness on our one CPT <> JHB NLD a little while ago. Seems to have normalised again. If it carries on, we'll drop this path.
 
Hi, anyone else noticing load/packet loss on teams ?

1744788425196.png

other sites local & international are fine . just teams.microsoft.com
 
websquadza said:
Looks like some sort of icmp rate limiting there, specifically for the http frontend. Is call quality affected? Calls and media should be served from a variety of other servers.
Click to expand...
Haven't noticed anything yet on actual calls. (I haven't had a call yet today) ; in any case, if teams.microsoft.com is not used when on a call or using teams, should I remove it from my monitoring list ?
 
chrisGolf said:
Haven't noticed anything yet on actual calls. (I haven't had a call yet today) ; in any case, if teams.microsoft.com is not used when on a call or using teams, should I remove it from my monitoring list ?
Click to expand...
chrisGolf said:
does seem to have calmed down ..?
View attachment 1813634
Click to expand...
I see there’s still occasional icmp rate limiting there. Not the best endpoint to keep an eye on as it won’t give you the most accurate reflection of Microsoft services. I’ll see if there are endpoints we can keep an eye on within Microsoft’s network that don’t rate limit icmp. Remember all Microsoft traffic is peering traffic, which means we hand over to Microsoft at the nearest peering exchange. So once you’re within the network, you’re monitoring Microsoft services rather than the actual routing between our networks.
 
Evening @websquadza , sorry to bug , i made my payment this month, got a confirm from bank, got a confirm from payfast, but the site still shows unpaid, trying to log a ticket, but the site not playing with now either , clicking submit on the ticket, and just a spinning circle
 
BouncyNinja said:
Evening @websquadza , sorry to bug , i made my payment this month, got a confirm from bank, got a confirm from payfast, but the site still shows unpaid, trying to log a ticket, but the site not playing with now either , clicking submit on the ticket, and just a spinning circle
Click to expand...
Afternoon, apologies for my late follow up here. It seems a management operation on the portal hogged some resources last night, we've asked our dev team to look into this. I've checked your account and I'm seeing all your invoices marked as paid. Let me know if you have any further issues
 
websquadza said:
Afternoon, apologies for my late follow up here. It seems a management operation on the portal hogged some resources last night, we've asked our dev team to look into this. I've checked your account and I'm seeing all your invoices marked as paid. Let me know if you have any further issues
Click to expand...

Noticed this morning all was back in order , thank you (:
 
Seeing a massive wobbly on NAP JHB currently, affecting a large number of peers. about 30% of direct peering sessions still down. Affecting a large number of NAP peers. NAP is investigating

Update: 12:25 - most peering sessions restored and traffic flowing. Some intermittent losses evident to some peers as they reconvert and restore local routes.
 
Last edited:
websquadza said:
Seeing a massive wobbly on NAP JHB currently, affecting a large number of peers. about 30% of direct peering sessions still down. Affecting a large number of NAP peers. NAP is investigating
Click to expand...

Yup, client called me because multiple branches VPN's went down.

As well as another client their internet died for a while.

National outage?
 
Mzezman said:
Yeah had a wobble from about 12-12:15 but seems to be resolving

View attachment 1821976
Click to expand...
Seems to be resolving itself, seeing a number of peers on the ZANOG channel saying they're still seeing some issues.
Rickster said:
Yup, client called me because multiple branches VPN's went down.

As well as another client their internet died for a while.

National outage?
Click to expand...
Every network in SA (and pretty much south of the equator) peers at NAP JHB, or has an upstream who does, plus this is where all the big cloud vendors hand over traffic, so very bad day when NAP has a wobbly like this.

We're also on INX-ZA's (JINX, DINX, CINX) fabrics, but we need more peers there to make sure that traffic jumps smoothly. Also bear in mind that the standard timeout on BGP sessions is 180s (without BFD), so that means even with multiple fabrics, it can take up to 3 minutes to drop a bad prefix route and install a good one.

NAP / INX are fabrics, where peers set up direct connections (BLP) to one another to exchange routing information, or use the route servers (RS/MLP) to exchange routes with one another. Today's outage resulted in RS1 and 2 going offline simultaneously, and at least for us, multiple BLP peers dropping for almost 10 minutes. It seems there was something on the fabric itself which caused traffic to stop flowing, but the great team at NAP Africa will most certainly do a deep analysis and confirm what happened today.
 
You must log in or register to reply here.
Back
Top
Sign up to the MyBroadband newsletter
X