Web sQuad ISP - Feedback Thread #2

[BouncyNinja]

Update: one of our JHB Edge routers decided to swallow some traffic. We took the box offline, found the issue and restored the box. Been monitoring closely for the past hour and traffic levels have restored. Please let us know if you are experiencing any issues

Thanks for the update

 

[rvanwyk]

I’m curious. How does traffic look with the fight, or does it not even show up on the graphs?

 

[BouncyNinja]

I’m curious. How does traffic look with the fight, or does it not even show up on the graphs?

netflix shat itself, cant watch it, everything else loads, but try open the fight, and it either hangs or give an error message

im watching some sketchy stream on x now

 

[BouncyNinja]

 

[rvanwyk]

Mine’s fine. Glitches every minute or so.

 

[cavedog]

I’m curious. How does traffic look with the fight, or does it not even show up on the graphs?

Traffic was pretty high.

 

[websquadza]

I’m curious. How does traffic look with the fight, or does it not even show up on the graphs?

Traffic on one of our NAP JHB ports as well as our CINX port (where we pick up CPT Netflix caches) was at about yesterday's evening peak, around 6:40 this morning. Durban cache traffic via DINX was relatively flat. Our transit interfaces also picked up a little later as Netflix shifted traffic around to work around their glitches.

 

[websquadza]

View attachment 1774204

Mine’s fine. Glitches every minute or so.

I definitely think Netflix have the CDN capacity to handle major live streams like this, it just seems they need to optimise some internal stuff, like getting source information to the edge caches reliably and consistently. Will be interesting to see if they do a deep dive on what happened and how they plan to fix it, like Cloudflare does.

 

[tm458]

Hey @websquadza , do you have any idea as to what is causing the incident/outage in my area?

Ticket ID: 085193

 

[websquadza]

Hey @websquadza , do you have any idea as to what is causing the incident/outage in my area?

Ticket ID: 085193

Afternoon, just checked Vuma's portal now. the latest update is this:

The Reeds Ext 9 links down, techs have been dispatched to investigate

No concrete feedback from Vuma as yet.

 

[tm458]

Afternoon, just checked Vuma's portal now. the latest update is this:


No concrete feedback from Vuma as yet.

The reeds?
I don't understand how links down in Centurion would be affecting a complex in Midrand.

Unless the PoP that we are connected to is linked to theirs or something?

 

[websquadza]

The reeds?
I don't understand how links down in Centurion would be affecting a complex in Midrand.

Unless the PoP that we are connected to is linked to theirs or something?

Checking on this to see if it's a linked OLT. Vuma's system links circuit IDs to their regional OLT/backhauls etc. But let me make 100% sure for you

 

[websquadza]

The reeds?
I don't understand how links down in Centurion would be affecting a complex in Midrand.

Unless the PoP that we are connected to is linked to theirs or something?

Checking on this to see if it's a linked OLT. Vuma's system links circuit IDs to their regional OLT/backhauls etc. But let me make 100% sure for you

By the looks of it, you're running off the same OLT/stack. With GPON networks, it's harder to sometimes pinpoint the exact locations of all the homes affected, especially if there are secondary splits in the field. These areas are all likely fed by OLTs at the DFA pop at Xneelo Samrand which is the closest POP, which is pretty much in the middle between your address and The Reeds. Rather the NOC jumps on the first few reported links and names that area, however some surrounding areas may only be updated later. Your circuit is correctly tied to the NWI in this case.

 

[tm458]

By the looks of it, you're running off the same OLT/stack. With GPON networks, it's harder to sometimes pinpoint the exact locations of all the homes affected, especially if there are secondary splits in the field. These areas are all likely fed by OLTs at the DFA pop at Xneelo Samrand which is the closest POP, which is pretty much in the middle between your address and The Reeds. Rather the NOC jumps on the first few reported links and names that area, however some surrounding areas may only be updated later. Your circuit is correctly tied to the NWI in this case.

I see, thank you very much for the clarification.

 

[PaulGherkin]

By the looks of it, you're running off the same OLT/stack. With GPON networks, it's harder to sometimes pinpoint the exact locations of all the homes affected, especially if there are secondary splits in the field. These areas are all likely fed by OLTs at the DFA pop at Xneelo Samrand which is the closest POP, which is pretty much in the middle between your address and The Reeds. Rather the NOC jumps on the first few reported links and names that area, however some surrounding areas may only be updated later. Your circuit is correctly tied to the NWI in this case.

You see people, that's how it's done! Transparency and honesty. You won't get it from any other ISP

 

[tm458]

You see people, that's how it's done! Transparency and honesty. You won't get it from any other ISP

Indeed, never been more happy to throw my money at a company.

 

[tm458]

By the looks of it, you're running off the same OLT/stack. With GPON networks, it's harder to sometimes pinpoint the exact locations of all the homes affected, especially if there are secondary splits in the field. These areas are all likely fed by OLTs at the DFA pop at Xneelo Samrand which is the closest POP, which is pretty much in the middle between your address and The Reeds. Rather the NOC jumps on the first few reported links and names that area, however some surrounding areas may only be updated later. Your circuit is correctly tied to the NWI in this case.

Any update on this?
Are they still Investigating?

 

[websquadza]

Any update on this?
Are they still Investigating?

Thanks for your patience here

Latest update: Area outage. Cause of damage: Excavations 3rd party responsible: Unknown 3rd party
Civil scope of work: floating of new cabel and splice at both hh's ETA for Civil: 40min.

I’d say between 3-4 hours depending on the progress of the civils and on the number of splices required once the fibre is floated.

 

[tm458]

Thanks for your patience here

Latest update: Area outage. Cause of damage: Excavations 3rd party responsible: Unknown 3rd party
Civil scope of work: floating of new cabel and splice at both hh's ETA for Civil: 40min.

I’d say between 3-4 hours depending on the progress of the civils and on the number of splices required once the fibre is floated.

Best ISP ever, thanks for the detailed updates.

 

[PaulGherkin]

Thanks for your patience here

Latest update: Area outage. Cause of damage: Excavations 3rd party responsible: Unknown 3rd party
Civil scope of work: floating of new cabel and splice at both hh's ETA for Civil: 40min.

I’d say between 3-4 hours depending on the progress of the civils and on the number of splices required once the fibre is floated.

Try and get an answer like that out of Vox Telecom (and several other ISPs... not gonna mention names...)