Web Squad ISP

[websquadza]

Twitch buffering constantly, nearly unwatchable tonight. Giving up and going to bed.

Local stream or foreign? Can you PM me a link perhaps? Want to try see what the origin is. seeing some local streams via the Optinet Akamai cache- and want to see if the issue is here or in the EU.

 

[CrypticZA]

Local stream or foreign? Can you PM me a link perhaps? Want to try see what the origin is. seeing some local streams via the Optinet Akamai cache- and want to see if the issue is here or in the EU.

Just an fyi in case you never knew but Twitch does a load balancing thing and we as South African's often have to pull streams from NA West/Hong Kong or Sao Paulo

 

[websquadza]

Just an fyi in case you never knew but Twitch does a load balancing thing and we as South African's often have to pull streams from NA West/Hong Kong or Sao Paulo

Thanks for this, nice to know. Noticing some oddness with their origins at the moment and this explains a lot. Add to that some local streams running off some archaic local CDN sources.

 

[CrypticZA]

Thanks for this, nice to know. Noticing some oddness with their origins at the moment and this explains a lot. Add to that some local streams running off some archaic local CDN sources.

I am on Cool Ideas and buffering on Twitch too now, not bad but every now and then but my 50/50 is running perfect other than Twitch so maybe something up their side, trace just goes to UK and then a nice solid red line on pingplotter

 

[websquadza]

I am on Cool Ideas and buffering on Twitch too now, not bad but every now and then but my 50/50 is running perfect other than Twitch so maybe something up their side, trace just goes to UK and then a nice solid red line on pingplotter

View attachment 1275062

They made some changes in the past two weeks- At one point stopped advertising origins in the UK. So I imagine there are changes happening in the background. Have you checked resource monitor for a url for the origin server on this particular stream?

 

[CrypticZA]

They made some changes in the past two weeks- At one point stopped advertising origins in the UK. So I imagine there are changes happening in the background. Have you checked resource monitor for a url for the origin server on this particular stream?

Yea i got video-edge-c68434.cdg02.justin.tv (52.223.195.11) but a trace to it doesn't show much other than traffic being handed off in UK. I have tested multiple streams, small and big and they all pointing towards similar IP's.

 

[Jason-ZA]

Yea i got video-edge-c68434.cdg02.justin.tv (52.223.195.11) but a trace to it doesn't show much other than traffic being handed off in UK. I have tested multiple streams, small and big and they all pointing towards similar IP's.

Thats served from France, on CISP I have noticed that ALL my streams are pulled from France via their France-IX peering, it used to be served from LHR (London/LINX) until a couple of months ago.

You can see more if you do a TCP based traceroute on port 443.

 1  firewall.home (10.0.1.1)  0.323 ms  0.342 ms  0.385 ms
 2  154.0.0.246 (154.0.0.246)  11.757 ms  11.788 ms  11.764 ms
 3  100.98.0.2 (100.98.0.2)  11.995 ms  11.905 ms  11.802 ms
 4  100.99.0.126 (100.99.0.126)  151.671 ms  151.487 ms  151.471 ms
 5  100.98.1.98 (100.98.1.98)  151.459 ms  151.447 ms  151.412 ms
 6  justintv2.par.franceix.net (37.49.237.26)  157.940 ms  157.329 ms  157.334 ms
 7  10.30.66.1 (10.30.66.1)  157.228 ms 10.30.66.33 (10.30.66.33)  156.891 ms  156.858 ms
 8  10.30.65.194 (10.30.65.194)  157.864 ms 10.30.65.166 (10.30.65.166)  159.724 ms 10.30.65.162 (10.30.65.162)  159.780 ms
 9  10.30.65.9 (10.30.65.9)  159.670 ms 10.255.10.173 (10.255.10.173)  158.513 ms 10.30.65.6 (10.30.65.6)  158.392 ms
10  10.255.10.181 (10.255.10.181)  223.448 ms 10.26.36.134 (10.26.36.134)  157.902 ms 10.255.10.173 (10.255.10.173)  158.382 ms
11  video-edge-c68434.cdg02.justin.tv (52.223.195.11) <syn,ack>  158.056 ms  158.354 ms 10.26.36.138 (10.26.36.138)  156.642 ms

 

[Senshi]

My internet just dropped for no apparent reason, was in the middle of a teams call and just dropped.

Anyone else experience the same? timestamp: 10:25AM 23 March 2022
Vuma Areal, Roodepoort

 

[websquadza]

My internet just dropped for no apparent reason, was in the middle of a teams call and just dropped.

Anyone else experience the same? timestamp: 10:25AM 23 March 2022
Vuma Areal, Roodepoort

Seems fairly isolated, not seeing any large scale PPPOE drops on our BNG - specifically when your session dropped.

 

[r00igev@@r]

We keep talking about NLD and I've received some enquiries with regards to this topic in the past few weeks. SA has multiple National Long Distance paths between key metros, and Web sQuad has capacity of our own on all major providers - linking major metros in a ring and providing resiliency and redundancy for our clients. These NLD paths are major undertakings and are extremely costly. Most of these paths are trenched.

These routes are key to the continued operation of all connectivity in South Africa. Isando has one of the largest exchanges in the world, with over 450+ inter connected networks. These networks all connect to the rest of the world via these NLD cables between KZN, CPT and JHB - because the rest of the world connects in Mtunzini, Ysterfontein, Amanzimtoti (amongst other submarine landing sites).

These routes have also been subject to extensive breaks in the past few months (more than usual) which affect all networks relying on them, to a lesser or greater extent depending on the spread of the breaks and the redundancy measures implemented. These breaks are sometimes accidental (roadworks and construction hitting fibre ducts) and sometimes malicious (attempts at cable theft or plain vandalism)

This morning saw a dual outage on CPT-JHB paths that resulted in certain routes being affected more than others. Our own NLDs stayed up, but some of our upstreams were affected. One route that experienced downtime had been vandalised extensively and I thought I would share the kinds of damage Fibre Operators need to deal with on a daily basis:
View attachment 1274764
Photo credit - ZANOG, G Beneke
- Unverified picture of vandalism at a DFA manhole in CPT today, affecting an NLD path to JHB 22/03/2022

Bliksem! Were the bergies trying to burn down the boerewors curtain?

 

[tracee]

I'm in Roodepoort as well and I have also been having multiple sessions of packet loss at least twice a day and one day, where the connection completely dropped. At around the same time as you Senshi, a web page started struggling to load. The packet loss always seem to happen at similar times everyday. Usually around this time everyday, between 12.20 and 1pm and again in the evenings from around 7.30 pm to after 8 pm.

I will try and log times when I notice the packet loss, to see if there is a pattern to it.

 

[websquadza]

Bliksem! Were the bergies trying to burn down the boerewors curtain?

scary thing is this isn’t the first time. Happened near harrismith on the liquid route recently. The one theory is that the guys set fire to the cables to see if there’s copper inside.

 

[websquadza]

I'm in Roodepoort as well and I have also been having multiple sessions of packet loss at least twice a day and one day, where the connection completely dropped. At around the same time as you Senshi, a web page started struggling to load. The packet loss always seem to happen at similar times everyday. Usually around this time everyday, between 12.20 and 1pm and again in the evenings from around 7.30 pm to after 8 pm.

I will try and log times when I notice the packet loss, to see if there is a pattern to it.

Keep me posted please. I checked on @Senshi’s pppoe session and didn’t see any other sessions with the same age in a 10 min window in either direction. This is how we usually pick up area wide outages. That said, your router may have held onto the pppoe for longer than his during this timeout.

You can send any mtrs to support.

 

[nelis]

Just had my internet disconnect 2 times now in the last 30min or so

 

[tracee]

Keep me posted please. I checked on @Senshi’s pppoe session and didn’t see any other sessions with the same age in a 10 min window in either direction. This is how we usually pick up area wide outages. That said, your router may have held onto the pppoe for longer than his during this timeout.

You can send any mtrs to support.

Alright, whatever I can log, I will send through to support. It is behaving a little better today

 

[websquadza]

Just had my internet disconnect 2 times now in the last 30min or so

Area an FNO?

 

[Senshi]

I just recorded massive packet loss (upwards of 15%). Did a router/ONT reboot, seems okay now. Did do MTR's and screenshots, monitoring for now.

Radiokop, Roodepoort, Vuma Aerial.

 

[Senshi]

I'm in Roodepoort as well and I have also been having multiple sessions of packet loss at least twice a day and one day, where the connection completely dropped. At around the same time as you Senshi, a web page started struggling to load. The packet loss always seem to happen at similar times everyday. Usually around this time everyday, between 12.20 and 1pm and again in the evenings from around 7.30 pm to after 8 pm.

I will try and log times when I notice the packet loss, to see if there is a pattern to it.

I've been noticing this over the last 3 months as well. It comes and goes, twitch, specifically has been really bad for me. The packet loss doesn't coincide with the twitch issues though.

I'm fairly sure it's a vumatel problem, as I game online and watch twitch (both fairly sensitive to latency and packet loss) and notice it immediately. Very very frustrating.

 

[Krazee]

I just recorded massive packet loss (upwards of 15%). Did a router/ONT reboot, seems okay now. Did do MTR's and screenshots, monitoring for now.

Radiokop, Roodepoort, Vuma Aerial.

I got the same burst of packet loss , now on a different ISP , but the same area so definitely a Vumatel issue.

Twitch has been pretty good for me , maybe the odd buffering issue here or there.

Vumatel's Technical Manager has been in contact with me , but they only care about speedtests on the line , they couldn't give a crap about the packet loss issues. I was even told I need a business line, if I don't want packet loss.
Hopefully they can solve this issue once and for all.

 

[websquadza]

I just recorded massive packet loss (upwards of 15%). Did a router/ONT reboot, seems okay now. Did do MTR's and screenshots, monitoring for now.

Radiokop, Roodepoort, Vuma Aerial.

Please share these so we can escalate.

I've been noticing this over the last 3 months as well. It comes and goes, twitch, specifically has been really bad for me. The packet loss doesn't coincide with the twitch issues though.

I'm fairly sure it's a vumatel problem, as I game online and watch twitch (both fairly sensitive to latency and packet loss) and notice it immediately. Very very frustrating.

I got the same burst of packet loss , now on a different ISP , but the same area so definitely a Vumatel issue.

Twitch has been pretty good for me , maybe the odd buffering issue here or there.

Vumatel's Technical Manager has been in contact with me , but they only care about speedtests on the line , they couldn't give a crap about the packet loss issues. I was even told I need a business line, if I don't want packet loss.
Hopefully they can solve this issue once and for all.

The packet loss has been an ongoing issue in the West Rand for months now. Comes and goes. We have tickets with Vuma, AEX and both together - we've seen packet loss that looks like congestion at times, path failover, MTU issues, packet fragmentation and more. We will continue working on these issues with them, and need this kind of feedback to ensure we can show them that the issues persist.