Web Squad ISP

[DrJohnZoidberg]

Weird - I downloaded a Steam game the other day (using the JHB server) and got line speed for all 15GB.

Ever since I enabled IPv6 things have been a bit funky. I'm going to try disable it and see if that makes any difference.

 

[PsyWulf]

Weird - I downloaded a Steam game the other day (using the JHB server) and got line speed for all 15GB.

Usually this type of content is on CDNs,see below highlight

• International traffic (excluding traffic from CDNs and locally peered networks including, but not limited to: Google, Facebook, Microsoft, Amazon, Fastly, Limelight, Akamai, Cloudflare, HE, Valve (Steam), Apple and more - this list is continually expanding) may be limited to 200 Mbps. We reserve the right to limit international bandwidth to 200 Mbps at any time

 

[DrJohnZoidberg]

Turned off IPv6 and everything is working again as expected.

Was getting sub-100Mbps speedtests on fast.com with IPv6 enabled and now it's over 900Mbps with it disabled. Local steam servers still a bit slow for my liking (only hitting 400Mbps max) but switching to Belgium seems to be around 600-700Mbps.

@websquadza Any ideas why I would see this behaviour with ipv6? I've turned it off for now.

 

[DrJohnZoidberg]

Definitely some weird stuff still happening.

Steam downloads up and down like crazy, get to like ~600Mbps then goes for a bit and then flat-lines completely (at one stage I had to pause and resume because it got stuck), comes back at 50Mbps, then back to 300Mbps then back down, etc. Even peaked at 760Mbps for a bit.

 

[Seeyou]

Usually this type of content is on CDNs,see below highlight

Yeah I know. I was referring to Zoidberg's experience with Steam vs my own.

 

[Bionic]

Intermediate hops and their latencies don't really matter on an MTR; unless their latency affects the subsequent hops. Your resultant latency is still very much the same at +- 200ms. What's of more concern though is the packet loss visible on that last hop - with no packet loss on the hops leading up to it. This would be a killer for streaming. Any other server you can test?

I noticed that anything on M365 is very slow. Our tenant is in EU.

 

[Seeyou]

Noticed an automated NNTP download was running at abysmal speed just now, so I ran a MTR to check, and noticed this weird routing I've never seen before:

|------------------------------------------------------------------------------------------|
|                                      WinMTR statistics                                   |
|                       Host              -   %  | Sent | Recv | Best | Avrg | Wrst | Last |
|------------------------------------------------|------|------|------|------|------|------|
|                             192.168.1.1 -    0 |    4 |    4 |    0 |    0 |    1 |    0 |
|             core.as-01.cp1.za.ws.net.za -    0 |    4 |    4 |    0 |    8 |   31 |    0 |
|                            100.99.197.1 -    0 |    4 |    4 |    1 |    1 |    1 |    1 |
|           165-69-148-197.as37497.za.net -    0 |    4 |    4 |    1 |    1 |    2 |    1 |
|           162-68-148-197.as37497.za.net -    0 |    4 |    4 |    1 |    1 |    1 |    1 |
|     63-218-189-25.static.pccwglobal.net -    0 |    4 |    4 |   19 |   19 |   19 |   19 |
| HundredGE0-2-0-0.br01.ldn03.pccwbtn.net -    0 |    4 |    4 |  143 |  150 |  174 |  143 |
|    uk-lon01b-ri1-xe-5-1-0-1-0.aorta.net -    0 |    4 |    4 |  143 |  152 |  173 |  149 |
|                   No response from host -  100 |    1 |    0 |    0 |    0 |    0 |    0 |
|                   No response from host -  100 |    1 |    0 |    0 |    0 |    0 |    0 |
|          nl-ams04a-ri3-ae-9-0.aorta.net -    0 |    4 |    4 |  150 |  158 |  181 |  150 |
|        nl-ams04a-ri2-xe-2-0-0.aorta.net -    0 |    4 |    4 |  150 |  157 |  181 |  150 |
|                   No response from host -  100 |    1 |    0 |    0 |    0 |    0 |    0 |
|                           81.171.92.224 -    0 |    4 |    4 |  151 |  159 |  182 |  151 |
|________________________________________________|______|______|______|______|______|______|
   WinMTR v0.92 GPL V2 by Appnor MSP - Fully Managed Hosting & Cloud Provider

Are we on alternate/failover routing @websquadza ?

EDIT: Everything else looks normal, just that path I've never seen before which doesn't seem to be optimal. Was barely breaking half line speed.

 

[websquadza]

Thanks for the email, how long will the FUP be in effect for, or is this permanent?

Apologies again for the delayed response here. I've had a chat to our network team and we're looking into this and will communicate more in this regard.

In general, the FUP is there purely as a protection measure and as I asked the team to mention in the mail, you should have received a notice and not been left guessing - I am investigating why this didn't occur as this is our company policy.

 

[websquadza]

Ever since I enabled IPv6 things have been a bit funky. I'm going to try disable it and see if that makes any difference.

Turned off IPv6 and everything is working again as expected.

Was getting sub-100Mbps speedtests on fast.com with IPv6 enabled and now it's over 900Mbps with it disabled. Local steam servers still a bit slow for my liking (only hitting 400Mbps max) but switching to Belgium seems to be around 600-700Mbps.

@websquadza Any ideas why I would see this behaviour with ipv6? I've turned it off for now.

Thanks for this. The 100 Mbps helped us narrow it down - and please feel free to submit tickets for things like this. This 100 Mbps is due to a route advertisement to HE. We've reached out to them and asked them to disable this. Will update you as to when this is resolved and you can turn IPv6 back up.

Turned off IPv6 and everything is working again as expected.

Was getting sub-100Mbps speedtests on fast.com with IPv6 enabled and now it's over 900Mbps with it disabled. Local steam servers still a bit slow for my liking (only hitting 400Mbps max) but switching to Belgium seems to be around 600-700Mbps.

@websquadza Any ideas why I would see this behaviour with ipv6? I've turned it off for now.

From what I've seen, there's a fair amount of rate limiting happening on the steam CDN; I think they're facing a bit of a bandwidth constraint. Africa's traffic levels are very high at the moment, and if they're anything like other foreign CDNS, maintenance and upgrades have been pushed out due to Rona.

Definitely some weird stuff still happening.

Steam downloads up and down like crazy, get to like ~600Mbps then goes for a bit and then flat-lines completely (at one stage I had to pause and resume because it got stuck), comes back at 50Mbps, then back to 300Mbps then back down, etc. Even peaked at 760Mbps for a bit.

This is usually a sign of a TCP issue and buffers being out of whack. It goes back to the Octotel fragmentation issue. Our TCP Accelerator can only help to a certain degree here (IE the bursts), but the rest is down to TCP windows, buffer sizes and CPU overhead to make sense of the TCP packets being fragmented and delivered out of order.

 

[websquadza]

I noticed that anything on M365 is very slow. Our tenant is in EU.

All Microsoft traffic is peering traffic; handed over in Isando or Cape Town. Are you using IPv6 by any chance? We're also EU tenanted at the office, and not seeing any major issues today

 

[websquadza]

Noticed an automated NNTP download was running at abysmal speed just now, so I ran a MTR to check, and noticed this weird routing I've never seen before:

|------------------------------------------------------------------------------------------|
|                                      WinMTR statistics                                   |
|                       Host              -   %  | Sent | Recv | Best | Avrg | Wrst | Last |
|------------------------------------------------|------|------|------|------|------|------|
|                             192.168.1.1 -    0 |    4 |    4 |    0 |    0 |    1 |    0 |
|             core.as-01.cp1.za.ws.net.za -    0 |    4 |    4 |    0 |    8 |   31 |    0 |
|                            100.99.197.1 -    0 |    4 |    4 |    1 |    1 |    1 |    1 |
|           165-69-148-197.as37497.za.net -    0 |    4 |    4 |    1 |    1 |    2 |    1 |
|           162-68-148-197.as37497.za.net -    0 |    4 |    4 |    1 |    1 |    1 |    1 |
|     63-218-189-25.static.pccwglobal.net -    0 |    4 |    4 |   19 |   19 |   19 |   19 |
| HundredGE0-2-0-0.br01.ldn03.pccwbtn.net -    0 |    4 |    4 |  143 |  150 |  174 |  143 |
|    uk-lon01b-ri1-xe-5-1-0-1-0.aorta.net -    0 |    4 |    4 |  143 |  152 |  173 |  149 |
|                   No response from host -  100 |    1 |    0 |    0 |    0 |    0 |    0 |
|                   No response from host -  100 |    1 |    0 |    0 |    0 |    0 |    0 |
|          nl-ams04a-ri3-ae-9-0.aorta.net -    0 |    4 |    4 |  150 |  158 |  181 |  150 |
|        nl-ams04a-ri2-xe-2-0-0.aorta.net -    0 |    4 |    4 |  150 |  157 |  181 |  150 |
|                   No response from host -  100 |    1 |    0 |    0 |    0 |    0 |    0 |
|                           81.171.92.224 -    0 |    4 |    4 |  151 |  159 |  182 |  151 |
|________________________________________________|______|______|______|______|______|______|
   WinMTR v0.92 GPL V2 by Appnor MSP - Fully Managed Hosting & Cloud Provider

Are we on alternate/failover routing @websquadza ?

EDIT: Everything else looks normal, just that path I've never seen before which doesn't seem to be optimal. Was barely breaking half line speed.

It looks like there's an issue on the WACS path, resulting in traffic taking a bit of a weird route out and back (two separate routes as we're not allowing inbound from PCCW at the moment (which may explain the speeds). Following up on the WACS path

Edit: Saw your Edit. Definitely a path issue via WACS, waiting for a RFO. PCCW aren't sending us traffic at the moment as they're not accepting instructional communities from us to increase our path length via their network. However, with the WACS route drop, their inbound traffic would have been nice. As soon as they update their end, we'll allow our upstream to advertise to them again.

 

[Fcon_Vpro]

Hitting 70MB/s average on nntp... best speeds ive ever had... although I don't use the service as often as I used to so not sure when speeds got so much better.
Peaked at 78MB/s.
So good to have a working fibre line again.

 

[DrJohnZoidberg]

Going to need that 10Gbit now, sorry.

 

[Bionic]

All Microsoft traffic is peering traffic; handed over in Isando or Cape Town. Are you using IPv6 by any chance? We're also EU tenanted at the office, and not seeing any major issues today

Nope. IPV6 turned off.

 

[Seeyou]

EU gaming feels REALLY bad since yesterday. Not sure what changed but the experience has taken a dive. Rubber banding and general sluggishness.

 

[Seeyou]

Hmm, could be the extra traffic to Apex with the new event and their generally crappy servers. I'll keep monitoring.

 

[Soul Assassin]

I think you just got a bad server, after I was done gaming for the night I watched some streams and even on their 15ms they would get a horrible rubber banding server.

There was even a bug where you could load into teams of 5 or 6, so I would just call it update night issues.

 

[Seeyou]

It looks like there's an issue on the WACS path, resulting in traffic taking a bit of a weird route out and back (two separate routes as we're not allowing inbound from PCCW at the moment (which may explain the speeds). Following up on the WACS path

Edit: Saw your Edit. Definitely a path issue via WACS, waiting for a RFO. PCCW aren't sending us traffic at the moment as they're not accepting instructional communities from us to increase our path length via their network. However, with the WACS route drop, their inbound traffic would have been nice. As soon as they update their end, we'll allow our upstream to advertise to them again.

Any news on this?

My current NNTP speeds are giving me flashbacks to certain other ISPs and I don't like it

 

[ijacobs3]

Question for @websquad

Those who have placed upgrade to 1000/200 , when would that take affect?

 

[Bionic]

Crazy local pings on battlefield Psn. More than 100ms.can see many others also unusually high