Web Squad ISP

Status
Not open for further replies.
ANybody else having pull/clone troubles with github.com? It's been.... excrutiation slow, had to switch to Vanilla to get stuff pulled.

Code:
                               My traceroute  [v0.93]
BumbleBee.local (10.1.1.9)                                 2020-03-23T22:32:45+0200
Keys:  Help   Display mode   Restart statistics   Order of fields   quit
                                           Packets               Pings
Host                                    Loss%   Snt   Last   Avg  Best  Wrst StDev
1. 10.1.1.1                              2.7%  1533    2.2   2.8   0.9 711.1  25.7
2. as-vuma.cp-gwf-4-01.za.ws.net.za      3.1%  1533   26.7   6.7   2.9 665.3  24.6
3. 160.119.233.130                       2.8%  1533    3.6   7.5   2.9 613.5  25.9
4. core.as-01.cp1.za.ws.net.za           4.2%  1533    2.8   4.0   1.7 559.6  22.3
5. core.cr-01.cp1.za.ws.net.za           3.7%  1532    2.0   3.8   1.7 508.5  19.5
6. core.pe-xe-ip01.cp1.za.ws.net.za      3.1%  1532    2.2   4.8   1.8 1530.  43.0
7. 165-69-148-197.as37497.za.net         2.7%  1532    4.1   5.0   1.9 1481.  41.3
8. 162-68-148-197.as37497.za.net         2.5%  1532   35.2   6.6   2.0 1430.  53.1
9. 54-71-148-197.as37497.za.net          2.2%  1532  143.0 146.3 142.0 1531.  51.5
10. 213.130.47.125                        3.3%  1532  143.5 148.0 142.8 1479.  51.2
11. ae-2.r25.londen12.uk.bb.gin.ntt.net   3.6%  1532  143.2 148.9 142.6 1431.  49.5
12. ae-1.r24.londen12.uk.bb.gin.ntt.net   2.6%  1532  144.6 148.6 142.7 1379.  47.7
13. ae-7.r20.nwrknj03.us.bb.gin.ntt.net  47.5%  1532  214.4 219.8 210.1 2532.  93.5
14. ae-0.r21.nwrknj03.us.bb.gin.ntt.net  66.6%  1532  211.0 214.2 210.2 366.6  10.9
15. ae-3.r22.asbnva02.us.bb.gin.ntt.net  24.7%  1532  217.4 219.9 215.0 1219.  33.8
16. ae-1.r05.asbnva02.us.bb.gin.ntt.net   4.6%  1532  216.8 219.2 214.9 1234.  39.1
17. ce-0-9-0-2.r05.asbnva02.us.ce.gin.nt  3.4%  1532  217.1 220.3 215.9 1186.  36.7
18. (waiting for reply)
19. (waiting for reply)
20. (waiting for reply)
21. lb-140-82-113-3-iad.github.com        4.3%  1532  219.0 223.1 218.9 980.3  31.0

Struggling with a git pull myself right now. Looking into this. Forward route seems good. Reverse route is identical if I test from NTT Ashurn (hop 17). No congestion along this route from what I can see. But picking up on losses on the last hop particularly. So could be an issue that end?

Actually looks like I'm pulling from the exact same server. Small world. This doesn't mean that Github's return route to us is the same. Not picking up any losses through to the edge of NTT's network (17). Whereas we see packet loss at hop 21.
 
Well, Vanilla doesn't seem to have the problems it seems:

Code:
root@slacky:~/# mtr -wbc 120 github.com
Start: 2020-03-23T20:45:08+0000
HOST: slacky                                        Loss%   Snt   Last   Avg  Best  Wrst StDev
  1.|-- 197.155.17.193                                 0.0%   120    2.3   4.4   2.2  43.9   6.0
  2.|-- 197.155.16.2                                   0.0%   120    2.4   3.5   2.3  29.5   3.9
  3.|-- 197.155.16.41                                  0.0%   120    1.4   1.1   0.9   3.2   0.2
  4.|-- cpt10G-teraco-core.gig.za.net (197.155.1.71)   0.0%   120    1.2   1.6   1.1  39.0   3.5
  5.|-- 197.155.1.101                                  0.0%   120    1.6   4.7   1.4 150.3  18.8
  6.|-- 105.233.31.25                                  0.0%   120    1.5   2.8   1.3  75.5   8.1
  7.|-- 105.233.31.45                                  0.0%   120  141.6 143.4 141.4 272.2  12.5
  8.|-- v115.core1.lon3.he.net (184.104.200.77)        0.0%   120  141.8 145.1 141.7 246.4  13.9
  9.|-- 100ge0-52.core1.ams2.he.net (184.104.193.194)  0.0%   120  147.4 149.3 146.8 203.5   8.0
10.|-- 100ge2-1.core1.ams1.he.net (184.104.192.129)   0.0%   120  148.1 149.2 147.8 178.6   4.4
11.|-- ???                                           100.0   120    0.0   0.0   0.0   0.0   0.0
12.|-- ???                                           100.0   120    0.0   0.0   0.0   0.0   0.0
13.|-- lb-140-82-118-4-ams.github.com (140.82.118.4)  0.0%   120  155.0 156.9 154.9 263.5  12.8
root@slacky:~/#

DEfinately something in the WebSquad path to/from github problematic:

Code:
BumbleBee.local (10.1.1.9)                                                     2020-03-23T22:53:07+0200
Keys:  Help   Display mode   Restart statistics   Order of fields   quit
                                                               Packets               Pings
 Host                                                        Loss%   Snt   Last   Avg  Best  Wrst StDev
 1. 10.1.1.1                                                 28.6%    35    6.5   2.1   1.1  11.6   2.2
 2. as-vuma.cp-gwf-4-01.za.ws.net.za                         11.4%    35    3.7   4.4   3.1   8.1   1.2
 3. 160.119.233.130                                          17.1%    35   16.7   5.0   3.0  16.7   2.9
 4. core.as-01.cp1.za.ws.net.za                               8.6%    35    2.2   2.8   1.7  18.8   2.9
 5. core.cr-01.cp1.za.ws.net.za                              22.9%    35    2.7   3.7   1.8  22.8   4.5
 6. core.pe-xe-ip01.cp1.za.ws.net.za                         25.7%    35    2.3   3.0   1.8  13.7   2.3
 7. 165-69-148-197.as37497.za.net                            14.3%    35    4.0   2.7   2.0   4.8   0.6
 8. 162-68-148-197.as37497.za.net                            11.8%    34  144.5 143.6 142.5 150.6   1.5
 9. 54-71-148-197.as37497.za.net                             14.7%    34  144.5 146.0 142.6 184.8   8.0
10. 37-66-148-197.as37497.za.net                             20.6%    34  142.3 146.3 142.3 210.7  13.0
11. 25-71-148-197.as37497.za.net                              5.9%    34  143.5 144.4 142.4 166.9   4.5
12. ldn-b7-link.telia.net                                    23.5%    34  170.2 168.7 158.1 201.2   7.4
13. ldn-bb4-link.telia.net                                   20.6%    34  184.5 188.7 171.7 215.1   9.6
14. (waiting for reply)
15. ffm-bb2-link.telia.net                                   17.6%    34  183.9 185.1 161.9 210.8   7.4
16. ffm-b7-link.telia.net                                    29.4%    34  182.2 185.3 179.2 192.6   3.1
17. github-ic-350971-ffm-b7.c.telia.net                      32.4%    34  207.9 186.6 167.7 213.4   8.9
18. (waiting for reply)
19. (waiting for reply)
20. lb-140-82-118-4-ams.github.com                           17.6%    34  179.9 191.1 179.9 199.8   2.9
 
Well, Vanilla doesn't seem to have the problems it seems:

Code:
root@slacky:~/# mtr -wbc 120 github.com
Start: 2020-03-23T20:45:08+0000
HOST: slacky                                        Loss%   Snt   Last   Avg  Best  Wrst StDev
  1.|-- 197.155.17.193                                 0.0%   120    2.3   4.4   2.2  43.9   6.0
  2.|-- 197.155.16.2                                   0.0%   120    2.4   3.5   2.3  29.5   3.9
  3.|-- 197.155.16.41                                  0.0%   120    1.4   1.1   0.9   3.2   0.2
  4.|-- cpt10G-teraco-core.gig.za.net (197.155.1.71)   0.0%   120    1.2   1.6   1.1  39.0   3.5
  5.|-- 197.155.1.101                                  0.0%   120    1.6   4.7   1.4 150.3  18.8
  6.|-- 105.233.31.25                                  0.0%   120    1.5   2.8   1.3  75.5   8.1
  7.|-- 105.233.31.45                                  0.0%   120  141.6 143.4 141.4 272.2  12.5
  8.|-- v115.core1.lon3.he.net (184.104.200.77)        0.0%   120  141.8 145.1 141.7 246.4  13.9
  9.|-- 100ge0-52.core1.ams2.he.net (184.104.193.194)  0.0%   120  147.4 149.3 146.8 203.5   8.0
10.|-- 100ge2-1.core1.ams1.he.net (184.104.192.129)   0.0%   120  148.1 149.2 147.8 178.6   4.4
11.|-- ???                                           100.0   120    0.0   0.0   0.0   0.0   0.0
12.|-- ???                                           100.0   120    0.0   0.0   0.0   0.0   0.0
13.|-- lb-140-82-118-4-ams.github.com (140.82.118.4)  0.0%   120  155.0 156.9 154.9 263.5  12.8
root@slacky:~/#

Remember, a traceroute is a forward route. We pick up HE routes (the same as above) in JHB, so I see this same route from my end. We pick up NP routes in CPT and favour those as they're shorter. (you can visit our lookingglass https://lg.as328137.net to confirm). However, this is only the forward route. We can't dictate return route Github uses. In this case, Github sees two routes back to our network, one via HE (single hop) and one via NTT and NP (two hop). Weirdly enough, they're picking the longer (two hop) route and sending traffic back that way. Probably a routing issue on their end (with the affected router taking significant strain as can be seen with the packet loss on their own network).
 
I'm seeing significant loss on your LAN (1st hop) when connected to your Web sQuad link:

Code:
Host                                                        Loss%   Snt   Last   Avg  Best  Wrst StDev
 1. 10.1.1.1                                                 28.6%    35    6.5   2.1   1.1  11.6   2.2

What's causing that?
 
DEfinately something in the WebSquad path to/from github problematic:

Code:
BumbleBee.local (10.1.1.9)                                                     2020-03-23T22:53:07+0200
Keys:  Help   Display mode   Restart statistics   Order of fields   quit
                                                               Packets               Pings
Host                                                        Loss%   Snt   Last   Avg  Best  Wrst StDev
1. 10.1.1.1                                                 28.6%    35    6.5   2.1   1.1  11.6   2.2
2. as-vuma.cp-gwf-4-01.za.ws.net.za                         11.4%    35    3.7   4.4   3.1   8.1   1.2
3. 160.119.233.130                                          17.1%    35   16.7   5.0   3.0  16.7   2.9
4. core.as-01.cp1.za.ws.net.za                               8.6%    35    2.2   2.8   1.7  18.8   2.9
5. core.cr-01.cp1.za.ws.net.za                              22.9%    35    2.7   3.7   1.8  22.8   4.5
6. core.pe-xe-ip01.cp1.za.ws.net.za                         25.7%    35    2.3   3.0   1.8  13.7   2.3
7. 165-69-148-197.as37497.za.net                            14.3%    35    4.0   2.7   2.0   4.8   0.6
8. 162-68-148-197.as37497.za.net                            11.8%    34  144.5 143.6 142.5 150.6   1.5
9. 54-71-148-197.as37497.za.net                             14.7%    34  144.5 146.0 142.6 184.8   8.0
10. 37-66-148-197.as37497.za.net                             20.6%    34  142.3 146.3 142.3 210.7  13.0
11. 25-71-148-197.as37497.za.net                              5.9%    34  143.5 144.4 142.4 166.9   4.5
12. ldn-b7-link.telia.net                                    23.5%    34  170.2 168.7 158.1 201.2   7.4
13. ldn-bb4-link.telia.net                                   20.6%    34  184.5 188.7 171.7 215.1   9.6
14. (waiting for reply)
15. ffm-bb2-link.telia.net                                   17.6%    34  183.9 185.1 161.9 210.8   7.4
16. ffm-b7-link.telia.net                                    29.4%    34  182.2 185.3 179.2 192.6   3.1
17. github-ic-350971-ffm-b7.c.telia.net                      32.4%    34  207.9 186.6 167.7 213.4   8.9
18. (waiting for reply)
19. (waiting for reply)
20. lb-140-82-118-4-ams.github.com                           17.6%    34  179.9 191.1 179.9 199.8   2.9

I'm seeing significant loss on your LAN (1st hop) when connected to your Web sQuad link:

Code:
Host                                                        Loss%   Snt   Last   Avg  Best  Wrst StDev
1. 10.1.1.1                                                 28.6%    35    6.5   2.1   1.1  11.6   2.2

What's causing that?
 
I'm seeing significant loss on your LAN (1st hop) when connected to your Web sQuad link:

Code:
Host                                                        Loss%   Snt   Last   Avg  Best  Wrst StDev
1. 10.1.1.1                                                 28.6%    35    6.5   2.1   1.1  11.6   2.2

What's causing that?

My Fortigate/switch setup when/while switching over my SD-WAN setup (Split with WebSquad in my flat & Vanilla on the fibre terminating in my neighbors flat)

Direct pings are fine:
Code:
➜  ~ sudo mtr -rc 20 10.1.1.1
Start: 2020-03-23T23:09:00+0200
HOST: BumbleBee.local             Loss%   Snt   Last   Avg  Best  Wrst StDev
  1.|-- 10.1.1.1                   0.0%    20    1.9   1.5   0.9   3.4   0.6
➜  ~

but if I need to, I can on L2 just switch/change the Slacky container's vlan to connect to WS with a WS IP to retest ;)
 
My Fortigate/switch setup when/while switching over my SD-WAN setup (Split with WebSquad in my flat & Vanilla on the fibre terminating in my neighbors flat)

Direct pings are fine:
Code:
➜  ~ sudo mtr -rc 20 10.1.1.1
Start: 2020-03-23T23:09:00+0200
HOST: BumbleBee.local             Loss%   Snt   Last   Avg  Best  Wrst StDev
  1.|-- 10.1.1.1                   0.0%    20    1.9   1.5   0.9   3.4   0.6
➜  ~

but if I need to, I can on L2 just switch/change the Slacky container's vlan to connect to WS with a WS IP to retest ;)

Nice setup! Ok, makes sense. Back to Github, Definitely something odd going on there. Don't understand why they are favouring the longer AS route. And I'm guessing this is leading to congestion on the affected router - they have direct peering with HE and should see that as the shortest route.
 
Morning @websquadza

Woke up to no internet this morning in Flamingo Vlei, Table View. Provider - Vumatel.

Indicator lights are not any different from usual and power-cycling did not help. Seems it connects fine to Vumatel - just no internet.
 
Morning @websquadza

Woke up to no internet this morning in Flamingo Vlei, Table View. Provider - Vumatel.

Indicator lights are not any different from usual and power-cycling did not help. Seems it connects fine to Vumatel - just no internet.
Morning. We were inadvertently affected by some maintenance done by the interconnect partner (AEX). We're investigating how and why this happened.
 
Morning @websquadza

Woke up to no internet this morning in Flamingo Vlei, Table View. Provider - Vumatel.

Indicator lights are not any different from usual and power-cycling did not help. Seems it connects fine to Vumatel - just no internet.

And ofcourse 10 minutes after logging the call its back again. If that's something you had a hand in thank you.
 
Yes still down..all lights on and connected but no internet connection

Same here, Plumstead area in Cape Town - very slow internet.

to Websquad:
Code:
|------------------------------------------------------------------------------------------|
|                                      WinMTR statistics                                   |
|                       Host              -   %  | Sent | Recv | Best | Avrg | Wrst | Last |
|------------------------------------------------|------|------|------|------|------|------|
|                             dlinkrouter -    0 |   35 |   35 |    0 |    1 |    2 |    2 |
|          as-vuma.cp-gwf-03.za.ws.net.za -    0 |   35 |   35 |    2 |    3 |   26 |    2 |
|             core.as-01.cp1.za.ws.net.za -    0 |   35 |   35 |    1 |    1 |    3 |    1 |
|             core.cr-01.cp1.za.ws.net.za -    0 |   35 |   35 |    1 |    1 |    2 |    1 |
|             core.cr-01.jnb.za.ws.net.za -    0 |   35 |   35 |   19 |   20 |   22 |   20 |
|             core.as-01.jnb.za.ws.net.za -    0 |   35 |   35 |   19 |   20 |   22 |   20 |
|                      www.websquad.co.za -    0 |   35 |   35 |   20 |   20 |   22 |   20 |
|________________________________________________|______|______|______|______|______|______|
   WinMTR v0.92 GPL V2 by Appnor MSP - Fully Managed Hosting & Cloud Provider


to Youtube:
Code:
|------------------------------------------------------------------------------------------|
|                                      WinMTR statistics                                   |
|                       Host              -   %  | Sent | Recv | Best | Avrg | Wrst | Last |
|------------------------------------------------|------|------|------|------|------|------|
|                             dlinkrouter -    0 |   35 |   35 |    0 |    0 |    1 |    1 |
|          as-vuma.cp-gwf-03.za.ws.net.za -    0 |   35 |   35 |    2 |    4 |   30 |    3 |
|                   No response from host -  100 |    7 |    0 |    0 |    0 |    0 |    0 |
|                   No response from host -  100 |    7 |    0 |    0 |    0 |    0 |    0 |
|                   No response from host -  100 |    7 |    0 |    0 |    0 |    0 |    0 |
|                   No response from host -  100 |    7 |    0 |    0 |    0 |    0 |    0 |
|                   No response from host -  100 |    7 |    0 |    0 |    0 |    0 |    0 |
|                   No response from host -  100 |    7 |    0 |    0 |    0 |    0 |    0 |
|                   No response from host -  100 |    7 |    0 |    0 |    0 |    0 |    0 |
|                   No response from host -  100 |    7 |    0 |    0 |    0 |    0 |    0 |
|                   No response from host -  100 |    7 |    0 |    0 |    0 |    0 |    0 |
|                   No response from host -  100 |    7 |    0 |    0 |    0 |    0 |    0 |
|                   No response from host -  100 |    7 |    0 |    0 |    0 |    0 |    0 |
|                   No response from host -  100 |    7 |    0 |    0 |    0 |    0 |    0 |
|                   No response from host -  100 |    7 |    0 |    0 |    0 |    0 |    0 |
|                   No response from host -  100 |    7 |    0 |    0 |    0 |    0 |    0 |
|                   No response from host -  100 |    7 |    0 |    0 |    0 |    0 |    0 |
|                   No response from host -  100 |    7 |    0 |    0 |    0 |    0 |    0 |
|                   No response from host -  100 |    7 |    0 |    0 |    0 |    0 |    0 |
|                   No response from host -  100 |    7 |    0 |    0 |    0 |    0 |    0 |
|                   No response from host -  100 |    7 |    0 |    0 |    0 |    0 |    0 |
|                   No response from host -  100 |    7 |    0 |    0 |    0 |    0 |    0 |
|                   No response from host -  100 |    7 |    0 |    0 |    0 |    0 |    0 |
|                   No response from host -  100 |    7 |    0 |    0 |    0 |    0 |    0 |
|                   No response from host -  100 |    7 |    0 |    0 |    0 |    0 |    0 |
|                   No response from host -  100 |    7 |    0 |    0 |    0 |    0 |    0 |
|                   No response from host -  100 |    7 |    0 |    0 |    0 |    0 |    0 |
|                   No response from host -  100 |    7 |    0 |    0 |    0 |    0 |    0 |
|                   No response from host -  100 |    7 |    0 |    0 |    0 |    0 |    0 |
|                   No response from host -  100 |    7 |    0 |    0 |    0 |    0 |    0 |
|________________________________________________|______|______|______|______|______|______|
   WinMTR v0.92 GPL V2 by Appnor MSP - Fully Managed Hosting & Cloud Provider
 
Still down here in Bellville as well.

Same here, Plumstead area in Cape Town - very slow internet.

to Websquad:
Code:
|------------------------------------------------------------------------------------------|
|                                      WinMTR statistics                                   |
|                       Host              -   %  | Sent | Recv | Best | Avrg | Wrst | Last |
|------------------------------------------------|------|------|------|------|------|------|
|                             dlinkrouter -    0 |   35 |   35 |    0 |    1 |    2 |    2 |
|          as-vuma.cp-gwf-03.za.ws.net.za -    0 |   35 |   35 |    2 |    3 |   26 |    2 |
|             core.as-01.cp1.za.ws.net.za -    0 |   35 |   35 |    1 |    1 |    3 |    1 |
|             core.cr-01.cp1.za.ws.net.za -    0 |   35 |   35 |    1 |    1 |    2 |    1 |
|             core.cr-01.jnb.za.ws.net.za -    0 |   35 |   35 |   19 |   20 |   22 |   20 |
|             core.as-01.jnb.za.ws.net.za -    0 |   35 |   35 |   19 |   20 |   22 |   20 |
|                      www.websquad.co.za -    0 |   35 |   35 |   20 |   20 |   22 |   20 |
|________________________________________________|______|______|______|______|______|______|
   WinMTR v0.92 GPL V2 by Appnor MSP - Fully Managed Hosting & Cloud Provider


to Youtube:
Code:
|------------------------------------------------------------------------------------------|
|                                      WinMTR statistics                                   |
|                       Host              -   %  | Sent | Recv | Best | Avrg | Wrst | Last |
|------------------------------------------------|------|------|------|------|------|------|
|                             dlinkrouter -    0 |   35 |   35 |    0 |    0 |    1 |    1 |
|          as-vuma.cp-gwf-03.za.ws.net.za -    0 |   35 |   35 |    2 |    4 |   30 |    3 |
|                   No response from host -  100 |    7 |    0 |    0 |    0 |    0 |    0 |
|                   No response from host -  100 |    7 |    0 |    0 |    0 |    0 |    0 |
|                   No response from host -  100 |    7 |    0 |    0 |    0 |    0 |    0 |
|                   No response from host -  100 |    7 |    0 |    0 |    0 |    0 |    0 |
|                   No response from host -  100 |    7 |    0 |    0 |    0 |    0 |    0 |
|                   No response from host -  100 |    7 |    0 |    0 |    0 |    0 |    0 |
|                   No response from host -  100 |    7 |    0 |    0 |    0 |    0 |    0 |
|                   No response from host -  100 |    7 |    0 |    0 |    0 |    0 |    0 |
|                   No response from host -  100 |    7 |    0 |    0 |    0 |    0 |    0 |
|                   No response from host -  100 |    7 |    0 |    0 |    0 |    0 |    0 |
|                   No response from host -  100 |    7 |    0 |    0 |    0 |    0 |    0 |
|                   No response from host -  100 |    7 |    0 |    0 |    0 |    0 |    0 |
|                   No response from host -  100 |    7 |    0 |    0 |    0 |    0 |    0 |
|                   No response from host -  100 |    7 |    0 |    0 |    0 |    0 |    0 |
|                   No response from host -  100 |    7 |    0 |    0 |    0 |    0 |    0 |
|                   No response from host -  100 |    7 |    0 |    0 |    0 |    0 |    0 |
|                   No response from host -  100 |    7 |    0 |    0 |    0 |    0 |    0 |
|                   No response from host -  100 |    7 |    0 |    0 |    0 |    0 |    0 |
|                   No response from host -  100 |    7 |    0 |    0 |    0 |    0 |    0 |
|                   No response from host -  100 |    7 |    0 |    0 |    0 |    0 |    0 |
|                   No response from host -  100 |    7 |    0 |    0 |    0 |    0 |    0 |
|                   No response from host -  100 |    7 |    0 |    0 |    0 |    0 |    0 |
|                   No response from host -  100 |    7 |    0 |    0 |    0 |    0 |    0 |
|                   No response from host -  100 |    7 |    0 |    0 |    0 |    0 |    0 |
|                   No response from host -  100 |    7 |    0 |    0 |    0 |    0 |    0 |
|                   No response from host -  100 |    7 |    0 |    0 |    0 |    0 |    0 |
|                   No response from host -  100 |    7 |    0 |    0 |    0 |    0 |    0 |
|                   No response from host -  100 |    7 |    0 |    0 |    0 |    0 |    0 |
|________________________________________________|______|______|______|______|______|______|
   WinMTR v0.92 GPL V2 by Appnor MSP - Fully Managed Hosting & Cloud Provider


Cape Town Vumatel: Maintenance is ongoing. Was meant to be completed already but teams are still on site completing upgrades. Updates to follow.
 
Status
Not open for further replies.
Top
Sign up to the MyBroadband newsletter
X