Web Squad ISP

[Looney]

We haven't had a drop at core level in a very long time - uptime on some of the bgp sessions that were dropped today was well over a year.

That said, no, these incidents are not common. We are investigating what led to it and will definitely learn from it and make necessary changes to ensure we don't see something like this again. A combination of unlikely events led to this outage today.

Once again, apologies to all for the inconvenience caused.

Thanks

 

[daelm]

We're running tests, but yes.

thanks

 

[mystic007]

My internet is back up but I can't reach any IPv6 sites:

# ping6 ipv6.google.com
connect: Network is unreachable

 

[websquadza]

My internet is back up but I can't reach any IPv6 sites:

# ping6 ipv6.google.com
connect: Network is unreachable

Looking into this now

 

[Zodiak]

Things still seem unstable, getting disconnected from things and then reconnected

 

[websquadza]

My internet is back up but I can't reach any IPv6 sites:

# ping6 ipv6.google.com
connect: Network is unreachable

Check on this again? Otherwise you may need to reboot your router.

 

[mystic007]

Rebooted but no change

 

[mystic007]

It appears since the outage my firewall is not getting a IPv6 default gateway from your DHCPv6 server
I have to add it manually:

[root@firewall ~]# ping6 ipv6.google.com
connect: Network is unreachable
[root@firewall ~]# ip -6 route add default dev ppp0
[root@firewall ~]#
[root@firewall ]# ping6 ipv6.google.com
PING ipv6.google.com(2c0f:fb50:4002:801::200e (2c0f:fb50:4002:801::200e)) 56 data bytes
64 bytes from 2c0f:fb50:4002:801::200e (2c0f:fb50:4002:801::200e): icmp_seq=1 ttl=118 time=5.27 ms
64 bytes from 2c0f:fb50:4002:801::200e (2c0f:fb50:4002:801::200e): icmp_seq=2 ttl=118 time=2.87 ms
64 bytes from 2c0f:fb50:4002:801::200e (2c0f:fb50:4002:801::200e): icmp_seq=3 ttl=118 time=3.40 ms

 

[tracee]

I am still getting 100% packet loss every 10 minutes or so

 

[DarkSt0rm]

Yea it seems to alternative between local and international haha

 

[Zodiak]

Internet has gone for sh*t again, can't open sites, timing out, what on earth is going on?!

 

[websquadza]

I am still getting 100% packet loss every 10 minutes or so

Internet has gone for sh*t again, can't open sites, timing out, what on earth is going on?!

Yea it seems to alternative between local and international haha

View attachment 1210664

Apologies, our engineers are currently investigating.

 

[tracee]

Thank you for the feedback

 

[blaine666]

Things still seem unstable, getting disconnected from things and then reconnected

Same, reboot also not helping..

 

[websquadza]

JHB Update: Our teams are monitoring the network very closely and is completing the investigation into today's events. We appreciate your support and patience today

 

[Zodiak]

Just had another small dip 10 minutes ago

 

[ijacobs3]

Just had another small dip 10 minutes ago

same

 

[websquadza]

Just had another small dip 10 minutes ago

same

Thanks for the feedback here. We saw this in our logs. Things have stabilised and we are still keeping a close eye on the network.

 

[DarkSt0rm]

Everything is dying again

 

[Zodiak]

Well the problems are back yet again, can't load websites and they keep timing out