Web Squad ISP

[websquadza]

Are you guys almost done with the maintenance? Hearing grumbling from the SO

Morning! Awaiting feedback from AEX (The interconnect provider for Vumatel). Maintenance window is over but still no traffic from them. Our network team has escalated this accordingly. Will revert as soon as we know more.

 

[Sopbeen]

Morning! Awaiting feedback from AEX (The interconnect provider for Vumatel). Maintenance window is over but still no traffic from them. Our network team has escalated this accordingly. Will revert as soon as we know more.

Top of the morning to you.
Thanks - I'll try to fend off the beast with coffee. Don't know how long I can last.

 

[ajv]

I hope AEX is feeling the heat. Its 7 already and still no internet, ridiculous.

 

[websquadza]

Top of the morning to you.
Thanks - I'll try to fend off the beast with coffee. Don't know how long I can last.

I hope AEX is feeling the heat. Its 7 already and still no internet, ridiculous.

Ok great news. Services are back up and traffic’s flowing.

Please let us know if you have any issues getting connected.

 

[ajv]

Great, seems to be back up.
I should have ranted earlier

 

[Cowboy619]

All up and running

 

[Sopbeen]

Ok great news. Services are back up and traffic’s flowing.

Please let us know if you have any issues getting connected.

PROF FARNSWORTH: "GOOD NEWS EVERYONE"

All good in the hood - thank you sir. On top of the ball as usual

 

[Pho3nix]

Should be joining you guys once more end of this month it seems

 

[DarkSt0rm]

Route troubles? Been disconnected from WoW several times in the past few minutes :/ Mates don't have an issue though.

Can't even log in now :sob:

 

[PsyWulf]

Route troubles? Been disconnected from WoW several times in the past few minutes :/ Mates don't have an issue though.

Can't even log in now :sob:
View attachment 796043

Yep something's wobbly,packet loss across a few services

 

[websquadza]

We're investigating, will update shortly

 

[DarkSt0rm]

Can't access most sites now either...

Also can't connect to several local ProtonVPN or ExpressVPN servers, took several retry attempts. However connection is restored over VPN so I'm happy for now

 

[duanesf]

Yup, completely down here - Vumatel trenched, 1000/ 100, Gallo Manor area.

 

[websquadza]

Update: Picking up on a broadcast storm generating about 80 Gbps on our core switches. It seems that loop protection has failed somewhere. Techs are on their way into DC now to break the loop (Just need to run from NOC to key store to DC) - +- 5 mins.

 

[PsyWulf]

Seems to have calmed down

 

[websquadza]

OK, issue resolved. Services Fully restored. My apologies for the inconvenience. Full RCA will be conducted to find the cause.

 

[abudabi]

20 mins... damn you guys are good

 

[Napalm]

My link down. Fibre trenched, vuma , bo oakdale, bellville

 

[websquadza]

My link down. Fibre trenched, vuma , bo oakdale, bellville

No net issues or reported issues from Vumatel yet. Can you submit a ticket?

 

[Napalm]

No net issues or reported issues from Vumatel yet. Can you submit a ticket?

Logged a ticket :
TICKET CREATED #216554