Facebook hit by global outage - WhatsApp, Instagram, and Facebook offline

John Tempus

Executive Member
Joined
Aug 8, 2017
Messages
5,812
The amount of 'network' specialists here speading misinformation is frightning.

Not misinformation, takes literally a few seconds to look at dns propagation tools to realize, facebook.com is wiped off the planet.

That my friend is how it looks when you got wiped or someone actually did a sophisticated dns hijack. I think the former is more likely at this time.

facebook.png
 

AfricanTech

Honorary Master
Joined
Mar 19, 2010
Messages
37,289
f02848dfd3138011b348d78ec2444688.jpg

 

RVQ

Expert Member
Joined
Apr 30, 2007
Messages
2,112
So let's say FB had a secondary DNS server right here in ZA and it still answered DNS requests. Since it's hosted in ZA it would be part of some ZA based ISP's BGP routing. Hence it would have been reachable on the internet. That little secondary DNS server would have have been able to answer DNS requests even though the main FB networks are not reachable and hence be able to at least redirect users to some backup servers that's not part of their single point of failure servers. Now just scale up this little ZA example to somewhere with more bandwidth like the UK. You don't understand how DR is supposed to be done.

I will say it again, someone or something nuked all their dns records.

If you have dns outtage or server outtage or any sort of outtage, your dns records would still show a history of actual last known dns nevermind the entries won't just vanish.

This is more than just an "oopsie fat fingers".

Its not a DNS issue, their DNS servers are hosted by Amazon, so the internet knows the addresses but there's no route to them because their BGP routes have been pulled...
 

marine1

Honorary Master
Joined
Sep 4, 2006
Messages
48,779
Not misinformation, takes literally a few seconds to look at dns propagation tools to realize, facebook.com is wiped off the planet.
So for us non IT experts what does this mean? How does it get put back ?
 

Muffin

Active Member
Joined
Jun 8, 2006
Messages
55
You don't know me, yet you claim I know nothing. I've been involved in BGP routing many years ago, so I do know how it works. You can't discount that FB has no DR strategy and that all their eggs are in one basket when it comes to a network failure. Go read my other posts where I make valid points about their DNS and DR strategy. Yes, systems of that size would need a lot of planning and resources to have proper DR, but it seems they have no strategy.
 

marine1

Honorary Master
Joined
Sep 4, 2006
Messages
48,779
This is the problem when you allow Facebook to control Social media
FB needs to be broken up !!!
 

Foxhound5366

Executive Member
Joined
Oct 23, 2014
Messages
8,119
Nuked and probably held hostage.

If you cant get into your dns tools then you cant get back in.

Might be fighting to get access or who knows what, they won't tell us with minute by minute updates on a situation like this.
Did they try “reset password” though?
 

gregmcc

Honorary Master
Joined
Jun 29, 2006
Messages
23,599
Not misinformation, takes literally a few seconds to look at dns propagation tools to realize, facebook.com is wiped off the planet.
DNS is one of the symptoms, not the cause. A BGP change was made to Facebooks ASN that caused it to drop off the internet. As a result you can't lookup facebook domain anymore. Even if you could, FB network is not reachable.
 

ToxicBunny

Oi! Leave me out of this...
Joined
Apr 8, 2006
Messages
99,730
You don't know me, yet you claim I know nothing. I've been involved in BGP routing many years ago, so I do know how it works. You can't discount that FB has no DR strategy and that all their eggs are in one basket when it comes to a network failure. Go read my other posts where I make valid points about their DNS and DR strategy. Yes, systems of that size would need a lot of planning and resources to have proper DR, but it seems they have no strategy.
Must be very disjointed and small scale bgp routing and never global enterprise scale stuff then.
 

John Tempus

Executive Member
Joined
Aug 8, 2017
Messages
5,812
DNS is one of the symptoms, not the cause. A BGP change was made to Facebooks ASN that caused it to drop off the internet. As a result you can't lookup facebook domain anymore. Even if you could, FB network is not reachable.

I don't believe this for one second.

A company as big as facebook would not go down like this, it is not rocket science to route them back up on any available network if that was indeed the issue.

For that simple reason I don't believe they are down for this long due to BGP routing.

Article on sunday, wiped out on monday. I think someone went rogue with too much power and tried to do as much damage today. Conspiracy or not.
 

Ghost64

Expert Member
Joined
Sep 12, 2021
Messages
1,844
Why are they hosted by Amazon? Are they not big enough to host themselves?
 
Top