Cloudflare Explains How Facebook Disappeared from the Internet

The folks at Cloudflare have published a fascinating look into the recent ~6 hour long downtime that the Facebook network went through, taking down not just the Facebook product itself, but also WhatsApp, Instagram, FB’s internal looks, and a lot more. It’s a somewhat technical explanation, but Cloudflare’s Tom Strickx and Celso Martinho have made it very easy to understand.

Today at 1651 UTC, we opened an internal incident entitled “Facebook DNS lookup returning SERVFAIL” because we were worried that something was wrong with our DNS resolver 1.1.1.1. But as we were about to post on our public status page we realized something else more serious was going on.

Social media quickly burst into flames, reporting what our engineers rapidly confirmed too. Facebook and its affiliated services WhatsApp and Instagram were, in fact, all down. Their DNS names stopped resolving, and their infrastructure IPs were unreachable. It was as if someone had “pulled the cables” from their data centers all at once and disconnected them from the Internet.

How’s that even possible?

It’s really interesting to see how a (possibly) minor piece of code can take down large parts of the internet like this. Honestly, it would be a good thing for the internet overall of Facebook disappears from the internet, but I feel for everyone at Facebook behind this issue. Major hugs to the people involved in bringing the network back up.

Then again, imagine messing up so bad that your boss ends up losing $6 billion.

October 5, 2021 ✚ Permalink

Instagram Announces Changes to “Improve” Your Feed

Instagram has today announced that it is making some changes to the Instagram Feed. The feed has been my single biggest annoyance about the app over the last few months, so I was excited when I read the title. Not only are the ads that show up every three posts irrelevant and annoying, the out-of-order timeline is even more terrible.

Unfortunately, these changes are too little and too late.

We’ve heard it can feel unexpected when your feed refreshes and automatically bumps you to the top. So today we’re testing a “New Posts” button that lets you choose when you want to refresh, rather than it happening automatically. Tap the button and you’ll be taken to new posts at the top of feed — don’t tap, and you’ll stay where you are. We hope this makes browsing Instagram much more enjoyable.

and

Based on your feedback, we’re also making changes to ensure that newer posts are more likely to appear first in feed. With these changes, your feed will feel more fresh, and you won’t miss the moments you care about. So if your best friend shares a selfie from her vacation in Australia, it will be waiting for you when you wake up.

The first change is nice, but what is up with the second? “More likely”? Why can’t I just see the posts in the feed in the order they were posted? Goddamnit!

Facebook really needs to stop shoving its algorithms everywhere.

March 23, 2018 ✚ Permalink