You'd be hard pressed to find an online service that isn't associated with AWS in some way.
post
The really stupid thing is that even if you weren't in AWS east us 1 you were still boned because that is where AWS does it's service authentication.
I love it when Cloud companies pretend there are "serverless" services that are "location-transparent"
You know, they sell this crap to governments and have to follow compliance regimes like FedRAMP but yet... this happens
But the only way to do this is to have a CSO willing to invest heavy in red-teaming -- for attacks of every kind the team can brainstorm -- and a CEO willing to spend the $$ and attention to get their recommendations implemented.
I just want AWS, Azure, Google, & Cloudflare to go down at the same time.
And maybe stay down.
If a nation wants to go to war with the US ... this is how they do it, they just shut down one, two or all of these systems down and watch the country go crazy. It wouldn't destroy the country, just disrupt it enough to make them go nuts and then do more things to them in other ways.
It's amazing when you think about it, first the US invested in heavily defending and arming itself in the 60s, 70s and 80s ... then it spent billions more in the 90s and 2000s to try to come up with ever more inventive ways to screw itself from the inside.
No. Everyone always focuses on the flashy stuff like datacenters but the truth is that the most vulnerable, overtaxed, and underfunded weak-spot for the United States is the electric grid.
Yup. Most of our core electrical infrastructure is over 100 years old now. And thanks to a combination of NIMBYism, profiteering, and the anti-nuclear brigades, we're not likely to see that change any time soon.
I'm pretty convinced that if we did have a complete grid failure, we wouldn't be able to complete a cold start.
Too many people would be pushing for their section to be started first so they could short the market first.
Edit: my proofreading sucks
Doesn't matter who wants want, the power company has contingency plans and those plans are what is happening.
SOURCE: Worked for Cox after a major ice storm smashed north-central Oklahoma flat. Lived Hurricane Ivan and saw their rollout priorities.
To be pedantic for a sec, the term is black start. Just cause I think it's super dystopian sounding.
Which in turn would take down the datacenters too, so same effect, just more severe
Most data centers are backed up by generators.
I feel like you got it backwards. Letting them run is doing more damage than turning them off would.
If the way someone goes to war with the US is by freeing us from the overly-centralized landlords of the Internet, maybe whoever they are isn't so bad.
I brought down all my department's services to take a day off and blame it on Amazon. Next year when negotiating a raise/budget increase, I'll point to this incident and take credit for migrating us off AWS after six months of in-person training classes (either in places I haven't visited or would like to see again) and another six months of hard work in the office (napping in the server room).
2026 is looking pretty good already and I definitely won't regret tempting fate by saying that.
Same, Canvas is perhaps the most used Learning Management System in the US and they apparently are entirely hosted on AWS East. The real kicker is I had my students midterm due date literally today for two classes. I've been swamped with panic emails (and I made clear my due dates aren't even that important when there isn't a national outage lol).
My head canon is someone wished for a miracle due date extension somewhere in the country and they monkey's pawed AWS into non existence.
I thought Canvas was self hosted? Or do they offer service instances too?
I'm sure there's a self hosted option but no way in hell it's as popular as it is without being a turnkey solution. Most smaller districts wouldn't touch anything self hosted with a 10 foot pole. They don't have the resources.
I thought that too until today, it's never clear until a quarter of the Internet is down randomly.
I wouldn't look at it that way. Even companies not leveraging AWS directly will be impacted.
Especially Microsoft, Google, and Oracle, who are all at this very moment probably sending out sales droids in vast numbers
There's so much vendor lock in with AWS, migrating to another provider over an outage even lasting 24h would be a tough sell. This isn't unique to AWS either, each of the cloud vendors have their own lock in and their own problems. If you had the money you could run in multiple clouds, but for most businesses who were only running in a single region, I can't imagine they'd choose this option.
Sounds like those companies are not considering the capabilities of their supply chain then.
All of them?
All of them.
EBSCO was down. Ask me how my dissertation writing progressed today...
How did your dissertation writing progress today?
Half the articles I needed to read couldn't be accessed due to aws. I figured I would grade assignments in the mean time, up until I learned e-learning was down as well. Nothing came back up till about 3.
Thanks for asking. How was your day? Was it affected by the AWS outage?
My school uses canvas for assignments, and it was down. It was pretty hectic for the teachers. Its amusing to me to see so many services down. Reminds me of the xkcd cloud. https://xkcd.com/908/
Yep, I just love how one service provider goes down and way to much of the internet goes down with it.
Same.
I think my school might have had a local mirror of their d2l brightspace instance though because it miraculously was still up, but taking multiple minutes to load pages
scums
Not a plural/countable word.
One scum. Two scums. Three scums. Four scums.
Seems countable to me.
Is atlassian scum? Confluence was acting all kinds of fucking terrible today.
It's funny aws report didn't mention 40% stops were replaced by AI. https://blog.stackademic.com/aws-just-fired-40-of-its-devops-team-then-let-ai-take-their-jobs-d9db9d298bfa
top 85 comments