fire 20% of their personnel

slopify

things fail

Sounds like a closed case to me.

I'm sure it all came down to poor upper management decisions which they will try to blame on technology

By 2030 AI is gonna completely replace sysadmins as the cause of outages.

The main reason for problems: Bad IT administration that relies way too much on Microsoft.

I'm sure the truth will emerge in coming days but was interested in the more tech savy people's opinione.

Why speculate when you will get it dfrom the horses mouth in a couple days?

But my 2¢ is a bad code being deployed.

Something something health control on too much servers shut them down, which made the others overloaded. My money is on the health monitoring being vibecoded.

I blame Jensen's leather jacket. It's clearly way too powerful.

EDIT: There's...a 3rd mistress now? Giggity.

There's been rumours about insufficient capacity on Microsoft cloud services around Europe for a while. Unofficial of course, and who knows how many "broken phones" has been on the chain before me, so don't take that as a fact. However, Microsoft stated that the problem started when they increased capacity, so maybe some initial synchronization or load balancing starting up caused extra load on the servers already running on pretty much full load and caused cascading failure.

Of course I don't know for sure and I don't expect we'll get a full technical brief with details and the main reason is management problems no matter what's the technical cause. I hope at least someone wearing a suit starts to think that maybe cloud isn't really the answer to everything. And it's not just 3654, a shit ton of different cloud services relies on AWS, Cloudflare and other players and if any of those goes down they'll take considerable chunk of business critical infrastructure with them.

All I can say for sure, is that nobody knows for sure.

At the moment, we can only guess. My guess: an update (maybe of a load balancer) went wrong. We will never know for sure.

this does once again prove that companies that put all their eggs in one basket, are at yhe mercy of big tech.

I am certainly no Microsoft lover, but 12-24hrs of downtime every few years seems like a highly reliable system compared to the cost of rolling your own software stack for the majority of companies.

If this event turns out to be a harbinger of what's to come I'll change my tune but I would be shocked if this single period of downtime led to a shift away from Outlook.

I think it is a cascading effect some unmaintained and forgotten server gave out causing others to fall.

Thats what think not based on any facts.

I’m sure this day loss of productivity and not even a total outage will have everyone hiring teams to run their email. I’m sure it’ll be cheaper and definitely more reliable 🙄

Y’all really don’t understand how the money flows or how expensive it is to run this shit.