carrylex comments on So how is it going South Korea?

[–] carrylex@lemmy.world [S] 23 points 1 year ago (4 children)

If I had a nickel for every time someone didn't backup their datacenter, I'd have two nickels.

Which isn't a lot, but it's weird that it happened at least twice.

permalink

fedilink

source

hideshow 4 child comments

[–] marcos@lemmy.world 23 points 1 year ago (2 children)

Last time we lost disks at work, there were full backups.

They were just in the same disks as the data. And because everything is abstracted two times into virtual disks on virtual machines, and containers and volumes, the people responsible for the backups didn't even know it.

permalink

fedilink

source

parent

hideshow 2 child comments

[–] Winter_Oven@piefed.social 16 points 1 year ago* (1 child)

But won't you like...check? That the backups are own their own drive? The whole 3-2-1 rule kinda make you want to check this, no?

Or was it like they knew where the drives of the backups were, but they didn't know those drives were being virtualized away and were in like production use?

permalink

fedilink

source

parent

hideshow 1 child comment

[–] marcos@lemmy.world 15 points 1 year ago*

I dunno what possibilities they actually had. But knowing the place, I can fully believe both that they weren't allowed to check and that they never bothered.

The most likely scenario in my head was that they sent a request to the provisioning team asking for the volume to be in a different disk, and that detail never made into the technician actually doing the work (that sits on the next chair, but the requests have to come from the system).

(And the long term backups were fine. We lost 3 days of data.)

permalink

fedilink

source

parent

load more comments (1 reply)