3
Brief outage Feb 21st (anarchaos.s3.eu-central-003.backblazeb2.com)
submitted 8 months ago by to c/bloc@anarchist.nexus
4 comments fedilink hide all child comments
 

Ahoy! It would seem that the Hetzner Helsinki Datacenter is having an outage that caught our little corner of the webs...

Luckily, our backups were updated just before their systems went down, and I was able to spin up a replacement and move DNS over. While things all cleared on my scopes, if you see trouble, please reach out in a DM.

Alternately, find us via matrix:

https://matrix.to/#/#faf-flotilla-lounge:anarchist.nexus

Apologies for the troubles!

nuclear mushroom cloud

all 4 comments

sorted by: hot top controversial new old
[–] 2 points 8 months ago (3 children)

The outage lasted long enough for it to be worth to move the entire server? Come one, don't make us other instance admins look bad 😅

  • permalink
  • fedilink
  • source
  • hideshow 3 child comments
    •
  • [–] [S] 1 point 8 months ago (2 children)

    In proper IT tradition... as soon as the new server was up and running and settled down, Hetzner got the issue with the previous node solved.

    Because of course.

    The little "good sysadmin" guy on my left shoulder is chastising me for not having failover and a floating IP already set up for this kind of thing.

    The little "devops burnout" guy on my right shoulder is chuckling at me and whispering something about just writing a BASH script to do it in a janky way and forget about it.

    I am caught in the middle and will probably do something with haproxy and keepalived. Such is the life of Ops.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •