I have a 56 TB local Unraid NAS that is parity protected against single drive failure, and while I think a single drive failing and being parity recovered covers data loss 95% of the time, I'm always concerned about two drives failing or a site-/system-wide disaster that takes out the whole NAS.

For other larger local hosters who are smarter and more prepared, what do you do? Do you sync it off site? How do you deal with cost and bandwidth needs if so? What other backup strategies do you use?

(Sorry if this standard scenario has been discussed - searching didn't turn up anything.)

you are viewing a single comment's thread
view the rest of the comments
[–] 4 points 8 months ago* (5 children)

I use aws s3 deep archive storage class, $0.001 per GB per month. But your upload bandwidth really matters in this case, I only have a subset of the most important things backed up this way otherwise it would take months just to upload a single backup. Using rclone sync instead of just uploading the whole thing each time helps but you still have to get that first upload done somehow...

I have complicated system where:

  • borgmatic backups happen daily, locally
  • those backups are stored on a btrfs subvolume
  • a python script will make a read-only snapshot of that volume once a week
  • the snapshot is synced to s3 using rclone with --checksum --no-update-modtime
  • once the upload is complete the btrfs snapshot is deleted

I've also set up encryption in rclone so that all the data is encrypted an unreadable by aws.

  • source
  • hideshow 5 child comments
  • [–] 1 point 8 months ago (1 child)

    It is cheap as long as you don't need to restore your data. Downloading data from S3 costs a lot. OP asked about 56TB of storage, for which data retrieval would cost about 4.7k

    https://aws.amazon.com/s3/pricing/ under data transfer

  • source
  • parent
  • hideshow 1 child comment
  • [–] 1 point 8 months ago

    I'm aware, but I myself have < 3TB and if I actually need it I'll be more happy to pay. It's my "backup of last resort", I keep other backups on site and infrequently on a portable HDD offsite.

  • source
  • parent
  • [–] 1 point 8 months ago (2 children)

    Don't do this. It's a god damn nightmare to delete

  • source
  • parent
  • hideshow 2 child comments