368
Pirate archivist group scrapes Spotify's 300TB library, posts free torrents for downloading 86,000,000 tracks — investigation underway as music and metadata hit torrent sites (www.tomshardware.com)
submitted 10 months ago by to c/cybersecurity@sh.itjust.works
53 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[–] 33 points 10 months ago (4 children)

Damn, I wish I could afford to buy 300TB of local data storage.

  • permalink
  • fedilink
  • source
  • hideshow 4 child comments
    •
  • [–] 20 points 10 months ago (3 children)

    Looks like you can get refurbished 26TB drives for about £340, so 12 of those. PCIe -> 6x SATA adaptors run you about £40 each. Molex to SATA power adaptors about £5. So £4200 will let you store all that with a bit left over for postage and some duct tape to make a storage bay out of the boxes it all came in.

    I'd probably want a few more drives for RAID6 and some hot spares, but if you go JBoD then at least you can just download the torrent again ;-)

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 3 child comments
    •
  • [–] -1 points 10 months ago (1 child)

    Research RAID more effectively.

    RAID-10 is far more efficient not only as a transfer speed but also as redundancy across large arrays. It’s only nerf is storage inefficiency.

    RAID-6 requires serious computing oomph to create the parity bits, which dramatically slows down writes and rebuilds. It also needs only two drive losses across any one array before the whole array dies. Conversely RAID-10 has only duplication, no parity, so compute load is far lower and writes/rebuilds are a lot faster, and it can have up to half of all drives fail before the array is irretrievably broken.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •
  • [–] 14 points 10 months ago

    Yeah yeah, I know RAID.

    If OP can't afford the storage for 'just a bunch of disks', then paying twice as much for 100% redundancy in RAID10 is doubly unaffordable.

    Also, consider what is being stored here. It's music files that we obtained from a torrent. We need sufficient raw performance to read a few megabytes per minute so we can listen to them. As a bonus, we may wish to upload the torrent again, and can use any spare capacity for that. What benefit are you going to obtain from your very expensive storage solution?

    RAID6 can lose any two drives, but at most two. RAID-10 can lose only 1 drive with guaranteed no data loss. Losing two might lose the cluster, if you lose a drive and its mirror. Yes, if you're really lucky, you can lose up to half, but 'feeling lucky' isn't how we plan data storage. Doesn't matter, we've got a backup - download the torrent again ;-)

  • permalink
  • fedilink
  • source
  • parent