We backed up Spotify (metadata and music files). It’s distributed in bulk torrents (~300TB), grouped by popularity.

This release includes the largest publicly available music metadata database with 256 million tracks and 186 million unique ISRCs.

It’s the world’s first “preservation archive” for music which is fully open (meaning it can easily be mirrored by anyone with enough disk space), with 86 million music files, representing around 99.6% of listens.

all 91 comments

sorted by: hot top controversial new old
[–] 107 points 10 months ago (3 children)

After Meta scraped all their books they have the perfect defense now. All they have to say is "we're training a music AI" and they're apparently untouchable.

  • source
  • hideshow 3 child comments
  • [–] 29 points 10 months ago (1 child)

    Well, they have to say "we're training a music AI" while slipping several million dollars into the pockets of the right people. Rich people don't win legal battles by actually proving what they did isn't illegal, they do it by discreetly paying people to say they did.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 144 points 10 months ago (8 children)

    damn, annas is fucking based. hope they stay safe..

  • source
  • hideshow 8 child comments
  • [–] 39 points 10 months ago* (last edited 10 months ago) (7 children)

    I fucking love annas archive.

    Anna does seem rather insane though

    Edit: I was thinking of Alexandra Elbakyan, the creator of Sci-Hub

  • source
  • parent
  • hideshow 7 child comments
  • [–] 12 points 10 months ago (6 children)

    C'mon you gotta say why im curious

  • source
  • parent
  • hideshow 6 child comments
  • [–] 6 points 10 months ago* (last edited 10 months ago) (5 children)

    iirc her writings gave me the impression that she basically worships communism and famous soviet communist leaders in a vaguely religious way. I can go look again later and elaborate. It could just be the language barrier that gave me that impression.

    Edit: I was misremembering Alexandra Elbakyan, the creator of Sci-Hub, as Anna of Anna's Archive. Oops

  • source
  • parent
  • hideshow 5 child comments
  • [–] 6 points 10 months ago

    Down with the bourgeoisie

    Eat the rich

    Sodomize the land-owners

    Impale all people who have more than 25 reál in their pocket

    Literally murder all human beings regardless of their political beliefs

  • source
  • parent
  • [–] 1 point 10 months ago (2 children)

    Huh, weird. Where can I find the writings?

  • source
  • parent
  • hideshow 2 child comments
  • [–] 2 points 10 months ago (1 child)

    I went to look for a link for you and found that I was misremembering. I was thinking of Alexandra Elbakyan, the creator of Sci-Hub, one of the libraries that Anna's Archive indexes. In case you're curious about her, here's an archive of her personal page on Sci-Hub

  • source
  • parent
  • hideshow 1 child comment
  • [–] 47 points 10 months ago (6 children)

    Anyone knows if spotify metadata have BPM and keys?

  • source
  • hideshow 6 child comments
  • [–] 37 points 10 months ago (2 children)
  • [–] 9 points 10 months ago (1 child)

    Would love lmao. Just bought a second hand VDJ and I'm starting to experiment with mixxx, and I don't know is the style I like (latincore and adjacents) or if the BPM detected of mixxx isn't that good.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 32 points 10 months ago* (last edited 10 months ago)

    Both. Per the SQL schema printed in the article, table track_audio_features has both fields tempo and key along with many other technicals. Worth checking out, it's near the bottom of the page.

  • source
  • parent
  • [–] 4 points 10 months ago

    Yes, and it hasn’t been easy to dig up until recently. There were a few ways to search the “hidden” metadata fields that Spotify uses internally. But it definitely hasn’t been easy or straightforward.

    Those hidden fields are how Spotify recommends similar artists. You have a few bands on repeat with specific instruments, chord progressions, and singer vocal range? Gee, maybe you’ll enjoy other bands that are similar to that…

  • source
  • parent
  • [–] 22 points 10 months ago (4 children)

    Does anyone see the torrent links?

  • source
  • hideshow 4 child comments
  • [–] 43 points 10 months ago* (3 children)

    It says,

    The data will be released in different stages on our Torrents page:

    [X] Metadata (Dec 2025)

    [ ] Music files (releasing in order of popularity)

    [ ] Additional file metadata (torrent paths and checksums)

    [ ] Album art

    [ ] .zstdpatch files (to reconstruct original files before we added embedded metadata)

  • source
  • parent
  • hideshow 3 child comments
  • [–] 12 points 10 months ago (2 children)

    Yeah, I saw that and assumed they'd be torrents of the metadata.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 38 points 10 months ago (31 children)

    Are these the actual music files you can use to play as well?

  • source
  • hideshow 31 child comments
  • [–] 40 points 10 months ago (27 children)

    Would be amazing if it was. I would love to just have Spotify's music on my nas

  • source
  • parent
  • hideshow 27 child comments
  • [–] 24 points 10 months ago (20 children)

    If your nas has 300tb spare, you could.

  • source
  • parent
  • hideshow 20 child comments
  • [–] 14 points 10 months ago (18 children)

    How much could it cost $10,000

  • source
  • parent
  • hideshow 18 child comments
  • [–] 11 points 10 months ago (4 children)

    A RAID6 of 24 * 20TB drives could contain that with both parity and hotswap, with room to spare. Let's say $400 per refurb drive, $2500 rackmount SAS enclosure, $2000 SAS RAID card, $14,100 total. Assuming you already have the server and power and SAS cables.

  • source
  • parent
  • hideshow 4 child comments
  • [–] 4 points 10 months ago (3 children)

    You could budget this way down. I run 10+2 12TB with Unraid. No reason for a raid card if it's for archive and personal use.

  • source
  • parent
  • hideshow 3 child comments
  • [–] 1 point 10 months ago (1 child)

    100% this. People who store easily replaceable media on RAID are just throwing away money (unless you have a need for faster read/write). If it's your family photos, copy of your in progress thesis, or other irreplaceable piece of info/content go for it.

    I have like 40tb Unraid NAS and I get asked pretty much every time I talk to someone about it how I do backups. Easy, I backup my *arr stack databases and in case of a failure I restore them and let it pull down everything over time. Which I have done in the past when I wanted to upgrade quality, easier for me to scrub it all and start over than make upgrade profiles and such.

    Or that's what I would have done, now I mostly use DebridService du jour and Stremio :-)

  • source
  • parent
  • hideshow 1 child comment
  • [–] 1 point 10 months ago*

    Nice sounds similar to what I do. I bought Unraid because everyone always suggested it. No regrets. It really makes things simple and have only had minor problems (usually related to docker). I had a HDD fail and recovery was easy (besides the 18 hours of rebuild). But the drive is emulated during repair so no real downtime.

    Family photos I use cloud storage for. I could probably get away with just doing local because I do hate that I'm sure they are being used to train AI. But I'd have to do off-site storage somewhere anyway. Parity drives don't really do well in the "fire" scenario. Don't want to have any risk of losing photos of my daughter growing up.

  • source
  • parent
  • [–] 1 point 10 months ago

    Oh totally, could do SATA instead of SAS too. I used to build out servers and render farms for motion graphics studios that needed the ability for multiple people to be doing high-bandwidth operations on the same network drive, and the above was just kind of the default offering.

  • source
  • parent
  • [–] 2 points 10 months ago (10 children)

    Considering the Price per TB is 10-11 US dollars, it's gonna cost $3500 max

  • source
  • parent
  • hideshow 10 child comments
  • [–] 17 points 10 months ago (3 children)

    10US dollar per TB?? 🤣🤣 More like 30/35€ per TB for a good graded HDD!

    Let's not talk about SSDs or nvme which are more in the 120€/TB.

    I always hear people say that storage comes cheap nowaday... I'm still looking for that cheap HDD on amazon... It has been 10 years 🤣🤣

  • source
  • parent
  • hideshow 3 child comments
  • [–] 9 points 10 months ago* (last edited 10 months ago) (1 child)

    $10/TB is a bit low, but not far off. Serverpartdeals has refurbed enterprise/NAS drives at about $15/TB right now, and thats with the AI pressure driving up prices. I recall seeing 18TB drives around $12/TB a few months back.

    The above is well loved vendor in the IT space. Much better place to buy from than Amazon, as they actually guarantee their inventory is legitimate.

  • source
  • parent
  • hideshow 1 child comment
  • It seems this post was locked down for some reason so I couldn't reply sooner.

    Here you go -

    $10.61/TB - HGST Ultrastar He8 HUH728080AL5200 | 0F23268 | 8TB 7.2K RPM 128MB Cache SAS 12Gb/s 512E 3.5"

    $10.83/TB - WD-40 Ultrastar HE12 12TB SAS 512E

    $12.65/TB - Seagate Expansion Desktop 26TB, Externe Harde Schijf, 3.5"

    $13.63/TB - Seagate Expansion 22TB External Hard Drive HDD - USB 3.0

    If it weren't for AI creating a shortage of drives, these prices would've been even cheaper

  • source
  • parent
  • [–] 6 points 10 months ago* (5 children)

    Is it that cheap now?? I would kill for 10tb

  • source
  • parent
  • hideshow 5 child comments
  • [–] 4 points 10 months ago* (last edited 10 months ago) (3 children)

    Here you go mate. They dont have 10TB in stock, but the do have 20TB refurbs at around $15/TB.

  • source
  • parent
  • hideshow 3 child comments
  • [+] 1 point 10 months ago* (2 children)
  • [–] 2 points 10 months ago* (1 child)

    Where are you getting $430? Im seeing $306, which puts the per TB at $15.34.

    A lot closer to the $10 the poster above was talking about than the $30-35 the person mocking him was saying drives cost.

    Its also a refurbed drive from a well trusted, quality vendor that does testing on each drive and offers a 3 year warrenty.

  • source
  • parent
  • hideshow 1 child comment
  • load more comments (-1 replies)
  • [–] 52 points 10 months ago (5 children)

    I'd wager 70% of what's on Spotify is not worth preserving since its AI slop.

  • source
  • parent
  • hideshow 5 child comments
  • [–] 10 points 10 months ago

    They've released torrents of the metadata, and they plan to release the music files, but they haven't yet. They intend to start by offering the downloads as bulk torrents, but they're open to considering implementing the ability to download single songs in the future.

    So in short, yes, but you can't download them yet

  • source
  • parent
  • [–] 5 points 10 months ago

    Not yet, but that’s the end goal. The tricky part is that they’re only offering bulk downloads for now, which means downloading a single artist or album would be difficult/impossible. You’d need to download the entire compressed file of like 300GB of music, then extract the specific songs/artists/albums you wanted. The goal for now is preservation, meaning they want to make the bulk download as easy as possible, to make sure people can preserve it. Once they’ve got that in a pretty good spot, they may look into allowing more granular downloads.

  • source
  • parent
  • [–] 16 points 10 months ago*

    Does this make Anna's Archive the top music tracker now? Lol move over RED

  • source
  • [–] 14 points 10 months ago (2 children)

    Dns blocked in germany. fun.

  • source
  • hideshow 2 child comments
  • load more comments (1 reply)
    [–] 12 points 10 months ago
    [–] 12 points 10 months ago

    Almost makes me want to get into torrenting again. But dab.yeet.su, squid.wtf, and doubledouble.top usually have me covered with ddl

  • source
  • [–] 12 points 10 months ago (1 child)

    "Honey, all I need is $10,000 for a server and we'll never pay for Spotify again"

  • source
  • hideshow 1 child comment
  • load more comments (1 reply)
    [–] 27 points 10 months ago (1 child)

    Now make it streamable and make a stremio-like music client 🤞

  • source
  • hideshow 1 child comment
  • [–] 17 points 10 months ago (2 children)

    I cannot fathom the legal fees that will be incurred if they release 99.6% of Spotify to the public for free. Holy fucking shit.

  • source
  • hideshow 2 child comments
  • [–] 8 points 10 months ago (11 children)

    I wonder why Spotify and not YouTube Music, Tidal or Apple Music all of which are higher quality.

  • source
  • hideshow 11 child comments
  • [–] -1 points 10 months ago (3 children)

    No one can tell the difference beyond 320kbps

  • source
  • parent
  • hideshow 3 child comments
  • load more comments (-1 replies)
  • [–] 8 points 10 months ago (1 child)

    Would be interesting if someone checked what % of that archive is slopified.

  • source
  • hideshow 1 child comment
  • [–] 2 points 10 months ago

    Is that ALL off the songs?

  • source
  • [–] 1 point 10 months ago (3 children)

    Ok, how do we download this?

  • source
  • hideshow 3 child comments
  • [–] 4 points 10 months ago* (2 children)

    Step 1: Buy £6,000 worth of identical hard drives and a motherboard with 16 SATA ports. Or £12,000 worth and a RAID 1 server rig. Or £24,000 and RAID 6

  • source
  • parent
  • hideshow 2 child comments
  • [–] 1 point 10 months ago

    6k for 10TB?

    A Raspberry pi with a sata hat and 16TB hard disk could download and serve this for well under 500 quid.

    An off the shelf 4 bay NAS with 4x 6TB drives in raid 5 would give you 15TB or so formatted capacity with redundancy. That would easily be under 2k... Jeez grab 2 and sync contents to a second location.. even a third location.. Still under 6k.

  • source
  • parent
  • [–] 1 point 10 months ago

    more like "backify". seriously!

  • source
  • [–] 1 point 10 months ago

    I got 10tb I'll throw at a few slices of this.

  • source
  • 34 comments in c/datahoarder@lemmy.ml view that post
    1 comment in c/datahoarder@selfhosted.forum view that post