With how many lawsuits they get and the total amounts they now have technically lost in court, how is it possible they still hide their hosting infrastructure? Anna's archive hosts a truly monumental amount of content and its not like its exactly easy to host petabytes(?) of content in secret easily. Hell the orders for hard drives should make it easy to find them. It's not like they can just tuck a raspberry pi with an Ethernet connection somewhere and throw up a proxy and call it a day. What kind of techniques are required to hide that amount of infrastructure? Especially under such scrutiny as the US government and many publishers coming for their throats I can't imagine it's a small feat.

all 28 comments

sorted by: hot top controversial new old
[–] 45 points 4 months ago* (1 child)
  • [–] 82 points 4 months ago (2 children)
  • [–] 72 points 4 months ago (13 children)

    Tldr all the site data has an offline copy that can be restored from scratch on endless numbers of types of servers.

    They don't really hide most of the servers. They simply put them in places where enforcement is slow. Then when the server goes down it doesn't point at anyone because it's simply hired anonymously. And then they hire another server and put the data back up.

  • source
  • hideshow 13 child comments
  • [–] 50 points 4 months ago (4 children)

    They also have all the data in a set of torrent files.

    I've actually been working on an AA client + Readarr (yes yes I know the main project is dead, I meant for generally book-related Arr stack projects) provider.

    The idea is pretty straightforward:

    • the client connects to the current AA instance and grabs the torrents
    • each torrent is added to a built-in client, with all files set to "don't download" (so at the moment it does nothing beyond peer discovery)
    • each torrent is now versioned and provides a metadata batch of all files and paths included
    • metadata is matched to paths during lookup
    • provider interface allows upstream software (e.g. Readarr, Chaptarr, etc.) to search for a specific release with some extra parameters (language, format, date added, etc.), uses AA approach of hash to path matching
    • path is matched to torrent, within that torrent, that path is set to be downloaded
    • upon download the file path is softlinked to destination provided for download
    • upstream picks up new file and parses it (then it gets passed to CWA, AudioBookShelf, Kavita or whatever other frontend you use)
    • the client also automatically selects 500MB worth of files with low availability. This 500MB is separate from what the user has actually downloaded, and is used to contribute back to the P2P net
  • source
  • parent
  • hideshow 4 child comments
  • [–] 8 points 4 months ago (1 child)

    This seems similar in general outline to Hyphanet, a system for distributed data storage that automatically handles random distribution and distributed searching. Unfortunately I don't think Anna's Archive puts its data on there, but perhaps you could consider having your client bridge to that and use it as an additional backup cache.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 1 point 4 months ago (7 children)

    They do hide the servers though, see other commenter's link - straight from the horse's mouth

  • source
  • parent
  • hideshow 7 child comments
  • [–] 1 point 4 months ago (6 children)

    Your computer always connects to something using an IP adress which is not hidden. That something can be a proxy or similar to hide another server, but there's always a visible server.

  • source
  • parent
  • hideshow 6 child comments
  • [–] 3 points 4 months ago (5 children)

    A proxy server is used to hide the actual application server. They also run separate servers on tor

  • source
  • parent
  • hideshow 5 child comments
  • [–] 1 point 4 months ago (4 children)

    That proxy server is visible (that's my whole point) and can be forced to take it down, and very few use Tor or I2P

  • source
  • parent
  • hideshow 4 child comments
  • [–] 1 point 4 months ago (3 children)

    Most aren't though, they're behind cloudflare

  • source
  • parent
  • hideshow 3 child comments
  • [–] 2 points 4 months ago (2 children)

    Using cloudflare means you're using them as a proxy. Cloudflare can be pressured with court orders

  • source
  • parent
  • hideshow 2 child comments
  • [–] 30 points 4 months ago (1 child)

    they don't. they rely on having a profound amount of mirrors, both servers and domains. every time they take down one, two more spring up in their place.

  • source
  • hideshow 1 child comment
  • [–] 18 points 4 months ago
    [–] 14 points 4 months ago*

    A lot of the actual content is hosted and backed up by volunteers via torrent. You can grab chunks of any size you want from the site and seed them. I'm doing my part!

    Edit: took a look at the site and i guess that's just the backup. Still neat.

  • source
  • [–] 1 point 3 months ago
    [–] -2 points 4 months ago (1 child)

    Leaving this comment to come read what people have written, later.

  • source
  • hideshow 1 child comment
  • [–] 0 points 4 months ago

    Old Oil mining rigs are known to be used for that. Other than that, as long your IP is sufficiently masked it doesnt matter if your servers are prominent or hidden in a bunker. Noone knows whats inside besides operators.

    However, i think they broke TOR's vpn ip masking by analysing traffic patterns on network nodes. So if they really wanna catch you, you are better somewhere they have no way of coming close. Think russia or other countries not too friendly with usa and not giving a flying fuck about copyright. The physical location of servers that is. The admin could sit comfy in the usa.

    Also you could have the data encrypted on an AWS bucket but the server decrypting that should be more secure. Not sure how much traffic those sites have but that could ease the strain of on premise infrastructure you have to maintain.

  • source
  • Same way your mom does.

  • source