31
Best way to download files from multiple unstable mirrors? (sh.itjust.works)
submitted 2 months ago by to c/piracy@lemmy.dbzer0.com
10 comments fedilink hide all child comments
 

Let's say I need to grab a large EPUB/PDF (60MB+) from a site with multiple mirrors. What often happens is I go the mirror, cut/paste the link, and watch as the file slowly trickles in before ultimately failing.

So I go to the next mirror and the process repeats.

Is there a way I can plug all the separate links into a software manager and download the file concurrently in chunks from the different servers, torrent style? Or at least resume the download at a fresh link?

I downloaded Persepolis on Linux Mint, but it doesn't seem to do anything differently than the browser.

all 10 comments

sorted by: hot top controversial new old
[–] 7 points 2 months ago (7 children)

Yes, most download managers support this. At least resuming, if not combining multiple HTTP sources.

  • permalink
  • fedilink
  • source
  • hideshow 7 child comments
    •
  • [–] [S] 3 points 2 months ago* (6 children)

    Can you recommend one that does?

    And do links expire pretty quickly? Why do my d/l's keep failing? I think the problem is server side. The d/l fails and the link is deleted.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 6 child comments
    •
  • [–] 4 points 2 months ago (5 children)

    As far as why the downloads are failing - does the site/mirrors your downloading from have subscriptions for higher speed downloads? My bet would be that if you’re downloading without a subscription then your traffic is getting deprioritized server-side. Kind of a shitty way for them to operate, if so, but nothing you can really do about it. Most sites I’ve downloaded from like that just make you watch an ad or force you to wait some amount of seconds before the download starts.

    Just my hypothesis, though. Can’t know for sure if that’s happening without knowing what site it is.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 5 child comments
    •
  • [–] [S] 3 points 2 months ago (4 children)

    Yeah, they're the servers with the countdown time to start the download.

    No idea what they want me to download a net of 200MB to get a 30MB file that fails at 10MB a bunch of times. Seems like they're wasting bandwidth.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 4 child comments
    •
  • [–] 4 points 2 months ago (3 children)

    If these are e-books you’re looking for, you may want to try soulseek. It’s promoted a lot on here for music downloads, but I’ve gotten almost all my e-books from there, too.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 3 child comments
    •
  • [–] [S] 1 point 2 months ago (2 children)

    Oh, nice. Unfortunately, I use a hotspot and VPN, so I don't think I can open the ports i need to share my library, so i get blacklisted pretty quickly as a leecher.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 2 points 2 months ago

    Ah, yeah, I can see where that would be an issue. I don't use a VPN for Soulseek since it's not really needed, but I seem to recall reading that it can be configured to work behind a VPN. However, the VPN provider must have port forwarding. And the configuration process may understandably be more effort than you'd want to put into downloading ebooks.

  • permalink
  • fedilink
  • source
  • parent
    • [–] 2 points 2 months ago (1 child)

    Aria2c perfect for exactly this.

  • permalink
  • fedilink
  • source
  • hideshow 1 child comment
    •