you are viewing a single comment's thread
view the rest of the comments
[–] 65 points 5 months ago* (9 children)

I kinda want to mirror this to the fediverse with a bot to 1. Make more people see it and 2. Mirror it so when it gets taken down its distributed on here.

Should I do it? Or is that dumb?

  • source
  • hideshow 9 child comments
  • [–] 7 points 5 months ago (1 child)

    Yeah, I'm real torn. On one hand, I immediately want to scrape this site, but I also don't want to beat the site up tying up their bandwidth. There seems to be a parent site db4p.org thats managing mirrors of this site, but I don't see any sort of torrent or archive. If there's something like that, I'd be very inclined to just archive the entire site/database.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 7 points 5 months ago*

    Mmm… such a bot could run once every 24 hours either “visiting the site” and reading the HTML contents. Or using the DB directly if they have an API somewhere.

    Either way it doesn’t cost them much.

  • source
  • parent
  • [+] 2 points 5 months ago (3 children)
  • [–] 1 point 5 months ago* (2 children)

    I was thinking indeed scraping (or using an API), and when a new entry is made, repost it on here (on a seperate community).

  • source
  • parent
  • hideshow 2 child comments
  • load more comments (-1 replies)
  • load more comments (-1 replies)