you are viewing a single comment's thread
view the rest of the comments
[–] 11 points 1 year ago* (last edited 1 year ago) (4 children)

How does archive get the unpaywalled version? I don't think they pay the subscription for every single tabloid out there?

Asking for a friend.

  • source
  • hideshow 4 child comments
  • [–] 6 points 1 year ago (1 child)

    I think they use the same thing that web crawlers use. If Google's crawler couldn't access the content of the page (or could only access a limited amount of content), it would likely rank far lower in search results

  • source
  • parent
  • hideshow 1 child comment
  • [–] 3 points 1 year ago*

    Btw, how come there is no search engine where you can sort and filter how you want instead of how they want? (except self-hosted i mean)

    Pornhub has better searchability than, uh, all search sites i know.

  • source
  • parent