Artificial intelligence labs are in a new arms race to buy up millions of rare books, slicing them open, scanning the pages and pulping the remains — sparking concerns that the last remaining copies of out-of-print texts are being destroyed on an industrial scale.

ISBNdb notes that “print books from the pre-LLM era are structurally guaranteed to be free of this contamination”.

“Millions of the most valuable books have never been digitised. They exist only in physical form, scattered across library shelves, used bookstores, and out-of-print catalogues. We get them to you at scale.”

top 93 comments

sorted by: hot top controversial new old
[–] 137 points 3 months ago (16 children)

I really hope the AI bubble pops soon and takes at least some of these stupid companies with it. They've been operating at a GIANT loss for years at this point, how much longer will this go on?

  • source
  • hideshow 16 child comments
  • [–] 65 points 3 months ago* (last edited 3 months ago) (5 children)

    The way I see the situation is that every single AI company can clearly see the massive wall they are speeding ever faster towards, they see it and can also see that it is a massive wall, thick and sturdy.

    There is however one thing that keeps them pushing the accelerator down hard against the floor, the delusion that they alone are smart enough to find the prefect weakpoint where they can smash through to the promised land of massive promises, while everyone else is just flattened against the wall.

    It is extreme narcissism combined with yes men powering this shit.

  • source
  • parent
  • hideshow 5 child comments
  • [–] 33 points 3 months ago (1 child)

    Investors are starting to notice that it’s all smoke and mirrors in terms of the profits. I am reasonably sure it will pop this year. I will be utterly shocked if it doesn’t pop by the end of next year. It’s just so comically and obviously unsustainable.

    This is gonna go down as the biggest Ponzi scheme of all time, I swear.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 11 points 3 months ago (3 children)

    I dunno, the GameStop Bros are still waiting for MOASS. So I'd say the wealthy have more ways to keep the plates spinning than we wish they did.

  • source
  • parent
  • hideshow 3 child comments
  • [–] 2 points 3 months ago

    I like the plate spinning analogy. I think these guys have SO much money that they do have a few tricks up their sleeve to keep investors going.

    I think once they land a few enterprise level fish hard, it will keep the plates spinning a good bit longer.

  • source
  • parent
  • [–] 2 points 3 months ago

    Depends on how much power the financiers have to fabricate capital from debt. In modern economics that's not necessarily a limitation. I do hope it will be tho.

  • source
  • parent
  • [–] 2 points 3 months ago (2 children)

    Be careful, because we will all pay the price when the bubble pops. It won't be just the CEOs paying the bill, it will be governments and people.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 62 points 3 months ago (17 children)

    Does anyone remember circa 2014 that radical jihadists in the middle east were destroying ancient and medieval artifacts, including stone heads? And I remember here in the liberal west we thought that was awful.

    This is not the only thing that makes me think of that. Also Trump's recent calls to reduce the size of US national parks and open them up to oil and uranium mining exploitation.

  • source
  • hideshow 17 child comments
  • [–] 7 points 3 months ago (6 children)

    Yeah we remember. Because that’s a literal fucking warcrime. You’re not allowed to destroy historical sites.

    While I agree that destroying books is bad - even common ones - it’s also not technically illegal. If I want to burn a first edition of whatever book worth thousands of dollars… I’m legally allowed to do that.

    I can also see the benefit of having a digital version of a rare book that can be enjoyed by thousands as opposed to sitting on a shelf. But yeah, definitely hold companies accountable for destroying them. There has to be a better way to do that work and still have a useable book afterwards.

  • source
  • parent
  • hideshow 6 child comments
  • [–] 14 points 3 months ago

    I don't trust AI companies to not alter the texts of those books if there's something in them that does not align with their worldview.
    So any book added to the online archive(s) by these companies is suspect.

  • source
  • parent
  • [–] 12 points 3 months ago

    The point of bookburning is that it would only be accessible to AI, bringing forth it's monopoly on said first edition. No one would upload it to IA in the process. It is deleting one source of knowledge out of existence.

  • source
  • parent
  • [–] 2 points 3 months ago (1 child)

    If they were archiving digital versions so they could be read by thousands in the future, this would be a totally different conversation.

    They don't even need to be as selfless as the internet archive - just follow Googles lead and allow people to search and view selections the archive, with automatic opening of the archive when you are confident copyright is expired. Even a closed archive owned by a third party with a dead mans switch to open it in the future when the business model is done would be something.

  • source
  • parent
  • hideshow 1 child comment
  • [+] -13 points 3 months ago (9 children)

    Random bulk rate books aren't artifacts. The vast majority of them probably have a copy in Anna's Archive.

  • source
  • parent
  • hideshow 9 child comments
  • [–] 29 points 3 months ago (2 children)

    If they did have a copy in Anna's Archive, why the fuck would AI companies find physical copies, buy them, rip them apart, scan them, and then digitize them before destroying them?

    Remember, you don't get the digital copy. It's only used to train their models.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 5 points 3 months ago (1 child)

    Absolutely. Every AI company has Anna's Archive in their training data already. They want to differentiate their models by having more training data than their competitors. There are way more books out there that have never been scanned than those that have.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 6 points 3 months ago (4 children)

    The use of the word "rare" implies that they are not bought in bulk....

  • source
  • parent
  • hideshow 4 child comments
  • [+] -6 points 3 months ago (1 child)

    Rare doesn’t necessarily mean culturally valuable. How many of these rare books are actually just old instruction manuals, travel guides, training materials, phone books, and dictionaries?

  • source
  • parent
  • hideshow 1 child comment
  • [–] 8 points 3 months ago

    The issue with that is that we don't yet know what is culturally valuable or not.

    Just because we don't see a need for the specific book now, doesn't mean it won't change tomorrow.

  • source
  • parent
  • [–] 54 points 3 months ago (2 children)

    Literally 1984 Fahrenheit 451

  • source
  • hideshow 2 child comments
  • [–] 36 points 3 months ago* (18 children)

    What's the point of destroying books after scanning them instead of reselling them apart from *hurr durr we are evil*?

  • source
  • hideshow 18 child comments
  • [–] 4 points 3 months ago (1 child)

    Fair use loophole, they claim they convert one physical book into one digital with no illicit copies, while also supporting the delusion of AI being an equivalent to a human reader. It is weird on so many levels but no one of noticeable weight asked them wtf.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 10 points 3 months ago

    Do make sure that knowledge is only available through their model and otherwise lost to humanity.

    Same with bombarding small websites until they give up and pull the plug.

    Everything is fucked

  • source
  • parent
  • [–] 16 points 3 months ago (4 children)

    To keep their competitors from buying them and scanning them.

  • source
  • parent
  • hideshow 4 child comments
  • [–] 1 point 3 months ago (3 children)

    That seems to be the most likely reason. Bastards.

  • source
  • parent
  • hideshow 3 child comments
  • [–] 2 points 3 months ago (2 children)

    Sorry, but I did an oopsie. I watched the video linked, they destroy the books to scan them. It's really sad. Though I'm sure they would destroy them anyway.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 1 point 3 months ago

    They take apart the books to scan them. There's no scanner in the world that deliberately destroys the paper it's scanning. They pulp them because that's more advantageous to them than reselling or archiving the disassembled pages.

  • source
  • parent
  • [–] 6 points 3 months ago (2 children)

    Copyright. They mustn't make a copy. There is legal precedent that confirms it's okay to transform the copy you bought into digital format. The Internet Archive relies a lot on that. I think they actually litigated it in the first place. So that's why the copyright heads are going so absolutely apeshit. If no one's charging you rent for using some data, then it's "unethical".

  • source
  • parent
  • hideshow 2 child comments
  • [–] 10 points 3 months ago* (1 child)

    The Internet Archive absolutely does not destroy books. They scan them the hard way with the binding still intact.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 33 points 3 months ago

    Anthropic described the project as “our effort to disruptively scan all the world’s books” in an internal memo, which noted “we do not want it to be known that we are pursuing this project”.

  • source
  • [–] 31 points 3 months ago (2 children)

    This sounded like clownish villainy in Rainbows End. I swear these guys are compulsively drawn to the worst parts of SciFi.

  • source
  • hideshow 2 child comments
  • [–] 3 points 3 months ago (1 child)

    As his faculties return, Robert (who has always been technophobic) must adapt to a different world, where almost every object is networked and mediated-reality technology is commonplace.

    …

    However, jitter and latency are considerable problems with this basic network when long distances are involved. In the novel, Robert Gu develops an algorithm that partially compensates for these technical deficiencies, and might ultimately allow the inclusion of haptics.

    This feels like it would be a little Mary-Sue to me, but I haven’t read the book. Is that transition handled well?

  • source
  • parent
  • hideshow 1 child comment
  • [–] 5 points 3 months ago

    I found it a bit of a stretch that a cranky technophobe English professor could, or even would bother to, create an algorithm the whole world of math and computer nerds overlooked. But I don't let preposterous characters get in the way of my big-ideas SF when I can help it.

  • source
  • parent
  • [–] 30 points 3 months ago

    That's fucking evil.

  • source
  • [–] 27 points 3 months ago* (last edited 3 months ago) (1 child)

    Because when you destroy the publicly available source you become the only available source. Paid, of course.

    The final nail in the coffin for humanity, locking knowledge behind digital sources that are inaccessible in event of catastrophe.

  • source
  • hideshow 1 child comment
  • [–] 3 points 3 months ago

    Crazy how we had all this information available and all we did was lock it up and make it for sale. The internet was an awesome place we shared ideas easily and without massive corporate "sponsors" now the owners of the internet are the corporations and they are just riding t till the wheels fall off.

  • source
  • parent
  • [–] 51 points 3 months ago (2 children)

    "We must destroy this precious archive of humanity so our competitors can't also scan it"

  • source
  • hideshow 2 child comments
  • [–] 66 points 3 months ago (3 children)

    Good way to prepare for rewriting history to their liking. Shredding/destroying the books should be illegal in this regard.

  • source
  • hideshow 3 child comments
  • [–] 2 points 3 months ago

    Yeah, part of me thinks this is part of why they are desperate for these LLMs to take off.

    Get everyone to trust it, then just manipulate it to saw whatever fascist lies they want as truth. Look at how Elon gets all pissy everytime Grok starts going to the left on its ideas.

  • source
  • parent
  • [–] 2 points 3 months ago

    To be fair, we don't know what books those are, anyone can publish anything as a book these days. It doesn't have to be good or even true. For example, Jordan Peterson shits out some books, and I personally would not mind if all copies were shredded and forgotten.

  • source
  • parent
  • [–] 22 points 3 months ago* (2 children)

    Combine this mass burning of humanity's canon with the onslaught of AI generated nonsense and think about what is doing to do our history and knowledge going forward.

    Humanity is being dragged into a black hole by tech-fetishist demons.

  • source
  • hideshow 2 child comments
  • [–] 3 points 3 months ago (1 child)

    It's a second dark age approaching. It's slow, maybe not in our lifetime but with the enormous pressure of climate and demographic crisis add the regression of human cognition and destruction of researchable truth and you will get a collapse of the global economy and a shift in priorities (survival first) that will bring a dark age.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 15 points 3 months ago (6 children)

    To be honest, I'd be MUCH less against this practice if this shredding at the very least included saving the original scans at at least 300 dpi for everyone to access, freely.

    Ideally, they wouldn't cut them by the spine, but even giving the despined ones to an archive/library would be just above the unpermissible line.

    Despining, scanning and public access archiving is borderline permissible.

  • source
  • hideshow 6 child comments
  • [–] 9 points 3 months ago (5 children)

    Also, if every AI company does this, then it's more books gone. If they cooperated they'd only need to do it once. Good scans of all books in the public domain would be so useful for us all as society.

  • source
  • parent
  • hideshow 5 child comments
  • [–] 2 points 3 months ago (4 children)

    While that would be nice, unfortunately it would almost certainly run into the very same legal issues that are also causing them to pulp the books after scanning them.

  • source
  • parent
  • hideshow 4 child comments
  • [–] 2 points 3 months ago (3 children)

    What issues specifically? Not disagreeing, trying to understand what you mean.

  • source
  • parent
  • hideshow 3 child comments
  • [–] 2 points 3 months ago (2 children)

    IIRC destruction of the physical copy to prevent resale while still possessing a copy is required for book scanning to be free use, or otherwise not encounter problems with copyright law. Proceeding to share/distribute those scans, or especially trying to charge money for them, would encounter those exact same copyright barriers.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 2 points 3 months ago (1 child)

    Oh, maybe. Even then, for things in the public domain this shouldn't matter. I know that's probably not the majority of what they're scanning though.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 1 point 3 months ago

    I would assume they aren't bothering to scan it if it's in the public domain. Much easier to just grab a copy off archive.org or any other website hosting such things, and that's assuming the entirety of the public domain isn't already in the training set.

  • source
  • parent
  • [–] 15 points 3 months ago

    "It was the best of times, it was the blurst of times?" Stupid AI!

  • source
  • [–] 41 points 3 months ago (2 children)

    Destroying the an endangered book feels like it should be criminal no?

  • source
  • hideshow 2 child comments
  • [–] -1 points 3 months ago (1 child)

    As much as I think this behaviour is fucked up, once they buy the books it's legally property of the company. And it can be destroyed without consequence since it's legally property of the company.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 28 points 3 months ago

    “Book burning, you say?”

  • source
  • [–] 39 points 3 months ago* (6 children)

    “I personally have mixed feelings about all of this,” one small bookseller told tech news website 404 Media last week.

    The bookseller explained that in April, he suddenly went from selling around 20 books per week to hundreds — including obscure and out-of-print works.

    “It benefits me financially as well as by clearing out old inventory that is otherwise unlikely to sell,” he said. “I’ve been well suited for these sales with inventory from overseas and foreign language books. On the other hand, I don’t like the end-use, and I don’t like that uncommon books are being pulped.”

    Then stop selling rare and out of print books to an AI company, you fucking doorknob.

    Greed knows no bounds.

  • source
  • hideshow 6 child comments
  • [–] 8 points 3 months ago (5 children)

    How would a book seller know? Orders increase and you find out afterwards why. Bit hard to know ahead of time

  • source
  • parent
  • hideshow 5 child comments
  • [–] 2 points 3 months ago (2 children)

    I mean I quoted the part where they made it clear that they know exactly who they're selling to...

  • source
  • parent
  • hideshow 2 child comments
  • load more comments
    view more: next ›
    13 comments in c/technology@lemmy.ml view that post
    9 comments in c/world@lemmy.world view that post
    8 comments in c/technology@beehaw.org view that post
    4 comments in c/books@lemmy.ml view that post
    1 comment in c/technology@midwest.social view that post
    1 comment in c/books@lemmy.world view that post