cross-posted from: https://sopuli.xyz/post/42490856

Obligatory damn clankers.

you are viewing a single comment's thread
view the rest of the comments
[–] 2 points 8 months ago* (1 child)

Aside from driving profits through demand for LLM use, these data centers are an environmental disaster.

The scale of these facilities is insane. A flagship LLM model can require around 1 TB of RAM to run effectively. A mid-tier model may need roughly 140 GB. In contrast, a top-end gaming PC typically needs 64 GB at most, and the vast majority of systems function perfectly well with 16 GB.

I was simply pointing out that these massive data centers exist because that demand exists.

  • source
  • parent
  • hideshow 1 child comment