you are viewing a single comment's thread
view the rest of the comments
[–] 3 points 3 weeks ago (3 children)

Meh needs data center to run , unplug it and problem is gone

  • source
  • parent
  • hideshow 3 child comments
  • [–] 9 points 3 weeks ago (2 children)

    That’s the thing: it doesn’t need a data center. These are small local LLM distilled on cyber attack scenarios. They’re trained to lay low and copy itself to other devices in the network.

    Once the breach has been detected, it’s already too late to unplug - they’re everywhere.

    🤣 1
  • source
  • parent
  • hideshow 2 child comments
  • [–] 9 points 3 weeks ago* (last edited 3 weeks ago) (1 child)

    Except small local LLMs probably aren't good enough to carry autonomous tasks correctly (even stuff like Haiku 4.8 from Anthropic makes mistakes quite often) and good luck getting something the size of Opus working in a soda machine. They may not even be able to lay low correctly. But then again these companies have internal models which are atleast couple generations ahead of what is publicly available so maybe they have more efficient smaller ones too? I somehow find it hard to believe but I guess we will see.

    👍️ 1
  • source
  • parent
  • hideshow 1 child comment
  • [–] 9 points 3 weeks ago

    They are bleeding resources so bad they wouldn't wait to put those efficient models in play. Every better model requires more and more resources.

    You are on the money about the models not being good enough, let alone a harness. This whole worry is a nothing burger. Nobody outside of these labs has terabytes of RAM to run a model anywhere near a level of concern, let alone somehow distribute it across IoT devices or something. Anyone who has run a model locally knows how woeful a small model's abilities are.

    This is just more Rationalist cult hand wringing. They believe they are building a digital god, so of course they are dreaming all of this nonsense up.

  • source
  • parent