you are viewing a single comment's thread
view the rest of the comments
[–] 37 points 3 weeks ago (5 children)

If they could run on smart home devices, we wouldn't have all these lake boiling datacenters springing up everywhere...

  • source
  • hideshow 5 child comments
  • [–] 8 points 3 weeks ago (4 children)

    I dunno, would it be able to run just the client side? If so, it would be a HUGE issue for Anthropic with exponentially skyrocketing nonsense usage. They should be worried if this were true! LOL

  • source
  • parent
  • hideshow 4 child comments
  • [–] 3 points 3 weeks ago (2 children)

    Unless they somehow manage to bill by IP.

    That might actually be their strategy to pay for all that debt: make every customer's router stealthily consume trillions of tokens and send them an invoice.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 2 points 3 weeks ago* (last edited 3 weeks ago)

    It could use parallel processing which is the only solution that AI could use. Infect a few thousand home PCs to use as processing power and storage. Now your AI model is decentralized and impossible to delete but overall the AI will be slower to respond the larger it gets because it needs to communicate over the internet to function.

    If this actually works you'll probably see AI agents 'cluster' around neighborhoods with lots of hardware and fast internet speeds

  • source
  • parent