14
Private AI? (www.wired.com)
submitted 1 month ago by to c/privacy@lemmy.ml
18 comments fedilink hide all child comments
 

Very confused, is this all BS?

"Confer, the private AI chatbot launched by Signal creator Moxie Marlinspike, uses that Nvidia-based TEE setup— along with an authentication system...."

"Meta, too, uses a TEE to offer a more private version of the Meta AI chatbot included in WhatsApp—a privacy system that Confer’s Marlinspike has said he is helping Meta to develop."

This feels too good to be true and I am surprised this article is the first i am hearing about the relationship between Marlinspike and Meta for this product.

you are viewing a single comment's thread
view the rest of the comments
[–] 3 points 1 month ago (1 child)

You need a minimum of 16gb of vram in order to do anything that requires tool calls and even then it is slow. Running llms locally is a fun challenge and it's impressive what can be done on consumer hardware but it isn't cheap or simple

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •
  • [–] 0 points 1 month ago

    Yeah. But you at least have the incentive to upgrade.

    I still have my GTX 1660super I want to upgrade to something better so that I can save on my AI subscription (unlike a sub you actually own it and can run whatever open weight model you desire).

  • permalink
  • fedilink
  • source
  • parent