Hacker reverse engineers his Samsung TV and finds on-device AI listening for your dog and baby, watching what you watch, and borrowing your soundbar's mic if the TV doesn't have one. Then OpenAI banned him for reverse-engineering it.

Source:

you are viewing a single comment's thread
view the rest of the comments
[–] 3 points 1 week ago (3 children)

It'll be slow but it'll run.

Though even 128GB isn't enough for the biggest models. 512 would open up more options and the very biggest need like 2-4TB, totally out of scope for personal use.

You could try a medium-big MoE model (Mixture of Experts) with less than 100b total parameters. Maybe start with something modest like Qwen3.6-35B-A3B at 8bit quants. That'll leave you with plenty of memory left over for context size.

  • source
  • parent
  • hideshow 3 child comments
  • [–] 2 points 1 week ago* (2 children)

    Hmm... I guess my board supports up to 256GB; would maxing out the RAM make a big difference? Also, I've got 2x16 core Opteron and an AMD Vega 56, if you have any advice related to those.

  • source
  • parent
  • hideshow 2 child comments