Hacker reverse engineers his Samsung TV and finds on-device AI listening for your dog and baby, watching what you watch, and borrowing your soundbar's mic if the TV doesn't have one. Then OpenAI banned him for reverse-engineering it.

Source:

you are viewing a single comment's thread
view the rest of the comments
[–] 23 points 1 week ago (39 children)

What is the honest capability delta between LLMs that can be run locally and the OpenAI model Log4J threw at the TV?

  • source
  • hideshow 39 child comments
  • [–] 35 points 1 week ago* (5 children)

    I have a Ultra 9, 5090, and 64GB RAM. I can comfortably run a 32B model which gives me the speed and performance of the best GPT/Claude model from about two years ago. It is functional? Yes. Does it do good work? Meh. Does it compare with the latest code models out now? Not even close.

  • source
  • parent
  • hideshow 5 child comments
  • [–] [S] 19 points 1 week ago (3 children)

    I'd recommend to try Qwen Flash Next with such hardware. You should have just enough RAM. Even Q3 should be quite good.

  • source
  • parent
  • hideshow 3 child comments
  • [–] 9 points 1 week ago (2 children)

    I've tried it. I find the responses of the Qwen models to be far inferior to the Gemma models.

  • source
  • parent
  • hideshow 2 child comments
  • load more comments (1 reply)
  • load more comments (34 replies)