Hacker reverse engineers his Samsung TV and finds on-device AI listening for your dog and baby, watching what you watch, and borrowing your soundbar's mic if the TV doesn't have one. Then OpenAI banned him for reverse-engineering it.

Source:

you are viewing a single comment's thread
view the rest of the comments
[–] 4 points 1 week ago*

You should get very fast inference with Qwen 30B on that rig.

A huge problem in this space is that popular inference engines are... generally awful, tech bro slop, and the best ones are in the obscure DIY/hacking realm. The experience you'd get doing a default "Ollama run" vs a tuned rocm exllamav3/vllm setup or something is like night-and day; think 4 tokens/sec of jibberish, vs 40 tokens/s that performs close to unquantized.

  • source
  • parent