Hacker reverse engineers his Samsung TV and finds on-device AI listening for your dog and baby, watching what you watch, and borrowing your soundbar's mic if the TV doesn't have one. Then OpenAI banned him for reverse-engineering it.
Source:
I run a 27-billion parameter model at home. It can do useful work but it more commonly misunderstands code than the big cloud models, so you have to be more rigorous yourself in watching its reasoning and stopping it when it's going astray. It's usually possible then to nudge it back on to the right track. Otherwise it's surprisingly good, enough that I can do a lot without turning to the cloud models. But it is significantly slower than them, sometimes absurdly slow on even very simple tasks, and it can reason round in circles and get nowhere. Still, it usually works well, and if I lost access to the cloud models I wouldn't feel like I had lost too much.