wizzor comments on DIY Handheld AI Chatbot runs on a Raspberry Pi 2 Zero, and costs around $120 to make

[–] wizzor@sopuli.xyz 3 points 1 year ago (3 children)

The models an rpi zero can run are very limited though. 512 mb ram is very, very little for AI models.

[–] Redex68@lemmy.world 9 points 1 year ago (2 children)

The LLM isn't local

For the actual conversational responses, the project typically utilizes cloud-based large language models accessed via APIs

permalink

fedilink

source

parent

hideshow 2 child comments

[–] rbn@sopuli.xyz 16 points 1 year ago (1 child)

Then, from my perspective, there's little to no value to have a dedicated piece of hardware for it. At least I'd guess that 99.999% the target audience for such a thing already has a smartphone with them. What - if not for the sake of privacy - is the added value of a special chatbot device?

permalink

fedilink

source

parent

hideshow 1 child comment

[–] Redex68@lemmy.world 4 points 1 year ago

I guess it makes it a bit easier to access + it's a fun project to DIY, not much else.

permalink

fedilink

source

parent