Welcome

We're not The Onion! Not affiliated with them in any way! Not operated by them in any way! All the news here is real!

The Rules

Posts must be:

Links to news stories from...
...credible sources, with...
...their original headlines, that...
...would make people who see the headline think, “That has got to be a story from The Onion, America’s Finest News Source.”

Please also avoid duplicates.

Comments and post content must abide by the server rules for Lemmy.world and generally abstain from trollish, bigoted, ableist, or otherwise disruptive behavior that makes this community less fun for everyone.

And that’s basically it!

founded 3 years ago

moderators

[–] halcyoncmdr@lemmy.world 14 points 11 months ago (3 children)

I call it enhanced autocomplete. We all know how inaccurate autocomplete is.

permalink

fedilink

source

parent

hideshow 3 child comments

[–] Axolotl_cpp@feddit.it 3 points 11 months ago* (2 children)

I wonder how a keyboard with those enhanched autocomplete would be to use...clearly if the autocomplete is used locally and the app is open source

permalink

fedilink

source

parent

hideshow 2 child comments

[–] ferrule@sh.itjust.works 2 points 11 months ago (1 child)

there are voice to text apps that run a model on your phone. a few more cores on our devices or some more optimisations to the models and we can run an LLM. The problem is battery life and heat.

permalink

fedilink

source

parent

hideshow 1 child comment

[–] Axolotl_cpp@feddit.it 1 point 11 months ago*

I once runned some models on my phone thruh termux. I tried to run Llama 3.2 with 1 and 3B parameters and run pretty well, i tried 8B and was slow. I tried deepseek-r1, 1.5B and run well, 7B was slow.

For text prediction llama 1B may be enough

Now, this is on a 300/400€ phone (Honor magic 6 lite)

permalink

fedilink

source

parent