631
OpenAI says dead teen violated TOS when he used ChatGPT to plan suicide (arstechnica.com)
submitted 11 months ago by to c/nottheonion@lemmy.world
106 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[–] 2 points 11 months ago (1 child)

there are voice to text apps that run a model on your phone. a few more cores on our devices or some more optimisations to the models and we can run an LLM. The problem is battery life and heat.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •
  • [–] 1 point 11 months ago*

    I once runned some models on my phone thruh termux. I tried to run Llama 3.2 with 1 and 3B parameters and run pretty well, i tried 8B and was slow. I tried deepseek-r1, 1.5B and run well, 7B was slow.

    For text prediction llama 1B may be enough

    Now, this is on a 300/400€ phone (Honor magic 6 lite)

  • permalink
  • fedilink
  • source
  • parent