[–] 3 points 5 days ago (2 children)

I always though it was something you said to kids. Not actually something you forced them to do. Like telling kids their eyes will turn to squares if they watch too much TV.

I'm sorry to hear that it happened to you.

  • source
  • parent
  • context
  • [–] 2 points 1 week ago

    If you have enough regular ram and an nvme ssd you can run huge models on modest hardware using Colibrí.

    I got a Lenovo mini PC with 64GB of ram and a 500GB nvme and a 38B model runs with 11 tokens per second on my machine.

    The 38B model fits in my ram but if I had used a 120B parameter model then it would stream the rest of the model from my nvme disk.

  • source
  • parent
  • context
  • [–] 4 points 2 weeks ago (2 children)

    Intolerance for intolerance is needed in a tolerant society and in my opinion punching that person in the face was not too far. That guy needs to learn to not behave like that towards women.

    He got swift justice and maybe he will think twice before he does that again.

    I don't think violence was the only soultion here. In the best case an adult would have heard what he said, banned him for that game, and calmly explained to him why that is wrong to do and he would improve himself. But from experience with kids behaving like that (depending on the age, young kids might listen) he wouldn't care.

    I am not strictly against violence, I am however strictly against murdering people.

  • source
  • parent
  • context
  • [–] 8 points 2 weeks ago (5 children)

    According to Game Theory you have to retaliate once if someone crosses a line.

    You need to make it clear that that type of behavior is not acceptable while simultaneously not going too far. Or else you will become a doormat.

    In the case of the hockey player, 1 punch is enough. More than 1 punch would cross a line.

  • source
  • parent
  • context
  • [–] 1 point 2 weeks ago

    Sure, but I still think calling it "memories" is a reach and a bit disingenuous. It's not remembering anything. It's re-reading it will the every run, making it appears as if it has remembered. Calling it "reminders" or something else I think would me more appropriate.

    The "memories" terminology comes from the big AI companies and they are doing everything in their power to make AI seem smarter than it actually is. A lot of reporters in media has a hard time understanding this as well and will report on AI as having it's "own thoughts" and "making own decisions".

    ChatGPT breaches confinement because their engineers are stupid. Not because of some self determination to fuck with us or our infrastructure. OpenAI are responsible and let it happen. Same with Anthropic.

    In the end an AI is a dumb computer program that only know and does what we tell it to do.

  • source
  • parent
  • context
  • [–] 1 point 2 weeks ago (2 children)

    Yes I would say that she temporarily learns something while reading the notes. And she stores it in short-term memory.

    The difference with AI though is that it has to re-read the same note again and again after each question you ask it. It does not keep things in "memory" from your previous conversations. It reads it again before answering you.

    That is why context length matters and is important in LLMs. There's a huge difference between talking to an AI with 10k in context length and 1mil in context length. You can try it yourself using Llama.cpp and running LLMs locally.

  • source
  • parent
  • context
  • view more: next ›