[–] 1 point 10 months ago

I haven't tried with API yet. With local one it's super quick though, it adds maybe a couple of seconds at most.

If you have a GPU and want to try it with local one there is a plugin for Godot and unity called "Nobody who" they have implemented the RAG approach out of the box with examples as well. So it wasn't something I came up with.

  • source
  • parent
  • context
  • [–] 2 points 10 months ago (2 children)

    What helped me in my project was a RAG implementation. So instead of trying to have all the information in the prompt, which becomes inconsistent if it becomes too big (especially when working on local llm), I can have quite a big knowledge base in a RAG. Then when being promoted it's a two step process, first search the RAG for the best match in the knowledge base, then Feed that to the LLM to generate the answers. You could also store noteworthy stuff in the rag on the fly.

  • source
  • parent
  • context
  • [–] 11 points 10 months ago (6 children)

    Because it's difficult to fit to a world. You need a pretty good GPU of which a lot of the memory will be take up by the LLM running locally. That means you basically can not use it while also having other fancy graphics at the same time. So you would basically have a not so demanding looking game with high GPU requirements.

    Also it's quite difficult to steer the NPCs to be consistent. In my free time I'm working on a small project right now to have a game centered around llm NPCs, but it's a lot of work to steer them to be consistent with the world you place them in. Because they always go with a "yes and" approach, so it's easy to end up in a situation where they make up things that contradict the reality of the game.

  • source
  • parent
  • context
  • [–] 1 point 10 months ago

    Drinks jeah, food I would say partially only. I mean it's good high quality food, but again it's more like you have it because you need it. It's not like you will have multiple things or food to share on the table at all times like in other cultures.

  • source
  • parent
  • context
  • [–] 13 points 10 months ago (4 children)

    But the importance of food can be very different still. As a German I would say food is not a huge part of social culture. Like yes we eat together when we celebrate, but the food is usually just a necessity instead of the main focus

  • source
  • parent
  • context
  • [–] 10 points 1 year ago

    I think that's what happens a lot of time, and why there is a tiny truth to them saying things like "pride makes the kids gay". It does not, but it might teach some bi sexuals that it's okay to be just that, and not force yourself to forget about the other half.

  • source
  • parent
  • context
  • view more: next ›