[–] 1 point 6 months ago (1 child)

The chat does not use an actual tokenizer. It just counts characters then divides by 3 or 4, or something like that. The AI plugin, however, has an actual tokenizer for whatever AI chat model perchance is using. TLDR: it's just a rough estimate on token count. If it's consistently off, try altering the code and see if you can land at a better number. Otherwise, it's just a rough estimate.

  • source
  • [–] 3 points 11 months ago

    Golly gee, dev. I know you're providing a completely free service and ads barely cover provided services, but go ahead and add these extra features that will raise costs further.

    It's free! What the hell? 🙄

  • source
  • [–] 1 point 1 year ago* (1 child)

    As I understand it (please, correct me if I'm wrong), aren't gallery posts global? From what little I know, a named gallery (default is "public") can be any name. That name becomes the identifier for that gallery. This means that anyone may use that same name and access that gallery from their own generator. If they're public like that, how would this removal power work. Since you would affectively have the right to remove gallery images that don't actually belong to the generator?

  • source
  • [–] 1 point 1 year ago* (3 children)

    What you are suggesting is something called an "editor phase", some COT (chain of thought, commonly known as "thinking" models) do this to an extent. It's also something that can be done via JavaScript in the current AAC right now. To do this in AAC, you can either fork the current chat and make your own changes, or you can leverage the JavaScript function on characters to have the AI respond twice. Once to perform a standard completion, and the next, passing the entire chat again, this time including the last response along with instructions on what to "edit". The AI makes a new response, and you replace the last response with the modified one. AI isn't actually capable of self-analysis or of thinking about what its going to do as its responding, so to help mitigate this issue, you must break things into steps.

  • source
  • parent
  • context
  • view more: next ›