you are viewing a single comment's thread
view the rest of the comments
[–] 2 points 1 year ago* (last edited 1 year ago) (1 child)

This seems to match up with some quick tests I did just now, on the pseudonyminized chatbot interface of duckduckgo.
chatgpt, llama, and claude all managed to use double spaces themselves, and all but llama managed to tell I was using them too.
It might well depend on the platform, with the "native" applications for them stripping them on both ends.

tests

Mistral seems a bit confused and uses tripple-spaces.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 2 points 1 year ago

    Tokenization can make it difficult for them.

    The word chunks often contain a space because it's efficient. I would think an extra space would stand out. Writing it back should be easier, assuming there is a dedicated "space" token like other punctuation tokens, there must be.

    Hard mode would be asking it how many spaces there are in your sentence. I don't think they'd figure it out unless their own list of tokens and a description is trained into them specifically.

  • source
  • parent