Ever notice how you letters don't work right in dreams? If you look at writing in a dream, you just know what it means without having to analyse the letters. But if you try to study the letters, they swim around like a stable diffusion image. LLMs deal in tokens, not letters. The approximate meaning of each token is learned during the training phase, so the LLM has a gut feeling of how the token should be used. But it doesn't know how to spell the token, which is why they can't tell you how many Rs are in the word Strawberry. Asking an LLM about spelling is like asking a dreamer about spelling. There's no spelling in dreams, just raw meaning.