I don’t need LLM’s to count letters
If I can't rely on a system to perform simple tasks I can easily validate, I'm not sure why I'd trust it to perform complex tasks I would struggle to verify.
Imagine a calculator that reported "1+1=3". It seems silly to use such a machine to do long division.