That's not entirely correct. They kinda "do maths". I tried to google OP's answer, and there's a bunch of papers showcasing how LLMs develop circuits to handle numbers. (I didn't find that specific one, though.) Of course everything is prediction with LLMs. But seems they try to form a model how to do base-10 maths. Surely they're bad at it and not a real calculator. And you're right. What people usually tend to do is give them tool access. Either to a proper calculator, or more often a Python sandbox and there will be a prompt to write a Python snippet to do arithmetic. But the usual models can also add and multiply smaller numbers without anything in the background. That's not really an achievement, they can simply memorize the basic multiplication tables.
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
replies: