That's exactly why we can't really call them intelligent or knowledgeable. They're pattern recognition engines, they mindlessly recognize and repeat patters even when they don't make any sense i.e. "hallucinate"
They're a productivity tool that can help actually intelligent and knowledgeable beings like humans do tasks, but on their own they are a parking lot covered with shredded dictionaries. If we use the Chinese room analogy, it'd be like trying to build a Chinese room with just the translation dictionary and without the human to do the translating.
Which is why LLMs make mistakes when translating too - they need a human, a real intelligence, to check.