You don't understand: when they say truthful, they mean agrees with Trump.

Granted, he disagrees with himself constantly when he doesn't just produce a word salad so this is harder than it should be, but it's somewhat doable.

And if you know what you want to hear will make up the entirety of the first page of google results, it's really good at doing that.

It's basically an evolution of Google search. And while we shouldn't overstate what AI can do for us, we also shouldn't understate what Google search has done.

They are clearly incompetent.

That said, generally speaking, pursuing a truth-seeking LLM is actually sensible, and it can actually be done. What is surprising is that no one is currently doing that.

A truth-seeking LLM needs ironclad data. It cannot scrape social media at all. It needs training incentive to validate truth above satisfying a user, which makes it incompatible with profit seeking organizations. It needs to tell a user "I do not know" and also "You are wrong," among other user-displeasing phrases.

To get that data, you need a completely restructured society. Information must be open source. All information needs cryptographically signed origins ultimately being traceable to a credentialed source. If possible, the information needs physical observational evidence ("reality anchoring").

That's the short of it. In other words, with the way everything is going, we will likely not see a "real" LLM in our lifetime. Society is degrading too rapidly and all the money is flowing to making LLMs compliant. Truth seeking is a very low priority to people, so it is a low priority to the machine these people make.

But the concept itself? Actually a good one, if the people saying it actually knew what "truth" meant.

Don't we all?