I tested a few local models to see how complete and recent their training data is. I want to use it to see if company A at xyz address is the same as Company B at xyz.1 address. I asked them for recent events and found a lot of gaps. So I asked for the roster of the 1992 dream team. Very mixed results. Open AIs model got 11/12 players correct but absolutely insisted that Christian Laettner was not the 12th player. I went back and forth with it to see if I could get it to accept my knowledge as is. It wouldn’t. I’m terrified about what happens when these AI bots have the ability to update Wikipedia in order to make the facts match their incomplete training data.

You don't have to be very good at a language to know when a translation is horrible. I'm not very good at spanish and I can do better than machine translations.