
It's just gluing together data from random sources it finds with no care for the accuracy or recency of that data; Lemmy has about 38,000 MAU, not 77,000.

It's just gluing together data from random sources it finds with no care for the accuracy or recency of that data; Lemmy has about 38,000 MAU, not 77,000.
I work in a 911 dispatch center, one time I had someone from the police in one town, let's call it Townsville, trying to get ahold of an officer from another town in our county, Citysburg.
I go to put a phone call request in for them, and ask what it's regarding, and they say it's about an incident that happened at the Mega Lo Mart in Citysburg.
There is no Mega Lo Mart in Citysburg, but there are a couple in nearby towns, some of them have Citysburg mailing addresses, or people might casually say that they're in Citysburg because they don't really know where the borders are, this is pretty common and we deal with it a lot, so I ask if they have the address to make sure that I'm getting them in contact with the police department that actually covers that store.
They spit out an address like 123 Main St in East Jabip
East Jabip isn't in our county, I'd never even heard of that town before. I punch it into Google maps, it's like 2 or 3 hours away from us and sure enough there is a Walmart at that address there.
So to make sure I wasn't missing something, I asked why they wanted to speak with Citysburg police if the incident happened in East Jabip.
And they reply "yeah, I'd never heard of east Jabip either, so I punched the address into Google and the AI told me that it was in Citysburg"
Just blatantly false, AI-hallucinated bullshit.
And our cops (or their office staff, can't remember who exactly it came from) just blindly believed it and didn't bother to verify it at all.
And Citysburg isn't some nowhere town, we're a fairly dense suburban county, these two towns are maybe about a 20 minute drive from each other if traffic cooperates, and Citysburg is our county seat, cops from all over the county are there all the time for court and such and the surrounding areas, they should know that area at least well enough to know that East Jabip isn't there
And they even admitted that it didn't sound right to them, but they still went ahead with it and didn't question the AI.
And luckily this wasn't for anything too urgent, it was for credit card fraud or something along those lines. But actual emergencies get called into us all kinds of bass-ackwards ways like someone in another state calls their mom who lives here who calls her local police who transfer her to us so that we can transfer her to the police where the person who's actually having an emergency is.
That kind of stuff happens pretty frequently by the way, that's not some bullshit scenario I'm making up, I get that probably on a weekly basis.
And so it burns me up thinking that if there had been an actual emergency, having to sort out this bullshit could have caused delays in getting help to someone who needed it because someone outsourced their thinking to a shitty AI
Lies a lot about Home Assistant I think, but that's probably because the info online also doesn't match reality. Garbage in garbage out still applies.
Damn, AI be coming for the politicians now??
Browsing is so much worse now. Note I don't use Google but Duck and turned all the AI shit off. Before Duck also had an AI overview and so many times I had to find actual different sites to verify the information. Wasted so much time. AI truly made everything worse. I had such a simple app to control my curtains. Now it's fucked by adding an AI POS assistant that takes up the whole main page.
Urgh I hate this enshittification in the name of progress.
Switched to Kagi a year ago, haven't looked back.
Can I ask how much your bill is for it and what level of usage you have with it?
Kagi is an AI company also.
Meh. For a control I need to see a comparison of the lies in the search results. I bet Gemini is doing a better job than the limitless bullshit that people are expected to click on.
Let us not forget that Gemini is often pointing out basic facts like, "vaccines actually work" when people search for information about them. This angers a lot of complete idiots and results in anger-inducing clickbait articles... Like this one.
The fact that a machine can get 90% of everything correct is fucking amazing. And the pace of improvement in AI in general is astounding. Try to keep that in perspective when reading stories like this.
Anything over 50% is probably better than a random sampling of humans could do, based on our current state of education and "knowledge upkeep" (which is something most humans fail at, utterly and completely).
Not really. Something that cant intentionally do anything can't really lie.
It presents information without validating. It's definitely lying in my book. They're trash.
Here for lies per hour as a metric.
So it's really Mango Mussolini behind the curtain - there is no Google AI ?
Insert Scooby Doo unveiling pic here
Not technically lies, as to lie there has to be an intent to deceive. LLMs don't have any intentions.
You can give them intentions. Grok is not a Nazi by Magic.
Don’t know if I’d call that an intention of the machine but rather the creator. Hate to be that kind of person but it’s similar to the whole thing of “guns don’t kill, people do.”
LLMs aren’t people. They’re not self-aware and don’t have any inner complexities like say, a dog, or a sheep has. There’s no drive or motivation. It’s just maths.
If you tie someone to a train track, and a train comes along killing them, it’s not like the train or the track intended to kill the person. That was the intent of you, who “programmed” the scenario.
Similar to guns, strict control is what will be needed to fix these kinds of things. Megalomaniac billionaires who see people as nothing but numbers running amok with narcissistic manipulator systems isn’t a recipe for anything good.
Ok, technically you are correct. Still they are lies or let's call it disinformation or propaganda. Wether the output is controlled by the machine it self having a mind (which of course is sci-fi) or by those who control the machine.
What you're calling lies are false positives. To lie you have to know the truth. AI's are ignorant. They don't know what anything is, as all they "know" is mathematical patterns in 1's and 0's.
They would only be lies if Google engineers explicitly overrided the model to output the false information. What most implementations of LLM's are is weaponized incompetence, for-profit. Capitalists know they output false information, and they don't care, because their only goal is profit and power.
If Google knows it outputs falsehoods and lets it continue it becomes purposeful. That makes them lies in my book.
If a newspaper prints lies you don't say the physical piece of pulped up tree you are holding is lying to you, you say the author is.
If it's shown to the newspaper that they are lies and they keep on printing them, then yes I do call them liars as well. Whatever you want to call it, you must admit they are culpable for spreading disinformation.
No, you are proving my point here. You say 'they' as in the publishers/owners/printers of the newspaper. You don't blame 'it' the literal, physical piece of paper you are holding in your hands.
In the same way that you would not say a clock was lying to you if it displays the wrong time.
OK, so I don't blame the GPUs crunching out the LLM lies, or the HTML on the page, I blame Google the company that programmed them.
The point is, the LLM is not 'lying' to you. It's showing you information. It doesn't 'know' whether the information is true or not. It also doesn't 'care'. Because it is a statistical model and is incapable of those things. And if you scroll back to my initial point, I said "technically, it's not lying, because lying requires intent to deceive, and LLMs don't have intent"
What's the point of making this semantic difference though?
It doesn’t really matter whether it’s the Machine or the creator.
The point is, AIs can be programmed to lie, much like Grok does. And if they can be programmed to lie, then they are not reliable for anything at all. We are going through a decent period where AI can be used for a few things reliably, but even these will surely be enshittified.
Oooh, philosophy! I disagree. I think that if a person programs a LLM to give disinformation, that's all it is. A lie giving misinformation knowing that's it's disinformation, intending do deceive. The LLM doesn't know what's true or false. It doesn't intend anything, because it is not a conscious entity. The person who programmed it can be lying by disseminating false information, the LLM cannot, any more than a broken clock or thermometer is 'lying' about the time or temperature.
I am trying to get away from the philosophy actually 😅 in the end what matters is how these tools are being used, not so much their inherent characteristics.
Can you envision a world where AI chatbots will be used to lead you down certain political beliefs (e.g. capitalism good, socialism bad) product recommendations will be made based on how much brands are willing to pay for ad placements, and your psychological state will be measured and molded to the interests of the AI owner? I can. It’s also already happening.
It matters because every time we anthropomorphize Generative AI LLM'S we re-enforce peoples belief in their ability to tell lies or truths.
People's belief is what leads to trust in LLM'S and things like AI psychosis.
An interesting way to look at it is AI also can't tell the truth.
What it does is generate the next likely word or words based on its most significant statistical positive in its database. So it doesn't know anything. It doesn't tell truth. It doesn't tell lies. It isn't an entity. The people behind it are allowing it to present information as factual and we have no reason to trust them.
LLMs don’t have any intentions.
Eh. The output from LLMs is usually pretty goal-oriented, so it arguably has intentions.
The LLM is not designed to deceive though, so in that sense it is correct that it is not lies.
The people who program, run and upkeep the LLM have intentions. The LLM is not a sapient or sentient entity.
An LLM is a statistical modeling tool. It doesn't have goals. It can't have intentions. It just outputs according to an algorithm.
It also uses Reddit as a reference A lot
You give it too much credit. In order to be able to lie it would first need do be actually capable of understanding what it writes. LLMs are text prediction algorithms. They cannot think.
The amount of times I've gone to look up a topic that I know something about and see something wrong in the AI summary that I didn't ask for...
I've turned off the AI summaries, but occasionally ask one of DDG's AIs a question, and it almost always has blatant errors in the responses. Yesterday, I did a manual search first, then asked 2 of the AI models if Arm & Hammer currently sells any non-clumping clay litters. It gave me a couple products that it claimed were non-clumping, but when I pulled up product listings to buy them, they were all very clearly labeled as clumping.
Makes it really hard to trust AI for things I don't know when they're so often so obviously wrong about things I do know and can easily verify.
Why is Google so insistent on forcing people to read their LLM output? Even their HTML seems intentionally designed to stop people from filtering it from search results. I don't understand what they gain from doing this.
Investment.
All of this AI hype is focused around convincing investors that it is of immense value and that [insert company here] is going to be well-positioned when AI takes over. Us poors are not the target audience, we're just pawns that are pushed into using AI to "prove" to investors that it is useful.
Interesting! I feel like they want the people to stay longer on their platform instead of going on the websites?
Because it drives the number of users up, and more users = more money
Although by stopping users right after the search with a scraped LLM answer, they won't go to other sites like they used to which could serve google ads for them, resulting in less money. Not to even mention the long term issue that with no more traffic or revenue, the websites the AI uses for information will die, making the AI useless.
True. What I was oversimplifying was that they need to drive the number of AI users up by inflating them through forced use.
Much like how companies demand employees to integrate AI in their workflow to show that they have AI users in the workplace
This then inflates the value of AI products, which makes more money for the sellers in that regard
Just a cycle of bullshit to drive AI investment and sales
That 90 percent right means 10 percent wrong stat terrifies me because scale matters. At billions of queries per hour that 10 percent failure rate floods the internet with hallucinations and misinformation that people cite as fact. We traded convenience for accuracy and now we have to manually verify AI outputs for basic facts.
I started using it this week on subjects I'm familiar with trying to prompt it into a correct answer. My experience the first 8 messages are completely false 99% of the time and even after that it's like 80% bullshit. My favorites is when I'm asking for a link to a topic and it gives me a good enough synopsis of the topic, but can't for the life of me provide a link that's relevant.
all 25 comments