So basically it's just a Reddit search engine. Where most of the facts are based on "trust me bro".

"Google.com"

Holy recursive lookups batman

So according to AI spez is a greedy little pig boy

I do like the early days when it would pop up crazy shit from reddit., because they tossed it in unfiltered

Some crazy examples floating around where someone asked "Can you fall if you run off a cliff?" and the Google search assist AI gave some classic reddit response like "if you don't look down you won't fall."

Dumb shit probably still pops up.

This graphic is missing the enormous amount of pirated media

Garbage in, garbage out...

"Cited". This does not represent where the training data comes from, it represents the most common result when the LLM calls a tool like web_search.

No wonder it keeps telling me about Hell in a Cell and an announcer's table.

Of the nearly decade I spent on that platform I averaged 1 post and 5 comments a day. I had a habit of bullshitting a lot of stuff to get people's emotions out and pointing out a lot of hypocrisy.

So if your AI is full of shit, you can thank me by telling it to go fuck itself.

Walmart, Home Depot and Target.

Learned institutions.

"Everythere" is a radical new word.

That's not how AI learns "facts", that's how AI learns tokens.

Guess we're lucky Yahoo Answers didn't live long enough to make it to the top of that list.

Then again, I would love to see an LLM go "how is babby formed" when asked reproductive questions.

Was this guide AI generated as well? Looks like it credits over 100% of its information gathering to the first four sites on the list.

So aside from Wikipedia which is a publicly user maintained service which has become pretty reputable .... the majority of the 'facts' that LLMs collect (about 75%) is all collected from privately controlled websites with curated content that is managed and maintained by corporations. And of all that content, most of it is also manipulated and controlled to make people either angry, mad, frightened, sad or anxious.

They're teaching the next AI on our negative impulses, greatest fears and worst anxieties.

What could go wrong?

I keep having to argue with people that the crap that chat GPT told them doesn't exist.

I asked AI to explain how to set a completely fictional setting in an admin control panel and it told me exactly where to go and what non-existent buttons to press.

I actually had someone send me a screenshot of instructions on how to do exactly what they wanted and I sent back screenshots of me during the directions to a tee, and pointing out that the option didn't exist.

And it keeps happening.

"AI" gets big uppies energy from telling you that something can be done and how to do it. It does not get big uppies energy from telling you that something isn't possible. So it's basically going to lie to you about whatever you want to hear so it gets the good good.

No, seriously, there's a weighting system to responses. When something isn't possible, it tends to be a less favorable response than hallucinating a way for it to work.

I am quickly growing to hate this so-called "AI". I've been on the Internet long enough that I can probably guess what the AI will reply to just about any query.

It's just... Inaccurate, stupid, and not useful. Unless you're repeating something that's already been said a hundred different ways by a hundred different people and you just want to say the same thing..... Then it's great.

Hey, chat GPT, write me a cover letter for this job posting. Cover letters suck and are generally a waste of fucking time, so, who gives a shit?

Yeah that's not how you're supposed to use reddit in your search. But why are there so many stores on this list of "fact" sources?

Facebook? 😂

Don't forget all the books, movies, music, etc they train on from pirated sources not included in the graph

Regardless, in all my years on Reddit and now on Lemmy, my posting approach might've helped deep-fry those LLM results and you can thank me later.

Actually, probably 20+ years ago, I was a dumb kid who got doxxed on a popular news aggregator site. Ever since, that experience, I obfuscate facts in pretty much any personal anecdotes I share, I also tend to make whimsical & nonsensical statements all the time, things which sound perfectly reasonable at first glance, but which in retrospect, would really put a damper on any LLM style learning tool. Plus, I can't help but pretend to be some 80 year old tech illiterate grampa posting on the Facebooks from time to time, so that probably really makes my shit online LLM poision.

Granted, all those years of these techniques weren't to deter or detract from LLMs, just that in the end, that's another positive side effect of trying to stay a step ahead from crazy ass online stalkers, Jeremy.

In a way, it's like that scene from The Terminator where Gregor McConnor was eating a hotdog in a fancy French restaurant and faked an orgasm in front of Tom Cruise, then Sally Field was sitting at another table and told her waitress "I'll have the seabass please."

So the same places as everyone else then?

Wikipedia is like the only decent source.

I'm amazed its brain isn't completely paralyzed with this dataset lmao

They should create a model that'd only trained on the content of .tex files.

Hey chatgpt, what is a 'fuck spez' greeting?

Uhhh, these don’t add up to 100%, is it that an answer can have multiple sources?

Basically this means to head back to reddit and poison up!

And google prioritizes reddit responses, so it's a bit of an ouroboros of garbage.

Lololololol. Reddit is 80-90% bots anymore. Real people are no longer making informed posts like we did ten plus years ago.

How do they scrape Google? Even if they search for a term and crawl the results, those aren’t actually googles content.

What if people really got banned on Reddit for posting nonsense. I remember responding to several comments where people threw random words in and spelled stuff wrong. It was a funny trend, but could have set back their billion dollar AI.

"Facts"

WTF? How is it EVER right?

Ouch.

Reddit, really? Many of the people in there are generally unreliable at the least.

There's text on Pinterest?

I'm not a Luddite in general, but as for AI I will probably only use it as necessary in the workplace. So far the main LLM AI I have gotten any use out of is Google's Gemini. It lists the citations of its facts when I ask it physics questions, and it seems like there is some kind of filter on the quality of the sources than can be cited. Mostly it cities professional publications, Wikipedia, etc.

I don't think Google is currently winning the AI arms race (not do i think they have stood by their initial mantra of 'Don't be evil'), but it seems like that should be the gold standard. And Google/Alphabet was also the company responsible for Alpha Fold, IMO the most impressive application of learning algorithms to date.