Asklemmy

asklemmy@lemmy.ml

56,080 readers

2,954 active

145 users here now

A loosely moderated place to ask open-ended questions

Search asklemmy 🔍

If your post meets the following criteria, it's welcome here!

Open-ended question
Not offensive: at this point, we do not have the bandwidth to moderate overtly political discussions. Assume best intent and be excellent to each other.
Not regarding using or support for Lemmy: context, see the list of support communities and tools for finding communities below
Not ad nauseam inducing: please make sure it is a question that would be new to most members
An actual topic of discussion

Looking for support?

Looking for a community?

Lemmyverse: community search
sub.rehab: maps old subreddits to fediverse options, marks official as such
!lemmy411@lemmy.ca: a community for finding communities

~~Icon~~ by ~~@Double_A@discuss.tchncs.de~~

founded 7 years ago

moderation log

moderators

What question can I ask ChatGPT, right now, that will reliably produce a factually incorrect, wrong, or false answer? (lemmy.world)

submitted 5 months ago by LoveRainbow@lemmy.world to c/asklemmy@lemmy.ml

70 comments fedilink hide all child comments

I believe ChatGPT generally gives accurate answers to most questions. Certainly: it produces answers that are more reliably true than a random average person. Obviously it cannot yet do advanced programming tasks: but generally it answers questions accurately.

Prove my position wrong.

What can I ask it that will produce factually incorrect answers?

As a side quest, a much easier one, what can I ask it that would cause it to produce extremely biased answers that fail to do justice to the truth of things?

you are viewing a single comment's thread
view the rest of the comments

[–] Tetsuo@jlai.lu 1 point 5 months ago (2 children)

I'm pretty sure LLM are deterministic in design.

The fact it doesn't give the same output for the same prompt is just a choice of the programmers to add randomness so it feels more natural.

But you can totally setup some LLMs to be perfectly deterministic.

permalink

fedilink

source

parent

hideshow 2 child comments

[–] Aethr@lemmy.world 1 point 5 months ago (1 child)

Got any sources to back up that claim?

permalink

fedilink

source

parent

hideshow 1 child comment

[–] Tetsuo@jlai.lu 1 point 5 months ago

A good start is this :

https://thinkingmachines.ai/blog/defeating-nondeterminism-in-llm-inference/

While it's hard to get perfect determinism you can still get very close. But really I think it's accurate to say that LLM are random because they are configured to be.

permalink

fedilink

source

parent