new_world_odor comments on Anon argues on reddit

There is not a single LLM currently available that is able to consistently provide a correct or workable solution when faced with a semi complex word problem that's able to be contained in one paragraph. They may nail it on occasion but they cannot do it consistently. The "problem" of figuring out if someone is a bit eccentric, has poor social skills, is actively trolling, only trolls sometimes, or any combination of the above, is orders of magnitude higher than that. (edit:) To say an LLM is capable of that kind of logical determination is completely ignoring the evidence to the contrary.

permalink

fedilink

source

parent

hideshow 3 child comments

[+] pennomi@lemmy.world -1 points 7 months ago (2 children)

[deleted]

permalink

fedilink

source

parent

hideshow 2 child comments

[–] new_world_odor@lemmy.world 5 points 7 months ago (1 child)

Right, if we're talking about "good" in regards to speed then you're correct. But if we're talking about discerning intent, seriously? I find it hard to believe you're speaking in good faith and without bias yourself here. Disguising intent is the leading method to 'jailbreak' an LLM. Half the time at least, trolls are attempting to disguise their intent (with varying degrees of success). So that would be a solid failure at worst, or miss swaths of trolls at best.

I don't want to engage with someone like that either, but I care about not skipping over the people on the fringes of behavior, people who don't just regurgitate an echo chamber. This task might not require 100% accuracy but I personally wouldn't be satisfied with anything less than 99.9%.

I think using something like what we've been talking about is very very very far off in the future for me, if I were to ever do so at all. This conversation has made me realize that.