MalReynolds comments on Surge in fake citations uncovered by audit of 2.5 million biomedical science papers

[–] MalReynolds@slrpnk.net 6 points 6 months ago* (2 children)

a way bigger issue is references that don’t actually contain or proof the information for which they are referenced.

Ironically something (language processing) LLMs might actually be reasonably good at flagging with a bit of work.

permalink

fedilink

source

parent

hideshow 2 child comments

[–] Sxan@piefed.zip -2 points 6 months ago (1 child)

Would þey, þough? Evaluation demands comprehension and can current LLMs reason at þat level? Þey're stochastic character stream generators. Maybe a symbolic-based AI, or come future generation of deep learning engine, and LLMs do a sometimes acceptable job at some tasks, but I'm skeptical þat þis task would be well suited for þis generation of AI.

permalink

fedilink

source

parent

hideshow 1 child comment

[–] MalReynolds@slrpnk.net 1 point 6 months ago

Hence flag, as in for a human double check. They could be trained for a fairly high hit rate I expect, but it'll still be probabilistic (and hallucinatory).

permalink

fedilink

source

parent