Kissaki comments on BBC tested ChatGPT, Copilot, Gemini, and Perplexity on 100 of its own articles; 51% of answers had significant issues

BBC tested ChatGPT, Copilot, Gemini, and Perplexity on 100 of its own articles; 51% of answers had significant issues (www.bbc.co.uk)

submitted 10 months ago by noumenon@lemmy.world to c/machine_learning@programming.dev

2 comments fedilink hide all child comments

you are viewing a single comment's thread
view the rest of the comments

[–] Kissaki@programming.dev 5 points 10 months ago

In December 2024, the BBC carried out research into the accuracy of four prominent AI assistants that can search the internet – OpenAI’s ChatGPT; Microsoft’s Copilot; Google’s Gemini; and Perplexity. We did this by reviewing responses from the AI assistants to 100 questions about the news, asking AI assistants to use BBC News sources where possible.

The answers produced by the AI assistants contained significant inaccuracies and distorted content from the BBC. In particular: …

51 % significant issues, 19 % factual errors, 13 % altered or invalid quote citations

permalink

fedilink

source