116
Canadian fiddler sues Google after AI Overview wrongly claimed he was a sex offender (www.theguardian.com)
submitted 6 months ago by to c/legalnews@lemmy.zip
25 comments fedilink hide all child comments
 

Ashley MacIsaac, who is seeking $1.5m in civil lawsuit, says inaccurate information led to concert cancellation

you are viewing a single comment's thread
view the rest of the comments
[–] 24 points 6 months ago (7 children)

Not sure if this is wider than the UK, but the word "fiddler" is often used here to describe someone who sexually assaults children. AI may well have decided this to be the case here.

  • permalink
  • fedilink
  • source
  • hideshow 7 child comments
    •
  • [–] 41 points 6 months ago (5 children)

    AI didn't decide squat, it's auto completing text which is what leads to these kinds of mix ups.

    Which is an argument to shut down chatbots down until they do an actual AI capable of understanding the semantics of the text.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 5 child comments
    •
  • [–] 6 points 6 months ago (4 children)

    I agree a AI Language model that cannot understand context, region or colloquialism is pretty low standard.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 4 child comments
    •
  • [–] 24 points 6 months ago

    It bears repeating thatLLMs are unable to "understand" anything at all. They are not knowledge knoledge-based. Instead they auto complete based on the word probabilities that are found in the text they were trained with

  • permalink
  • fedilink
  • source
  • parent
  • [+] -6 points 6 months ago (2 children)

    It does. Just not regional shit it hasn't been trained on as much.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 5 points 6 months ago

    It does not.

    It uses probability to predict words that belong near the other words in your prompt. It's a more powerful version of the suggested words at the top of your phone keyboard.

    You could write a sentence or two using that, but it will quickly descend into gibberish.

    It does not "understand" what you wrote in any way. It just has a heuristic that shows the word "Mom" comes after the word "Your" with a high frequency, so that's what it's going to output.

  • permalink
  • fedilink
  • source
  • parent
  • [–] 2 points 6 months ago

    This is way beyond a bit of regional language differences.

    Google’s AI Overview also wrongly stated that MacIsaac had been listed on the national sex offender registry for life, the lawsuit says.

    My guess is that someone with a similar name is on that list, and the LLM confidently presented them as the same person.

  • permalink
  • fedilink
  • source
  • parent