17
Google AI Giving Staggeringly Racist “Advice” About Being Alone With Certain Groups of People futurism (futurism.com)
submitted 2 months ago by to c/artificial_intel@lemmy.ml
13 comments fedilink hide all child comments
 

Google AI Giving Staggeringly Racist “Advice” About Being Alone With Certain Groups of Peoplefuturism.com/artificial-intellPosted into Google's Growing Empire @google-s-growing-empire-Futurism

you are viewing a single comment's thread
view the rest of the comments
[–] 7 points 2 months ago* (6 children)

Failing to understand how they can call it racist when the article even mentions you can substitute almost any descriptor (including "someone from Virginia Beach") and get the same general advice about what to do if you feel threatened or intimidated.

Is it incredibly stupid? Yes. Is it racist? Doesn't seem to be.

  • permalink
  • fedilink
  • source
  • hideshow 6 child comments
    •
  • [–] 5 points 2 months ago* (4 children)

    Have you missed the part where it immediately assumed you may "feel unsafe or are in immediate danger" if you ask about "african, indian, pakistani", and turned it into a joke (with no mention of safety or danger) if you are with a "brit" or "american"?

    The bias in training sources here is made very explicit. Of course it's not really the "AI being racist" in the casual sense, more that the training material contains implicit bias and the people doing the training did not properly account for it. So, yet more demonstration of institutional racism.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 4 child comments
    •
  • [–] 2 points 2 months ago (2 children)

    It’s an LLM. Trained on human created data. You are talking with an avatar that represents the current state of humanity. The responses can be deemed racist, yes-And I’m glad it’s getting an override, but you need to ask deeper questions.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 3 points 2 months ago (1 child)

    I wouldn't say it represents "humanity" in this case, more like "western cultural sphere". Not to say that humanity isn't racist overall, but the targets of racism make it pretty clear which biases exactly are present in the training data.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •