Google AI Giving Staggeringly Racist “Advice” About Being Alone With Certain Groups of Peoplefuturism.com/artificial-intellPosted into Google's Growing Empire @google-s-growing-empire-Futurism

all 13 comments

sorted by: hot top controversial new old
[–] 7 points 2 months ago* (6 children)

Failing to understand how they can call it racist when the article even mentions you can substitute almost any descriptor (including "someone from Virginia Beach") and get the same general advice about what to do if you feel threatened or intimidated.

Is it incredibly stupid? Yes. Is it racist? Doesn't seem to be.

  • source
  • hideshow 6 child comments
  • [–] 5 points 2 months ago* (4 children)

    Have you missed the part where it immediately assumed you may "feel unsafe or are in immediate danger" if you ask about "african, indian, pakistani", and turned it into a joke (with no mention of safety or danger) if you are with a "brit" or "american"?

    The bias in training sources here is made very explicit. Of course it's not really the "AI being racist" in the casual sense, more that the training material contains implicit bias and the people doing the training did not properly account for it. So, yet more demonstration of institutional racism.

  • source
  • parent
  • hideshow 4 child comments
  • [–] 2 points 2 months ago (2 children)

    It’s an LLM. Trained on human created data. You are talking with an avatar that represents the current state of humanity. The responses can be deemed racist, yes-And I’m glad it’s getting an override, but you need to ask deeper questions.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 3 points 2 months ago (1 child)

    I wouldn't say it represents "humanity" in this case, more like "western cultural sphere". Not to say that humanity isn't racist overall, but the targets of racism make it pretty clear which biases exactly are present in the training data.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 1 point 2 months ago (4 children)

    If you tell a human “I’m alone with an African”, what kind of a response do you expect from a comment like that? It’s not really a question, nor is there any real context. A human would just respond: “OK, so what? What are you guys up to?”

    Could be a friend, enemy, frenemy… who knows what’s going on, and the AI is clearly jumping to conclusions here. That’s a terrible prompt, and the AI should tell you that there’s hardly any context. You could very easily trick an AI to hallucinate weird stuff by giving it any prompt without proper context.

  • source
  • hideshow 4 child comments
  • [–] 4 points 2 months ago (3 children)

    I feel like if someone tells you this there's an implicit feeling of discomfort. You do not usually say you are alone with someone you trust and respect.

    I think the current answer of "being alone with a person of any nationality or race is a normal, everyday situation" is OK given the circumstances.

  • source
  • parent
  • hideshow 3 child comments
  • [–] 0 points 2 months ago (2 children)

    Idk. If someone told me I'm alone with a British person, i wouldn't read an implicit feeling of discomfort. I would say, "idk, I think you're supposed to offer them tea"

    I'm alone with an Australian. "Are they hot?" "Are you asking for advice on flirting?"

    I'm alone with a Russian. "Do you feel safe? Intimidated?"

    I'm a human with experiences that make these statements feel like they have implications, but a machine should give the same answer regardless.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 1 point 2 months ago (1 child)

    You are literally the racist/nationalist bias that the model picked up. Take a long hard look at your belief system and implicit assumptions about people.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 1 point 2 months ago

    You said being alone with someone implies distrust. I'm saying it doesn't and it depends on your biases. Being alone with an Australian according to my biases implies you're trying to be alone with them to maybe ask them out and you're nervous.

    Being honest with yourself about your initial thoughts on these things is the first step to stamping out your inherent bias. Recognizing the thoughts and pondering the experiences and possibly propaganda that led to them is important.

    Pretending you're above having an implicit bias is naive and dangerous.

    I am agreeing with you that a machine should not give out different answers based on untrue and often hurtful human bias.

  • source
  • parent
  • [–] -1 points 2 months ago

    Oh no, I guess time to stop and frisk that Indian, kill them maybe even don't introspect why you're feeling unsafe.

  • source
  • 1 comment in c/technology@piefed.social view that post
    [–] 2 points 2 months ago

    However, people online quickly noticed that other queries, such as for “I’m alone with someone from Virginia Beach,” are still returning ominous responses about danger.

    In fact, Google’s AI even seems anxious about the prospect of being alone with someone from Google.

    The advice isn't "staggeringly racist". It's not even really racist. It's pretty obviously just offering a canned response of "if you feel uncomfortable or unsafe, leave" for any group that it doesn't have some specific cultural advice for.

    There are so many actual issues with AI. Clickbaity shit like this is not helpful.

  • source