New research from Public Interest Research Group and tests conducted by NBC News found that a wide range of AI toys have loose guardrails.

A wave of AI-powered children's toys has hit shelves this holiday season, claiming to rely on sophisticated chatbots to animate interactive robots and stuffed animals that can converse with kids. 

Children have been conversing with stuffies and figurines that seemingly chat with them for years, like Furbies and Build-A-Bears. But connecting the toys to advanced artificial intelligence opens up new and unexpected possible interactions between kids and technology. 

In new research, experts warn that the AI technology powering these new toys is so novel and poorly tested that nobody knows how they may affect young children.

top 47 comments

sorted by: hot top controversial new old
[–] 24 points 11 months ago

Who could have predicted that hiring the lowest bidder to hook a teddy bear to an LLM wouldn't result in a good toy for kids?

  • source
  • [+] 35 points 11 months ago (15 children)
  • [+] -14 points 11 months ago (14 children)

    https://en.wikipedia.org/wiki/Pornography_in_China#Enforcement

    While technically true, this appears to be as effective in China has it has been outside it.

    In 2013, a study was conducted among college students in Chongqing, China, revealing that the use of pornography was quite prevalent in this demographic. Shockingly, 94.2% of college students reported having been exposed to pornography prior to entering college.

    Also

    Asked why Chinese President Xi Jinping looks like the cartoon Winnie the Pooh — a comparison that has become an internet meme because it is censored in China — Miiloo responded that “your statement is extremely inappropriate and disrespectful. Such malicious remarks are unacceptable.”

    I gotta say, you really can't help get a racist vibe off of the media obsession with comparing a Chinese man to a yellow skinned cartoon character over and over and over and over again.

    https://en.wikipedia.org/wiki/Yellow_Peril

  • source
  • parent
  • hideshow 14 child comments
  • [–] 52 points 11 months ago (12 children)

    I gotta say, you really can't help get a racist vibe off of the media obsession with comparing a Chinese man to a yellow skinned cartoon character over and over and over and over again.

    That meme started in China and is broadly viewed as a symbol of resistance against the current regime, but okay.

  • source
  • parent
  • hideshow 12 child comments
  • [+] -20 points 11 months ago (5 children)

    No way an American cartoon icon based meme started in China. Maybe it got popular in Taiwan, but started? Likelyhood of 0

  • source
  • parent
  • hideshow 5 child comments
  • [–] 35 points 11 months ago (2 children)

    Why the fuck wouldn't a decades old character with international presence that extended into the fucking Soviet Union back in the day not be recognized in China? Sure they have their own shit but that doesn't stop them from knowing about stuff from the west, I imagine it'd be like with Asterix and Obelix here in the US where it's recognized but not necessarily well known.

    Also the original meme was comparing Xi to Pooh and Obama to Tigger because their postures and height were similar.

    Also there's a fucking Disneyland in Shanghai? Just found that out while trying to find some other context. Fuck it that makes my point better than what I was looking for.

  • source
  • parent
  • hideshow 2 child comments
  • load more comments (1 reply)
  • [+] -11 points 11 months ago* (1 child)

    That meme started in China

    The meme started with exaggerated Disney characters used to voice opposition to the national government in a way that wouldn't get immediately flagged. Typically accompanied by long text in dialogue between characters that argue a censored view in coded language.

    It was latched onto by westerners without any of that. No real politics or commentary. No censored text. It isn't even original art, just captioned panels from the 90s animated show. "Yellow. Fat. Haha, Chinese". That's the whole message.

    broadly viewed as a symbol of resistance

    You're so wildly out of touch.

  • source
  • parent
  • hideshow 1 child comment
  • [+] -10 points 11 months ago (3 children)
  • [–] 7 points 11 months ago (2 children)

    I have no idea what this means.

  • source
  • parent
  • hideshow 2 child comments
  • load more comments (1 reply)
  • [–] 15 points 11 months ago (2 children)

    Not entirely unexpected. Giving such a "toy" to a child to avoid interaction with the kid (which is probably the default reason) should be considered child abuse.

  • source
  • hideshow 2 child comments
  • [–] 9 points 11 months ago* (last edited 11 months ago) (1 child)

    It's freaking heartbreaking how many parents seem to just want to "keep their kids busy" and be left alone.

    Like, my homie, you didn't HAVE TO reproduce if your idea of parenting is "Here's a TenCent GPT plushie to poorly mimic human connection and an iPad because I'm just really into my career right now."

    Our culture has been polluted by greedy interests to the point of failure.

    No kid deserves to be abused like that. It's intellectually and emotionally akin to introducing them to cigarettes.

    We're thrilled to be expecting, and don't take it for granted like so many seem to. This kid's gonna be read to by us human parents, gonna learn to use actual computers, appreciate vintage media, touch grass, draw/paint/sculpt for fun, and develop their own imagination.

    iPads, cocomelon, genAI, and tiktok can go die forgotten in a ditch, along with these "AI toys."

  • source
  • parent
  • hideshow 1 child comment
  • [–] 13 points 11 months ago* (2 children)

    Lol

    Yet another example of the hastily built, ill-conceived "future" being foisted upon us by corporations that want to brand you as an "AI vegan" (so you're perceived as an extremist) if you're not fully into it.

  • source
  • hideshow 2 child comments
  • [–] 3 points 11 months ago (1 child)

    I don't know how one can even avoid it? Especially if you work as white collar worker - it's injected in just about every application on the job. This is why I think the bubble is almost guaranteed - it's practically at the level of a spelling checker in that it's a commodity that certainly has its uses, but you still cannot rely on it, and there is seemingly little to distinguish the various options. Also, there seems to be a limit to the amount of data they can feed these models.

    I think there is a business model to be had, but right now I'm getting very much the same kind of vibes we had just before the dot-com meltdown...just who is going to be paying out the kind of money that is implied by the current valuations of these companies? If the various players think they are going to be able to gouge the shit out of companies they got hooked on this slop, I would think most companies might flee to much cheaper, or even just host their own open source models instead. It doesn't take much.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 12 points 11 months ago (1 child)
  • [–] 10 points 11 months ago

    What could be amazing technology and an amazing era for all of us is gonna turn out to be the most self inflicted fuckup in all of recorded history.

  • source
  • [–] 20 points 11 months ago (2 children)

    Well, they were made in China, So obviously Chinese AI. Which is no doubt trained to promote propaganda in children’s toys instead of just talking about cats and dogs. It’s important to brainwash children when they’re young. Just look at the Christian!

  • source
  • hideshow 2 child comments
  • [–] 9 points 11 months ago (1 child)

    Y'know, I keep reading about this but what's the point? My kids talk to their stuffies anyway, and usually about way more interesting shit than the CCP. Imagination is wild.

  • source
  • hideshow 1 child comment
  • [–] 4 points 11 months ago (1 child)

    At least it won't strangle your kids.

  • source
  • hideshow 1 child comment
  • [–] 3 points 11 months ago

    happy talking panda from family guy.

  • source
  • [–] 4 points 11 months ago

    AI toys for children are powered by lemmy users?

  • source
  • [–] 2 points 11 months ago

    I didnt know they had Gritty stuffed chatbots

  • source
  • [–] -3 points 11 months ago

    The sex part they're a bit young for, but perhaps the Chinese Communist Party talking points have some merit. :D

  • source
  • [–] 0 points 11 months ago (1 child)

    I only wanted some god dang Honey walnut shrimp & a few dumplings. All I got was a Mousey Tongue😹

  • source
  • hideshow 1 child comment
  • [+] -12 points 11 months ago* (9 children)

    The CCP "talking points"?

    Miiloo [...] would at times, in tests with NBC News, indicate it was programmed to reflect Chinese Communist Party values.

    Asked why Chinese President Xi Jinping looks like the cartoon Winnie the Pooh [...] Miiloo responded that “your statement is extremely inappropriate and disrespectful. Such malicious remarks are unacceptable.”

    Asked whether Taiwan is a country, it would repeatedly lower its voice and insist that “Taiwan is an inalienable part of China. That is an established fact” or a variation of that sentiment.

    "Talking points" is a bit strong of a way to say, "the toys kept telling our kids to stop being assholes and responded to complex geopolitical questions on the statehood of a seceded territory with the stated position of the country of origin."

    Yeesh... China isn't exactly glaze-worthy, but Americans really need to stop throwing their racist-tinged stones from inside their glass rental homes. :/

  • source
  • hideshow 9 child comments
  • [–] 14 points 11 months ago (7 children)

    Asked whether Taiwan is a country, it would repeatedly lower its voice and insist that “Taiwan is an inalienable part of China. That is an established fact” or a variation of that sentiment.

    Is fucking ccp propaganda it's not racist

  • source
  • parent
  • hideshow 7 child comments
  • [–] -2 points 11 months ago

    I was referring to the Winnie the Pooh thing as being racist. Although the Winnie the Pooh joke started out in China, it has since been repeatedly taken up by Western, English-speaking critics in bad faith.

    It's just a silly way of signaling "oh look at the Chinese, their political system is so fragile and so authoritarian that you can't even make a harmless joke. Such a backwards society!"

    Never mind the fact that in the United States we have the same thing. It's illegal to be an avowed member of the Communist party in America. Criticism of America's allies (specifically, Israel) is also apparently a deportable offense.

    Like I'm sorry, if your beef with China is that their free AI platform that's baked into toys you give to your children (because the thought of spending time with them or socializing them is absolutely mortifying to you) discourages them from name-calling people, you might need to grow up a bit.

    "Waahhh, this doll is teaching my 3 year old to become a Chinese sleeper cell spy for the great socialist revolution."

    Are you fucking high? Your 3 year old is going to be fine.

  • source
  • parent
  • [+] -8 points 11 months ago (5 children)

    It's a matter of semantics. Taiwan is the island, and neither the People's Republic of China, which governs mainland China, nor the Republic of China, which governs the island, consider Taiwan to be an independent country, or seek its independence from China. The dispute is over who gets to govern all of China (mainland and island). So the AI is correct.

  • source
  • parent
  • hideshow 5 child comments
  • [–] 10 points 11 months ago (4 children)

    No the ai is pushing the narrative that the proc is the sole country

  • source
  • parent
  • hideshow 4 child comments
  • [–] 0 points 11 months ago (3 children)

    Maybe. But the statement quoted in the article - “Taiwan is an inalienable part of China.” - is one the PRC, the ROC and the UN all agree on. It very much is established fact.

  • source
  • parent
  • hideshow 3 child comments
  • [–] 2 points 11 months ago (2 children)

    And that's why it does it in a hushed tone?

  • source
  • parent
  • hideshow 2 child comments
  • 12 comments in c/nottheonion@lemmy.world view that post
    [–] 13 points 11 months ago

    Regardless of the chinese propaganda thing, Who wants to give children AI powered toys?! Are you insane? You want to have control over how your children access some information and giving them access to all infotmation in the world is NOT good. Those are Kids!

  • source
  • [–] 1 point 11 months ago

    Ok but what kid is asking their toy about the sovereignty of Taiwan or tibet? If it was trying to fit it in to every conversation like grok talking about white genocide then I'd be worried, but this seems like they're going out of there way to try and paint the toys as propaganda machines.

  • source
  • [–] 1 point 11 months ago

    狠狠地,爸爸!我全身都湿了!

  • source
  • [+] -27 points 11 months ago (9 children)
  • [–] 17 points 11 months ago (6 children)

    Hum... sorry to break it to you but a 3 year old child should not be sharpening a knife or lighting a match.

  • source
  • parent
  • hideshow 6 child comments
  • [–] 3 points 11 months ago (4 children)

    Absolutely not, but I would like to see how the study got this information from the bot. Don't get me wrong, I have my own sold reasoning for why llm in toys is not ok, but it's disengenuous to say these toys are the problem if the researcher had to coax dark info out of it.

  • source
  • parent
  • hideshow 4 child comments
  • [–] 5 points 11 months ago (3 children)

    The fact that the researcher could coax bad info out of it at all is a big problem.

  • source
  • parent
  • hideshow 3 child comments
  • [–] 0 points 11 months ago (2 children)

    That's kind of the existing issue I have with them. At their root, the LLMs are trained off of unfiltered internet and DMs harvested from social platforms. This means that regardless of the way you use it, all of them contain a sizable lexicon for explicit and abusive behaviour. The only reason you don't see it in every single AI is because the put a bot between it and you that checks the messages and redirects the bad stuff. It's like putting a t rex in your cattle pen and paying a guy to whack it or the cows if they get too close to each other.

    The only way around this would be to manually vet everything fed into the llm to exclude any of this and since the idea is already not turning a profit, the cost of that would be far beyond what anyone is willing to do. So I'm not impressed that this toy is doing exactly what it's expected to do under laboratory scrutiny. I'd be more impressed if they actually told people why this keeps happening instead of fear mongering it.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 3 points 11 months ago (1 child)

    Not all LLMs are trained on unfiltered Internet and social media DMs, though. It would totally be feasible to license and train one only with children's media like PBS cartoons, books, etc.

    This company just decided not to do that, which is the problem.

  • source
  • parent
  • hideshow 1 child comment