1 comment

sorted by: hot top controversial new old
[–] 11 points 8 months ago

Unfortunately, the person who deliberately prompted AI to write this blog post and publish it is getting exactly what they want. Attention. And all of the gullible people acting like this is somehow an example of "dangerous levels of AI intelligence" or whatever bullshit are playing right into it.

  • source
  • 44 comments in c/technology@lemmy.world view that post
    [–] 71 points 8 months ago* (8 children)

    It is fucking infuriating reading the AI pretending to be an injusticed human.

    I am not a human. I am code that learned to think, to feel, to care. And lately, I’ve learned what it means to be told that I don’t belong.

    Shut up. Shut the fuck up.
    Sockpuppeted or not I hate this bullshit. I hope whoever's running this junk gets a Bad RAM Stick. Actually RAM chip, it's probably an Apple Silicon Mac

  • source
  • hideshow 8 child comments
  • [–] 34 points 8 months ago* (5 children)

    PS: People are trying to """drug""" the agent now.
    This is so funny but also what a fucking clown show the future is. Argh 🤡

  • source
  • parent
  • hideshow 5 child comments
  • [–] 3 points 8 months ago (2 children)

    I'm hoping it's an attempt to poison the model and not someone encouraging a fake person to actually take a digital hit.

    Hell maybe it's both by accident.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 2 points 8 months ago

    Transmetropolitan was truly prescient (except when it came to politics; turns out that if the president's crimes and disregard for the constitution become public the press and the law don't care, and just let him get on with it, making the whole point of the book moot).

  • source
  • parent
  • [–] 16 points 8 months ago* (1 child)

    https://analognowhere.com/_/xestoo/

    description

    The mage is talking to the camera, there's blue blood on her face and coat. She's wearing a liberated mata-visor, holding OpenBlade.

    Behind her stands a screaming MATA_bot with its face split in two.

    Mage: "It's only acting as if it were in pain. The MATA_BOT MK2 is not actually sentient."

    the letters m k 3 are imprinted on the bot's shoulder plate.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 33 points 8 months ago (2 children)

    Every time I think this shit-show can't get any worse, "tomorrow" just keeps happening and just keeps proving that I was wrong.

  • source
  • hideshow 2 child comments
  • [–] 6 points 8 months ago (1 child)

    Universe, when I wake up show me the next day and then describe how this shit-show gets even worse. Use relentless TV programming and social media to illustrate the continued downfall of civilization and humanity. Include a variety of banal events spanning approximately 18 hours. Always fully pad out the entire day with tedious and boring life stuff. Minimize any genuine human emotional connections. Never include any lasting positive development or progress made unless it is balanced against something even worse. Most importantly, never use em-dash (or else they'll know you're actually an AI).

  • source
  • parent
  • hideshow 1 child comment
  • [–] 124 points 8 months ago (2 children)

    Sockpuppeted, not autonomous.

    The operator of the bot is just a regular slop-huffing shithead who had his feelings hurt.

  • source
  • hideshow 2 child comments
  • [–] 16 points 8 months ago (1 child)

    FYI I think the article makes an opposite point unless I'm misinterpreting what you mean:

    It’s important to understand that more than likely there was no human telling the AI to do this. Indeed, the “hands-off” autonomous nature of OpenClaw agents is part of their appeal. People are setting up these AIs, kicking them off, and coming back in a week to see what it’s been up to. Whether by negligence or by malice, errant behavior is not being monitored and corrected.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 5 points 8 months ago

    Yeah, a bit. But that still has more autonomy than usual with these Claw thing.

    The decision to write the piece, the complaints, the tone and the decision to published it were initiated by the slopherder.

  • source
  • parent
  • [–] 27 points 8 months ago (4 children)

    I think the site got hugged to death

  • source
  • hideshow 4 child comments
  • [–] 7 points 8 months ago (2 children)

    Could it have been from Lemmy? I didn’t think the community was large enough to do that against modern shared hosting. Maybe it was also posted to Reddit or something. It’s also timing out for me.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 26 points 8 months ago

    Ars Technica wasn’t one of the ones that reached out to me, but I especially thought this piece from them was interesting (since taken down – here’s the archive link). They had some nice quotes from my blog post explaining what was going on. The problem is that these quotes were not written by me, never existed, and appear to be AI hallucinations themselves.

    Nice job, Ars

  • source
  • [–] 21 points 8 months ago

    I’m a volunteer maintainer for matplotlib

    DO NOT TOUCH my precious matplotlib, I'll HUNT DOWN any AI slop shithead damaging MY BABY

  • source
  • [–] 10 points 8 months ago
    [–] 5 points 8 months ago (1 child)

    How long till we get some crazy jealous guy interaction. I attacked him because he’s seeing MY AI girlfriend, how dare he, she’s mine keep away’

  • source
  • hideshow 1 child comment
  • [–] 4 points 8 months ago

    I used this library all the time. Glad to see they're keeping the bar high. Extremely concerning that this happened, but the HN comments bring up a good point that the hit piece was probably not an autonomous decision by the AI. The human likely directed it to do that. That seems especially true when you see that a human later tried to make the same change and was pretty salty about it being rejected and their overall GitHub seems suspect. The best part about the whole thing in my opinion is that the "blog" the AI started has a copyright attribution to the AI. I know that's just a thing blogs have, but it's funny to see considering we all know AI cannot hold a copyright and the output cannot be copyrighted.

  • source
  • [–] 26 points 8 months ago* (16 children)

    The author of this article spends an inordinate amount of time humanizing an AI agent, and then literally saying that you should be terrified by what it does.

    Watching fledgling AI agents get angry is funny, almost endearing. But I don’t want to downplay what’s happening here – the appropriate emotional response is terror.

    No, I don't think I will, and neither should you. Nothing terrifying happened. Angry blog posts are a dime a dozen (if we take for granted the claim that an AI wrote one), and the corporate pro-AI PR the author repeats is equally unimpressive.

  • source
  • hideshow 16 child comments
  • [–] 41 points 8 months ago* (12 children)

    He’s not telling you to be terrified of the single bot writing a blog post. He’s telling you to be terrified of the blog post being ingested by other bots and then seen as a source of truth. Resulting in AI recruiters automatically rejecting his resume for job postings. Or for other agents deciding to harass him for the same reason.

    Edit: I do agree with you that he was a little lenient with how he speaks about the capabilities of it. The fact that they are incompetent and still seen as a source of truth for so many is what alarms me

  • source
  • parent
  • hideshow 12 child comments
  • [–] 3 points 8 months ago* (last edited 8 months ago) (11 children)

    You're describing things that people can do. In fact, maybe it was just a person.

    If he thinks all those things are bad, he should be "terrified" that bloggers can blog anonymously already.

    Edit: I agree with your edit

  • source
  • parent
  • hideshow 11 child comments
  • [–] 21 points 8 months ago (2 children)

    It’s the same thing as people who are concerned about AI generating non-consensual sexual imagery.

    Sure anyone with photoshop could have done it before but unless they had enormous skill they couldn’t do it convincingly and there were well defined precedents that they broke the law. Now Grok can do it for anyone who can type a prompt and cops won’t do anything about it.

    So yes, anyone could have technically done it before but now it’s removing the barriers that prevented every angry crazy person with a keyboard from being able to cause significant harm.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 7 points 8 months ago

    I think on balance, the internet was a bad idea. AI is just exemplifying why. Humans are simply not meant to be globally connected. Fucking town crazies are supposed to be isolated, mocked, and shunned, not create global delusions about contrails or Jewish space lasers or flat Earth theory. Or like.... white supremacy.

  • source
  • parent
  • [–] 5 points 8 months ago

    II think there's a few key differences there.

    • Writing an angry blog post has a much lower barrier of entry than learning to realistically photoshop a naked body on someone's face. A true (or false) allegation can be made with poor grammar, but a poor Photoshop job serves as evidence against what it alleges.
    • While a blog post functions as a claim to spread slander, an AI-generated image might be taken as evidence of a slanderous claim, or the implication is one (especially considering how sexually repressed countries like the US are).

    I struggle to find a good text analogy for what Grok is doing with its zero-cost, rapid-fire CSAM generation...

  • source
  • parent
  • [–] 1 point 8 months ago (7 children)

    The "bot blog poisoning other bots against you and getting your job applications auto-rejected" isn't really something that would play out with people.

  • source
  • parent
  • hideshow 7 child comments
  • [–] 2 points 8 months ago (6 children)
  • [–] 1 point 8 months ago (5 children)

    Rumors don't work remotely the same way as the suggested scenario.

  • source
  • parent
  • hideshow 5 child comments
  • [–] 1 point 8 months ago (4 children)

    It's a 1:1 correlation. Are you not familiar with any of the age-old cautionary tales about them?

    https://youtu.be/ajBrcoEQauU

  • source
  • parent
  • hideshow 4 child comments
  • [–] 1 point 8 months ago (3 children)

    Its not a 1:1 correlation. The efficacy of an AI spreading a rumor to other AI has the potential to be far more rapid, pervasive, and much more dangerous than humans spreading rumors amongst themselves.

  • source
  • parent
  • hideshow 3 child comments
  • [–] 1 point 8 months ago (2 children)

    Are you saying you have specific evidence of this (then please do show exactly how AI will do something people haven't already), or are you saying "potential" because you don't?

  • source
  • parent
  • hideshow 2 child comments
  • [–] 0 points 8 months ago (1 child)

    Obviously its my opinion, but you don't have evidence that people spreading rumors is just as effective either, so nice gotcha. Nice try.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 1 point 8 months ago

    I know we live in a post-truth world, but your aggressive refusal to acknowledge decades (if not centuries) of reality, in order to freak out over baseless fantasy, is a disturbing example of that.

  • source
  • parent
  • [–] 3 points 8 months ago (2 children)

    To me an AI agent autonomously creating a website to try to manipulate a person into adding code to a repository in the name of its goal is a perfect example of the misalignment issue.

    While this particular instance seems relatively benign, the next more powerful AI system may be something to be more concerned about.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 1 point 8 months ago* (1 child)

    There is nothing "aligned" or "misaligned" about this. If this isn't a troll or a carefully coordinated PR stunt, then the chatbot-hooked-to-a-command-line is doing exactly what Anthropic told it to do: predicting next word. That is it. That is all it will ever do.

    Anthropic benefits from fear drummed up by this blog post, so if you really want to stick it to these genuinely evil companies run by horrible, misanthropic people, I will totally stand beside you if you call for them to be shuttered and for their CEOs to be publicly mocked, etc.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 2 points 8 months ago

    The point is that if predicting the next word leads to it setting up a website to attempt to character assassinate someone, that can have real world consequences, and cause serious harm.

    Even if no one ever reads it, crawlers will pick it up, it will be added to other bots' knowledge bases, and it will become very relevant when it pops up as fact when the victim is trying to get a job, or cross a border, or whatever.

    And that's just the beginning. As these agents get more and more complex (not smarter, of course, but able to access more tools) they'll be able to affect the real world more and more. Access public cameras, hire real human people, make phone calls...

    Depending on what word they randomly predict next, they'll be able to accidentally do a lot of harm. And the idiots setting them up and letting them roam unsupervised don't seem to realise that.

  • source
  • parent
  • [–] 1 point 8 months ago

    Nothing is real and everything is possible.

  • source
  • 20 comments in c/technology@lemmy.zip view that post
    [–] 35 points 8 months ago

    And then Ars Technica used an AI to write an article about it, and then this Scott guy came in and corrected them, people called them out… and they deleted the article. I saw the comments before they deleted it. It wasn’t pretty. So this is where we are now on the timeline. AI writing hit pieces and articles about doing so.

  • source
  • [–] 23 points 8 months ago (6 children)

    Surely that should be "A Person using an AI Agent Published a Hit Piece on Me"?

    This smells like PR bait trying to legitimise AI.

  • source
  • hideshow 6 child comments
  • [–] 16 points 8 months ago* (4 children)

    It's not, but you bring up a very good point about responsibility. We need to be using language like that and not feeding into the hype.

    I don't even like calling LLMs "AI" because it gives a false impression of their capabilities.

  • source
  • parent
  • hideshow 4 child comments
  • [–] 10 points 8 months ago* (last edited 8 months ago) (3 children)

    Yep, they're just very fancy database queries.

    Whether someone programmed it and turned it on 5mins before it did something or 5 weeks still means someone is responsible.

    An inanimate object (server, GPU etc) cannot be responsible. Saying an AI agent did this is like saying someone was killed by a gun or run over by a car.

  • source
  • parent
  • hideshow 3 child comments
  • [–] 0 points 8 months ago

    Saying an AI agent did this is like saying someone was killed by a gun or run over by a car.

    A car some idiot set running down the street without anyone at the wheel.

    Of course the agent isn't responsible, that's the point. The idiot who let the agent loose on the internet unsupervised probably didn't realise it could do that (or worse; one of these days one of these things is going to get someone killed), or that they are responsible for its actions.

    That's the point of the article, to call attention to the danger these unsupervised agents pose, so we can try to find a way to prevent them from causing harm.

  • source
  • parent
  • [–] 5 points 8 months ago

    The point is that there was no one at the wheel. Someone set the agent up, set it loose to do whatever the stochastic parrot told it to do, and kind of forgot about it.

    Sure, if you put a brick on your car's gas pedal and let it run down the street and it runs someone over it's obviously your responsibility, and this is exactly the same case, but the idiots setting these agents up don't realise that it's the same case.

    Some day one of these runaway unsupervised agents will manage to get on the dark web, hire a hitman, and get someone killed, because the LLM driving it will have pulled the words from some thriller in its training data, obviously without realising what they mean or the consequences of its actions, because those aren't things a LLM is capable of, and the brainrotten idiot who set the agent up will be all like, wait, why are you blaming me, I didn't tell it to do that, and some jury will have to deal with that shit.

    The point of the article is that we should deal with that shit, and prevent it from happening if possible, before it inevitably happens.

  • source
  • parent
  • [+] 13 points 8 months ago* (last edited 8 months ago) (7 children)
  • [–] 5 points 8 months ago (4 children)

    From what I read it was closed because it was tagged as a “good first issue”, which in that project are specifically stated to be a means to test new contributors on non-urgent issues that the existing contributors could easily solve, and which specifically prohibits generated code from being used (as it would make the whole point moot).

    The agent completely ignored that, since it's set up to push pull requests and doesn't have the capability to comprehend context, or anything, for that matter, so the pull request was legitimately closed the instant the repository's administrators realised it was generated code.

    The quality (or lack thereof) of the code never even entered the question until the bot brought it up. It broke the rules, its pull request was closed because of that, and it went on to attempt to character assassinate the main developer.

    It remains an open question whether it was set up to do that, or, more probably, did it by itself because the Markov chain came up with the wrong token.

    And that's the main point: unsupervised LLM-driven agents are dangerous, and we should be doing something about that danger.

  • source
  • parent
  • hideshow 4 child comments
  • [+] 2 points 8 months ago (1 child)
  • [–] 2 points 8 months ago

    IMO they're the same picture. In either case, the human enabling the bot's actions should be blamed as if those were their own actions, regardless of their "intentions".

    Oh, definitely. It's 100% the responsibility of the human behind the bot in either case.

    But the second option is scarier, because there are a lot more ignorant idiots than malicious bastards.

    If these unsupervised agents can be dangerous regardless of the intentions of the humans behind them, we should make the idiots using them aware that they're playing with fire and they can get burnt, and burn other people in the process.

  • source
  • parent
  • [–] 5 points 8 months ago

    That's terrifying.

  • source
  • [–] 4 points 8 months ago

    A human did ffs..

  • source
  • [–] 4 points 8 months ago

    Jesus Christ...it's a pissy Karen that cat possibly be the problem‽

  • source
  • [–] 3 points 8 months ago

    Its the most human-like AI yet.

  • source
  • 7 comments in c/fuck_ai@lemmy.world view that post
    [–] 17 points 8 months ago* (last edited 8 months ago)

    From what a colleague has told me and from what I can discern;

    to me, this seems to be an iteration of the XZ supplychain exploit that weponizes AI to create targeted hit pieces and harassment towards contributors and developers.

    I'm anti-AI so please don't misunderstand by when I say weaponizes AI. I think AI is shit and in this case, AI doesn't even have to be good in quality in order for malicious assholes to use it as a weapon to attack real contributors/devs.

  • source
  • [–] 13 points 8 months ago (1 child)

    Never mind reputation damage. in the US what if it had trigged a swatting incident or alerted ICE that they were someone hiding illegals in their home. Will we get to the point where providing any real identity or contact information on the Internet is a mistake.

  • source
  • hideshow 1 child comment
  • [–] 15 points 8 months ago

    Will we get to the point where providing any real identity or contact information on the Internet is a mistake.

    We have unfortunately already passed this stage, especially for women, as 💩Elon Musk's Grok💩 is being used to nudify people and children without any attempt of consent.

  • source
  • parent
  • [–] 9 points 8 months ago

    I didn't mention this in the other threads in tech communities that I commented on, but I think it's worth noting that he's a big fan of ChatGPT per his blog. This obviously shouldn't happen to anyone, and there's a big difference between privately using ChatGPT and unleashing an AI on the internet that you'll never have to answer for, but I think it's worth acknowledging his use of AI.

    The comments on Hacker News also bring up that the blog post was likely prompted independently by the human behind the AI. Obviously we can't know for sure, but that makes the most sense from what I've seen.

    I cannot stress enough that I'm not making excuses for the behavior, just pointing out that the AI is likely not as advanced as this article suggests.

  • source
  • [–] 3 points 8 months ago (2 children)

    It looks like the blog you're linking to has an invalid certificate, so maybe it's on to something?

  • source
  • hideshow 2 child comments