Or my favorite quote from the article

"I am going to have a complete and total mental breakdown. I am going to be institutionalized. They are going to put me in a padded room and I am going to write... code on the walls with my own feces," it said.

top 97 comments

sorted by: hot top controversial new old
[–] 263 points 1 year ago (7 children)

Google replicated the mental state if not necessarily the productivity of a software developer

  • source
  • hideshow 7 child comments
  • [–] [S] 109 points 1 year ago (3 children)

    Gemini has imposter syndrome real bad

  • source
  • parent
  • hideshow 3 child comments
  • [–] 134 points 1 year ago (24 children)

    I was an early tester of Google's AI, since well before Bard. I told the person that gave me access that it was not a releasable product. Then they released Bard as a closed product (invite only), to which I was again testing and giving feedback since day one. I once again gave public feedback and private (to my Google friends) that Bard was absolute dog shit. Then they released it to the wild. It was dog shit. Then they renamed it. Still dog shit. Not a single of the issues I brought up years ago was ever addressed except one. I told them that a basic Google search provided better results than asking the bot (again, pre-Bard). They fixed that issue by breaking Google's search. Now I use Kagi.

  • source
  • hideshow 24 child comments
  • [–] 10 points 1 year ago (6 children)

    I remember there was an article years ago, before the ai hype train, that google had made an ai chatbot but had to shut it down due to racism.

  • source
  • parent
  • hideshow 6 child comments
  • [–] 30 points 1 year ago (4 children)

    Are you thinking of when Microsoft's AI turned into a Nazi within 24hrs upon contact with the internet? Or did Google have their own version of that too?

  • source
  • parent
  • hideshow 4 child comments
  • [–] 26 points 1 year ago (1 child)

    I know Lemmy seems to very anti-AI (as am I) but we need to stop making the anti-AI talking point "AI is stupid". It has immense limitations now because yes, it is being crammed into things it shouldn't be, but we shouldn't just be saying "its dumb" because that's immediately written off by a sizable amount of the general population. For a lot of things, it is actually useful and it WILL be taking peoples jobs, like it or not (even if they're worse at it). Truth be told, this should be a utopic situation for obvious reasons

    I feel like I'm going crazy here because the same people on here who'd criticise the DARE anti-drug program as being completely un-nuanced to the point of causing the harm they're trying to prevent are doing the same thing for AI and LLMs

    My point is that if you're trying to convince anyone, just saying its stupid isn't going to turn anyone against AI because the minute it offers any genuine help (which it will!), they'll write you off like any DARE pupil who tried drugs for the first time.

    Countries need to start implementing UBI NOW

  • source
  • parent
  • hideshow 1 child comment
  • [–] 22 points 1 year ago

    Countries need to start implementing UBI NOW

    It is funny that you mention this because it was after we started working with AI that I started telling one that would listen that we needed to implement UBI immediately. I think this was around 2014 IIRC.

    I am not blanket calling AI stupid. That said, the AI term itself is stupid because it covers many computing aspects that aren't even in the same space. I was and still am very excited about image analysis as it can be an amazing tool for health imaging diagnosis. My comment was specifically about Google's Bard/Gemini. It is and has always been trash, but in an effort to stay relevant, it was released into the wild and crammed into everything. The tool can do some things very well, but not everything, and there's the rub. It is an alpha product at best that is being forced fed down people's throats.

  • source
  • parent
  • [–] 1 point 1 year ago (1 child)

    Weird because I’ve used it many times fr things not related to coding and it has been great.

    I told it the specific model of my UPS and it let me know in no uncertain terms that no, a plug adapter wasn’t good enough, that I needed an electrician to put in a special circuit or else it would be a fire hazard.

    I asked it about some medical stuff, and it gave thoughtful answers along with disclaimers and a firm directive to speak with a qualified medical professional, which was always my intention. But I appreciated those thoughtful answers.

    I use co-pilot for coding. It’s pretty good. Not perfect though. It can’t even generate a valid zip file (unless they’ve fixed it in the last two weeks) but it sure does try.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 1 point 1 year ago

    Not a single of the issues I brought up years ago was ever addressed except one.

    That's the thing about AI in general, it's really hard to "fix" issues, you maybe can try to train it out and hope for the best, but then you might play whack a mole as the attempt to fine tune to fix one issue might make others crop up. So you pretty much have to decide which problems are the most tolerable and largely accept them. You can apply alternative techniques to maybe catch egregious issues with strategies like a non-AI technique being applied to help stuff the prompt and influence the model to go a certain general direction (if it's LLM, other AI technologies don't have this option, but they aren't the ones getting crazy money right now anyway).

    A traditional QA approach is frustratingly less applicable because you have to more often shrug and say "the attempt to fix it would be very expensive, not guaranteed to actually fix the precise issue, and risks creating even worse issues".

  • source
  • parent
  • [–] -1 points 1 year ago (10 children)

    5 bucks a month for a search engine is ridiculous. 25 bucks a month for a search engine is mental institution worthy.

  • source
  • parent
  • hideshow 10 child comments
  • [–] 3 points 1 year ago (3 children)
  • [–] 1 point 1 year ago (2 children)

    And duckduckgo is free. Its interesting that they don't make any comparisons to free privacy focused search engines. Cause they still don't have a compelling argument for me to use and pay for their search. But i aint no researcher so maybe it worth it then 🤷‍♂️

  • source
  • parent
  • hideshow 2 child comments
  • [–] 1 point 1 year ago (1 child)

    I mean, you have 100 queries free if you want to try.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 1 point 1 year ago

    Just really don't see the worth in trying it period. There are enough privacy focused free search engines that get me all the answers i need from a search already. I have no reason to want to invest more into it. And i think general public would see it the same way.

    Kagi based on its features doesn't have a good enough value proposition for me to even want to try it out cause really what more are they offering?

    it may be a good value proposition for people who lives revolve around searches and research but it ain't a need I have and unless ypur part of that group idk why youd want to pay for it.

    And don't said ads. They are honestly laughable easy to get around still or even ignore.

  • source
  • parent
  • [–] 1 point 1 year ago (5 children)

    How much do you figure it'd cost you to run your own, all-in?

  • source
  • parent
  • hideshow 5 child comments
  • [–] 1 point 1 year ago (4 children)

    Free considering duckduckgo covers almost all the same bases. I just don't think kagi has a compelling argument especially for the type of searching the average person does. Maybe if you have a career that revovles more around research.

  • source
  • parent
  • hideshow 4 child comments
  • [–] 0 points 1 year ago (3 children)

    Duckduckgo is not free. You pay for it by looking at ads. How much do you think it would cost you to run a service like Kagi locally?

  • source
  • parent
  • hideshow 3 child comments
  • [–] 1 point 1 year ago (2 children)

    Lmao i get ur point bud. But it seems you don't get mine? Plus really are ads the issue for you? Plenty of easy ways to never see them. Also their ad tradeoff for it being free is a better compromise to me than paying for a search engine.

    I just think the idea of kagi is niche proposal considering the needs of most ppl from a search engine. I just don't think its the value proposition you are spouting but go off lol.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 103 points 1 year ago (8 children)

    Is it doing this because they trained it on Reddit data?

  • source
  • hideshow 8 child comments
  • [–] 21 points 1 year ago (4 children)

    If they did it on Stackoverflow, it would tell you not to hard boil an egg.

  • source
  • parent
  • hideshow 4 child comments
  • [–] 6 points 1 year ago (2 children)

    Jquery has egg boiling already, just use it with a hard parameter.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 88 points 1 year ago (3 children)

    AI gains sentience,

    first thing it develops is impostor syndrome, depression, And intrusive thoughts of self-deletion

  • source
  • hideshow 3 child comments
  • [–] 1 point 1 year ago

    It didn't. It probably was coded not to admit it didn't know. So first it responded with bullshit, and now denial and self-loathing.

    It feels like it's coded this way because people would lose faith if it admitted it didn't know.

    It's like a politician.

  • source
  • parent
  • [–] 51 points 1 year ago (4 children)
  • [–] 82 points 1 year ago (16 children)
  • [–] 2 points 1 year ago

    I remember often getting GPT-2 to act like this back in the "TalkToTransformer" days before ChatGPT etc. The model wasn't configured for chat conversations but rather just continuing the input text, so it was easy to give it a starting point on deep water and let it descend from there.

  • source
  • parent
  • [–] 37 points 1 year ago (1 child)

    So it's actually in the mindset of human coders then, interesting.

  • source
  • hideshow 1 child comment
  • [–] 35 points 1 year ago (2 children)

    I once asked Gemini for steps to do something pretty basic in Linux (as a novice, I could have figured it out). The steps it gave me were not only nonsensical, but they seemed to be random steps for more than one problem all rolled into one. It was beyond useless and a waste of time.

  • source
  • hideshow 2 child comments
  • [–] 10 points 1 year ago (1 child)

    This is the conclusion that anyone with any bit of expertise in a field has come to after 5 mins talking to an LLM about said field.

    The more this broken shit gets embedded into our lives, the more everything is going to break down.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 5 points 1 year ago

    after 5 mins talking to an LLM about said field.

    The insidious thing is that LLMs tend to be pretty good at 5-minute initial impressions. I've seen repeatedly people looking to eval LLM and they generally fall back to "ok, if this were a human, I'd ask a few job interview questions, well known enough so they have a shot at answering, but tricky enough to show they actually know the field".

    As an example, a colleague became a true believer after being directed by management to evaluate it. He decided to ask it "generate a utility to take in a series of numbers from a file and sort them and report the min, max, mean, median, mode, and standard deviation". And it did so instantly, with "only one mistake". Then he tried the exact same question later in the day and it happened not to make that mistake and he concluded that it must have 'learned' how to do it in the last couple of hours, of course that's not how it works, there's just a bit of probabilistic stuff and any perturbation of the prompt could produce unexpected variation, but he doesn't know that...

    Note that management frequently never makes it beyond tutorial/interview question fodder in terms of the technical aspect of their teams, and you get to see how they might tank their companies because the LLMs "interview well".

  • source
  • parent
  • [–] 34 points 1 year ago (1 child)

    "Look what you've done to it! It's got depression!"

  • source
  • hideshow 1 child comment
  • [–] 61 points 1 year ago (2 children)

    call itself "a disgrace to my species"

    It starts to be more and more like a real dev!

  • source
  • hideshow 2 child comments
  • [+] 30 points 1 year ago (1 child)
  • [–] 30 points 1 year ago (16 children)

    i was making text based rpgs in qbasic at 12 you telling me i'm smarter than ai?

  • source
  • hideshow 16 child comments
  • [–] 18 points 1 year ago (1 child)

    High five, me too!

    At that age I also used to do speed run little programs on the display computers in department stores. I'd write a little prompt welcoming a shopper and ask them their name. Then a response that echoed back their name in some way. If I was in a good mood it was "Hi [name]!". If I was in a snarky mood it was "Fuck off [name]!" The goal was to write it in about 30 seconds, before one of the associates came over to see what I was doing.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 7 points 1 year ago (2 children)

    I did a Dr Mario clone around that age. I had an old Amstrad CPC I had grew up with typing listing of basic programs and trying to make my own. I think this was the only functional game I could finish, but, it worked.

    Speed was tied to CPU, I had no idea how to "slow down" the game other than making it do useless for loops of varying sizes... Max speed that was about comparable to Game Boy Hi speed was just the game running as fast as it could. Probably not efficient code at all.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 2 points 1 year ago (1 child)

    Ha, computer bro upvote for you.

    I learned programming with my Amstrad CPC (6128!) manual. Some of it I did not understand at the time, especially stuff about CP/M and the wizardry with poke. But the BASIC, that worked very well. Solid introduction to core concepts that didn't really change much, really. We only expanded (a lot) over them.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 2 points 1 year ago

    6128 too, with the disk drive. I wish I still had that thing. Drive stopped functioning, and we got rid of it. Had I known back then that we apparently just needed to replace a freaking rubber band...

  • source
  • parent
  • [–] 12 points 1 year ago (5 children)

    sigh yes, you're smarter than the bingo cage machine.

  • source
  • parent
  • hideshow 5 child comments
  • [–] 3 points 1 year ago (4 children)

    Oh....thank fuck....was worried for a minute there!

  • source
  • parent
  • hideshow 4 child comments
  • [–] 2 points 1 year ago (3 children)

    Don't mention it! I'm glad I could help you with that.

    I am a large language model, trained by Google. My purpose is to assist users by providing information and completing tasks. If you have any further questions or need help with another topic, please feel free to ask. I am here to assist you.

    /j, obviously. I hope.

  • source
  • parent
  • hideshow 3 child comments
  • load more comments
    view more: next ›