284
I Asked AI to Count My Carbs 27,000 Times. It Couldn’t Give Me the Same Answer Twice. (www.diabettech.com)
submitted 6 months ago by to c/technology@lemmy.world
70 comments fedilink hide all child comments
😂 1
 

Hacker News

you are viewing a single comment's thread
view the rest of the comments
[+] -10 points 6 months ago (18 children)

They put lives at risk the same way every single product at your local home improvement store does. When you misuse a tool for a purpose it wasn't intended and isn't good at, you're going to get bad results.

This is an issue for the educational system, not the legal system.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 18 child comments
    •
  • [–] 33 points 6 months ago (10 children)

    What if the packaging on every tool at home depot grossly misrepresented its capabilities and/or purpose?

    This chainsaw cures cancer? Hot damn somebody call RFK!

    Concrete mix goes great with pancakes, etc.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 10 child comments
    •
  • [+] -10 points 6 months ago (9 children)

    Does OpenAI claim ChatGPT is fit for those purposes? No.

    The concrete itself will happily mix into your pancakes.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 9 child comments
    •
  • [–] 27 points 6 months ago (8 children)

    I think the whole point of this discussion is that the various peddlers of AI in fact do make wild claims about their capability.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 8 child comments
    •
  • [–] -2 points 6 months ago (7 children)

    My observation is that largely it's the downstream AI consumers who repackage it irresponsibly. That said, I don't hang on the words of Sam Altman and it's certain they are pushing the idea that AI is more capable than it is, but mostly what I see is them saying they built this thing and it does neat stuff and it can probably do neat stuff for you, use your imagination.

    I believe a lot of the folks developing these tools would be horrified at the irresponsible ways vendors and end users are using it.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 7 child comments
    •
  • [–] 11 points 6 months ago* (last edited 6 months ago) (6 children)

    Sam Altman is the face of OpenAI. He is responsible for misrepresenting the product he sells. If you're going to sling blame around, then you had better observe the words of Sam Altman.

    The thing that I think will be most impactful on that five to ten year timeframe is AI will actually discover new science.

    This sick man is taken seriously in mainstream media and politics, and it's no exaggeration to say he has blood on his hands.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 6 child comments
    •
  • [–] -1 points 6 months ago (5 children)

    That's obviously bullshit but he's not telling users they can develop time travel or something. That's the distinction I would draw. He's selling investment. That's not where the end users that are misusing ChatGPT are at.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 5 child comments
    •
  • [–] 2 points 6 months ago (4 children)

    It's the job of the company and especially the face and CEO of the company to sell the product. Compared to Sam Altman's promises, the use in this post is practically modest.

    If you think this isn't the case, maybe you can point to some ChatGPT marketing that would make it clear what correct, and especially incorrect usage would look like?

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 4 child comments
    •
  • [–] -1 points 6 months ago (3 children)

    They don't. They say we made this thing, see what you can do with it. They also put disclaimers on ChatGPT to say not to rely on it to be correct.

    One can infer from that, that any use for which you are relying on accuracy is incorrect use. Which is why it's critical to have any output filtered through a domain-capable human.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 3 child comments
    •
  • [–] 3 points 6 months ago (2 children)

    They don't.

    "The thing that I think will be most impactful on that five to ten year timeframe is AI will actually discover new science." - Sam Altman

    This is what the face of OpenAI explicitly says their product is for. Do you have anything more concrete? Or am I just to buy into this infinite good faith and assume that anything dumb Trump Sammy says is just hyperbole?

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 1 point 6 months ago (1 child)

    He's not selling anything specific and not to end users. You're talking about something completely different. The way Sam and investors and corporate customers talk about AI is pretty misleading, but it's not misleading users. No one looks at AI replacing CSRs and inventing new sciences, whatever the fuck that means, and jumps to it can unerringly diagnose a rash. And even if they did, the bot explicitly says not to trust it.

    If some dirt farmer asks it how to avoid losing his family farm in a drought and takes ChatGPT's advice to plant chocolate chips and loses the farm anyway, I suggest that's a user error.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •
  • [–] 3 points 6 months ago

    We might as well be discussing whether the tobacco industry has mislead customers because they have a little disclaimer on their cartons.

    Mainstream media publishes Sammy's statements uncritically. ChatGPT releases ads. It's extremely clear he is misleading the general public, his users. I don't know why you're in denial over this.

  • permalink
  • fedilink
  • source
  • parent
  • [+] 18 points 6 months ago* (2 children)
    [deleted]
  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 1 point 6 months ago

    And at the same time I wouldn't say "hey fuck that, duct tape is terrible! It doesn't hold beams together, I can't use it to tow a trailer, it's all just pretending to stick paper together because really every sliver of duct tape just sticks to the previous piece, etc etc" But that's the cool thing we do on Lemmy.

    The ad is bad, duct tape ain't bad.

  • permalink
  • fedilink
  • source
  • parent
  • [–] -2 points 6 months ago

    I have not seen OpenAI advertise ChatGPT as capable of medical diagnosis or therapy or anything like that. If you want therapy, and you can't afford better — because I think we can agree that AI is terrible at it, then there should be a therapy app with explicit safety controls.

    The problem is someone created a screwdriver which is handy for lots of screwdriver shaped purposes and someone is trying to carve a ham.

  • permalink
  • fedilink
  • source
  • parent
  • [–] 9 points 6 months ago (3 children)

    Tools at home improvement stores were made to fulfill a specific purpose. GenAI still does not have a purpose it fulfills despite having hundreds of billions of dollars invested, not to mention all the other resources it's sucking up.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 3 child comments
    •
  • [–] 3 points 6 months ago* (last edited 6 months ago)

    Nonsense.

    It does a great job of scamming idiots (mainly investors and CEOs) and lining the pockets of the scammers selling it, which is all it's designed for.

    It's 100% fulfilling its purpose, it's just not the purpose they claim to be selling it for.

  • permalink
  • fedilink
  • source
  • parent
  • [–] -3 points 6 months ago (1 child)

    A pencil is a tool with a pretty wide open purpose within the writing ecosystem. It can be used to document history or remember a phone number or draw a picture.

    You can also stab yourself in the eye with it or plan a murder.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •
  • [–] 5 points 6 months ago

    Yes, a pencil can do a whole bunch of different. things. GenAI cannot do things. It has no purpose. Pencils were made to write stuff. GenAI was made to ???. It is a technology in search of a problem to address. A niche to fill. It has no purpose as it stands, yet it is supposedly the most important thing ever to the point where the rich and wealthy are losing their minds investing into it on the vague hopes that it'll do something. They've even got our government in on it; the US economy is being dangerously propped up by this industry that doesn't solve any problems or fulfill any purpose. All the things it does are novelties and even then, it does those things poorly and unreliably.

  • permalink
  • fedilink
  • source
  • parent