From AI coding to AI coding

top 66 comments

sorted by: hot top controversial new old
[–] 55 points 6 months ago

Hey Hoffman, remember the sneezes you had in succession last winter for 2 weeks straight? I asked chatgpt and tells me is brain cancer. Are you going to start cancer therapy ASAP?

PS: for the people that still remember WebMD at the start, they would never trust a machine for full diagnosis, let alone considering this as an option

  • source
  • [–] 42 points 6 months ago

    Reid Hoffman: the original LinkedIn Lunatic

  • source
  • [–] 37 points 6 months ago

    "Sir, you seem to be low on vitamin C, which gave you scurvy, but Grok says that it is more likely to be an psychosomatic response to an internal conflict between the way you live your life, and the Hitler inside you waiting to be let out"

  • source
  • [–] 28 points 6 months ago* (6 children)

    Image recognition to help radiologists find tumors is probably fine; especially since you can usually run those models locally.

    These morons think ChatGPT is “conscious” and “was trained on humanity’s collective knowledge”. THAT is the problem with AI Derangement Syndrome

    EDIT: aw fuck let’s not use that acronym

  • source
  • hideshow 6 child comments
  • [–] 11 points 6 months ago*

    There are a bunch of studies that in general show there is an effect where, despite what people say and think, they inevitably start to offload decision making to AI inappropriately and it eventually makes them worse. Harvard did a study specifically around radiologists, interestingly enough.

    The "only use it as an aid" seems to be a myth.

    To me it seems very similar to cocaine.

  • source
  • parent
  • [–] 8 points 6 months ago (1 child)

    AI (statistical predictive models) work best when it's designed for a specific purpose and when the model is too challenging to derive by hand. Detecting tumors is a specific purpose, and doing so manually is challenging enough that it requires specific training. It gets a pass by me.

    Predicting protein structures/drug effects: specific purpose, check. Doing it manually, yep, very challenging. Good use of AI.

    LLM chatbot: purpose is unclear. Making a non-AI-based chatbot is easy and has been done before. Verdict: useless technology

  • source
  • parent
  • hideshow 1 child comment
  • [–] 4 points 5 months ago

    Or to put it another way, use the right tool for the job don't use the shitty multi tool that does every job passably at best. The only exception to this rule of thumb is the humble spork, but that's a piece of engineering genius that couldn't be replicated by AI pushers.

  • source
  • parent
  • [–] [S] 25 points 6 months ago

    Context: Coding in medical nomenclature refers to code blue (life threatening emergency)

  • source
  • [–] 24 points 6 months ago (6 children)

    Literal blatant HIPPA violation, giving personal medical info to AI companies in exchange for useless and dangerous advice

  • source
  • hideshow 6 child comments
  • [–] 12 points 6 months ago (5 children)

    The worst part is that HIPAA has actually already allowed AI companies to do this. Epic EHR software now has built in AI chart summary support as well as AI dictation where the patient is recorded throughout the visit by the AI agent. Somone has decided that feeding patient's PHI and voice into an AI company's black box is somehow acceptable healthcare practice and has actively implemented it in physical healthcare facilities.

  • source
  • parent
  • hideshow 5 child comments
  • [–] 11 points 6 months ago (3 children)

    We should be able to opt out of this shit

  • source
  • parent
  • hideshow 3 child comments
  • [–] 3 points 5 months ago (1 child)

    I'm fairly certain there's a consent specifically for use of AI at patient checkin, but I doubt the front desk staff are trained on people refusing that consent and will likely tell you that you have to sign it to be treated which I'm almost positive is not true, and may even be illegal.

    An online medical service I used a while back had a consent for AI charting mixed in with the various other consent to treat paperwork, and I did have the option to decline it (and did so). During the visit, the provider once again pestered me about using AI, and I declined. They were irritated by this, because they used it to document the visit automatically, and didn't want to have to do it themselves, but I wasn't denied care because of it.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 1 point 5 months ago*

    Do you with in healthcare? I haven’t seen an option like that in my EHR, and it does do AI summaries of patient’s charts. (To be clear, I’m not a physician, nor do I work in a clinic where I could ask a coworker about registration or “front desk” stuff, so if could be that I just don’t see it.)

  • source
  • parent
  • [–] 4 points 5 months ago

    At my last visit my doctor asked if I was okay with her recording for this (dunno if it was that exact company or not) and I said fuck no. I’m there to talk about sensitive shit, you wouldn’t catch me posting any of it online and you won’t catch me narrating it to a chatbot.

  • source
  • parent
  • [+] 21 points 6 months ago (2 children)
  • [–] 17 points 5 months ago

    It is very curious rhetorical move from:

    If your doctor isn't using AI, they are incompetent and awful and should be considered malpractice

    to

    We shouldn't be forcing these Big Government Regulations on the itty bitty small bean doctors who just want to help people

    Techno-Libertarianism in a nutshell. It is never a serious analysis of best practices and procedures. Always some hollow appeal to legalism out of one side of the mouth and denouncement of bureaucracy out of the other. And all in pursuit of selling a new line of magic fucking beans to the rubes.

    Counting the days until Dr. Oz is talking about LLMs like he talks about ginseng and acai berry juice.

  • source
  • [–] 16 points 6 months ago* (last edited 6 months ago)

    I check it out once in a while to see what's going on, and the OpenAI people apparently seemed to try to fix the sycophancy problem by turning it into an insufferable pedant.

    "I want to check... you should put pants on before leaving the house, right?"

    "That's not exactly right. Putting pants on involves putting your legs into the leg holes in the pants. After that you should zip and button any zips and buttons on your pants."

  • source
  • [–] 14 points 6 months ago (1 child)

    Older adults have always made a fool of themselves when new tech comes out as they scramble over each other to either voice dramatically out-of-touch opinions or avoid it entirely while preaching moral panic. This time around with AI, there's not a big financial barrier to access so the youth are equally in on the game.

  • source
  • hideshow 1 child comment
  • [–] 12 points 6 months ago (1 child)

    I hope his doctor does ask Chat GPT and it prescribes him a penectomy.

  • source
  • hideshow 1 child comment
  • [–] 12 points 5 months ago

    I had a very entertaining time asking search engine AI about various bacteria when writing an open book exam.

    Ask how X bacteria acts in the oral cavity, and the AI summary calls it a beneficial species

    Ask how X bacteria relates to periodontal disease, and the AI summary tells you it is a pathogen of utmost importance.

    It answers solely based on how you pose the question and does not even provide an accurate summary of the websites it purports to have used as sources.

  • source
  • [–] 10 points 6 months ago

    We should ask AI if tech CEOs are worth keeping around despite the negative impacts of AI construction and implementation.

  • source
  • [–] 16 points 6 months ago (1 child)
  • [–] 6 points 5 months ago (1 child)

    Elon Musk's AI recommends Ivermectin and anal bleaching, because it's biased. I don't care if what I said was true.

    But it is biased.

    Imagine doctors using the same AI that convinced that poor, lonely guy to kill himself!

  • source
  • hideshow 1 child comment
  • [–] 5 points 5 months ago

    Yet when they get sick enough they ALWAYS go to the hospital. Same with covid. If you don't trust doctors when you're healthy then stop trusting them when you're sick. Just reminds me of that "the only moral abortion is my abortion" story.

  • source
  • [–] 5 points 6 months ago

    That’s LinkedIn for you. Just corporate felating in the desperate hopes a CEO will notice you

  • source
  • [–] 5 points 5 months ago (6 children)

    I already immediately left a veterinarian for using AI as part of its xray diagnosis process, which may even be somewhat acceptable since computer vision is relatively mature. Fuck if I’m lasting 5 mins with a human doctor that utters the letters “AI.”

  • source
  • hideshow 6 child comments
  • [–] 8 points 5 months ago* (last edited 5 months ago) (3 children)

    I can’t speak for veterinary, but in dentistry AI can be problematic because:

    A) it really over-diagnoses - it’s very very sensitive, meaning that it identifies things that aren’t necessarily clinically relevant

    B) it does not compare to previous radiographs, so it cannot give reasonable clinical judgement on whether decay is active or arrested.

    It could be a helpful tool to give you a laundry list of places to check. However, I’ve used demo software and did not find it added anything for me, although I have 15 years experience. You still need to use your clinical judgement.

    I do worry about the younger clinicians being over-reliant on it, as they have it pushed on them by multi-practice dental corporations.

  • source
  • parent
  • hideshow 3 child comments
  • [–] 1 point 5 months ago (1 child)

    Yep, the “laziness” of reliance was a big part of my immediate reaction. I’ve recently found out that veterinary clinics across the country, and especially in Texas, were aggressively moved on by investment capital in the years between now and my last dogs. The pet economy, including medical care, has long been seen as recession proof. Medical care in particular is seen as emotionally driven and ripe for greater exploitation, so of course the vultures moved in. Having AI flag everything, allowing you to show a customer tons of things to worry about and milk them for more diagnostics, a.k.a. more money, is the logical conclusion.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 1 point 5 months ago

    It’s a disturbing trend - dental offices are also being acquired by investment groups that run them as purely a business rather than a health care service.

    I have spoken to some younger dentists when I go to courses, and it sounds as though they are receiving disciplinary conversations/actions when they do not treat what the AI tells them to. The business expects them to transfer the responsibility of diagnosis to a computer program ( and frankly a shitty one) yet still be medicolegally responsible for making the decision to treat.

  • source
  • parent
  • [–] 2 points 5 months ago (1 child)

    Ya an LLM is very different than a vision based machine learning /trained visual model on something specific like x-rays.

    Now, if its just a LLM looking at an xray image, that's another story, and it could've been that too.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 8 points 6 months ago (4 children)

    I just wanna know how much the AI lobbyists gave him to say that..

  • source
  • hideshow 4 child comments
  • [–] 4 points 5 months ago

    That's an amazing post title, bravo

  • source
  • [–] 3 points 5 months ago (1 child)

    AI is great at being a sort of consultant. Something to bounce ideas off of. Sometimes it comes up with something you hadn't thought of. It's great to confer with. However, it's terrible to rely on. Confer with it, but don't defer to it.

  • source
  • hideshow 1 child comment
  • load more comments (1 reply)
    [–] 3 points 6 months ago

    He needs help to care for more people than just himself.

  • source
  • [–] 3 points 5 months ago

    I already loved it when I had GPs who googled my symptoms. Now with added made-up nonsense!

  • source
  • [–] 7 points 6 months ago (2 children)

    A professional using AI as part of your diagnosis is fine.

    A professional using AI to diagnose you is not.

    To put it another way. If I had a condition, and my doctor used and AI to look through thousands of studies to find a treatment regimen that fits my particular health profile better than the standard treatment and they then review the sources and decide that it would be a safer and more effective option than the standard care, then I'm all for that. If my doctor says "I asked this AI, and it said do this", then I'm definitely not doing "that" until I check in with another doctor.

  • source
  • hideshow 2 child comments
  • [–] 2 points 5 months ago (1 child)

    and my doctor used and AI to look through thousands of studies to find a treatment regimen that fits my particular health profile better than the standard treatment

    We used to call that a search engine.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 2 points 5 months ago

    "Take two rocks and prompt me in the morning."

  • source
  • [–] 3 points 5 months ago (5 children)

    Nah, I work in AI for medicine we have lots of data that it does actually help.

    My work specifically looks at images from scans (mostly MRI and X-ray) to diagnose conditions (mostly respiratory) before even senior doctors are able to reliably diagnose it. It's already out working in the world and has saved hundreds of people's lives already.

    I also have friends that work in AI diagnosis and they have similar success and just save doctors a ton of time.

  • source
  • hideshow 5 child comments
  • [–] 1 point 5 months ago (3 children)

    People purposefully misunderstanding the concept of a "second opinion" and not having used an LLM since the original ChatGPT. 🙄

  • source
  • hideshow 3 child comments
  • [–] 5 points 5 months ago*

    purposefully misunderstanding the concept of a “second opinion”

    The premise of a second opinion is that the secondary voice demonstrates core competencies in a specific field of study.

    not having used an LLM since the original ChatGPT

    4.0 is the one that has been driving celebrities insane with its endless stream of sycophancy. LLMs have grown progressively worse over time. In part due to modern models training against their own slop and in part due to marketing teams kicking actual developers out of the drivers' seat to sell more tokens.

    The last fucking thing medical specialists need is an algorithm to inflate their own egos.

  • source
  • parent
  • [–] 1 point 5 months ago

    AI shouldn’t replace doctors, but using it as a second set of eyes makes sense. The key is keeping a human responsible for the final call.

  • source
  • load more comments
    view more: next ›