At a recent appointment, Emily’s physical therapist (who knows some about her research) said, “Before we get started, there’s something I want to ask you about.” The something was an automatic “scribing” system their office is trialling for two weeks and deciding whether to purchase. These systems take in a (presumably audio-only) recording of the patient encounter and then output a draft patient note for the chart.

So what’s the big deal with “AI” charting? Here are nine reasons why we recommend refusing to consent to the use of scribing tools in healthcare settings:

you are viewing a single comment's thread
view the rest of the comments
[–] 1 point 6 months ago (1 child)

Wellllll.....

I'm fully against these systems, and fully against my data leaving the doctors office, but the "summarization in particular don’t need powerful hardware" is a bit of a stretch to put it mildly, especially when you start looking at what computers most doctors have to work with. The average doctor computer that I see still uses VGA cables for crying out loud, you won't see any AI on those machines ever.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 2 points 6 months ago

    Summarization is known for being one of the things weaker models can handle competently, and there are LLMs with very low system requirements:

    239 tok/s decode on AMD CPU, 82 tok/s on mobile NPU. Runs under 1GB of memory

    I don't know exactly what the minimum performance a model would have to have to do this specific task, but it seems very likely it could be done by something that can run on a phone, or other low powered hardware.

  • source
  • parent