There exists online and offline ML.

Transcription is not a task that needs a full blown LLM, summarization probably does, and if being done offline or on a server with trusted verifiable lack of logging should be fine. That does not mean send it to ChatGPT API.

I would hope they store the raw conversation file encrypted with patient records so they can retranscribe later as tools improve.