Say you are trying to turn fifteen minutes of rushed exam notes into a clean SOAP note before your next patient walks in. You paste your shorthand into a chatbot, ask it to “write this up properly,” and get back something that reads well but quietly reorders your assessment, softens a finding you flagged as urgent, and adds a recommendation you never made. You now have a documentation problem instead of a documentation shortcut.
My team supports clinical staff at a handful of outpatient practices, and this exact scenario is the one that comes up most in our onboarding calls. Everyone has heard some version of “AI can write your notes for you” and some version of “AI is too risky to touch near patient charts.” Neither claim survives contact with actual daily use. Below is a rundown of the claims we hear most often, next to what we’ve found holds up when the prompt is built correctly and the output is checked the way any clinical document should be checked.
Myth: A generic “clean this up” prompt is enough for clinical notes
Feed a model raw exam shorthand and a one-line instruction, and you get prose that sounds confident regardless of whether it’s accurate. The model doesn’t know your clinic’s documentation standard, your specialty’s terminology conventions, or which parts of your note are findings versus which are your working hypothesis. It fills those gaps with the most statistically common pattern for “clinical note,” which is rarely your pattern.
Reality: The prompt needs to specify structure before it specifies tone. Naming the exact format — SOAP, DAP, or your EHR’s specific template — and stating which fields are mandatory gets you a document that matches what your practice actually files, not a plausible-sounding substitute. In testing across a few different note types, prompts that named the section headers explicitly (“Subjective, Objective, Assessment, Plan — do not merge sections”) produced notes that needed noticeably fewer structural edits than prompts that just asked for “a clean version.”
Myth: If the output sounds professional, it’s clinically accurate
This is the one that causes the most damage, because fluent language reads as trustworthy language. A well-formatted paragraph with confident medical phrasing can still contain an invented detail, a dropped qualifier, or a severity level that got quietly upgraded or downgraded in the rewrite.
Reality: Fluency and accuracy are separate properties, and no prompt eliminates the gap between them — only review does. What a good prompt can do is reduce how often that gap shows up. Instructing the model explicitly not to add clinical content beyond what’s in your source notes (“Do not infer symptoms, diagnoses, or recommendations not explicitly stated above”) measurably cuts down on invented detail compared to an open-ended rewrite request. It’s still a draft. Every note still needs a clinician’s eyes on it before it’s filed, the same way it would if a scribe had typed it.
Myth: Patient-facing messages just need to be “simplified”
Ask for a “simpler version” of a clinical explanation and you often get something shorter, but not necessarily something a patient without a medical background can act on. Shorter isn’t the same as clear, and clear isn’t the same as actionable.
Reality: Patient communication prompts work better when you specify the reading level, the emotional context, and the action you need the patient to take, as three separate instructions rather than one vague request. Compare “simplify this for a patient” against “rewrite this at a sixth-grade reading level for a patient who just received a new diagnosis, ending with the two things they need to do before their next visit.” The second version tells the model what vocabulary to use, what tone to hold, and what the message needs to accomplish. In our team’s testing, that framing consistently produced messages patients described as easier to follow, without stripping out the medical substance that still needs to be there.
Myth: One well-crafted prompt template works for every note type
A template tuned for a post-visit summary tends to produce oddly casual or incomplete output when it’s reused for something like a referral letter or a discharge instruction, because the underlying task — audience, required detail, formality — shifts even though both are “patient communication.”
Reality: Treat each documentation type as its own prompt, not a variation of one master prompt. A referral letter needs a different addressee, a different level of clinical detail, and a different closing than a discharge instruction sheet. We keep a short library of separate starting prompts by document type — visit summary, referral, discharge instructions, prescription refill note — and each one names its specific audience and required fields up front. Reusing one flexible template across all four consistently produced weaker results than having four narrow ones.
Myth: Adding PHI to a prompt is an acceptable shortcut if it saves time
This one deserves flat correction rather than nuance. Pasting real patient names, dates of birth, or identifiable details into a general-purpose AI tool that isn’t covered by a signed business associate agreement is a compliance failure, not a shortcut, regardless of how much time it saves in the moment.
Reality: The fix is a habit, not a clever prompt. Draft with placeholder tokens — “Patient X, age Y, presenting with Z” — and do the find-and-replace with real identifiers after the AI-assisted portion of the work is done, inside your secure system. This adds seconds to the workflow and removes a real risk. Any tool your practice uses for this kind of work should have a signed BAA in place before real patient data touches it, full stop — that’s a policy question to raise with your compliance lead, not something a prompt can solve around.
Myth: Faster documentation means lower-quality documentation
There’s an assumption that speed and thoroughness trade off against each other, and that if a note took less time to produce, something must have been cut.
Reality: In our own before-and-after comparisons, prompts built around explicit structure and explicit source-only constraints didn’t just save time — they reduced the number of missing fields and forgotten follow-ups compared to notes written from scratch under time pressure at the end of a long clinic day. The time savings come from not staring at a blank template while tired, not from skipping steps. Speed and completeness moved together here, not against each other, once the prompt was doing the structural work instead of the clinician’s memory.
A quick self-check before you use any of this on a real chart
Before you paste a note or a patient message into an AI tool, run through these five questions:
- Did I name the exact document type and required sections, instead of asking for a generic rewrite?
- Did I tell the model not to add anything beyond what’s in my source notes?
- Did I strip identifiable patient information before it left my secure system?
- Did I specify the audience and reading level for anything patient-facing?
- Am I planning to review this output the same way I’d review a draft from a new scribe?
If you can answer yes to all five, the tool is doing what it’s good at — structuring and drafting — while you’re still doing what only a clinician can do, which is verifying that what’s on the page matches what actually happened in the room.
What’s the documentation task eating the most of your time right now — the notes themselves, or the patient messages that follow them? That’s usually the better place to start tightening prompts before touching anything else.
🔗 Recommended Reading
- Designing Long-Term Memory Systems for AI Agents: The 5 Architectures Ranked
- Function Calling and Tool Use in LLMs: A Practical Guide
- How to Write Effective Prompts for AI-Powered Translation and Localization
- How to Debug and Troubleshoot Failing AI Prompts
- How to Evaluate and Benchmark LLM Prompt Performance