Pertinent and Patient-Centered: Effect of a Note-Writing Didactic on Immediate Behavior in Family Medicine Residency
BACKGROUND
During residency, physicians refine note-writing skills to meet real-world clinical demands, balancing communication, billing, and medical reasoning amid increasing patient volume.¹,² Patients have become a new audience for clinical notes, requiring physicians to write in a manner that is clear and therapeutic.³,⁴ Patient-centered documentation represents an opportunity to improve transparency and trust while promoting concise, clinically relevant records.
Prior interventions to improve resident note writing have focused largely on inpatient settings, with mixed results. Outpatient documentation—where efficiency and patient-centeredness are particularly salient—remains understudied.⁵⁻⁹
We developed a brief educational intervention designed to enhance outpatient note writing using a simulated encounter involving concern for a sexually transmitted infection. Our objective was to determine whether a single didactic session affected note length or quality, as assessed by faculty ratings.
INTERVENTION
Family medicine residents (N = 15) attending a scheduled didactic session were invited to participate; 14 consented to analysis of their notes. We developed a rubric assessing readability, redundancy, pertinence, focused physical examination, inclusion of active diagnoses only, clear follow-up, explicit medical decision-making, and inclusion of patient education and care plans in the after-visit summary (AVS). Two faculty members independently rated each note using binary criteria.
Note efficiency was assessed by comparing word counts for note subsections (history of present illness [HPI], review of systems [ROS], physical examination [PE], assessment, and plan).
Residents viewed a mock outpatient encounter presented in three parts: agenda and HPI (video), physical examination (written findings), and assessment and plan (video). They documented the encounter using a Microsoft Forms template, received a concise didactic emphasizing focus, brevity, and patient-centered language, and then revised their notes. Notes were deidentified, randomly ordered, and independently coded by faculty blinded to preintervention and postintervention status.
This study was reviewed and deemed exempt by the Western Michigan University Homer Stryker M.D. School of Medicine Institutional Review Board.
RESULTS
Following the didactic session, documentation changed modestly. Word count analysis demonstrated a significant reduction in physical examination length (P < .05) and a significant increase in assessment and plan length (P < .05), suggesting greater selectivity in examination documentation and expanded clinical reasoning.
Table 1. Word Count and Rubric Scores Before and After Intervention (Within Subjects)
|
Variable |
Pre |
Post |
P-Value |
||
|
|
Mean |
Range |
Mean |
Range |
|
|
HPI Word Count |
130.14 |
(87–173) |
120.50 |
(56–172) |
0.32 |
|
ROS Word Count |
8.71 |
(2–33) |
9.93 |
(2–39) |
0.63 |
|
PE Word Count** |
124.00 |
(92–133) |
93.86 |
(38–130) |
0.01 |
|
Assessment Word Count |
41.00 |
(14–78) |
42.79 |
(7–84) |
0.25 |
|
Plan Word Count** |
43.64 |
(5–97) |
67.07 |
(12–168) |
0.03 |
|
Overall Word Count |
347.50 |
(274–411) |
334.14 |
(159–448) |
0.90 |
|
|
|
||||
|
Average Rubric Score Overall* Rater 1 Rater 2 |
5.61 (5.0 – 7.0) 6.00 (5.0 – 7.0) 5.21 (4.0 – 7.0) |
6.25 (5.0 – 8.0) 6.64 (5.0 – 8.0) 5.86 (4.0 – 8.0) |
0.05 |
||
|
Average Rubric Golden Note Score Overall* Rater 1 Rater 2 |
3.14 (2.0 – 4.0) 3.64 (3.0 – 4.0) 2.64 (1.0 – 4.0) |
3.57 (2.5 – 4.5) 3.79 (3.0 – 5.0) 3.36 (2.0 – 5.0) |
0.05 |
||
* = Marginally Statistically Significant (0.05<p≤0.10)
** = Statistically Significant (p≤0.05)
Additional Results:
- No significant changes were observed in HPI, ROS, assessment, or total word count.
- Overall rubric scores showed marginal improvement (P = .05).
Faculty ratings demonstrated limited interrater agreement (Table 2). Most notes were rated as readable at baseline, leaving little room for improvement. Redundancy remained common after revision. The most consistent improvement occurred in the “focused physical examination” domain, where several residents made changes aligned with instructional goals.
Table 2. Rubric Ratings by Rater and Item, Before and After Intervention
|
Variable |
Pre |
Post |
|
Redundancy (Reverse Score) Rater 1 Rater 2 |
13 (92.86%) 12 (85.71%) |
12 (85.71%) 13 (92.86%) |
|
Readability Rater 1 Rater 2 |
11 (78.57%) 13 (92.86%) |
13 (92.86%) 13 (92.86%) |
|
Pertinent Rater 1 Rater 2 |
14 (100.00%) 14 (100.00%) |
14 (100.00%) 14 (100.00%) |
|
Focused Physical Exam Rater 1 Rater 2 |
0 (0.00%) 0 (0.00%) |
6 (42.86%) 5 (35.71%) |
|
Active Diagnosis Only Rater 1 Rater 2 |
14 (100.00%) 13 (92.86%) |
14 (100.00%) 13 (92.86%) |
|
Provides Follow Up Rater 1 Rater 2 |
9 (64.29%) 9 (64.29%) |
9 (64.29%) 9 (64.29%) |
|
Describes Medical Decision Making Rater 1 Rater 2 |
13 (92.86%) 9 (64.29%) |
14 (100.00%) 9 (64.29%) |
|
AVS Outlines Pt Responsibilities and Care Rater 1 Rater 2 |
10 (71.43%) 3 (21.43%) |
11 (78.57%) 6 (42.86%) |
DISCUSSION
This note-writing session produced small, targeted changes in residents’ outpatient documentation, particularly in physical examination and assessment and plan sections. However, the overall effect was modest. Persistent redundancy and high baseline readability likely reflect entrenched documentation habits and the structural influence of electronic health record (EHR) templates.
Inconsistent interrater agreement highlights the challenge of assessing note quality using simple rubrics, a limitation noted in prior documentation studies.⁵⁻⁹
Consistent with prior literature, single-session interventions may raise awareness but are unlikely to produce sustained behavior change.⁸,⁹ Limitations of this study include small sample size, single-institution design, and reliance on a simulated encounter. Faculty assessed only one note per resident. P values reflect immediate within-subject change under constrained conditions and should be interpreted cautiously, as documentation quality is influenced by multiple factors, including EHR templates, attending physician preferences, and prior training.
Patient-centered documentation improves transparency and engagement.³,⁴ Written after-visit summaries, readability, and explicit care plans have been associated with improved patient understanding and follow-up adherence.¹⁰ These elements were captured in our rubric, reflecting an effort to assess documentation from the patient perspective, although changes in these domains were modest.
This brief didactic produced small but measurable documentation changes. Sustained improvement will likely require iterative curricula with individualized feedback integrated into clinical training.
REFERENCES
- Robey T. The art of writing patient record notes. Virtual Mentor. 2011;13(7):482-484. doi:10.1001/virtualmentor.2011.13.7.cprl1-1107
- Han H, Lopp L. Writing and reading in the electronic health record: an entirely new world. Med Educ Online. 2013;18(1):18634. doi:10.3402/meo.v18i0.18634
- Park J, Saha S, Chee B, Taylor J, Beach MC. Physician use of stigmatizing language in patient medical records. JAMA Netw Open. 2021;4(7):e2117052. doi:10.1001/jamanetworkopen.2021.17052
- Himmelstein G, Bates DW, Zhou L. Examination of stigmatizing language in the electronic health record. JAMA Netw Open. 2022;5(1):e2144967. doi:10.1001/jamanetworkopen.2021.44967
- Fanucchi L, Yan D, Conigliaro RL. Duly noted: lessons from a two-site intervention to assess and improve the quality of clinical documentation in the electronic health record. Appl Clin Inform. 2016;7(3):653-659. doi:10.4338/ACI-2016-02-CR-0025
- Nackers KAM, Shadman KA, Kelly MM, et al. Resident workshop to improve inpatient documentation using the Progress Note Assessment and Plan Evaluation (PNAPE) tool. MedEdPORTAL. 2020;16:11040. doi:10.15766/mep_2374-8265.11040
- Crawford S, Kushner I, Wells R, Monks S. Electronic health record documentation times among emergency medicine trainees. Perspect Health Inf Manag. 2019;16(Winter):1c.
- Aylor M, Campbell EM, Winter C, Phillipi CA. Resident notes in an electronic health record. Clin Pediatr (Phila). 2017;56(3):257-262. doi:10.1177/0009922816658651
- Kelly MM, Sklansky DJ, Nackers KAM, et al. Evaluation and improvement of intern progress note assessments and plans. Hosp Pediatr. 2021;11(4):401-405. doi:10.1542/hpeds.2020-003244
- Pavlik V, Brown AE, Nash S, Gossey JT. Association of patient recall, satisfaction, and adherence to content of an electronic health record–generated after-visit summary: a randomized clinical trial. J Am Board Fam Med. 2014;27(2):209-218. doi:10.3122/jabfm.2014.02.130137