Skip to main content

Impact of a medical scribe on clinical efficiency and quality in an academic general internal medicine practice

Abstract

Background

Scribes have been proposed as an intervention to decrease physician electronic health record (EHR) workload and improve clinical quality. We aimed to assess the impact of a scribe on clinical efficiency and quality in an academic internal medicine practice.

Methods

Six faculty physicians worked with one scribe at an urban academic general internal medicine clinic April through June 2017. Patient visits during the 3 months prior to intervention (baseline, n = 789), unscribed visits during the intervention (concurrent control, n = 605), and scribed visits (n = 579) were included in the study. Clinical efficiency outcomes included time to close encounter, patient time in clinic, and number of visits per clinic session. Quality outcomes included EHR note quality, rates of medication and immunization review, population of patient instructions, reconciliation of outside information, and completion of preventative health recommendations.

Results

Median time to close encounter (IQR) was lower for scribed visits [0.4 (4.8) days] compared to baseline and unscribed visits [1.2 (5.9) and 2.9 (5.4) days, both p < 0.001]. Scribed notes were more likely to have a clear history of present illness (HPI) [OR = 7.30 (2.35–22.7), p = 0.001] and sufficient HPI information [OR = 2.21 (1.13–4.35), p = 0.02] compared to unscribed notes. Physicians were more likely to review the medication list during scribed vs. baseline visits [OR = 1.70 (1.22–2.35), p = 0.002]. No differences were found in the number of visits per clinic session, patient time in clinic, completion of preventative health recommendations, or other outcomes.

Conclusions

Working with a scribe in an academic internal medicine practice was associated with more timely documentation.

Peer Review reports

Background

In the decade since the Health Information Technology for Economic and Clinical Health (HITECH) Act in 2009, electronic health record (EHR) use has significantly increased in the U.S. [1,2,3] EHR use has been found to improve some quality and safety measures [4,5,6]. However, concerns have been raised about increased administrative burdens placed on physicians due to EHR use, and the associated physician burnout [7,8,9,10,11,12,13]. Recent studies have found that physicians in outpatient practice spend half their workday on the EHR (e.g., chart review, composition of progress notes, order entry, etc.) and an additional 1–2 h per day outside of office hours on EHR-related work [14,15,16]. These troubling trends have sparked calls for reductions in EHR-related administrative tasks to enhance practice efficiency and combat physician burnout [17,18,19].

Scribes are trained personnel who assist physicians with documentation and clinical workflow and are a proposed solution to decrease physician EHR burden [20,21,22,23]. A PubMed literature search revealed that scribe use was associated with improvements in clinician satisfaction in emergency departments, and subspecialty and primary care clinic settings [23,24,25,26,27,28,29]. In addition, scribes have been found to increase productivity and efficiency in emergency departments and subspecialty clinics [23, 25, 26, 29,30,31,32,33,34].

Few studies have focused on the impact of scribes on clinical efficiency and quality in primary care. Four previous studies in primary care have found that scribes improved physician productivity, timely chart completion, and EHR note quality [33,34,35,36]. However, no study has simultaneously assessed the impact of scribes on clinical efficiency and quality in primary care. We sought to assess the impact of scribes in primary care on clinical efficiency measures (e.g., number of visits per clinic session) and clinical quality (e.g. EHR note quality, rate of immunization and current medication review, and completion of preventative health recommendations) [37].

Methods

Setting and participants

We implemented a scribe program at an academic general internal medicine (GIM) clinic at UChicago Medicine between April and June 2017 [38]. Among the faculty physicians, 15 physicians were interested in working with a scribe. From these faculty, six faculty were selected to participate in the program based on their clinic schedules to allow for the scribe to be used full time (Monday-Friday 8 AM-5 PM) during the intervention. Participating faculty had between one and four 4-h clinic sessions per week, and we scheduled the scribe to work with faculty for 25–80% of their total clinic sessions, in order to provide a concurrent control and address issues of secular trends and seasonality in the analysis. In prior scribe studies, providers were required to see more patients when they are provided scribes and their scheduling templates were adjusted accordingly [33, 35]. In our study, while we did not ask physicians to increase the number of patients seen during their scribed clinic sessions, they were permitted to add more patients to their clinic schedule if they desired. Thus, our study design would permit us to see if physicians were willing to add more patients to their schedules when scribes were present without extrinsic pressure.

Intervention

One full-time medical scribe was hired and trained by a professional scribe agency (PhysAssist Scribes, Inc.). The scribe had 1 year of prior scribing experience and received 40 h of general medical terminology training, as well as 4 h of institution-specific EHR ambulatory training. Before the study, the scribe shadowed each physician for one clinic session [38]. Scribe responsibilities included drafting the clinic note and entering after visit summary instructions. Physicians were responsible for entering orders and reviewing, signing, and closing notes. After the study period, physicians completed a standardized exit interview with a study author (WWL) [38].

Study design

This program evaluation compared group-level means for clinical efficiency and quality in scribe intervention visits vs. two control conditions (baseline visits during February–March 2017 and concurrent unscribed visits during April–June 2017). Scribed visits were compared with both control conditions (baseline and unscribed) for all measures except for EHR note quality, which was only compared to the baseline group. Two control conditions were included to account for secular trends and potential changes to workflow during the intervention period, which may have impacted outcome measures during the unscribed and scribed visits.

Outcomes

Data for clinical efficiency and quality were abstracted retrospectively from the EHR. The clinical efficiency outcomes were 1) physician time to close encounter, 2) patient time in clinic, and 3) number of visits per clinic session. Clinical quality measures were assessed by 1) comparing EHR note quality between notes documented during scribed and baseline visits, and 2) comparing rates of medication review, immunization review, populating of patient instructions into the after-visit summary, reconciliation of outside information in the EHR, and completion of preventative health recommendations in scribed vs. baseline and unscribed visits.

Physician time to close encounter was defined as the total difference between the time that the provider closed the encounter in the EHR and the patient’s appointment time; this time included time to review, edit, and sign the note and could be during clinic or at home. Patient time in clinic was defined as the difference between patient check out and check in times.

To assess note quality, clinic notes were systematically abstracted from the EHR for baseline (n = 75) and intervention (n = 75) groups; a total of 150 charts were expected to find significant differences in note quality [36]. The number of charts reviewed per physician was proportional to their clinical load. For each physician, starting from the last clinic session during the study period and going backwards in time, every other chart was extracted from the EHR until the desired number of charts per physician was obtained. Up to six clinic sessions per physician and time period were needed. Physician identifiers and scribe attestations were removed to assure a blinded chart review.

Quality of EHR notes was assessed using measures from 1) the validated QNOTE tool for assessment of outpatient notes [39], 2) the Physician Documentation Quality Instrument (PDQI) tool (“Internal Consistency” measure) [40], and 3) our internal institutional recommendations (e.g. duplications in medication list and problem list). The final note quality instrument included 11 items with each item scored 0 (no), 1 (partial), or 2 (yes), for a maximal possible score of 22 (Additional file 1). Three authors [AP (medical student), FFC (internal medicine resident), and WWL (general internal medicine faculty physician)] coded 10 progress notes separately using the tool and discussed results to resolve discrepancies. This process was repeated iteratively for 20 progress notes, after which consensus was achieved with a high level of inter-rater reliability (Krippendorff’s alpha = 0.89). Two investigators (AP and FFC) then independently coded the 150 included charts.

The number and proportion of preventative health recommendations completed at the visit was assessed for 12 recommendations: depression screening, prediabetes surveillance, diabetes screening, hepatitis C screening, human immunodeficiency virus (HIV) screening, breast cancer and osteoporosis screening, and shingles, tetanus (Tdap/Td), pneumococcal polysaccharide (PPSV23), pneumococcal conjugate (PCV13) and human papillomavirus vaccine (HPV) vaccine administration [37].

To identify which preventative health items were due on the visit date, preventative health measures completed between 1995 and 2017 were extracted from the EHR. A 90-day window was allowed after each patient encounter in the study period to allow time for completion of the preventative care measure. For each patient, the proportion of completed recommendations compared to recommendations due was calculated for each patient encounter. Patients with more than one visit during the study period were excluded from the preventative care analysis because there would be inadequate time for the 90-day follow-up period. Patients who had no preventative health recommendations due at the visit were also excluded from the preventative care analysis.

Statistical analysis

For clinical efficiency and quality data, we tested unadjusted group differences between the intervention and each control group using Chi-square tests for dichotomous outcomes, Wilcoxon rank sums for ordinal and non-normally distributed continuous outcomes, and t-tests for normally distributed outcomes. Generalized linear mixed models (GLMMs) were used for adjusted analyses to determine the effect of scribe presence on clinical efficiency or quality controlling for study design, baseline physician percentage, and patient demographics. The outcomes we examined include the physician time to close encounter, number of visits per clinic session, patient time in clinic, EHR note quality, medication review, immunization review, population of patient instructions into the after-visit summary, reconciliation of outside information, and preventative health recommendations. Physician was treated as a random effect in all models.

For time to close encounter, patient visits were nested within physician and modeled using repeated measures to account for meaningful differences in case mix that could affect the time to close the encounter. To determine the differences in the number and proportion of appropriate preventative health recommendations addressed, a multilevel logistic regression was conducted by intervention condition, adjusting for patient’s age, gender, and number of preventative health recommendations due. Count data were modeled using a Poisson model, gamma-distributed outcomes used log-linear models, binary and binomial response data were modeled using logistic regressions, and normally distributed outcomes used linear models. The analyses used alpha = 0.5 to define statistical significance and Stata 15 and SAS 9.4 for computations. This project was approved as a quality improvement project by the University of Chicago and therefore did not require an Institutional Review Board (IRB) approval.

Results

Patient demographics

Of the 1973 patient visits included in the analysis, 789 were baseline visits, 605 were unscribed visits during the intervention period, and 579 were scribed visits (Additional file 1). A total of 1493 unique patients were included with a mean of 1.39 (Standard Deviation (SD) 0.69) visits per patient. About half of patients were under 65 years old (50.4%) and over half were women (62.5%) (Additional file 1). A total of 1044 patients were included in the analysis of preventative measures (379 baseline, 332 unscribed, 333 scribed) and 150 EHR notes (75 baseline, 75 scribed) were included in the note quality analysis.

Clinical efficiency

In unadjusted models, the median (Interquartile Range (IQR)) time to close encounter was shorter for scribed visits [0.4 (4.8) days] than baseline [1.2 (5.9) days] and unscribed visits [2.9 (5.4) days] (both p < 0.001). Additionally, there were more patient visits per clinic session during scribed visits [mean (SD), 7.38 (1.94)] than baseline [6.86 (2.11), p = 0.08] and unscribed visits [6.58 (2.74), p = 0.03] (Table 1). Additional file 1 provides modeling comparisons adjusted for study design characteristics. In adjusted models, the time to close encounter remained shorter during scribed visits compared with baseline and unscribed visits, but there was no longer a difference in the number of patient visits per clinic session (Fig. 1a). Patient time in clinic did not differ in unadjusted or adjusted analyses.

Table 1 Clinical efficiency measures for scribed, baseline, and unscribed visits (n = 1973)
Fig. 1
figure 1

Adjusted Odds Ratios for Models* of Individual Scribe Intervention Outcomes. *Panel A Patients per clinic session is adjusted for morning or afternoon clinic and physician mean during baseline control. Visit-level models are adjusted for patient age, gender, and physician mean during baseline control. Odds ratios are estimated from log odds for gamma-distributed outcomes. Panel B models are adjusted for physician percentage during baseline control. Panel C models adjusted for patient age, gender, and physician percentage during baseline control. All models include physician as a random effect

Clinical quality

Quality of notes

In unadjusted models, the history of present illness (HPI) was rated as more “clear” for scribed visits compared with baseline visits (92.0% vs. 69.3%, p < 0.001) (Table 2). In adjusted models, the HPI for scribed notes remained more likely to be rated as “clear” [Odds Ratio (OR) = 7.30, 95% Confidence Interval (CI) 2.35–22.7, p = 0.001]. In addition, the HPI for scribed notes was more likely to have “sufficient information” [OR = 2.21, 95% CI 1.13–4.35, p = 0.02) (Fig. 1b). There were no differences in the remaining items assessed in the HPI or in the assessment and plan, internal consistency, or number of problem list and medication list duplicates between scribed and baseline notes (Table 2). There was also no difference in the overall note quality score between scribed and baseline notes (average score 15.6/22 for both groups, p = 0.92). Of note, in exit interviews, physicians reported that they instructed the scribe to spend less time on the assessment and plan, because they preferred to write this section themselves. Other themes from exit interviews are reported in our previous work [38].

Table 2 Unadjusted changes in note quality comparing scribed and baseline visits*

Medication review, immunization review, population of patient instructions, reconciliation of outside information

In unadjusted models, medications were reviewed more frequently during scribed visits compared to baseline visits (88.4% vs. 81.2%, p < 0.001) (Table 3). However, immunizations were reviewed less frequently during scribed visits than baseline visits (7.8% vs. 13.8%, p < 0.001). In adjusted models (Fig. 1c), current medications (OR = 1.70, 95% CI 1.22–2.35, p = 0.002) remained more likely to be reviewed, and immunizations less likely to be reviewed in scribed visits vs. baseline visits (OR = 0.55, 95% CI 0.38–0.79, p = 0.002). Additional file 1 includes comparisons between clinical quality measures for scribed, baseline, and unscribed visits adjusted for study design characteristics. Outside information was also more likely to be reconciled for scribed visits compared to baseline in adjusted analyses (OR = 1.37, 95% CI 1.04–1.81, p = 0.03) (Fig. 1c). There were no differences in medication or immunization review between scribed and unscribed visits, or population of patient instructions during scribed vs. baseline or unscribed visits.

Table 3 Clinical quality measures for scribed, baseline, and unscribed visits

Completion of preventative health recommendations

In total, 1044 (70%) patients were included in the preventative care analysis. The most common preventative health recommendations due at visit were depression screening, HIV screening, and shingles vaccination. On average, four recommendations were due per visit for scribed, baseline, and unscribed visits (Additional file 1). The overall mean and proportion of preventative health items addressed within 90 days of the visit was lower at scribed visits [0.38 (SD 0.70); 9.5%] vs. baseline [0.55 (SD 0.84), p = 0.05; 14.4%, p < 0.001] and unscribed visits [0.56 (SD 0.98), p = 0.005; 14.4%, p < 0.001) (Additional file 1). The difference was driven primarily by differences in depression screening rates [scribed 17.2% vs. baseline 26.9% (p = 0.004) and unscribed 28.8% (p = 0.001)]. In adjusted models, scribed visits were no longer different in the overall mean number or proportion of completed preventative care recommendations (Fig. 1c).

Discussion

In this study, we found that scribed visits were associated with more timely closure of clinic encounters and increased clarity and completeness in HPI documentation at an academic general internal medicine practice. No difference was found in the number of visits per clinic session, patient time in clinic, or completion of preventative health measures in adjusted analyses. While prior scribe studies in primary care required clinicians to see more patients per clinic session or decrease appointment lengths during the intervention period, we did not implement these measures to minimize disruption and assess for impact on existing workflows [33, 35]. To our knowledge, this is the first scribe study using both baseline and concurrent controls to account for secular trends.

The association of scribed visits with decreased time to close encounter is consistent with prior studies [41]. This finding is important for clinical quality since increased lag time between visit date and note closure can result in documentation omissions and inaccuracies, raising patient safety concerns [42, 43]. In addition, when charts are not closed in a timely fashion, billing delays can result in loss of revenue for clinical practices [44]. Thus, employing a scribe may address important quality measures for practices by improving timeliness and integrity of documentation while also optimizing the practice’s revenue cycle management.

The results of our analysis on note quality, reconciliation of information, and preventative health measure completion can be used to identify target areas for improved clinical quality. We found that scribed notes had higher ratings on clarity and completeness for the HPI section and slightly higher rates of medication review, suggesting that working with scribes may be a viable strategy to improve documentation accuracy. However, no difference was found in the quality of the assessment and plan, which was likely related to participating physicians’ self-reported preference for editing this section of the note themselves.

Interestingly, the lower rate of immunization review and no improvement in the completion of preventative health recommendations during scribed visits may have been an unintended consequence of decreased physician time spent in the EHR during scribed encounters. Our finding in the unadjusted analyses of fewer preventative care recommendations addressed during scribed visits was primarily driven by the lower rates of depression screening when the scribe was present. This finding is unsurprising because in 2017, depression screening was expected to be performed by physicians during clinic visits and physicians may have been less aware that depression screening was due since they spent less time in the EHR during scribed visits. Since 2017, the primary responsibility of depression screening at our institution has shifted from physicians to other members of the care team, as is typical in many primary care practices [45].

Our findings on the quality of scribed notes address concerns about the quality of documentation written by scribes or physicians [46]. One prior study found that only 18% of the physician-generated progress note text was manually entered (vs. copy and pasted) by the physician [47], and another study noted that 20% of patients who read their ambulatory note found a mistake in it [48]. As initiatives such as OpenNotes, which promotes note sharing with patients, gain popularity [49, 50], the quality and readability of EHR notes co-authored by scribes may reduce patient confusion and improve patient satisfaction with their notes [33, 41]. Additionally, prior studies have found large physician-physician variability in the content and completion of common clinical documentation domains, which may result in inefficiencies and potential harm to patients due to missed or misinterpreted information [51,52,53,54]. Working with scribes may be one strategy to help reduce note variability and improve quality of documentation. Future work should study the impact of enhanced training and providing continuous quality improvement feedback for scribes and physicians to improve clinical quality and documentation [55].

Consistent with prior studies, we found that scribe presence did not impact patient time from check in to check out, which likely reflects the impact of other variables such as clinic staffing ratios and physician time allotted per visit [33, 56]. Importantly, since the scribe was responsible for documentation during clinic visits, it is likely that physicians had increased face-to-face time with patients [33], which may improve doctor-patient relationship, and may lead to patient engagement and improved adherence to care plans [57, 58]. Indeed, while this was not a measured outcome of our study, several participating physicians gave us qualitative feedback that working with the scribe allowed them to more meaningfully engage with patients, increased their facetime with patients, and increased physicians’ satisfaction in their practice [38]. Further, in a prior study of this program, we found that physicians reported spending significantly less time on post-clinic EHR documentation after clinic sessions with a scribe vs. without a scribe [38].

Our study had several limitations. The short duration of the single-site program, small number of physicians participating in the pilot, and employment of a single, well-trained, scribe limit the generalizability of the study. However, our findings are consistent with similar studies in primary care settings finding decreased time to close encounter and no effect on patient time in clinic, which may alleviate some concerns about generalizability [33, 41]. In addition, the GIM clinic at our institution may have similar clinical volume to other large urban academic medical centers. Further, the fact that participating faculty were selected from a group that expressed an interest in working with a scribe may have introduced a selection bias into the study. Additionally, we did not assess how physicians spent their time in the exam room and were not able to objectively assess whether physicians spent more face-to-face time with patients when the scribe was present. Since a relatively small number of EHR notes was reviewed for quality, we also may have missed meaningful note quality differences due to wide confidence intervals around each estimate. Finally, we only accessed an outsourced scribe model, in which training and management of scribes is managed by an outside company, and our results cannot be generalized to in-house scribe models, in which clinical practices expand the roles of team members (e.g. licensed practical nurses or medical assistants) to act as scribes and provide documentation assistance [59,60,61]. In-house scribe models may be more suitable for certain continuous quality improvement interventions, such as empowering scribes to remind physicians of preventative care gaps.

Conclusions

Our study found that scribes may improve some aspects of clinical efficiency, quality, and EHR documentation. In addition to these potential benefits, other benefits of scribes that have been previously described including improved physician satisfaction due to decreased administrative burdens of the EHR [7,8,9,10,11,12,13]. Importantly, we did not ask clinicians to see more patients when working with a scribe, so our results suggest the impact of a scribe presence on existing clinic workflows. Further research should explore the potential to improve clinical efficiency and quality outcomes in primary care by enhancing workflow training for physicians and scribes and using continuous quality improvement to optimize documentation and address relevant care gaps.

Availability of data and materials

The datasets generated and analyzed during the current study are not publicly available to preserve anonymity of deidentified patient data but available from the corresponding author on reasonable request.

Abbreviations

HITECH:

Health Information Technology for Economic and Clinical Health Act of 2009

EHR:

Electronic health record

GIM:

General internal medicine

PDQI:

Physician Documentation Quality Instrument

HIV:

Human immunodeficiency virus

Tdap/Td:

Tetanus, diphtheria, pertussis vaccine

PPSV 23:

Pneumococcal polysaccharide vaccine

PCV13:

Pneumococcal conjugate vaccine

HPV:

Human papillomavirus

GLMM:

Generalized Linear Mixed Models

SD:

Standard Deviation

IQR:

Interquartile Range

HPI:

History of present illness

OR:

Odds ratio

CI:

Confidence interval

References

  1. Blumenthal D, Tavenner M. The “meaningful use” regulation for electronic health records. N Engl J Med. 2010;363(6):501–4. https://doi.org/10.1056/NEJMp1006114.

    Article  CAS  PubMed  Google Scholar 

  2. Gold M, McLaughlin CA. Assessing HITECH implementation and lessons: 5 years later. Milbank Q. 2016;94(3):654–87. https://doi.org/10.1111/1468-0009.12214.

    Article  PubMed  PubMed Central  Google Scholar 

  3. Burde H. The HITECH act: an overview. AMA J Ethics. 2011;13(3):172–5.

    Article  Google Scholar 

  4. Lin SC, Jha AK, Adler-Milstein J. Electronic health records associated with lower hospital mortality after systems have time to mature. Health Aff. 2018;37(7):1128–35. https://doi.org/10.1377/hlthaff.2017.1658.

    Article  Google Scholar 

  5. Campanella P, Lovato E, Marone C, Fallacara L, Mancuso A, Ricciardi W, et al. The impact of electronic health records on healthcare quality: a systematic review and meta-analysis. Eur J Pub Health. 2015;26(1):60–4. https://doi.org/10.1093/eurpub/ckv122.

    Article  Google Scholar 

  6. Kruse CS, Stein A, Thomas H, Kaur H. The use of electronic health records to support population health: a systematic review of the literature. J Med Syst. 2018;42(11):214. https://doi.org/10.1007/s10916-018-1075-6.

    Article  PubMed  PubMed Central  Google Scholar 

  7. Friedberg MW, Chen PG, Van Busum KR, et al. Factors Affecting Physician Professional Satisfaction and Their Implications for Patient Care, Health Systems, and Health Policy. Rand Health Q. 2014;3(4):1. Published 2014 Dec 1.

  8. Shanafelt TD, Dyrbye LN, Sinsky C, Hasan O, Satele D, Sloan J, et al. Relationship between clerical burden and characteristics of the electronic environment with physician burnout and professional satisfaction. Mayo Clin Proc. 2016;91(7):836–48. https://doi.org/10.1016/j.mayocp.2016.05.007.

    Article  PubMed  Google Scholar 

  9. Sinsky CA, Dyrbye LN, West CP, Satele D, Tutty M, Shanafelt TD. Professional satisfaction and the career plans of US physicians. Mayo Clin Proc. 2017;92(11):1625–35. https://doi.org/10.1016/j.mayocp.2017.08.017.

    Article  PubMed  Google Scholar 

  10. Weiner M. Forced inefficiencies of the electronic health record. J Gen Intern Med. 2019;34(11):2299–301. https://doi.org/10.1007/s11606-019-05281-3.

    Article  PubMed  PubMed Central  Google Scholar 

  11. Flanagan ME, Militello LG, Rattray NA, Cottingham AH, Frankel RM. The thrill is gone: burdensome electronic documentation takes its toll on physicians’ time and attention. J Gen Intern Med. 2019;34(7):1096–7. https://doi.org/10.1007/s11606-019-04898-8.

    Article  PubMed  PubMed Central  Google Scholar 

  12. Olson K, Sinsky C, Rinne ST, Long T, Vender R, Mukherjee S, et al. Cross-sectional survey of workplace stressors associated with physician burnout measured by the mini-Z and the Maslach burnout inventory. Stress Health. 2019;35(2):157–75. https://doi.org/10.1002/smi.2849.

    Article  PubMed  Google Scholar 

  13. Melnick ER, Dyrbye LN, Sinsky CA, Trockel M, West CP, Nedelec L, et al. The association between perceived electronic health record usability and professional burnout among US physicians. Mayo Clin Proc. 2019;95(3):476–87. https://doi.org/10.1016/j.mayocp.2019.09.024.

    Article  PubMed  Google Scholar 

  14. Sinsky C, Colligan L, Li L, Prgomet M, Reynolds S, Goeders L, et al. Allocation of physician time in ambulatory practice: a time and motion study in 4 specialties. Ann Intern Med. 2016;165(11):753–60. https://doi.org/10.7326/M16-0961.

    Article  PubMed  Google Scholar 

  15. Arndt BG, Beasley JW, Watkinson MD, Temte JL, Tuan WJ, Sinsky CA, et al. Tethered to the EHR: primary care physician workload assessment using EHR event log data and time-motion observations. Ann Fam Med. 2017;15(5):419–26. https://doi.org/10.1370/afm.2121.

    Article  PubMed  PubMed Central  Google Scholar 

  16. Tai-Seale M, Olson CW, Li J, Chan AS, Morikawa C, Durbin M, et al. Electronic health record logs indicate that physicians split time evenly between seeing patients and desktop medicine. Health Aff. 2017;36(4):655–62. https://doi.org/10.1377/hlthaff.2016.0811.

    Article  Google Scholar 

  17. The American Medical Informatics Association. AMIA Calls on HHS to Decouple Clinical Documentation and Administrative Requirements. https://www.amia.org/news-and-publications/press-release/amia-calls-hhs-decouple-clinical-documentation-and-administrative. Accessed 13 Sept 2020.

  18. The American Medical Association. AMA Announces Policies Adopted During Interim Meeting. https://www.ama-assn.org/press-center/press-releases/ama-announces-policies-adopted-during-interim-meeting. Accessed 13 Sept 2020.

  19. The Office of the National Coordinator for Health Information Technology. Strategy on Reducing Regulatory and Administrative Burden Relating to the Use of Health IT and EHRs. Final Report. 2020. https://www.healthit.gov/sites/default/files/page/2020-02/BurdenReport_0.pdf. Accessed 13 Sept 2020.

    Google Scholar 

  20. Baugh R, Trott RN, Takyi VE, Abbas JT. Medical scribes. J Med Pract Manag. 2012 Nov 1;28(3):195–7.

    Google Scholar 

  21. The Joint Commission. Documentation Assistance Provided by Scribes. https://www.jointcommission.org/standards/standard-faqs/ambulatory/record-of-care-treatment-and-services-rc/000002210/. Accessed 13 Sept 2020.

  22. Gellert GA, Ramirez R, Webster SL. The rise of the medical scribe industry: implications for the advancement of electronic health records. JAMA. 2015;313(13):1315–6. https://doi.org/10.1001/jama.2014.17128.

    Article  CAS  PubMed  Google Scholar 

  23. Heaton HA, Castaneda-Guarderas A, Trotter ER, Erwin PJ, Bellolio MF. Effect of scribes on patient throughput, revenue, and patient and provider satisfaction: a systematic review and meta-analysis. Am J Emerg Med. 2016;34(10):2018–28. https://doi.org/10.1016/j.ajem.2016.07.056.

    Article  PubMed  Google Scholar 

  24. Nambudiri VE, Watson AJ, Buzney EA, Kupper TS, Rubenstein MH, Yang F-SC. Medical scribes in an academic dermatology practice. JAMA Dermatol. 2018;154(1):101–3. https://doi.org/10.1001/jamadermatol.2017.3658.

    Article  PubMed  Google Scholar 

  25. Earls ST, Savageau JA, Begley S, Saver BG, Sullivan K, Chuman A. Can scribes boost FPs’ efficiency and job satisfaction? J Fam Pract. 2017;66(4):206–14.

    PubMed  Google Scholar 

  26. Gao RW, Dugala A, Maxwell J, et al. Effect of medical scribes on outpatient oncology visits at a multidisciplinary Cancer center. J Oncol Pract. 2020;16(2):e139–47.

    Article  Google Scholar 

  27. Taylor KA, McQuilkin D, Hughes RG. Medical scribe impact on patient and provider experience. Mil Med. 2019;184(9–10):388–93. https://doi.org/10.1093/milmed/usz030.

    Article  PubMed  Google Scholar 

  28. Koshy S, Feustel PJ, Hong M, Kogan BA. Scribes in an ambulatory urology practice: patient and physician satisfaction. J Urol. 2010;184(1):258–62. https://doi.org/10.1016/j.juro.2010.03.040.

    Article  PubMed  Google Scholar 

  29. Hess JJ, Wallenstein J, Ackerman JD, Akhter M, Ander D, Keadey M, et al. Scribe impacts on provider experience, operations, and teaching in an academic emergency medicine practice. West J Emerg Med. 2015;16(5):602–10. https://doi.org/10.5811/westjem.2015.6.25432.

    Article  PubMed  PubMed Central  Google Scholar 

  30. Bastani A, Shaqiri B, Palomba K, Bananno D, Anderson W. An ED scribe program is able to improve throughput time and patient satisfaction. Am J Emerg Med. 2014;32(5):399–402. https://doi.org/10.1016/j.ajem.2013.03.040.

    Article  PubMed  Google Scholar 

  31. Bank AJ, Obetz C, Konrardy A, et al. Impact of scribes on patient interaction, productivity, and revenue in a cardiology clinic: a prospective study. Clin Outcomes Res. 2013;5:399–406. https://doi.org/10.2147/CEOR.S49010.

    Article  Google Scholar 

  32. Bank AJ, Gage RM. Annual impact of scribes on physician productivity and revenue in a cardiology clinic. Clin Outcomes Res. 2015;7:489–95. https://doi.org/10.2147/CEOR.S89329.

    Article  Google Scholar 

  33. Zallman L, Finnegan K, Roll D, Todaro M, Oneiz R, Sayah A. Impact of medical scribes in primary care on productivity, face-to-face time, and patient comfort. J Am Board Fam Med. 2018;31(4):612–9. https://doi.org/10.3122/jabfm.2018.04.170325.

    Article  PubMed  Google Scholar 

  34. Mishra P, Kiang JC, Grant RW. Association of Medical Scribes in primary care with physician workflow and patient experience. JAMA Intern Med. 2018;178(11):1467–72. https://doi.org/10.1001/jamainternmed.2018.3956.

    Article  PubMed  PubMed Central  Google Scholar 

  35. Heckman J, Mukamal KJ, Christensen A, Reynolds EE. Medical scribes, provider and patient experience, and patient throughput: a trial in an academic general internal medicine practice. J Gen Intern Med. 2019;5:1–5.

    Google Scholar 

  36. Misra-Hebert AD, Amah L, Rabovsky A, Morrison S, Cantave M, Hu B, et al. Medical scribes: how do their notes stack up? J Fam Pract. 2016;65(3):155–9.

    PubMed  Google Scholar 

  37. U.S. Preventive Services Task Force. Published Recommendations. https://www.uspreventiveservicestaskforce.org/BrowseRec/Index/browse-recommendations. Accessed 13 Sept 2020.

  38. Pozdnyakova A, Laiteerapong N, Volerman A, Feld LD, Wan W, Burnet DL, et al. Impact of medical scribes on physician and patient satisfaction in primary care. J Gen Intern Med. 2018;33(7):1109–15. https://doi.org/10.1007/s11606-018-4434-6.

    Article  PubMed  PubMed Central  Google Scholar 

  39. Burke HB, Hoang A, Becher D, Fontelo P, Liu F, Stephens M, et al. QNOTE: an instrument for measuring the quality of EHR clinical notes. J Am Med Inform Assoc. 2014;21(5):910–6. https://doi.org/10.1136/amiajnl-2013-002321.

    Article  PubMed  PubMed Central  Google Scholar 

  40. Stetson PD, Bakken S, Wrenn JO, Siegler EL. Assessing electronic note quality using the physician documentation quality instrument (PDQI-9). Appl Clin Inform. 2012;3(2):164–74. https://doi.org/10.4338/aci-2011-11-ra-0070.

    Article  PubMed  PubMed Central  Google Scholar 

  41. Gidwani R, Nguyen C, Kofoed A, Carragee C, Rydel T, Nelligan I, et al. Impact of scribes on physician satisfaction, patient satisfaction, and charting efficiency: a randomized controlled trial. Ann Fam Med. 2017;15(5):427–33. https://doi.org/10.1370/afm.2122.

    Article  PubMed  PubMed Central  Google Scholar 

  42. Leventhal R. Recognizing the Value of Clinical Documentation Improvement. https://www.hcinnovationgroup.com/finance-revenue-cycle/article/13023287/recognizing-the-value-of-clinical-documentation-improvement. Accessed 13 Sept 2020.

  43. AHIMA Work Group. Integrity of the healthcare record: best practices for EHR documentation (2013 update). J AHIMA. 2013;84(8):58–62 [extended web version].

    Google Scholar 

  44. Perez MC, McCaw K, Drury T, Alix B. Requirements for the payment of Medicare claims – a selection of some important criteria. Med Bull. 2006;8(3):3–4.

    Google Scholar 

  45. Loeb D, Sieja A, Corral J, Zehnder NG, Guiton G, Nease DE. Evaluation of the role of training in the implementation of a depression screening and treatment protocol in 2 academic outpatient internal medicine clinics utilizing the electronic medical record. Am J Med Qual. 2015;30(4):359–66. https://doi.org/10.1177/1062860614532681.

    Article  PubMed  Google Scholar 

  46. Yan C, Rose S, Rothberg MB, Mercer MB, Goodman K, Misra-Hebert AD. Physician, scribe, and patient perspectives on clinical scribes in primary care. J Gen Intern Med. 2016;31(9):990–5. https://doi.org/10.1007/s11606-016-3719-x.

    Article  PubMed  PubMed Central  Google Scholar 

  47. Wang MD, Khanna R, Najafi N. Characterizing the source of text in electronic health record progress notes. JAMA Intern Med. 2017;177(8):1212–3. https://doi.org/10.1001/jamainternmed.2017.1548.

    Article  PubMed  PubMed Central  Google Scholar 

  48. Bell SK, Delbanco T, Elmore JG, Fitzgerald PS, Fossa A, Harcourt K, et al. Frequency and types of patient-reported errors in electronic health record ambulatory care notes. JAMA Netw Open. 2020;3(6):e205867. https://doi.org/10.1001/jamanetworkopen.2020.5867.

    Article  PubMed  PubMed Central  Google Scholar 

  49. Walker J, Leveille S, Bell S, Chimowitz H, Dong Z, Elmore JG, et al. OpenNotes after 7 years: patient experiences with ongoing access to their clinicians’ outpatient visit notes. J Med Internet Res. 2019;21(5):e13876. https://doi.org/10.2196/13876.

    Article  PubMed  PubMed Central  Google Scholar 

  50. Miliard M. Healthcare IT News. OpenNotes Notches Another Big Milestone, with 40 Million Patients Now Seeing their EHRs. https://www.healthcareitnews.com/news/opennotes-notches-another-big-milestone-40-million-patients-now-seeing-their-ehrs. Accessed 13 Sept 2020.

  51. Cohen GR, Friedman CP, Ryan AM, Richardson CR, Adler-Milstein J. Variation in physicians’ electronic health record documentation and potential patient harm from that variation. J Gen Intern Med. 2019;34(11):2355–67. https://doi.org/10.1007/s11606-019-05025-3.

    Article  PubMed  PubMed Central  Google Scholar 

  52. Pollard SE, Neri PM, Wilcox AR, Volk LA, Williams DH, Schiff GD, et al. How physicians document outpatient visit notes in an electronic health record. Int J Med Inform. 2013;82(1):39–46. https://doi.org/10.1016/j.ijmedinf.2012.04.002.

    Article  PubMed  Google Scholar 

  53. Ancker JS, Kern LM, Edwards A, Nosal S, Stein DM, Hauser D, et al. With the HITEC investigators. How is the electronic health record being used? Use of EHR data to assess physician-level variability in technology use. J Am Med Inform Assoc. 2014;21(6):1001–8. https://doi.org/10.1136/amiajnl-2013-002627.

    Article  PubMed  PubMed Central  Google Scholar 

  54. Edwards ST, Neri PM, Volk LA, Schiff GD, Bates DW. Association of note quality and quality of care: a cross-sectional study. BMJ Qual Safety. 2014;23(5):406–13. https://doi.org/10.1136/bmjqs-2013-002194.

    Article  Google Scholar 

  55. McNicol M, Kuhn C, Sebastian S. Standardized documentation workflow within an electronic health record to track pharmacists’ interventions in pediatric ambulatory care clinics. J Am Pharm Assoc. 2019;59(3):410–5. https://doi.org/10.1016/j.japh.2019.01.007.

    Article  Google Scholar 

  56. Militello LG, Arbuckle NB, Saleem JJ, Patterson E, Flanagan M, Haggstrom D, et al. Sources of variation in primary care clinical workflow: implications for the design of cognitive support. Health Informatics J. 2014;20(1):35–49. https://doi.org/10.1177/1460458213476968.

    Article  PubMed  Google Scholar 

  57. Náfrádi L, Kostova Z, Nakamoto K, Schulz PJ. The doctor–patient relationship and patient resilience in chronic pain: a qualitative approach to patients’ perspectives. Chronic Illn. 2018;14(4):256–70. https://doi.org/10.1177/1742395317739961.

    Article  PubMed  Google Scholar 

  58. Matusitz J, Spear J. Effective doctor–patient communication: an updated examination. Soc Work Public Health. 2014;29(3):252–66. https://doi.org/10.1080/19371918.2013.776416.

    Article  PubMed  Google Scholar 

  59. Anderson P, Halley MD. A new approach to making your doctor-nurse team more productive. Fam Pract Manag. 2008;15(7):35–40.

    PubMed  Google Scholar 

  60. Woodcock DV, Pranaat R, McGrath K, Ash JS. The evolving role of medical scribe: variation and implications for organizational effectiveness and safety. Stud Health Technol Inform. 2017;234:382–8.

    PubMed  Google Scholar 

  61. Funk KA, Davis M. Enhancing the role of the nurse in primary care: the RN “co-visit” model. J Gen Intern Med. 2015;30(12):1871–3. https://doi.org/10.1007/s11606-015-3456-6.

    Article  PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgements

We acknowledge the following contributors: Lisa Vinci MD MS, Lynda Hale, Debra White.

Funding

This work was supported by the University of Chicago Bucksbaum Institute for Clinical Excellence and the University of Chicago Section of General Internal Medicine.

Author information

Authors and Affiliations

Authors

Contributions

AP contributed to data collection, analysis and interpretation of the results, and was a major contributor in writing the manuscript. NL contributed to the conception and design of the study, analysis and interpretation of the results, and was a major contributor in writing the manuscript. SAH was a major contributor to the analysis and interpretation of the results, and contributed to writing the manuscript. FFC contributed to data collection and analysis. SH contributed to the interpretation of the results and to writing the manuscript. DB contributed to the conception and design of the study. WWL contributed to the conception and design of the study, data collection, interpretation of the results, and was a major contributor in writing the manuscript. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Wei Wei Lee.

Ethics declarations

Ethics approval and consent to participate

This project was approved as a quality improvement project by the University of Chicago. The need for ethics approval and consent to participate was deemed unnecessary for this project, which was decided by the University of Chicago Quality Chief and the Center for Healthcare Delivery Science and Innovation and waived by the University of Chicago Institutional Review Board. All methods were carried out in accordance with relevant guidelines and regulations.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1: Appendix Table 1.

Scoring System for Assessing EHR Note Quality. Appendix Table 2. Visit-Level Patient Demographics During Baseline, Unscribed, and Scribed Visits (February–June 2017). Appendix Table 3. Comparisons Between Clinical Efficiency Measures for Scribed, Baseline, and Unscribed Visits Adjusting for Study Design (n = 1973). Appendix Table 4. Comparisons Between Clinical Quality Measures for Scribed, Baseline, and Unscribed Visits Adjusting for Study Design. Appendix Table 5. Preventative Health Recommendations Due and Completed within 90 Days for Baseline, Unscribed, and Scribed Visits (n = 1044). Appendix Table 6. Proportion of Preventative Care Recommendations Completed within 90 Days for Baseline, Unscribed, and Scribed Visits (n = 1044).

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Piersa, A.P., Laiteerapong, N., Ham, S.A. et al. Impact of a medical scribe on clinical efficiency and quality in an academic general internal medicine practice. BMC Health Serv Res 21, 686 (2021). https://doi.org/10.1186/s12913-021-06710-y

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12913-021-06710-y

Keywords