- Research article
- Open Access
Economic impact of clinical decision support interventions based on electronic health records
BMC Health Services Research volume 20, Article number: 871 (2020)
Unnecessary healthcare utilization, non-adherence to current clinical guidelines, or insufficient personalized care are perpetual challenges and remain potential major cost-drivers for healthcare systems around the world. Implementing decision support systems into clinical care is promised to improve quality of care and thereby yield substantial effects on reducing healthcare expenditure. In this article, we evaluate the economic impact of clinical decision support (CDS) interventions based on electronic health records (EHR).
We searched for studies published after 2014 using MEDLINE, CENTRAL, WEB OF SCIENCE, EBSCO, and TUFTS CEA registry databases that encompass an economic evaluation or consider cost outcome measures of EHR based CDS interventions. Thereupon, we identified best practice application areas and categorized the investigated interventions according to an existing taxonomy of front-end CDS tools.
Results and discussion
Twenty-seven studies are investigated in this review. Of those, twenty-two studies indicate a reduction of healthcare expenditure after implementing an EHR based CDS system, especially towards prevalent application areas, such as unnecessary laboratory testing, duplicate order entry, efficient transfusion practice, or reduction of antibiotic prescriptions. On the contrary, order facilitators and undiscovered malfunctions revealed to be threats and could lead to new cost drivers in healthcare. While high upfront and maintenance costs of CDS systems are a worldwide implementation barrier, most studies do not consider implementation cost. Finally, four included economic evaluation studies report mixed monetary outcome results and thus highlight the importance of further high-quality economic evaluations for these CDS systems.
Current research studies lack consideration of comparative cost-outcome metrics as well as detailed cost components in their analyses. Nonetheless, the positive economic impact of EHR based CDS interventions is highly promising, especially with regard to reducing waste in healthcare.
Contributions to the literature
A recent economic analysis of implemented clinical decision support (CDS) interventions based on electronic health records (EHR) is presented based on previous reviews.
Different EHR based CDS tools are prioritized and weighted regarding their economic benefit. This study provides policymakers, clinic managers, and other healthcare providers, who intend to implement similar health information technology, with a better understanding of valuable interventions and their application areas.
The small number of model-based economic evaluations and the studies’ heterogeneity are regarded as indicators that information about costs and benefits is not extensively reported in the scientific literature.
As stated in the 2017 OECD health report, the annual average growth rate in per capita health expenditure continued to increase by 1.7% in Germany and 2.1% in the US in real terms since 2009 . Healthcare expenditure per capita was estimated to be $5551 in Germany but was yet outspent by the United States, with almost 80% higher spending per capita . The latest OECD Health Statistics 2019 report reconfirms these numbers on rising healthcare expenditure, and yet reveals an increase of spending per capita to $5986 in Germany and $10,586 in the US, which is equal to 11.2% and 16.9% of total GDP, respectively .
Unnecessary healthcare utilization, non-adherence to current clinical guidelines, or insufficient personalized care are perpetual challenges and remain potential major cost-drivers for healthcare systems around the world [3, 4]. For instance, a recent review estimated the annual cost of waste in the US healthcare system between $760 billion and $935 billion, which accounts for 25% of total healthcare spending . Furthermore, Shrank et al.  approximated that $191 billion to $282 billion could be saved annually with the use of systematic interventions that address the reduction of waste in healthcare.
The benefits of electronic health records (EHR) culminate in the integration of computerized provider order entry (CPOE) systems and real-time, point of care clinical decision support (CDS) interventions. Introducing decision support systems into clinical care is promised to improve quality of care and thereby yield substantial effects on reducing healthcare expenditure . In addition, the growing field of behavioral economics explores how different interventions, such as nudges or best-practice-alerts (BPA), influence and improve clinical decision making through various applicable concepts [6, 7].
The goal of this study is to explore the economic impact of EHR based CDS interventions and to identify a coherent best practice approach for these clinical interventions from a cost outcome perspective. Finally, we seek to examine cost-saving or cost-effective application areas for different medical risk factors.
We conducted a systematic literature review to identify the current research progress regarding the economic impact and benefits of clinical decision support interventions based on EHRs. Following the preferred reporting items for systematic reviews and meta-analyses (PRISMA) statement , we searched English-language literature indexed in the following databases: (1) PubMed, (2) Cochrane Central Register of Controlled Trials (CENTRAL) in the Cochrane Library, (3) Web of Science, (4) EBSCO Business Source Complete, and (5) CEA Registry Tufts Medical Center Library. Additionally, we screened the reference lists of all included studies for eligibility. The literature screening process was completed on January 10th, 2020.
To achieve high sensitivity and precision, we developed each search query based on three main pillars: (a) economic outcome, (b) electronic health record, and (c) clinical decision support. These main terms are then further extended with specific terminology and synonyms using Boolean operators to complete the search strategy. We used MeSH terms for the search in PubMed (1) and comparable search terms in databases (2)–(4). For the basic CEA registry search (5), only basic key search terms were used. A detailed summary of the developed search queries is listed in an additional file (see Additional file 1).
We included all trials in which a monetary economic outcome of an implemented EHR based CDS system is reported. Thus, we considered all analyses of inpatient or ambulatory financial data measures as well as trial-based modelling predictions. We also included all kinds of model perspectives, i.e., societal, health insurance, health systems, or user-centered perspective, to identify the complete economic dimension of an EHR based CDS intervention. We summarized the detailed inclusion and exclusion criteria of this systematic economic review in Table 1.
A pre-search showed that prior systematic reviews adequately elaborate the timeframe until 2014, and we, therefore, include only studies published from 2014 to 2020. During our search process, we found that the number of studies meeting the inclusion criteria increased tremendously in the past years, partially overlapping the present research question [9,10,11]. The most recent review by Jacob et al.  examined the cost and economic benefits of CDS systems restricted to cardiovascular disease prevention. However, the authors were unable to conclude whether these interventions were cost-beneficial or cost-effective. Moja et al.  reviewed randomized controlled trials (RCTs) that examined the effectiveness of EHR based CDS systems with regard to mortality, morbidity, and economic outcomes. The authors report that EHR based CDS interventions resulted in only small differences in cost and health service utilization.
Front-end CDS interventions
Wright et al.  developed a taxonomy of front-end CDS interventions available to EHR users, which we adopt into this study. In contrast to back-end system capabilities, the authors defined front-end CDS tools as “the intervention types available to end-users created using specific clinical knowledge bases and application logic .” Their taxonomy consists of 53 designed CDS front-end tools, i.e., interventions, that were further categorized into six categories :
Medication dosing support
Point-of-care alert or reminders
Relevant information display
We utilize this taxonomy to analyze application areas of significant cost-savings. For this, we prioritize and weight different EHR based CDS tools based upon their economic benefit. This approach can give policymakers, clinic managers, and other healthcare providers a better understanding of valuable EHR based CDS interventions and their application areas to implement similar health information technology.
We screened in total 1309 publications, of which 27 studies meet our inclusion criteria for this economic review [5, 13,14,15,16,17,18,19,20,21,22,23,24,25,26,27,28,29,30,31,32,33,34,35,36,37,38]. The process of our literature search and the reasons for excluding several studies is provided within the PRISMA flow-diagram in Fig. 1. An overview of the characteristics of the included studies is listed in Table 2.
Generally, 22 studies (81%) [5, 13,14,15,16, 18, 20,21,22,23,24,25, 28,29,30,31,32, 34,35,36,37,38] out of the included 27 studies report cost savings after implementing an EHR based CDS intervention. Four studies (15%) [17, 26, 27, 33] report a rise in cost expenditure. The remaining study (4%)  did not detect significant differences in cost outcomes. In the majority of included studies the main cost outcome measures were related to laboratory test cost [15,16,17, 20, 21, 25, 28, 29, 31, 32, 38].
Exploration of different front-end CDS intervention categories
According to the taxonomy by Wright et al. , we identified 10 (37%) studies [5, 13, 15, 20, 22, 23, 26, 36,37,38] which explored EHR based CDS interventions based on point-of-care alerts or reminders (category 3). Three interventions (11%) [17, 27, 34] were order facilitators (category 2). Medication dosing support, relevant information display, and expert systems (categories 1, 4, and 5) were each reported only once from an economic perspective (11%) [18, 19, 24]. In eight studies (30%) [14, 16, 25, 28, 30, 31, 33, 35], interventions from two different categories were explored in combination. Moreover, we found three studies (11%) [21, 29, 32] in which the option to place a certain order or test, e.g., a laboratory test, was removed from the EHR CPOE system or the clinician’s laboratory ordering preference list. These restrictive frond-end CDS intervention types were not yet mentioned in the predefined categories by Wright et al. . Thus, we extend their taxonomy by a new category:
Restriction of choice 
The removal of an order option ultimately resulted in fewer laboratory tests and reduced healthcare expenditure in all studies [14, 28, 31]. Finally, we identified two different types of implemented hard-stops : an interruptive alert  and a restrictive hard-stop . An interruptive alert requires a clicking response from the physician before being able to move forward. A restrictive hard-stop prevents the physician from ordering a test, e.g., by directing them to call the laboratory director. We grouped studies regarding the interruptive alert intervention to category 3 and the restrictive hard-stop intervention to category 7.
Economic impact for prevalent application areas
In Table 3, we summarized our findings and created an overview of application areas and cost outcome measures in relation to the applied CDS intervention types. The included studies show a high heterogeneity with regard to different types of reported cost outcomes and different intervention durations. Due to this complexity, it was not possible to conduct a subgroup analysis regarding the economic impact of each CDS-front end category. A detailed evidence synthesis of all included 27 studies and a brief description of their intervention types, their application area, and the resulting economic impact are provided in an additional file (see Additional file 2).
Application areas for cost-savings
We identified four primary application areas based on their investigated prevalence that resulted in cost-savings after EHR based CDS implementation. Firstly, two studies report on reducing unnecessary Vitamin D routine testing, which led to a decrease in laboratory test cost of $300,000  and $1.4 mill.  per year.
Secondly, two studies addressed the economic outcome of reducing waste in transfusion practice and red blood cell usage [36, 37]. The acquisition product cost of red cell units was decreased with the help of EHR based CDS and resulted in cost savings of $4,821,000 after 3 years  and about $62,715 within 1 year  after implementation, respectively.
Thirdly, two cost-effectiveness analyses modeled the cost outcome of reducing antibiotic prescriptions for acute respiratory infection and acute bronchitis [5, 33]. Gong et al.  include a full accounting of costs into their Markov model, and explore that the implemented CDS intervention, called “suggested alternatives”, yielded more quality adjusted life years (QALYs) at a lower cost of $500,000 per 100,000 individuals over 30 years of implementation. Michaelidis et al.  report only a small increase in costs compared to a printed decision support system, i.e., posters. However, the latter mainly results from a cost difference between the direct costs of poster printing and computer programming.
Lastly, five studies [20, 29, 31, 32, 38] report on the potential to reduce duplicate orders, e.g., duplicate laboratory tests, using hard-stops  or order frequency rules . Order frequency rules prevent ordering the same test within a specified timeframe. Reducing duplicate laboratory tests resulted in savings of $3395 after 3 months for a small patient size cohort , and up to $315,565 within 24 month for a large patient size cohort .
Application areas resulting in cost increase
We also identified risk areas, which possibly lead to a further increase in healthcare expenditure. One study found that specialized HIV laboratory testing cost increased by $14,000–$96,000 within 6 months after implementing a CPOE system with default settings . Another study reports that an unplanned change of a pre-selected default order for ‘complete blood count’ to ‘complete blood count with differential’ led to an average cost increase of $293.11 per day . Finally, the implementation of order sets as decision facilitators possibly entails adverse economic effects. One study found that only after uncoupling joint orders of Vitamin B12 and serum folate tests from predefined order sets, laboratory test cost decreased by about $26,719 per year . Similarly, another study removed the option to order daily routine tests from automated admission order sets and found savings of $26,416 after 2 months .
In Table 4, we present an overview of studies that conducted a cost-effectiveness-analysis (CEA) of EHR-based CDS interventions and include various cost data as well as economic outcome measures. One such economic outcome measure is the incremental cost-effectiveness ratio (ICER), which depicts the incremental change in costs divided by the incremental change in health outcome or effect.
Cost-effectiveness analyses aim to reveal the trade-offs in resource-allocation decisions . In this context, it is essential to investigate when and to what extend upfront and maintenance costs for an EHR based CDS system will be amortized by its benefits. The benefits can be measured in health outcomes, such as quality adjusted life years (QALYs), or the reduction of unnecessary healthcare utilization.
Generally, two studies report an increase in healthcare expenditure from a societal perspective [26, 33] while the other two report cost savings from a societal perspective and the medical group’s perspective [5, 35]. Notably, the measurement of effectiveness was single study-based estimates in all four studies.
Regarding the consideration of upfront implementation cost, Gong et al.  include only base case consolidated cost data of $1.91 for a cohort of 100.000 individuals based on expert opinions. Sharifi et al.  include intervention start-up cost for EHR modification of $2.7 mill. as well as other direct costs, such as professional care provider training. Michaelidis et al.  report implementation and maintenance cost data, which is physician education per hour and medical record and CDS programming per patient of $18 in the base case. Lastly, Forrester et al.  report CPOE CDS system cost as hardware, software, and maintenance costs starting from $373,000 in year one to $92,000 after 5 years, as well as personnel, $555,000 in year one, and indirect costs as 3% of the total cost. Interestingly, the indirect costs also include the HITECH Meaningful Use incentives in their model to simulate the financial incentives by the Centers for Medicare & Medicaid Services in the US [35, 47].
Studies lack consideration of all cost components
Despite revealing significant potentials for cost-savings, we could not assess the quality of the included studies because of missing cost information or non-consideration of all relevant cost components. According to the Consolidated Health Economic Evaluation Reporting Standards (CHEERS) statement, most of the reported recommendations were not satisfied . All 23 non-model studies (85%) only calculate the economic outcome based on financial data reported before and after intervention implementation. For instance, this results from the computation of price per healthcare resource utilization multiplied by the quantity of used healthcare resources or services. Thus, even though it was not intended in those studies, it is necessary to mention that only four of the included studies adhere to sound economic evaluations as recommended by CHEERS [5, 35].
The challenge of heterogeneity for the CEA is also aggravated by considering different cost outcomes. Two studies neither report an incremental cost effectiveness ratio (ICER) for a predefined threshold directly, nor do they include comparative metrics [33, 35]. Other standardized metrics, such as the return on investment or net present value, were also not examined in the included studies. Only one study reports on the net monetary benefit (NMB) of the intervention in relation to a predefined threshold [5, 49].
Additional studies worth mentioning
Notably, five more studies [50,51,52,53,54] meet most of our inclusion criteria but were excluded due to various, although little, deviations. Three studies [50,51,52] report cost-savings after a bundle of information technology was implemented simultaneously, but the economic benefit could not solely be attributed to the EHR based CDS intervention. The fourth publication is an NHS health technology assessment (HTA) report . In this HTA, an RCT was conducted in 79 general practices in the UK in which a multi-component intervention was installed using EHRs to reduce the number of antibiotic prescriptions for respiratory infections. The authors perform a basic cost-analysis focusing on the number of provider consultations as the cost of healthcare utilization. However, they found no difference in the cost outcome between the intervention and control period.
The last study worth mentioning compared retrospectively generated alerts by an advanced machine learning CDS system to alerts triggered through the home-grown EHR based CDS system . The authors calculated the healthcare cost of potentially prevented adverse drug events and medication errors and found that the advanced machine learning CDS system gave 68.2% more alerts resulting in cost savings of $60.67 per alert. After extrapolating these results to a local patient population of 747,985, they estimated savings of $1,294,457 over 5 years .
Evaluating the economic impact of EHR-based CDS interventions and their potential to increase value in healthcare remains a significant challenge. Even though we found that 22 studies report cost savings, most of them do not include developing or maintaining costs. Therefore, we could not draw a sound correlation between vendor-purchased or home-grown systems’ costs to their economic benefit. Nonetheless, this study reveals several use cases with coherent CDS tools that have proven to be cost-saving and could be eligible for other healthcare providers, clinic managers, and researchers for implementation or further exploration.
With the majority of implemented CDS interventions based on point-of-care alerts, the question remains on how more algorithm-based expert systems and multiple interventions will have synergy effects on the economic impact. Considering the amount of alerts and the healthcare provider’s time expense, a process-cost analysis, such as the time-driven activity based costing approach, could be combined with the CEA to achieve a better understanding of the whole cost cycle as well as productivity effects for healthcare entities [55, 56]. Generally, cost outcome measures continue to require comparative metrics, for instance, as used by Mathias et al., the cost per useful alert . In a simple model, the authors introduce this measure to analyze how different parameters affect the cost of implementing EHR based CDS alerts for genomic precision medicine . However, for future economic evaluations of EHR based CDS interventions, a more specific approach for individual application areas or focus on medical risk factors is needed to draw meaningful conclusions from cost and outcome comparisons . Moreover, decision-analytic modelling techniques, e.g., Markov models, enable the evaluation of multiple income and outcome parameters. They address downstream costs or savings that may result from the introduction of health information technology. These complex modelling approaches are necessary in order to consider various health outcomes resulting from EHR CDS systems, e.g., prevention of adverse events .
Another economic challenge to consider is CPOE systems with default lists or opt-out options of orderable tests as well as predefined order sets. The automation of orders through such order sets or joint-order options could ultimately lead to an increase in costs and a decrease of value [58, 59]. For example, the rate of unnecessary laboratory tests can increase when healthcare professionals tend to accept the whole order set rather than de-selecting single order items . This can be explained by alert fatigue, which must not directly be related to the order set, in combination with the ‘button clicking syndrome’, which explains the inducement of moving along inattentively [17, 59]. Apart from the direct economic factors, other potential benefits of order sets and joint-order options, such as improved adherence to clinical guidelines or patient safety outcomes, are not sufficiently addressed by the included studies. This again highlights the importance of further profound health economic evaluations.
Finally, one study also reported an increase in costs after an unplanned change in the CDS system . Such malfunctions or unintended errors, when caused by newly integrated health information technology, are referred to as ‘e-Iatrogenesis’ . These may also lead to yet another cost-driver and possibly cause unpredictable economic damage [61, 62].
Transferability for other countries
All included studies where based on cost data and trials from the United States or Canada. Consequently, current research progress on the economic potentials of EHR based CDS systems on rising healthcare expenditure in Europe and worldwide cannot be derived. We found recent studies that evaluate the cost-effectiveness of a stand-alone CPOE CDS system in the Netherlands , or compare the effectiveness of an EHR based CDS intervention in the US, UK, Republic of Korea, and Belgium . Another RCT explored the effectiveness of an EHR based CDS intervention for patients with atrial fibrillation and a high risk of stroke in Sweden . Nevertheless, we found no study that has evaluated the potential for increasing value in this present highly promising field of health information technology outside of North America.
However, this study reveals promising cost savings for already implemented health information technology. Even though implementation cost was not considered, on a long-term view, these results reveal the potential for cost-savings once implementation cost is amortized. Therefore, the sooner large health information technology systems will be implemented in other countries around the world and evaluated economically, the earlier cost-benefits and return on investments can be realized.
Support from policymakers could accelerate economic benefits
Interestingly, Forrester et al.  include monetary incentives provided by the Meaningful Use Initiative in the US in their CEA. This financial support covered only a small percentage of total implementation cost in their developed model as incentive-eligible prescribers received $42,000 over 5 years. Nevertheless, this contributed to the investigated cost-effectiveness of an EHR based CDS intervention compared to paper-based prescriptions. Therefore, how policymakers worldwide intend to support EHR adoption and incentivize embedded CDS systems financially is a critical factor for the economic success of such systems. High upfront implementation cost constitute a significant burden for healthcare entities, especially for smaller to middle-sized practices and hospitals . For instance, a systematic review of EHR embedded CDS systems for cardiovascular disease prevention derived the mean annual cost of development, implementation, and ongoing costs of operations to be $102 per patient and $6056 per practice for small practices, and $49 per patient and $35,201 per practice for medium-sized practices .
Finally, achieving a decrease in healthcare expenditure should never influence a patient’s quality of life or disease treatment in a negative way. Even though eliminating a laboratory order option from a CPOE system led to cost-savings, each patient’s value and health outcome is of the highest importance and should be individually assessed. Future economic evaluations of EHR based CDS systems should focus more on the potentials of health benefits that could be achieved, such as through reduced antibiotic prescriptions or reduced adverse drug events, rather than proving to have effectively reduced laboratory test cost. In the end, competing on shifting costs will not change anything about the primary goal of decision stewardship, and that is to increase value in healthcare .
There are some limitations to this study. Firstly, we only considered English language literature and, therefore, might not have included international publications in other languages that indeed report on the information technology progress made by other countries regarding the linkage of CDS systems to an existing EHR. Another limitation is the exclusion of EHR cost and price display interventions. This decision was based on another recent systematic review, which found that cost display interventions in EHR CPOE systems do not affect the efficiency and effectiveness domain of healthcare quality . We also excluded other non-monetary impact measures, such as length of stay, which necessarily also refers to the economic impact of EHR based CDS implementations.
Overall, our findings might be biased since we included all types of studies as well as all kinds of monetary outcomes. Due to the lack of economic evaluations, included studies tend to declare high cost-savings but only consider little to no cost components regarding the implementation and maintenance of such a complex information system. In addition, authors might have been tempted to calculate cost-savings only when the implemented intervention proved effective. Finally, we found that some studies not necessarily mention the calculated economic outcome in the title or abstract of their publication. Therefore, we might have excluded studies that did not initially meet our inclusion criteria by following the PRISMA guidelines.
Clinical decision support interventions based on electronic health records have an overall positive economic impact. Predominantly point-of-care alerts concerning unnecessary laboratory testing, efficient transfusion practice, or reduction of antibiotic prescription emerged as application areas with already promising potential for high-cost savings. Nonetheless, most studies lack consideration of coherent cost components as well as comparative metrics. Therefore, the economic dimension of EHR based CDS interventions needs to be further explored. High-quality cost-effectiveness or cost-utility analyses, which include more extensive cost data and consider different economic perspectives, are needed to draw a sound conclusion. Finally, introducing personalized health services based on peoples’ electronic health records is yet another promising research field with high potential for further increasing value in healthcare and should receive more attention in future research.
Availability of data and materials
Adverse drug events
Clinical decision support
Consolidated Health Economic Evaluation Reporting Standards
Computerized provider order entry
Electronic health record
Health technology assessment
Incremental cost-effectiveness ratio
Net monetary benefit
Quality adjusted life years
Randomized controlled trial
Preferred Reporting Items for Systematic Reviews and Meta Analyses
OECD. Health at a glance 2017: OECD indicators. Paris: OECD Publishing; 2017. https://doi.org/10.1787/health_glance-2017-en. Accessed 1 Oct 2019.
OECD. OECD Health Statistics 2019. 2019. https://www.oecd.org/health/health-data.htm. Accessed 1 Dec 2019.
Shrank WH, Rogstad TL, Parekh N. Waste in the US health care system: estimated costs and potential for savings. JAMA. 2019;322(15):1501–9 https://doi.org/10.1001/jama.2019.13978.
McGinn T. Putting meaning into meaningful use: a roadmap to successful integration of evidence at the point of care. JMIR Med Inform. 2016;4(2):e16 https://doi.org/10.2196/medinform.4553.
Gong CL, Zangwill KM, Hay JW, et al. Behavioral economics interventions to improve outpatient antibiotic prescribing for acute respiratory infections: a cost-effectiveness analysis. J Gen Intern Med. 2019;34(6):846–54 https://doi.org/10.1007/s11606-018-4467-x.
Atkins D. So many nudges, so little time: can cost-effectiveness tell us when it is worthwhile to try to change provider behavior? J Gen Intern Med. 2019;34(6):783–4 https://doi.org/10.1007/s11606-019-04871-5.
Cho I, Bates DW. Behavioral economics interventions in clinical decision support systems. Yearb Med Inform. 2018;27(1):114–21 https://doi.org/10.1055/s-0038-1641221.
Moher D, Liberati A, Tetzlaff J, Altman DG, PRISMA Group. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med. 2009;6(7):e1000097 https://doi.org/10.1371/journal.pmed.1000097.
Jacob V, Thota AB, Chattopadhyay SK, et al. Cost and economic benefit of clinical decision support systems for cardiovascular disease prevention: a community guide systematic review. J Am Med Inform Assoc. 2017;24(3):669–76 https://doi.org/10.1093/jamia/ocw160.
Moja L, Kwag KH, Lytras T, et al. Effectiveness of computerized decision support systems linked to electronic health records: a systematic review and meta-analysis. Am J Public Health. 2014;104(12):e12–22 https://doi.org/10.2105/AJPH.2014.302164.
Bright TJ, Wong A, Dhurjati R, et al. Effect of clinical decision-support systems: a systematic review. Ann Intern Med. 2012;157(1):29–43 https://doi.org/10.7326/0003-4819-157-1-201207030-00450.
Wright A, Sittig DF, Ash JS, et al. Development and evaluation of a comprehensive clinical decision support taxonomy: comparison of front-end tools in commercial and internally developed electronic health record systems. J Am Med Inform Assoc. 2011;18(3):232–42 https://doi.org/10.1136/amiajnl-2011-000113.
Chen D, Bhambhvani HP, Hom J, et al. Effect of electronic clinical decision support on Imaging for the evaluation of acute low back pain in the ambulatory care setting. World Neurosurg. 2019;S1878–8750(19):32867 https://doi.org/10.1016/j.wneu.2019.11.03.
Marcelin J, Brewer C, Beachy M, et al. Hardwiring diagnostic stewardship using electronic ordering restrictions for gastrointestinal pathogen testing. Infect Control Hosp Epidemiol. 2019;40(6):668–73 https://doi.org/10.1017/ice.2019.78.
Chin KK, Hom J, Tan M, et al. Effect of electronic clinical decision support on 25(OH) vitamin D testing. J Gen Intern Med. 2019;34(9):1697–9 https://doi.org/10.1007/s11606-019-05057-9.
Goetz C, Di Capua J, Lee I, et al. A student-led, multifaceted intervention to decrease unnecessary Folate ordering in the inpatient setting. J Healthc Qual. 2019;41(5):e54–60 https://doi.org/10.1097/JHQ.0000000000000177.
Bolles K, Woc-Colburn L, Hamill RJ, et al. Ordering patterns and costs of specialized laboratory testing by hospitalists and house staff in hospitalized patients with HIV at a county hospital: An opportunity for diagnostic stewardship. Open Forum Infect Dis. 2019;6(6):ofz158 https://doi.org/10.1093/ofid/ofz158.
Fertel BS, Podolsky SR, Mark J, et al. Impact of an individual plan of care for frequent and high utilizers in a large healthcare system. Am J Emerg Med. 2019;37(11):2039–42 https://doi.org/10.1016/j.ajem.2019.02.032.
Tamblyn R, Winslade N, Qian CJ, et al. What is in your wallet? A cluster randomized trial of the effects of showing comparative patient out-of-pocket costs on primary care prescribing for uncomplicated hypertension. Implement Sci. 2018;13(1):7 https://doi.org/10.1186/s13012-017-0701-x.
Bejjanki H, Mramba LK, Beal SG, et al. The role of a best practice alert in the electronic medical record in reducing repetitive lab tests. Clinicoecon Outcomes Res. 2018;10:611–8 https://doi.org/10.2147/CEOR.S167499.
MacMillan TE, Gudgeon P, Yip PM, et al. Reduction in unnecessary red blood cell folate testing by restricting computerized physician order entry in the electronic health record. Am J Med. 2018;131(8):939–44 https://doi.org/10.1016/j.amjmed.2018.03.044.
Chen JR, Tarver SA, Alvarez KS, et al. Improving aztreonam stewardship and cost through a penicillin allergy testing clinical guideline. Open Forum Infect Dis. 2018;5(6):ofy106 https://doi.org/10.1093/ofid/ofy106.
Heekin AM, Kontor J, Sax HC, et al. Choosing wisely clinical decision support adherence and associated inpatient outcomes. Am J Manag Care. 2018;24(8):361–6.
Nault V, Pepin J, Beaudoin M, et al. Sustained impact of a computer-assisted antimicrobial stewardship intervention on antimicrobial use and length of stay. J Antimicrob Chemother. 2017;72(3):933–40 https://doi.org/10.1093/jac/dkw468.
Sadowski BW, Lane AB, Wood SM, et al. High-value, cost-conscious care: Iterative systems-based interventions to reduce unnecessary laboratory testing. Am J Med. 2017;130(9):1112.e1–7 https://doi.org/10.1016/j.amjmed.2017.02.029.
Sharifi M, Franz C, Horan CM, et al. Cost-effectiveness of a clinical childhood obesity intervention. Pediatrics. 2017;140(5):e20162998 https://doi.org/10.1542/peds.2016-2998.
Schnaus MJ, Michalik M, Skarda P. Effects of electronic medical record display on provider ordering behavior: leveraging the EMR to improve quality and costs. Am J Med. 2017;130(12):1366–71 https://doi.org/10.1016/j.amjmed.2017.08.019.
Felcher AH, Gold R, Mosen DM, et al. Decrease in unnecessary vitamin D testing using clinical decision support tools: making it harder to do the wrong thing. J Am Med Inform Assoc. 2017;24(4):776–80 https://doi.org/10.1093/jamia/ocw182.
Konger RL, Ndekwe P, Jones G, et al. Reduction in unnecessary clinical laboratory testing through utilization management at a US government veterans affairs hospital. Am J Clin Pathol. 2016;145(3):355–64 https://doi.org/10.1093/ajcp/aqv092.
Stenner SP, Chakravarthy R, Johnson KB, et al. ePrescribing: reducing costs through in-class therapeutic interchange. Appl Clin Inform. 2016;7(4):1168–81.
Procop GW, Keating C, Stagno P, et al. (a). Reducing duplicate testing: a comparison of two clinical decision support tools. Am J Clin Pathol. 2015;143(5):623–6 https://doi.org/10.1309/AJCPJOJ3HKEBD3TU.
Procop GW, Yerian LM, Wyllie R, et al. (b). Duplicate laboratory test reduction using a clinical decision support tool. Am J Clin Pathol. 2014;141(5):718–23 https://doi.org/10.1309/AJCPOWHOIZBZ3FRW.
Michaelidis CI, Kern MS, Smith KJ. Cost-effectiveness of decision support strategies in acute bronchitis. J Gen Intern Med. 2015;30(10):1505–10 https://doi.org/10.1007/s11606-015-3289-3.
Shaha SH, Gilbert-Bradley D. Improved immediate and continued-care outcomes for stroke through community-wide data. Stud Health Technol Inform. 2015;209:140–6.
Forrester SH, Hepp Z, Roth JA, et al. Cost-effectiveness of a computerized provider order entry system in improving medication safety ambulatory care. Value Health. 2014;17(4):340–9 https://doi.org/10.1016/j.jval.2014.01.009.
Goodnough LT, Maggio P, Hadhazy E, et al. Restrictive blood transfusion practices are associated with improved patient outcomes. Transfusion. 2014;54:2753–9 https://doi.org/10.1111/trf.12723.
Razavi SA, Carter AB, Puskas JD, et al. Reduced red blood cell transfusion in cardiothoracic surgery after implementation of a novel clinical decision support tool. J Am Coll Surg. 2014;219(5):1028–36 https://doi.org/10.1016/j.jamcollsurg.2014.06.012.
Bridges SA, Papa L, Norris AE, et al. Duplicated laboratory tests: evaluation of a computerized alert intervention abstract. J Healthc Qual. 2014;36(3):46–53 https://doi.org/10.1111/j.1945-1474.2012.00219.x.
Ubel PA, Rosenthal MB. Beyond nudges - when improving health calls for greater assertiveness. N Engl J Med. 2019;380(4):309–11 https://doi.org/10.1056/NEJMp1806371.
Powers EM, Shiffman RN, Melnick ER, et al. Efficacy and unintended consequences of hard-stop alerts in electronic health record systems: a systematic review. J Am Med Inform Assoc. 2018;25(11):1556–66.
Cornu P, Phansalkar S, Seger DL, et al. High-priority and low-priority drug-drug interactions in different international electronic health record systems: a comparative study. Int J Med Inform. 2018;111:165–71 https://doi.org/10.1016/j.ijmedinf.2017.12.027.
Karlsson LO, Nilsson S, Bång M, et al. A clinical decision support tool for improving adherence to guidelines on anticoagulant therapy in patients with atrial fibrillation at risk of stroke: a cluster-randomized trial in a Swedish primary care setting (the CDS-AF study). PLoS Med. 2018;15(3):e1002528 https://doi.org/10.1371/journal.pmed.1002528.
Slight SP, Quinn C, Avery AJ, et al. A qualitative study identifying the cost categories associated with electronic health record implementation in the UK. J Am Med Inform Assoc. 2014;21(e2):e226–31 https://doi.org/10.1136/amiajnl-2013-002404.
Porter ME. What is value in health care? N Engl J Med. 2010;363(26):2477–81 https://doi.org/10.1056/NEJMp1011024.
Mummadi SR, Mishra R. Effectiveness of provider price display in computerized physician order entry (CPOE) on healthcare quality: a systematic review. J Am Med Inform Assoc. 2018;25(9):1228–39 https://doi.org/10.1093/jamia/ocy076.
Meeker D, Linder JA, Fox CR, et al. Effect of behavioral interventions on inappropriate antibiotic prescribing among primary care practices: a randomized clinical trial. JAMA. 2016;315(6):562–70 https://doi.org/10.1001/jama.2016.0275.
Taveras EM, Marshall R, Kleinman KP, et al. Comparative effectiveness of childhood obesity interventions in pediatric primary care: a cluster-randomized clinical trial. JAMA Pediatr. 2015;169(6):535–42 https://doi.org/10.1001/jamapediatrics.2015.0182.
Gonzales R, Anderer T, McCulloch CE, et al. A cluster randomized trial of decision support strategies for reducing antibiotic use in acute bronchitis. JAMA Intern Med. 2013;173(4):267–73 https://doi.org/10.1001/jamainternmed.2013.1589.
Black JT. Capsule Commentary on Michaelidis et al., Cost-Effectiveness of decision support strategies in acute bronchitis. J Gen Intern Med. 2016;31(3):328 https://doi.org/10.1007/s11606-015-3431-2.
Devine EB, Hansen RN, Wilson-Norton JL, et al. The impact of computerized provider order entry on medication errors in a multispecialty group practice. J Am Med Inform Assoc. 2010;17(1):78–84 https://doi.org/10.1197/jamia.M3285.
Neumann PJ, Sanders GD. Cost-effectiveness analysis 2.0. N Engl J Med. 2017;376(3):203–5 https://doi.org/10.1056/NEJMp1612619.
Centers for Medicare & Medicaid Services. Medicare and Medicaid programs; Regulations & Guidance; Promoting Interoperability Programs. 2020. http://www.cms.gov/Regulations-and-Guidance/Legislation/EHRIncentivePrograms/index.html. Accessed 26 June 2020.
Husereau D, Drummond M, Petrou S, et al. Consolidated health economic evaluation reporting standards (CHEERS)—explanation and elaboration: a report of the ISPOR health economic evaluations publication guidelines good reporting practices task force. Value Health. 2013;16(2):231–50.
Stinnett AA, Mullahy J. Net health benefits: a new framework for the analysis of uncertainty in cost-effectiveness analysis. Med Decis Mak. 1998;18:S68–80.
Graven M, Allen P, Smith I, et al. Decline in mortality with the Belize integrated patient-Centred country wide health information system (BHIS) with embedded program management. Int J Med Inform. 2013;82(10):954–63 https://doi.org/10.1016/j.ijmedinf.2013.06.003.
Riahi S, Fischler I, Stuckey MI, et al. The value of electronic medical record implementation in mental health care: a case study. JMIR Med Inform. 2017;5(1):e1.
Olchanski N, Dziadzko MA, Tiong IC, et al. Can a novel ICU data display positively affect patient outcomes and save lives? J Med Syst. 2017;41(11):171 https://doi.org/10.1007/s10916-017-0810-8.
Gulliford MC, Juszczyk D, Prevost AT, et al. Electronically delivered interventions to reduce antibiotic prescribing for respiratory infections in primary care: cluster RCT using electronic health records and cohort study. Health Technol Assess. 2019;23(11):1–70 https://doi.org/10.3310/hta23110.
Rozenblum R, Rodriguez-Monguio R, Volk LA, et al. Using a machine learning system to identify and prevent medication prescribing errors: a clinical and cost analysis evaluation. Jt Comm J Qual Patient Saf. 2020;46(1):3–10 https://doi.org/10.1016/j.jcjq.2019.09.008.
Keel G, Savage C, Rafiq M, et al. Time-driven activity-based costing in health care: a systematic review of the literature. Health Policy. 2017;121(7):755–63 https://doi.org/10.1016/j.healthpol.2017.04.013.
Campanale C, Cinquini L, Tenucci A. Time-driven activity-based costing to improve transparency and decision making in healthcare. Management. 2014;11:165–86.
Mathias PC, Tarczy-Hornoch P, Shirts BH. Modeling the costs of clinical decision support for genomic precision medicine. AMIA Jt Summits Transl Sci Proc. 2016;2016:60–4 eCollection 2016.
Hussain MI, Reynolds TL, Zheng K, et al. Medication safety alert fatigue may be reduced via interaction design and clinical role tailoring: a systematic review. J Am Med Inform Assoc. 2019;26(10):1141–9 https://doi.org/10.1093/jamia/ocz095.
Hakim I, Hathi S, Nair A, et al. Electronic health records and the frequency of diagnostic test orders. Am J Manag Care. 2017;23(1):e16–23.
Payne TH, Bates DW, Berner ES, et al. Healthcare information technology and economics. J Am Med Inform Assoc. 2013;20(2):212–7.
Wright A, Ai A, Ash J, et al. Clinical decision support alert malfunctions: analysis and empirically derived taxonomy. J Am Med Inform Assoc. 2018;25(5):496–506 https://doi.org/10.1093/jamia/ocx106.
Aaron S, McEvoy DS, Ray S, et al. Cranky comments: detecting clinical decision support malfunctions through free-text override reasons. J Am Med Inform Assoc. 2019;26(1):37–43 https://doi.org/10.1093/jamia/ocy139.
Vermeulen KM, van Doormaal JE, Zaal RJ, et al. Cost-effectiveness of an electronic medication ordering system (CPOE/CDSS) in hospitalized patients. Int J Med Inform. 2014;83(8):572–80 https://doi.org/10.1016/j.ijmedinf.2014.05.003.
This work has received funding from the European Union’s Horizon 2020 research and innovation program under the grant agreement No. 826117 Smart4Health - Building a citizen-centered EU-EHR exchange for personalized health. The funding body had no role in the design of the study, collection or data analysis. Open Access funding provided by Projekt DEAL.
Ethics approval and consent to participate
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Lewkowicz, D., Wohlbrandt, A. & Boettinger, E. Economic impact of clinical decision support interventions based on electronic health records. BMC Health Serv Res 20, 871 (2020). https://doi.org/10.1186/s12913-020-05688-3
- Economic evaluation
- Electronic health record
- Clinical decision support
- Behavioral economics