Improving drug safety in hospitals: a retrospective study on the potential of adverse drug events coded in routine data
BMC Health Services Research volume 19, Article number: 555 (2019)
Adverse drug events (ADEs) that occur during hospitalization are an ongoing medical concern. Systematic strategies for ADE identification are lacking. The aim of this study was to evaluate the potential to identify adverse drug events caused by medication errors (preventable ADEs, pADEs), and previously unknown adverse drug reactions (ADRs or non-preventable ADEs, npADEs) in inpatients by combining diagnosis codes in routine data with a chart review.
Diagnoses of inpatients are routinely coded using the International Classification of Diseases, 10th Revision (ICD-10). A total of 2326 cases were sampled from routine data of four hospitals using a set of ICD-10 German Modification ADE codes. Following a chart review, cases were evaluated in a standardized process with regard to drug relation and preventability of events.
By chart review, 1302 cases were classified as hospital-acquired and included in the evaluation. This yielded 1285 cases indicating an ADE. 96.8% of ADEs (1244 ADEs) were classified as known npADEs, only three cases as suspected previously unknown npADEs, one case as event after drug abuse. A total of 37 ADEs were classified as preventable (2.9% of all ADEs) by identifying a medication error as probable cause. The prevalence of pADEs varied considerably between included ADE codes, with hemorrhagic diathesis due to coumarins and localized skin eruptions showing the highest rates (8.7 and 9.1%, respectively). Most frequent medication errors were non-compliance to a known allergy, and improper dose.
When focusing on specific ADE codes, routine data can be used as markers for npADEs and medication errors, thus providing a meaningful complement to existing drug surveillance systems. However, the prevalence of medication errors is lower than in former studies on the frequency of pADEs.
Patients often experience adverse drug events (ADEs) during hospitalization [1, 2]. Such inpatient ADEs pose a considerable health and economic burden on the patients as well as on the health care system [3,4,5]. A significant number of inpatient ADEs are caused by medication errors and can be prevented (pADEs) [1, 6, 7]. By release of the action plans for improvement of medication safety by the Federal Ministry of Health in Germany, various measures have been implemented and promoted over the past decade in order to prevent and identify ADEs . In developed countries, hospitals increasingly use clinical decision support systems and computerized physician order entry systems to reduce prescription errors [9, 10].
To further improve drug safety it is crucial to overcome the lack of systematic detection and reporting of non-preventable adverse drug events (npADEs) and pADEs, and to perform an ongoing root cause analysis in order to identify factors that contribute to errors in hospitals [11, 12]. Spontaneous reporting systems and critical incident reporting systems (CIRS) for reporting ADEs are internationally established, but they suffer from acceptance problems in daily routine . Although the total number of spontaneous reports in Germany has been increasing for several years, the number is still low and the increase is mainly a result of higher reporting rates from pharmaceutical companies and patients .
Important data sources in hospitals are the diagnoses of inpatients routinely coded in Germany with the ICD-10 German Modification (ICD-10-GM) . The codes are part of the hospital routine data, which are transmitted promptly to sickness funds and annually to the Institute for the Hospital Remuneration System as a standardized data set. Various studies have identified and validated ICD-10 codes as high-precision markers for the identification of ADEs (so-called ADE codes) [16,17,18,19]. It was further reported that 50% of inpatient ADEs are coded as disease in the routine data , including between 7 and 12% [18,19,20] that are coded as drug-related disease. Despite this moderate sensitivity, given the high precision and nationwide availability of ADE codes, routine data could complement existing pharmacovigilance systems and thereby contribute to the improvement of drug safety in hospitals.
Therefore, the aim of this study was to evaluate the potential of utilizing ADE codes encoded in routine data as a complementary drug safety source by identifying a) preventable ADEs including causes and contributing factors of medication errors, and b) previously unknown non-preventable ADEs, those that are not listed in the Summary of Product Characteristics (SmPC). The results of the study could stimulate the use of routine data as a pharmacovigilance resource.
The following definitions are used allowing a clear distinction between non-preventable and preventable ADEs [21, 22]: an adverse drug event (ADE) is any harmful incident resulting from medical intervention related to a drug. ADEs are subdivided into non-preventable ADEs (npADEs) defined as harmful and unintended reactions to a drug after its appropriate use (adverse drug reaction), and preventable ADEs (pADEs), defined as harm to the patient due to errors in the drug treatment process. The definition of a npADE is consistent with the definition of an adverse reaction in ICD-10-GM, version 2018: adverse reaction of a drug that has been correctly prescribed and properly administered .
Study design and database
We conducted a retrospective, multicenter, observational study with an explorative approach using secondary data analysis to identify preventable and non-preventable harm in inpatients. Hospital discharge data from four full-service, non-academic hospitals in Germany of the calendar years 2015 and 2016 were used. The hospitals are located in cities with a population between 45,000 and 180,000 and together operate 2300 beds and treat 109,000 inpatients. The routine data contain inpatient conditions coded by ICD-10-GM with one principal diagnosis and several additional diagnoses. The principal diagnosis is defined as “that condition established after study to be chiefly responsible for occasioning the admission of the patient to the hospital for care”, whereas additional diagnoses are defined as “all conditions that coexist at the time of the principal diagnosis, or that develop during the hospital stay” . Since the focus of this study was on hospital-acquired ADEs (nosocomial conditions acquired during hospitalization) and as by definition hospital-acquired events cannot be assigned as principal diagnosis, only additional diagnoses were included. However, because additional diagnoses include comorbidities present at admission as well as hospital-acquired complications, and because the ICD-10-GM does not contain a Present on Admission (POA) indicator, the time of occurrence of corresponding events was determined during the chart review process.
In previous studies of the authors, the general suitability of ICD-10 codes for ADE identification was investigated by calculating prevalence, precision and sensitivity of ICD-10 additional diagnosis codes [19, 23]. Based on these results, ADE codes were selected for evaluation in this study if they a) indicate predominantly hospital-acquired events, b) have been validated as codes representing ADEs with high precision (positive predictive values 68 to 94%, see ), and c) occurred more frequently compared to other ADE codes. One ADE code identifies one inpatient stay and is defined as one observational unit (hereinafter called “case”). In each hospital, all cases in each code group that fulfilled inclusion criteria were independently retrieved from the respective routine data, resulting in a sample of 2326 cases. A case was identified in the hospital information system by the patient identifier linked to the ICD-10 code representing the ADE. Then, the patient chart was retrieved either in electronic or in paper-based format. Table 1 shows the included codes and the number of cases.
Data extraction and evaluation
Data for the analysis were recorded and evaluated in a multi-level, standardized procedure (Fig. 1). First, experienced personnel with medicinal and pharmaceutical background performed the chart review and documentation of event characteristics at the hospital’s site after completing a two-month study-specific training. To assure the data quality in the chart review process, multiple on-site visits were carried out. Starting point for a chart review was the diagnosis of one of the ADE codes listed in Table 1. After identification of the event in the medical record, data regarding the time point of the event, the relationship of the event to a drug if reported by the hospital staff, patient characteristics, drugs taken before event, patient’s known allergies and comorbidities, and source of information (physician or nurse) were extracted from the medical charts and the hospital information system. Data were recorded on a standardized data collection form. The parameters to be collected to identify and characterize a medication error were adopted from the taxonomy of medication errors from the National Coordinating Council for Medication Error Reporting and Prevention (NCC MERP, USA) .
At the scientific study center, the completed data collection forms were evaluated. All cases that occurred during hospitalization were classified according to type of adverse event. The underlying root cause of the occurrence of the event was assessed and related drugs to the ADE were assigned by taking into account the drug relationships recorded by the hospitals and by inspecting the SmPCs of administered drugs. A preventability assessment of the ADEs was performed to distinguish pADEs from npADEs by considering errors recorded by the hospital staff and by comparing collected data with the SmPC’s application instructions. A clinical decision support system (Software ID DIACOS PHARMA; ID Information und Dokumentation im Gesundheitswesen GmbH, Berlin) was used to support the assessment process. The following groups were defined to categorize the ADEs.
G0 – event without drug relationship: Adverse event for which no related drug therapy was identified.
G1 – known non-preventable ADE: ADE after proper use without indication of a medication error; ADE listed in the SmPC.
G2 – suspected previously unknown non-preventable ADE: ADE after proper use without indication of a medication error; ADE not listed in the SmPC.
G3 – preventable ADE: ADE with medication error as probable cause for reported event.
G4 – drug abuse: ADE because of drug abuse by the patient.
No personnel of the study center was involved in the data extraction process at the hospital’s site. At the scientific study center, cases were evaluated and categorized by author MA. All assessments were reviewed by author NK. For cases assigned to G2 and G3, a final consensus agreement was achieved by authors JS and NK. Absolute and relative frequencies and exact 95% confidence intervals (CI) were calculated using SAS (SAS Institute Inc., Release 9.4).
By chart review, data from 2326 cases were extracted. Of the reviewed cases, 1328 cases encoded events that occurred during hospitalization (57.1% of 2326), 747 cases represented events present at admission, and 251 with unknown onset date. Overall, 26 cases were excluded from the set of hospital-acquired events due to incomplete data or implausibility. Therefore, 1302 cases were included in the final analysis and assigned to groups G0 - G4 (Table 2).
Most of the cases were confirmed as ADE (G1-G4). A small percentage of the codes enterocolitis due to Clostridium difficile (A04.7-), and postprocedural renal failure (N99.0) represented events without drug relationship (G0). While 90 to 100% of cases across all codes were classified as known npADEs, only three cases were classified as suspected previously unknown npADEs, i.e. the ADE was not listed in the SmPC: Eliquis (active ingredient: Apixaban) associated with toxic gastroenteritis and colitis (K52.1), and Valoron (active ingredient: Tilidine; two cases) associated with localized skin eruption (L27.1).
A total of 37 cases (2.9% of all 1285 ADEs) represented pADEs. pADEs were identified in association with the ADE codes hemorrhagic diathesis due to coumarins (D68.33), hypotension due to drugs (I95.2), generalized and localized skin eruption (L27.0 and L27.1), and postprocedural renal failure (N99.0). Among pADEs, the codes D68.33, L27.0, and L27.1 showed the highest rates. One case with the ADE code hypotension due to drugs (I95.2) was related to drug abuse by the patient.
Out of the 37 cases with pADEs, 28 medication errors were related to skin eruptions. The non-compliance to a known allergy (27 cases) was the most frequent type of medication error (Table 3). Of these, 24 cases were associated with allergies to antibiotics. Improper dosing was rarely observed (seven cases). Possible causes and contributing factors could only be identified for a small proportion of medication errors.
In our study, codes of the ICD-10-GM (ADE codes) were analyzed to assess their potential for the detection of pADEs and previously unknown npADEs. As observed in the preceding validation study , the selected ADE codes represented high-precision markers for drug-related conditions that, with the exception of hemorrhagic diatheses, by the majority developed during hospitalization. These codes are thus suitable for the analysis of hospital-acquired ADEs.
The evaluation of the ADE codes revealed no evidence of medication errors in the vast majority of cases. Only 2.9% of all ADEs (G1-G4) were classified as probable consequences of medication errors and therefore as preventable (pADEs). However, the prevalence of pADEs varied significantly between ADE codes, ranging from 0 to 9.1%. In particular, higher rates were found for the ADE codes hemorrhagic diathesis associated with administration of vitamin K antagonists (8.7%), and skin eruptions (9.1%), mostly due to antibiotics. Both drug groups are frequently reported in association with hospital-acquired medication errors [7, 25, 26]. Former studies found higher rates of hospital-acquired pADEs compared to the results presented. For example, a prospective study at two hospitals in the Netherlands reported a rate of 5% inpatient pADEs , a prospective study in the UK found a pADE rate of 52%, and classified 47% of them as “possible” and 5% as “definite” . One meta-analysis reviewing eight prospective studies from the years 1994–2010  assessed 45% of all hospital-acquired ADEs to be preventable, whereas another meta-analysis evaluating nine prospective and retrospective studies from the years 2006 to 2014  reported 32% pADEs. However, differences in methodology and study population complicate the comparison of the results. A continuous improvement of quality standards in the drug therapy process and a more frequent use of electronic systems contribute to a reduction of preventable adverse events [9, 10]. This might explain the rarity of pADEs determined in this study, indicating a possible overestimation of the burden of medication errors in the current discussion on drug safety in the inpatient setting. However, considering the total number of inpatients in Germany and high percentage of ADE codes, rates of pADEs as determined in this study still demonstrate the ongoing relevance of drug safety improvement.
Possible causes and contributing factors of medication errors could only be determined in a few cases. Hospital staff related human factors such as heavy workload, transmission errors between documents, and communication deficits could be identified. To increase the patient’s safety, a systematic root cause analysis of medication errors at hospitals is essential in order to identify conditions in which medication errors are favored, to initiate structural changes to remedy them, and to define and optimize specific workflows. These measures have received increasing attention in recent years, for example through implementation of CIRS  or the formulation of standard operating procedures . In total, three cases of suspected previously unknown npADEs were identified. The low number and lack of information on the actual frequency of previously unknown ADEs in hospitals hampers a final qualitative assessment of the usability of routine data in this context. Therefore, the potential of routine data for the detection of previously unknown npADEs cannot be conclusively derived. A validation of the prevalence having a larger sample is recommended.
Limitations in the interpretation of the presented results can be discussed at different levels. Generally, routine data have only a moderate sensitivity for inpatient ADEs. As reported in the preceding validation study, 50% of hospital-acquired ADEs were coded as disease in the routine data, from which a subgroup of 12% was coded as drug-associated disease . A possible impact of under-reporting of ADEs in routine data on the rate of pADEs was not verified in this study. It can be argued that clinical personnel may be reluctant to code events related to medication errors and that there is a lack of information in the source data. On the other hand, this effect may be compensated because the severity and relevance of pADEs may in turn lead to higher coding rates. Therefore, taking into account the impact of under-reporting of pADEs but also the tendency to code ADEs with high severity more frequently, there is no evidence that the sensitivity of ADE codes indicating medication errors is lower than of ADE codes encoding non-preventable ADEs. The suspected medication errors and previously unknown npADEs identified in this work are distributed over a small set of ADE codes. Although the most frequent ADE codes were included in the analysis, it is not easily possible to generalize the prevalence rates determined in this study to other codes. The hospitals in this study have no specific characteristics. The evaluation based on nationwide uniform ICD-10 codes that are coded according to standardized guidelines . Therefore, a generalization of the results to other hospitals in Germany is reasonable. However, due to possible structural differences in different countries with regard to the pharmacovigilance infrastructure, a generalizability to other countries is only possible to a limited extent. Data on the frequencies of additional diagnoses in Germany show that unspecific codes are regularly used to code events . This includes codes such as T78.4 “Other and unspecified allergy” and T88.7 “Unspecified adverse effect of drug or medicament” - codes which do not directly identify the underlying event and which were therefore excluded from the study. Further studies are necessary to validate the impact of these codes on the rate of hospital-acquired pADEs.
Detection of pADEs and previously unknown npADEs in everyday clinical practice is a major challenge in healthcare. Our study confirmed the potential of utilizing ADE codes encoded in routine data as a complementary drug safety source. Furthermore, our data indicated that pADEs occur less frequently than expected. The majority of npADEs were mentioned in the SmPCs of related drugs.
The Drug Commission of the German Medical Association is currently developing a reporting system to systematically collect and evaluate medication errors within the framework of the spontaneous reporting system for ADRs . To address the under-reporting of ADEs, additional strategies to collect drug safety data are needed. Having a comprehensive and standardized acquisition, routine data can be effectively used as a complementary data source to detect medication errors. Our results demonstrate that the majority of ADEs coded in routine data are known npADEs. However, using routine data as markers for pADEs in combination with chart review is reasonable when focusing on specific ICD-10 codes. In a study from South Korea, ADE codes from nationwide routine data have been used as a basis to evaluate drug safety following the realization of an electronic drug prescription system . Furthermore, pADEs coded in routine data can provide important information for systematic prospective quality assessments in hospitals in order to implement preventive, risk-reducing measures in hospital management. One important step towards greater use of routine data in drug safety is the identification of further, suitable ADE codes . The implementation of a POA indicator in the German version of the ICD-10, a more strict specification of medication error coding in routine data, and not least raising awareness of ADE coding in hospitals can further increase the potential of routine data within the framework of drug safety.
Availability of data and materials
The data that support the findings of this study are available from the participating hospitals but restrictions apply to the availability of these data, which were used under license for the current study, and so are not publicly available. Data are however available from the authors upon reasonable request and if no interests of the participating hospitals are affected.
Adverse Drug Event
Adverse Drug Reaction
Critical Incident Reporting System
International Classification of Diseases, 10th Revision, German Modification
non-preventable Adverse Drug Event
preventable Adverse Drug Event
Present on Admission
Summary of Product Characteristics
de Vries EN, Ramrattan MA, Smorenburg SM, Gouma DJ, Boermeester MA. The incidence and nature of in-hospital adverse events: a systematic review. Qual Saf Health Care. 2008;17:216–23.
Martins ACM, Giordani F, Rozenfeld S. Adverse drug events among adult inpatients: a meta-analysis of observational studies. J Clin Pharm Ther. 2014;39:609–20.
Hug BL, Keohane C, Seger DL, Yoon C, Bates DW. The costs of adverse drug events in community hospitals. Jt Comm J Qual Patient Saf. 2012;38:120–6.
Jha AK, Larizgoitia I, Audera-Lopez C, Prasopa-Plaizier N, Waters H, Bates DW. The global burden of unsafe medical care: analytic modelling of observational studies. BMJ Qual Saf. 2013;22:809–15.
Rottenkolber D, Hasford J, Stausberg J. Costs of adverse drug events in German hospitals-a microcosting study. Value Health. 2012;15:868–75.
Hakkarainen KM, Hedna K, Petzold M, Hagg S. Percentage of patients with preventable adverse drug reactions and preventability of adverse drug reactions--a meta-analysis. PLoS One. 2012;7:e33236.
Laatikainen O, Miettunen J, Sneck S, Lehtiniemi H, Tenhunen O, Turpeinen M. The prevalence of medication-related adverse events in inpatients-a systematic review and meta-analysis. Eur J Clin Pharmacol. 2017;73:1539–49.
Arzneimittelkommission der deutschen Ärzteschaft: Aktionspläne zur Verbesserung der Arzneimitteltherapiesicherheit in Deutschland [in German]. www.akdae.de/AMTS/Aktionsplan/index.html. Accessed 08 Jul 2019.
Prgomet M, Li L, Niazkhani Z, Georgiou A, Westbrook JI. Impact of commercial computerized provider order entry (CPOE) and clinical decision support systems (CDSSs) on medication errors, length of stay, and mortality in intensive care units: a systematic review and meta-analysis. J Am Med Inform Assoc. 2017;24:413–22.
Varghese J, Kleine M, Gessner SI, Sandmann S, Dugas M. Effects of computerized decision support system implementations on patient outcomes in inpatient care: a systematic review. J Am Med Inform Assoc. 2017;0:1–10.
Carnovale C, Mazhar F, Pozzi M, Gentili M, Clementi E, Radice S. A characterization and disproportionality analysis of medication error related adverse events reported to the FAERS database. Expert Opin Drug Saf. 2018;17:1161–9.
Morrison M, Cope V, Murray M. The underreporting of medication errors: a retrospective and comparative root cause analysis in an acute mental health unit over a 3-year period. Int J Ment Health Nurs. 2018;27:1719–28.
Alatawi YM, Hansen RA. Empirical estimation of under-reporting in the U.S. Food and Drug Administration adverse event reporting system (FAERS). Expert Opin Drug Saf. 2017;16:761–7.
Dubrall D, Schmid M, Alešik E, Paeschke N, Stingl J, Sachs B. Frequent adverse drug reactions, and medication groups under suspicion—a descriptive analysis based on spontaneous reports to the German Federal Institute for Drugs and Medical Devices from 1978–2016. Dtsch Arztebl Int. 2018;115:393–400.
German Institute for Medical Documentation and Information (DIMDI): ICD-10, German Modification (ICD-10-GM). https://www.dimdi.de/dynamic/de/klassifikationen/icd/icd-10-gm/. Accessed 08 Jul 2019.
Hodgkinson MR, Dirnbauer NJ, Larmour I. Identification of adverse drug reactions using the ICD-10 Australian modification clinical coding surveillance. J Pharm Pract Res. 2009;39:19–23.
Hohl CM, Karpov A, Reddekopp L, Doyle-Waters M, Stausberg J. ICD-10 codes used to identify adverse drug events in administrative data: a systematic review. J Am Med Inform Assoc. 2014;21:547–57.
Hougland P, Xu W, Pickard S, Masheter C, Williams SD. Performance of international classification of diseases, 9th revision, clinical modification codes as an adverse drug event surveillance system. Med Care. 2006;44:629–36.
Kuklik N, Stausberg J, Jöckel KH. Adverse drug events in German hospital routine data: a validation of international classification of diseases, 10th revision (ICD-10) diagnostic codes. PLoS One. 2017;12:e0187510.
Hohl CM, Kuramoto L, Yu E, Rogula B, Stausberg J, Sobolev B. Evaluating adverse drug event reporting in administrative data from emergency departments: a validation study. BMC Health Serv Res. 2013;13:473.
World Health Organization (WHO): Conceptual Framework for the International Classification for Patient Safety 2009. www.who.int/patientsafety/taxonomy/icps_full_report.pdf. Accessed 08 Jul 2019.
Dequito AB, Mol PG, van Doormaal JE, Zaal RJ, van den Bemt PM, Haaijer-Ruskamp FM, et al. Preventable and non-preventable adverse drug events in hospitalized patients: a prospective chart review in the Netherlands. Drug Saf. 2011;34:1089–100.
Stausberg J, Hasford J. Drug-related admissions and hospital-acquired adverse drug events in Germany: a longitudinal analysis from 2003 to 2007 of ICD-10-coded routine data. BMC Health Serv Res. 2011;11:134.
National Coordinating Council for Medication Error Reporting and Prevention (NCC-MERP): Taxonomy of Medication Errors. www.nccmerp.org/sites/default/files/taxonomy2001-07-31.pdf. Accessed 08 Jul 2019.
Davies EC, Green CF, Taylor S, Williamson PR, Mottram DR, Pirmohamed M. Adverse drug reactions in hospital in-patients: a prospective analysis of 3695 patient-episodes. PLoS One. 2009;4:e4439.
Ducharme MM, Boothby LA. Analysis of adverse drug reactions for preventability. Int J Clin Pract. 2007;61:157–61.
Hubertus J, Piehlmeier W, Heinrich M. Communicating the improvements developed from critical incident reports is an essential part of CIRS. Klin Padiatr. 2016;228:270–4.
Leotsakos A, Zheng H, Croteau R, Loeb JM, Sherman H, Hoffman C, et al. Standardization in patient safety: the WHO high 5s project. Int J Qual Health Care. 2014;26:109–16.
'Aus der UAW-Datenbank' - Nebenwirkungen durch Medikationsfehler [in German]. Dtsch Arztebl 2016; 113: A-1948/B-1636/C-1624.
Lee J, Noh Y, Lee S. Evaluation of preventable adverse drug reactions by implementation of the nationwide network of prospective drug utilization review program in Korea. PLoS One. 2018;13:e0195434.
Amelung S, Meid AD, Nafe M, Thalheimer M, Hoppe-Tichy T, Haefeli WE, et al. Association of preventable adverse drug events with inpatients' length of stay-a propensity-matched cohort study. Int J Clin Pract. 2017;71:e12990.
Hoffmann W, Latza U, Terschuren C, GSf E. Guidelines and recommendations for ensuring good epidemiological practice (GEP) -- revised version after evaluation. Gesundheitswesen. 2005;67:217–25.
The authors thank the participating hospitals for providing the routine data and for performing the chart review.
The work was funded by the Federal Ministry of Education and Research (BMBF, funding code 01GY1328). This authority played no role in the collection, analysis and interpretation of the data or in the decision to submit the manuscript for publication.
Ethics approval and consent to participate
The study was conducted in accordance with national law and the 1964 Helsinki declaration and its later amendments, and according to the recommendations of the guidelines on Good Epidemiological Practice . Ethical approval was given by the institutional review board of the University Duisburg-Essen.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Kuklik, N., Stausberg, J., Amiri, M. et al. Improving drug safety in hospitals: a retrospective study on the potential of adverse drug events coded in routine data. BMC Health Serv Res 19, 555 (2019). https://doi.org/10.1186/s12913-019-4381-x
- Routine data
- Adverse drug event
- Medication error
- Drug safety