Hospital deaths and adverse events in Brazil
© Martins et al; licensee BioMed Central Ltd. 2011
Received: 28 February 2011
Accepted: 19 September 2011
Published: 19 September 2011
Adverse events are considered a major international problem related to the performance of health systems. Evaluating the occurrence of adverse events involves, as any other outcome measure, determining the extent to which the observed differences can be attributed to the patient's risk factors or to variations in the treatment process, and this in turn highlights the importance of measuring differences in the severity of the cases. The current study aims to evaluate the association between deaths and adverse events, adjusted according to patient risk factors.
The study is based on a random sample of 1103 patient charts from hospitalizations in the year 2003 in 3 teaching hospitals in the state of Rio de Janeiro, Brazil. The methodology involved a retrospective review of patient charts in two stages - screening phase and evaluation phase. Logistic regression was used to evaluate the relationship between hospital deaths and adverse events.
The overall mortality rate was 8.5%, while the rate related to the occurrence of an adverse event was 2.9% (32/1103) and that related to preventable adverse events was 2.3% (25/1103). Among the 94 deaths analyzed, 34% were related to cases involving adverse events, and 26.6% of deaths occurred in cases whose adverse events were considered preventable. The models tested showed good discriminatory capacity. The unadjusted odds ratio (OR 11.43) and the odds ratio adjusted for patient risk factors (OR 8.23) between death and preventable adverse event were high.
Despite discussions in the literature regarding the limitations of evaluating preventable adverse events based on peer review, the results presented here emphasize that adverse events are not only prevalent, but are associated with serious harm and even death. These results also highlight the importance of risk adjustment and multivariate models in the study of adverse events.
The occurrence of adverse events is considered a serious problem worldwide regarding the performance of health services . A report by the United States Institute of Medicine called attention to the fact that the mortality rate due to adverse events was higher than that attributed to some of the principal causes of mortality, such as motor vehicle accidents, breast cancer, and AIDS . Studies have indicated that approximately 10% of the incidence of adverse events are related to hospital care, and it is estimated that 4.4% to 20.8% of adverse events lead to patient death [3, 4].
The concept of adverse event is related to the occurrence of harm or injury caused by medical care rather than by the underlying disease . Thus, assessing the occurrence of an adverse event involves distinguishing between undesirable results caused by problems in the quality of care and those resulting from the patient's inherent risk factors and the severity of the case, which define the prognosis and odds of survival [6, 7]. A central concern in evaluating the outcomes of health care, especially regarding adverse events or hospital deaths, is the identification of preventable cases .
Sox et al  contrast the Institute of Medicine's estimate of deaths of hospitalized patients resulting from medical error  with the robustness of the methods used in this calculation. Their central argument is that the methodology involves peer review, characterized by a high degree of subjectivity in the assessment and low inter-reviewer reliability .
Few studies were carried out with the particular purpose of identifying an association between hospital deaths and adverse events [3, 4, 10, 11]. Generally, studies have focused on evaluating specific situations such as surgical cases and hospital infections [10, 12, 13]. Garcia-Martin et al  developed a case-control study to estimate the proportion of hospital deaths associated with adverse events. They found that the presence of at least one adverse event was significantly associated with an increased risk of death (OR = 1.75), and that 24% of deaths were associated with adverse events. A study carried out in the Netherlands  examined adverse events and preventable deaths using a specific sample of cases of death and found that, among the patients who died, 10.7% had suffered an adverse event, while preventable adverse events accounted for 4.1% of hospital deaths. Importantly, Hayward & Hofer  point to an overestimation of preventable deaths associated with good-quality care, since the majority of estimates overlooks the underlying prognostic factors of patients who died. Weingart et al  further highlight that risk is not homogeneous. Patients who are more severely ill, are subject to multiple interventions and remain hospitalized longer are more likely to suffer serious injury or harm as a result of medical error.
Considering the relevance of this theme and the lack of studies, especially in developing countries, this article has the objective to evaluate the relationship between hospital deaths and adverse events, adjusted for patient risk factors, in hospitalized patients in Brazil.
Study design and population
The data were obtained from a previous study on the incidence of adverse events in Brazilian hospitals that used retrospective chart review as the methodology [15, 16], based on the design and tools developed by Canadian researchers. According to the Canadian Adverse Event Study , an adverse event was defined as an unintended injury which results in temporary or permanent disability, including increased length of stay caused by clinical care rather than disease process. Preventability refers to an adverse event resulting from an error or series of errors, either negligent or non-negligent, or failure.
Patient charts were reviewed in two stages: (1) screening of potential adverse events by nurses and (2) identification of adverse events by physicians. The screening stage was based on the presence of at least one of 18 previously established screening criteria (trigger tools). Death was one of the 18 triggers, so all the deaths were selected for the second stage. Based on evidence in each patient's chart, the second stage of evaluation confirmed (or disproved) the occurrence of an adverse event and its preventability. Six-point scales were used, and results greater than or equal to 4 were defined as confirming the presence of an adverse event and its preventability. The assessment of preventable adverse events was based on subjective and implicit criteria, backed by the expertise, practical experience and clinical decision-making of physicians . The assumption was that a preventable adverse event results from poor quality in the process of care or problems in the health system.
In the present study, 1103 patient charts were selected by means of simple random sampling out of 27,350 adult patients admitted between January 1st, 2003, and December 31st, 2003, to 3 general teaching hospitals in the state of Rio de Janeiro, Brazil. Two of the hospitals have emergency departments and maternity wards. The hospitals were selected based on their voluntary willingness to collaborate and the degree of excellence in their areas of expertise.
Following the Canadian study , the exclusion criteria were patients under 18 years of age, patients who remained hospitalized for less than 24 hours, and psychiatric patients. However, unlike the Canadian study, obstetric cases were included in the sample in face of the persistently high maternal mortality rate in Brazil. The random sample process was applied to each hospital. The parameters used to define the sample size were also based on the Canadian study: a 10% expected incidence of patients with adverse events (maximum absolute error -3%), a 50% proportion of potential adverse events, and a significance level of 5%. The loss rate was estimated at 10%, and the rate of ineligible patients was estimated at 20% .
The analysis of the relationship between deaths and adverse events assumed that patient characteristics associated with case severity are important confounding factors. In order to identify the variables associated with the risk of death in the study population, we conducted univariate and bivariate analyses using variables related to demographic and clinical patient characteristics and to the hospitalization, including type of admission (elective, urgency, and emergency), specialty (obstetrics versus non-obstetrics), procedure performed, and length of stay. Patients' social variables were not analyzed due to the high percentage of missing information.
Multiple logistic regression was used to analyze factors associated with death in the selected cases. The dichotomous dependent variable was death (yes/no). Only deaths that occurred during the hospital stay were analyzed. The following steps were applied for modeling: (1) baseline model; (2) introduction of the variables related to the process of care: clinical specialty (obstetrics: yes/no), length of stay (continuous variable), and performance of a surgical or invasive procedure (yes/no); (3) introduction of the occurrence of an adverse event.
The initial baseline model (model 1) was constructed to adjust for patient risk factors, since the prognosis depends on patient attributes that indicate the severity of the case. The baseline model consisted of the following independent variables: age, gender, primary diagnosis, secondary diagnoses (comorbidities), and type of admission. Age was treated as a categorical variable, where younger than 50 years of age was the reference category, and patients older than 79 were grouped due to the small number of cases. Gender, treated as a dichotomous variable, used the male gender as the reference category. This variable was maintained in the model for theoretical reasons, although it has not shown to be of statistical significance.
The primary diagnosis of patients is an essential dimension for risk adjustment, but specific reasons for admission were not considered due to the wide range of diagnostic categories identified and the low number of cases in each category. As a strategy to control severity, the Charlson index  was applied to the primary diagnosis. The variable with the Charlson index score for the primary diagnosis was treated as a dichotomous variable, where the reference category was a score equal to 0.
The Charlson index  was also applied to the 6 reported secondary diagnoses and was the fourth independent variable introduced into the baseline model. This index was treated as a categorical variable. According to the frequency distribution, the categories for this index were regrouped as follows: (1) score 0 (reference category); (2) score 1; and (3) score greater than or equal to 2. We used the algorithm developed by Quan et al  to translate the clinical conditions from the Charlson index  to the International Classification of Diseases, 10th Revision (ICD-10).
Type of admission was the last variable included in the baseline model, since unplanned admissions (emergencies) generally entail greater risk of death than planned (elective) admissions . Type of admission was treated as a dichotomous variable with 2 groups, where elective admissions constituted the reference category.
Variables related to the process of care - length of stay, surgical or invasive procedure performed, and specialty - were also tested (model 2). Length of stay was treated as a continuous variable. The reference categories for procedures performed and specialty were no procedure performed and obstetrics, respectively. These variables were subsequently excluded because they lacked statistical significance.
The occurrence of an adverse event, including its preventability, was the main independent variable for measuring whether this event represented a risk factor associated with the worsening of patient prognosis and an adverse outcome (death). It was included in the third modeling step (final model). The occurrence of adverse events was treated as a categorical variable, and the categories were grouped as follows: (1) no adverse events (reference category); (2) no preventable adverse events; and (3) preventable adverse events. The cases of adverse events are described in the Additional File 1: Appendix.
We tested the impact of the introduction of each variable on the model's performance, starting from the baseline model. The adequacy of the model for predicting death was assessed according to the percentage of improvement in the model as compared to the initial deviance (likelihood χ2), C statistics, and Hosmer-Lemeshow test. The statistical analyses were processed with SPSS 17.0. This study was approved by the Ethics Committee of the Oswaldo Cruz Foundation, protocol 271/05.
Study population characteristics: sampled admissions and deaths
Number of cases (% of total)
Mean age in years (SD)
Age bracket (%)
Record of 1 secondary diagnosis (%)
Record of 2 secondary diagnoses (%)
Record of 6 secondary diagnoses (%)
Charlson index (% by score)
Type of admission (%)
Procedure performed (%)
Length of stay (days)
Number of patients (% of total)
Preventable adverse event
Number of patients (% of total)
25 (26.6) **
Non-preventable adverse event
Number of patients (% of total)
7 (7.5) **
Measures of association between death and patient characteristics, process of care, preventable and non-preventable adverse events
Number of cases
Number of deaths
Measure of association
OR 0.55 (95% CI: 0.36-0.84)
(p < 0.005)
R = -0.08
χ2 63.380; 4 df, p < 0.000
Somers' D 0.11, p < 0.000
R = 0.24
Charlson index (score)
OR 3.96 (95% CI: 2.54-6.16)
(p < 0.000)
R = 0.20
χ2 46.200; 2 df, p < 0.000
Somers' D 0,12, p < 0.000
R = 0.20
Type of admission
OR 5.14 (95% CI: 02.89-9.20)
(p < 0.000)
R = 0.18
OR 0.79 (95% CI: 0.76-0.81)
p < 0.000
R = 0.15
OR 0.74 (95% CI: 0.46-1.19)
(p > 0.209)
R = -0.04
OR 9.50 (95% CI: 5.71-15.82) (p < 0.000)
R = 0.30
Preventable adverse event
OR 11.43 (95% CI: 6.40-20.43) (p < 0.000)
R = 0.30
The overall hospital mortality rate was 8.5%, but this rate increased to 38.1% in the subset of cases with the occurrence of an adverse event, and to 44.6% in the subset of cases with a preventable adverse event (Table 2). The correlation between death and adverse event showed a statistically significant association, with odds ratio of 9.50 (Table 2). There was also a significant association between death and preventable adverse event, with an even higher odds ratio (11.43). The mortality rate related to adverse events was 2.9% (32/1103), while that related to preventable adverse events was 2.3% (25/1103).
The mean length of stay, which may reflect a consequence of the adverse event and the severity of the case, was 25.1 days in cases with a fatal outcome (SD: 33.4; 95% CI: 18.3-32.0 days), more than twice as much as cases without death (11.1 days - SD: 22.2; 95% CI: 9.7-12.5 days). A similar pattern emerged when comparing cases with and without an adverse event: the mean length of stay tripled in cases with adverse events (32.4 days - SD: 36.0; 95% CI: 24.6-40.2 days) compared to those without adverse events (10.6 days - SD: 21.5; 95% CI: 9.3-12.0 days).
Discriminatory capacity and adjustment of models for predicting death
χ2 of Model*
Hosmer-Lemeshow χ2 test
1. Baseline model**:
(df 9, sig. 0.000)
2. Baseline model + Length of stay***
(df 10, sig. 0.000)
3. Final model: Model 2 + Occurrence of adverse event ****
(df 12, sig. 0.000)
Logistic regression for prediction of hospital death: baseline model and final model
Age bracket (years)
Primary diagnosis (Charlson index ≥ 1)
Secondary diagnoses (Charlson index)
Urgency and emergency admissions
Age bracket (years)
Primary diagnosis (Charlson index ≥ 1)
Secondary diagnoses (Charlson index)
Urgency and emergency admissions
Length of stay
Occurrence of adverse event
The occurrence of adverse events was examined as a factor associated with risk of death adjusted by case severity. The overall mortality rate in the study population was 8.5%; 2.9% had adverse events and 2.3% had preventable adverse events. The logistic regression models tested in order to evaluate the relationship between hospital death and adverse event, adjusted according to patient risk, showed good discrimination capacity . The unadjusted odds ratio between death and preventable adverse event was high (OR 11.43), while the risk of dying adjusted for patient risk factors decreased to 8.23, but remained high. The relationship between death and non-preventable adverse event, i.e. complications due to the complexity of the case, showed an even high adjusted odds ratio (OR 6.25).
More than ten years ago, Hayward & Hofer [8, 22] highlighted the fact that estimates on the relationship between death and adverse event failed to consider patient risk factors in the analysis. In the present study, using logistic regression for risk adjustment, it can be seen that older patients have higher odds of dying. However, it appears that part of this risk is related to the occurrence of adverse events. This point demonstrates the difficulty of isolating the effect of each factor. It seems that this kind of association is much more synergic and involves patient risk factors, the process of care, non-preventable complications, and even preventable adverse events. Nevertheless, 50-59 year-old patients in our study presented a slight increase in death risk after the occurrence of adverse events was included.
Despite discussions in the literature on the methodological limitations of the evaluation of preventable adverse events based on peer review [8, 10, 22, 23], the findings presented here emphasize not only that adverse events are prevalent but that preventable adverse events are associated with serious and irreversible harm, and even death. Notwithstanding differences in the study design, the adjusted odds ratio obtained here was much higher than that described by Garcia-Martin et al , who reported 1.75. According to Zegers et al , 10.7% of deaths among patients in the Netherlands were associated with an adverse event, while in our study this proportion was much higher (34%). In our study, cases involving preventable adverse events accounted for 26.6% of the deaths, while in the Dutch study the proportion was only 4.1% of hospital deaths . These findings indicate an increased risk of serious adverse events among Brazilian patients.
Principal study limitations
It is important to acknowledge that the findings may be related to the characteristics of the study design and the study population. Importantly, the study population was limited to admissions to 3 public teaching hospitals in a single state of Brazil, which could partially explain the results. Hospital characteristics minimize the generalization capacity of the study. Brazil has more than 5,000 hospitals; they are heterogeneous in terms of facilities, human resources, and quality of care. Since the selected hospitals have adequate medical records and develop training activities, among others factors, the results presented are probably better in these hospitals than in many others. Therefore, we consider that the numbers obtained could be underestimated for the Brazilian reality.
Primary diagnosis is an important dimension of case severity and a determinant in the process and quality of care, and thus is correlated with the occurrence of adverse events and deaths . Because of the low number of cases in specific diagnostic categories, we opted to apply the Charlson index , without the respective weights, as indicative of the severity associated with the principal reason for admission. Despite the difficulty of interpreting the relationship between length of stay and death, case severity, and characteristics of the health service system , the length of stay variable, expressing severity and characteristics of the process of care, remained in the final model.
In the context of health care, the evaluation of any outcome measure involves determining the extent to which the observed differences can be attributed to patient risk factors or to the various treatment processes . This highlights the importance of measuring differences in the severity of cases in studies about adverse events.
Despite some limitations in the study design and analytical strategy, we observed a correlation between the occurrence of adverse events and the risk of hospital death; this association was higher when the preventability of the adverse event was considered. However, the vast majority of preventable events with fatal outcomes occurred in cases classified as level 4 in the judgment scale, and very few cases (4/25 deaths) were classified as levels with greater certainty. This point corroborates the limitations identified by Hayward & Hofer , i.e., that studies based on peer review are characterized by a high degree of subjectivity in the judgment of the reviewers. Even so, we feel that the current study, which includes the use of risk adjustment and multivariate models, represents an important step in the evaluation of the occurrence of adverse events. Its future developments can contribute to specific interventions and to further studies focused on improving clinical performance in hospitals [25, 26], particularly considering the issue of patient safety and quality of care as part of Brazil's national healthcare agenda.
International Classification of Diseases, 10th Revision
Statistical Package for the Social Sciences
Fundação Carlos Chagas Filho de Amparo à Pesquisa do Estado do Rio de Janeiro (FAPERJ), Brazil - Grant: E-26/100.668/2007.
- Jha AK, Prasopa-Plaizier M, Larizgoitia I, Bates D: Patient safety research: an overview of the global evidence. Qual Saf Health Care. 2010, 19: 42-47. 10.1136/qshc.2008.029165.View ArticlePubMedGoogle Scholar
- Kohn LT, Corrigan JM, Donaldson MS, McKay T, Pike KC: To err is human. 2000, Washington, DC: National Academy PressGoogle Scholar
- Zegers M, Bruijne MC, Wagner C, Hoonhout LHF, Waaijman R, Smits M, et al: Adverse events and potentially preventable deaths in Dutch hospitals: results of a retrospective patient record review study. Qual Saf Health Care. 2009, 18: 297-302. 10.1136/qshc.2007.025924.View ArticlePubMedGoogle Scholar
- De Vries EN, Ramrattan MA, Smorenburg SM, Gouma DJ, Boermeester MA: The incidence and nature of in-hospital adverse events: a systematic review. Quality and Safety on Health Care. 2008, 17: 216-223. 10.1136/qshc.2007.023622.View ArticleGoogle Scholar
- Leape LL, Brennan TA, Laird N, Lawthers AG, Localio AR, Barnes BA, et al: The nature of adverse events in hospitalized patients. Results of the Harvard Medical Practice Study II. New England Journal of Medicine. 1991, 324: 377-84. 10.1056/NEJM199102073240605.View ArticlePubMedGoogle Scholar
- Dubois RW, Brook RH: Preventable Deaths: who, how often, and why?. Ann Intern Med. 1988, 109 (7): 582-589.View ArticlePubMedGoogle Scholar
- Iezzoni L: Risk adjustment for measuring health care outcomes. 2003, Ann Arbor MI: Health Administration Press, thirdGoogle Scholar
- Sox HC, Woloshin S: How many deaths are due to medical error? Getting the number right. Effective Clinical Practice. 2000, 3 (6): 277-282.Google Scholar
- Hayward RA, Hofer TP: Estimating hospital deaths due to medical errors - Preventability in the eye of the reviewer. JAMA. 2001, 286 (4): 415-20. 10.1001/jama.286.4.415.View ArticlePubMedGoogle Scholar
- Marang-van de Mheen PJ, Hollander EJ, Kievit J: Effects of study methodology on adverse outcome occurrence and mortality. Int J Qual Health Care. 2007, 19: 399-406. 10.1093/intqhc/mzm039.View ArticlePubMedGoogle Scholar
- García-Martín M, Lardelli-Claret P, Bueno-Cavanillas A, Luna-del-Castillo JD, Espigares-García M, Gálvez-Vargas R: Proportion of Hospital Deaths Associated with Adverse Events. Journal of Clinical Epidemiology. 1997, 50 (12): 1319-1326. 10.1016/S0895-4356(97)00219-9.View ArticlePubMedGoogle Scholar
- Gawandee AA, Thomas EJ, Zinner MJ, Brennan TA: The incidence and nature of surgical adverse events in Colorado and Utah en 1992. Surgery. 1999, 126: 66-75. 10.1067/msy.1999.98664.View ArticleGoogle Scholar
- Kable AK, Gibberd RW, Spigelman AD: Adverse event in surgical patients in Australia. International Journal for Quality in Heath Care. 2002, 14 (4): 269-276. 10.1093/intqhc/14.4.269.View ArticleGoogle Scholar
- Weingart SN, Wilson R, Gibberd RW, Harrison B: Epidemiology of medical error. BMJ. 2000, 320: 774-777. 10.1136/bmj.320.7237.774.View ArticlePubMedPubMed CentralGoogle Scholar
- Mendes W, Travassos C, Martins M, Marques P: Adaptação dos instrumentos de avaliação de eventos adversos para uso em hospitais brasileiros. Rev Bras Epidemiologia. 2008, 11 (1): 55-66. 10.1590/S1415-790X2008000100005.View ArticleGoogle Scholar
- Mendes W, Martins M, Rozenfeld S, Travassos C: The assessment of adverse events in hospitals in Brazil. Int J Qual Health Care. 2009, 21: 279-84. 10.1093/intqhc/mzp022.View ArticlePubMedGoogle Scholar
- Baker GR, Norton PG, Flintoft V, Blais R, Brown A, Cox J, et al: The Canadian Adverse Events Study: the incidence of adverse events among hospital patients in Canada. Canadian Medical Association Journal. 2004, 170: 1678-86. 10.1503/cmaj.1040498.View ArticlePubMedPubMed CentralGoogle Scholar
- Donabedian A: An introduction to quality assurance in health care. 2003, Oxford: Oxford University PressGoogle Scholar
- Charlson ME, Pompei P, Ales KL, MacKenzie CR: A new method of classifying prognostic comorbidity in longitudinal studies: development and validation. Journal of Chronic Disease. 1987, 40: 373-383. 10.1016/0021-9681(87)90171-8.View ArticleGoogle Scholar
- Quan H, Sundarajan V, Halfon P, Fong A, Burnand B, Luthi J, Saunders LD, Beck CA, Feasby TE, Ghali WA: Coding algorithms for defining comorbidities in ICD-9-CM and ICD-10 administrative data. Medical Care. 2005, 43 (11): 1130-1139. 10.1097/01.mlr.0000182534.19832.83.View ArticlePubMedGoogle Scholar
- Aylin P, Bottle A, Majeed A: Use of administrative data or clinical databases as predictors of risk of death in hospital: comparison of models. BMJ. 2007, 334: 1044-10.1136/bmj.39168.496366.55.View ArticlePubMedPubMed CentralGoogle Scholar
- Hofer T, Hayward RA: What is an Error?. Effective Clinical Practice. 2000, 3 (6): 261-269.PubMedGoogle Scholar
- Hofer T, Bernstein S, DeMonner S, Hayward R: Discussion between Reviewers Does Not Improve Reliability of Peer Review of Hospital Quality. Medical Care. 2000, 38 (2): 152-161. 10.1097/00005650-200002000-00005.View ArticlePubMedGoogle Scholar
- Jenks SF, Williams DK, Kay TL: Assessing hospital associated deaths from discharge data: the role of length of stay and comorbidity. JAMA. 1988, 260 (5): 2240-2246. 10.1001/jama.260.15.2240.Google Scholar
- Bates D, Larizgoitia I, Plaizier NP, Jha AK, The Research Priority Setting Working Group of the WHO World Alliance for Patient Safety: Global priorities for patient safety research. BMJ. 2009, 338: 1775-10.1136/bmj.b1775.View ArticleGoogle Scholar
- Andermann A, Ginsburg L, Norton P, Arora N, Bates D, Wu A, Larizgoitia I, The Patient Safety Research Training and Education Expert Working Group of WHO Patient Safety: Core competencies for patient safety research: a cornerstone for global capacity strengthening. BMJ Qual Saf. 2011, 20: 96-101. 10.1136/bmjqs.2010.041814.View ArticlePubMedPubMed CentralGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1472-6963/11/223/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.