The Swiss cheese model of safety incidents: are there holes in the metaphor?
© Perneger; licensee BioMed Central Ltd. 2005
Received: 02 August 2005
Accepted: 09 November 2005
Published: 09 November 2005
Reason's Swiss cheese model has become the dominant paradigm for analysing medical errors and patient safety incidents. The aim of this study was to determine if the components of the model are understood in the same way by quality and safety professionals.
Survey of a volunteer sample of persons who claimed familiarity with the model, recruited at a conference on quality in health care, and on the internet through quality-related websites. The questionnaire proposed several interpretations of components of the Swiss cheese model: a) slice of cheese, b) hole, c) arrow, d) active error, e) how to make the system safer. Eleven interpretations were compatible with this author's interpretation of the model, 12 were not.
Eighty five respondents stated that they were very or quite familiar with the model. They gave on average 15.3 (SD 2.3, range 10 to 21) "correct" answers out of 23 (66.5%) – significantly more than 11.5 "correct" answers that would expected by chance (p < 0.001). Respondents gave on average 2.4 "correct" answers regarding the slice of cheese (out of 4), 2.7 "correct" answers about holes (out of 5), 2.8 "correct" answers about the arrow (out of 4), 3.3 "correct" answers about the active error (out of 5), and 4.1 "correct" answers about improving safety (out of 5).
The interpretations of specific features of the Swiss cheese model varied considerably among quality and safety professionals. Reaching consensus about concepts of patient safety requires further work.
The Swiss cheese model is frequently referred to and widely accepted by patient safety professionals. This was summarised by safety expert Ronald Westrum in a testimony before a United States Advisory Committee on Blood Safety and Availability on April 25, 2000 :
"Reason's model has become the common language through which complex accidents can be understood. I remember being at one conference where six speakers in a row got up and showed Swiss cheese diagrams as a kind of academic overkill. The popularity of this model obviously comes from its wide application. It's generally felt, as I said, this provides a common ground for discussing system safety."
There is no clear evidence, however, that the Swiss cheese metaphor is understood in the same way by all concerned. In this study, I explored the understanding of the Swiss cheese model by professionals who work in healthcare quality improvement.
Samples and data collection
The data for this cross-sectional survey came from two sources: paper questionnaires filled by conference delegates, and online questionnaires. A self-completed questionnaire ("the Swiss cheese quiz") was handed out to attendees of the 20th conference of the International Society for Quality in Health Care (Amsterdam, October 19–22, 2004), at the booth of the International Journal for Quality in Health Care. Completed questionnaires were collected in a ballot box. The same questionnaire was also posted on the internet . Links to this site were placed on the access page of the International Journal for Quality in Health Care and the home page of the International Society for Quality in Health Care between November 2004 and January 2005.
Interpretation of the Swiss cheese model of medical error by 85 professionals who claimed to be fairly or very familiar with the model.
Compatibility with Swiss cheese model
N (%) endorsing statement
Percent "correct" answers
In your opinion, what does a slice of cheese represent?
A health care professional
A barrier that protects patients from harm
A root cause of an error
A procedure that alleviates the consequences of an error
A defence that prevents the occurrence of an error
In your opinion, what does a hole represent?
A latent error1
A loss (in terms of health or money) due to an error
An opportunity for error
A weakness in defences against error
An unsafe act
What does the arrow represent?
The patient's trajectory through the health care system
A transfer of energy that injures a patient
The transformation of a latent error1 into an active error2
The series of events leading to a medical error
The path from hazard to patient harm
How or where is an active error represented on this figure?
At the base (origin) of the arrow
At the tip of the arrow
As one of the holes
As the arrow itself
As the alignment of holes
How can we make the health care system safer, using the "Swiss cheese" metaphor?
By adding a slice of cheese
By removing a slice of cheese
By plugging a hole
By adding a hole
By making all slices thinner
Because the goal was to explore the understanding of respondents who believed that they knew the model, only respondents who said they were "very much" or "quite a bit" familiar with the model were analysed. There was no statistically significant difference between those who filled the questionnaire at the conference and those who filled it online, thus the samples were pooled for the analysis.
The analysis consisted of simple frequencies of endorsement for each proposed answer. Endorsement of an item that was compatible with Reason's model according to the author, and non-endorsement of an incompatible item, were treated as "correct" answers. Sums of endorsed compatible and incompatible items were computed, as well as the number of "correct" answers out of 23. The two ambiguous items were left out of this analysis.
Forty-eight usable questionnaires were collected at the conference (4 others were incomplete), and 111 on the internet (11 others were empty, duplicated, only partially filled, included only "I have no idea" answers, or had all answer options checked). Eighty-five respondents (53.5%) stated that they were "very" (N = 45) or "quite" (N = 40) familiar with the Swiss cheese model. Only these respondents are reported on in the analyses.
Participants were 44 years old on average (SD 9, range 25 to 70, 5 missing), and comprised 42 women and 42 men (1 missing), from 31 countries representing all continents. Most job titles were in health care policy and quality management, but respondents included also health care professionals (doctors, nurses and pharmacists) and academic researchers. Sixty-three (74.1%) respondents had worked in quality management in the past 5 years, 31 (36.9%) in risk management, and 19 (22.6%) in safety science (several answers were allowed; one person did not answer).
Most respondents thought that the Swiss cheese model was "very useful" (44, 51.8%) or "quite useful" (32, 37.6%). At the end of the questionnaire, 9 (10.7%) rated themselves as very knowledgeable about patient safety, 63 (75.0%) as quite knowledgeable, and 12 (14.3) as only a little knowledgeable.
Interpretation of the model
Respondents endorsed on average 5.3 of 11 statements that were compatible with the Swiss cheese model (SD 2.2, range 1 to 10), and 2.0 of the 12 statements that were incompatible (SD 1.7, range 0 to 9). The mean number of "correct" answers was 15.3 (SD 2.3, range 10 to 21) out of 23 (66.5%). This was significantly more than 11.5 "correct" answers that would expected if answers were given at random (p < 0.001). Respondents gave on average 2.4 "correct" answers regarding the slice of cheese (out of 4), 2.7 "correct" answers about the holes (out of 5), 2.8 "correct" answers about the arrow (out of 4), 3.3 "correct" answers about the active error (out of 5), and 4.1 "correct" answers about improving safety (out of 5). None of the following variables were associated with the mean number of "correct" answers: sex, age, previous experience in quality management, risk management or safety science, familiarity with the model (very familiar versus quite familiar), perceived usefulness of the model, and knowledge of patient safety.
Most respondents interpreted the slice of cheese as intended by J. Reason (barrier that protects patients from harm), and inferred correctly that this would include a defence that prevents the occurrence of an error (Table 1). However, only few recognised that procedures that alleviate consequences of an error may also appear as barriers. Majorities interpreted a hole as suggested by Reason – a weakness in defences, but only few respondents understood that a hole is either a latent error or an unsafe act. The most obvious interpretation of the arrow (path from hazard to harm) was chosen by only half of the respondents. The majority choice (series of events leading to an error) is not entirely correct, as it is patient harm, not an error, that is represented by Reason at the tip of the arrow (however, the error may be equivalent to patient harm, as in wrong site surgery). Only three out of ten respondents identified correctly an active error as one of the holes. Making the system safer by plugging a hole was correctly selected by most respondents, but the solution of adding a barrier (a slice of cheese) was not.
This survey shows that among quality improvement professionals, the meaning of the Swiss cheese model of medical error is far from univocal. On average, respondents gave answers that were compatible with the model to about two thirds of the proposed statements. This is better than half – the proportion that would be expected by chance – but far from a general consensus. This suggests that invoking the Swiss cheese model will not necessarily lead to effective communication, even among quality and safety professionals.
There was substantial variability among respondents as to what the various features of the model represent. The murkiest notion appeared to be the representation of the medical error itself. Few of the respondents recognised that an active error is a type of weakness in defences against patient harm within the health care system, represented by a hole in the Swiss cheese model (a "hole" is either an active or a latent error). The model is almost too successful in placing emphasis on systemic causes of patient harm, as opposed to an individual's failure.
While no model ever claims to represent fairly a complex reality, it is possible that the latest rendition of the Swiss cheese model has become too simplified to remain effective in promoting patient safety. More realistic alternatives include the model of 1995 (Figure 3), which clearly separates the event, or accident, from patient harm, and has remained in use , and that of 1997 (Figure 4), which suggests that the occurrence of a system failure cannot be easily represented by a simple linear sequence. In this Reason's model rejoins Haddon's matrix, a successful epidemiologic model for investigating injuries . The relevance of Haddon's matrix for investigating medical mishaps has been recognised by others . The integration of Reason's and Haddon's models may be a worthwhile next step toward a comprehensive model of patient safety.
More generally, the diversity of views documented in this study raises questions about the current status of a "culture of safety" among quality and safety professionals. A culture is a set of values, concepts and beliefs that are shared by a social group [12, 13]. The Swiss cheese model is the leading candidate for a common understanding of how harmful events occur and how they can be prevented. Until most or all actors agree on what the model means, the emergence and dissemination of a shared culture of safety may prove difficult. The danger is that people today use the label "Swiss cheese model" without realising that its meaning varies from one person to the next.
This study has several limitations. The main concern is that the sample of respondents was self-selected, and may not represent fairly the broader community of patient safety and healthcare quality professionals. It is likely that those who were most interested and most knowledgeable about patient safety are over-represented among participants. Secondly, it is possible that respondents misrepresented their level of familiarity with the model, and that results would have been better among true experts. Nevertheless, the discrepancy between self-perceived familiarity with the model and variable interpretations of the model features is striking. Finally, the questionnaire was developed ad hoc, and its reliability and validity are untested.
In summary, this study has shown that quality and safety professionals vary considerably in their interpretation of various components of the Swiss cheese model applied to medical mishaps. This finding echoes the variability in interpretation that exists even for basic terms of patient safety, such as "incident," "error," "mishap," etc. . Recent proposals of a comprehensive taxonomy of patient safety illustrate the necessity of a global conceptual model . Good models and clear concepts are required for a common terminology, and a common terminology is a pre-requisite for effective communication and progress in the field of patient safety.
Maria-Julia Stonborough and Paul Kidd helped with data collection. Vincent Baujard created the online version of the questionnaire. No specific funding was obtained for this study.
- Reason J: Human error: models and management. BMJ. 2000, 320: 768-70. 10.1136/bmj.320.7237.768.View ArticlePubMedPubMed CentralGoogle Scholar
- Reason J: Human Error. 1990, Cambridge: Cambridge University PressView ArticleGoogle Scholar
- Reason J: Understanding adverse events: human factors. Qual Health Care. 1995, 4: 80-89.View ArticlePubMedPubMed CentralGoogle Scholar
- Reason J: Managing the Risks of Organizational Accidents. 1997, Aldershot, UK: AshgateGoogle Scholar
- Reason JT, Carthey J, de Leval MR: Diagnosing "vulnerable system syndrome": an essential prerequisite to effective risk management. Qual Health Care. 2001, 10 (Suppl II): ii21-5.PubMedPubMed CentralGoogle Scholar
- United States Department of Health and Human Services. Blood Safety Transcripts. Advisory Committee on Blood Safety and Availability, 11th meeting. Accessed on October 22, 2005, [http://www.hhs.gov/bloodsafety/transcripts/20000425.html]
- Swiss Cheese Quiz. Accessed on October 22, 2005, [http://184.108.40.206/ICQ/]
- Layde PM, Cortes LM, Teret SP, Brasel KJ, Kuhn EM, Mercy JA, Hargarten SW, Maas LA: Patient safety efforts should focus on medical injuries. JAMA. 2002, 287: 1993-7. 10.1001/jama.287.15.1993.View ArticlePubMedGoogle Scholar
- McNutt RA, Abrams R, Arons DC, Patient Safety Committee: Patient safety efforts should focus on medical errors. JAMA. 2002, 287: 1997-2001. 10.1001/jama.287.15.1997.View ArticlePubMedGoogle Scholar
- Vincent C, Taylor-Adams S, Chapman EJ, Hewett D, Prior S, Strange P, Tizzard A: How to investigate and analyse clinical incidents: Clinical Risk Unit and Association of Litigation and Risk Management protocol. BMJ. 2000, 320: 777-81. 10.1136/bmj.320.7237.777.View ArticlePubMedPubMed CentralGoogle Scholar
- Haddon W: A logical framework for categorizing highway safety phenomena and activity. J Trauma. 1972, 12: 193-207.View ArticlePubMedGoogle Scholar
- Hudelson PM: Culture and quality: an anthropological perspective. Int J Qual Health Care. 2004, 16: 345-6. 10.1093/intqhc/mzh076.View ArticlePubMedGoogle Scholar
- Westrum R: A typology of organisational cultures. Qual Saf Health Care. 2004, 13 (Suppl 2): ii22-ii27. 10.1136/qshc.2003.009522.PubMedPubMed CentralGoogle Scholar
- Weingart SN: Beyond Babel: prospects for a universal patient safety taxonomy. Int J Qual Health Care. 2005, 17: 93-4. 10.1093/intqhc/mzi029.View ArticlePubMedGoogle Scholar
- Chang A, Schyve PM, Croteau RJ, O'Leary DS, Loeb JM: The JCAHO patient safety event taxonomy: a standardized terminology and classification schema for near misses and adverse events. Int J Qual Health Care. 2005, 17: 95-105. 10.1093/intqhc/mzi021.View ArticlePubMedGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1472-6963/5/71/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.