Patient safety culture lives in departments and wards: Multilevel partitioning of variance in patient safety culture
© Deilkås and Hofoss; licensee BioMed Central Ltd. 2010
Received: 14 July 2009
Accepted: 31 March 2010
Published: 31 March 2010
Aim of study was to document 1) that patient safety culture scores vary considerably by hospital department and ward, and 2) that much of the variation is across the lowest level organizational units: the wards. Setting of study: 500-bed Norwegian university hospital, September-December 2006.
Data collected from 1400 staff by (the Norwegian version of) the generic version of the Safety Attitudes Questionnaire (SAQ Short Form 2006). Multilevel analysis by MLwiN version 1.10.
Considerable parts of the score variations were at the ward and department levels. More organization level variation was seen at the ward level than at the department level.
Patient safety culture improvement efforts should not be limited to all-hospital interventions or interventions aimed at entire departments, but include involvement at the ward level, selectively aimed at low-scoring wards. Patient safety culture should be studied as closely to the patient as possible. There may be such a thing as "hospital safety culture" and the variance across hospital departments indicates the existence of department safety cultures. However, neglecting the study of patient safety culture at the ward level will mask important local variations. Safety culture research and improvement should not stop at the lowest formal level of the hospital (wards, out-patient clinics, ERs), but proceed to collect and analyze data on the micro-units within them.
Although the risk of harming patients is evident to most caregivers, eliminating or reducing risk has not always been the first priority of health care management. Management often takes the safety of patients for granted, and considers patient safety as the responsibility of caregivers honouring the guideline "primum non nocere".
Compared to other Scandinavian countries, Norway has only recently made patient safety a national health policy issue, following a series of non-governmental calls for action, most notably by professor emeritus Peter F. Hjort's 2004 policy suggestion  and 2007 textbook . In 2007 the Directorate of Health established a national unit for patient safety and in 2009 the Ministry of Health launched a national patient safety campaign.
Efforts to improve patient safety may follow several lines of action, including mortality-and-morbidity conferences, sentinel event scrutiny, restructuring of care delivery systems and safety culture surveys . Each strategy has its merits, and surveying safety culture is a useful option, not least because a common experience in patient safety improvement work is that interventions directed against specific causes of adverse events often result in only temporary improvement. One possible interpretation is that adverse events have multiple causes, and the quintessential explanation is the priority of safety reflected in the general patient safety culture of the unit in which the adverse events occur.
The aim of the study was to test the hypothesis that patient safety culture is a local phenomenon, implying that patient safety culture scores vary considerably by hospital department and ward, and that much of the variation is across the lowest level organizational units: the wards.
This study analyzes patient safety attitudes data on clinical staff at Akershus University Hospital. Responses of staff to a patient safety attitudes questionnaire were collected from October to December 2006. If our hypothesis was correct, we would expect to find considerable clustering of the safety attitude scores at the department and ward level, i.e. non-trivial-to-high intraclass correlation coefficients.
The study plans were presented to the Regional Ethical Committee for Medical Research in Eastern Norway for approval. The Committee decided the project did not require their approval as it did not involve collecting data on patients. The collection of data on clinical staff was approved by the proper government authority, the Norwegian Data Inspectorate.
Setting and participants
Akershus University Hospital is located just outside Oslo, the capital of Norway. In 2006 the hospital had 500 somatic and 200 psychiatric beds, 4200 employees, and an annual budget of 2.500.000.000 NOK (approximately 450 million USD). It is a general hospital with a wide variety of specialities, but it does not include an eye clinic and a geriatric department. In 2006 it served a population of 280 000 inhabitants of Northeast Oslo and the Northeastern part of the Oslo-surrounding county of Akershus. It treated 53.000 inpatients and had 150.000 outpatient consultations. Eighty-five percent of the inpatients were unscheduled emergency cases.
The questionnaire was distributed to all clinical staff (physicians, registered nurses, auxiliary nurses, radiographers, laboratory technicians, midwives, and clerical workers) at 45 somatic caregiving units - 27 wards, 14 outpatient service units, and four laboratories - of 10 clinical departments: emergency admissions, anesthesiology, surgery, operations, orthopedics, gynecology and obstetrics, pediatrics, internal medicine, neurology and ear-nose-throat.
The survey instrument used was (the Norwegian translation of) the Safety Attitudes Questionnaire (the SAQ) Short Form 2006. The original (American) version of the questionnaire is described by Sexton, Helmreich, Neilands et al. . The Norwegian version of the SAQ has 41 questions, of which 36 reflect seven patient safety culture dimensions: Team Climate, Safety Climate, Job Satisfaction, Stress Recognition, Perception of Unit Management, Perception of Hospital Management and Work Conditions. The items which reflect each dimension are listed in Deilkås & Hofoss , which also describes the development of the Norwegian version of the SAQ and the assessment of its psychometric properties.
The survey was carried out at the hospital's somatic clinical areas during October-December 2006.
The questionnaires, which took approximately 15-20 minutes to complete, were distributed and completed at regular staff meetings. Forms were to be completed anonymously and did not have an ID number which could be used to trace the responder. Employees who did not attend the staff meeting were sent their SAQs through the hospital's internal mail system. As the questionnaires were anonymous, we had no way of reminding non-responders, except for asking the ward and department heads to urge their staff to participate.
To calculate the factor scores, we reversed the scores on the negatively worded items (2 and 11). For each factor, the mean of the item scores was calculated. One was subtracted from each mean, and the result was multiplied by 25.
To partition the variation of the dimension scores by organization level, the seven patient safety culture scores were analyzed by MLwiN, a multilevel analysis program developed by the University of London's Institute of Education . The program is now being distributed and expanded by the University of Bristol's Centre for Multilevel Modelling . Multilevel analysis makes it possible to partition the total variance in each dimension score into variance across individual respondents (individual level variance), variance across wards (ward level variance) and variance across departments (department level variance). Analyzing the model which contains only the intercept (the data set's average patient safety attitudes score) and no explanatory variables - what is known as "the empty model"  - one can calculate the percentage of the total variance in patient safety attitudes scores that reside at the organizational level, that is, the percentage of the variance which is not score differences across individual responders, but across the organizational units.
Organization level variance by patient safety attitudes dimension
Dimension (all dimensions scaled 0-100)
Variance at individual level (% of total variance)
Variance at ward level (% of total variance)
Variance at department level (% of total variance)
ICC (ratio of organizational level variance to total variance)
(valid n: 1090)
(valid n: 984)
(valid n: 1036)
(valid n: 1024)
(valid n: 843)
Perception of Unit Management
(valid n: 949)
Perception of Hospital
Management (valid n: 904)
Organization level variance by patient safety attitudes dimension
-2LL of three-level Model
-2LL of two-level model (individuals & wards)
Change in -2LL when department level was removed from model
0,163 (n.s.: p > ,05)
5,532 (p < ,05)
5,533 (p < ,05)
3,125 (n.s.: p > ,05)
6,439 (p < ,01)
Perception of Unit Management
1,263 (n.s.: p > ,05)
Perception of Hospital Management
2,809 (n.s.: p > ,05)
All clinical staff, a total of 1911, were asked to complete the SAQ, and 1306 (68%) did. The response rate was higher among nurses, auxiliary nurses, midwives, laboratory technicians, radiographers, physiotherapists and other staff with less education (as compared to the physicians). Response rates were higher (98 percent) among those who received their SAQs at staff meetings. Further details on response rates are published in Deilkås & Hofoss .
As shown in Table 1 five of the seven patient safety dimension scores showed considerable variance at the organizational level. Except for Stress Recognition (ICC =,02) and Perception of Hospital Management (ICC =,07) all dimensions had ICCs of 14 percent or higher. The highest ICC value was for Perception of Unit Management (21 percent) and Teamwork Climate (19 percent). For the dimension Work Conditions, clustering was more pronounced at the department level than at the ward level. For the dimensions of Teamwork Climate, Safety Climate and Perception of Unit Management, clustering was more pronounced at the ward level.
As shown in Table 2, for four of the seven dimensions - Teamwork Climate, Stress Recognition, Perception of Unit Management and Perception of Hospital Management - the elimination of the department level from the model did not reduce the model's goodness-of-fit significantly, as measured by the change in the -2LL. For the remaining three dimensions - Safety Climate, Job Satisfaction, and Work Conditions - the exclusion of the department level from the model did worsen the model's goodness-of-fit.
Given that hospital top management wish to improve patient safety culture, where should they intervene? Obviously, patient safety culture scores depend on the personal interest, attention and engagement of each staff member. The major part of the variance in patient safety attitudes was across individual employees, so efforts to promote a patient safety culture must continue targeting individual staff members. But we also found marked clustering of patient safety culture scores at the organizational levels, and much of the organization level variance was across wards. In some patient safety culture dimensions department averages differ, but in other dimensions, wards vary more strongly than departments. Therefore, interventions to improve patient safety should aim not only at individual employees, but also at organizational units, in particular those at the sharpest end of the health services: the wards.
Having data on one hospital only, we have not been able to check empirically the amount of clustering of safety attitudes at the hospital level, but, as indicated by Sexton, Helmreich, Neilands et al. , there probably are hospital-specific patient safety cultures. However, as shown by Pronovost & Sexton  and by Singer , variability in SAQ measurements may be greater across working groups than across hospitals. This analysis adds to the suggestion that strategies for improving safety climate and patient safety should be tailored for work areas and disciplines by estimating the relative size of the variances at ward and department levels for each of the seven safety attitudes dimensions.
As we have documented significant clustering of three patient safety attitude dimensions at the department level (safety climate, job satisfaction, and work conditions), it should be noted that there may be differences in patient safety culture across departments. However, for four of the seven dimensions, there was no evidence of variation across departments, only across wards.
Patient safety culture improvement efforts should, therefore, include interventions at the ward level, and not just department or all-hospital interventions. Zohar et al.  has reported how information on safety climate has been used to guide prevention efforts toward selected units. Selection must, however, be done with discretion in order to avoid stigmatizing working units as "low-score." And one must not focus solely on the low scorers: high-scoring units may also be interesting; lessons may be learnt from their successes.
Possibly, even probably, one should in the future also aim at studying even lower-level units, the "micro-systems" that do not appear in organizational blueprints, but in which so much of the actual clinical work is carried out [14–16]. The importance of studying such lower-level units is obvious enough in medical departments. One may easily see patient safety as a function of the safety culture of sub-groups of nurses or small nurse-doctor groups within a ward. The point is particularly obvious in surgical departments, where the wards are the bed units where patients are prepared for surgery and nursed after having undergone surgery, but the work that gives the department its name - and is vital to surgical patients' safety - takes place in the theatres of the department's operating section. Studying surgical department patient safety at the ward level, although bedside, one might easily miss important information. A data collection problem is that micro-systems like operating teams are temporary groups, which do not have permanently designated staff. This may differ among organizations: at our hospital operation teams are temporary, but in other organizations they may be permanent. The inclusion of the micro-unit level into multi-level analyses of patient safety attitudes and other aspects of patient safety is an important task for future patient safety research.
Patient safety culture should be studied in care-giving units as close to the patient as possible. There may be such a thing as "hospital safety culture," and there are differences across hospital departments. However, neglecting the study of patient safety culture at the ward level will mask important local variations.
Patient safety culture improvement efforts should include interventions at ward level, not just department or all-hospital interventions.
Future research should not stop at the level of hospital wards, out-patient clinics, and ERs, but collect and analyze data on the micro-systems within them: nurse teams, doctor-nurse teams, operating teams etc.
The study was partly funded by grants from the Eastern Norway Regional Health Authority, which in 2006 awarded Ellen Deilkås a three-year PhD scholarship.
- Hjort PF: Uheldige hendelser i helsetjenesten: forslag til nasjonalt program for forebygging og håndtering (Adverse events in health care: suggestion for a national program). 2004, Oslo, Norway, Social and Health DepartmentGoogle Scholar
- Hjort PF: Uheldige hendelser i helsetjenesten - en lære-, tenke- og faktabok (Adverse events in health care). 2007, Oslo, Gyldendal Norsk ForlagGoogle Scholar
- Hofoss D, Deilkas E: Roadmap for patient safety research: approaches and roadforks. Scand J Public Health. 2008, 36: 812-7. 10.1177/1403494808096168.View ArticlePubMedGoogle Scholar
- Sexton J, Helmreich R, Neilands T, Rowan K, Vella K, Boyden J, Roberts PR, Thomas EJ: The Safety Attitudes Questionnaire: psychometric properties, benchmarking data, and emerging research. BMC Health Serv Res. 2006, 6: 44-10.1186/1472-6963-6-44.View ArticlePubMedPubMed CentralGoogle Scholar
- Deilkas E, Hofoss D: Psychometric properties of the Norwegian version of the Safety Attitudes Questionnaire (SAQ), Generic version (Short Form 2006). BMC Health Serv Res. 2008, 8: 191-10.1186/1472-6963-8-191.View ArticlePubMedPubMed CentralGoogle Scholar
- Rasbash J, Steele F, Browne W, Prosser B: A user's guide to MLwinN. 1996, London, University of London, Institute of Education, Centre for Multilevel ModellingGoogle Scholar
- Centre for Multilevel Modeling. University of Bristol. [http://www.cmm.bristol.ac.uk/]
- Snijders T, Bosker R: Multilevel analysis. An introduction to basic and advanced multilevel modeling. 2002, London, Sage PublicationsGoogle Scholar
- Woodhouse G: Multilevel modelling applications. A guide for users of MLn. 1996, London, University of London, Institute of EducationGoogle Scholar
- Pinheiro J, Bates D: Mixed-effects models in S and S+. 2004, New York: Springer, 83-4.Google Scholar
- Pronovost P, Sexton B: Assessing safety culture: guidelines and recommendations. Qual Saf Health Care. 2005, 14: 231-3. 10.1136/qshc.2005.015180.View ArticlePubMedPubMed CentralGoogle Scholar
- Singer SJ, Gaba DM, Falwell A, Lin S, Hayes J, Baker L: Patient safety climate in 92 US hospitals: differences by work area and discipline. Medical Care. 2009, 47: 23-31. 10.1097/MLR.0b013e31817e189d.View ArticlePubMedGoogle Scholar
- Zohar D, Livne Y, Orly T, Admi H, Donchin Y: Healthcare climate: a framework for measuring and improving patient safety. Critical Care Medicine. 2007, 35: 1312-7. 10.1097/01.CCM.0000262404.10203.C9.View ArticlePubMedGoogle Scholar
- Mohr JJ, Batalden PB, Barach P: Integrating patient safety into the clinical microsystem. Qual Saf Health Care. 2004, 13 (Suppl 2): ii34-8. 10.1136/qshc.2003.009571.PubMedPubMed CentralGoogle Scholar
- Berwick DM: A user's manual for the IOM's "Quality Chasm" report. Health Aff. 2002, 21: 80-90. 10.1377/hlthaff.21.3.80.View ArticleGoogle Scholar
- Mohr JJ, Batalden PB: Improving safety on the front lines: the role of clinical microsystems. Qual Saf Health Care. 2002, 11: 45-50. 10.1136/qhc.11.1.45.View ArticlePubMedGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1472-6963/10/85/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.