- Research
- Open access
- Published:
Safety culture in the operating room: translation, validation of the safety attitudes questionnaire – operating room version
BMC Health Services Research volume 23, Article number: 491 (2023)
Abstract
Background
Measuring the safety culture in Healthcare is an important step in improving patient safety. One of the most commonly used instruments to measure the safety climate is the Safety Attitudes Questionnaire (SAQ). The aim of the current study was to establish the validity and reliability of the Slovenian version of the SAQ for the operating room SAQ-OR.
Methods
The SAQ, consisting of six dimensions, was translated and adapted to the Slovenian context and applied in operating rooms from seven out of ten Slovenian regional hospitals. Cronbach’s alpha and confirmatory factor analysis (CFA) was used to evaluate the reliability and validity of the instrument.
Results
The sample consisted of 243 health care professionals who hold positions in the OR, divided into 4 distinct professional classes, namely, 76 surgeons (31%), 15 anesthesiologists (6%), 140 nurses (58%) and 12 auxiliary persons (5%). It was observed a very good Cronbach's alpha (0.77 to 0.88). The CFA and its goodness-of-fit indices (CFI 0.912, TLI 0.900, RMSE 0.056, SRMR 0.056) showed an acceptable model fit. There are 28 items in the final model.
Conclusions
The Slovenian version of the SAQ-OR revealed good psychometric properties for studying the organisational safety culture.
Background
Patient safety is a crucial aspect of healthcare provision [1]. A strong patient safety culture is important for patient safety and creating such a culture is one of the most important strategies for determining and improving patient safety in health institutions [2, 3]. A positive patient safety culture is an essential aspect of reducing errors and improving patient outcomes [4]. There are many definitions of safety culture, both within and outside healthcare [5]. Safety culture is the product of individual and group values, attitudes, competencies and behaviours that form a strong foundation on which to build a learning organization [6].
Safety culture refers mostly to individual and group values, attitudes, perceptions, and competencies with regard to safety. On the other hand, safety climate is mainly used to describe the expressed ideas, tools and techniques used in general by the organization in order to confirm its compliance with safety. In other words, the climate can easily be perceived by others, while culture is the basis that lies hidden beneath the surface. An operating room (OR) can have a high prevalence of errors, being an interdisciplinary, complex activity with a strong dependence on technical skill, where ergonomics and organizational factors play an essential role [7]. Measuring the safety climate in such a workplace is an important step in understanding patient safety [8].
An instrument that measures healthcare professionals' attitudes towards the safety climate in the OR would be helpful in understanding and identifying areas that need improvement, and for evaluating improvements in interventions [8]. The attitudes of health professionals are instantaneous snapshots of the safety cultures, reflecting the weak points and potential hazards in the medical system.
The purpose of the present study was to establish the reliability and validity of the in Slovenian translated version of the SAQ (OR version).
Methods
The Safety Attitudes Questionnaire (SAQ)
The SAQ was developed to measure attitudes towards the safety climate of a workplace. The SAQ is a refinement of the Intensive Care Unit Management Attitudes Questionnaire (ICUMAQ) [9], which was derived from the Flight Management Attitudes Questionnaire (FMAQ) [10]. The FMAQ was created after most airline accidents were found to be due to breakdowns in the interpersonal aspects of the crew’s performance. The SAQ was adopted for use in intensive care units. The SAQ-OR contains 30 items belonging to six dimensions [8]: teamwork climate, safety climate, job satisfaction, stress recognition, perceptions of management, and working conditions. Each item is answered using a five-point Likert scale, from “Disagree Strongly” to “Agree Strongly”, based on the respondent’s experiences in the OR department where they work.
Translation of the Safety Attitudes Questionnaire – Operating Room (SAQ-OR)
The questionnaire was translated from the English original in Göras et al.’s article [8]. The EN-SLO translation was made by a Slovene native speaker with a high degree of fluency in English.
After this, another expert in English translated the questionnaire back from Slovene into English. Finally, we compared the original version and our back translated version. We have modified just a few words.
Face validity
The face validity was tested by three physicians and one nurse, who were selected randomly from the OR team and were from different age groups and specialities. The questionnaire was thus reviewed by a surgeon and an anaesthesiologist with more than 10 years experience, a resident with three years experience, and an OR nurse with more than 10 years experience. They were asked to give feedback about the comprehensibility and minimal changes to the questionnaire were made to their oral feedback.
Data collection and ethical considerations
A cross-sectional design was used to test the questionnaire. Surgeons, nurses, anaesthesiologists and auxiliary nurses from seven of the ten Slovenian regional hospitals, all with at least 1 year of OR work experience, were asked to fill in the Slovene translation of the SAQ-OR (written questionnaires). We chose hospitals where we had such good personal contacts with the managers that we could ensure the appropriateness of conducting the research at the hospital level. At the team meetings, the purpose of the questionnaire was explained, and potential participants were asked to fill out the questionnaire. We guaranteed that participation was voluntary and anonymous. We sent the questionnaires to the medical directors by post or delivered them in person.
The respondents were informed that participation was voluntary. The questionnaires were treated anonymously. The response rate of completed questionnaires was 65%, so there were 243 participants (from 374 original requests).
The present study respected the bioethical principles for medical research on human beings of the Declaration of Helsinki, related to confdentiality, freedom, respect and non-malefcence; and, was approved by the Hospital dr. Jožeta Potrča, Ptuj Ethics Committee (01/3–81/11–22).
Statistical analysis
Initially, descriptive statistics used frequencies (n) and percentages (%) to summarize nominal and ordinal data. The internal consistency of the total SAQ-OR and its six factors, teamwork climate, safety climate, job satisfaction, stress recognition, perception of management, and working conditions, was measured by calculating Cronbach's alpha. Confirmatory Factor Analysis (CFA) was applied to test the validity of the SAQ. The CFA is also sufficient to verify the theoretically-founded factors as well as to identify factor loadings and fit of single items per factor/to identify certain items that should be excluded.
IBM SPSS Statistics 20, IBM Amos, JASP and the Mplus software package Version 7.32 were used, using maximum likelihood estimation with robust standard errors (MLR), which is robust to the deviation of scores from the normal distribution and the dependence of observations. Several fit indices were used to evaluate the model: the Yuan-Bentler χ2 test (YBχ2), the Root Mean Square Error of Approximation (RMSEA), the Comparative Fit Index (CFI), the Taker-Lewis Index (TLI), and the Standardized Root Mean Squared Residual (SRMR). The Yuan-Bentler χ2 should be statistically insignificant to indicate that the model fits the data well; however, with large samples, a non-significant value of the χ2 test is very rarely obtained [11]. A value of the RMSEA less than 0.06, a value of the SRMR below 0.08, and values of the Comparative Fit Index and the Tucker-Lewis Index greater than 0.95 indicate a good model fit [11]. The criteria for an acceptable model fit are as follows: RMSEA between 0.06 and 0.08, SRMR between 0.08 and 0.10, and CFI and TLI above 0.90 [12].
Results
No significant differences were detected between the translations, and no major remarks were made during face validity.
The sample consisted of 243 healthcare professionals who hold positions in the OR, divided into 4 distinct professional classes: 76 surgeons (31%), 15 anaesthesiologists (6%), 140 nurses (58%) and 12 auxiliary personnel (5%).
The participants had a mean age of 41.5 years, with a minimum of 25 years and maximum of 65 years. The average number of years that the health professionals had worked in that institution was 13.1. With regard to the sex distribution of the sample, 79 were male (33%) and 164 were female (67%). The SAQ dimensions, items, factor loadings and Cronbach`s alpha for items are presented in Table 1. The dimension Job satisfaction received the highest average grade (4.1) and the dimension Perceptions of Management the lowest average grade (3.1). Two questions (in bold in Table 1) (“In this clinical area, it is difficult to speak up if I perceive a problem with patient care”, and “In this clinical area, it is difficult to discuss errors”) had insufficient factor loadings and we had to exclude them.
In order to study the internal consistency of the instrument used, Cronbach's alpha for each of the factors of the questionnaire was calculated. We obtained a very good Cronbach`s alpha (0.77 to 0.88).
The original six-factor solution (YBχ2(335) = 639,23, p < 0.001; CFI = 0.895, TLI = 0.882, SRMR = 0.064; RMSEA = 0.061, 90% CI = 0.054, 0.064) showed good or acceptable model fit in the case of RMSEA and SRMR fit indices, however, the values of CFI and TLI indices were slightly lower than the acceptable values. The six-factor model was modified by correlating errors for items with similar/same meaning, which was suggested by high values of modification indices (over 30) (items 1 and 4 in the job satisfaction subscale and items 1 and 4 in the working condition subscale). Fit indices of the modified six-factor model (YBχ2(333) 588.93, p < 0.001; CFI = 0.912, TLI = 0.900, SRMR = 0.056; RMSEA = 0.056, 90% CI = 0.049, 0.064) indicate good fit for RMSEA and SRMR, as well as acceptable fit for TLI and CFI. Item factor loadings and factors' Cronbach alpha of the final modified six—factor are presented in Table 2.
The intercorrelations between the factors are presented in Table 3. All subscales have moderate to high positive correlations with each other, except for the stress recognition subscale, with which the other subscales achieves low negative or nonsignificant correlations.
Discussion
This study evaluated the psychometric properties of the 28-items SAQ-OR Slovenian-language version. The results showed good Cronbach’s alpha and acceptable CFA fit statistics. The present study represents the first report on attitudes relevant to safety culture in ORs in Slovenia. Klemenc-Ketis et al. [13] presented a study in which they developed the SAQ for our country, but it was for the out-of-hours primary care setting.
The development of a valid and reliable instrument is a longitudinal and multi-step process [13]. We chose one of the most widely used surveys (the SAQ-OR) [14] and included all the professional profiles involved in the work of the OR (anaesthesiologists, surgeons, operating room nurses, auxiliary personnel) in most Slovenian regional hospitals. Work in the OR must be conducted as a team, and all personnel must be aware of the importance of a safety culture.
The number of participants in the study was sufficient (n = 243) for the model fit to be good. There was also a good proportion of returned questionnaires (65%), and it was implemented in seven of the ten regional hospitals in Slovenia. Göras et al. [8] tested the Swedish SAQ in three hospitals with 237 respondents (and 63% of the questionnaires were returned). Bernalte-Marti [15] in Spain and in Italy made validated questionnaire with only 30 experts, while Pinheiro et Uva [7] carried out their study at one hospital in Portugal with 82 healthcare professionals.
The questionnaire consisted of six dimensions [16]. We hoped to include as many areas of risk for patient safety as possible. The dimension Job satisfaction received the highest average rating, and the dimension Perceptions of Management received the lowest average rating. The average response values were very high for claims of Job satisfaction working in the OR (for example, 4.4 for “This is a good place to work”). Pinheiro and Uva [7] also found the highest average rating to be in the Job satisfaction dimension and the lowest average rating in the dimension Perception of Management. Job satisfaction is related to fewer adverse events [17].
Low management perceptions suggest that professionals do not notice any commitment from the management with regard to safety culture (item Hospital management supports my daily efforts –rating 2.9). Our country also constantly deals with a lack of suitable personnel (item The levels of staffing in this clinical area are sufficient to handle the number of patients—rating 2.8). Carvalho and al. [18] in their Brazilian study also noted a poor result in the dimension Hospital management.
We showed that the questionnaire has appropriate internal consistency (Cronbach’s alpha values between 0.77 and 0.88). In a Swedish study of psychometric testing of the same questionnaire, Göras et al. [8] demonstrated a Cronbach’s alpha between 0.59 and 0.83, while in Portugal, Pinheiro and Uva [7] reported a Cronbach’s alpha between 0.34 and 0.72, and in Italy and Spain, a study carried out by Bernalte-Marti [15] reported a Cronbach’s alpha between 0.37 and 0.78. The CFA performed on the 6-dimensional model confirmed that the model is good and two questions did not meet all the strict criteria of the factor analysis and were therefore excluded from the final questionnaire. Methodologically, the approaches of other authors were similar. Pinheiro and Uva [7] and Göras et al. [8] measured Cronbach's alpha and passed the CFA but Bernalte-Marti [15] Marti first performed a Cronbach’s alpha, and in the next study [19] carried out an EFA and CFA on the same sample.
The exclusion of two questions is a special feature of our research. Obviously, the factors that determine the safety culture in our country are different than elsewhere, but the purpose of the validation is to adjust the questionnaire to the cultural and other characteristics of our country.
This is in concordance with the Harzing [20] finding, that questionnaires in the english language elicit a higher rate of an intermediate responses, while the questionnaires in the respondent's native language elicit more extreme response styles.
Limitations of the study
A pool of different professionals was included in our study, and given the subsample sizes, further sub-analysis to test for possible differences in responses and factor structure between the professions was hardly feasible. Also the sampling procedure, in so many different hospitals, could have had some bias. The study was limited to self-reported outcome. There was no continuous assessment of safety attitudes over time.
Conclusions
The Slovenian version of the SAQ-OR demonstrates good psychometric capabilities for studying the safety culture of a workplace. The questionnaire seems to have potential as a useful tool for evaluating safety culture. Health professionals are satisfied with their work, but management has not promoted patient safety.
Availability of data and materials
The datasets used and/or analyzed during the current study are available from the corresponding author on reasonable request.
References
Behzadifar M, Behzadifar M, Jahanpanah F, Bragazzi NL. Patient safety culture assessment in Iran using the “Hospital survey on patient safety culture” tool: A systematic review and meta-analysis. Clin Epidemiol Glob Health. 2019;7:641–7.
Fujita S, Seto K, Ito S, Wu Y, Huang CC, Hasegawa T. The characteristics of patient safety culture in Japan, Taiwan and the United States. BMC Health Serv Res. 2013;14(13):20. https://doi.org/10.1186/1472-6963-13-20.
Güneş UY, Gürlek O, Sönmez M. A survey of the patient safety culture of hospital nurses in Turkey. Collegian. 2016;23(2):225-32. 23. https://doi.org/10.1016/j.colegn.2015.02.005.
Ginsburg LR, Tregunno D, Norton PG, Mitchell JI, Howley H. “Not another safety culture survey”: using the Canadian patient safety climate survey (Can-PSCS) to measure provider perceptions of PSC across health settings. BMJ Qual Saf. 2014;23(2):162–70. https://doi.org/10.1136/bmjqs-2013-002220.
Churruca K, Ellis LA, Pomare C, Hogden A, Bierbaum M, Long JC, et al. Dimensions of safety culture: a systematic review of quantitative, qualitative and mixed methods for assessing safety culture in hospitals. BMJ Open. 2021;11(7):e043982. https://doi.org/10.1136/bmjopen-2020-043982.
Østergaard D, Madsen MD, Ersbøll AK, Frappart HS, Kure JH, Kristensen S. Patient safety culture and associated factors in secondary health care of the Capital Region of Denmark: influence of specialty, healthcare profession and gender. BMJ Open Qual. 2022;11(4):e001908. https://doi.org/10.1136/bmjoq-2022-001908.
Pinheiro J, de Sousa UA. Safety Climate in the Operating Room – Translation, Validation and Application of the Safety Attitudes Questionnaire. Revista Portuguesa de Saúde Pública. 2015;34(2):107–16. https://doi.org/10.1016/j.rpsp.2015.07.006.
Göras C, Wallentin FY, Nilsson U, Ehrenberg A. Swedish translation and psychometric testing of the Safety Attitudes Questionnaire (Operating Room version). BMC Health Serv Res. 2013;13:104. https://doi.org/10.1186/1472-6963-13-104.
Sexton JB, Thomas EJ, Helmreich RL. Error, stress, and teamwork in medicine and aviation: cross sectional surveys. BMJ. 2000;320(7237):745–9. https://doi.org/10.1136/bmj.320.7237.745.
Helmreich RL. Cockpit management attitudes. Hum Factors. 1984;26(5):583–9. https://doi.org/10.1177/001872088402600510.
Barrett P. Structural equation modelling: adjudging model fit. Pers Indiv Differ. 2007;42:815–24. https://doi.org/10.1016/j.paid.2006.09.018.
Hu L, Bentler PM. Cut-off criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Struct Equ Model. 1999;6(1):1–55. https://doi.org/10.1080/10705519909540118.
Klemenc-Ketis Z, Maletic M, Stropnik V, Deilkås ET, Hofoss D, Bondevik GT. The Safety Attitudes Questionnaire – ambulatory version: psychometric properties of the Slovenian version for the out-of-hours primary care setting. BMC Health Serv Res. 2017;17(1):36. https://doi.org/10.1186/s12913-016-1972-7.
Churruca K, Ellis LA, Pomare C, Hogden A, Bierbaum M, Long JC, Olekalns A, Braithwaite J. Dimensions of safety culture: a systematic review of quantitative, qualitative and mixed methods for assessing safety culture in hospitals. BMJ Open. 2021;11(7):e043982. https://doi.org/10.1136/bmjopen-2020-043982.
Bernalte-Martí V. Cross-cultural Adaptation of the Safety Attitudes Questionnaire Short Form in Spanish and Italian Operating Rooms: Psychometric Properties. J Patient Saf. 2022;18(3):e687–96. https://doi.org/10.1097/PTS.0000000000000902.
Sexton JB, Helmreich RL, Neilands TB, Rowan K, Vella K, Boyden J, Roberts PR, Thomas EJ. The Safety Attitudes Questionnaire: psychometric properties, benchmarking data, and emerging research. BMC Health Serv Res. 2006;3(6):44. https://doi.org/10.1186/1472-6963-6-44.
Relihan E, Glynn S, Daly D, Silke B, Ryder S. Measuring and benchmarking safety culture: application of the safety attitudes questionnaire to an acute medical admissions unit. Ir J Med Sci. 2009;178(4):433–9. https://doi.org/10.1007/s11845-009-0352-2.
Carvalho PA, Göttems LB, Pires MR, de Oliveira ML. Safety culture in the operating room of a public hospital in the perception of healthcare professionals. Rev Lat Am Enfermagem. 2015;23(6):1041–8. https://doi.org/10.1590/0104-1169.0669.2647.
Bernalte-Martí V. The Spanish and Italian Healthcare Professionals’ Contribution to the Safety Attitudes Questionnaire Short Form in the Operating Room: Construct Validity and Reliability. J Patient Saf. 2022;18(6):e953–61. https://doi.org/10.1097/PTS.0000000000001068.
Harzing AW. Response Styles in Cross-national Survey Research: A 26-country Study. IJCCM. 2006;6(2):243–66 (https://cmk-proxy.mf.uni-lj.si:2819/10.1177/1470595806066332).
Acknowledgements
The authors thank all the healthcare professionals for their generous contribution to this study.
Funding
Self-financed.
Author information
Authors and Affiliations
Contributions
T.P. and E.T. wrote the main manuscript. T.A. wrote introduction and table. All authors reviewed the manuscript. The author(s) read and approved the final manuscript.
Corresponding author
Ethics declarations
Ethics approval and consent to participate
The present study respected the bioethical principles for medical research on human beings of the Declaration of Helsinki, related to confdentiality, freedom, respect and non-malefcence; and was approved by the Hospital dr. Jožeta Potrča, Ptuj Ethics Committee (01/3–81/11–22). Participants gave a verbal informed consent to participate in the study. Participants considered that their anonymity was violated by written consent. As this was an anonymous survey, a written consent was not applicable. Insistence on this, notwithstanding the non-mention of verbal informed consent by the Hospital Ethics Commission, would greatly reduce the number of participants.
Consent for publication
Not applicable.
Competing interests
The authors declare no competing interests.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
About this article
Cite this article
Pevec, T., Albreht, T. & Turk, E. Safety culture in the operating room: translation, validation of the safety attitudes questionnaire – operating room version. BMC Health Serv Res 23, 491 (2023). https://doi.org/10.1186/s12913-023-09539-9
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s12913-023-09539-9