Skip to main content
  • Research article
  • Open access
  • Published:

The safety attitudes questionnaire in Chinese: psychometric properties and benchmarking data of the safety culture in Beijing hospitals

Abstract

Background

In China, increasing attention has been devoted to the patient safety culture within health administrative departments and healthcare organizations. However, no official version of a patient safety culture assessment tool has been published or is widely used, and little is known about the status of the safety culture in Chinese hospitals. The aims of this study were to examine the reliability and validity of the Safety Attitudes Questionnaire in Chinese and to establish benchmark data on the safety culture in Beijing.

Methods

Across-sectional survey on patient safety culture was conducted from August to October 2014 using the Safety Attitudes Questionnaire in Chinese. Using a stratified random sampling method, we investigated departments from five integrative teaching hospitals in Beijing; frontline healthcare workers in each unit participated in the survey on a voluntary basis. The internal consistency and reliability were tested via Cronbach’s alpha, and the structural validity of the questionnaire was tested using a correlation analysis and confirmatory factor analysis. The patient safety culture in the five hospitals was assessed and analyzed.

Results

A total of 1663 valid questionnaires were returned, for a response rate of 87.9%. Cronbach’s alpha of the total scale was 0.945, and Cronbach’s alpha for the six dimensions ranged from 0.785 to 0.899. The goodness-of-fit indices in the confirmatory factor analysis showed an acceptable but not ideal model fit. The safety attitude score of healthcare workers in the five hospitals was 69.72, and the positive response rate was 38.57% overall. The positive response rates of the six dimensions were between 20.80% and 59.31%.

Conclusions

The Safety Attitudes Questionnaire in Chinese has good internal consistency, and the structural validity and reliability are acceptable. This questionnaire can be used to assess the safety culture in Beijing hospitals, but some items require further refinement. The patient safety culture in Beijing hospitals must be improved in certain key areas.

Peer Review reports

Background

In 1999, the Institute of Medicine published a report entitled “To err is human: Building a safety health system” and noted that “health care organizations must develop a ‘culture of safety’ such that their workforce and processes are focused on improvement of the reliability and safety of care for patients” [1]. Since then, as one of these patient safety promotion projects, safety culture has received attention from medical and health organizations worldwide [1,2,3].

China is in the beginning stages of establishing a patient safety culture. A patient safety event reporting system was established in hospitals as part of the risk management system by the China Hospital Association in 2007, and "Building a culture of patient safety" was proposed in 2014 as one of the top 10 patient safety goals. The National Health Administration Department has committed to improving medical quality and ensuring patient safety by launching various nationwide activities, such as the “Medical Quality Tour”, “Three Good and One Satisfaction”, and “the National Healthcare Improvement Initiative”, and has made substantial progress.

The WHO definition of a safety culture is as follows: “The safety culture of an organization is the product of individual and group values, attitudes, perception, competencies and patterns of behavior that determine the commitment to, and the style and proficiency of, an organization’s health and safety management” [4]. Studies have shown that a positive safety culture can promote safety behavior among medical personnel, reduce the occurrence of adverse medical events, reduce the patient readmission rate, and decrease hospitalization time [5,6,7,8].

A number of safety culture assessment tools have been developed in the healthcare field [9,10,11,12], and they can be used to assess the safety culture to identify areas for improvement, raise awareness about patient safety, evaluate patient safety interventions or programs, track changes over time, conduct internal and external benchmarking, and fulfill directives or regulatory requirements [3].

According to a systematic literature review of the safety culture tools currently in use, the Safety Attitudes Questionnaire (SAQ) was found to exhibit superior characteristics in 24 of 25 indicators. The SAQ is one of “two tools that have been used to evaluate the associations between patient safety climate scores and process measures theorized to be associated with improved patient outcomes”, and “only the SAQ has been used to explore the relationship between safety climate scores and patient outcomes” [13]. The SAQ is a psychometrically sound tool that has been tested on a large sample [9]. It has been translated into different languages and used in various countries, including the United States [9], the United Kingdom [9], New Zealand [9], Sweden [14, 15], Norway [16], Australia [17], Italy [18], Turkey [19], and Chinese Taiwan [20]. The SAQ demonstrated good reliability and validity in these studies, and the survey findings could provide a baseline database of safety culture assessments and indicate the strengths and weaknesses at the clinical level. Regular safety culture assessments have been performed by some health administration nongovernmental organizations [20, 21] to conduct a comparative analysis, and continuous efforts have been initiated to minimize the variations in safety culture among hospitals.

However, patient safety culture and its assessment tools are still being researched in China. Due to the linguistic differences between Chinese and Western cultures, the introduction and modification of the scale and its validity and effectiveness have not yet been recognized by the healthcare industry. Knowledge of the psychometric properties of the SAQ and of benchmarking data in China is limited. This study aims to test the applicability of the SAQ in Chinese healthcare organizations in Beijing, to investigate the current status of the patient safety culture, to identify the advantages and disadvantages, and to provide basic information for the improvement of the patient safety culture in China.

Methods

Survey instrument

The SAQ was developed by the University of Texas [9]; 25% of the items are from the Flight Management Attitude Questionnaire (FMAQ) [22, 23], and 75% of the items pertain to healthcare industry characteristics [24, 25]. The SAQ contains six dimensions: Teamwork Climate, Safety Climate, Job Satisfaction, Stress Recognition, Perception of Management, and Working Conditions. It has been adapted for use in different settings; these alternate versions include the ICU version, Operating Room version, Ambulatory version, Labor & Delivery version, Pharmacy version, and Short-Form version. The item content is the same for each version of the SAQ, with minor modifications to reflect the clinical area. The SAQ uses a five-point Likert scale: 1 = Strongly Disagree, 2 = Slightly Disagree, 3 = Neutral, 4 = Slightly Agree, 5 = Strongly Agree.

The present research adopted the generic SAQ Short-Form version (available at https://med.uth.edu/chqs/surveys/safety-attitudes-and-safety-climate-questionnaire/). This version consists of 36 items, 31 of which are categorized into 6 dimensions and 5 of which do not belong to any dimension. The items are as follows: Teamwork Climate: Items 1–6; Safety Climate: Items 7–13; Job Satisfaction: Items 15–19; Stress Recognition: Items 20–23; Perceptions of Management: Items 24–29 (each of these items is measured at two levels–unit and hospital); and Working Conditions: Items 30–32. Items 14 and 33–36 are not part of the subscales above; Items 2, 11, 20–23 and 36 are reverse-scored [9].

Translation and adaptation of the SAQ

The translation of the SAQ Short-Form version into Chinese was performed independently by two staff members. The comparison and modification of the translation with reference to the SAQ Taiwan version was conducted by a clinical expert and a psychology expert with experience in medical English translation. Scientific and cultural adjustments were completed through two rounds of an expert seminar (focus group), including 15 experts in hospital management, health statistics, psychology, clinical medical care, and nursing. We organized the group discussions and the interviews of healthcare staff subjects in different positions while fully considering the equivalence and understandability between the Chinese version and the generic English version. The Safety Attitudes Questionnaire in Chinese see Additional file 1.

Based on the original scale, the social-demographic characteristics section was self-designed and included gender, age (years), education degree, profession, technical titles, administrative post, years working in the current department, and related information.

Administration of the survey

Five integrative teaching hospitals were selected from affiliated or teaching hospitals of Capital Medical University in Beijing, including three tertiary-level hospitals and two secondary-level hospitals; the leaders of these hospitals expressed their willingness to participate in the survey. Using stratified random sampling, we selected the investigative departments from the five hospitals, including clinical departments (internal medicine, general surgery, and obstetrics and gynecology) and medico-technical departments (pharmacies, laboratories, radiology departments, etc.), while three special units (intensive care units, operating rooms, emergency rooms) were included due to the high rates of error with serious consequences [1]. The frontline healthcare workers in the investigation departments of the five hospitals participated in the survey on a voluntary basis. The inclusion criteria required that the respondents had worked in the department for at least 4 weeks and either influenced or were influenced by the “working environment” in the specific clinical area [9, 20].

From August to October 2014, the survey was conducted in five hospitals by the investigators using concentrated dissemination and processing on the spot in the selected departments. Based on the unified training, the investigators should have understood the purpose of the research, the connotations of safety culture and the meaning of each item in the SAQ. During the investigation, the investigators introduced the study’s background and purpose and clarified matters requiring attention to ensure thorough understanding among the respondents, encourage their compliance to avoid low recovery rates and reduce missing items. The questionnaire took approximately 10 to 15 min to complete. To ensure anonymity and confidentiality, the questionnaire was folded in half and directly handed to the investigators after completion.

Incomplete or invalid questionnaires were excluded, including those with more than 5 questions with missing answers, answers with obvious reaction tendencies (such as the use of extreme answers for questions, choosing the same answer for 10 questions in a row, or answering with a specific regularity) and those with the same answers.

Data management and analysis

The data were read using Epidata software version3.1 and analyzed using SPSS19.0 for Windows; confirmatory factor analysis was conducted using Amos17.0. Negatively worded items were reverse-scored to ensure that their valence matched the positively worded items. To clarify the interpretation of the data, the five-point scale was converted to a 100-point scale, 1 → 0, 2 → 25, 3 → 50, 4 → 75, 5 → 100 [14, 18, 20, 26].

Reliability analysis

Thirty-one items in six dimensions were considered in the reliability and validity analysis. The reliability evaluation was used to measure the reliability, stability and consistency of the results of the questionnaire, that is, the size of the variance of the measurement value caused by random errors in the measurement process. As the reliability index, Cronbach’s alpha was used to evaluate the internal reliability of the questionnaire [27]. In the analysis of the split-half reliability, the questionnaire was divided into two halves, the correlation coefficient of the two halves of the score was calculated, and the reliability of the scale was estimated. The split-half reliability is linked to the internal consistency coefficient and was used to evaluate the consistency between the scores of two items. If the alpha coefficient was ≥0.70, the internal consistency reliability was considered acceptable [28], i.e., the cutoff = 0.70 [29], and when the coefficient was ≥0.8, the scale reliability was considered very good [30]. Because the medical staff was busy at work, this study did not retest the reliability assessment.

Validity analysis

The validity assessment provides an evaluation of the accuracy, validity and correctness of the scale, that is, the deviation between the measured value and the real value of the target construct. Content validity is the appropriateness and representativeness between the content and the subject of the scale, namely, whether the content of the reaction to the psychological characteristics of the measurement can measure or assess behavioral constructs. The assessment was generally rated by the expert group with a two-way breakdown evaluation: Very relevant = 4; Somewhat relevant = 3; Weakly relevant = 2; Not related = 1. The content validity index at the item level (I-CVI) was determined as part of the expert group according to the correlation of each item and the research concept. The number of experts whose scores were 3 or 4 was divided by the total number of experts to determine the I-CVI. When the number of experts is less than or equal to 5, the opinions of all experts must be consistent to ensure the validity of content; that is, the I-CVI must be 1. When the number of experts increases, this standard can be reduced, but the I-CVI must be higher than 0.78 [31]. The I-CVI of each item can be used to determine whether to retain, modify, or discard the scale. The content validity index at the scale level (S-CVI) is the proportion of the items that all experts rated 3 or 4, that is, the total number of the items all experts rated 3 or 4 divided by the total number of the items in the scale, and the S-CVI should be at least 0.80 [32]. In this study, the expert group was composed of six associate senior professors in clinical medical, hospital management, health statistics, or psychology.

Construct validity is used to evaluate whether the structure of the scale is consistent with its theoretical assumptions and whether the internal components of the measurement results are consistent with the designers’ intention to measure the field.

A correlation analysis is used to evaluate the construct validity of the measurement tool, including the correlation analysis between each dimension and item. Construct reliability (CR) values larger than 0.7 suggest good reliability, and values between 0.6 and 0.7 are potentially acceptable provided that other indicators of the model’s construct validity are good. High construct reliability indicates the existence of internal consistency [33].

A confirmatory factor analysis (CFA) was used to explore whether the factor structure of the scale model fit the actual data collected. A structural equation model was constructed to explore whether the index variable could be effectively used as a measure of the factors. The missing value was replaced by the average near points in the CFA but maintained null values in other statistical analyses [34].

The following indices were specifically considered: (i) the chi-square goodness-of-fit (χ2): the model was acceptable if the p-value of the chi-square test was not significant; (ii) normalized chi-square (NC), which is the chi-square divided by the degree of freedom (d.f.): a ratio ranging from 3 to 1 was acceptable for a model fit [35]; (iii) goodness-of-fit index (GFI), adjusted goodness-of-fit index (AGFI), the comparative fit index (CFI): a value within 0.90–1.00 was acceptable for indicating model fit [36]; and (iv) root mean square error of approximation (RMSEA): a value of approximately 0.05 or less indicated a close fit of the model in relation to the d.f. [37].

Benchmarking climate

Once the structure was confirmed, the mean scores of the safety factors for each respondent were calculated to determine the percentage of respondents with positive attitudes toward each safety dimension.

A positive response meant choosing the answers “agree slightly” or “agree strongly”, which indicated that the score was 75 or higher. The positive response rate of the dimension (or the item) = the number of scores ≥75 in the dimension (or the item) / the number of effective respondents. Dimensions (or items) with a positive response rate of 80% or higher were advantageous areas, and those lower than 60% were the improvement areas [14, 18, 20, 26].

Results

Of the 1892 distributed questionnaires, 1663 effective questionnaires were collected; the effective rate was 87.90%. The loss rates for the 36 items were between 0.06% and 1.38%.

Reliability of the SAQ in Chinese

Table 1 shows that the total Cronbach’s alpha was 0.945, and the Cronbach’s alpha values of the six dimensions were between 0.785 and 0.899. The split-half reliability of the scale was 0.869, the correlation coefficient between two parts was 0.769, and the split-half reliability indices of six dimensions were between 0.738 and 0.912. The SAQ in Chinese thus had high internal consistency.

Table 1 Cronbach’s α of the SAQ in Chinese

Validity of the SAQ in Chinese

In the CVI, the I-CVI of each item was between 0.8 and 1.0, higher than 0.78; the S-CVI was 0.86, which is greater than 0.80.

In the Pearson correlation test, the correlation coefficient between Stress Recognition and the entire questionnaire was low (r = 0.412); the correlation coefficients between the five dimensions and the entire questionnaire were higher (r = 0.617 to 0.874) and were also higher than the correlation coefficients between each dimension. The correlation coefficient between the Stress Recognition dimension and the other five dimensions was lower, between 0.174 and 0.196; the correlation coefficient between the remaining dimensions was between 0.572 and 0.777. The correlation coefficient between each dimension in the SAQ is shown in Table 2. The correlation coefficients between each item and its corresponding dimensions were higher than the correlation with the other dimensions (see Table 3). These findings indicate that the scale had good internal consistency.

Table 2 The correlation coefficient between each dimension of the SAQ in Chinese
Table 3 The correlation coefficient between each item and dimension of the SAQ in Chinese

In the CFA, a structural equation model was constructed (see Fig. 1). Influenced by the large sample size, the χ2 value and NC value were greater, χ2 = 1410.544(p = 0.000), NC = 3.474. However, considering the other goodness-of-fit statistics, i.e., GFI = 0.948, AGFI = 0.936, CFI = 0.963, RMSEA = 0.039 (Table 4), the GFI, AGFI and CFI were greater than 0.90, and the RMSEA value was less than 0.05; therefore, the construct validity was not ideal but was acceptable. Goodness-of-fit indices for the model are shown in Table 4.

Fig. 1
figure 1

The structural equation model

Table 4 Goodness-of-fit indices for the model

Demographic information

Of the 1663 respondents, 652 were in a secondary-level hospital (39.21%) and 1011 were in a tertiary-level hospital (60.79%). A total of 78.00% of the respondents were in clinical departments, 15.45% were in a medico-technical department, and 6.55% were in an outpatient department. The majority of the respondents were female (79.38%), and 76.47% were young (ages 21–40 years). More than half were nurses (55.06%), followed by physicians (30.69%), technicians (6.91%), and pharmacy personnel (6.25%). The demographics of the respondents are provided in Table 5.

Table 5 Characteristics of the safety attitude survey respondents

Benchmarking climate

Table 6 shows that the mean score for the healthcare workers in five hospitals was 69.72 (SD = 15.47). The six dimensions from high to low scores were as follows: Teamwork Climate: 74.87 (SD = 18.23); Safety Climate: 73.82 (SD = 17.51); Job Satisfaction: 72.43 (SD = 22.50); Recognition of Management: 69.64 (SD = 19.68); Working Conditions: 68.59 (SD = 20.09); and Stress Recognition: 44.53 (SD = 28.70). Stress Recognition showed the greatest variability, and Safety Climate showed the least variability. The positive response rate of the healthcare workers in the five hospitals was 38.57%; the positive response rates of the six dimensions were from 20.80% to 59.31%. From high to low, these rates were as follows: Teamwork Climate: 59.31%; Safety Climate: 54.09%; Job Satisfaction: 54.63%; Working Conditions: 46.69%; Recognition of Management: 45.97%; and Stress Recognition: 20.80%, all of which were lower than 60%. The positive response rates for six items were higher than 80%, including two items in Teamwork Climate, two items in Safety Climate, and two items not within any dimension. Ten items were lower than 60%: four items in Stress Recognition, four items in Recognition of Management, one item in Working Conditions, and one item not within any dimension. Descriptions of each item in the SAQ are shown in Table 7.

Table 6 The scores for healthcare workers in Beijing hospitals
Table 7 The description of each item in Beijing hospitals

Discussion

The introduction and application of the SAQ in Chinese

The SAQ Short-Form version was introduced and applied in a safety culture survey of Beijing hospitals to evaluate the psychological characteristics and cross-cultural applicability of the SAQ in Chinese for the first time. The study showed that the SAQ in Chinese had very good internal consistency, similar to the English version [9] and versions in other languages [14, 16, 18, 19]; Cronbach’s alpha for the total scale was 0.945 and that for all dimensions was greater than 0.70. The validity analysis showed that the SAQ in Chinese had high content validity and good construct validity; most of the CFA indices indicated goodness for fit for the application of the SAQ model to the patient safety culture in Beijing.

The effective response rate for this survey was 87.9%, which was higher than the rates of similar studies in other countries (47.4%–69.4%) [9, 11, 14, 16, 19, 20]; the rate of missing items (0.06% to 1.38%) was also low [9, 14,15,16]. The success of the survey is attributable to several factors. First, all managers in the five hospitals supported the survey of patient safety culture. Second, we conducted the survey using on-the-spot questionnaires instead of email- or mail-based questionnaires because the delivery and recovery of the questionnaires through mail or email can result in lengthy collection times and questionnaire loss. Third, the introduction of the patient safety culture survey to the respondents was important for helping them fully understand the items. Fourth, the SAQ itself has favorable characteristics; it is a self-reported anonymous questionnaire, the number of items is moderate, the wording is easy to understand, and the scoring method is simple and easy to learn. Scoring with a machine-read card form is easy, which could facilitate an online survey platform for a large-scale survey such as in a city or for the entire country. The survey required a short amount of time (10–15 min) to complete. The above findings confirmed the acceptability of the SAQ in Chinese in practice.

We also recognize that the East and the West have different cultures, which can result in a different semantic understanding [38]. Although the translations were correct, non-equivalence of the concepts and their definitions may still exist [15], such as the word “appropriately” in “Disagreements in this clinical area are resolved appropriately”; “feedback” in “I receive appropriate feedback about my performance”; and “constructively,” in “Problem personnel are dealt with constructively by our management”. The evaluation criteria are obviously subjective. In addition, some items with reverse statements were difficult for the respondents to understand; thus, the answers may be variable and not consistent with the facts. Therefore, the respondents must carefully read the questions before providing the answers [18].

Therefore, the SAQ in Chinese requires further modification and improvement in theoretical research and in practice to serve as a safety culture evaluation tool that is suitable for respondents from Chinese cultural backgrounds.

The analysis of stress recognition

Controversy exists regarding whether to keep the Stress Recognition dimension in the SAQ. In the correlation analysis of the structural validity, Stress Recognition showed a poor correlation with other dimensions, and similar results have been shown in previous studies on the SAQ in other languages [14, 15, 18,19,20].Similar studies have also recommended that Stress Recognition does not fit in the SAQ scale in terms of the theoretical construction of safety culture given its low explanatory power and that it could be removed when calculating the total score [20, 39]. Gallego et al. [40] indicated that Stress Recognition is different from other dimensions of the SAQ scale because it requires the evaluation of one’s behavior in the workplace, while the other dimensions of the SAQ focus on others’ behavior. In a study evaluating the effectiveness of safety culture improvement strategies using the SAQ, significant differences were seen before and after carrying out the improvement strategy, except for in the score for Stress Recognition [41].

We retained the dimension of Stress Recognition in the SAQ, as the developer’s intention was to assess frontline healthcare workers’ acknowledgement of how performance is influenced by stressors [9]; this dimension could remind them and their managers to pay attention to adverse conditions and take effective actions to enhance patient safety.

The advantages and disadvantages of patient safety culture

The study showed that the safety culture was not sufficiently established at most hospitals in Beijing. The total mean score of the healthcare workers in the five hospitals was 69.72, and the respective scores of the six dimensions ranged from 44.53 to 74.87. Five dimensions (all except Stress Recognition) exhibited higher scores than baseline data from the United States, Britain, and Italy obtained in 2006 [9, 18], but slightly lower scores than the survey data reported by Taylor in 2011 [39]. The overall positive response rate was 38.57%; the positive response rates of the six dimensions ranged from 20.80% to 59.31% and were higher than the data obtained in Taiwan in 2010 [20]. However, all dimensions needed improvement to decrease the positive response rate to below the international standard (60%). Of the 36 items, six showed advantages, and ten items showed disadvantages.

Of the six dimensions, the scores and the positive response rates of Teamwork Climate were the highest, as in most studies [9, 14, 20, 39]. In the current complicated medical environment, healthcare providers have realized the importance of knowledge and complementary skills, resource sharing between team members, and establishing good cooperative relationships with colleagues to better manage conflict within the team with the clear target of ensuring patient safety. However, mutual trust between team members and the two-way communication capabilities in the department need to be improved, especially when perceiving a problem with patient care; speaking up is very important for patient safety, quality and efficiency in the patient treatment experience.

Compared to the other five dimensions in the study and this dimension in other studies [9, 14, 18, 39], the score and the positive response rates of Stress Recognition in the study were lower. The stress source (also called pressure source) is common in both China and other countries, but it is a far more serious issue in China because medical personnel’s job performance is affected to a great extent by insufficient human resources due to overwork, occupational stress, fatigue and other factors. Therefore, the medical environment and medical staff’s coping abilities and reaction intensity to stressful situations must be focused on and improved. Job burnout among medical staff is increasing, and satisfaction and loyalty are decreasing, which are important issues to address.

Four of five items in the Recognition of Management dimension showed disadvantages in the study, similar to the results in 2006 [9]. “For effective safety management, leadership plays an important role at every level of management, ranging from team leaders to middle managers at a tactical level to top-level managers at the strategic level.” [42]. Developing a hospital safety culture involves complicated system engineering; this culture must be constructed based on initiation from upper management, and leadership roles must be strengthened to drive the general organization’s cognitions and behavior changes toward safety recognition [43, 44].

In recent years, continued attention has been given to patient safety in domestic and foreign medical industries. Medical institutions in China are also committed to patient safety activities and have seen some advancements, while many patient safety projects focus on the improvement of unsafe factors in technology and procedures. Patient safety event reporting channels have been preliminarily established as part of the risk management system in hospitals in China since 2007, but the staff’s initiative and enthusiasm for reporting adverse events are affected by the punishment-based culture. Additionally, an effective safety culture has not been attained because appropriate feedback regarding the staff’s job performance cannot be obtained, and open discussion of errors and accidents in the department cannot be facilitated. Promotion activities related to safety culture in organizations are not being performed or effectively internalized [9], and the medical staff’s attitudes, cognition, abilities, and behavior patterns regarding patient safety still need to be improved.

A series of intervention strategies based on the principles of leadership, teamwork, and behavior changes have been designed and proven to be effective in improving both safety and patient outcomes in developed countries [45,46,47,48,49,50,51,52,53,54]; however, they are scarcely being applied in China. Executive Walk Rounds (EWRs) [47, 48] can enlist leadership to breakdown the significant barriers to discussion of human error in healthcare and help hospitals identify opportunities to improve care processes. They demonstrate the executives’ and the organization’s commitment to patient safety, and they may improve provider attitudes regarding safety-related issues. The Comprehensive Unit-based Safety Program (CUSP) [52] is a multifaceted strategy that includes elements of the science of safety training, safety hazard identification, senior executive partnership, learning from defects, and communication and teamwork. The Triad for Optimal Patient Safety Project (TOPS) [53] is expected to closely address teamwork within the unit and communication through an interdisciplinary team training intervention, involvement of a unit-based safety team to continue safety-focused teamwork, and establishment of a method for engaging patients within the multidisciplinary team. In addition, the establishment of a patient safety culture can be effectively combined with specific actions to enable safer patients to form a multiple-component organizational patient safety intervention project [54].

Due to the limitations of the study sample size, these results may not represent the overall data for Beijing hospitals, and the validation sample should be expanded in future research. The association between safety culture and patient outcomes also needs to be examined because the ultimate goal is to build a safe health system and reduce adverse medical events.

Conclusions

As a valid assessment tool, the SAQ Short-Form in Chinese is suitable for the evaluation of safety culture in diverse clinical areas in Beijing hospitals. It demonstrates good psychometric properties, while some items require localization and further adaptation. This study provides baseline data for long-term continuous assessment and a reasonable basis for further targeted measures. The safety culture in most hospitals is not fully established and needs to be improved through intervention strategies. To insert the concept of “first, do no harm” into each unit and every operation code in the healthcare organization [55], we should accurately understand and grasp the connotation of a safety culture and its basic elements, highlight the important influence of human factors on the safety of patients, emphasize the important role of safety culture at every level of management, and constantly improve communication and cooperation within the team and between teams.

Abbreviations

AGFI:

Adjusted goodness-of-fit index

AIC:

Akaike information criteria

CAIC:

The Consistent Version of AIC

CFI:

Comparative fit index

CN:

Critical N

CVI:

Content validity index

ECVI:

Expected cross-validation index

FMAQ:

Flight Management Attitude Questionnaire

GFI:

Goodness-of-fit index

ICU:

Intensive care Unit

I-CVI:

Content validity index at the item level

IFI:

Incremental fit index

NC:

Normalized chi-square

NCP:

Non-centrality parameter

NFI:

Normed fit index

PGFI:

Parsimony Goodness-of-Fit Index

PNFI:

Parsimonious Normed Fit Index

RFI:

Relative fit index

RMR:

Root mean square residual

RMSEA:

Root mean square error of approximation

SAQ:

Safety Attitudes Questionnaire

S-CVI:

Content validity index at the scale level

TLI:

Tacker-Lewis index

References

  1. Institute of Medicine (US) Committee on Quality of Health Care in America, Kohn LT, Corrigan JM, Donaldson MS. To err is human: building a safer health system. Washington: National Academies Press; 2000.

    Google Scholar 

  2. Xuanyue M, Yanli N, Hao C, Pengli J, Mingming Z. Literature review regarding patient safety culture. J Evid Based Med. 2013;6:43–9. doi:10.1111/jebm.12020.

    Article  PubMed  Google Scholar 

  3. Nieva VF, Sorra J. Safety culture assessment: a tool for improving patient safety in healthcare organizations. Qual Saf Health Care. 2003;12(Suppl 2):ii17–23. doi:10.1136/qhc.12.suppl_2.ii17

    PubMed  PubMed Central  Google Scholar 

  4. Flin R, Winter J, Sarac C, Raduma M. Human factors in patient safety, review of topics and tools. Geneva: World Health Organization; 2009.

    Google Scholar 

  5. DiCuccio MH. The relationship between patient safety culture and patient outcomes: a systematic review. J Patient Saf. 2015;11:135–42. doi:10.1097/PTS.0000000000000058

    Article  PubMed  Google Scholar 

  6. Singer S, Lin S, Falwell A, Gaba D, Baker L. Relationship of safety climate and safety performance in hospitals. Health Serv Res. 2009;44:399–421. doi:10.1111/j.1475-6773.2008.00918.x

    Article  PubMed  PubMed Central  Google Scholar 

  7. Mardon RE, Khanna K, Sorra J, Dyer N, Famolaro T. Exploring relationships between hospital patient safety culture and adverse events. J Patient Saf. 2010;6:226–32. doi:10.1097/PTS.0b013e3181fd1a00

    Article  PubMed  Google Scholar 

  8. Huang DT, Clermont G, Kong L, Weissfeld LA, Sexton JB, Rowan KM, Angus DC. Intensive care unit safety culture and outcomes: a US multicenter study. Int J Qual Health Care. 2010;22:151–61. doi:10.1093/intqhc/mzq017

    Article  PubMed  PubMed Central  Google Scholar 

  9. Sexton JB, Helmreich RL, Neilands TB, Rowan K, Vella K, Boyden J, Roberts PR, Thomas EJ. The safety attitudes questionnaire: psychometric properties, benchmarking data, and emerging research. BMC Health Serv Res. 2006;6:44. doi:10.1186/1472-6963-6-44

    Article  PubMed  PubMed Central  Google Scholar 

  10. Sorra JS, Dyer N. Multilevel psychometric properties of the AHRQ hospital survey on patient safety culture. BMC Health Serv Res. 2010;10:199. doi:10.1186/1472-6963-10-199

    Article  PubMed  PubMed Central  Google Scholar 

  11. Singer SJ, Gaba DM, Geppert JJ, Sinaiko AD, Howard SK, Park KC. The culture of safety: results of an organization-wide survey in 15 California hospitals. Qual Saf Health Care. 2003;12:112–8. doi:10.1136/qhc.12.2.112

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  12. Ashcroft DM, Morecroft C, Parker D, Noyce PR. Safety culture assessment in community pharmacy: development, face validity, and feasibility of the Manchester patient safety assessment framework. Qual Saf Health Care. 2005;14:417–21. doi:10.1136/qshc.2005.014332

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  13. Colla JB, Bracken AC, Kinney LM, Weeks WB. Measuring patient safety climate: a review of surveys. Qual Saf Health Care. 2005;14:364–6. doi:10.1136/qshc.2005.014217

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  14. Nordén-Hägg A, Sexton JB, Kälvemark-Sporrong S, Ring L, Kettis-Lindblad A. Assessing safety culture in pharmacies: the psychometric validation of the safety attitudes questionnaire (SAQ) in a national sample of community pharmacies in Sweden. BMC Clin Pharmacol. 2010;10:8. doi:10.1186/1472-6904-10-8

    Article  PubMed  PubMed Central  Google Scholar 

  15. Göras C, Wallentin FY, Nilsson U, Ehrenberg A. Swedish translation and psychometric testing of the safety attitudes questionnaire (operating room version). BMC Health Serv Res. 2013;13:104. doi:10.1186/1472-6963-13-104

    Article  PubMed  PubMed Central  Google Scholar 

  16. Deilkås ET, Hofoss D. Psychometric properties of the Norwegian version of the safety attitudes questionnaire (SAQ), generic version(short form 2006). BMC Health Serv Res. 2008;8:191. doi:10.1186/1472-6963-8-191

    Article  PubMed  PubMed Central  Google Scholar 

  17. Chaboyer W, Chamberlain D, Hewson-Conroy K, Grealy B, Elderkin T, Brittin M, McCutcheon C, Longbottom P, Thalib L. CNE article: safety culture in Australian intensive care units: establishing a baseline for quality improvement. Am J Crit Care. 2013;22:93–102. doi:10.4037/ajcc2013722

    Article  PubMed  Google Scholar 

  18. Nguyen G, Gambashidze N, Ilyas SA, Pascu D. Validation of the safety attitudes questionnaire (short form 2006) in Italian in hospitals in the northeast of Italy. BMC Health Serv Res. 2015;15:284. doi:10.1186/s12913-015-0951-8

    Article  PubMed  PubMed Central  Google Scholar 

  19. Kaya S, Barsbay S, Karabulut E. The Turkish version of the safety attitudes questionnaire: psychometric properties and baseline data. Qual Saf Health Care. 2010;19:572–7. doi:10.1136/qshc.2008.032003

    PubMed  Google Scholar 

  20. Lee WC, Wung HY, Liao HH, Lo CM, Chang FL, Wang PC, Fan A, Chen HH, Yang HC, Hou SM. Hospital safety culture in Taiwan: a nationwide survey using Chinese version safety attitude questionnaire. BMC Health Serv Res. 2010;10:234. doi:10.1186/1472-6963-10-234

    Article  PubMed  PubMed Central  Google Scholar 

  21. Jones KJ, Skinner A, Xu L, Sun J, Mueller K. The AHRQ Hospital survey on patient safety culture: a tool to plan and evaluate patient safety programs. In: Henriksen K, Battles JB, Keyes MA, editors. Advances in patient safety: new directions and alternative approaches (Vol. 2: culture and redesign). Agency for Healthcare Research and Quality: Rockville; 2008.

    Google Scholar 

  22. Helmreich RL, Merritt AC. Culture at work in aviation and medicine: national, organizational, and professional influences. Aldershot: Ashgate; 1998.

    Google Scholar 

  23. Sexton JB, Thomas EJ, Helmreich RL. Error, stress, and teamwork in medicine and aviation: cross sectional surveys. BMJ. 2000;320:745–9. doi:10.1136/bmj.320.7237.745

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  24. Vincent C, Taylor-Adams S, Stanhope N. Framework for analysing risk and safety in clinical medicine. BMJ. 1998;316:1154–7. doi:10.1136/bmj.316.7138.1154

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  25. Donabedian A. The quality of care. How can it be assessed? JAMA. 1988;260:1743–8. doi:10.1001/jama.1988.03410120089033

    Article  CAS  Google Scholar 

  26. Modak I, Sexton JB, Lux TR, Helmreich RL, Thomas EJ. Measuring safety culture in the ambulatory setting: the safety attitudes questionnaire-ambulatory version. J Gen Intern Med. 2007;22:1–5. doi:10.1007/s11606-007-0114-7

    Article  PubMed  PubMed Central  Google Scholar 

  27. Cronbach LJ. Coefficient alpha and the internal structure of tests. Psychometrika. 1951;16:297–334. doi:10.1007/BF02310555

    Article  Google Scholar 

  28. Nunnaly JC, Bernstein IH. Psychometric theory. 3rd ed. New York: McGraw-Hill; 1994.

    Google Scholar 

  29. Streiner DL. Starting at the beginning: an introduction to coefficient alpha and internal consistency. J Pers Assess. 2003;80:99–103. doi:10.1207/S15327752JPA8001_18

    Article  PubMed  Google Scholar 

  30. Bryman BA, Cramer D. Quantitative data analysis with SPSS for windows. London: Routledge; 1997.

    Google Scholar 

  31. Lynn MR. Determination and quantification of content validity. Nurs Res. 1986;35:382–5. doi:10.1097/00006199-198611000-00017

    Article  CAS  PubMed  Google Scholar 

  32. Davis LL. Instrument review: getting the most from a panel of experts. Appl Nurs Res. 1992;5:194–7. doi:10.1016/S0897-1897(05)80008-4

    Article  Google Scholar 

  33. Hair JF, Black WC, Babin BJ, Anderson RE, Tatham RL. Multivariate data analysis. Upper Saddle River: Pearson Education, Inc.; 2006.

    Google Scholar 

  34. Jöreskog KG, PRELISSD. User’s reference guide, vol. 2. Lincolnwood: Scientific Software International; 2002.

    Google Scholar 

  35. Carmines EG, Mciver JP. Analyzing models with unobserved variables: analysis of covariance structures. Beverly Hills: Sage Publications; 1981.

    Google Scholar 

  36. Hu L, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct Equ Model. 1999;6:1–55. doi:10.1080/10705519909540118

    Article  Google Scholar 

  37. Hoope D, Coughlan J, Mullen M. Structural equation modelling: guidelines for determining model fit. Electron J Bus Res Methods. 2008;6:53–60.

    Google Scholar 

  38. Zhu J, Li L, Zhao H, Han G, Wu AW, Weingart SN. Development of a patient safety climate survey for Chinese hospitals: cross-national adaptation and psychometric evaluation. BMJ Qual Saf. 2014;23:847–56. doi:10.1136/bmjqs-2013-002664

    Article  PubMed  Google Scholar 

  39. Taylor JA, Pandian R. A dissonant scale: stress recognition in the SAQ. BMC Res Notes. 2013;6:302. doi:10.1186/1756-0500-6-302

    Article  PubMed  PubMed Central  Google Scholar 

  40. Gallego B, Westbrook MT, Dunn AG, Braithwaite J. Investigating patient safety culture across a health system: multilevel modelling of differences associated with service types and staff demographics. Int J Qual Health Care. 2012;24:311–20. doi:10.1093/intqhc/mzs028

    Article  PubMed  Google Scholar 

  41. Pettker CM, Thung SF, Raab CA, Donohue KP, Copel JA, Lockwood CJ, Funai EF. A comprehensive obstetrics patient safety program improves safety climate and culture. Am J Obstet Gynecol. 2011;204:216.e1–6. doi:10.1016/j.ajog.2010.11.004

    Article  Google Scholar 

  42. Human factors in patient safety, Review of topics and tools. World Health Organization (WHO); 2009.

    Google Scholar 

  43. Sammer CE, Lykens K, Singh KP, Mains DA, Lackan NA. What is patient safety culture? A review of the literature. J Nurs Scholarsh. 2010;42:156–65. doi:10.1111/j.1547-5069.2009.01330.x

    Article  PubMed  Google Scholar 

  44. Clarke JR, Lerner JC, Marella W. The role for leaders of health care organizations in patient safety. Am J Med Qual. 2007;22:311–8. doi:10.1177/1062860607304743

    Article  PubMed  Google Scholar 

  45. Weaver SJ, Lubomksi LH, Wilson RF, Pfoh ER, Martinez KA, Dy SM. Promoting a culture of safety as a patient safety strategy: a systematic review. Ann Intern Med. 2013;158:369–74. doi:10.7326/0003-4819-158-5-201303051-00002

    Article  PubMed  PubMed Central  Google Scholar 

  46. Morello RT, Lowthian JA, Barker AL, McGinnes R, Dunt D, Brand C. Strategies for improving patient safety culture in hospitals: a systematic review. BMJ Qual Saf. 2013;22:11–8. doi:10.1136/bmjqs-2011-000582

    Article  PubMed  Google Scholar 

  47. Frankel A, Grillo SP, Pittman M, Thomas EJ, Horowitz L, Page M, Sexton B. Revealing and resolving patient safety defects: the impact of leadership walk rounds on frontline caregiver assessments of patient safety. Health Serv Res. 2008;43:2050–66. doi:10.1111/j.1475-6773.2008.00878.x

    Article  PubMed  PubMed Central  Google Scholar 

  48. Thomas EJ, Sexton JB, Neilands TB, Frankel A, Helmreich RL. The effect of executive walk rounds on nurse safety climate attitudes: a randomized trial of clinical units [ISRCTN85147255] [corrected]. BMC Health Serv Res. 2005;5:28. doi:10.1186/1472-6963-5-28

    Article  PubMed  PubMed Central  Google Scholar 

  49. Bleakley A, Boyden J, Hobbs A, Walsh L, Allard J. Improving teamwork climate in operating theatres: the shift from multiprofessionalism to interprofessionalism. J Interprof Care. 2006;20:461–70. doi:10.1080/13561820600921915

    Article  PubMed  Google Scholar 

  50. O’Leary KJ, Wayne DB, Haviley C, Slade ME, Lee J, Williams MV. Improving teamwork: impact of structured interdisciplinary rounds on a medical teaching unit. J Gen Intern Med. 2010;25:826–32. doi:10.1007/s11606-010-1345-6

    Article  PubMed  PubMed Central  Google Scholar 

  51. Guerlain S, Turrentine FE, Bauer DT, Calland JF, Adams R. Crew resource management training for surgeons: feasibility and impact. Cogn Tech Work. 2008;10:255–64. doi:10.1007/s10111-007-0091-y

    Google Scholar 

  52. Paine LA, Rosenstein BJ, Sexton JB, Kent P, Holzmueller CG, Pronovost PJ. Assessing and improving safety culture throughout an academic medical centre: a prospective cohort study. Qual Saf Health Care. 2010;19:547–54. doi:10.1136/qshc.2009.039347

    PubMed  Google Scholar 

  53. Blegen MA, Sehgal NL, Alldredge BK, Gearhart S, Auerbach AA, Wachter RM. Improving safety culture on adult medical units through multidisciplinary teamwork and communication interventions: the TOPS project. Qual Saf Health Care. 2010;19:346–50. doi:10.1136/qshc.2008.031252

    Article  CAS  PubMed  Google Scholar 

  54. Benning A, Ghaleb M, Suokas A, Dixon-Woods M, Dawson J, Barber N, Franklin BD, Girling A, Hemming K, Carmalt M, Rudge G, Naicker T, Nwulu U, Choudhury S, Lilford R. Large scale organisational intervention to improve patient safety in four UK hospitals: mixed method evaluation. BMJ. 2011;342:d195. doi:10.1136/bmj.d195

    Article  PubMed  PubMed Central  Google Scholar 

  55. Han G. Hospital culture of safety and medical safety. Chin J Hosp Admin. 2004;20:129–31. doi:10.3760/j.issn:1000-6672.2004.03.001

    Google Scholar 

Download references

Acknowledgements

Funds were provided by the Beijing Research Base of Philosophy and Social Sciences Planning Project (13JDSHA004).

The authors thank the developer, Bryan Sexton, for providing access to the SAQ (Short Form 2006) and the Taiwan Joint Commission on Hospital Accreditation (TJCHA), especially Dr. Wui-Chiang Lee, for their research assistance, and the expert committee for their valuable contributions. We also thank the hospitals that participated in the survey and all healthcare providers and managers who offered valuable suggestions for the study.

Funding

Philosophy and Social Science Research Base Project of Beijing (13JDSHA004).

Availability of data and materials

The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.

Author information

Authors and Affiliations

Authors

Contributions

XX initiated and planned the project, administered the survey, analyzed and interpreted the data, drafted and revised the manuscript, and issued final approval. YC designed and administered the study; conducted the survey, data collection, and analysis; interpreted the data; drafted the manuscript; revised the manuscript; and issued final approval. JZ and JF participated in the design of the study; conducted the study, data collection, and analysis; interpreted the data; revised the manuscript; and issued the final approval. XD, AL and JZ performed the data collection, analysis, and interpretation of the data; revised the manuscript; and issued final approval. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Xiuming Xi.

Ethics declarations

Ethics approval and consent to participate

We obtained approval from the ethics committee of Fu Xing Hospital, Capital Medical University. Ethical considerations were met, and responding to the questionnaire was voluntary and anonymous. All answers were de-identified to maintain confidentiality.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Additional file

Additional file 1:

The Safety Attitudes Questionnaire in Chinese. (DOCX 283 kb)

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Cui, Y., Xi, X., Zhang, J. et al. The safety attitudes questionnaire in Chinese: psychometric properties and benchmarking data of the safety culture in Beijing hospitals. BMC Health Serv Res 17, 590 (2017). https://doi.org/10.1186/s12913-017-2543-2

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12913-017-2543-2

Keywords