The characteristics of patient safety culture in Japan, Taiwan and the United States

Abstract

Background

Quality and safety issues are receiving growing attention. Patient safety culture (PSC) plays an important role in patient safety. The characteristics of PSC in various countries, each with a different set of values, have not been determined sufficiently. The aim of this study is to investigate the characteristics of PSC in Japan, Taiwan and the U.S.

Methods

A cross-sectional survey was conducted in Japan and Taiwan using the Hospital Survey on PSC (HSOPS) questionnaire developed by the U.S. Agency for Healthcare Research and Quality (AHRQ). Data from Japan and Taiwan were also compared with the U.S. “2010 HSOPS Comparative Database” provided by AHRQ.

Results

Valid response rates in Japan, Taiwan and the U.S. were 66.5% (6,963/10,466), 85.7% (10,019/11,692) and 35.2% (291,341/827,424), respectively. The proportion of respondents with some experience of event reporting during the past 12 months was highest in Japan. In general, U.S. healthcare workers were likely to evaluate their PSC higher than that in Japan or Taiwan. The attitude of continuous improvement in Japan and event reporting of near misses in Taiwan were rated as low. In the U.S., staffing was rated as high.

Conclusions

The results suggest that PSC varies among different countries, and the cultural setting of each country should be given special consideration in the development of effective intervention plans to improve PSC. Additional investigations with improved methodology and a common protocol are required to accurately compare PSCs among countries.

Background

Quality and safety issues in healthcare continue to receive a growing amount of attention. The role of patient safety culture (PSC) is regarded as important for patient safety. A positive PSC is considered to guide many discretionary behaviours of healthcare professionals towards viewing patient safety as one of their highest priorities [1]. PSC is defined as the product of individual and group values, attitudes, perceptions, competencies, and patterns of behaviour, which determine the commitment to and the style and proficiency of an organization's health and safety management [2]. Although several measurement tools were developed, the Hospital Survey on PSC (HSOPS), which was developed by the U.S. Agency for Healthcare Research and Quality (AHRQ), is used widely all over the world [3–7]. Previous studies that used subjects from a country reported internal consistency and construct validity [3–7]. HSOPS was also used to assess the effect of interventions for improving patient safety such as encouraging teamwork within hospital units [8–11]. Although HSOPS subjectively evaluates safety-related responses, it did report on the relationship between clinical outcomes and the PSC values measured by HSOPS [11]. PSC may differ according to professions, units, hospitals, countries, and others. Although multiple studies have referred to PSC results obtained in other studies, few statistical analyses have been conducted [5–7, 12, 13]. Chen et al. (2010) used statistical analysis to compare Taiwanese and U.S. PSC, and highlighted some of the characteristics of Taiwanese healthcare workers [7]. However, the subjects originated from teaching hospitals, and the sample size appeared insufficient to understand the characteristics of Taiwanese healthcare workers. For international comparisons of PSC, diverging values should be considered because PSC could be affected by race, religion, healthcare system, and other similar variables. The PSC characteristics from countries with different values have not been explored sufficiently. We hypothesized that PSC characteristics were similar among East Asian countries, whose cultures were closely related, and different from those of western countries, whose cultures include heterogeneous customs such as interpersonal relationships. The aim of this study is to investigate and compare the PSC characteristics of Japan, Taiwan, and the U.S.

Methods

For comparing PSC, we conducted a questionnaire-based, anonymous, and self-administered cross-sectional survey to healthcare workers in Japan and Taiwan. The HSOPS questionnaire was used to measure PSC in each country. Japanese and Taiwanese data were also compared with the U.S. ‘2010 HSOPS Comparative Database’, which was provided by AHRQ. The survey period and recruitment strategy of hospitals and respondents in each country differed from one another; details are listed in Table 1[2, 14, 15]. Only acute care hospitals participated in this study because the questionnaire was developed only for this type of hospital.

Table 1 Materials and response rates

Measures

HSOPS had 51 questions and assessed healthcare worker opinions or attitudes about patient safety issues, errors in hospital settings, or event reporting. It included 42 items that measure 12 sub-dimensions of PSC, 2 items regarding PSC outcome measures, and 6 items regarding background information of the respondent. Each item used a Likert scale of 5-point response options of degree of agreement (1: strongly disagree to 5: strongly agree) or frequency (1: never to 5: always). The questions related to the PSC outcome measures included both a Patient Safety Grade that asked respondents to provide an overall grade on patient safety in their respective departments (1: failing to 5: excellent) and a Number of Events that asked respondents to provide the number of events they reported during the previous 12 months (1: no event to 5: 21 events or more). The requested background information included years in current profession, hours of work per week, and direct interaction with patients [2, 15].

The sub-dimensions of PSC consisted of (1) Frequency of Events Reported, (2) Overall Perceptions of Safety, (3) Supervisor/Manager Expectations and Actions Promoting Safety, (4) Organizational Learning/Continuous Improvement, (5) Teamwork within Hospital Units, (6) Communication Openness, (7) Feedback and Communication about Error, (8) Non-punitive Response to Error, (9) Staffing, (10) Hospital Management Support for Patient Safety, (11) Teamwork Across Hospital Units, and (12) Hospital Handoffs and Transitions.

For each sub-dimension, the proportion of positive responses (percent positive score) was calculated for every respondent based on the AHRQ instructions, and it ranged from 0 to 1; higher scores indicated a more positive PSC. The total score of each sub-dimension, which was the sum of the item scores within each sub-dimension, was also calculated and ranged from 3 to 20; higher scores indicated a positive PSC. Although the percent positive scores were recommended by AHRQ for use in analysis, the total scores may have contained more respondent information because total scores reflect the 5-point response to each item. Results with greater accuracy may have been achieved if the total scores were used for the comparisons [2, 15].

The HSOPS questionnaire was translated into Japanese and Mandarin. For the Mandarin version, backward translation was performed to confirm that the accuracy of the questionnaire was maintained. In contrast, the Japanese version was translated by a panel comprising a bilingual English–Japanese translators and specialists in patient safety, and backward translation was not used; other experts in safety culture verified the accuracy of the translation [14].

Data analysis

To estimate internal consistency, we used Cronbach’s α to calculate values with each sub-dimension of each country. The percent positive scores, total scores, and other items belonging to a particular sub-dimension were compared among Japan, Taiwan, and the U.S. using Tukey’s honestly significantly different (HSD) test. In addition, the impact of each effect (Cohen’s d) was calculated by dividing the difference in score means of 2 countries by the pooled standard deviation. In our study, an absolute value of Cohen’s d of at least 0.5 indicated that the difference was significant. Chi-square tests were used to compare categorical variables. Statistical analyses were conducted using SPSS 19.0 (SPSS Inc.; Chicago, IL, USA).

Ethical concerns

According to the Ethical Guidelines for Epidemiological Research, which was drawn up by the Japanese government, the approval of the ethics committee was not required because it was an anonymous and self-administered survey with no intervention or mental anguish [16]. In Taiwan, the survey was approved by Institutional Human subject Ethic Committee of National Chung Cheng University.

Results

The response rates for each country are listed in Table 1. Respondent characteristics are shown in Table 2. Among the respondents, a significantly lower proportion of nurses were included in the U.S. (36.6%) compared with Japan (58.1%, P < 0.01) and Taiwan (57.0%, P < 0.01). The proportion of U.S. respondents who worked fewer than 40 hours per week (40.4%) was significantly higher than that of either Japan (23.6%, P < 0.01) or Taiwan (14.1%, P < 0.01). The proportion in Japan who reported at least 1 adverse event or near-miss event during the previous 12 months (64.0%) was significantly higher than that in Taiwan (48.0%, P < 0.01) and the U.S. (46.6%, P < 0.01). With regard to Patient Safety Grade, the proportion of U.S. respondents who answered ‘excellent’ or ‘very good’ (70.8%) was significantly higher than that in Japan (44.6%, P < 0.01) or Taiwan (37.7%, P < 0.01).

Table 2 Respondent characteristics

Cronbach’s α for each sub-dimension in Japan, Taiwan, and the U.S. was 0.47–0.88, 0.26–0.83, and 0.61–0.87, respectively (Additional file 1).

The mean total and percent positive scores based on sub-dimension are listed in Table 3. The mean score differences among Japan, Taiwan, and the U.S. are shown in Table 4. Although most pairs exhibited significant differences, only some sub-dimensions had pairs with significant differences according to Cohen’s d. In Japan, ‘Organizational Learning/Continuous Improvement’ received the lowest rating among all 3 countries, and ‘Hospital Management Support for Patient Safety’ received a rating lower than that in the U.S. In Taiwan, ‘Frequency of Events Reported’ received the lowest rating among all 3 countries, and ‘Communication Openness’ received a lower rating than that in the U.S. In the U.S., ‘Staffing’ received the highest rating among all 3 countries.

Table 3 Total scores and percent positive scores in each sub-dimension

Table 4 Comparison of total scores and percent positive scores from each sub-dimension across Japan, Taiwan and the U.S.

The mean score for each item under each of the 5 sub-dimensions is shown in Figure 1, and the mean score differences among Japan, Taiwan, and the U.S. are shown in Additional file 2. In Taiwan, the scores for most items under sub-dimension ‘Frequency of Events Reported’ were significantly lower than the scores in other countries. In Japan, the mean score of A13, the item on evaluations of improvement effect, received the lowest rating among all 3 countries. In the U.S., the mean score of C2, the item regarding staff capacity to point out poor care of patients by other staff, received the highest rating among all 3 countries.

Figure 1

The scores of each item in the 5 sub-dimensions.

Discussion

With regard to PSC outcome indicators, Japan had the highest proportion of respondents who had experienced event-reporting during the past 12 months, and the Patient Safety Grade was the highest in the U.S. Regarding PSC characteristics, an attitude of continuous improvement in Japan and the reporting of near-miss events in Taiwan were evaluated low among all 3 countries. In the U.S., staffing received a high rating.

PSC characteristics in each country

For continuous improvement of safety and quality, organizations need to construct a Deming Cycle or analyse the course of adverse events to mitigate recurrence [17]. However, in Japan, the sub-dimension ‘Organizational Learning/Continuous Improvement’ was rated low due to the lack of evaluation on the effectiveness of changes implemented to improve patient safety. In the past, these types of improvement assessments were absent in most U.S. hospitals as well [18]. The evaluation systems used for improvement, such as monitoring or benchmarking, require quality indicators. These evaluations require management and institutional support for patient safety because related activities may be taxing in the work place and may minimize productivity. Therefore, in Japan, the lack of ‘Organizational Learning/Continuous Improvement’ and ‘Hospital Management Support for Patient Safety’ may be related.

Under-reporting of adverse events in healthcare settings is a common problem throughout the world [19]. Several studies have revealed that healthcare workers often do not report adverse events for fear of management reaction, blame, or being deemed incompetent. A culture of non-punitive response to error is required in healthcare settings [19–21]. In Taiwan, the attitude towards reporting near-miss events, which is reflected in the evaluation of sub-dimension ‘Frequency of Events Reported’, received the lowest rating among all 3 countries. The sub-dimension ‘Non-punitive Response to Error’ also received a low rating in Taiwan. In Chinese societies, authoritarianism is considered an important feature of leadership; and higher ranking individuals tend to speak poorly of subordinates in an effort to maintain their own dominance [22]. In addition, ‘face-saving’ is also considered an important tenet of interpersonal interactions in East Asian societies, and healthcare workers in Taiwan may fear to ‘lose face’ by reporting events [21, 22]. This phenomenon may explain the lack of ‘Communication Openness’ in Taiwan; this sub-dimension includes several items that explore reporting possibilities with regard to a co-worker’s faults. Taiwanese individuals may be more likely to avoid reporting the faults of co-workers because intra-group harmony and in-group solidarity are emphasized in East Asian societies, and saving face of a co-worker is important to Taiwanese healthcare workers [21, 22]. Those cultures in Taiwan also may affect attitudes toward reporting of near-miss events. Japanese healthcare workers were more likely to report near-miss events, despite Japan being an East Asian country. Japanese healthcare workers may have become familiar with event-reporting systems because nearly a decade has passed since all Japanese hospitals established an in-house, legally bound event-reporting system in 2002.

In the U.S., the sub-dimension ‘Staffing’ received high ratings because of the higher number of healthcare workers in U.S. hospitals than that in Japan and Taiwan. According to ‘OECD Health Data 2010’ and national statistics of Taiwan, the number of nurses per bed was 5 times higher (3.4) than that in Japan (0.7), and 4 times higher than that in Taiwan (0.8) [23, 24]. U.S. hospitals may encourage job-sharing and part-time schedules because the proportion of U.S. respondents who work fewer than 40 hours per week was significantly higher than that in Japan or Taiwan. By varying the number of part-time workers, U.S. hospitals may be better positioned to adapt the number of healthcare workers to sudden changes in demand of manpower. In U.S. hospitals, temporary nurses, who are identified as ‘agency nurses’ or ‘travel nurses’ are hired [25]. In the contrast, most hired nurses in the Japanese and Taiwanese hospitals are permanent staff.

Japanese healthcare workers had more event-reporting experience than Taiwan or the U.S. A possible explanation may lie in the high rating that Japan received for the sub-dimension ‘Non-punitive Response to Error’; however, the U.S. exhibited a rating for this sub-dimension similar to that of Japan. Other U.S. factors, such as self-protection against legal action or job loss, may contribute to the smaller proportion of U.S. respondents who noted experiences of event-reporting. The small proportion of nurses in the U.S. respondent pool also may have affected this rating because, as is widely known, most event reports originate from nurses [26]. In addition, the definitions or perceptions of reportable events may differ across the 3 countries.

Challenges associated with PSC comparison

In a cross-cultural study, the differences among societies were shown to be influenced by several factors, such as study design, traditional values, or socioeconomic status [22]. The first problem is translation accuracy of the questionnaire in the context of culture [22]. Most sub-dimensions, except ‘Overall Perceptions of Patient Safety’ in Taiwan, exhibit sufficient internal consistency. Relatively low levels of internal consistency related to ‘Staffing’ were common in all 3 countries, and similar problems were pointed out in other studies conducted outside the U.S [3, 6, 13]. The problem may not be translation but rather the items that comprise the sub-dimension ‘Staffing’. Employment system characteristics of each country should be reflected in these items.

The second problem pertains to target population representation [27]. Taiwanese hospitals were selected according to stratified sampling techniques, but Japanese and U.S. hospitals participated voluntarily. The voluntary hospitals may be more aware of PSC, and thereby, the respondents in Japan and the U S may have better PSC compared with respondents in Taiwan. The U.S. response rate was lower than the response rate in Japan and Taiwan, and the characteristics of non-respondents were unknown [28].

The third problem is the central tendency response pattern [29]. For example, with regard to Patient Safety Grade, Japanese and Taiwanese respondents were more likely to choose ‘Acceptable’, which was the central option of the 5-point Likert scale. This selection pattern may lead to a skewed proportion of ‘Excellent’ and ‘Very Good’ responses in Japan and Taiwan that are lower than those in the U.S. In East Asian societies, people may be more inclined to offer ambiguous opinions because they fear that clear or extreme opinions occasionally may yield adverse effects on intra-group harmony and in-group solidarity [21, 22]. In this study, the percent positive score results were similar to total score results, which suggests that the effect of this central tendency was small.

The fourth problem is that the comparison was based on subjective evaluations of PSC. Subjective evaluation often is inconsistent with objective evaluations because it is influenced by multiple factors, including internal predispositions of respondents [30]. To identify the impacts of different PSC on objective outcomes of patient safety, we need tools such as Patient Safety Indicators. PSC in each country should be adjusted according to objective data with regard to patient safety.

Conclusions

Healthcare workers in the U.S. were likely to evaluate their PSC as higher than that in Japan or Taiwan. The attitudes towards continuous improvement in Japanese healthcare workers and the reporting of near-miss events in Taiwanese healthcare workers were evaluated as low. The results of this study suggest that PSC varies among different countries, and the effective intervention to improve PSC should be developed with focus on the cultural background of the country. Further investigations with improved methodology and a common protocol will be required for accurate comparison of PSC among countries.