Skip to main content
Download PDF
  • Research article
  • Open access
  • Published:

Cross-cultural validation and psychometric testing of the Norwegian version of the TeamSTEPPS® teamwork perceptions questionnaire

BMC Health Services Research volume 17, Article number: 799 (2017) Cite this article

Abstract

Background

Teamwork is an integrated part of today’s specialized and complex healthcare and essential to patient safety, and is considered as a core competency to improve twenty-first century healthcare. Teamwork measurements and evaluations show promising results to promote good team performance, and are recommended for identifying areas for improvement. The validated TeamSTEPPS® Teamwork Perception Questionnaire (T-TPQ) was found suitable for cross-cultural validation and testing in a Norwegian context. T-TPQ is a self-report survey that examines five dimensions of perception of teamwork within healthcare settings. The aim of the study was to translate and cross-validate the T-TPQ into Norwegian, and test the questionnaire for psychometric properties among healthcare personnel.

Methods

The T-TPQ was translated and adapted to a Norwegian context according to a model of a back-translation process. A total of 247 healthcare personnel representing different professionals and hospital settings responded to the questionnaire. A confirmatory factor analysis was carried out to test the factor structure. Cronbach’s alpha was used to establish internal consistency, and an Intraclass Correlation Coefficient was used to assess the test - retest reliability.

Result

A confirmatory factor analysis showed an acceptable fitting model (χ2 (df) 969.46 (546), p < 0.001, Root Mean Square Error of Approximation (RMSEA) = 0.056, Tucker-Lewis Index (TLI) = 0.88, Comparative fit index (CFI) = 0.89, which indicates that each set of the items that was supposed to accompany each teamwork dimension clearly represents that specific construct. The Cronbach’s alpha demonstrated acceptable values on the five subscales (0.786–0.844), and test-retest showed a reliability parameter, with Intraclass Correlation Coefficient scores from 0.672 to 0.852.

Conclusion

The Norwegian version of T-TPQ was considered to be acceptable regarding the validity and reliability for measuring Norwegian individual healthcare personnel’s perception of group level teamwork within their unit. However, it needs to be further tested, preferably in a larger sample and in different clinical settings.

Peer Review reports

Background

Teamwork is integrated into today’s specialized and complex healthcare [1], and is a critical component for patient safety [2]. Furthermore, teamwork is ranked as a core competency to help improve twenty-first century healthcare services [3]. The WHO estimates that 3% to 16% of all patients are affected by adverse events while receiving hospital care [4], and that a large portion of these events are considered to be preventable [5, 6]. Research demonstrates that poor teamwork is an independent cause of many of the system failures that lead to patient harm [7,8,9]. Team training has been widely recognized in the patient safety literature as a method to optimize teamwork, thereby improving patient outcomes in healthcare [10,11,12]. Teamwork is described in terms of behaviour, cognitions and attitudes that make interdependent performance possible [13], and is defined as: “The interaction or relationship of two or more health professionals who work interdependently to provide care for patients” ([14], p. 3). In Norway, previous studies in teamwork training have focused on acute and trauma care settings [15, 16] and the effects on participants’ self-reported knowledge and confidence [17], different simulation modalities [18] and the performance of emergency teams [19]. A recent review of patient safety literature found a few Nordic, though no Norwegian studies measuring the perception of teamwork in the hospital settings [20].

In response to the importance of teamwork in improving patient safety in healthcare, the US Agency for Healthcare Research and Quality (AHRQ), in collaboration with the Department of Defense, developed the team training programme, Team Strategies and Tools to Enhance Performance and Patient Safety (TeamSTEPPS®) [21]. From 2006, TeamSTEPPS® has been the national standard for team training in US healthcare [21]. TeamSTEPPS® is an evidence-based team training programme and framework based on more than 30 years of teamwork, team training and cultural change research [22,23,24]. The purpose of TeamSTEPPS® is to improve team structure and team competencies, such as communication, leadership, situation monitoring and mutual support to promote quality, patient safety and the efficiency of healthcare services [25]. These are competencies, referred to in the “Big Five Model of Teamwork” by Salas et al. [24], as essential competencies that affect team performance. The programme provides tools, strategies and measurements to promote team practice in all aspects of healthcare service [25], and uses an implementation strategy based on Kotter’s model of organizational change [26]. Studies of TeamSTEPPS® demonstrate an improvement in patient safety culture [27,28,29], an improved efficiency in the delivery of patient care and treatment [27, 28, 30] and a reduction in patient complications [31]. Moreover, a correlation between the implementation of TeamSTEPPS® and a reduction in patient mortality has been documented [31].

Despite an increasing awareness of the importance of the teamwork competences, team training in both clinical practice and healthcare education curricula has been implemented to a small extent [32,33,34]. Teamwork measurements, evaluations and feedback to healthcare personnel may help to promote good team performance [35], with a self-report questionnaire being a common method for measuring teamwork [36]. Questionnaires measuring teamwork competencies are available, although evidence of psychometric validity is missing for most of them [35, 37]. The TeamSTEPPS® Teamwork Perception Questionnaire (T-TPQ), developed by the American Institutes for Research [38] on behalf of the AHRQ as a part of the TeamSTEPPS® package, has been shown to be valid [38, 39]. The T-TPQ measures an individual’s perception of group-level teamwork skills and behaviour within hospital units or departments. The questionnaire includes the five core competencies of teamwork with the following dimensions: team structure, leadership, situation monitoring, mutual support and communication. The T-TPQ measure has shown a good internal consistency (Cronbach’s alpha of 0.88 to 0.96) in previous studies [38, 39]. The questionnaire can be administrated for various purposes, either as assessing health personnel’s perceptions of teamwork, as a part of a site assessment to define training needs in organizations or as a tool to evaluate the effectiveness of TeamSTEPPS® training [38]. The T-TPQ questionnaire has been translated into other languages and adapted to a few cultural contexts [40, 41]. In the context of implementing TeamSTEPPS® in a Norwegian hospital, there was a need to assess teamwork skills and behaviour with a validated, culturally adapted tool in Norwegian. Additionally, there is a need for studies outside US to confirm and test the questionnaire, as well as its relevance to healthcare personnel in other countries. AHRQ gave its permission to translate the questionnaire to Norwegian. The present paper contributes to further teamwork research by addressing how to adapt, refine and evaluate the feasibility of foreign teamwork assessments to national, non-English-speaking healthcare environments. However, to make conclusions about the conceptual and equivalence to the original questionnaire in order to achieve a valid, reliable and culturally sensitive measure, psychometric testing is required [42].

Method

Aim

The aim of the study was to translate and cross-validate the T-TPQ into Norwegian, and to test the questionnaire for psychometric properties among Norwegian healthcare personnel.

The questionnaire

T-TPQ consists of 35 items divided into the five teamwork dimensions: Team Structure, Leadership, Situation Monitoring, Mutual Support and Communication. Each dimension includes seven items on a five-point Likert scale, from 5 = strongly agree with the statement to 1 = strongly disagree with the statement. Each dimension of T-TPQ is calculated to a total sum score or to an average score [38].

Translation of T-TPQ

The translation followed a model of back-translation inspired by Brislin [43] in a process described in the following five steps:

  1. 1.

    Forward translation of the T-TPQ into Norwegian by a professional bilingual translator with Norwegian as his/her native language.

  2. 2.

    Reviewing of the translated version by a team [44], including expert groups of nurses and the members of the research team to obtain cross-cultural equivalence: i) A group of three nurses with expert knowledge in the field of teamwork relating to patient safety reviewed the translated version in collaboration with the members of the research team; ii) Five nurses with experience from clinical practice were consulted to help confirm the cultural relevance of the concepts used with regard to a Norwegian healthcare setting. This step generated some semantic and conceptual changes, and resulted in a preliminary initial translated version.

  3. 3.

    Back-translation by a second professional bilingual translator with English as his/her native language, who was blinded to the original English version.

  4. 4.

    Comparison of the back-translated version and the original version by members of the research team. In this step, only minor inconsistencies were discovered, thereby resulting in some minor revisions.

  5. 5.

    Pilot testing of the translated version. To strengthen both sematic and content equivalence [42], the translated version was pilot-tested by 20 healthcare personnel: 11 registered nurses (RNs), three assistant nurses (AN) and six physicians recruited from a hospital. Each participant made comments on items they found unclear [45]. They subsequently gave a response on a scale from 1 to 5 as to whether the items in the questionnaire were relevant, precise, well-articulated and understandable. This last step generated some semantic and conceptual changes, and resulted in the final translated Norwegian version (see Additional file 1).

Study design, setting, sample and data collection

The study utilized a cross-sectional design, and was carried out at two hospitals (Hospital A and Hospital B) in two hospital trusts in Norway. The target population was frontline healthcare personnel (physician, registered nurse (RN), assistant nurse (AN), midwife, physiotherapist and occupational therapist). A survey with a coded paper version of the T-TPQ was carried out on two occasions during the period from October to December 2015 (Fig. 1).

Fig. 1
figure 1

Flowchart of the study sample and data collection

Full size image

Firstly, the questionnaire was distributed to all healthcare personnel (n = 624) employed in medical (Hospital A and Hospital B), gynecological/obstetrical, surgical, intensive care, anesthesia and emergency units (Hospital A). Two reminders were sent. In total, 247 healthcare personnel (40%) responded to the T-TPQ. Three participants with incomplete data (< 50% scores) were deleted (n = 244). Secondly, 2 weeks after the completion of the first data collection, the questionnaire was distributed to 70 participants randomly selected from those who responded on the first occasion. Twenty-six healthcare personnel (37%) completed the T-TPQ. The distribution of different healthcare personnel professions in the study sample is shown in Table 1.

Table 1 Distribution of healthcare personnel professions in the study sample
Full size table

Data analysis

The data were analysed using SPSS version 23 and SPSS AMOS version 23. Descriptive statistics were used to describe sample characteristics and the mean score and standard deviation for each teamwork dimension and single item. A confirmatory factor analysis (CFA) (Model 1) was conducted to test the factor structure of the T-TPQ [46]. Fourteen missing scores distributed among 10 participants were replaced by each participant’s mean score in the relevant dimension [47]. The purpose of a CFA is to test explicit hypotheses about the measure’s dimensionality, and is recommended to be used, e.g., to test whether a factor structure is comparable for different versions of an instrument [48]. This is particularly important with questionnaires that have been translated and/or culturally adapted [48]. Post-hoc modifications (Model 2) were made in accordance with a study by Keebler et al. [39], who examined the construct validity (CFA) of the original English-language version of T-TPQ. To assess the strength of each model, the three fit indexes: the Root Mean Square Error of Approximation (RMSEA), the Tucker-Lewis Index (TLI) and the Comparative Fit Index (CFI) were used. RMSEA represents an absolute fit index [48], and takes into account the error estimates in the population. RMSEA is accepted as the best estimation of how well the model with unknown but optimally chosen parameters values fit the population covariance matrix if it was available ([49], p. 80, 46). For RMSEA, cutoff values close to 0.06 indicate a good fitting model [50], with values as high as 0.08 representing reasonable errors of approximation in the population [49]. TLI and CFI representing indexes of comparative fit [48]. These indexes compare the chi-square values for the hypothesized model with that from a null model, in which all of the variables are uncorrelated, thus having a large chi-square value indicative of a poor fit [48]. For both indexes, cutoff values close to 0.95 offer evidence of a good model fit [50]. A Pearson correlation coefficient was carried out to test the independence of the teamwork construct. The reliability was assessed by Cronbach’s alpha to establish internal consistency for the teamwork dimensions, with a value above 0.70 considered to indicate an acceptable level [51]. An Intraclass Correlation Coefficient (ICC) with the Two-Way Random model was used for test-retest reliability [42].

Results

The construct validity of the translated T-TPQ was verified through a CFA index standard. The result indicated that each set of seven items that were supposed to accompany each teamwork dimension represent that specific construct. Model 1 showed a reasonable fit with the data (χ2 (df) 1180.37 (550), p < 0.001, RMSEA = 0.069, TLI = 0.819, CFI = 0.833). The post-hoc modifications according to Keebler et al. [39] referred to four sets of items with high modification indexes, within three of the five dimensions to improve the fit of the model. This included items 12 and 13 under Leadership, items 22 and 23 under Mutual Support, items 26 and 27 under Mutual Support, and items 29 and 31 under Communication, which resulted in the final model (Model 2). This model showed an acceptable fit with the data (χ2 (df) 969.46 (546), p < 0.001, RMSEA = 0.056, TLI = 0.878, CFI = 0.888) (Table 2).

Table 2 CFA fit indices for Model 1 and Model 2 (N = 244)
Full size table

The inter-correlation test of the five-teamwork dimensions ranged from 0.52 to 0.71 (Table 3). The internal consistency of the T-TPQ with Cronbach’s alpha demonstrated values from 0.786 to 0.844 on T-TPQ’s five dimensions. The test-retest reliability revealed ICC scores from 0.672 to 0.852 (Table 4). The mean scores and standard deviations for the five teamwork dimensions and the items are shown in Table 5.

Table 3 Summary of reliability and correlation for the T-TPQ dimensions (N = 244)
Full size table
Table 4 Test-retest reliability (N = 244)
Full size table
Table 5 Mean scores and standard deviations for T-TPQ items and dimensions
Full size table

Discussion

The aim of this study was to translate and cross-validate the T-TPQ into Norwegian, and test the questionnaire for psychometric properties among healthcare personnel. The original questionnaire was developed in the US with a predefined cultural group in mind [48]. However, the use of formally validated and established instruments has the advantage of building a cross-cultural knowledge for which findings can be compared [52]. The Norwegian version of the questionnaire may contribute to improved evidence, knowledge and awareness of teamwork competencies in Norwegian healthcare. The T-TPQ questionnaire may serve as an alternative or complementary measure of teamwork behaviours. Keebler et al. [39] suggest using the questionnaire in healthcare organizations that have implemented TeamSTEPPS®, or similar programmes for improving team training, implementation and sustainment. In Norway, interprofessional teamwork has gained more of a focus in recent years, although no special programmes such as TeamSTEPPS® have thus far been developed and implemented in health care.

There are challenges associated with the translation of a questionnaire [48]. Cross-cultural validity is one type of construct validity [53], and concerns “the degree to which the performance of the items on a translated or culturally adapted instrument are an adequate reflection of the performance of the items of the original version of the instrument” ([53], p. 243). The cross-cultural validity was ensured by a thorough five-step process of translation and back-translation, followed by a pilot testing of the translated version [43]. A challenge in the process was shifting the focus from a simple word for word translation of the questionnaire to its adaption to Norwegian healthcare culture with references to conceptual meaning and linguistic structure. Even though healthcare personnel in Norway work in teams and the concept of teamwork is used in healthcare, healthcare personnel have a light awareness of the core competencies of teamwork [21, 54]. There is still no consensus about a single model or definition of teamwork that can be expected to accommodate every aspect of teamwork within a specific healthcare specialty [8]. Furthermore, teamwork competencies have not been addressed in a systematic way by healthcare systems in general [55], and knowledge related to teamwork has probably been more practical and tacit. In this context, it was important to achieve a translation that gave meaning for the healthcare personnel, but at the same time was true to the English version. The pilot testing with a sample of healthcare personnel was important to ensure that the items made sense in a clinical setting.

Another aspect of construct validity is structural validity that refers “to the extent to which the structure of a multi-item scale adequately reflects the hypothesized dimensionality of the construct being measured” ([56], p. 318). The CFA in this study was performed in accordance with the US T-TPQ validation study [39], with post hoc modifications to improve the fit due to high modification indexes in four sets of items within three of the five dimensions. These items contain a highly similar content which would therefore lead to correlated errors [39]. However, no changes were made in the original English-language version of T-TPQ developed by the American Institutes for Research [38]. In this study, the result from the post hoc modification (Model 2) exhibited an RMSEA index of 0.056, which indicates a reasonable fit [49]. Nonetheless, the two indexes, TLI = 0.88 and CFI = 0.89, are slightly below the values that offer a good evidence of model fit. However, RMSEA is recognized as the most informative and robust criteria in covariance structure modelling [46, 49, 57, 58]. The study by Keebler et al. [39] exhibited better values on the two indexes TLI (0.94) and CFI (0.94) to a certain extent while the RMSEA (0.057) was almost the same as in our study. The Korean study by Hwang, Ahn [41] reported a more modest RMSEA (0.067) value. In their study, only nurses participated, which may have had an impact on the result. CFA works best when the sample is large, which enables stabile parameter estimates [48]. In the same study by Keebler et al. [39] the sample was large, 1700 staff members from US Army medical facilities were included, which could be an explanation for the better outcome. In this study, 244 participants provided seven cases for each parameter, which are in line with the recommendations of 5–10 [59]. A larger sample may have resulted in a CFA model with a better fit with data [48].

The ICC is the preferred reliability parameter for test-retest reliability, also called stability or reproducibility [56]. A review of the literature showed that the criteria for acceptable ICC values vary from one expert to another, so the standard for reliability might vary according to the situation. Polit [60] advises developers of new measures to aspire to test-retest reliabilities of 0.80 or higher. In this study, the ICC varied from 0.672–0.852. A problem for the test-retest reliability of instruments used in healthcare may be linked to the fact that healthcare personnel’s perceptions do change over time, and sometimes even over a short period. Healthcare personnel’s attitude, knowledge and skills can be modified by experiences between the test and the retest, and change would make a measure less reliable than it actually is [56].

Some issues regarding the sample and response rate of the study should be noted. The analysis was undertaken with a sample from the population for whom the measure is intended, but only two hospitals were included. Moreover, the response rate was low, with only 10% of the physicians responding to the questionnaire. Asch et al. [61] reported that surveys of physicians had a lower response rate than surveys of other healthcare personnel, while Cook et al. [62] did not find any differences between healthcare professions. However, surveys of physicians had a decrease in response rates from 1995 to 2005. We do not know whether all subjects were actually eligible for the study, and the dropouts may be associated with staff turnover, sick leave, and working schedules. Moreover, the term teamwork still has different meanings to various healthcare professions and the lack of a shared understanding of team structure, team roles and tasks in connection with a patient’s care team [8, 63], may have influenced the motivation to respond to the questionnaire. The perceptions of interprofessional teamwork may be influenced by professional role identities. Aase et al. [64] found nursing students were more likely to share the responsibility than medical students, who regarded taking responsibility at an individual level. Dropout analyses with background variables, such as age and sex, between the responders and the non-responders were not performed because we did not have access to this data. A low response rate might involve a risk of bias, which may affect the external validity of the study [56]. Based on these limitations, it is important to carry out additional studies that include more participants and, above all, motivate more physicians to respond. The internal dropout was low, with only 14 missing scores (less than 1%), distributed over 10 participants. To satisfy the requirements for running a CFA, missing substitutes were manually conducted using the “case mean substitution technique” [47].

Conclusions

The Norwegian translated version of T-TPQ was considered to be acceptable regarding validity and reliability for measuring individual healthcare personnel’s perception on group level teamwork at the front line within their unit. However, it needs to be further tested, preferably in a larger sample and different clinical settings. A further psychometric testing of the Norwegian T-TPQ questionnaire is therefore required to establish the psychometric property and a multisite study with a range of variation among different types of healthcare systems across several healthcare settings and professionals would be desirable. The T-TPQ highlights opportunities to identify areas for teamwork improvement as part of the promotion of patient safety. Healthcare organizations implementing TeamSTEPPS® programme may use the T-TPQ for a continuous evaluation of team training and the sustainability of the teamwork skills.

Abbreviations

AHRQ:

Agency for Healthcare Research and Quality

AN:

Assistant nurse

CFA:

Confirmatory factor analysis

CFI:

Comparative Fit Index

ICC:

Intraclass Correlation Coefficient

RMSEA:

Root Mean Square Error of Approximation

RN:

Registered nurse

TeamSTEPPS®:

Team Strategies and Tools to Enhance Performance and Patient Safety

TLI:

Tucker-Lewis Index

T-TPQ:

TeamSTEPPS Teamwork Perception Questionnaire

References

  1. Weaver SJ, Feitosa J, Salas E, Seddon R, Vozenilek JA. The theoretical drivers and models of team performance and effectiveness for patient safety. In: Salas E, Frush K, editors. Improving patient safety through teamwork and team training. New York: Oxford University Press; 2013. p. 3–26.

    Google Scholar 

  2. Baker D, Gustafson S, Beaubien J, Salas E, Barach P. Medical teamwork and patient safety: the evidence-based relation. Washington, DC: American Institutes for Research; 2007.

    Google Scholar 

  3. IOM. Health Professions Education: A Bridge to Quality. National Academies Press; 2003.

  4. Jha A, Prasopa-Plaizier N, Larizgoitia I, Bates D. Patient safety research: an overview of the global evidence. Qual Saf Health Care. 2010;19(1):42–7. https://doi.org/10.1136/qshc.2008.029165.

    Article  CAS  PubMed  Google Scholar 

  5. Rafter N, Hickey A, Conroy RM, Condell S, O'Connor P, Vaughan D et al. The Irish National Adverse Events Study (INAES): the frequency and nature of adverse events in Irish hospitals—a retrospective record review study. BMJ Qual Saf. 2016:bmjqs-2015-004828. doi:https://doi.org/10.1136/bmjqs-2015-004828.

  6. de Vries EN, Ramrattan MA, Smorenburg SM, Gouma DJ, Boermeester MA. The incidence and nature of in-hospital adverse events: a systematic review. Qual Saf Health Care. 2008;17(3):216–23. https://doi.org/10.1136/qshc.2007.023622.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  7. Pham JC, Aswani MS, Rosen M, Lee H, Huddle M, Weeks K, et al. Reducing medical errors and adverse events. Annu Rev Med. 2012;63:447–63. https://doi.org/10.1146/annurev-med-061410-121352.

    Article  CAS  PubMed  Google Scholar 

  8. Manser T. Teamwork and patient safety in dynamic domains of healthcare: a review of the literature. Acta Anaesthesiol Scand. 2009;53(2):143–51. https://doi.org/10.1111/j.1399-6576.2008.01717.x.

    Article  CAS  PubMed  Google Scholar 

  9. Källberg A-S, Göransson KE, Florin J, Östergren J, Brixey JJ, Ehrenberg A. Contributing factors to errors in Swedish emergency departments. Int Emerg Nurs. 2015;23(2):156–61. https://doi.org/10.1016/j.ienj.2014.10.002.

    Article  PubMed  Google Scholar 

  10. Georgiou A, Lockey DJ. The performance and assessment of hospital trauma teams. Scand J Trauma Resusc Emerg Med. 2010;18(1):1. https://doi.org/10.1186/1757-7241-18-66.

    Article  Google Scholar 

  11. Rabøl LI, Andersen ML, Østergaard D, Bjørn B, Lilja B, Mogensen T. Descriptions of verbal communication errors between staff. An analysis of 84 root cause analysis-reports from Danish hospitals. BMJ Qual Saf. 2011;20(3):268–74. https://doi.org/10.1136/pgmj.2010.040238rep.

    Article  PubMed  Google Scholar 

  12. Bleetman A, Sanusi S, Dale T, Brace S. Human factors and error prevention in emergency medicine. Emerg Med J. 2012;29(5):389–93. https://doi.org/10.1136/emj.2010.107698.

    Article  PubMed  Google Scholar 

  13. Weaver SJ, Rosen MA, DiazGranados D, Lazzara EH, Lyons R, Salas E, et al. Does teamwork improve performance in the operating room? A multilevel evaluation. Jt Comm J Qual Patient Saf. 2010;36(3):133–42.

    Article  PubMed  Google Scholar 

  14. Oandasan I, Ross Baker GR, Barker K, Bosco C, D’Amour D. Teamwork in healthcare: promoting effective teamwork in healthcare in Canada, Policy synthesis and recommendations. Canadian Health Services Research Foundation: Ottawa; 2006.

    Google Scholar 

  15. Wisborg T, Castren M, Lippert A, Valsson F, Wallin C. Training trauma teams in the Nordic countries: an overview and present status. Acta Anaesthesiol Scand. 2005;49(7):1004–9. https://doi.org/10.1111/j.1399-6576.2005.00742.x.

    Article  CAS  PubMed  Google Scholar 

  16. Ringen AH, Hjortdahl M, Wisborg T. Norwegian trauma team leaders-training and experience: a national point prevalence study. Scand J Trauma Resusc Emerg Med. 2011;19(1):54. https://doi.org/10.1186/1757-7241-19-54

    Article  PubMed  PubMed Central  Google Scholar 

  17. Wisborg T, Brattebø G, Brinchmann-Hansen Å, Uggen PE, Hansen KS. Effects of nationwide training of multiprofessional trauma teams in norwegian hospitals. J Trauma. 2008;64(6):1613–8. https://doi.org/10.1097/TA.0b013e31812eed68.

    Article  PubMed  Google Scholar 

  18. Wisborg T, Brattebø G, Brinchmann-Hansen Å, Hansen KS. Mannequin or standardized patient: participants' assessment of two training modalities in trauma team simulation. Scand J Trauma Resusc Emerg Med. 2009;17(1):59. https://doi.org/10.1186/1757-7241-17-59

    Article  PubMed  PubMed Central  Google Scholar 

  19. Husebø SE, Olsen ØE. Impact of clinical leadership in teams’ course on quality, efficiency, responsiveness and trust in the emergency department: study protocol of a trailing research study. BMJ Open. 2016;6(8):e011899. https://doi.org/10.1136/bmjopen-2016-011899.

    Article  PubMed  PubMed Central  Google Scholar 

  20. Husebø SE, Wiig S, V. G, Storm M, Sætre Hansen B. Status of Nordic research on patient safety and quality of care In: Aase K, Schibevaag L, editors. Researching patient safety and quality in healthcare: a Nordic perspective. Boca Raton: CRC Press/Taylor & Francis; 2017.

  21. Baker D, Salas E, Battles J, King H. The relation between teamwork and patient safety. In: Carayon P, editor. Human factors and ergonomics in health care and patient safety. Boca Raton: CRC Press; 2012.

    Google Scholar 

  22. Alonso A, Baker DP, Holtzman A, Day R, King H, Toomey L, et al. Reducing medical error in the military health system: how can team training help? Hum Resour Manag Rev. 2006;16(3):396–415. https://doi.org/10.1016/j.hrmr.2006.05.006.

    Article  Google Scholar 

  23. Alonso A, Dunleavy D. Building teamwork skills in healthcare: the case for communication and coordination competencies. In: Frush K, Salas E, editors. Improving patient safety through teamwork and team training. Oxford: Oxford University Press, USA; 2012. p. 41–58.

    Google Scholar 

  24. Salas E, Sims DE, Burke CS. Is there a “big five” in teamwork? Small Group Res. 2005;36(5):555–99. https://doi.org/10.1177/1046496405277134.

    Article  Google Scholar 

  25. King HB, Battles J, Baker DP, Alonso A, Salas E, Webster J, et al. TeamSTEPPS™: team strategies and tools to enhance performance and patient safety. In: Henriksen K, Battles JB, Keyes MA, Grady MLB, editors. Advances in patient safety: new directions and alternative approaches. Rockville (MD): Agency for Healthcare Research and Quality; 2008.

    Google Scholar 

  26. Kotter JP, Mueller P, Rathgeber H. Our iceberg is melting: changing and succeeding under any conditions. London: Macmillan; 2006.

    Google Scholar 

  27. Capella J, Smith S, Philp A, Putnam T, Gilbert C, Fry W, et al. Teamwork training improves the clinical care of trauma patients. J Surg Educ. 2010;67(6):439–43. https://doi.org/10.1016/j.jsurg.2010.06.006.

    Article  PubMed  Google Scholar 

  28. Mayer CM, Cluff L, Lin WT, Willis TS, Stafford RE, Williams C, et al. Evaluating efforts to optimize TeamSTEPPS implementation in surgical and pediatric intensive care units. Jt Comm J Qual Patient Saf. 2011;37(8):365-3AP.

    Google Scholar 

  29. Thomas L, Galla C. Republished: building a culture of safety through team training and engagement. Postgrad Med J. 2013;89(1053):394–401. https://doi.org/10.1136/postgradmedj-2012-001011rep.

    Article  PubMed  Google Scholar 

  30. Deering S, Rosen MA, Ludi V, Munroe M, Pocrnich A, Laky C, et al. On the front lines of patient safety: implementation and evaluation of team training in Iraq. Jt Comm J Qual Patient Saf. 2011;37(8):350–6.

    Article  PubMed  Google Scholar 

  31. Forse RA, Bramble J, McQuillan R. Team training can improve operating room performance. Surgery. 2011;150(4):771–8. https://doi.org/10.1016/j.surg.2011.07.076.

    Article  Google Scholar 

  32. Rosen MA, Pronovost P. Teamwork in healthcare: from training programs to intergrated system of developement. In: Salas E, Frush K, editors. Improving patient safety through teamwork and team training. New York: Oxford University Press; 2013. p. 239–43.

    Google Scholar 

  33. Reeves S, Lewin S, Espin S, Zwarenstein M. Interprofessional teamwork for health and social care. Chichester: Wiley-Blackwell; 2010.

    Book  Google Scholar 

  34. Aase I, Aase K, Dieckmann P. Teaching interprofessional teamwork in medical and nursing education in Norway: a content analysis. J Interprof Care. 2013;27(3):238–45. https://doi.org/10.3109/13561820.2012.745489.

    Article  PubMed  Google Scholar 

  35. Rosen MA, Dietz AS, Yang T, Priebe CE, Pronovost PJ. An integrative framework for sensor-based measurement of teamwork in healthcare. J of the Am Med Inform Assoc. 2015:amiajnl-2013-002606. doi:https://doi.org/10.1136/amiajnl-2013-002606.

  36. Rosen M, Schiebel N, Salas E. How can team performance be measured, assessed, and dignosed? In: Frush K, Salas E, editors. Improving patient safety through teamwork and team training. Oxford: Oxford University Press, USA; 2012.

    Google Scholar 

  37. Valentine MA, Nembhard IM, Edmondson AC. Measuring teamwork in health care settings: a review of survey instruments. MedCare. 2015;53(4):e16–30. https://doi.org/10.1097/MLR.0b013e31827feef6.

    Google Scholar 

  38. American Institutes for Research. TeamSTEPPS® teamwork perceptions questionnaire (T-TPQ) manual. Washington, DC: American Institutes for Research; 2010.

    Google Scholar 

  39. Keebler JR, Dietz AS, Lazzara EH, Benishek LE, Almeida SA, Toor PA, et al. Validation of a teamwork perceptions measure to increase patient safety. BMJ Qual Saf. 2014;13:1–9. https://doi.org/10.1136/bmjqs-2013-001942.

    Google Scholar 

  40. Brandão CS, Fernandes DC, Collares CF, Fernandes GR, Marin HF. Translation and back-translation of the TeamSTEPPS® teamwork assessment tool for use in simulation teaching in Brazil. Sci Med. 2016;26(4):24622. http://dx.doi.org/10.15448/1980-6108.2016.4.24622.

    Article  Google Scholar 

  41. Hwang J-I, Ahn J. Teamwork and clinical error reporting among nurses in Korean hospitals. Asian Nurs Res. 2015;9(1):14–20. https://doi.org/10.1016/j.anr.2014.09.002.

    Article  Google Scholar 

  42. Polit DF, Beck CT. Nursing research. Generating and assessing evidence for nursing practice. Philadelphia: Wolters Kluwer; 2017.

    Google Scholar 

  43. Brislin RW. Back-translation for cross-cultural research. J Cross-Cult Psychol. 1970;1(3):185–216. https://doi.org/10.1177/135910457000100301.

    Article  Google Scholar 

  44. Solano-Flores W, Hurtado M. CAHPS Guidelines for assessing and selecting translators and reviewers. American Institutes for Research (AIR) Team; 2005.

  45. Sousa VD, Rojjanasrirat W. Translation, adaptation and validation of instruments or scales for use in cross-cultural health care research: a clear and user-friendly guideline. J Eval Clin Pract. 2011;17(2):268–74. https://doi.org/10.1111/j.1365-2753.2010.01434.x.

    Article  PubMed  Google Scholar 

  46. Blunch NJ. Introduction to structural equation modeling using IBM SPSS statistics and AMOS. 2nd ed. SAGE: Los Angeles, Calif; 2013.

    Book  Google Scholar 

  47. Fox-Wasylyshyn SM, El-Masri MM. Handling missing data in self-report measures. Res Nurs Health. 2005;28(6):488–95.

    Article  PubMed  Google Scholar 

  48. Polit DF, Yang FM. Measurement and the measurement of change: a primer for health professionals. Philadelphia: Wolters Kluwer; 2016.

    Google Scholar 

  49. Byrne BM. Structural equation modeling with AMOS: basic concepts, applications, and programming. 2nd ed. multivariate applications series. New York: Psychology Press; 2010.

    Google Scholar 

  50. Hu LT, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct Equ Model Multidiscip J. 1999;6(1):1–55. https://doi.org/10.1080/10705519909540118.

  51. Streiner DL, Norman GR. Health measurement scales: a practical guide to their development and use. Oxford: Oxford University Press; 2008.

    Book  Google Scholar 

  52. Brislin RW. The wording and translation of research instruments. In: Lonner WJ, Berry JW, editors. Field methods in cross-cultural research. Beverly Hills: Sage; 1986. p. 137–64.

    Google Scholar 

  53. Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, et al. The COSMIN study reached international consensus on taxonomy, terminology, and definitions of measurement properties for health-related patient-reported outcomes. J Clin Epidemiol. 2010;63(7):737–45. https://doi.org/10.1016/j.jclinepi.2010.02.006.

    Article  PubMed  Google Scholar 

  54. Ballangrud R, Hall-Lord ML, Persenius M, Hedelin B. Intensive care nurses’ perceptions of simulation-based team training for building patient safety in intensive care: a descriptive qualitative study. Intensive Crit Care Nurs. 2014;30(4):179–87. https://doi.org/10.1016/j.iccn.2014.03.002.

    Article  PubMed  Google Scholar 

  55. Salas E, Rosen MA. Building high reliability teams: progress and some reflections on teamwork training. BMJ Qual Saf. 2013;22(5):369–73. https://doi.org/10.1136/bmjqs-2013-002015.

    Article  PubMed  Google Scholar 

  56. Polit DF, Beck CT. Nursing research: generating and assessing evidence for nursing practice. Philadelphia: Wolters Kluwer; 2016.

    Google Scholar 

  57. Gustafsson J-E. Strukturella ekvationsmodeller. In: Djurfeldt G, Barmark M, editors. Statistisk verktyglåda - multivariat analys. Lund, Sweden: Studentlittertur; 2009.

    Google Scholar 

  58. MacCallum RC, Austin JT. Applications of structural equation modeling in psychological research. Annu Rev Psychol. 2000;51(1):201–26. https://doi.org/10.1146/annurev.psych.51.1.201

    Article  CAS  PubMed  Google Scholar 

  59. Hair JF. Multivariate data analysis. 7th., Pearson new international ed. Pearson: Harlow; 2014.

    Google Scholar 

  60. Polit D. Getting serious about test–retest reliability: a critique of retest research and some recommendations. Intl J Qual Life Aspects Treatment Care Rehabil. 2014;23(6):1713–20. https://doi.org/10.1007/s11136-014-0632-9.

    Article  Google Scholar 

  61. Asch DA, Jedrziewski MK, Christakis NA. Response rates to mail surveys published in medical journals. J Clin Epidemiol. 1997;50(10):1129–36. https://doi.org/10.1016/S0895-4356(97)00126-1

    Article  CAS  PubMed  Google Scholar 

  62. Cook JV, Dickinson HO, Eccles MP. Response rates in postal surveys of healthcare professionals between 1996 and 2005: an observational study. BMC Health Serv Res. 2009;9(1):160. https://doi.org/10.1186/1472-6963-9-160.

    Article  PubMed  PubMed Central  Google Scholar 

  63. Muller-Juge V, Cullati S, Blondon KS, Hudelson P, Maître F, NV V, et al. Interprofessional collaboration on an internal medicine ward: role perceptions and expectations among nurses and residents. PLoS One. 2013;8(2):e57570. https://doi.org/10.1371/journal.pone.0057570.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  64. Aase I, Hansen BS, Aase K. Norwegian nursing and medical students' perception of interprofessional teamwork: a qualitative study. BMC Med Educ. 2014;14:1–8. https://doi.org/10.1186/1472-6920-14-170

    Article  Google Scholar 

  65. World Medical Association, World Medical Association Declaration of Helsinki. Ethical principles for medical research involving human subjects. Bull World Health Organ. 2001;79(4):373–4.

    PubMed Central  Google Scholar 

Download references

Acknowledgements

The authors would like to acknowledge the all the healthcare professionals for their contribution in the translation process of the questionnaire with a special thanks to Oddveig Reiersdal Aaberg at the Norwegian University of Science and Technology. Moreover, we would like to thank the frontline healthcare personnel for their participation in the study, in addition to, Jari Appelgren at Karlstad University, for the statistical support. We would like to acknowledge the Norwegian Nurses Organization for their financial support.

Funding

This study is sponsored by Norwegian Nurses Organization (15/0018) and supported by the Norwegian University of Science and Technology in Gjøvik and the University of Stavanger. The funding has contributed to allocating time for use in the collection, analysis and interpretation of data, and in the writing of the manuscript.

Availability of data and materials

The datasets generated and analysed during the current study are not publicly available, as a further paper will be written based on the dataset, but are available from the corresponding author on reasonable request.

Author information

Authors and Affiliations

  1. Department of Health Science Gjøvik, Faculty of Medicine and Health Sciences, Norwegian University of Science and Technology, Teknologivn. 22, 2815, Gjøvik, Norway

    Randi Ballangrud & Marie Louise Hall-Lord

  2. Faculty of Health Sciences, University of Stavanger, Kjell Arholms hus, Kjell Arholms gate 43, 4021, Stavanger, Norway

    Sissel Eikeland Husebø

  3. Department of Surgery, Stavanger University Hospital, Gerd Ragna Bloch Thorsens street 8, 4011, Stavanger, Norway

    Sissel Eikeland Husebø

  4. Department of Health Sciences, Faculty of Health, Science and Technology, Karlstad University, Karlstad, Sweden

    Marie Louise Hall-Lord

Authors
  1. Randi Ballangrud
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Sissel Eikeland Husebø
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Marie Louise Hall-Lord
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

RB, SEH and MLHL were responsible for the study design and translation of the questionnaire. RB performed the data collection. RB and MLHL contributed to the analysis and interpretation of the data. RB, SEH and MLHL were involved in drafting the manuscript and revising it critically for important intellectual content and give final approval of the version to be published. All authors have read and approved the final manuscript.

Corresponding author

Correspondence to Randi Ballangrud.

Ethics declarations

Authors’ information

RB: RNCCN PhD Associate Professor.

SEH: RNCCN PhD Associate Professor.

MLHL: RNT PhD Professor

Ethics approval and consent to participate

The study was approved by the Norwegian Social Science Data Services (Ref. NR. 43,295), and permission was given by the head administration in the participating hospitals. Information and an invitation to participate in the study were given to healthcare personnel in written form, referring to the principle of autonomy addressed by confidentiality and voluntariness. A returned questionnaire implied consent to participate in the study, and the study was conducted in accordance with the principles of the Helsinki Declaration [65].

Consent for publication

“Not applicable”.

Competing interests

The authors declare that they have no competing interests and no financial disclosures.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Additional file

Additional file 1:

The Norwegian-language version of TeamSTEPPS® Teamwork perception Questionnaire. (DOCX 19 kb)

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ballangrud, R., Husebø, S.E. & Hall-Lord, M.L. Cross-cultural validation and psychometric testing of the Norwegian version of the TeamSTEPPS® teamwork perceptions questionnaire. BMC Health Serv Res 17, 799 (2017). https://doi.org/10.1186/s12913-017-2733-y

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12913-017-2733-y

Keywords

BMC Health Services Research

ISSN: 1472-6963

Contact us