- Research article
- Open access
- Published:
The Swedish version of the TeamSTEPPS® teamwork attitudes questionnaire (T-TAQ): A validation study
BMC Health Services Research volume 21, Article number: 105 (2021)
Abstract
Background
Effective teamwork is essential for delivering safe health care. It is important to increase patient safety in healthcare by conducting interprofessional team training with both healthcare professionals and undergraduate students. Validated questionnaires that evaluate team training activities contribute to valuable knowledge regarding changes in attitudes toward teamwork. The aim of the study was to test the reliability and structural validity of the Swedish version of the TeamSTEPPS® Teamwork Attitudes Questionnaire (T-TAQ).
Methods
The study had a cross-sectional design. Four hospitals in three health care regions in Sweden participated in the study. In total, 458 healthcare professionals, response rate 39.4%, completed the questionnaire. The T-TAQ, which consists of 30 items and covers five dimensions (Team Structure, Leadership, Situation Monitoring, Mutual Support and Communication), was translated to Swedish. A paper version of the T-TAQ was distributed to healthcare professionals (physicians, registered nurses, midwives, nursing assistants and allied health professionals) from the hospitals. Reliability and validity were tested using Cronbach’s alpha and confirmatory factor analysis.
Results
Cronbach’s alpha was 0.70 for the total T-TAQ and ranged from 0.41 to 0.87 for the individual dimensions. The goodness-of-fit indexes in the confirmatory factor analysis (Model 2) revealed a normed chi-square of 2.96, a root mean square error of approximation of 0.068, a Tucker-Lewis index of 0.785 and a comparative fit index of 0.808.
Conclusions
The Swedish version of the T-TAQ has some potential to measure healthcare professionals’ general attitudes toward the core components of teamwork in hospital settings. Further validation studies of the Swedish version of the T-TAQ are required, with samples representing both healthcare professionals and students from various healthcare disciplines and educational levels.
Background
There is an increasing focus on effective interprofessional teamwork to improve communication and collaboration among healthcare professionals to enhance patient safety in healthcare [1]. Failures in communication [2,3,4,5] and a lack of coordination [6] between healthcare professionals may lead to adverse events in patients [4]. Although interventions in healthcare should include organizational factors to have a significant impact on patient safety and quality of care [7], team training for healthcare professionals and undergraduate students in various healthcare disciplines is important [8]. Evaluating the impact of training activities with validated measurements is vital, and change in attitudes can be used as a measurement of learning outcome [9] and contribute to valuable knowledge regarding changes in attitudes toward teamwork.
Healthcare provided by teams rather than individuals requires collaboration between healthcare personnel from various professions. Potential solutions to building better health care teams and teamwork that is more effective can involve educational interventions. Salas et al. [10] divided effective teamwork into the “Big five” dimensions (team leadership, mutual performance monitoring, backup behavior, adaptability, and team orientation), which are coordinated by the underlying mechanisms mutual trust, closed-loop communication and shared mental models. To achieve the five dimensions of effective teamwork, team members must respect and trust each other, have good communication skills and have a shared mental model to facilitate the team’s progression toward goal attainment that promotes common understanding and action. The relationship between communication and patient safety [11, 12] indicates the need to educate healthcare professionals and healthcare students in interprofessional team training [13, 14],
To improve quality and safety in healthcare in the US, the Department of Defense and the Agency for Healthcare Research and Quality (AHRQ) developed the Team Strategies and Tools to Enhance Performance and Patient Safety (TeamSTEPPS®) program, which is an evidence-based program based on the theory of the “Big five” dimensions of effective teamwork developed by Salas et al. [10]. TeamSTEPPS® includes Team Structure in addition to four important teamwork competences: Leadership, Situation Monitoring, Mutual Support and Communication. The program provides knowledge of the TeamSTEPPS® principles and on how to effectively work in interprofessional teams. TeamSTEPPS® incorporates simulation as a training tool, which is common when educating healthcare professionals and undergraduate students in interprofessional teamwork [15]. Interprofessional team training with TeamSTEPPS® and simulation shows improved communication, team performance, patient outcomes [15] and patient safety culture [16,17,18].
The American Institute of Research developed the TeamSTEPPS® Teamwork Attitudes Questionnaire (T-TAQ) to measure individual attitudes related to the core components of teamwork [19]. The T-TAQ has been validated by Baker et al. [20] and can be used to understand the effects of team training, as it is administrated before and after the training. The questionnaire has been used in several studies evaluating team training with undergraduate students from various disciplines [21,22,23], with nursing students [24, 25] and with individuals continuing interprofessional education [18, 26, 27]. There are few tools based on a theoretical framework measuring teamwork attitudes available in Sweden and we judged the T-TAQ to fit in the context of a Swedish health care system, since the concepts and content used in the questionnaire are in agreement with Swedish terminology. The T-TAQ was translated with the permission of the United States AHRQ from the TeamSTEPPS® 2.0 National Implementation (accessible at http://teamstepps.ahrq.gov/). New validation efforts are required to determine whether a questionnaire translated into another language and used in another culture is a valid measure of the construct [28]. The aim of this study was to test the reliability and structural validity of the Swedish version of the TeamSTEPPS® Teamwork Attitudes Questionnaire (T-TAQ).
Methods
The questionnaire and the translation process
The T-TAQ consists of 30 items and covers five dimensions: Team Structure, Leadership, Situation Monitoring, Mutual Support and Communication. Each dimension has six items with five response options ranging from 1 = strongly disagree to 5 = strongly agree on a Likert scale. Four items are negatively worded, including three items in the Mutual Support dimension and one item in the Communication dimension. The scores for the total scale and for each dimension were calculated by adding all items and dividing the score by the number of items in each dimension and in the total scale [19, 20].
Brislin [29] inspired the translation of the T-TAQ. A Swedish professional bilingual translator translated the original English version of the questionnaire from English to Swedish. We reviewed the translated version of the T-TAQ with some minor semantic and conceptual adjustments. Another professional bilingual translator performed back-translation of the reviewed Swedish version to English. Then, the research group assessed the original version and the back-translated version of the T-TAQ with only some minor revisions in the translated questionnaire. A pilot test of the Swedish T-TAQ was carried out with 15 healthcare professionals (three physicians, eight registered nurses, two midwives, one nursing assistant and one physiotherapist) working in clinical practice. The participants were asked to comment if the items were understandable and clear. Due to their replies, some further language changes were made in the questionnaire.
Design
This study had a cross-sectional design.
Settings and sample
Four hospitals (hospital A, hospital B, hospital C, hospital D) in three health care regions in Sweden were included. In hospital A, the operating room and the medical-, gynecological-, obstetric-, and intensive care wards participated. In hospital B, the emergency room and medical care wards participated. In hospital C and hospital D, the obstetric care wards participated. All frontline healthcare professionals in the wards, including physicians, registered nurses, midwives, nursing assistants, and allied health professionals (N = 1176), were invited to participate in the study.
Data collection
The chief manager in the ward and members of the research group informed the healthcare professionals about the study. Between September and December 2018, the healthcare professionals obtained a paper version of the T-TAQ together with a letter containing information about the study. Completed questionnaires were returned to the research group anonymously in self-addressed envelopes.
Statistics
Data analysis was conducted using IBM SPSS Statistics for Windows, version 25.0 (Armonk, New York) and IBM AMOS version 25.0. The four negatively worded items in the questionnaire were reverse-coded and a mean score was calculated for the total scale and for each teamwork dimension. Internal consistency (measured by Cronbach alpha) was tested for the total questionnaire and each teamwork dimension. Corrected item-total correlation and Cronbach alpha whether an item was deleted were calculated for the five individual dimensions.
Participants with no missing data were included in the confirmatory factor analysis (CFA). Structural validity by CFA tested the a priori hypothesis based on the theoretical understanding of the structure of factors, in this case, by analyzing the empirical data of the five dimensions of T-TAQ. CFA yields goodness-of-fit indexes, which illustrate how well the hypothesized model matches the data [28]. First, the goodness-of-fit indexes evaluated how well the data corresponded to the hypothesized five-factor model (Model 1). Second, since the four reverse-coded items indicated low corrected item-total correlation and low factor loadings, we decided to build a model with a possible better fit to the data (Model 2). In this post-hoc modification, the error variances for the four negatively worded items were correlated. Common goodness-of-fit indexes were used to assess the strength of the two models [28, 30], including the chi-square goodness of fit (x2), normed chi-square (chi-square/df), root mean square error of approximation (RMSEA), Tucker-Lewis index (TLI) and comparative fit index (CFI). RMSEA is one of the most informative criteria in CFA and takes into account the error of the approximation in the population [30]. TLI and CFI evaluate the goodness of fit of a hypothesized model and compare this model with a null model [28, 30]. There are criteria for the goodness-of-fit indexes for determining model fit. The chi-square goodness of fit (x2) should have a p value of > 0.05 and the normed chi-square value should be < 3. A RMSEA value less than 0.06 indicate good fit and values as high as 0.08 represent errors of approximation in the population [30]. For TLI and CFI values close to 0.95 indicate a good fit [31].
Results
In total, 458 of the healthcare professionals (response rate 39.4%) completed the T-TAQ (Table 1).
Table 2 shows the corrected item-total correlation and Cronbach’s alpha for each dimension and whether the item was deleted.
The corrected item-total correlations were above 0.30 for items in three (Team Structure, Leadership, Situational Monitoring) of the five dimensions. The corrected item-total correlations for five out of six items in the Mutual Support dimension and one item in the Communication dimension were below 0.30. Cronbach’s alpha was 0.70 for the total T-TAQ and ranged from 0.41 (Mutual Support) to 0.87 (Leadership) for the five dimensions. Cronbach’s alpha showed a higher score in the Mutual Support dimension (0.45) and in the Communication dimension (0.72) whether an item in each dimension was deleted.
Participants with no missing data were included in the CFA (N = 423). The first model showed values below the recommended limits of the CFA criteria indexes (see Table 3).
We decided to conduct a post-hoc analysis in an attempt to improve the fit of the model. The post-hoc modification (Model 2) concerned the four reverse-coded items; three items in the Mutual Support dimension and one item in the Communication dimension. Goodness of fit statistics related to Model 2 showed that the correlations between the error variances for the four items made a moderately improvement to model fit. The normed chi-square decreased from 3.43 to 2.96, RMSEA decreased from 0.076 to 0.068, while TLI and CFI increased slightly (see Table 3).
Figure 1 presents factor loadings and correlations between the factors (dimensions) and between the four reverse-coded items. The factor loadings ranged from 0.06 to 0.82 and the correlations between the dimensions were between 0.39 and 0.70. The correlations between the four reverse-coded items ranged between 0.13 and 0.45.
Discussion
This study aimed to test the reliability and structural validity of the Swedish version of the T-TAQ, and the results revealed that the questionnaire has some potential to measure healthcare professionals’ attitudes toward teamwork. Cronbach’s alpha showed that the reliability of three of the dimensions (Team Structure, Leadership, Situation Monitoring) and the total T-TAQ were considered acceptable, with values above 0.70 [28]. In contrast, the Cronbach’s alpha values were notably lower in the two dimensions with negatively worded items (Mutual Support, Communication). The validation study of the original English version of the T-TAQ showed acceptable values in all dimensions (Team Structure 0.70, Leadership 0.81, Situational Monitoring 0.81, Mutual Support 0.70, Communication 0.74) [20]. In the Norwegian study by Ballangrud et al. [32], there were low values in the same two dimensions as in our study but also in the Team Structure dimension. In the study by Sweigart et al. [9], the lowest Cronbach’s alpha value was observed in the Communication dimension (0.57). Polit and Yang [28] note that the internal consistency of a questionnaire is not a property of the questionnaire itself but rather a property of the questionnaire used with a particular population under specific circumstances. Moreover, the estimates of internal consistency can be affected by whether a measure captures both the main construct and other personal attributes, such as social desirability responses leading to bias [28].
The results of the corrected item-total correlation and the factor loadings in the CFA indicate that there may be a problem with the negatively worded items in the Mutual Support and Communication dimensions. In general, negatively worded items should be avoided, as including both negative and positive items on a scale can confuse people by reversing polarities [28]. However, we recommend not removing these items as a multicenter study is required that validates the questionnaire.
A post-hoc modification (Model 2) with a correlation between the reverse-coded items resulted in a model with better fit to the data. The RMSEA value was close to 0.06 (0.068) and the normed Chi-square was below 3. According to the recommendations for CFA, these goodness-of-fit indexes of CFA indicated an acceptable fit with the original construct [30]. Compared to the study by Ballangrud et al. [32], who validated the Norwegian version of the T-TAQ in healthcare professionals, the values reported herein were slightly higher. On the other hand, the TLI and CFI were below the recommended goodness-of-fit indexes (> 0.95), but were higher than in the previous validation study [32]. The correlations, conducted as a part of CFA, between the five dimensions suggest that all dimensions overlap to some degree but also demonstrate unique variance. Post-hoc modification can improve the fit, but it is important that the final model does not differ from the theoretical model [33].
The sample size is an important factor in CFA, and it is desirable to have a sample size of at least 10 cases for each item [33]. Although the present study had 423 cases in the CFA, even more are preferred [28].
In addition to the study by Ballangrud et al. [32], this is the second study to use CFA to investigate the T-TAQ, which was not used in the original T-TAQ validation study by Baker et al. [20]. Although the T-TAQ has been used to evaluate team training in several studies, we have not found any study where CFA has been performed. Baker et al. [20] recommended additional validation with CFA since the T-TAQ is based on a theoretical framework of teamwork.
Limitations
The response rate was low, and therefore, there is a risk of sampling bias, which limits the generalizability of the study [34]. The low response rate may have been due to high workloads and stress. In addition, the motivation to respond to the questionnaire may be affected by whether the concept of teamwork has been acknowledged or whether an item is relevant to the responder. It was not possible to carry out a dropout analysis of those who did not respond since the healthcare professionals answered the questionnaire anonymously. Within the various profession groups, the proportion of physicians and allied health professionals who answered the questionnaire was lower compared to midwives, registered nurses and assistant nurses. However, none of the profession groups was underrepresented in the sample.
Conclusions
This validation study of the Swedish version of the T-TAQ indicates that the questionnaire has some potential for measuring healthcare professionals’ individual attitudes toward the core components of teamwork. Continued use in both research and education should take into account that the T-TAQ can be used as unidimensional, and responders should pay attention to negatively worded items. Further validation of the Swedish version of the T-TAQ is required. It would be desirable to conduct studies with both healthcare professionals from various healthcare settings and students from various disciplines and educational levels.
Availability of data and materials
The datasets used and analyzed during the current study are available from the corresponding author on reasonable request.
Abbreviations
- AHRQ:
-
Agency for Healthcare Research and Quality
- CFA:
-
Confirmatory factor analysis
- CFI:
-
Comparative fit indexes
- CI:
-
Confidence interval
- RMSEA:
-
Root mean square error of approximation
- T-TAQ:
-
TeamSTEPPS Teamwork Attitudes Questionnaire
- TeamSTEPPS:
-
Team Strategies and Tools to Enhance Performance and Patient Safety
- TLI:
-
Tucker-Lewis index
- WHO:
-
World Health Organization
References
Reeves S. An overview of continuing interprofessional education. J Contin Educ Heal Prof. 2009;29(3):42–146.
Lingard L, Espin S, Whyte S, Regehr G, Baker GR, Reznick R, Bohnen J, Orser B, Doran D, Grober E. Communication failures in the operating room: an observational classification of recurrent types and effects. Qual Saf Health Care. 2004;13:330–4.
Manojlovich M, Decicco B. Healthy work environments, nurse-physician communication, and patient outcomes. AJCC. 2007;16:537–43.
Rabøl LI, Lehmann Andersen M, Østergaard D, Bjørn B, Lilja B, Mogensen T. Republished error management: descriptions of verbal communication errors between staff. An analysis of 84 root cause analysis-reports from Danish hospitals. Postgrad Med J. 2011;87:783–9.
Foronda C, MacWilliams B, McArthur E. Interprofessional communication in healthcare: an integrative review. Nurse Educ Pract. 2016;19:36–40.
Manser T, Howard ST, Gaba DM. Adaptive coordination in cardiac anaesthesia: a study of situational changes in coordination patterns using a new observation system. Ergonomics. 2008;51(8):1153–78.
Carayon P, Wetterneck TB, Rivera-Rodriguez JA, Hundt AS, Hoonakker P, Holden R, Gurses AP. Human factors systems approach to healthcare quality and patient safety. Appl Ergon. 2014;45(1):14–25.
World Health Organization. Framework for action on interprofessional education & collaborative practice. Health Professions Networks Nursing & Midwifery, Human Resources for Health, Department of Human Resources for Health, Geneva. 2010. https://apps.who.int/iris/bitstream/handle/10665/70185/WHO_HRH_HPN_10.3_eng.pdf;jsessionid=5A3D1A8E39A8760F9D797BFA1AF747F6?sequence=1. Accessed 27 April 2020.
Sweigart LI, Umoren RA, Scott PJ, Carlton KH, Jones JA, Truman B, Gossett EJ. Virtual TeamSTEPPS simulations produce teamwork attitude changes among health profession students. J Nurs Educ. 2016;65:31–5.
Salas E, Sims DE, Burke CS. Is there a “big five” in teamwork? Small Group Res. 2005;36(5):555–99.
Leonard M, Graham S, Bonacum D. The human factor: the critical importance of effective teamwork and communication in providing safe care. Qual Saf Health Care. 2004;13(Suppl 1):i85–90.
Blegen MA, Sehgal NL, Alldredge BK, Gearhart S, Auerbach AA, Wachter RM. Republished paper: improving safety culture on adult medical units through multidisciplinary teamwork and communication interventions: the TOPS project. Postgrad Med J. 2010;86:729–33.
Kyrkjebø JM, Brattebø G, Smith-Strøm H. Improving patient safety by using interprofessional simulation training in health professional education. J Interprof Care. 2006;20(5):507–16.
Weller JM, Barrow M, Gasquoine S. Interprofessional collaboration among junior doctors and nurses in the hospital settings. Med Educ. 2011;45:478–87.
Welsch LA, Hoch J, Poston RD, Parodi AV, Akpinar-Elci M. Interprofessional education involving didactic TeamSTEPPS and interactive healthcare simulation: a systematic review. J Interprof Care. 2018;32(6):657–65.
Jones KJ, Skinner AM, High R, Reiter-Palmon R. A theory-driven, longitudinal evaluation of the impact of team training on safety culture in 24 hospitals. BMJ Qual Saf. 2013;22:394–404.
Wong AH-W, Gang M, Szyld D, Mahoney H. Making an “attitude adjustment” using a simulation-enhanced interprofessional education strategy to improve attitudes toward teamwork and communication. Sim Healthcare. 2016;11(2):117–25.
Aaberg OR, Ballangrud R, Husebø SE, Hall-Lord ML. An interprofessional team training intervention with an implementation phase in a surgical ward. A controlled quasi-experimental study. J Interprof Care. 2019;Epub Dec 18. doi: https://doi.org/10.1080/13561820.2019.1697216.
Baker DP, Krokos KJ, Amodeo AM. TeamSTEPPS teamwork attitudes questionnaire manual. American Institutes Research Washington, DC. 2008. https://www.ahrq.gov/sites/default/files/wysiwyg/teamstepps/instructor/reference/teamattitudesmanual.pdf. Accessed 27 April 2020.
Baker DP, Amodeo AM, Krokos KJ, Slonim A, Herrera H. Assessing teamwork attitudes in healthcare development of the TeamSTEPPS teamwork attitudes questionnaire. Qual Saf Health Care. 2010;19(6):e49. https://doi.org/10.1136/qshc.2009.036129.
Brock D, Abu-Rish E, Chiu C, Hammer D, Wilson S, Vorvick L, Blondon K, Schaad D, Liner D, Zierler B. Interprofessional education in team communication: working together to improve patient safety. BMJ Qual Saf. 2013;22:414–23.
Thompson BM, Bratzler DW, Fisher MJ, Torres A, Sparks RA. Working together: using a unique approach to evaluate an interactive and clinic-based longitudinal interprofessional education experience with 13 professions. J Interprof Care. 2016;30(6):754–61.
Motycka C, Egelund EF, Gannon J, Genuardi F, Gautam S, Stittsworth S, Young A, Simon L. Using interprofessional medication management simulations to impact student attitudes toward teamwork to prevent medication errors. Curr Pharm Teach Learn. 2018;10:952–89.
Maquire MBR, Bremner MN, Bennett DN, VanBrackle L. Evaluation of TeamSTEPPS integration across a curriculum ragrding team attitudes: a longitudinal study. J Nurs Educ Pract. 2015;3(7):131–8.
Plemmons C, Clark M, Feng D. Comparing student clinical self-efficacy and team processes outcomes for a DEU, blended, and traditional clinical setting: a quasi-experimental research study. Nurse Educ Today. 2018;62:107–11.
Sawyer T, Laubach VA, Hudak J, Yamamura K, Pocrnich A. Improvements in teamwork during neonatal resuscitation after interprofessional TeamSTEPPS training. NN. 2013;32(1):26–33. https://doi.org/10.1891/0730-0832.32.1.26.
Cook M. TeamSTEPPS for health care risk managers: improving teamwork and communication. J Healthc Risk Manag. 2016;36(1):35–45.
Polit DF, Yang FM. Measurement and the measurement of change. A primer for health professions. Philadelphia: Wolters Kluwer; 2016.
Brislin RW. Back-translation for cross-cultural research. J Cross-Cult Psychol. 1970;1:185–216.
Byrne BM. Structural equation modeling with AMOS: basic concepts, applications, and programming. 2nd ed. New York: Routledge, Taylor & Francis Group; 2010.
Hu LT, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct Equ Model. 1999;6(1):1–55.
Ballangrud R, Husebø SE, Hall-Lord ML. Cross-cultural validation and psychometric testing of the Norwegian version of the TeamSTEPPS® teamwork attitudes questionnaire. J Interprof Care. 2020;34:116–23.
Schreiber JB, Nora A, Stage FK, Barlow EA, King J. Reporting structural equation modeling and confirmatory factor analysis results: a review. J Educ Res. 2006;99(6):323–38.
Polit DF, Beck CT. Nursing research: generating and assessing evidence for nursing practice. 10th ed. Philadelphia: Wolters Kluwer; 2017.
Acknowledgements
The authors want to thank the healthcare professionals who participated in the study. We also want to thank assistant professor Jari Appelgren, Karlstad University, for statistical support and doctoral student Annika Skoogh, Karlstad University, for her contribution to data collection.
Funding
None.
Author information
Authors and Affiliations
Contributions
MHL, CB, RB and AN contributed to the conception and design of the study. MHL, CB and AN conducted the data collection. All authors contributed to the data analysis. MHL drafted the manuscript and CB, RB and AN provided critical revision of the manuscript. All authors read and approved the final version of the manuscript.
Corresponding author
Ethics declarations
Ethics approval and consent to participate
The Research Ethics Committee at Karlstad University (C2018/50) approved the study. Permission to conduct the study was obtained from the head manager at each division. The healthcare professionals gave informed consent for study participation by answering and returning the questionnaire. The participants answered the questionnaire anonymously. We followed the ethical principles of the Helsinki Declaration.
Consent for publication
Not Applicable.
Competing interests
The authors declare that they have no competing interests.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
About this article
Cite this article
Hall-Lord, M.L., Bååth, C., Ballangrud, R. et al. The Swedish version of the TeamSTEPPS® teamwork attitudes questionnaire (T-TAQ): A validation study. BMC Health Serv Res 21, 105 (2021). https://doi.org/10.1186/s12913-021-06111-1
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s12913-021-06111-1