A four-year, systems-wide intervention promoting interprofessional collaboration
© Braithwaite et al; licensee BioMed Central Ltd. 2012
Received: 24 August 2011
Accepted: 20 April 2012
Published: 20 April 2012
A four-year action research study was conducted across the Australian Capital Territory health system to strengthen interprofessional collaboration (IPC) though multiple intervention activities.
We developed 272 substantial IPC intervention activities involving 2,407 face-to-face encounters with health system personnel. Staff attitudes toward IPC were surveyed yearly using Heinemann et al's Attitudes toward Health Care Teams and Parsell and Bligh's Readiness for Interprofessional Learning scales (RIPLS). At study's end staff assessed whether project goals were achieved.
Of the improvement projects, 76 exhibited progress, and 57 made considerable gains in IPC. Educational workshops and feedback sessions were well received and stimulated interprofessional activities. Over time staff scores on Heinemann's Quality of Interprofessional Care subscale did not change significantly and scores on the Doctor Centrality subscale increased, contrary to predictions. Scores on the RIPLS subscales of Teamwork & Collaboration and Professional Identity did not alter. On average for the assessment items 33% of staff agreed that goals had been achieved, 10% disagreed, and 57% checked neutral. There was most agreement that the study had resulted in increased sharing of knowledge between professions and improved quality of patient care, and least agreement that between-professional rivalries had lessened and communication and trust between professions improved.
Our longitudinal interventional study of IPC involving multiple activities supporting increased IPC achieved many project-specific goals. However, improvements in attitudes over time were not demonstrated and neutral assessments predominated, highlighting the difficulties faced by studies targeting change at the systems level and over extended periods.
KeywordsSystems research Action research Intervention Change Interprofessionalism Survey Longitudinal research Attitudinal improvement Collaboration Socio-ecological theory
Much health systems research is underpowered or cross-sectional. The field is dominated by small-scale studies, where research designs typically fail to incorporate longitudinal measurements. Studies of interprofessional learning (IPL) and interprofessional practice (IPP) (collectively, interprofessional collaboration (IPC)) are no exception. By professionalism we mean the expertise, challenges and autonomy that characterise practitioners' clinical work. Typically interprofessionalism is defined as two or more health care team members from differing professions working together productively, each making unique contributions to common goals. There is a prevalent view that encouraging interprofessionalism leads to enhancements in the ways healthcare professionals relate, interact and communicate, with resulting gains in quality of care and patient safety [1–3]. Demonstrating this causal chain has proven difficult, and showing controlled or sustained improvements in IPC has challenged researchers.
Some studies with randomised controlled designs have demonstrated IPC gains. Localised interprofessional rounds , interprofessional meetings [5, 6] and externally facilitated interprofessional audits  can, depending on context, contribute to improvements in care (for a detailed review, see Zwarenstein et al. ). Building on this research, we deployed an action research team to the field to strengthen health professionals' IPC endeavours across the Australian Capital Territory's health system (ACT Health) over four years .
Rather than measure quality of care, which is notoriously difficult to achieve at the systems level [10, 11], we designed interventional activities to make concerted efforts to stimulate increased interprofessionalism. We actively sought to work with staff, promoting communication, trust, joint problem solving, knowledge sharing and mutually constituted care, and discouraging rivalries and hierarchical modes of working. The research design, based on socio-ecological change theory, aimed to induce improvements by construing the health service as a socio-ecological system amenable to multiple intervention strategies [12, 13]. This involved purposefully ranging across organisational hierarchical levels and divisional boundaries and silos, working with diverse participants and groups, focusing on cultural, interprofessional and process improvements. Socio-ecological theory eschews single method studies, instead proposing that the dynamic interconnections between behaviour and complex environments must be taken into account for change to occur [14, 15]. It invites interventional researchers to take a multi-level, multi-pronged approach.
The aims of the present study were to investigate whether: 1) Initiatives, workshops and activities supported by the intervention achieved their goals, 2) Attitudes of health staff toward IPL and IPP became more favourable during the course of the study as measured at yearly intervals and 3) Health staff judged the intervention had achieved its goals.
Intervention projects and activities
Seven investigators with expertise in social psychology, medicine, patient safety, science, allied health, statistics, nursing and economics contributed to this study. Three experienced social scientists engaged as field researchers worked with an experienced project officer in the health system, led by a senior executive. Ethics committee approval for this project was given by the UNSW Social/Health Research Human Research Ethics Advisory Panel [approval number 09-10-006] and ACT Health Ethics Committee [approval number ET.3/07.2740].
Examples of interventional activities
Enhancing IPL-IPP of Continuum of Care for Allied Health Managers
The project investigated how a senior management meeting could be improved to enhance IPC and clinical governance
• Development and piloting of questionnaire survey
• Cross sectional census: survey
• FEFL reflection exercise
IPL and IPP in Palliative Care
To strengthen staff wellbeing through examining and reflecting upon staff attitudes and their ongoing experience of IPC
• Development and piloting of survey
• Longitudinal survey results fed back to participants
• FEFLs with team
Enhancing the interprofessional capacity of the Integrated Multi-agencies for Parents and Children Together (IMPACT) Program
To enhance intra- and inter-agency IPC with the aim of improving client outcomes
• Development and piloting of survey
• Longitudinal survey results
• Key informant interviews, working out ways to collaborate more effectively
• FEFLs with program staff
IPL in primary health care to encourage active patient self-management of chronic disease (PSMCD)
The project aimed to 1) identify strategies to strengthen PSMCD; 2) improve IPC across the health and community services sectors; and 3) support improvements in patient health literacy
• Development and piloting of questionnaire survey
• Longitudinal survey results
• Key informant interviews, with information fed back to participants
• Consumer focus groups
• FEFLs with program staff
Evaluating the enactment of the Clinical Care Cultural Charter
To assess progress in the enactment of a staff-defined organisational cultural charter
• Development and piloting of survey
• Survey of staff
• FEFL at staff development session
Survey samples and procedure
ACT Health had 4,996 staff (full-time equivalent) in 2010, a slight increase from 4,869 at the beginning of the study, serving a population of almost 352,000. We surveyed staff in 2008, 2009 and 2010. Questionnaires were distributed at meetings to approximately 74% of clinical teams and units. Taking account of those not rostered at those times 30% of staff who had the opportunity to return the questionnaire in 2008 did so (n = 449), 35% in 2009 (n = 525) and 31% in 2010 (n = 471). Of staff completing the 2010 survey 16% indicated that they had completed both prior surveys, 8% that they completed the 2009 survey only, and 2% that they completed only the 2008 survey. Of staff answering the 2010 survey 39% had not been working for ACT Heath at the time of the first survey and only 52% had worked for ACT Health at the time the study commenced. As the surveys were completed anonymously it was not possible to compare an individual's responses across time. Overall, this implies that the majority of respondents completed the survey on only one occasion.
In the analyses, the respondent groups for each of the three years were treated as independent. The proportions of respondents from the different professions differed marginally across the years. The percentages of participants in 2008, 2009 and 2010 were medicine (8%, 5%, 9%), nursing (40%, 52%, 45%), allied health (36%, 33%, 35%), administration (12%, 5%, 7%), and other professions (4%, 4%, 4%). Thus compared to other years nurses were over-represented in 2009 and administrators in 2008. Similar proportions of males (17%) and females (83%) responded on all occasions. Average time since graduation for respondents across years was similar (15.6 years) as was time spent working in ACT Health (4.5 years).
Scales in survey questionnaire
Attitudes toward Health Care Teams Scale
Subscales : Scores 6 (strongly agree) to 1 (strongly disagree)
Higher scores indicate acceptance of doctors' higher authority in health care teams
Quality of interprofessional care (14 items)
e.g. 'The interprofessional team approach makes the delivery of care more efficient'
Higher scores indicate agreement with value of interprofessional care
Physician Centrality (6 items)
e.g. 'Doctors have the right to alter patient care plans developed by the interprofessional team'
RIPLS (Readiness for Interprofessional Learning Scale)
Subscales : Scores 5 (strongly agree) to 1 (strongly disagree):
Higher scores indicate non-rigid, non-tribal professional identity
Teamwork & Collaboration (9 items)
e.g. 'Team-working skills are essential for health professionals from different professions to learn'
Higher scores indicate approval of interprofessional teamwork and collaboration
Professional Identity (7 items)
e.g. 'Clinical problem-solving skills can only be learned with health professionals from my own profession' (reverse scored)
Results of ANOVAs comparing staff attitudes in 2008, 2009 and 2010
Mean scores for years
Duncan range test results*
2008 (n = 449)
2009 (n = 525)
2010 (n = 471)
Attitudes toward Health Team subscales
Quality of IP Care #
Doctor Centrality #
2009 2008 2010
Teamwork & Collaboration §
Professional Identity §
Interprofessional projects were stimulated by the study. They were logged and documented, and included in a database. The documentation was reviewed and content-analysed and the projects categorised. The scores on the two Attitudes toward Health Care Teams and two RIPLS subscales of the groups tested in the three years were compared by ANOVAs. When an F value was significant a Duncan range test was performed to identify which years differed significantly from others. The assessments of the success of 10 goals of the study made by respondents in 2010 were tabulated and a total assessment index calculated for each item by subtracting the percentage of the group who disagreed that a goal had been achieved from the percentage that agreed. For example, if 29% agreed and 8% disagreed that communication had improved the assessment index for this item would be 21%. Assessment indices were ranked from 1 (goal most achieved) to 10 (goal least achieved).
The interventions realised over the period 2007-2010 were the initiation or support of 101 substantial IPC improvement projects involving 573 health system participants, 108 feedback sessions (with 1,010 participants), 25 educational workshops (594 participants) and 38 other interventional activities (230 participants), attempting to build systems-wide momentum in support of increased IPC. The interventions stimulated are typified by the examples listed in Table 1. Intervention activities were conducted widely throughout the health system including in acute services, aged care, rehabilitation, mental health, community health and cancer services, involving some 2,407 substantial face-to-face encounters between research team staff and health professionals.
Assessment by the 2010 sample of achievement of study goals
'The IPL-IPP study has...'
% of staff responding
(% agree - % disagree)
1. Improved communication between members of different professions
2. Improved trust between members of different professions
3. Helped individuals improve communication skills
4. Reduced between-professional rivalries
5. Resulted in better relationships between members of different professions
6. Resulted in more positive attitudes to team work
7. Led to sharing of knowledge/
ideas between members of different professions
8. Led to more creative, integrated services
9. Improved clinical practice between members of different professions
10. Improved quality of care for patients
Our concerted, longitudinal study, in partnership with a receptive health system which was prepared to engage in action research, produced or documented multiple activities promoting IPC. We stimulated many health system encounters with staff, and demonstrated substantial and growing participation in, and support levels for, interprofessionalism. However we found no evidence of improvements in attitudes over time, and in one case found that attitudes became less favourable; all despite the expertise provided by the intervention. This is consistent with Jha et al's conclusion that there is scant evidence of interventions influencing attitudes toward professionalism in medicine . Nevertheless examination of the mean subscale scores indicates that, on the whole, staff possessed relatively favourable attitudes toward IPC from the very beginning, i.e., the time of the first survey (Figure 3). The mid-point of the Heinemann et al. subscales is 3.5. Mean scores on the Quality of Interprofessional Care subscale were substantially higher than this on all occasions and the means on the Doctor Centrality subscale were below the mid-point even when they rose at the end of the project. The mid-point of the RIPLS subscales is 3 and on the Teamwork & Collaboration and Professional Identity subscales the staff means were well above 3 each year. Thus the ACT Health workforce as a whole was well disposed toward IPC from the initial testing a year into the research. We do not know whether improvement occurred prior to the initial survey.
Notwithstanding much normative literature arguing in favour of IPC, according to these results, enabling greater levels of IPC across health systems over time is challenging. By expressing neutral views to the goal assessment questions the majority of staff did not commit themselves to judging either the success or failure of the project in achieving its objectives. The neutral response rate was high for this type of survey. Participants' reasons for checking neutral may have varied from feeling unable to make an assessment, holding mixed attitudes which were averaged to 'neutral', to lacking interest. If the wording of the items had specifically asked respondents to answer in terms of their own experiences they may have been less hesitant to make judgements. Nevertheless of staff making a definite assessment, three times more on average agreed goals had been achieved as disagreed that this was the case. The project was considered most successful in bringing about a sharing of ideas between members of the different professions, improving the quality of patient care and bringing about more positive attitudes toward team work. The least successful goals were the attempts to reduce between-professional rivalries, improve communication between the professions and improve inter-professional trust, which are core goals of IPC. Thus some of the goals of interprofessionalism appear to be more achievable than others.
A limitation of the study was staff turnover. This is a phenomenon all longitudinal health systems research faces. Many staff were not exposed to the full project so could the observed lack of change of attitudes over time be partly attributed to new staff? This possibility was not supported when we compared the 2010 attitude scores of staff who had only worked in ACT Health for two years with staff who had been employed for the full project. Newer staff expressed similar attitudes to their longer-term counterparts. Additionally, newer staff differed significantly from longer-term staff in their assessments of the project; on all items recent staff made fewer negative, more neutral and with one exception, more favourable judgements. Not surprisingly, longer exposure to the project was associated with greater likelihood of making a definite appraisal but that appraisal was more likely to be unfavourable. Perhaps we are detecting a form of world-weary jadedness in longer-standing staff, and more accommodating receptivity for IPC exhibited by newer, possibly younger recruits. The differing professional composition of the samples on the three testing occasions was also a limitation. However differences occurred primarily in the proportions of administrators and nurses. Examination of the professional groups' responses indicated that these two professions expressed more moderate attitudes on the attitude subscales while allied health and doctors held the more extreme attitudes, allied health expressing the most favourable and doctors the least favourable views about IPC.
Other study limitations include: lack of randomisation and a control group (although in mitigation, this was an attempt to induce systems-wide change rather than do a randomised controlled trial); weak capacity to identify causality between interventions and improvements; lack of baseline data; and incomplete knowledge of the contribution of different elements of the study toward influencing IPC. In research of this kind we cannot rule out the Hawthorne effect , a mechanism whereby any changed behaviour can be attributed to participants responding to being studied. However, the point of action research is to promote improvements. In any case, untangling Hawthorne from planned study effects is not possible with current research capacities.
These findings highlight the difficulty faced by studies promoting change across entire health systems and over extended periods where staff are busy, have many existing routines, and encounter competing priorities. We have demonstrated that a study predicated on using multiple interventional strategies to involve differing hierarchical levels, applying a socio-ecological logic with multiple target groups to induce systems change in IPC, is feasible . However, it may be that longer time periods are needed to show sustained gains in IPC gradients at the systems level. Studies of this kind must answer the question: how will we engage and maintain the interest of managers and staff in longitudinal action research projects sufficiently to make significant change? On average, of staff who did make a definite assessment over three-quarters believed that the goals had been met. However, primary strategies of the study centred on lessening interprofessional rivalry and distrust and these were judged as least successful. Accomplishing these seems to be particularly challenging [18, 26, 29]. Improving IPC in complex socio-ecological environments seems to be an entrenched , wicked  problem.
We wish to thank and acknowledge Karen Murphy, Allied Health Adviser and Judy Stone, Interprofessional Learning Coordinator, ACT Health, and Associate Professor Marc Budge, the Australian National University, for their support and work to facilitate this project. This research was supported by ARC Linkage Grant LP0775514 and NHMRC Program Grant 568612.
- Braithwaite J, Runciman W, Merry A: Towards safer, better healthcare: harnessing the natural properties of complex sociotechnical systems. Qual Saf Health Care. 2009, 18: 37-41. 10.1136/qshc.2007.023317.View ArticlePubMedPubMed CentralGoogle Scholar
- Leonard M, Graham S, Bonacum D: The human factor: the critical importance of effective teamwork and communication in providing safe care. Qual Saf Health Care. 2004, 13: 85-90.View ArticleGoogle Scholar
- Sutcliffe K, Lewton E, Rosenthal M: Communication failures: an insidious contributor to medical mishaps. Acad Med. 2004, 79: 186-194. 10.1097/00001888-200402000-00019.View ArticlePubMedGoogle Scholar
- Curley C, McEachern J, Speroff T: A firm trial of interdisciplinary rounds on the inpatient medical wards. Med Care. 1998, 36: AS4-AS12. 10.1097/00005650-199808001-00002.View ArticlePubMedGoogle Scholar
- Schmidt I, Claesson C, Westerholm B, Nilsson L, Svarstad B: The impact of regular multidisciplinary team interventions on psychotropic prescribing in Swedish nursing homes. J Am Geriatr Soc. 1998, 46: 77-82.View ArticlePubMedGoogle Scholar
- Wilson S, Marks R, Collins N, Warner B, Frick L: Benefits of multidisciplinary case conferencing using audiovisual compared with telephone communication: a randomized controlled trial. J Telemed Telecare. 2004, 10: 351-354. 10.1258/1357633042602026.View ArticlePubMedGoogle Scholar
- Cheater F, Hearnshaw H, Baker R, Keane M: Can a facilitated programme promote effective multidisciplinary audit in secondary care teams? An exploratory trial. Int J Nurs Stud. 2005, 42: 779-791. 10.1016/j.ijnurstu.2004.11.002.View ArticlePubMedGoogle Scholar
- Zwarenstein M, Goldman J, Reeves S: Interprofessional collaboration: effects of practice-based interventions on professional practice and healthcare outcomes. Cochrane Database of Syst Rev. 2009Google Scholar
- Braithwaite J, Westbrook J, Foxwell AR, Boyce R, Devinney T, Budge M, et al: An action research protocol to strengthen system-wide inter-professional learning and practice [LP0775514]. BMC Health Serv Res. 2007, 7: 144-10.1186/1472-6963-7-144.View ArticlePubMedPubMed CentralGoogle Scholar
- Braithwaite J, Coiera E: Beyond patient safety Flatland. J R Soc Med. 2010, 103: 219-225. 10.1258/jrsm.2010.100032.View ArticlePubMedPubMed CentralGoogle Scholar
- Benn J, Burnett S, Parand A, Pinto A, Iskander S, Vincent C: Studying large-scale programmes to improve patient safety in whole care systems: challenges for research. Soc Sci Med. 2009, 69: 1767-1776. 10.1016/j.socscimed.2009.09.051.View ArticlePubMedGoogle Scholar
- Edwards N, Mill J, Kothari A: Multiple intervention research programs in community health. Can J Nurs Res. 2004, 36: 40-54.PubMedGoogle Scholar
- Glanz K, Lewis F, Rimer B: Health Behavior and Health Education: Theory, Research and Practice. 2002, San Francisco: John Wiley & Sons, 3Google Scholar
- Bronfenbrenner U: Toward an experimental ecology of human development. Am Psychol. 1977, 32: 513-531.View ArticleGoogle Scholar
- Bronfenbrenner U: The Ecology of Human Development. 1979, Cambridge: Harvard University PressGoogle Scholar
- Greenfield D, Nugus P, Travaglia J, Braithwaite J: Auditing an organisations' interprofessional learning and interprofessional practice: the interprofessional praxis audit framework (IPAF). J Interprof Care. 2010, 24: 436-449. 10.3109/13561820903163801.View ArticlePubMedGoogle Scholar
- Greenfield D, Nugus P, Travaglia J, Braithwaite J: Factors that shape the development of interprofessional improvement initiatives in health organisations. BMJ Qual Saf. 2011, Published Online First: 12 January 2011. doi:10.1136/bmjqs.2010.044545Google Scholar
- Nugus P, Greenfield D, Travaglia J, Westbrook J, Braithwaite J: How and where doctors exercise power: interprofessionalism, collaboration and leadership across a health system. Soc Sci Med. 2010, 71: 898-909. 10.1016/j.socscimed.2010.05.029.View ArticlePubMedGoogle Scholar
- Reason P, Bradbury H: Handbook of Action Research. 2001, London: SageGoogle Scholar
- Heinemann G, Schmitt M, Farrell M, Brallier S: Development of an attitudes toward health care teams scale. Eval Health Prof. 1999, 22: 123-142. 10.1177/01632789922034202.View ArticlePubMedGoogle Scholar
- Parsell G, Bligh J: The development of a questionnaire to assess the readiness of health care students for interprofessional learning (RIPLS). Med Educ. 1999, 33: 95-100. 10.1046/j.1365-2923.1999.00298.x.View ArticlePubMedGoogle Scholar
- McFadyen AK, Webster V, McClaren WM: The test-retest reliability of the Readiness for Interprofessional Learning Scale (RIPLS). J Interprof Care. 2006, 20: 633-639. 10.1080/13561820600991181.View ArticlePubMedGoogle Scholar
- Lauffs M, Ponzer S, Saboonchi F, Lonka K, Hylin U, Mattiasson A-C: Cross-cultural adaptation of the Swedish version of Readiness for Interprofessional Learning Scale (RIPLS). Med Educ. 2008, 42: 405-411. 10.1111/j.1365-2923.2008.03017.x.View ArticlePubMedGoogle Scholar
- McFadyen AK, Webster V, Strachan K, Figgins E, Brown H, McKechnie J: The readiness for Interprofessional Learning Scale: A possible more stable sub-scale for the original version of RIPLS. J Interprof Care. 2005, 19: 595-603. 10.1080/13561820500430157.View ArticlePubMedGoogle Scholar
- Reid R, Bruce D, Allstaff K, McLernon D: Validating the Readiness for Interprofessional Learning Scale (RIPLS) in the postgraduate context: Are health care professionals ready for IPL?. Med Educ. 2006, 40: 415-422. 10.1111/j.1365-2929.2006.02442.x.View ArticlePubMedGoogle Scholar
- Jha V, Bekker HL, Duffy SRG, Roberts TE: A systematic review of studies assessing and facilitating attitudes towards professionalism in medicine. Med Educ. 2007, 41: 822-829. 10.1111/j.1365-2923.2007.02804.x.View ArticlePubMedGoogle Scholar
- Mayo E: Hawthorne and the Western Electric Company. 1949, London: Routledge and Kegan Paul, The Social Problems of an Industrial CivilisationGoogle Scholar
- Greenfield D, Nugus P, Travaglia J, Braithwaite J: Interprofessional learning and practice can make a difference: an opposing view. Med J Aust. 2011, 194: 364-365.PubMedGoogle Scholar
- Greenfield D, Nugus P, Fairbrother G, Milne J, Debono D: Applying and developing health service theory: an empirical study into clinical governance. Clin Gov Int J. 2011, 16: 8-19. 10.1108/14777271111104547.View ArticleGoogle Scholar
- Rittel H, Webber M: Dilemmas in a general theory of planning. Policy Sci. 1973, 4: 155-169. 10.1007/BF01405730.View ArticleGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1472-6963/12/99/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.