Skip to main content
  • Research article
  • Open access
  • Published:

Evaluating the impact of a falls prevention community of practice in a residential aged care setting: a realist approach

Abstract

Background

Falls are a major socio-economic problem among residential aged care (RAC) populations resulting in high rates of injury including hip fracture. Guidelines recommend that multifactorial prevention strategies are implemented but these require translation into clinical practice. A community of practice (CoP) was selected as a suitable model to support translation of the best available evidence into practice, as it could bring together like-minded people with falls expertise and local clinical knowledge providing a social learning opportunity in the pursuit of a common goal; falls prevention. The aims of this study were to evaluate the impact of a falls prevention CoP on its membership; actions at facility level; and actions at organisation level in translating falls prevention evidence into practice.

Methods

A convergent, parallel mixed methods evaluation design based on a realist approach using surveys, audits, observations and semi-structured interviews. Participants were 20 interdisciplinary staff nominating as CoP members between Nov 2013-Nov 2015 representing 13 facilities (approximately 780 beds) of a RAC organisation. The impact of the CoP was evaluated at three levels to identify how the CoP influenced the observed outcomes in the varying contexts of its membership (level i.), the RAC facility (level ii.) and RAC organisation (level iii.).

Results

Staff participating as CoP members gained knowledge and awareness in falls prevention (p < 0.001) through connecting and sharing. Strategies prioritised and addressed at RAC facility level culminated in an increase in the proportion of residents supplemented with vitamin D (p = 0.002) and development of falls prevention education. At organisation level a falls policy reflecting preventative evidence-based guidelines and a new falls risk assessment procedure with aligned management plans were written, modified and implemented. A key disenabling mechanism identified by CoP members was limited time to engage in translation of evidence into practice whilst enabling mechanisms included proactive behaviours by staff and management.

Conclusions

Interdisciplinary staff participating in a falls prevention CoP gained connectivity and knowledge and were able to facilitate the translation of falls prevention evidence into practice in the context of their RAC facility and RAC organisation. Support from RAC organisational and facility management to make the necessary investment in staff time to enable change in falls prevention practice is essential for success.

Peer Review reports

Background

Falls are a major socio-economic problem in the residential aged care (RAC) sector; half its population fall annually [1,2,3] and 25–30% of these falls result in physical injury [3,4,5]. Consequences for residents who fall include increased risk of mortality, functional decline, depression and anxiety [4, 6, 7] in addition to significant cost burden for the health sector [8, 9]. Preventing falls and resultant injury is challenging due to the multifactorial nature of falls, the complex characteristics of RAC populations who have multiple co-morbidities with age-related systems decline [5, 10, 11] and a diversely skilled workforce caring for them [10, 12]. Two recent meta analyses in RAC populations showed different findings; the Cochrane review [13] found supplementing residents with low vitamin D levels reduced the rate of falls by 37% but not the risk of falling whilst Vlaeyen et al. [7] reported multifactorial interventions delivered by a multidisciplinary staff reduced falls by 33% and the number of recurrent fallers by 21%. Falls prevention evidence based guidelines also offer strategy implementation and adoption advice at staff, facility and organisation levels [14, 15]. Implementing and adopting evidence based falls prevention activities in the context of a RAC organisation requires embedding these activities in policy, processes and practices. To achieve this translation into practice systematic enquiry, synthesis and tailoring of falls prevention evidence for the local workplace is necessary [16,17,18]. Thus bringing people together with falls research expertise and local knowledge of barriers and facilitators to RAC workplace practices could facilitate effective translation of evidence into practice. One option to bring like-minded people together is a community of practice (CoP) that enables sharing of expertise and ideas, to innovate for change in pursuit of a common goal [19,20,21]. CoPs have been used in health care organisations with the intent of building capacity and improving health care outcomes with inconclusive results largely due to poor or absent evaluation. Improved impact evaluations are thus indicated [21,22,23]. A CoP was established to bring together RAC staff with an interest and goal in preventing falls with the intention of offering a social learning opportunity [19] and robustly evaluating its feasibility to facilitate translation of the current evidence using both objective outcomes and observed changes in health behaviour [24, 25]. The CoP was viewed as a complex intervention at the organisational level that could have differing impact across RAC facilities and the individual staff participating as members, dependent upon leadership, culture and staff behaviours [25,26,27]. Evaluation using this realist approach could identify how the CoP influenced the observed outcomes in different contexts of its membership, the RAC facility and RAC organisation [26, 28, 29].

Therefore the aims of this study were to evaluate the impact of a falls prevention CoP on its: i) membership; ii) actions at facility level; iii) actions at organisation level in translating falls prevention evidence into practice.

Methods

Design

This study used a convergent, parallel mixed methods evaluation design [30] based on a realist approach [31]. It formed part of a larger project to evaluate the impact of a falls prevention CoP on falls outcomes (including falls rates and injurious falls rates) in a RAC setting [32]. Briefly, realist approaches have been used when more than a description of an intervention’s outcomes is required; they seek in depth to identify how interventions trigger (mechanisms) the observed ‘outcomes’ in varying ‘contexts’ [26, 28, 31]. These triggers, termed ‘mechanisms’, are hidden causal factors that under certain conditions produce a particular outcome. Theoretical explanations of how a CoP might impact falls prevention were derived from the literature and stakeholder meetings using a context, mechanisms and outcomes (CMO) framework described elsewhere [32]. This framework was tested by posing the questions “what was it about the intervention that worked?”, “for whom?”, and “under what conditions?” Survey questionnaires, semi-structured interviews, observation journals, electronic transcripts, emails, meeting minutes, clinical records and policy documents provided data on CoP activity. An overview of the study design is shown in Fig. 1.

Fig. 1
figure 1

Overview of measuring CoP impact at member, facility and organisational level

Participants and setting

The RAC organisation was led by a Chief Executive Officer from a central administrative site. There were approximately 1200 full and part time care staff across 13 geographically diverse facilities providing mainly high level care in a home-like environment for 780 older people with a mean age of 84.01 years (SD = 4.56 years). Facilities were led by a care manager, with direct resident care provided mostly by care assistants supervised by professional nursing and allied health staff. The CoP partnered university researchers with staff across the 13 facilities. As the CoP was an intervention at organisation level and it’s actions interventions at facility level, all RAC facilities operated by the provider organisation were included. CoP membership was open to all RAC facility staff involved in resident care expressing an interest in falls prevention, following invitations delivered at facility and organisational levels. All facilities were represented by at least one CoP member with no more than 20 members at any one time for the duration of the study. Fourteen (65%) allied health professionals five (25%) care/deputy care managers and one (5%) researcher made up the membership. All CoP activities involving RAC staff or residents followed invitations provided at facility and organisation level yielding purposive samples. The study was conducted between November 2013 and November 2015.

Outcome measures

The impact of the falls prevention CoP was evaluated at three levels; i) membership level (RAC staff who participated), ii) RAC facility level and iii) RAC organisation level on translating falls prevention evidence into practice, as shown in Fig. 1. This range of measured outcomes was used to inform theorised explanatory conjectured CMOs, which postulate how the outcomes were achieved considering the context in which they took place.

Data collection and procedure

CoP member level

An online survey questionnaire was administered to CoP members via an email link using software by SurveyMonkey™ on entry into the CoP and following 24 months of CoP operation. Additional open response questions, modified from Ranmuthugala et al. [26], to determine experiences of CoP membership were included in the 24 months post CoP operation questionnaire. CoP electronic communication transcripts including emails and face to face meeting minutes were used for triangulation.

The researcher kept a journal to record her observations and reflections regarding CoP member participation and operation. The observations contributed to descriptions and explanations of CoP web based communication, activity and impact. Findings were presented to the CoP members to establish respondent validation or ‘member checking’ [30, 33].

The establishment of a community through connections between its members and knowledge flow through the community was recorded by counting postings on the CoP intranet discussion web page and whom the posting was shared with, in addition to members’ email frequency and attendance at eight face to face meetings. These CoP member interactions were recorded in a Microsoft Excel (2013) spreadsheet (Microsoft Corporation, Washington, USA).

RAC facility level

Measurement of the impact of the CoP at facility level prioritised improving the proportion of residents supplemented with vitamin D and development of falls prevention education. These priority areas were determined in the early phase of CoP operation when the CoP conducted an audit of falls prevention activity [34]. One of the 13 RAC sites did not participate in this intervention evaluation as it converted to a short term transition care facility and thus residents were not present for the duration of the intervention.

The proportion of residents at each facility supplemented with vitamin D was calculated from medication charts. Electronic dispensing records from supplying pharmacists were sourced to verify the accuracy of medication chart audits.

Surveys of care staff and residents were planned to scope what they knew and thought about falls and falls prevention to inform subsequent education program design.

Care staff consenting to participate were surveyed using a self-administered questionnaire distributed in a paper format at facility shift handovers, as computer access was limited. Explanation on completing the questionnaire was provided verbally and in written format by the shift registered nurse and the survey collection box was given prominence at the nurses’ station. Completed questionnaires were collected after two weeks by the researcher.

Consenting residents who did not have a diagnosis of cognitive impairment were surveyed face to face by a trained research assistant who read them the questions and recorded their responses.

All facility care managers (n = 13) were surveyed using an emailed short questionnaire modified from Ranmuthugala et al. [26] to determine their perception of CoP impact at their RAC facility following 24 months of CoP operation.

RAC organisation level

Policy manuals, procedure documents (including forms) and stakeholder meeting minutes were scrutinised by facility CoP members and professional staff at facilities during the falls prevention activity audit that is reported elsewhere [34]. Semi-structured interviews were conducted with two managerial representatives from the organisation, who had a role in overseeing the CoP project from its inception, using CoP evaluation questions modified from Ranmuthugala et al. [26]. The interviews were audio recorded using a digital dictaphone and followed the procedure recommended by Liamputtong [35]; face to face contact was established, the researcher chatted with the participants ensuring their comfort and gave an explanation of the interview procedure and recording process. Participants were encouraged to speak freely and on completion these conversations were transcribed verbatim by the researcher and checked by a second researcher for accuracy. Transcripts were returned to participants for member checking.

Data analysis

Member level

CoP member pre and post questionnaire responses addressing capability, confidence, opportunity and motivation to champion falls prevention activity were extracted into SPSS version 22 software package (IBM SPSS Inc., Chicago IL, USA) and summarised using descriptive statistics. Differences pre CoP and 24 months post CoP operation were examined using a Wilcoxon signed rank test. Social Network Analysis enables the study of social processes by examining connections between individuals and communities [36]. As learning and knowledge exchange in CoPs is considered to occur at a social level, we undertook a social network analysis to determine the relationships and connections established between CoP members and patterns of knowledge flow within the CoP, that reflected learning. Data were organised in an excel matrix prior to entry into Ucinet 6 for Windows (Software for Social Network Analysis. Harvard, MA: Analytic Technologies). Exchanges between groups of members on the CoP discussion board provided frequency counts that were displayed in a matrix representing CoP member activity and connectivity. Qualitative data from CoP surveys, CoP face to face meeting minutes, researcher journal observations and emails were collected, transcribed verbatim and managed using NVivo analysis software (QSR International Pty Ltd. Version 10, 2012). Two independent researchers (JFC, AMH) read through all transcripts several times to become familiar with the data [37]. Correct responses in regard to falls prevention knowledge, were determined by two researchers with falls prevention expertise based on research evidence and best practice guidelines [13,14,15]. Where open question responses provided further categorical data frequency counts were also undertaken. Transcripts were analysed using deductive content analysis, which uses previous knowledge around the research topic, when a theory is being tested [38]. Question led category matrices were constructed [38] for member level responses based on the theoretical framework of what CoP activities or behaviours may have triggered the observed outcomes [26, 32]. As it was theorised CoP outcomes would be influenced by CoP member actions and behaviours the determinants of health behaviour change; capability, opportunity and motivation (to enact falls prevention behaviours) were used as a framework [24, 25]. Coding was thus framed around these behaviour change determinants of capability, opportunity and motivation [24] to explain what worked or didn’t work (CoP falls prevention actions, behaviours) for whom (members, RAC facilities, RAC organisation) and under what conditions [26, 29].

Facility level

Pre and post CoP audit measures for the proportion of residents per RAC facility on Vitamin D supplementation were described using proportion and percentage. Proportion differences pre and post intervention were examined using a dependent t-test or the non-parametric alternative Wilcoxon signed rank test. Cross-sectional quantitative survey responses from care managers, care staff and resident surveys were entered into SPSS version 22 software package (IBM SPSS Inc., Chicago IL, USA) and summarised using descriptive statistics. Qualitative care manager perceptions of CoP impact at their facilities were analysed using deductive content analysis and a capability, opportunity and motivation (to perform the behaviour) categorisation matrix as described previously [38].

Organisation level

Content analysis of falls prevention related policy and process documents (electronic and paper) together with management meeting minutes at baseline and following 24 months of CoP operation was undertaken to identify newly implemented falls related documents or process reporting. Data from semi-structured interviews of two management representatives was transcribed verbatim and analysed as described for CoP members.

Identification of causal mechanisms

After analyses for each level were completed, results from all 3 levels of measurement were examined to deduce what worked for whom and under what conditions; forming conjectured CMOs.

Results

The impact of the falls prevention CoP at member, facility and organisation level is summarised in Table 1.

Table 1 Summary of CoP impact at member, facility and organisation level

Member level impact

A total of 22 staff participated as CoP members for varying durations throughout the study, with 18 completing surveys pre CoP and 24 months post CoP operation.

Capability, opportunity and motivation to prevent falls

The greatest benefit of CoP membership reported by participants was improved evidence based falls prevention awareness and knowledge, Participating CoP member (P)11“I’ve a better scope of knowledge relating to falls, the awful consequences and the evidence too.” CoP members (n = 18) identified falls prevention strategies they were aware of at baseline [125 correct responses, median number of correct responses = 6.00 (IQR = 3–15)] and 24 months post CoP operation [221 correct responses, median number of correct responses = 10.50 (IQR = 4–28)]). There was a significant difference between the pre and post scores with post survey scores showing increases in knowledge [p < 0.001]. For example there was awareness of intrinsic risk factors like medication review, P6“it’s improved my personal knowledge of falls management (multifactorial approach),” P8“I didn’t know the impact vitamin D and medications can have on falls until I joined the CoP. I bring this up when discussing with residents and staff.”

When member survey responses regarding motivation and confidence to lead falls prevention activities were compared pre CoP and 24 months post CoP operation there were no significant differences (see Additional file 1). However when interviewed six members reported they felt motivated to attend external falls prevention events since joining the CoP, P3“I’ve registered for the local falls conference,” and eight became new contributors to facility falls prevention meetings, P9“I’m part of a regular falls meeting at my facility now.”

Connectivity amongst the membership

New or improved social connections were enabled, P7 “it was great to get to know more staff” and the opportunity to network, ask questions and share ideas with interdisciplinary colleagues (n = 11) was perceived as a membership benefit. This was reported as particularly relevant for members who were new to the RAC organisation or novice practitioners, P13“It was lovely to have a place where I could ask questions,” P9“I feel I can contribute more to preventing falls and discussions about falls.” Knowledge flow through the CoP and connections amongst members was evident through frequency counts of discussion board participation and post sharing amongst CoP members (see Additional file 2) and is represented visually in Fig. 2.

Fig. 2
figure 2

CoP member connectivity and knowledge flow amongst the membership

There were 11 different CoP web-based discussion topics supported by eight face to face meetings across the 24 months of CoP operation. Discussion topics included falls prevention auditing (29 member posts), promoting vitamin D supplementation (20 member posts), “Ask the CoP?” (21 member posts) and psychotropic medication use (11 member posts). The researcher and facilitator were the most connected across the entire membership providing a link between the research institution and RAC organisation. Six CoP members, who were therapists, became the most connected sharing more than eight postings and additional monthly email contact. Seventeen members shared falls prevention knowledge from the CoP with staff at their facilities, P7 “I gave feedback at staff meetings, clinical meetings and shift handovers” and ten with residents at their facilities, P8 “we’ve discussed falls prevention in our new ‘Better Balance’ program.”

The key barrier to member participation in the CoP was perceived to be lack of dedicated time due to competing interests P9 “finding the time with so many other things to do,” Manager 1 “staff got no additional time to support involvement in the CoP, this was a barrier to getting things done.”

Facility level impact

Evidence-based falls prevention audit

The CoP was able to successfully lead and conduct a falls prevention activity audit at all 13 facilities in the organisation. The full procedure and results of the audit are described elsewhere [34].

Vitamin D supplementation

Significant improvements were made across 12 participating RAC facilities in the proportion of residents supplemented with vitamin D from July 2014 (baseline CoP audit) to November 2015 (follow up audit) with the mean increase in the proportion of residents receiving supplementation of 28.23% [(95%CI:15.96–40.51), p = 0.002] (see Additional file 3). P8“we have printed out all the articles on vitamin D and the nursing staff have put the articles in all our visiting GP’s files and they discuss it with them so residents can be put on vitamin D.” The key barrier to supplementation was identified as lack of some GP’s willingness to prescribe, P8 “Some GPs are very resistive to any suggestions, it’s like they think what do you know?”

Falls prevention education

To inform development of education, surveys of care staff and residents were undertaken to determine what they knew and thought about falls prevention following piloting at a single facility. Briefly, 147 care staff from eight facilities participated (response rate 37.9%); reminders to carry out falls prevention strategies by displaying posters around the facility were the most popular education preference [n = 80 (54.4%)]. Forty residents who did not have a diagnosis of cognitive impairment (response rate 83.3%) across six facilities participated in the resident survey. Education preferences included having a reminder poster for their room [n = 11 (27.5%)]. These findings led to the development and implementation of a pictorial falls prevention poster checklist across all facilities. One CoP member developed the ‘Catch a Falling Star’ program targeting residents assessed as at higher risk of falling and recurrent fallers using a personalised strategy checklist, P16“we have the falling stars program, our residents have personal checklists to remind staff of the strategies to use at all times.” Twenty two (78.6%) care staff participating in the survey from this facility discussed using the program when questioned about their knowledge of falls prevention strategies, Care staff 4“I check and report on the falling star plans every shift,” Care staff 11“falling star plan says to always make sure they (resident) have their call bell in reach.” Following CoP information sharing this program was then implemented by two additional facilities. Feedback from 12 care managers regarding CoP impact at their facility was strongly perceived to be: improved staff falls prevention awareness and actions through education and resources provided by the CoP members, Manager 9 “given staff ideas on how to keep residents from falling, it’s a very precious tool.”

Falls meetings, screening personal items and equipment provision

Falls prevention practices deemed to be effective at some facilities were shared with others for adoption, these included monthly facility “falls meetings” (n = 3) and falls prevention becoming an agenda item at staff meetings (n = 7), P3 “we prioritised it, we discussed prevention together in team meetings to help them (staff) understand,” P2 “we helped staff realise how important it is by showing them the facts (displaying monthly falls rates)” and screening resident footwear and clothing (n = 3) P16“we went through the cupboards checking all items that were unsafe so family could remove, if it’s not there staff can’t put it on.” Additional equipment, namely sensor lights for night-time toileting and bed or chair alarms, was introduced at two facilities.

Barriers to implementation

Barriers identified by CoP members to implementing fall prevention strategies included perceived lack of management support in realising the importance of prioritising falls prevention and member participation, P16“there were some care managers who didn’t provide the project with the same importance as mine,” P17“at a facility where the manager is not committed, sees it (CoP) as less relevant, then it’s hard to get any impact,” Manager 1“if you’ve got care manager support then it’s front and centre in peoples’ minds.”

Organisation level impact.

Falls prevention policy and processes

CoP auditing of relevant falls related policy and process documents and management meeting minutes identified gaps in governance for targeted attention, Manager 1“having a culture of wanting to improve is fundamental, acknowledge you are not perfect, have a willingness to change.” A standardised fall definition to assist in clarifying the reporting of falls was adopted, “an unexpected event in which a person comes to rest on the ground or lower level” [39], P2“the wording is easier for everyone to understand in this one,” P5“after discussing this and watching the simulation video I realised that some incidences should have been counted as falls at our facility.” The drafting and completion of a falls prevention policy, risk assessment tool and aligned management strategies by the CoP was an iterative extensive process over 11 months, which engaged CoP members with RAC management. This reflected a cultural shift by both CoP members and RAC managers in their approach to falls from one of reactively managing falls to more proactive prevention, Manager 1“there were gaps and I knew we didn’t have a standardised way of addressing falls, now we do all that proactive preventative stuff.” The CoP liaised with clinical and management groups across the organisation through face to face and email discussions regarding content together with IT personnel for adaptation into workable electronic formats, Manager 1“for me the major achievements of the CoP have been the policies and procedures, that was our gap and now I feel like we’re getting there.”

Dissemination of CoP actions

Raising awareness and providing education regarding falls and falls prevention was addressed via a CoP newsletter in electronic and paper formats four monthly across the organisation to all levels of management, clinical working groups and staff, Manager 2“it’s had a positive impact, I’ve seen it at facilities on coffee tables and noticeboards and heard staff talking about it.” Ten care managers reported the CoP newsletter was distributed at their facilities and 11 thought it was a useful resource. The awareness of the problem of falls and importance of falls prevention raised by the CoP led to CoP reporting becoming an agenda item at the organisation’s Board Care Committees’ meetings, Manager 1“it’s (newsletter) included in reports to the board care committees so they’ve got it as a standing agenda item.”

Barriers to evidence translation

Barriers to the CoP translating evidence into practice from an organisational perspective were conflicting priorities and realising commitment in supporting dedicated staff time, Manager 2“there was a lack of focus (on falls prevention), we didn’t give it dedicated time, but there are so many things we are involved in.”

What worked? for whom? and under what conditions?

Results from each of the three levels of evaluation in the form of conjectured CMOs are presented in Table 2.

Table 2 Conjectured context-mechanism-outcome configurations

The conjectured CMOs demonstrated how the variability observed in translating evidence into practice was influenced by the RAC context. For example, the level of facility care manager support for CoP member participation and action (context), through realising the need to prioritise falls prevention activities (mechanism), influenced the success of translating evidence into practice (outcome).

Discussion

Overall, interdisciplinary staff perceived that they benefitted from participating in a falls prevention CoP and that the CoP was able to translate falls prevention evidence into practice in the context of their individual facility and the RAC organisation.

Member level

Reflection and realisation (CCMO 1 & 2)

Our study found that all CoP members benefited from membership by improving their knowledge of RAC falls prevention strategies through association with experts, but translating this knowledge into practice showed varied levels of success. Although possessing the relevant knowledge is a foundation step in the translation process identified by other studies [16, 18], simply having more knowledge did not necessarily mean CoP members moved it into use at facilities as other factors were involved [18, 40]. Furthermore, translation appeared to be triggered by CoP members who fully understood the negative consequences of a resident fall, reflected and realised the importance of engaging their colleagues in actioning falls prevention strategies at their facility. Reflection and realising negative consequences are traits reported elsewhere as important in triggering health behaviour change [25, 41].

Opportunities, connections and credibility (CCMO 2 & 3)

Membership of the falls prevention CoP enabled clinicians to gain confidence and credibility, through connections to experts and identify themselves as role models. This motivated members to then step up and contribute to falls prevention change at their facilities, particularly if they were new to the field of falls prevention. Social learning opportunity is a characteristic of CoPs whereby association of novice with expert in a field can lead to professional identity building through sharing and collaborating [20, 26]. Higher levels of connectivity in social networks such as CoPs have been associated with a stronger sense of community and greater resource exchange amongst members [42, 43]. Membership of the CoP enabled new and more frequent interdisciplinary connections to develop which then served as a resource for guidance and reduced professional isolation within the organisation as identified by Ranmuthugala et al. [26].

Facility level

Relationships, credibility and advocating (CCMO 4)

Improvement in the proportion of residents supplemented with vitamin D varied across the 12 participating facilities, which could have been influenced by the enabling or disenabling actions of the visiting GPs as the main prescribers (of medications). It was perceived by CoP members that GPs who viewed RAC staff as credible peers, regarding providing falls prevention evidence, advocated for vitamin D supplementation, whereas those who didn’t acted as a barrier. Other studies have found that doctor and nurse cooperation can influence the success of intervention implementation: A systematic review of interdisciplinary interventions in nursing home settings reported positive impacts on resident outcomes when the resident’s doctor participated in the intervention [44]. Conversely Steinmo et al. [45] also noted conflict between doctor and nurse was a key barrier to implementation success of a quality improvement program in a health care setting.

Sharing, motivation and reinforcement (CCMO 5)

More falls prevention activities were implemented at RAC facilities that had manager support and when CoP members were motivated and provided meaningful resources. For example the ‘Catch a Falling Star’ program, supported by the facility manager, was one CoP member’s motivational way of sharing falls prevention strategies that made sense to facility staff and resulted in uptake at their facility. Motivational ways of sharing knowledge is recommended for enabling knowledge transfer [20, 45]. Enactment of falls prevention strategies by frontline care staff was observed when facility managers supported staff accountability, through reinforcing documentation of their actions in resident notes. Reinforcement of desired health behaviours has been shown to assist in habit formation [24, 25].

Prioritising and supporting (CCMO 6)

CoP members who were given the time to attend face to face CoP meetings and became involved in web-based discussion and collaboration were more successful at implementing falls prevention evidence and practice change at their facility. This action was perceived by CoP members to be triggered when care manager’s realised dedicated time was needed for CoP members to lead falls prevention change and were able to prioritise support for CoP participation. For example, supported CoP members implemented additional multifactorial falls prevention strategies such as tailored resident falls prevention plans, footwear screening and facility committee meetings. Conversely at facilities where CoP members were not supported to participate in CoP meetings and discussions there was limited implementation of evidence based practices. Limited dedicated time for staff to be involved was a common barrier reported in other health implementation studies [27, 45, 46].

Organisation level

Acknowledgment, engagement and cultural change (CCMO 7)

The CoP, were able to identify a gap in the falls management policy and procedures. The CoP engaged management using information on the pros and cons of taking preventative action to gain their support in a cultural change to approaching falls. Taking a more proactive cultural approach to falls may lead to better outcomes for residents as RAC culture has been linked to quality outcomes for residents [27, 47]. Providing information on the pros and cons of performing a behaviour has been used to facilitate health behaviour change [24]. The further engagement of CoP members, who were clinical staff delivering resident care, in writing the new falls policy and procedures brought authenticity and relevancy. This tailoring of knowledge by the users has been identified as a step in successful evidence translation [18, 21].

Opportunity and engagement (CCMO 8)

At an organisational level failure to consistently support opportunity, in terms of dedicated time commitment, for CoP members to learn and engage in falls prevention activity was perceived to limit implementation of falls prevention activities. Whilst CoP members were cognisant of the fact that the organisation had to manage a range of complex issues, they felt this still reflected a lack of realised importance of the need to learn and action falls prevention in the workplace and achieve even better outcomes. Limited time and resources was identified in other studies as a barrier to work place learning and implementing new practices [27, 48].

Feedback loop and focus (CCMO 9)

Regular CoP reporting on their falls prevention actions and outcomes, created a strong feedback loop from frontline care staff to organisational management. Recognition of higher levels of feedback for systems, teams or individuals is a factor linked with successful implementation [21, 49] and use of evidence in practice [16]. CoP reporting to the organisation’s Board Committees assisted in focussing attention and subsequent support for falls prevention activity. Organisational support has been reported as a CoP enabling mechanism by Ranmuthugala et al. [26] whilst shifting organisational priorities has been identified as a barrier to implementation by others [27, 50].

Limitations

Evaluation and explanation of the impact of operating a falls prevention CoP on falls rates and injurious falls rates was beyond the scope of this study and these findings are reported elsewhere [51]. In this study we have postulated possible mechanisms that triggered the observed outcomes under certain contextual conditions. Whilst findings from evaluating a single RAC organisation are not generalizable they provide valuable learnings for similar RAC organisations looking to translate falls evidence into practice. The size of the CoP may appear small (n = 20) but we feel it reflects the authentic number of staff a RAC organisation of this size may assign to participate in a given project. Whilst elements of this study relied on self-report, we have supported validity and credibility of the findings by incorporating quantitative data where possible, triangulating findings using multiple data sources and maintaining an audit trail. Ideally interviews of care staff, facility managers and representatives of the organisation’s Board Committees would have provided further depth to our insights however the pragmatics of such an undertaking were beyond the scope of this study. The intranet software was unable to track members accessing the CoP web site unless they posted comments on the electronic discussion board but future upgrades to the software should have the capacity to track access across all areas.

Conclusions

An interdisciplinary falls prevention CoP provided connections and knowledge gains amongst its members and was able to facilitate translation of falls prevention evidence into practice in the context of a RAC facility and RAC organisation. Translation worked best at facilities with an active CoP member connected to evidence with management support in a proactive falls prevention culture. Support by RAC management to provide the necessary investment in staff time to better enable change in falls prevention practice is essential for success. Future research should continue to test these conjectured mechanisms of action noting the contextual conditions that produce the desired or undesired outcomes. This may better inform how CoPs impact their membership and the translation of evidence into practice.

Abbreviations

CMO:

Context-Mechanism-Outcome

CoP:

Community of Practice

P:

Participating CoP member

RAC:

Residential Aged Care

References

  1. Haralambous B, Haines TP, Hill K, Moore K, Nitz J, Robinson A. A protocol for an individualised, facilitated and sustainable approach to implementing current evidence in preventing falls in residential aged care facilities. BMC Geriatr. 2010;10(1):8.

    Article  PubMed  PubMed Central  Google Scholar 

  2. Nyman SR, Victor CR. Older people’s recruitment, sustained participation, and adherence to falls prevention interventions in institutional settings: a supplement to the Cochrane systematic review. Age Ageing. 2011;40(4):430–6.

    Article  PubMed  Google Scholar 

  3. Burland E, Martens P, Brownell M, Doupe M, Fuchs D. The evaluation of a fall management program in a nursing home population. Gerontologist. 2013;53(5):828–38.

    Article  PubMed  Google Scholar 

  4. Oliver D, Connelly JB, Victor CR, Shaw FE, Whitehead A, Genc Y, et al. Strategies to prevent falls and fractures in hospitals and care homes and effect of cognitive impairment: systematic review and meta-analyses. BMJ. 2007;334(7584):82.

    Article  PubMed  Google Scholar 

  5. Rapp K, Becker C, Cameron ID, König H-H, Büchele G. Epidemiology of falls in residential aged care: analysis of more than 70,000 falls from residents of Bavarian nursing homes. J Am Med Dir Assoc. 2012;13(2):187.

    Article  PubMed  Google Scholar 

  6. Morley JE. Falls and fractures. J Am Med Dir Assoc. 2007;8(5):276–8.

    Article  PubMed  Google Scholar 

  7. Vlaeyen E, Coussement J, Leysens G, Van der Elst E, Delbaere K, Cambier D, et al. Characteristics and effectiveness of fall prevention programs in nursing homes: a systematic review and meta-analysis of randomized controlled trials. J Am Geriatr Soc. 2015;63(2):211–21.

    Article  PubMed  Google Scholar 

  8. Watson W, Clapperton A, Mitchell R. The burden of fall-related injury among older persons in new South Wales. Aust N Z J Public Health. 2011;35(2):170–5.

    Article  PubMed  Google Scholar 

  9. Haines TP, Nitz J, Grieve J, Barker A, Moore K, Hill K, et al. Cost per fall: a potentially misleading indicator of burden of disease in health and residential care settings. J Eval Clin Pract. 2013;19(1):153–61.

    Article  PubMed  Google Scholar 

  10. Becker C, Rapp K. Fall prevention in nursing homes. Clin Geriatr Med. 2010;26(4):693–704.

    Article  PubMed  Google Scholar 

  11. Onder G, Carpenter I, Finne-Soveri H, Gindin J, Frijters D, Henrard JC, et al. Assessment of nursing home residents in Europe: the services and health for elderly in long TERm care (SHELTER) study. BMC Health Serv Res. 2012;12:5.

    Article  PubMed  PubMed Central  Google Scholar 

  12. King D, Mavromaras K, He B, Healy J, Macaitis K, Moskos M, et al. The aged care workforce 2012 final report. Canberra: Department of Health and Ageing; 2013.

    Google Scholar 

  13. Cameron ID, Murray GR, Gillespie LD, Robertson MC, Hill KD, Cumming RG, et al. Interventions for preventing falls in older people in nursing care facilities and hospitals. Cochrane Database Sys Rev. 2012;1(3):1–19.

    Google Scholar 

  14. Australian Commission on Safety and Quality in Healthcare. Implementation guide for preventing falls and harm from falls in older people: Best practice guidelines for Australian Hospitals and Residential Aged Care Facilities. Canberra: Australian Commonwealth Government; 2009.

  15. National Institute for Health and Care Excellence (NICE). Falls: assessment and prevention of falls in older People. NICE Clinical Guideline; 2013. guidance.nice.org.uk/cg161.

  16. Glasziou P, Ogrinc G, Goodman S. Can evidence-based medicine and clinical quality improvement learn from each other? BMJ Qual Saf. 2011;20(1):i13–i7.

    Article  PubMed  PubMed Central  Google Scholar 

  17. Haines TP, Waldron NG. Translation of falls prevention knowledge into action in hospitals: what should be translated and how should it be done? J Saf Res. 2011;42(6):431–42.

    Article  Google Scholar 

  18. Tetroe JM, Graham ID, Scott V. What does it mean to transform knowledge into action in falls prevention research? Perspectives from the Canadian Institutes of Health Research. J Saf Res. 2011;42(6):423–6.

    Article  Google Scholar 

  19. Wenger E. Communities of practice: learning as a social system. Syst Thinker. 1998;9(5):2–3.

    Google Scholar 

  20. Tolson D, Lowndes A, Booth J, Schofield I, Wales A. The potential of communities of practice to promote evidence-informed practice within nursing homes. J Am Med Dir Assoc. 2011;12(3):169–73.

    Article  PubMed  Google Scholar 

  21. Bertone MP, Meessen B, Clarysse G, Hercot D, Kelley A, Kafando Y, et al. Assessing communities of practice in health policy: a conceptual framework as a first step towards empirical research. Health Res Policy Syst. 2013;11(1):39.

    Article  PubMed  PubMed Central  Google Scholar 

  22. Li LC, Grimshaw JM, Nielsen C, Judd M, Coyte PC, Graham ID. Use of communities of practice in business and health care sectors: a systematic review. Implement Sci. 2009;4:27.

    Article  PubMed  PubMed Central  Google Scholar 

  23. Ranmuthugala G, Plumb JJ, Cunningham FC, Georgiou A, Westbrook JI, Braithwaite J. How and why are communities of practice established in the healthcare sector? A systematic review of the literature. BMC Health Serv Res. 2011;11:273.

    Article  PubMed  PubMed Central  Google Scholar 

  24. Michie S, van Stralen MM, West R. The behaviour change wheel: a new method for characterising and designing behaviour change interventions. Implement Sci. 2011;6(1):42.

    Article  PubMed  PubMed Central  Google Scholar 

  25. Colquhoun H, Leeman J, Michie S, Lokker C, Bragge P, Hempel S, et al. Towards a common terminology: a simplified framework of interventions to promote and integrate evidence into health practices, systems, and policies. Implement Sci. 2014;9(1):51.

    PubMed  PubMed Central  Google Scholar 

  26. Ranmuthugala G, Cunningham FC, Plumb JJ, Long J, Georgiou A, Westbrook JI, et al. A realist evaluation of the role of communities of practice in changing healthcare practice. Implement Sci. 2011;6(1):49–54.

    Article  PubMed  PubMed Central  Google Scholar 

  27. Tolson D, Booth J, Lowndes A. Achieving evidence-based nursing practice: impact of the Caledonian development model. J Nurs Manag. 2008;16(6):682–91.

    Article  PubMed  Google Scholar 

  28. Hewitt G, Sims S, Harris R. The realist approach to evaluation research: an introduction. Int J Ther Rehabil. 2012;19(5):251.

    Article  Google Scholar 

  29. Williams L, Burton C, Rycroft-Malone J. What works: a realist evaluation case study of intermediaries in infection control practice. J Adv Nurs. 2013;69(4):915–26.

    Article  PubMed  Google Scholar 

  30. Creswell JW, Plano Clark VL. Designing and conducting mixed methods research. Los Angeles: Sage; 2007.

    Google Scholar 

  31. Pawson R, Tilley N. Realistic evaluation. London: Sage; 1997.

    Google Scholar 

  32. Francis-Coad J, Etherton-Beer C, Bulsara C, Nobre D, Hill AM. Investigating the impact of a falls prevention community of practice in a residential aged-care setting: a mixed methods study protocol. J Adv Nurs. 2015;71(12):2977–86.

    Article  PubMed  Google Scholar 

  33. Thomas E, Magilvy JK. Qualitative rigor or research validity in qualitative research. J Spec Pediatr Nurs. 2011;16(2):151–5.

    Article  PubMed  Google Scholar 

  34. Francis-Coad J, Etherton-Beer C, Bulsara C, Nobre D, Hill A-M. Using a community of practice to evaluate falls prevention activity in a residential aged care organisation: a clinical audit. Aust Health Rev. 2016;41(1):13–8.

    Article  Google Scholar 

  35. Liamputtong P. Research methods in health: foundations for evidence-based practice. 2nd ed. Australia: Oxford University Press; 2013.

    Google Scholar 

  36. Yousefi-Nooraie R, Dobbins M, Marin A. Social and organizational factors affecting implementation of evidence-informed practice in a public health Department in Ontario: a network modelling approach. Implement Sci. 2014;9(29):166.

    Google Scholar 

  37. Polit DF, Beck CT. Essentials of nursing research: appraising evidence for nursing practice. Philadelphia: Lippincott Williams & Wilkins; 2013.

    Google Scholar 

  38. Elo S, Kyngäs H. The qualitative content analysis process. J Adv Nurs. 2008;62(1):107–15.

    Article  PubMed  Google Scholar 

  39. Lamb SE, Jørstad-Stein EC, Hauer K, Becker C. Development of a common outcome data set for fall injury prevention trials: the prevention of falls network Europe consensus. J Am Geriatr Soc. 2005;53(9):1618–22.

    Article  PubMed  Google Scholar 

  40. Goodwin V, Jones-Hughes T, Thompson-Coon J, Boddy K, Stein K. Implementing the evidence for preventing falls among community-dwelling older people: a systematic review. J Saf Res. 2011;42(6):443–51.

    Article  Google Scholar 

  41. Vestjens L, Kempen GI, Crutzen R, Kok G, Zijlstra GR. Promising behavior change techniques in a multicomponent intervention to reduce concerns about falls in old age: a Delphi study. Health Educ Res. 2015;30(2):309–22.

    Article  PubMed  Google Scholar 

  42. Yousefi-Nooraie R, Dobbins M, Marin A, Hanneman R, Lohfeld L. The evolution of social networks through the implementation of evidence-informed decision-making interventions: a longitudinal analysis of three public health units in Canada. Implement Sci. 2015;10(1):166.

    Article  PubMed  PubMed Central  Google Scholar 

  43. Ikioda F, Kendall S, Brooks F, De Liddo A, Shum SB. Factors that influence healthcare professionals’ online interaction in a virtual community of practice. Soc Netw. 2013;2:174–84.

    Article  Google Scholar 

  44. Nazir A, Unroe K, Tegeler M, Khan B, Azar J, Boustani M. Systematic review of interdisciplinary interventions in nursing homes. J Am Med Dir Assoc. 2013;14(7):471–8.

    Article  PubMed  Google Scholar 

  45. Steinmo SH, Michie S, Fuller C, Stanley S, Stapleton C, Stone SP. Bridging the gap between pragmatic intervention design and theory: using behavioural science tools to modify an existing quality improvement programme to implement “sepsis six”. Implement Sci. 2016;11(1):1.

    Google Scholar 

  46. der Zijpp TJ, Niessen T, Eldh AC, Hawkes C, McMullan C, Mockford C, et al. A bridge over turbulent waters: illustrating the interaction between managerial leaders and facilitators when implementing research evidence. Worldviews Evid-Based Nurs. 2016. https://doi.org/10.1111/wvn.12138.

  47. Etherton-Beer C, Venturato L, Horner B. Organisational culture in residential aged care facilities: a cross-sectional observational study. PLoS One. 2013;8(3):e58002.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  48. O’Connell B, Ostaszkiewicz J, Sukkar K, Plymat K. The tri-focal model of care: advancing the teaching-nursing home concept. Int J Nurs Pract. 2008;14(6):411–7.

    Article  PubMed  Google Scholar 

  49. Ivers N, Jamtvedt G, Flottorp S, Young JM, Odgaard-Jensen J, French SD, et al. Audit and feedback: effects on professional practice and healthcare outcomes (review). Cochrane Database Sys Rev. 2012;(6):2-4.

  50. Sorensen AV, Harrison MI, Kane HL, Roussel AE, Halpern MT, Bernard SL. From research to practice: factors affecting implementation of prospective targeted injury-detection systems. BMJ Qual Saf. 2011;20(6):527–33.

    Article  CAS  PubMed  Google Scholar 

  51. Francis-Coad J, Haines T, Etherton-Beer C, Nobre D, Hill AM. Evaluating the impact of operating a falls prevention community of practice on falls in a residential aged care setting. J Clin Gerontol Geriatr. In press.

Download references

Acknowledgements

The authors thank the Brightwater Care Group for their support, especially the staff and members of the falls prevention Community of Practice.

Funding

This study has confirmed funding support from Collaborative Research Network (CRN) funding (Federal Government of Australia) as part of a project led by Associate Professor Anne-Marie Hill that was independently peer reviewed by the funder.

Availability of data and materials

All data are presented in the main manuscript and Additional files 1, 2 and 3.

Author information

Authors and Affiliations

Authors

Contributions

JFC, AMH and CEB conceptualised and contributed to all aspects of the research project. AMH is the chief investigator of the funding awarded for this research activity. JFC wrote the first draft, CB contributed to qualitative methods, PC to statistical support and NB to data collection. All authors contributed to manuscript appraisal, revision and editing and have read and approved the final manuscript.

Corresponding author

Correspondence to Jacqueline Francis-Coad.

Ethics declarations

Ethics approval and consent to participate

Ethical approvals for the study were obtained from the University of Notre Dame Australia Human Research Ethics Committee (reference number 013145F) and the board of the RAC organisation. All CoP members, staff and residents provided written consent to participate.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Additional files

Additional file 1:

CoP member confidence, motivation and opportunity to engage in intranet usage and lead falls prevention activity. (DOCX 15 kb)

Additional file 2:

Matrix of knowledge flow through CoP and member connections through discussion board participation. (DOCX 21 kb)

Additional file 3:

Proportion of residents supplemented with vitamin D measured in July 2014 and re-measured November 2015. (JPEG 48 kb)

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Francis-Coad, J., Etherton-Beer, C., Bulsara, C. et al. Evaluating the impact of a falls prevention community of practice in a residential aged care setting: a realist approach. BMC Health Serv Res 18, 21 (2018). https://doi.org/10.1186/s12913-017-2790-2

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12913-017-2790-2

Keywords