- Research
- Open access
- Published:
Strategies to implement evidence-informed decision making at the organizational level: a rapid systematic review
BMC Health Services Research volume 24, Article number: 405 (2024)
Abstract
Background
Achievement of evidence-informed decision making (EIDM) requires the integration of evidence into all practice decisions by identifying and synthesizing evidence, then developing and executing plans to implement and evaluate changes to practice. This rapid systematic review synthesizes evidence for strategies for the implementation of EIDM across organizations, mapping facilitators and barriers to the COM-B (capability, opportunity, motivation, behaviour) model for behaviour change. The review was conducted to support leadership at organizations delivering public health services (health promotion, communicable disease prevention) to drive change toward evidence-informed public health.
Methods
A systematic search was conducted in multiple databases and by reviewing publications of key authors. Articles that describe interventions to drive EIDM within teams, departments, or organizations were eligible for inclusion. For each included article, quality was assessed, and details of the intervention, setting, outcomes, facilitators and barriers were extracted. A convergent integrated approach was undertaken to analyze both quantitative and qualitative findings.
Results
Thirty-seven articles are included. Studies were conducted in primary care, public health, social services, and occupational health settings. Strategies to implement EIDM included the establishment of Knowledge Broker-type roles, building the EIDM capacity of staff, and research or academic partnerships. Facilitators and barriers align with the COM-B model for behaviour change. Facilitators for capability include the development of staff knowledge and skill, establishing specialized roles, and knowledge sharing across the organization, though staff turnover and subsequent knowledge loss was a barrier to capability. For opportunity, facilitators include the development of processes or mechanisms to support new practices, forums for learning and skill development, and protected time, and barriers include competing priorities. Facilitators identified for motivation include supportive organizational culture, expectations for new practices to occur, recognition and positive reinforcement, and strong leadership support. Barriers include negative attitudes toward new practices, and lack of understanding and support from management.
Conclusion
This review provides a comprehensive analysis of facilitators and barriers for the implementation of EIDM in organizations for public health, mapped to the COM-B model for behaviour change. The existing literature for strategies to support EIDM in public health illustrates several facilitators and barriers linked to realizing EIDM. Knowledge of these factors will help senior leadership develop and implement EIDM strategies tailored to their organization, leading to increased likelihood of implementation success.
Review registration
PROSPERO CRD42022318994.
Background
There exist expectations that decisions and programs that affect public and population health are informed by the best available evidence from research, local context, and political will [1,2,3]. To achieve evidence-informed public health, it is important that public health organizations engage in and support evidence-informed decision making (EIDM). For this review, “public health organizations” refers to organizations that implement public health programs, including health promotion, injury and disease prevention, population health monitoring, emergency preparedness and response, and other critical functions [4]. EIDM, at an organizational level, involves the integration of evidence into all practice decisions by identifying and synthesizing evidence, then developing and executing plans to implement and evaluate changes to practice [2, 5, 6]. EIDM considers research evidence along with other factors such as context, resources, experience, and patient/community input to influence decision making and program implementation [2, 3, 7, 8]. When implemented, EIDM results in efficient use of scarce resources, encourages stakeholder involvement resulting in more effective programs and decisions, improves transparency and accountability of organizations, improves health outcomes, and reduces harm [3, 7, 8]. Therefore, it is important that EIDM is integrated into organizations serving public health.
Driving organizational change for EIDM is challenging due to the need for multifaceted interventions [9].While there are systematic reviews of the implementation of specific evidence-informed initiatives, reviews of implementation of organization-wide EIDM are lacking. For example, Mathieson et al. and Li et al. examined the barriers and facilitators to the implementation of evidence-informed interventions in community nursing and Paci et al. examined barriers in physiotherapy [10,11,12]. Li et al. found that implementation of evidence-informed practices is associated with an organizational culture for EIDM where staff at all levels value and contribute to EIDM [12]. Similarly, Mathieson et al. and Paci et al. found that organizational context plays an important role in evidence-informed practice implementation along with organizational support and resources [10, 11]. While these reviews identify organizational context, culture and support as crucial for the implementation of a particular evidence-informed practice, they do not identify and describe sufficiently what and how an organization evolves to consistently be evidence-informed for all decisions and programs and services it delivers.
Primary studies have explored how building capacity for staff to find, interpret and synthesize evidence to develop practice and program recommendations may contribute to EIDM [13,14,15,16]. In 2019, Saunders et al. completed an overview of systematic reviews on primary health care professionals’ EIDM competencies and found that implementation of EIDM across studies was low [9]. Participants reported insufficient knowledge and skills to implement EIDM in daily practice despite positive EIDM beliefs and attitudes [9]. In 2014, Sadeghi-Bazargani et al. and in 2018, Barzkar et al. also explored the implementation of EIDM and found similar results, listing inadequate skills and lack of knowledge amongst the most common barriers to EIDM [17, 18].
An underlying current in research for organizational EIDM is a focus on organizational change [13, 14, 19, 20]. To achieve EIDM across an organization, significant organizational change is usually necessary, resulting in substantial impact on the entire organization, as well as for individuals working there. However, while there are reviews of individual capacity for EIDM, there is minimal synthesized evidence describing EIDM capacity at the organizational level. This review seeks to address this research gap by identifying, appraising, and synthesizing research evidence from studies seeking to understand the process of embedding EIDM across an organization, with a focus on public health organizations.
The COM-B model for behaviour change was used as a guide for contextualizing the findings across studies. By integrating causal components of behaviour change, the COM-B model supports the development of interventions that can sustain behaviour change in the long-term. While there are numerous models available to support implementation and organizational change, the COM-B model was chosen, in part, for its simple visual representation of concepts, as well as its contributions to the sustainability of behaviours [21]. This model is designed to guide organizational change initiatives and distill complex systems that influence behaviour into simpler, visual representations. Specifically, this model looks at capability (C), opportunity (O) and motivation (M) as three key influencers of behaviour (B). The capability section of the COM-B model reflects whether the intended audience possess the knowledge and skills for a new behaviour. Opportunity reflects whether there is opportunity for new behaviour to occur, while motivation reflects whether there is sufficient motivation for a new behaviour to occur. All three components interact to create behaviour and behaviours can, in turn, alter capability, motivation and opportunity [21]. Selection of the COM-B model was also driven by authors’ extensive experience supporting public health organizations in implementing EIDM, which observed enablers for EIDM that align well with the COM-B model, such as team-wide capacity-building for EIDM, integration of EIDM into processes, and support from senior leadership [20, 22, 23]. The COM-B model has been used to map findings from systematic reviews examining the barriers and facilitators of various health interventions including nicotine replacement, chlamydia testing and lifestyle management of polycystic ovary syndrome [24,25,26]. This review has a broader focus and maps barriers and facilitators for organization-wide EIDM to the COM-B model.
Overall, EIDM is expected to be a foundation at public health organizations to achieve optimal health of populations. However, the capacity of public health organizations to realize EIDM varies considerably from organization to organization [14, 22, 27,28,29]. This rapid review aims to examine the implementation of EIDM at the organizational level to inform change efforts at Canadian public health organizations. The findings of this review can be applied more broadly and will support public health organizations beyond Canada to implement change efforts to practice in an evidence-informed way.
Methods
Study design
The review protocol was registered with the International Prospective Register of Systematic Reviews (PROSPERO; Registration CRD42022318994). The review was conducted and reported following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) statement for reporting systematic reviews and meta-analyses [30]. A rapid review approach was used, since the review was requested to be completed by the National Collaborating Centre for Methods and Tools’ Rapid Evidence Service within a specific timeline, in order to inform an organizational change initiative at a provincial public health organization in Canada [31]. Given the nature of the research question, a mixed methods rapid systematic review approach was taken, with guidance from the Joanna Briggs Institute (JBI) Manual for Evidence Synthesis [32].
Information sources and search strategy
The search was conducted on March 18, 2022. The following databases were searched from 2012 onward: Medline, Embase, Emcare, Global Health Database, PsycINFO, Web of Science. Each database was searched using combinations and variations of the terms “implement*”, “knowledge broker*”, “transform*”, “organizational culture”, “change management”, “evidence-based”, “knowledge translation”, and “knowledge mobilization”. Additionally, publications by key contributors to the field were reviewed. The full search strategy is included in Appendix 1.
Studies were screened using DistillerSR software. Titles and abstracts of retrieved studies were screened by a single reviewer. Full texts of included studies were screened by a second reviewer and reviewed by a third. Screening was not completed in duplicate, consistent with a rapid review protocol [31]. To minimize the risk of bias, a subset of 100 retrieved articles were screened in duplicate at the title and abstract stage to ensure consistency across reviewers. Of this subset, there were four articles with conflicting decisions, which were discussed amongst screeners to clarify inclusion criteria.
Eligibility criteria
English-language, published primary studies with experimental or observational designs were eligible for inclusion. Review papers, such as literature and systematic reviews, were excluded to ensure that details regarding implementation of initiatives were captured without re-interpretation or generalization by review authors. Grey literature was not included. Eligibility criteria are outlined below in terms of a PICO (Population, Intervention, Comparison, Outcome) structure [33].
Population
Studies conducted with public sector health-related service-delivery organizations were eligible for inclusion. This included public health departments and authorities, health care settings and social services. Studies focused on departments or teams within an organization, or on entire organizations, were also eligible for inclusion. Studies conducted in private sectors or academic institutions were excluded to narrow the focus of the review.
Intervention
Interventions designed and implemented to shift teams, departments, or organizations to EIDM in all decisions were eligible for inclusion. These can include initiatives where organizations establish roles or teams to drive organizational change for EIDM, or efforts to build and apply the knowledge and skill of staff for EIDM. These are distinct from implementation strategies for evidence-informed interventions. Eligible interventions were applied to a team, department, or organization to drive change toward evidence use in decision making at all levels of the organizations.
Comparator
Studies that included any comparator or no comparator were included, recognizing that literature was likely to include case reports.
Outcomes
Outcomes measured either quantitatively or qualitatively were considered. These included behaviour change, confidence and skills, patient-level data such as quality indicators, evidence of EIDM embedded in organizational and decision-making processes, changes in organizational culture, and changes to budget allocation. Studies that reported primarily on implementation fidelity were excluded, since studies of implementation fidelity focus on whether an intervention is delivered as intended, rather than drivers for organizational change.
Setting
Studies conducted in the 38 member countries of the Organization for Economic Co-operation and Development (OECD) were included in this review to best align with the Canadian context and to inform organizational change efforts in public health within Canada [34].
Quality assessment
The methodological rigour of included studies was evaluated using the JBI suite of critical appraisal tools [35]. Ratings of low, moderate, or high quality were assigned based on the critical appraisal results. Quality assessment was completed by one reviewer and verified by a second. Conflicts were resolved through discussion or by consulting a third reviewer.
Data extraction
Data extraction was completed by a single reviewer and reviewed by a second. Data on the study design, setting, sector (e.g., public health, primary care, etc.), participants, intervention (e.g., description of learning initiatives, implementation strategies, etc.), outcome measures, and findings were extracted. To minimize the risk of bias, a subset of three included articles underwent data extraction in duplicate to ensure consistency across reviewers. There was good agreement between duplicate extraction, with variations in the format of extracted data but consistency in content.
Data analysis
Quantitative and qualitative data were synthesized simultaneously, using a convergent integrated approach [32]. Quantitative data underwent narrative synthesis, where findings that caused benefit were compared with those that caused harm or no effect [36]. Vote counting based on the direction of effect was used to determine whether most studies found a positive or negative effect [36]. For qualitative findings, studies were grouped according to common strategies. Within these common strategies, findings were reviewed for trends in reported facilitators and barriers. These trends were deductively mapped to the COM-B model for behaviour change [37].
Due to the heterogeneity in study outcomes, the Grading of Recommendations, Assessment, Development and Evaluations (GRADE) [38] approach was not used for this review. Overall certainty of evidence was determined based on the risk of bias of included study designs and study quality.
Results
Database searching retrieved 7067 records. After removing duplicates, 4174 records were screened by title and abstract, resulting in 1370 reports for full text review. Of those 1370 records, 35 articles were included. Scanning the publication lists of key authors retrieved 187 records, of which eight were retrieved for full text review and two were included, for a total of 37 articles included in this review. See Fig. 1 for a PRISMA flow chart illustrating the article search and selection process.
Study characteristics
The overall characteristics of included studies are summarized in Table 1. Of 37 included studies, most were conducted in primary care settings (n = 16) and public health settings (n = 16), with some in social services (n = 3), child and youth mental health (n = 1), and occupational health (n = 1). Most studies were conducted in the USA (n = 17), followed by Canada (n = 12), Australia (n = 5), and Europe (n = 3).
Study designs included case reports (n = 18), single group pre-/post-test studies (n = 10), qualitative studies (n = 7), and randomized controlled trials (RCTs) (n = 2). Both RCTs evaluated the implementation of organizational EIDM.
Studies reported quantitative (n = 11), qualitative (n = 20), or both quantitative and qualitative results (n = 6). For the studies that reported quantitative results, measures included EIDM implementation, EIDM-related beliefs and behaviours, organizational priorities for EIDM, and patient care quality indicators. Quantitative measures were heterogenous and did not allow meta-analysis. Qualitative findings were generated through formal qualitative analysis (n = 19) or descriptive case reports (n = 7). Most qualitative results included facilitators and barriers to implementation (n = 16).
Study quality
The critical appraisal checklist used to assess each study is indicated in Table 1. Single group, pre-/post-test studies were evaluated according to the JBI Checklist for Quasi-experimental Studies [35].
A lack of control groups contributed to the risk of bias. Most included studies were rated Moderate or High quality according to their respective quality assessment tools. Full quality assessments for each article are included in Appendix 2. Therefore, the overall methodological quality for this body of literature was rated as Moderate.
Strategies for implementing organization-wide EIDM
Due to the heterogeneity of study designs, interventions, and outcomes, it was not possible to determine which EIDM implementation strategies are more effective compared to others. Implementation strategies included the establishment of Knowledge Broker-type roles, building the EIDM capacity of staff, and research or academic partnerships. These strategies are listed in Table 2.
Evaluation of strategies implemented by studies in this review was often qualitative and described facilitators and barriers, rather than quantitatively measuring effectiveness. However, it is possible to explore EIDM implementation strategies and factors that appear to contribute to or inhibit success. The most common strategy implemented in included studies was the establishment of Knowledge Broker-type roles [20, 41, 44, 47, 48, 51, 52, 54,55,56,57, 59, 60, 62,63,64,65,66,67, 69, 71, 72]. Studies described roles differently (e.g., “Evidence-based Practice Facilitator”, “Evidence Facilitator”, “EIDM Mentor”). These roles all served to support EIDM across organizations through knowledge sharing, evidence synthesis, implementation, and other EIDM-related activities. In some studies, new staff were hired to Knowledge Broker roles, or developed among existing staff, while in others, Knowledge Brokers were contracted from external organizations. Knowledge Broker strategies were mostly implemented in parallel with other EIDM implementation strategies, such as capacity building for staff, integrating EIDM into decision-making processes and development of leadership to support EIDM. When these strategies were evaluated quantitatively for organizational capacity, culture and implementation of EIDM, most studies found positive results, such as increased scores for organizational climates supporting EIDM, improved attitudes toward EIDM, or the integration of EIDM into processes [44, 52, 54, 62, 66, 67, 71, 72], although some studies found no change [55, 60] following implementation of Knowledge Broker roles. Qualitatively, most studies described facilitators and barriers to EIDM, either through formal qualitative analysis or case report [14, 20, 39,40,41,42,43, 45, 47, 48, 52, 55, 57, 59,60,61, 64, 65, 68]. Facilitators included organizational culture with supportive leadership and staff buy-in, expectations to use evidence to inform decisions, accessible knowledge, and integration of EIDM into processes and templates. Barriers included limited time and competing priorities, staff turnover, and lack of understanding and support from management.
Ten included studies focused primarily on building EIDM capacity of existing staff at the organization, often at multiple levels (e.g., front-line service providers, managers, and leadership) [13, 14, 39, 40, 42, 43, 46, 49, 50, 58, 61]. Capacity building was typically done through EIDM-focused workshops, often with ongoing follow up support from workshop facilitators. While studies often measured changes in individual knowledge and skill for EIDM for workshop participants, organizational change for EIDM was reported qualitatively, either through formal qualitative analysis or through a case report. Facilitators for EIDM in these ten studies included organizational culture with supportive leadership and staff buy-in, dedicated staff roles to support EIDM, opportunities to meet and discuss EIDM (e.g., communities of practice, journal clubs), knowledge sharing across the organization, expectations to use evidence to inform decisions, accessible knowledge, and integration of EIDM into processes and templates. Barriers included limited time and competing priorities, staff turnover, and negative attitudes toward EIDM.
Research or academic partnerships and networks were the main strategy described in three case reports [45, 53, 68]. These involved establishing collaborations, either through universities or non-governmental health organizations, that provided direct EIDM support. These strategies were not evaluated quantitatively but described facilitators and barriers to effective cross-sector collaborations. Facilitators for EIDM included supportive leadership and management, dedicated staff roles to support EIDM, EIDM knowledge and skill development for staff, and regular communication between partners. Barriers included limited time and competing priorities, preference for experiential over research evidence, and negative attitudes toward EIDM.
Overall, studies described successes in implementing EIDM across organizations, citing several common key facilitators and barriers. To instigate behaviour change, strategies must address capability for change, which may be achieved by building staff capacity, establishing dedicated support roles, improving access to evidence, and sharing knowledge across the organization. Strategies must also enable opportunities for change, which may be supported through forums for EIDM learning and practice, protecting time for EIDM, integrating EIDM into new or existing roles, and adding EIDM to processes and templates. Behaviour change also requires motivation, which may be built through a supportive organizational culture, expectations to use EIDM, recognition and positive reinforcement, and strong support from leadership.
Key considerations for implementing EIDM
Many of the facilitators and barriers to EIDM are common across strategies explored by the studies included in this review. To conceptualize these factors, they were mapped to the COM-B model for behaviour change [21] in Fig. 2.
Within the capability component of the COM-B model, staff knowledge and skill development were included as a facilitator. Studies included in this review demonstrated that knowledge and skill for EIDM supported the use of evidence in decision making [13, 14, 39, 40, 42, 43, 46, 49, 50, 58, 61]. The establishment of specialized or dedicated roles for EIDM, such as Knowledge Broker roles, was included in the capability component of the COM-B model, since Knowledge Broker roles support the capacity of organizations and their staff to use evidence-informed approaches [20, 41, 44, 47, 48, 51, 52, 54,55,56,57, 59, 60, 62,63,64,65,66,67, 69, 71, 72]. Finally, knowledge sharing across organizations was described as a facilitator for EIDM by several of the studies that built staff capacity for EIDM or established Knowledge Broker roles [13, 48, 49, 51, 52, 54, 56, 59, 61, 65]. Barriers to the capability for EIDM behaviours include staff turnover and subsequent knowledge loss [14, 20, 56]. Staff turnover is especially challenging for interventions that involve staff in dedicated Knowledge Broker roles and interventions that build the knowledge and skill for staff to engage in evidence use [14, 20, 56]. In some cases, individuals who are trained in the Knowledge Broker role are then promoted to new roles or management and have fewer opportunities to apply their Knowledge Broker skills [20].
The opportunity portion of the COM-B model reflects whether there is opportunity for new behaviour to occur. The development of processes and mechanisms that support new practices can act as a reminder for staff, and may include re-design of planning or decision-making templates to capture supporting evidence, or adding EIDM-related items to agendas for regular meetings [41, 47, 53, 60]. Forums for learning and skill development provide staff with opportunities to gain knowledge and practice newly acquired skills in group settings, such as communities of practice or journal clubs [48, 56, 61, 65]. Finally, protected time to apply EIDM was found to be a facilitator for opportunity in the COM-B model [20, 47, 57, 59, 65], while competing priorities were found to be a barrier [20, 39, 40, 52, 55, 57, 60, 64, 65].
The final influencer in the COM-B model, motivation, reflects whether there is sufficient motivation for a new behaviour to occur. Facilitators include supportive organizational culture [14, 20, 43, 47, 57, 59], expectations for new practices to occur [20, 40], recognition and positive reinforcement [52, 59, 60, 65], and strong leadership support [14, 20, 39, 40, 43, 47, 56, 59, 65, 68]. Barriers to motivation included a lack of understanding or support from management [20], and negative attitudes toward change [20, 52, 59, 68].
Discussion
Strategies to implement EIDM across organizations include establishing specialized roles, providing staff education and training, developing processes or mechanisms to support new practices, and demonstrating leadership support. Facilitators and barriers for these strategies align with the COM-B model for behaviour change, which outlines capability, opportunity, and motivation as influencers of behaviour (Fig. 2). The COM-B model provides a comprehensive framework for the factors that influence behaviour change and has provided a valuable structure for examining barriers and facilitators to behaviour change in public health and related fields [73,74,75,76].
The capability section of the COM-B model reflects whether the intended audience possess the knowledge and skill for a new behaviour. Findings from this review establish facilitators for EIDM implementation capability, including the development of staff knowledge and skill, establishing specialized roles, and knowledge sharing across the organization. The development of staff knowledge and skill for EIDM are a necessary component to ensure EIDM in practice, however, literature has found that the organization-wide impact of conducting only individual-level knowledge and skill development is limited [77,78,79]. While knowledge and skill development are a necessary component to EIDM practice, they must be supported by other components to have an impact beyond the individual. Other strategies that support the use of newly gained knowledge and skills include the establishment of specialized roles for EIDM. Another strategy to support the use of EIDM is the establishment of dedicated staff roles, such as Knowledge Brokers. Knowledge Broker roles have been used across diverse contexts and show promise in supporting organization-wide EIDM implementation [20, 22, 23, 67, 80,81,82,83]. One facilitator for Knowledge Broker roles was knowledge sharing across the organization. Factors that influence the success of staff in Knowledge Broker roles align with those mapped to opportunity and motivation in the COM-B model, including the integration of EIDM into processes, knowledge sharing, and supportive organizational culture [20, 22, 47, 67, 84, 85]. Knowledge Brokers can also help facilitate knowledge sharing across the organization, which was another facilitator mapped to the capability level of the model [20, 47, 84, 85]. Knowledge sharing refers to the shared learning, knowledge products and resources for EIDM. At large public health organizations, it can be challenging to facilitate knowledge sharing between teams and departments [86, 87]. Integrating technology can help; there have been some advances driven by the COVID-19 pandemic, such as the development of knowledge sharing platforms [88,89,90,91]. Public health organizations seeking to implement EIDM should invest in their knowledge sharing infrastructure.
At the capability level of the COM-B model, staff turnover was a barrier to EIDM implementation. Organizations that implement these strategies should be cognizant of the potential for knowledge loss due to staff turnover when selecting staff for Knowledge Broker roles or capacity building opportunities.
Facilitators for organizational EIDM opportunity include the development of processes or mechanisms to support new practices, forums for learning and skill development, and protected time. The use of reminders for organizational behaviour change and implementation of clinical practice guidelines has been shown to be an effective strategy across many contexts [92,93,94,95]. Organizations seeking to implement EIDM should consider revising current templates and processes to support their initiatives. Another facilitator included forums for shared learning and skill development. Other literature shows that these forums can be effective in developing knowledge and skill and should foster an environment of learning without fear of reprisal [96, 97]. Finally, protected time for EIDM was a facilitator and competing priorities were a barrier. In public health practice, staff are often challenged with high workloads, so that EIDM may be viewed as an additional burden rather than a means to improve practice [98, 99]. For an EIDM approach to be practiced, staff must be provided with sufficient time to apply and practice skills. Organizations should consider involving middle management who oversee staff time allocations, rather than only senior leadership, to help ensure that staff are provided with the time they need and that expectations are adjusted accordingly [20, 23].
At the motivation level of the COM-B model, supportive organizational culture was mapped as a facilitator. The influence of organizational culture on evidence-informed practice at health organizations has been explored in a previous systematic review by Li et al. [100]. This systematic review of organizational contextual factors that influence evidence-based practice included 37 studies conducted in healthcare-related settings. Findings align with facilitators identified above, especially leadership support, which was found to impact evidence-based practice as well as all other factors that influence evidence-based practice [100]. The review also found that monitoring and feedback contributed to implementation of evidence-based practice, which aligns with recognition and positive reinforcement in the COM-B model above [100]. Notably, another factor that was mapped to the COM-B model was the expectation for new practices to occur, which was not explicitly identified as an influence on practice [100]. While Li et al. acknowledge that leadership that neglects to hold staff accountable are detrimental to implementation of EIDM, this accountability and clear expectations for change practice were a stronger finding in this current rapid systematic review.
The need for leadership support aligns with opportunity, since it is often management that determines the allocation of staff time for EIDM [20, 23]. Attitudes and the belief that EIDM is associated with positive outcomes is a key factor in overall competence for EIDM [101]. Efforts to address negative attitudes within staff, especially at the leadership level, may improve implementation of EIDM.
While this review provides a comprehensive overview of interventions to support EIDM in public health and related organizations, it does have some limitations. Given the heterogeneity of included studies, it was not possible to discern which implementation strategies for EIDM are more effective compared to others. Knowledge Broker roles, building capacity for EIDM, and research-academic partnerships were all shown to contribute to EIDM, but study findings do not support one strategy as superior to others. Given the highly contextual nature of these interventions, it is likely that the relative effectiveness of different interventions depends on the organization’s unique set of characteristics. Evaluation is also critical to determine if change efforts are successful or need to be adjusted. It is possible that a combination of strategies would maximize the likelihood that diverse needs of staff are met. Rigorous studies to evaluate this hypothesis are needed.
Most studies included in this review are non-randomized studies of interventions. Given the importance of context in organizational change, randomized controlled trial designs may not be well-suited to evaluate studies of EIDM implementation [102]. High-quality single-group studies, such as prospective cohort analytic studies evaluated with validated measures or qualitative descriptive analyses of case studies with thorough descriptions of interventions and context, may be more appropriate designs for designing future initiatives in this field. However, arguments have been made for the use of randomized trial designs in implementation research [103]. Foy et al. advocate for overcoming contextual barriers by using innovative trial designs, such as the multiphase optimization strategy approach, where a series of trials identify the most promising single or combined intervention components, or the sequential multiple assignment randomized trial approach, where early results inform tailoring of adaptive interventions [103]. These designs may be a promising approach to conducting trials within highly contextual settings. Another viewpoint is that perhaps it may not be essential to determine if one strategy is superior to another, but rather that strategies build a larger, multi-strategy approach to implementation [104]. There may be greater benefit to determining the conditions under which various strategies are effective [104].
A limitation in this review’s methodology is that the review was completed following a rapid review protocol to ensure timely completion. Modifications of a systematic review approach included the use of a single reviewer for screening and using an unblinded reviewer to check quality assessment and data extraction. This may have contributed to some bias within the review, due to the reviewers’ interpretations of studies. To minimize this bias, there were efforts to calibrate screening, quality assessment and data extraction using a subset of studies.
This review provides a synthesis of strategies for the organization-wide implementation of EIDM, and an in-depth analysis of their facilitators and barriers in public health organizations. Facilitators and barriers mapped to the COM-B model for behaviour change can be used by organizational leadership to drive organizational change toward EIDM.
Conclusion
This rapid systematic review explored the implementation of EIDM at the organizational level of public health and related organizations. Despite the similarity of these implementation challenges, studies used distinct strategies for implementation, including the establishment of dedicated roles to support EIDM, building staff capacities, research or academic partnerships, and integrating evidence into processes or mechanisms. Facilitators and barriers mapped to the COM-B model provide key guidance for driving organizational change to evidence-informed approaches for all decisions.
Availability of data and materials
All data generated or analysed during this study are included in this published article and its supplementary information files.
Abbreviations
- EIDM:
-
Evidence-informed Decision Making
- EBP:
-
Evidence-based Practice
- EIP:
-
Evidence-informed Practice
- GRADE:
-
Grading of Recommendations, Assessment, Development and Evaluations
- JBI:
-
Joanna Briggs Institute
- KT:
-
Knowledge Translation
- RCT:
-
Randomized Controlled Trial
References
Public Health Agency of Canada. Core Competencies for Public Health in Canada. 1st ed. 2008.
National Collaborating Centre for Methods and Tools. Evidence-Informed Decision Making in Public Health 2022. Available from: https://www.nccmt.ca/tools/eiph.
World Health Organization. WHO guide for evidence-informed decision-making. Evidence, policy, impact. 2021.
Canadian Public Health Association. Public health: a conceptual framework. Ottawa: Canadian Public Health Association; 2017.
Brownson RC, Gurney JG, Land GH. Evidence-based decision making in public health. J Public Health Manag Pract. 1999;5(5):86–97.
Kohatsu ND, Robinson JG, Torner JC. Evidence-based public health: an evolving concept. Am J Prev Med. 2004;27(5):417–21.
Titler MG. The evidence for evidence-based practice implementation. In: Hughes RG, editor. Patient safety and quality: an evidence-based handbook for nurses. Advances in Patient Safety. Rockville (MD); 2008.
Pan American Health Organization. A guide for evidence-informed decision-making, including in health emergencies. 2022.
Saunders H, Gallagher-Ford L, Kvist T, Vehvilainen-Julkunen K. Practicing Healthcare professionals’ evidence-based practice competencies: an overview of systematic reviews. Worldviews Evid Based Nurs. 2019;16(3):176–85.
Paci M, Faedda G, Ugolini A, Pellicciari L. Barriers to evidence-based practice implementation in physiotherapy: a systematic review and meta-analysis. Int J Qual Health Care. 2021;33(2):mzab093.
Mathieson A, Grande G, Luker K. Strategies, facilitators and barriers to implementation of evidence-based practice in community nursing: a systematic mixed-studies review and qualitative synthesis. Prim Health Care Res Dev. 2019;20:e6.
Li S, Cao M, Zhu X. Evidence-based practice: knowledge, attitudes, implementation, facilitators, and barriers among community nurses-systematic review. Med (Baltim). 2019;98(39):e17209.
Ward M, Mowat D. Creating an organizational culture for evidence-informed decision making. Healthc Manage Forum. 2012;25(3):146–50.
Peirson L, Ciliska D, Dobbins M, Mowat D. Building capacity for evidence informed decision making in public health: a case study of organizational change. BMC Public Health. 2012;12:137.
Allen P, Parks RG, Kang SJ, Dekker D, Jacob RR, Mazzucca-Ragan S, et al. Practices among Local Public Health Agencies to support evidence-based decision making: a qualitative study. J Public Health Manag Pract. 2023;29(2):213–25.
Ellen ME, Leon G, Bouchard G, Ouimet M, Grimshaw JM, Lavis JN. Barriers, facilitators and views about next steps to implementing supports for evidence-informed decision-making in health systems: a qualitative study. Implement Sci. 2014;9:179.
Sadeghi-Bazargani H, Tabrizi JS, Azami-Aghdash S. Barriers to evidence-based medicine: a systematic review. J Eval Clin Pract. 2014;20(6):793–802.
Barzkar F, Baradaran HR, Koohpayehzadeh J. Knowledge, attitudes and practice of physicians toward evidence-based medicine: a systematic review. J Evid Based Med. 2018;11(4):246–51.
Clark E, Dobbins M, Hagerman L, Neumann S, Akaraci S. What is known about strategies to implement evidence-informed practice at an organizational level? Prospero; 2022.
Clark EC, Dhaliwal B, Ciliska D, Neil-Sztramko SE, Steinberg M, Dobbins M. A pragmatic evaluation of a public health knowledge broker mentoring education program: a convergent mixed methods study. Implement Sci Commun. 2022;3(1):18.
Michie S, van Stralen MM, West R. The behaviour change wheel: a new method for characterising and designing behaviour change interventions. Implement Sci. 2011;6:42.
Dobbins M, Hanna SE, Ciliska D, Manske S, Cameron R, Mercer SL, et al. A randomized controlled trial evaluating the impact of knowledge translation and exchange strategies. Implement Sci. 2009;4:61.
Dobbins M, Traynor RL, Workentine S, Yousefi-Nooraie R, Yost J. Impact of an organization-wide knowledge translation strategy to support evidence-informed public health decision making. BMC Public Health. 2018;18(1):1412.
McDonagh LK, Saunders JM, Cassell J, Curtis T, Bastaki H, Hartney T, et al. Application of the COM-B model to barriers and facilitators to chlamydia testing in general practice for young people and primary care practitioners: a systematic review. Implement Sci. 2018;13(1):130.
Mersha AG, Gould GS, Bovill M, Eftekhari P. Barriers and facilitators of adherence to nicotine replacement therapy: a systematic review and analysis using the capability, opportunity, motivation, and Behaviour (COM-B) Model. Int J Environ Res Public Health. 2020;17(23):8895.
Pirotta S, Joham AJ, Moran LJ, Skouteris H, Lim SS. Implementation of evidence-based PCOS lifestyle management guidelines: perceived barriers and facilitators by consumers using the theoretical domains Framework and COM-B Model. Patient Educ Couns. 2021;104(8):2080–8.
Dubois A, Lévesque M. Canada’s National Collaborating centres: facilitating evidence-informed decision-making in public health. Can Commun Dis Rep. 2020;46(2–3):31–5.
Martin W, Wharf Higgins J, Pauly BB, MacDonald M. Layers of translation - evidence literacy in public health practice: a qualitative secondary analysis. BMC Public Health. 2017;17(1):803.
van der Graaf P, Forrest LF, Adams J, Shucksmith J, White M. How do public health professionals view and engage with research? A qualitative interview study and stakeholder workshop engaging public health professionals and researchers. BMC Public Health. 2017;17(1):892.
Page MJ, McKenzie JE, Bossuyt PM, Boutron I, Hoffmann TC, Mulrow CD, et al. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. BMJ. 2021;372:n71.
Neil-Sztramko SE, Belita E, Traynor RL, Clark E, Hagerman L, Dobbins M. Methods to support evidence-informed decision-making in the midst of COVID-19: creation and evolution of a rapid review service from the National Collaborating Centre for Methods and Tools. BMC Med Res Methodol. 2021;21(1):231.
Lizarondo L, Stern C, Carrier J, Godfrey C, Rieger K, Salmond S, Apostolo J, Kirkpatrick P, Loveday H. Chapter 8: mixed methods systematic reviews. Aromataris EMZ. 2020.
Thomas J, Kneale D, McKenzie JE, Brennan SE, Bhaumik S. In: Chandler J, Cumpston M, Li T, Page MJ, Welch VA, editors. Chapter 2: determining the scope of the review and the questions it will address. editor: Cochrane: Higgins JPT TJ; 2023.
Organisation for Economic Co-operation and Development. List of OECD Member countries - Ratification of the Convention on the OECD; 2021. Available from: https://www.oecd.org/about/document/ratification-oecd-convention.htm.
Joanna Briggs Institute. Available from: https://jbi.global/critical-appraisal-tools.
McKenzie JE, Brennan SE. Chapter 12. Synthesizing and presenting findings using other methods. 2021.
Brogly C, Bauer MA, Lizotte DJ, Press ML, MacDougall A, Speechley M, et al. An app-based Surveillance System for undergraduate students’ Mental Health during the COVID-19 pandemic: protocol for a prospective cohort study. JMIR Res Protoc. 2021;10(9):e30504.
Guyatt G, Oxman AD, Akl EA, Kunz R, Vist G, Brozek J, et al. GRADE guidelines: 1. Introduction-GRADE evidence profiles and summary of findings tables. J Clin Epidemiol. 2011;64(4):383–94.
Allen P, O’Connor JC, Best LA, Lakshman M, Jacob RR, Brownson RC. Management practices to build evidence-based decision-making capacity for Chronic Disease Prevention in Georgia: a Case Study. Prev Chronic Dis. 2018;15:E92.
Allen P, Jacob RR, Lakshman M, Best LA, Bass K, Brownson RC. Lessons learned in promoting evidence-based Public Health: perspectives from Managers in State Public Health Departments. J Community Health. 2018;43(5):856–63.
Augustino LR, Braun L, Heyne RE, Shinn A, Lovett-Floom L, King H, et al. Implementing evidence-based practice facilitators: a Case Series. Mil Med. 2020;185(Suppl 2):7–14.
Awan S, Samokhvalov AV, Aleem N, Hendershot CS, Irving JA, Kalvik A, et al. Development and implementation of an Ambulatory Integrated Care Pathway for Major Depressive Disorder and Alcohol Dependence. Psychiatr Serv. 2015;66(12):1265–7.
Bennett S, Whitehead M, Eames S, Fleming J, Low S, Caldwell E. Building capacity for knowledge translation in occupational therapy: learning through participatory action research. BMC Med Educ. 2016;16(1):257.
Breckenridge-Sproat ST, Throop MD, Raju D, Murphy DA, Loan LA, Patrician PA. Building a unit-level Mentored Program to sustain a culture of Inquiry for evidence-based practice. Clin Nurse Spec. 2015;29(6):329–37.
Brodowski ML, Counts JM, Gillam RJ, Baker L, Collins VS, Winkle E, Skala J, Stokes K, Gomez R, Redmon J. Translating evidence-based policy to practice: a Multilevel Partnership using the interactive systems Framework. J Contemp Social Serv. 2018;94(3):141–9.
Brownson RC, Allen P, Jacob RR, deRuyter A, Lakshman M, Reis RS, et al. Controlling Chronic diseases through evidence-based decision making: a Group-Randomized Trial. Prev Chronic Dis. 2017;14:E121.
Dobbins M, Greco L, Yost J, Traynor R, Decorby-Watson K, Yousefi-Nooraie R. A description of a tailored knowledge translation intervention delivered by knowledge brokers within public health departments in Canada. Health Res Policy Syst. 2019;17(1):63.
Elliott MJ, Allu S, Beaucage M, McKenzie S, Kappel J, Harvey R, et al. Defining the scope of knowledge translation within a National, Patient-Oriented Kidney Research Network. Can J Kidney Health Dis. 2021;8:20543581211004803.
Fernandez ME, Melvin CL, Leeman J, Ribisl KM, Allen JD, Kegler MC, et al. The cancer prevention and control research network: an interactive systems approach to advancing cancer control implementation research and practice. Cancer Epidemiol Biomarkers Prev. 2014;23(11):2512–21.
Flaherty HB, Bornheimer LA, Hamovitch E, Garay E, Mini de Zitella ML, Acri MC, et al. Examining organizational factors supporting the adoption and use of evidence-based interventions. Community Ment Health J. 2021;57(6):1187–94.
Gallagher-Ford L. Implementing and sustaining EBP in real world healthcare settings: transformational evidence-based leadership: redesigning traditional roles to promote and sustain a culture of EBP. Worldviews Evid Based Nurs. 2014;11(2):140–2.
Gifford W, Lefebre N, Davies B. An organizational intervention to influence evidence-informed decision making in home health nursing. J Nurs Adm. 2014;44(7/8):395–402.
Haynes A, Rowbotham S, Grunseit A, Bohn-Goldbaum E, Slaytor E, Wilson A, et al. Knowledge mobilisation in practice: an evaluation of the Australian Prevention Partnership Centre. Health Res Policy Syst. 2020;18(1):13.
Hitch D, Lhuede K, Vernon L, Pepin G, Stagnitti K. Longitudinal evaluation of a knowledge translation role in occupational therapy. BMC Health Serv Res. 2019;19(1):154.
Hooge N, Allen DH, McKenzie R, Pandian V. Engaging advanced practice nurses in evidence-based practice: an e-mentoring program. Worldviews Evid Based Nurs. 2022;19(3):235–44.
Humphries S, Hampe T, Larsen D, Bowen S. Building organizational capacity for evidence use: the experience of two Canadian healthcare organizations. Healthc Manage Forum. 2013;26(1):26–32.
Irwin MM, Bergman RM, Richards R. The experience of implementing evidence-based practice change: a qualitative analysis. Clin J Oncol Nurs. 2013;17(5):544–9.
Kaplan L, Zeller E, Damitio D, Culbert S, Bayley KB. Improving the culture of evidence-based practice at a Magnet(R) hospital. J Nurses Prof Dev. 2014;30(6):274–80. quiz E1-2.
Kimber M, Barwick M, Fearing G. Becoming an evidence-based service provider: staff perceptions and experiences of organizational change. J Behav Health Serv Res. 2012;39(3):314–32.
Mackay HJ, Campbell KL, van der Meij BS, Wilkinson SA. Establishing an evidenced-based dietetic model of care in haemodialysis using implementation science. Nutr Diet. 2019;76(2):150–7.
Martin-Fernandez J, Aromatario O, Prigent O, Porcherie M, Ridde V, Cambon L. Evaluation of a knowledge translation strategy to improve policymaking and practices in health promotion and disease prevention setting in French regions: TC-REG, a realist study. BMJ Open. 2021;11(9):e045936.
Melnyk BM, Fineout-Overholt E, Giggleman M, Choy K. A test of the ARCC(c) model improves implementation of evidence-based practice, Healthcare Culture, and patient outcomes. Worldviews Evid Based Nurs. 2017;14(1):5–9.
Miro A, Perrotta K, Evans H, Kishchuk NA, Gram C, Stanwick RS, et al. Building the capacity of health authorities to influence land use and transportation planning: lessons learned from the healthy Canada by Design CLASP Project in British Columbia. Can J Public Health. 2014;106(1 Suppl 1):eS40–52.
Parke B, Stevenson L, Rowe M. Scholar-in-Residence: an Organizational Capacity-Building Model to move evidence to action. Nurs Leadersh (Tor Ont). 2015;28(2):10–22.
Plath D. Organizational processes supporting evidence-based practice. Adm Social work. 2013;37(2):171–88.
Roberts M, Reagan DR, Behringer B. A Public Health Performance Excellence Improvement Strategy: Diffusion and Adoption of the Baldrige Framework within Tennessee Department of Health. J Public Health Manag Pract. 2020;26(1):39–45.
Traynor R, DeCorby K, Dobbins M. Knowledge brokering in public health: a tale of two studies. Public Health. 2014;128(6):533–44.
van der Zwet RJM, Beneken genaamd Kolmer DM, Schalk R, Van Regenmortel T. Implementing evidence-based practice in a Dutch Social Work Organisation: A Shared responsibility. Br J Social Work. 2020;50(7):2212–32.
Waterman H, Boaden R, Burey L, Howells B, Harvey G, Humphreys J, et al. Facilitating large-scale implementation of evidence based health care: insider accounts from a co-operative inquiry. BMC Health Serv Res. 2015;15:60.
Williams NJ, Wolk CB, Becker-Haimes EM, Beidas RS. Testing a theory of strategic implementation leadership, implementation climate, and clinicians’ use of evidence-based practice: a 5-year panel analysis. Implement Sci. 2020;15(1):10.
Williams C, van der Meij BS, Nisbet J, McGill J, Wilkinson SA. Nutrition process improvements for adult inpatients with inborn errors of metabolism using the i-PARIHS framework. Nutr Diet. 2019;76(2):141–9.
Williams NJ, Glisson C, Hemmelgarn A, Green P. Mechanisms of change in the ARC Organizational Strategy: increasing Mental Health clinicians’ EBP adoption through improved Organizational Culture and Capacity. Adm Policy Ment Health. 2017;44(2):269–83.
Alexander KE, Brijnath B, Mazza D. Barriers and enablers to delivery of the healthy kids check: an analysis informed by the theoretical domains Framework and COM-B model. Implement Sci. 2014;9:60.
McArthur C, Bai Y, Hewston P, Giangregorio L, Straus S, Papaioannou A. Barriers and facilitators to implementing evidence-based guidelines in long-term care: a qualitative evidence synthesis. Implement Sci. 2021;16(1):70.
Moffat A, Cook EJ, Chater AM. Examining the influences on the use of behavioural science within UK local authority public health: qualitative thematic analysis and deductive mapping to the COM-B model and theoretical domains Framework. Front Public Health. 2022;10:1016076.
De Leo A, Bayes S, Bloxsome D, Butt J. Exploring the usability of the COM-B model and theoretical domains Framework (TDF) to define the helpers of and hindrances to evidence-based practice in midwifery. Implement Sci Commun. 2021;2(1):7.
Morshed AB, Ballew P, Elliott MB, Haire-Joshu D, Kreuter MW, Brownson RC. Evaluation of an online training for improving self-reported evidence-based decision-making skills in cancer control among public health professionals. Public Health. 2017;152:28–35.
Jones K, Armstrong R, Pettman T, Waters E. Knowledge translation for researchers: developing training to support public health researchers KTE efforts. J Public Health (Oxf). 2015;37(2):364–6.
Dreisinger M, Leet TL, Baker EA, Gillespie KN, Haas B, Brownson RC. Improving the public health workforce: evaluation of a training course to enhance evidence-based decision making. J Public Health Manag Pract. 2008;14(2):138–43.
Mendell J, Richardson L. Integrated knowledge translation to strengthen public policy research: a case study from experimental research on income assistance receipt among people who use drugs. BMC Public Health. 2021;21(1):153.
Russell DJ, Rivard LM, Walter SD, Rosenbaum PL, Roxborough L, Cameron D, et al. Using knowledge brokers to facilitate the uptake of pediatric measurement tools into clinical practice: a before-after intervention study. Implement Sci. 2010;5:92.
Brown KM, Elliott SJ, Robertson-Wilson J, Vine MM, Leatherdale ST. Can knowledge exchange support the implementation of a health-promoting schools approach? Perceived outcomes of knowledge exchange in the COMPASS study. BMC Public Health. 2018;18(1):351.
Langeveld K, Stronks K, Harting J. Use of a knowledge broker to establish healthy public policies in a city district: a developmental evaluation. BMC Public Health. 2016;16:271.
Bornbaum CC, Kornas K, Peirson L, Rosella LC. Exploring the function and effectiveness of knowledge brokers as facilitators of knowledge translation in health-related settings: a systematic review and thematic analysis. Implement Sci. 2015;10:162.
Sarkies MN, Robins LM, Jepson M, Williams CM, Taylor NF, O’Brien L, et al. Effectiveness of knowledge brokering and recommendation dissemination for influencing healthcare resource allocation decisions: a cluster randomised controlled implementation trial. PLoS Med. 2021;18(10):e1003833.
Jansen MW, De Leeuw E, Hoeijmakers M, De Vries NK. Working at the nexus between public health policy, practice and research. Dynamics of knowledge sharing in the Netherlands. Health Res Policy Syst. 2012;10:33.
Sibbald SL, Kothari A. Creating, synthesizing, and sharing: the management of knowledge in Public Health. Public Health Nurs. 2015;32(4):339–48.
Barnes SJ. Information management research and practice in the post-COVID-19 world. Int J Inf Manage. 2020;55:102175.
Dwivedi YH, Coombs DL, Constantiniou C, Duan I, Edwards Y, Gupta JS, Lal B, Misra B, Prashant S, Raman P, Rana R, Sharma NP, Upadhyay SK. Impact of COVID-19 pandemic on information management research and practice: transforming education, work and life. Int J Inf Manag. 2020;55:102211.
Krausz M, Westenberg JN, Vigo D, Spence RT, Ramsey D. Emergency response to COVID-19 in Canada: platform development and implementation for eHealth in Crisis Management. JMIR Public Health Surveill. 2020;6(2):e18995.
Smith RW, Jarvis T, Sandhu HS, Pinto AD, O’Neill M, Di Ruggiero E, et al. Centralization and integration of public health systems: perspectives of public health leaders on factors facilitating and impeding COVID-19 responses in three Canadian provinces. Health Policy. 2023;127:19–28.
Pereira VC, Silva SN, Carvalho VKS, Zanghelini F, Barreto JOM. Strategies for the implementation of clinical practice guidelines in public health: an overview of systematic reviews. Health Res Policy Syst. 2022;20(1):13.
Tomsic I, Heinze NR, Chaberny IF, Krauth C, Schock B, von Lengerke T. Implementation interventions in preventing surgical site infections in abdominal surgery: a systematic review. BMC Health Serv Res. 2020;20(1):236.
Harrison R, Fischer S, Walpola RL, Chauhan A, Babalola T, Mears S, et al. Where do models for Change Management, improvement and implementation meet? A systematic review of the applications of Change Management models in Healthcare. J Healthc Leadersh. 2021;13:85–108.
Correa VC, Lugo-Agudelo LH, Aguirre-Acevedo DC, Contreras JAP, Borrero AMP, Patino-Lugo DF, et al. Individual, health system, and contextual barriers and facilitators for the implementation of clinical practice guidelines: a systematic metareview. Health Res Policy Syst. 2020;18(1):74.
Valizadeh L, Zamanzadeh V, Alizadeh S, Namadi Vosoughi M. Promoting evidence-based nursing through journal clubs: an integrative review. J Res Nurs. 2022;27(7):606–20.
Portela Dos Santos O, Melly P, Hilfiker R, Giacomino K, Perruchoud E, Verloo H, et al. Effectiveness of educational interventions to increase skills in evidence-based practice among nurses: the EDITcare. Syst Rev Healthc (Basel). 2022;10(11):2204.
Shelton RC, Lee M. Sustaining evidence-based interventions and policies: recent innovations and future directions in implementation science. Am J Public Health. 2019;109(S2):S132–4.
Brownson RC, Fielding JE, Green LW. Building Capacity for evidence-based Public Health: reconciling the pulls of Practice and the push of Research. Annu Rev Public Health. 2018;39:27–53.
Li SA, Jeffs L, Barwick M, Stevens B. Organizational contextual features that influence the implementation of evidence-based practices across healthcare settings: a systematic integrative review. Syst Rev. 2018;7(1):72.
Belita E, Yost J, Squires JE, Ganann R, Dobbins M. Development and content validation of a measure to assess evidence-informed decision-making competence in public health nursing. PLoS One. 2021;16(3):e0248330.
Dobbins M, Robeson P, Ciliska D, Hanna S, Cameron R, O’Mara L, et al. A description of a knowledge broker role implemented as part of a randomized controlled trial evaluating three knowledge translation strategies. Implement Sci. 2009;4:23.
Foy R, Ivers NM, Grimshaw JM, Wilson PM. What is the role of randomised trials in implementation science? Trials. 2023;24(1):537.
Pawson R. Pragmatic trials and implementation science: grounds for divorce? BMC Med Res Methodol. 2019;19(1):176.
Acknowledgements
The authors would like to acknowledge the NCCMT’s Rapid Evidence Service, particularly Alyssa Kostopoulos, Sophie Neumann and Selin Akaraci, for their contributions to this review.
Funding
The National Collaborating Centre for Methods and Tools is hosted by McMaster University and funded by the Public Health Agency of Canada. The views expressed herein do not necessarily represent the views of the Public Health Agency of Canada. The funder had no role in the design of the study, collection, analysis, or interpretation of data or in writing the manuscript.
Author information
Authors and Affiliations
Contributions
E.C.C. and M.D. designed the study. E.C.C., L.H., R.B., R.L.T., and T.B. completed screening, quality assessment and data extraction. E.C. and M.D. analyzed study results. E.C.C. and T.B. wrote the manuscript in consultation with M.D. All authors read and approved the final manuscript.
Corresponding author
Ethics declarations
Ethics approval and consent to participate
Not applicable.
Consent for publication
Not applicable.
Competing interests
The authors declare no competing interests.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
About this article
Cite this article
Clark, E.C., Burnett, T., Blair, R. et al. Strategies to implement evidence-informed decision making at the organizational level: a rapid systematic review. BMC Health Serv Res 24, 405 (2024). https://doi.org/10.1186/s12913-024-10841-3
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s12913-024-10841-3