From: Development of an Implementation Process Model: a Delphi study
Implementation and Sustainability Sub-domains, Elements and Sub-elements | N | Mean | SD | Median | IQR | % Agree |
---|---|---|---|---|---|---|
Implementation and Sustainability Sub-Domains | ||||||
āThese four sub-domains appropriately represent necessary steps in the implementation and sustainability process of healthcare innovations. | 54 | 3.8 | 0.9 | 4 | 0 | 75% |
ā1. Engage relevant stakeholders and establish partnerships to: | Ā | Ā | Ā | Ā | Ā | Ā |
ā2. Identify the implementability and sustainability of the innovation | Ā | Ā | Ā | Ā | Ā | Ā |
ā3. Develop an implementation and sustainability plan | Ā | Ā | Ā | Ā | Ā | Ā |
ā4. Monitor and evaluate the implementation and sustainability of the intervention/innovation | Ā | Ā | Ā | Ā | Ā | Ā |
āThe order of the four sub-domains makes sense. | 54 | 4.0 | 1.0 | 4 | 1 | 80% |
āThe components of the sub-domains are comprehensive. | 54 | 3.4 | 1.2 | 4 | 2 | 68% |
1. Engage relevant stakeholders and establish partnerships to: | ||||||
āThe following elements are necessary for this sub domain: | Ā | Ā | Ā | Ā | Ā | Ā |
āa. Determine the objectives and goals for implementation | 54 | 4.4 | 0.8 | 5 | 1 | 89% |
āb. Determine optimized communication mechanism among team | 54 | 4.1 | 0.8 | 4 | 1 | 82% |
āc. Identify and clarify roles | 54 | 4.2 | 0.8 | 4 | 1 | 85% |
ād. Identify any anticipated challenges and mitigating strategies to implementation | 54 | 4.2 | 0.8 | 4 | 1 | 84% |
āThe order of the four elements makes sense. | 54 | 3.9 | 0.9 | 4 | 0 | 78% |
āThe components of the elements are comprehensive. | 54 | 3.4 | 1.2 | 4 | 2 | 67% |
2. Identify the implementability and sustainability of the innovation | ||||||
āThe following elements are necessary for this sub domain: | ||||||
āāa. Identify the purpose of the implementation and sustainability | 54 | 4.0 | 0.9 | 4 | 1 | 80% |
āāb. Assess the determinants of implementation and sustainability (barriers and facilitators to change) | 54 | 4.4 | 0.6 | 4 | 1 | 89% |
āāc. Assess Readiness to Change | 54 | 4.3 | 0.6 | 4 | 1 | 86% |
āāThe order of the three elements makes sense. | 54 | 4.0 | 0.9 | 4 | 1 | 79% |
āāThe components of the elements are comprehensive. | 54 | 3.8 | 0.9 | 4 | 1 | 76% |
3. Develop an implementation and sustainability plan | ||||||
āThe following elements are necessary for this sub domain: | ||||||
āāa. Identify stakeholders who should be involved in the implementation | 54 | 4.4 | 0.6 | 4 | 1 | 88% |
āāb. Assess the context and characteristics of the adopter environment | 54 | 4.3 | 0.7 | 4 | 1 | 87% |
āāc. Assess the fit and effectiveness of the intervention/innovation | 54 | 4.1 | 0.9 | 4 | 1 | 82% |
āād. Assess fidelity and adaptation of the intervention/innovation | 54 | 4.1 | 0.9 | 4 | 1 | 82% |
āāe. Assess the capacity to sustain the intervention/innovation | 54 | 4.3 | 0.6 | 4 | 1 | 86% |
āāf. Adapt learnings from implementation | 54 | 4.2 | 0.8 | 4 | 1 | 83% |
āāg. Consider the use of an implementation framework | 54 | 4.1 | 0.8 | 4 | 1 | 82% |
āāh. Consider the use of a sustainability framework | 54 | 4.1 | 0.8 | 4 | 1 | 81% |
āāThe order of the eight elements makes sense. | 54 | 3.6 | 1.1 | 4 | 1 | 72% |
āāThe components of the elements are comprehensive. | 54 | 3.8 | 0.9 | 4 | 1 | 77% |
4. Monitor and evaluate the implementation and sustainability of the intervention/innovation | ||||||
āThe following elements are necessary for this sub domain: | ||||||
āāa. Engage stakeholders and knowledge users | 54 | 4.3 | 0.5 | 4 | 1 | 86% |
āāb. Define the scope of implementation and sustainability | 54 | 4.1 | 0.7 | 4 | 1 | 83% |
āāc. Identify objectives and purpose of the evaluation | 54 | 4.3 | 0.5 | 4 | 1 | 86% |
āād. Determine the focus of the implementation and sustainability evaluation | 54 | 4.3 | 0.6 | 4 | 1 | 86% |
āāThe order of the above elements makes sense. | 54 | 3.8 | 1.0 | 4 | 0 | 77% |
āāThe components of the elements are comprehensive. | 54 | 3.7 | 1.0 | 4 | 1 | 73% |
āThe following element and sub-elements are necessary for this sub domain: | ||||||
āāe. Select the type of evaluation | 54 | 4.2 | 0.8 | 4 | 1 | 85% |
āāFormative evaluation | 54 | 4.1 | 0.7 | 4 | 1 | 83% |
āāImplementation or process evaluation | 54 | 4.3 | 0.7 | 4 | 1 | 86% |
āāOutcome evaluation | 54 | 4.3 | 0.7 | 4 | 1 | 86% |
āāEconomic evaluation | 54 | 4.1 | 0.8 | 4 | 1 | 82% |
āāImpact evaluation | 54 | 4.1 | 0.7 | 4 | 1 | 82% |
āāSummative evaluation | 54 | 4.2 | 0.7 | 4 | 1 | 83% |
āāHybrid model | 54 | 4.0 | 0.7 | 4 | 2 | 80% |
āāThe order of the seven sub-elements makes sense. | 54 | 3.8 | 0.9 | 4 | 1 | 75% |
āāThe components of the sub-elements are comprehensive. | 54 | 4.0 | 0.7 | 4 | 0 | 81% |
āThe following elements and sub-elements are necessary for this sub domain: | ||||||
āāf. Select the appropriate study design(s) for the type of evaluation | 54 | 4.2 | 0.7 | 4 | 1 | 83% |
āāg. Select outcomes and establish indicators | 54 | 4.4 | 0.6 | 4 | 1 | 87% |
āāClinical | 54 | 4.3 | 0.8 | 4 | 1 | 85% |
āāPatient | 54 | 4.3 | 0.8 | 4 | 1 | 85% |
āāProvider | 54 | 4.3 | 0.7 | 4 | 1 | 86% |
āāProcess or implementation | 54 | 4.3 | 0.7 | 4 | 1 | 86% |
āāService | 54 | 4.2 | 0.7 | 4 | 1 | 84% |
āāOrganizational and health care system | 54 | 4.2 | 0.7 | 4 | 1 | 85% |
āāEconomic | 54 | 4.2 | 0.7 | 4 | 1 | 85% |
āāh. Consider using implementation evaluation frameworks to drive the evaluation | 54 | 4.1 | 0.8 | 4 | 1 | 82% |
āāThe order of the elements and sub-elements make sense. | 54 | 3.8 | 0.9 | 4 | 1 | 76% |
āāThe components of the elements and sub-elements are comprehensive. | 54 | 3.8 | 0.8 | 4 | 1 | 76% |