Skip to main content

Table 2 Round 1: Results

From: Development of an Implementation Process Model: a Delphi study

Implementation and Sustainability Sub-domains, Elements and Sub-elements N Mean SD Median IQR % Agree
Implementation and Sustainability Sub-Domains
These four sub-domains appropriately represent necessary steps in the implementation and sustainability process of healthcare innovations. 54 3.8 0.9 4 0 75%
 1. Engage relevant stakeholders and establish partnerships to:       
 2. Identify the implementability and sustainability of the innovation       
 3. Develop an implementation and sustainability plan       
 4. Monitor and evaluate the implementation and sustainability of the intervention/innovation       
The order of the four sub-domains makes sense. 54 4.0 1.0 4 1 80%
The components of the sub-domains are comprehensive. 54 3.4 1.2 4 2 68%
1. Engage relevant stakeholders and establish partnerships to:
The following elements are necessary for this sub domain:       
 a. Determine the objectives and goals for implementation 54 4.4 0.8 5 1 89%
 b. Determine optimized communication mechanism among team 54 4.1 0.8 4 1 82%
 c. Identify and clarify roles 54 4.2 0.8 4 1 85%
 d. Identify any anticipated challenges and mitigating strategies to implementation 54 4.2 0.8 4 1 84%
 The order of the four elements makes sense. 54 3.9 0.9 4 0 78%
 The components of the elements are comprehensive. 54 3.4 1.2 4 2 67%
2. Identify the implementability and sustainability of the innovation
The following elements are necessary for this sub domain:
  a. Identify the purpose of the implementation and sustainability 54 4.0 0.9 4 1 80%
  b. Assess the determinants of implementation and sustainability (barriers and facilitators to change) 54 4.4 0.6 4 1 89%
  c. Assess Readiness to Change 54 4.3 0.6 4 1 86%
  The order of the three elements makes sense. 54 4.0 0.9 4 1 79%
  The components of the elements are comprehensive. 54 3.8 0.9 4 1 76%
3. Develop an implementation and sustainability plan
The following elements are necessary for this sub domain:
  a. Identify stakeholders who should be involved in the implementation 54 4.4 0.6 4 1 88%
  b. Assess the context and characteristics of the adopter environment 54 4.3 0.7 4 1 87%
  c. Assess the fit and effectiveness of the intervention/innovation 54 4.1 0.9 4 1 82%
  d. Assess fidelity and adaptation of the intervention/innovation 54 4.1 0.9 4 1 82%
  e. Assess the capacity to sustain the intervention/innovation 54 4.3 0.6 4 1 86%
  f. Adapt learnings from implementation 54 4.2 0.8 4 1 83%
  g. Consider the use of an implementation framework 54 4.1 0.8 4 1 82%
  h. Consider the use of a sustainability framework 54 4.1 0.8 4 1 81%
  The order of the eight elements makes sense. 54 3.6 1.1 4 1 72%
  The components of the elements are comprehensive. 54 3.8 0.9 4 1 77%
4. Monitor and evaluate the implementation and sustainability of the intervention/innovation
The following elements are necessary for this sub domain:
  a. Engage stakeholders and knowledge users 54 4.3 0.5 4 1 86%
  b. Define the scope of implementation and sustainability 54 4.1 0.7 4 1 83%
  c. Identify objectives and purpose of the evaluation 54 4.3 0.5 4 1 86%
  d. Determine the focus of the implementation and sustainability evaluation 54 4.3 0.6 4 1 86%
  The order of the above elements makes sense. 54 3.8 1.0 4 0 77%
  The components of the elements are comprehensive. 54 3.7 1.0 4 1 73%
The following element and sub-elements are necessary for this sub domain:
  e. Select the type of evaluation 54 4.2 0.8 4 1 85%
  Formative evaluation 54 4.1 0.7 4 1 83%
  Implementation or process evaluation 54 4.3 0.7 4 1 86%
  Outcome evaluation 54 4.3 0.7 4 1 86%
  Economic evaluation 54 4.1 0.8 4 1 82%
  Impact evaluation 54 4.1 0.7 4 1 82%
  Summative evaluation 54 4.2 0.7 4 1 83%
  Hybrid model 54 4.0 0.7 4 2 80%
  The order of the seven sub-elements makes sense. 54 3.8 0.9 4 1 75%
  The components of the sub-elements are comprehensive. 54 4.0 0.7 4 0 81%
The following elements and sub-elements are necessary for this sub domain:
  f. Select the appropriate study design(s) for the type of evaluation 54 4.2 0.7 4 1 83%
  g. Select outcomes and establish indicators 54 4.4 0.6 4 1 87%
  Clinical 54 4.3 0.8 4 1 85%
  Patient 54 4.3 0.8 4 1 85%
  Provider 54 4.3 0.7 4 1 86%
  Process or implementation 54 4.3 0.7 4 1 86%
  Service 54 4.2 0.7 4 1 84%
  Organizational and health care system 54 4.2 0.7 4 1 85%
  Economic 54 4.2 0.7 4 1 85%
  h. Consider using implementation evaluation frameworks to drive the evaluation 54 4.1 0.8 4 1 82%
  The order of the elements and sub-elements make sense. 54 3.8 0.9 4 1 76%
  The components of the elements and sub-elements are comprehensive. 54 3.8 0.8 4 1 76%
  1. Bold items did not reach consensus (< 76%)
  2. IQR: 0 = high consensus; 1 = good consensus; 2 = poor consensus