Skip to main content

Table 2 Round 1: Results

From: Development of an Implementation Process Model: a Delphi study

Implementation and Sustainability Sub-domains, Elements and Sub-elements

N

Mean

SD

Median

IQR

% Agree

Implementation and Sustainability Sub-Domains

ā€ƒThese four sub-domains appropriately represent necessary steps in the implementation and sustainability process of healthcare innovations.

54

3.8

0.9

4

0

75%

ā€ƒ1. Engage relevant stakeholders and establish partnerships to:

Ā Ā Ā Ā Ā Ā 

ā€ƒ2. Identify the implementability and sustainability of the innovation

Ā Ā Ā Ā Ā Ā 

ā€ƒ3. Develop an implementation and sustainability plan

Ā Ā Ā Ā Ā Ā 

ā€ƒ4. Monitor and evaluate the implementation and sustainability of the intervention/innovation

Ā Ā Ā Ā Ā Ā 

ā€ƒThe order of the four sub-domains makes sense.

54

4.0

1.0

4

1

80%

ā€ƒThe components of the sub-domains are comprehensive.

54

3.4

1.2

4

2

68%

1. Engage relevant stakeholders and establish partnerships to:

ā€ƒThe following elements are necessary for this sub domain:

Ā Ā Ā Ā Ā Ā 

ā€ƒa. Determine the objectives and goals for implementation

54

4.4

0.8

5

1

89%

ā€ƒb. Determine optimized communication mechanism among team

54

4.1

0.8

4

1

82%

ā€ƒc. Identify and clarify roles

54

4.2

0.8

4

1

85%

ā€ƒd. Identify any anticipated challenges and mitigating strategies to implementation

54

4.2

0.8

4

1

84%

ā€ƒThe order of the four elements makes sense.

54

3.9

0.9

4

0

78%

ā€ƒThe components of the elements are comprehensive.

54

3.4

1.2

4

2

67%

2. Identify the implementability and sustainability of the innovation

ā€ƒThe following elements are necessary for this sub domain:

ā€ƒā€ƒa. Identify the purpose of the implementation and sustainability

54

4.0

0.9

4

1

80%

ā€ƒā€ƒb. Assess the determinants of implementation and sustainability (barriers and facilitators to change)

54

4.4

0.6

4

1

89%

ā€ƒā€ƒc. Assess Readiness to Change

54

4.3

0.6

4

1

86%

ā€ƒā€ƒThe order of the three elements makes sense.

54

4.0

0.9

4

1

79%

ā€ƒā€ƒThe components of the elements are comprehensive.

54

3.8

0.9

4

1

76%

3. Develop an implementation and sustainability plan

ā€ƒThe following elements are necessary for this sub domain:

ā€ƒā€ƒa. Identify stakeholders who should be involved in the implementation

54

4.4

0.6

4

1

88%

ā€ƒā€ƒb. Assess the context and characteristics of the adopter environment

54

4.3

0.7

4

1

87%

ā€ƒā€ƒc. Assess the fit and effectiveness of the intervention/innovation

54

4.1

0.9

4

1

82%

ā€ƒā€ƒd. Assess fidelity and adaptation of the intervention/innovation

54

4.1

0.9

4

1

82%

ā€ƒā€ƒe. Assess the capacity to sustain the intervention/innovation

54

4.3

0.6

4

1

86%

ā€ƒā€ƒf. Adapt learnings from implementation

54

4.2

0.8

4

1

83%

ā€ƒā€ƒg. Consider the use of an implementation framework

54

4.1

0.8

4

1

82%

ā€ƒā€ƒh. Consider the use of a sustainability framework

54

4.1

0.8

4

1

81%

ā€ƒā€ƒThe order of the eight elements makes sense.

54

3.6

1.1

4

1

72%

ā€ƒā€ƒThe components of the elements are comprehensive.

54

3.8

0.9

4

1

77%

4. Monitor and evaluate the implementation and sustainability of the intervention/innovation

ā€ƒThe following elements are necessary for this sub domain:

ā€ƒā€ƒa. Engage stakeholders and knowledge users

54

4.3

0.5

4

1

86%

ā€ƒā€ƒb. Define the scope of implementation and sustainability

54

4.1

0.7

4

1

83%

ā€ƒā€ƒc. Identify objectives and purpose of the evaluation

54

4.3

0.5

4

1

86%

ā€ƒā€ƒd. Determine the focus of the implementation and sustainability evaluation

54

4.3

0.6

4

1

86%

ā€ƒā€ƒThe order of the above elements makes sense.

54

3.8

1.0

4

0

77%

ā€ƒā€ƒThe components of the elements are comprehensive.

54

3.7

1.0

4

1

73%

ā€ƒThe following element and sub-elements are necessary for this sub domain:

ā€ƒā€ƒe. Select the type of evaluation

54

4.2

0.8

4

1

85%

ā€ƒā€ƒFormative evaluation

54

4.1

0.7

4

1

83%

ā€ƒā€ƒImplementation or process evaluation

54

4.3

0.7

4

1

86%

ā€ƒā€ƒOutcome evaluation

54

4.3

0.7

4

1

86%

ā€ƒā€ƒEconomic evaluation

54

4.1

0.8

4

1

82%

ā€ƒā€ƒImpact evaluation

54

4.1

0.7

4

1

82%

ā€ƒā€ƒSummative evaluation

54

4.2

0.7

4

1

83%

ā€ƒā€ƒHybrid model

54

4.0

0.7

4

2

80%

ā€ƒā€ƒThe order of the seven sub-elements makes sense.

54

3.8

0.9

4

1

75%

ā€ƒā€ƒThe components of the sub-elements are comprehensive.

54

4.0

0.7

4

0

81%

ā€ƒThe following elements and sub-elements are necessary for this sub domain:

ā€ƒā€ƒf. Select the appropriate study design(s) for the type of evaluation

54

4.2

0.7

4

1

83%

ā€ƒā€ƒg. Select outcomes and establish indicators

54

4.4

0.6

4

1

87%

ā€ƒā€ƒClinical

54

4.3

0.8

4

1

85%

ā€ƒā€ƒPatient

54

4.3

0.8

4

1

85%

ā€ƒā€ƒProvider

54

4.3

0.7

4

1

86%

ā€ƒā€ƒProcess or implementation

54

4.3

0.7

4

1

86%

ā€ƒā€ƒService

54

4.2

0.7

4

1

84%

ā€ƒā€ƒOrganizational and health care system

54

4.2

0.7

4

1

85%

ā€ƒā€ƒEconomic

54

4.2

0.7

4

1

85%

ā€ƒā€ƒh. Consider using implementation evaluation frameworks to drive the evaluation

54

4.1

0.8

4

1

82%

ā€ƒā€ƒThe order of the elements and sub-elements make sense.

54

3.8

0.9

4

1

76%

ā€ƒā€ƒThe components of the elements and sub-elements are comprehensive.

54

3.8

0.8

4

1

76%

  1. Bold items did not reach consensus (<ā€‰76%)
  2. IQR: 0ā€‰=ā€‰high consensus; 1ā€‰=ā€‰good consensus; 2ā€‰=ā€‰poor consensus