Table 1 Implementation outcome measurements used in both Kenya and Ethiopia projects

Reach

The degree to which an intervention-eligible population receives it

• Number of sick young infants managed for PSBI (% infants eligible who receive PSBI care)

• Proportion of SYI referred

Facility iCCM/PSBI register review

Effectiveness

The impact of an intervention on the uptake of PSBI treatment

• Improvement in percent of mothers/caretakers of SYIs who seek care from an appropriate provider

Before-after household surveys

Adoption

The extent to which project innovations are employed

• Number of facilities providing PSBI services when a referral is not feasible

• Number of facilities and community-based providers trained in PSBI intervention

• % of supplies in stock and percent of re-supply

Chart reviews and facility assessment and program monitoring data

Implementation

Fidelity: intervention or strategy was implemented as it was designed in an original protocol, plan, or policy or as adapted

• Implementation strength score:

− % of HEWs/CHVs trained/mentored on PSBI

− Mean percentage of materials/ equipment available

− Mean percentage of supplies available

− % of HEWs/CHVs supervised on PSBI

− % of health posts /PHCs facilitated awareness creation meetings at the community level

Process evaluation (facility assessment, interview with service providers and program managers, facility iCCM/PSBI register review) and program monitoring data

Acceptability: Perception of stakeholders (county and sub-county) about the contribution of the interventions to project results

• CHVs/Facility-based providers’ acceptability of introducing and implementing the IMNCI/PSBI intervention package in the context of COVID-19

• Barriers and facilitators to uptake of PSBI guidelines in the context of COVID-19

Process evaluation, interview with service providers,

Before-after household surveys

Maintenance

The extent to which the intervention is institutionalized in both facilities and communities

• Trends in service uptake and rebound

• Functionality of CHVs

• Implementation strategies incorporated with the district work stream and integration

• Feasibility of the strategies for national scale-up

Process evaluation (facility assessment, interview with service providers and program managers, facility iCCM/PSBI register review)