Skip to main content
Download PDF

Quality of sick child management by health extension workers: role of a complex improvement intervention

BMC Health Services Research volume 23, Article number: 165 (2023) Cite this article

Abstract

Background

Despite the expansion of the Integrated Community Case Management services for childhood illness, quality and utilization of services have remained low. To address the problem, the Government of Ethiopia introduced a complex intervention that included community engagement, capacity building of health workers and enhanced district-level ownership of sick child management. We examined whether this complex intervention was associated with improved management of sick children by health extension workers.

Methods

The study was conducted in four Ethiopian regions. A baseline survey was conducted in 26 intervention and 26 comparison districts from December 2016 to February 2017, followed by an end-line survey 24 months later. We observed health extension workers’ consultations of sick 2–59 months old children. The analysis has evaluated if children with pneumonia, diarrhoea and malnutrition were assessed, classified and treated according to guidelines, and included difference-in-difference analyses.

Results

We observed 1325 consultations of sick children. At baseline, 86% of the sick children with cough in the intervention areas and 85% in comparison areas were assessed according to the guidelines, without any change at end-line associated with the intervention (difference-in-difference = -21%, p = 0.55). Sixty-two percent of children were assessed for dehydration at baseline in intervention and 47% in comparison areas, with no improvement associated with the intervention. Similarly, 87% of sick children in intervention and 91% in comparison areas were assessed for malnutrition, with no change over time associated with the intervention (difference-in-difference = 5%, p = 0.16). Appropriate pneumonia treatment with antibiotics declined and diarrhea treatment increased in both areas. Half of the malnourished children received ready-to-use therapeutic foods without any improvement associated with the intervention.

Conclusion

The intervention was not associated with improved quality of the health extension workers’ management of sick children. The lack of association may be linked to low fidelity in the implementation of the intervention. Our findings suggest that training healthcare providers without continued clinical mentoring and support does not improve the quality of care. Community-based programs can be strengthened by ensuring high coverage and continued clinical mentorships, supportive supervision, and supply of medicines and other essential commodities.

Trial registration number

ISRCTN12040912, retrospectively registered on 19/12/ 2017.

Peer Review reports

Introduction

Pneumonia and diarrhoea remain major killers of young children, despite the existence of proven interventions [1, 2]. These two illnesses account for one-third of all under-five child deaths and a loss of two million young lives per year [3]. The burden of these health problems is also higher among malnourished children. Nutrition-related factors contribute to about 45% of these deaths [4, 5]. Although the incidence of pneumonia and diarrhoea has declined in the past few decades worldwide, these reductions are not uniform across regions, with sub-Saharan Africa and Southern Asia having the highest burden of morbidity [6,7,8].

The community-based management of suspected pneumonia using antibiotics, diarrhoea with Oral Rehydration Solution (ORS) and zinc, and malnutrition with ready-to-use therapeutic food plays a key role in providing prompt care to reduce mortality in low-resource settings [9,10,11,12,13,14]. Ethiopia established the program for Integrated Community Case Management (iCCM) of childhood illness in 2010, comprising the management of pneumonia, diarrhoea, malaria and acute malnutrition; referral of severe illnesses; and, counselling parents of sick children [15]. These services are provided by health extension workers at health posts as part of the Health Extension Program, which itself was introduced in 2003 [16].

Providers’ adhere to clinical guidelines in the assessment, classification and treatment of sick children is low in most low-and-middle income countries; indicating the missed opportunities to provide them with lifesaving interventions [17,18,19]. In Ethiopia, in the early implementation period, studies assessing iCCM indicated that the quality of these services was good [20]. The program had strong leadership and support from the government [15]. Appropriate managerial and clinical support also improved the health extension workers’ performance [21]. Over time, despite the expansion of the iCCM services, quality and utilization of services have remained low. Studies have reported that assessment, classification, and management of sick children need improvement [22, 23] and that the referral practices for severely sick children was weak [22, 24]. Lack of medicines, supplies, supportive supervision and mentorship, and a decay in the health workers' clinical knowledge have been identified as challenges facing the program [25,26,27,28].

Based on a scoping review and a qualitative study that analysed the barriers and facilitators of child health service utilization, the Government of Ethiopia introduced a complex intervention called Optimizing the Health Extension Program (OHEP) [29, 30]. This intervention was implemented in four regions of Ethiopia (Oromia, Amhara, Tigray and Southern Nations, Nationalities, and Peoples region) from 2017 to end of 2018. OHEP aimed to increase the utilization of child health services through three main strategies: engaging communities, strengthening the capacity of the health extension workers to improve the quality of care they provide, and increasing the district-level accountability and ownerships for child health services [31]. Improved quality of care by health extension workers was an intermediate outcome of strengthening their capacity. The intervention was implemented by UNICEF, Last 10 Kilometers/John Snow, Inc., Save the Children and Program for Appropriate Technology in Health (PATH) in collaboration with the Ministry of Health and Regional Health Bureaus. The evaluation of the effectiveness of the OHEP intervention on the primary outcome, the utilisation of services for sick under-five children, has been reported and revealed that there was no effect of the intervention on the utilisation of services for sick children aged 2–59 months [32].

This study aimed to examine if at all there was any association between the intervention and the quality of assessment, classification and treatment of sick under-five children by health extension workers at health posts, which we considered to be in the pathway to increase service utilization for sick under-five children. This was done by conducting observations of health workers' management of sick children, which was then compared to the iCCM clinical guidelines. We focused on three major child health problems in this analysis, i.e., pneumonia, diarrhoea, and malnutrition.

The World Health Organization Health Facility Survey Tool was used to assess the quality of care delivered to sick children attending primary-level outpatient health facilities using the Integrated Management of Childhood Illness (IMCI) clinical guidelines as a best practice. This tool measures how well heath care workers’ asses, classify and treat under five children and also how well they council the caretakers. This is done by conducting observation of health workers' management of sick children, exit interview with caretakers, re-examination of the children by a health worker that serves as a “gold standard”, and assessing availability of equipment and supplies. In this paper, we have used information from the clinical observation sick-child module. The tool was validated and has been applied in various low-and-middle-income countries [33, 34].

Methods

Study design and setting

Baseline and end-line surveys in the intervention and comparison areas were conducted from December 2016 to February 2017 and from December 2018 to February 2019, respectively. The study was conducted in 52 districts across the four most populous regions of Ethiopia: Oromia, Amhara, Tigray and Southern Nations Nationalities and Peoples’ regions. Twenty-six of these districts were intervention districts, where the complex intervention was implemented for two years; from 2017 to end of 2018 (Fig. 1). The intervention districts were selected by the OHEP implementing partners and the Ministry of Health for having poor primary health service utilization indicators for under five children. All the district health offices, health centers, health posts and community members within the districts were targeted by the program. The 26 comparison districts were identified by regional health authorities based on their similarity in population size and key maternal and child health indicators. The study districts were also comparable with respect to the health service coverage and other health system characteristics [32]. The intervention protocol has been published [31] and a summary description of OHEP strategies to improve sick child quality of care are presented in Table 1.

Fig. 1
figure 1

Study area map

Full size image
Table 1 Description of Optimizing Health Extension Program sick child health services quality improvement strategies
Full size table

Study participants and selection procedure

A list of enumeration areas in the 52 districts were identified from the 2007 Ethiopian housing and population census. Two hundred clusters (enumeration areas) were randomly selected proportional to the population size of the districts. The health posts in the selected clusters were included in the study. The sick children who visited the selected health posts to seek care from health extension workers at time of the data collection were included.

A total of 800 sick child consultations were planned to be observed across intervention and comparison areas at baseline and again at end-line, with an average of four sick child observations per health post. This sample size would allow us to detect a 10–15 percentage point difference in the quality of health care provided by health extension workers between intervention and comparison areas at baseline and end-line, with a power of 80%. Given the low number of children that seek care at health posts, to ensure that we achieved this sample size, data collectors in collaboration with kebele (village) administrators mobilized families to bring their sick children to the health posts. This ensured that data collectors did not stay in the field for an extended amount of time. A similar approach of mobilization was employed both at baseline and end-line surveys.

Measurements

We used a structured observation questionnaire to collect data. The questions and content of the tool were developed based on the World Health Organization tool to evaluate the quality of care delivered to sick children attending outpatient facilities [35] and the iCCM guideline developed by the Federal Ministry of Health in Ethiopia [36].

At baseline and end-line surveys, the questionnaire included the following sections: complaints, assessments, classification, treatment, counselling and referral. The observation questionnaire also assessed the service experience of caretakers at health posts and background information about the health extension workers. The questionnaire was translated into three local languages (Afan Oromo, Amharic and Tigrigna) and uploaded on tablets (CSPro 6.3 at baseline and CSPro 7.1 at end-line) for data collection. The questionnaire was pilot tested and revised.

Data were collected by experienced and trained data collectors who were health professionals and had received refresher training on the iCCM guidelines for the clinical management of sick under-five children. The data collectors and supervisors were trained for 10 days and also participated in the pilot test. The training included a detailed review of the questionnaire, data collection techniques, field procedures and research ethics. Data collectors and field supervisors were blinded to whether a district was an intervention or comparison area.

The overall data collection process was strictly monitored by supervisors at field level who were health professionals with a bachelor’s degree and above. In addition, a data manager performed daily data quality checks and provided feedback to the field-level team on identified errors. A similar approach of data collection was undertaken both at baseline and end-line surveys.

Children 2–59 months, who were considered sick and brought to the health post by their parents, were included in the study. Observation of sick child consultations with health extension workers was conducted and caregivers were interviewed after completion of the consultation.

Data processing and analysis

The completeness and consistency of data were checked. The data analysis was conducted using Stata V.16 (StataCorp LLC, College Station, Texas, USA). First, the characteristics of study participants were analysed and presented using means, frequencies, and proportions. We conducted chi-square tests for all categorical variables and t-test for one continuous variable (average service year of HEWs) to assess if any differences existed between intervention and comparison areas over time. Second, the sick child complaints were analysed and presented. Third, the main outcome variables (appropriateness of sick child health care or quality of care) were analysed. Quality of care referred to the appropriate assessment, classification, and treatment of sick children as compared to the iCCM algorithm. In this study the appropriate management of common childhood illnesses, i.e., pneumonia, diarrhoea, malnutrition, were analysed (Table 2). The analysis was done for intervention and comparison areas at baseline and end-line.

Table 2 Definitions of outcome indicators
Full size table

The complex-intervention was the main independent variable for the observed changes. Difference-in-difference analyses was undertaken ([(IE-IB)-(CE-CB)]; where I was intervention group, C comparison group, E end-line and B baseline) to determine the association between the intervention and the management of suspected pneumonia, diarrhoea and malnutrition by the health extension workers. The key explanatory variable for the outcomes of this study was whether the sick child lived in the OHEP intervention area or lived in the comparison area. A model was created that included an interaction term for the timing of the survey (baseline or end line) and the survey area (intervention or comparison area). This model allowed for the calculation of the odds of appropriate assessment, classification or treatment of sick under-five children for the three illnesses separately, in intervention areas as compared with comparison areas, accounting for any differences between the areas at baseline, with adjustment for the cluster sampling and identified confounding factors from the Chi-square and t-test. Logistic regression model was fitted to assess if there was any difference between intervention and comparison areas over time. P-value < 0.05 and 95% CI were applied. Stata svy commands were used to adjust for clustering at the health post level.

Results

Of the planned 200 eligible clusters, data were not gathered from six intervention clusters at baseline due to civil unrest. At the end-line survey, another three intervention clusters and ten comparison clusters were excluded due to civil unrest. A total of 620 sick child consultations at baseline (325 intervention, 295 comparison) and 705 consultations at end-line (395 intervention, 310 comparison) were observed across 147 and 143 health posts, respectively (Fig. 2). Some of the clusters shared a health post and in other clusters data were not gathered since no sick child appeared at the health posts despite mobilization efforts. On average, four sick child consultations at the baseline survey and five sick child consultations at the end-line survey were observed per health post. The median duration of a sick child consultation was 20 min (IQR 12) at baseline and 20 min (IQR 16) at end-line. A description of the actual implementation of the OHEP quality of care strategies based on our published process evaluation is provided Table 3.

Fig. 2
figure 2

Study flow diagram

Full size image
Table 3 The implementation processes of Optimizing Health Extension Program sick child health services quality improvement strategies
Full size table

Characteristics of sick children and health extension workers

The sex distribution of examined sick children was similar in intervention and comparison districts at baseline and end-line. At baseline, the age distribution differed between intervention and comparison areas, whereas at end-line it was similar. The distribution of sick children by region differed at end-line in both areas. In all study areas at baseline and end-line the major complaint reported by caretakers were respiratory problems followed by diarrhoea.

At baseline and end-line, no difference was observed in the proportion of sick children managed by Level-3 (certificate) and Level-4 (diploma) health extension workers in the intervention and comparison areas. The health extension workers who assessed children had similar number of years of experience at baseline and end-line in both areas. Most sick child consultations across areas were done by iCCM-trained health extension workers both at baseline and end-line.

At the baseline and end-line surveys in intervention and comparison areas, approximately seven in ten of the sick children were managed by health extension workers who had been supervised by health centre or district health office staff in the last three months. At baseline in both areas, less than half of the sick children were managed by health extension workers who had participated in performance reviews and clinical mentoring meetings in the six months prior to the survey. At end-line, there was an increase in both intervention and comparison areas. Nine out of ten sick children were managed by health extension workers that used the iCCM chart booklet and iCCM registration books in the intervention and comparison districts at baseline and end-line surveys (Table 4).

Table 4 Characteristics of sick children and health extension workers at baseline (December 2016 to February 2017) and end-line (December 2018 to February 2019) in the intervention and comparison areas
Full size table

Assessment

As recommended by the Ethiopian iCCM guidelines, the health extension workers assessed pneumonia by counting breath for one minute for children with a respiratory complaint in 86% of the sick children in the intervention areas at baseline. This proportion decreased to 74% at end-line. In comparison areas, at baseline the health extension workers counted breaths in 85% of children with a respiratory complaint. This increased to 94% at end-line (difference-in-difference = -21%, p = 0.55).

At baseline in the intervention districts, the health extension workers assessed dehydration by pinching abdominal skin in 62% of sick children with diarrhoea. This assessment decreased to 42% at end-line. In comparison areas, 47% of sick children with diarrhoea were assessed for dehydration at baseline and 53% at end-line (difference-in-difference = -26%, p = 0.01).

The health extension workers had assessed acute malnutrition using Mid-Upper-Arm Circumference (MUAC) tape in over 80% of sick children in intervention and comparison areas at baseline and end-line surveys (difference-in-difference = 5%, p = 0.16) (Table 5).

Table 5 Proportion of appropriately assessed sick children at baseline (December 2016 to February 2017) and end-line (December 2018 to February 2019) in intervention and comparison areas
Full size table

Classification

At baseline, the health extension workers appropriately classified the complaints and findings as suspected pneumonia in 86% (intervention area) and 85% (comparison area) of sick children with cough and fast breathing. At end-line, this performance decreased in the intervention (60%) and comparison (54%) areas (difference-in-difference analysis = 5%, p = 0.88). Health extension workers appropriately classified acute malnutrition in over 90% sick children with a MUAC of < 11.9 cm in intervention and comparison areas at both baseline and end-line surveys (difference-in-difference = 7%, p = 0.09). Similar data were not available for diarrhoea since the health extension workers did not record the results of skin pinch test (Table 6).

Table 6 Proportion of appropriately classified sick children at baseline (December 2016 to February 2017) and end line (December 2018 to February 2019) in intervention and comparison areas
Full size table

Treatment

The proportion of children classified as having pneumonia that were appropriately treated with antibiotics slightly decreased from 60 to 54% in the intervention areas, while comparison areas showed a much greater decline from 92 to 41% (difference-in-difference analysis = 44%, p = 0.05). Appropriate treatment for children classified as having diarrhoea with ORS and zinc increased from 65% in the intervention areas at baseline to 82% at end-line. It also increased in comparison areas from 52% at baseline to 70% at end-line (difference-in-difference = -1%, p = 0.74). Forty percent of children classified as having malnutrition received ready-to-use therapeutic foods at baseline and 50% at end-line. In comparison areas, the corresponding figures were 70% at baseline and 33% at end-line (difference-in-difference 47%, p = 0.44) (Table 7).

Table 7 Proportion of appropriately treated sick children at baseline (December 2016 to February 2017) and end-line (December 2018 to February 2019) in intervention and comparison areas
Full size table

Discussion

Our analysis did not reveal any evidence that the complex intervention targeting communities, health facilities and district health managers was associated with improved assessment, classification or treatment of sick children with suspected pneumonia, diarrhoea, or acute malnutrition by health extension workers. The intervention did not improve the proportion of sick children that were seen by health extension workers that were trained in iCCM, had regular supervision or attended clinical mentorship meetings. The proportion of children seen by HEWs that were trained and supervised declined in both groups at end-line whereas the proportion that were seen by HEWs who had attended a clinical mentorship increased, more in the intervention group.

The approach used in the assessment of pneumonia was counting breaths for one minute, and that of acute malnutrition was MUAC tape measurement. Dehydration assessment was measured using abdominal skin pinching and checking whether skin goes back slowly or very slowly. There was no association between intervention and change in appropriate assessment of pneumonia, diarrhoea or malnutrition. Dehydration assessment for children with a diarrheal complaint was relatively high in intervention areas at baseline and decreased at end-line. In contrast, dehydration assessment was low in comparison areas at baseline and showed a sizable increase at end-line. Similarly, at end-line pneumonia assessment had increased in the comparison area and declined in the intervention area. While, malnutrition assessment was declined in both areas at end-line, more in the comparison area. Though a significant difference was observed in dehydration assessment over time, there was insufficient evidence to say that the intervention was associated with the decline. The possible reasons for improper assessment might be the lack of equipment’s such as timer at the health posts in the study area, and the low capacity of the health extension workers to adhere to the clinical guidelines. Similar gaps in the assessment of sick children following the clinical algorithm were observed in a study done in Ethiopia and a multi-country study conducted in Namibia, Kenya, Tanzania and Uganda [38, 39].

The complex intervention did not improve the health extension worker’s classification of pneumonia and malnutrition. For pneumonia, eight out of ten children with reported cough were classified according to guidelines in both areas at baseline whereas at end-line this had decreased to approximately half. The correct classification of malnutrition was over 90% in intervention and comparison areas at the start and end of study. The lack of association between the intervention and correct classifications might partly be due to improper assessments caused by the low level of iCCM supplies in the study area health posts. At baseline, only one-fifth of the health posts had functional timer in intervention and comparison areas and this has declined at end-line. In contrast, almost all health posts in intervention area and all health posts in comparison area had MUAC tape at the start and end of the study [32].

The intervention did not improve treatment for pneumonia, diarrhea and malnutrition. The proportion of appropriate pneumonia treatment declined in both areas at end-line with a greater decline in the comparison areas. The appropriate treatment of acute malnutrition with therapeutic food increased in the intervention areas and declined in the comparison areas at the end of the study; however, the change over time was not associated with the intervention. The lack of association between the intervention and correct treatment might partly be due to the low level of iCCM medicines. The overall evaluation of the complex intervention revealed that greater than three-fourths of health posts in intervention area and comparison area had amoxicillin at baseline and this has declined at end-line, with greater reduction in intervention area. There was no change in the availability of amoxicillin in the study area over time. The availability of oral rehydration solution increased in both areas and zinc availability was high at baseline and end-line in both groups. The availability of ready-to-use therapeutic food was low and declined in both areas [32].

A study that assessed the health extension workers perceived context and preparedness of health posts in the same setting revealed that there was a low level of resources and preparedness of health posts to provide child health services [40]. Ensuring iCCM medicines availability, and training of health extension workers to monitor their stock of medicines is important [41, 42]. Without adequate commodities, healthcare providers cannot provide life-saving treatments to their communities and are at risk of losing community trust [43].

The lack of associations might be also related to the low knowledge of the health extension workers on the management of sick children including drug provisions. A study conducted in Ethiopia revealed that a considerable proportion of the health extension workers had poor knowledge of drug provision for childhood illnesses, and their knowledge of sick child management was associated with presence of continuous supervisions and refresher trainings [44]. Another study conducted on the sick children referral practices of the health extension workers reported that lack of knowledge of treatment guidelines and skills was hindrance to adherence of the clinical guidelines [45].

In the present study area, most of the sick children were assessed, classified and treated by health extension workers who utilized the iCCM chart booklet and the registration book. Although adherence to iCCM principles may increase the quality of services [46, 47], the health extension workers did not properly follow these guidelines. Improper assessments negatively influence subsequent classification and treatment of sick children, exposing children to missed opportunities of lifesaving interventions. A previous study reported that the complexity of the guidelines could hinder adherence to recommended actions [48]. Proper diagnosis and treatment of sick children are prerequisites for reducing under-five deaths in pneumonia, diarrhoea and severe acute malnutrition [43]. Many children’s lives can be saved with correct management of childhood diarrhoea [49, 50].

The OHEP intervention aimed to support the health extension workers by building their capacity to provide iCCM services. Previous research has shown positive relationships between capacity building interventions and aspects of quality of care provided by community health workers. Trained, supported and well-equipped community health workers can implement iCCM according to the guidelines [20, 51, 52]. However, there was no increase in iCCM-trained health extension workers that could be attributed to the intervention. Furthermore, iCCM training was provided to approximately eight out of ten health extension workers in both areas at baseline and end-line, implying that better coverage of training is necessary but not sufficient intervention to improve the quality of health care [32]. In addition to coverage, the duration and frequency of trainings, as well as the general conditions for health workers influence the quality of care that is provided. Earlier studies have also reported that in-service training is more effective when provided jointly with supervision and mentorship [53, 54]. An approach that combined training with facility-based practice, coaching and continuous supportive supervision and mentorship of community health workers has improved their skills and retention [52]. OHEP was intended to provide joint supervision by district health staff and biannual performance reviews and clinical mentoring meetings. However, supervision or clinical mentorship did not increase as a result of the intervention [32].

The process evaluation of the complex intervention has also indicated that the capacity building interventions had low coverage. Some of the intervention packages were introduced late and in some of the districts the packages of interventions were interrupted for months due to administrative issues. Only a fifth of the intervention activities had high fidelity of implementation in the first year [37]. This could potentially explain the lack of change in the quality of care provided by the health extension workers in the study area. The lack of associations between OHEP intervention and improved quality of care might also be related to the level of education of the health extension workers, and lack of in-kind incentives as reported from Ethiopia and other parts of the world [44, 55,56,57]. In the OHEP evaluation areas health extension workers with a lower level of training (level-3) were more common and only few of them were provided with an incentive accommodation. Intervention and comparison area health extension workers, however, were similar at baseline and end-line with respect to their level of education, service experience, and having accommodation.

The overall evaluation of OHEP intervention also revealed a lack of effect on care-seeking for common childhood illnesses in children 2–59 months’ age. The intervention had no effect on household participation in community engagement forums, nor on indicators of district accountability of child health services [32]. Another study based on the same survey data also revealed a lack of association between the intervention and correct classification of sick children 2–59 months by the health extension workers as compared to health officers who served as a gold standard [58].

The study clusters with health posts in intervention and comparison areas were selected for the evaluation of the intervention. However, we believe that study health posts and health extension workers were not substantially different from the average in the four study regions. Some health posts were excluded due to security reasons, and this might theoretically bias the findings. These excluded health posts were few and occurred in equal proportions in intervention and comparison areas. The intervention and comparison areas were similar in baseline characteristics [32]. Child age was an exception, but this was accounted for in the analyses. The study was based on observation of sick children’s consultations by health extension workers and observations were conducted by trained clinicians who also had received refresher training of iCCM. The observers silently followed and recorded the consultations [59]. The results may therefore potentially be influenced by a Hawthorne effect [60,61,62], implying that the daily management without observation could be even less correct. The outcome was measured at two points (baseline and end-line) and the trend or speed of changes of outcome in the absence of the program (time-varying differences) in both areas was not assessed. This might partly underestimate the effect of the complex intervention.

Conclusion

We have shown that a complex intervention had no association with appropriate assessment and management by the health extension workers of children with suspected pneumonia, diarrhoea and acute malnutrition. The lack of association might be linked to a low coverage and poor implementation of the interventions. Our findings confirm earlier reports that training of health care providers without continued mentoring and support does not improve the quality of care. Therefore, such kind of community level complex intervention need adequate time and high coverage of implementation to bring change. It is critical to strengthen community-based programs with clinical mentorship, supportive supervision and supply of medicines and other essential commodities.

Availability of data and materials

Data from this study are co-owned by the participating institutions and stored in a depository at the Ethiopian Public Health Institute (EPHI). The use of these data is guided by a data sharing agreement that states that data will be made available upon reasonable request but are not publicly available during the period when Ph.D. students and other involved researchers are analyzing and reporting based on these data. Data can be accessed from the secretary of Data sharing committee of EPHI-LSHTM collaborative projects, Mrs. Martha Zeweldemariam; E-mail: martha.zeweldemariam@lshtm.ac.uk.

References

  1. Qazi S, Aboubaker S, MacLean R, Fontaine O, Mantel C, Goodman T, et al. Ending preventable child deaths from pneumonia and diarrhoea by 2025. Development of the integrated Global Action Plan for the Prevention and Control of Pneumonia and Diarrhoea. Arch Dis Child. 2015;100(Suppl 1):S23 LP-S28 Available from: http://adc.bmj.com/content/100/Suppl_1/S23.abstract.

    Article  Google Scholar 

  2. Leung DT, Chisti MJ, Pavia AT. Prevention and Control of Childhood Pneumonia and Diarrhea. Pediatr Clin North Am. 2016;63(1):67–79.

    Article  PubMed  PubMed Central  Google Scholar 

  3. UNICEF. One is too many: Ending child deaths from pneumonia and diarrhoea. 2016. Available from: https://data.unicef.org/wp-content/uploads/2016/11/UNICEF-Pneumonia-Diarrhoea-report2016-web-version_final.pdf.

    Google Scholar 

  4. World Health Organization. Key facts. Children: improving survival and wellbeing. 2019. Available from: https://www.who.int/news-room/fact-sheets/detail/children-reducing-mortality.

    Google Scholar 

  5. UNICEF. UNICEF DATA: Monitoring the situation of children amd women. 2019. Available from: https://data.unicef.org/topic/child-health/pneumonia/.

    Google Scholar 

  6. McAllister DA, Liu L, Shi T, Chu Y, Reed C, Burrows J, et al. Global, regional, and national estimates of pneumonia morbidity and mortality in children younger than 5 years between 2000 and 2015: a systematic analysis. Lancet Glob Heal. 2019;7(1):e47-57. Available from: https://doi.org/10.1016/S2214-109X(18)30408-X.

    Article  Google Scholar 

  7. Fischer Walker CL, Rudan I, Liu L, Nair H, Theodoratou E, Bhutta ZA, et al. Global burden of childhood pneumonia and diarrhoea. Lancet. 2013;381(9875):1405–16.

    Article  Google Scholar 

  8. Liu L, Oza S, Hogan D, Chu Y, Perin J, Zhu J, et al. Global, regional, and national causes of under-5 mortality in 2000–15: an updated systematic analysis with implications for the Sustainable Development Goals. Lancet. 2016;388(10063):3027–35. Available from: https://doi.org/10.1016/S0140-6736(16)31593-8.

    Article  PubMed  PubMed Central  Google Scholar 

  9. Wanduru P, Tetui M, Tuhebwe D, Ediau M, Okuga M, Nalwadda C, et al. The performance of community health workers in the management of multiple childhood infectious diseases in Lira, northern Uganda - A mixed methods cross-sectional study. Glob Health Action. 2016;9(1):33194.

    Article  PubMed  Google Scholar 

  10. Das JK, Lassi ZS, Salam RA, Bhutta ZA. Effect of community based interventions on childhood diarrhea and pneumonia: Uptake of treatment modalities and impact on mortality. BMC Public Health. 2013;13(SUPPL.3):S29.

    Article  PubMed  PubMed Central  Google Scholar 

  11. Amouzou A, Morris S, Moulton LH, Mukanga D. Assessing the impact of integrated community case management (iCCM) programs on child mortality: Review of early results and lessons learned in sub-Saharan Africa. J Glob Health. 2014;4(2):020411.

    Article  PubMed  PubMed Central  Google Scholar 

  12. Ballard M, Montgomery P. Systematic review of interventions for improving the performance of community health workers in low-income and middle-income countries. BMJ Open. 2017;7(10):e014216.

    Article  PubMed  PubMed Central  Google Scholar 

  13. López-Ejeda N, Charle Cuellar P, Vargas A, Guerrero S. Can community health workers manage uncomplicated severe acute malnutrition? A review of operational experiences in delivering severe acute malnutrition treatment through community health platforms. Matern Child Nutr. 2019;15:e12719.

    Article  PubMed  Google Scholar 

  14. Brenner JL, Barigye C, Maling S, Kabakyenga J, Nettel-Aguirre A, Buchner D, Kyomuhangi T, Pim C, Wotton K, Amon NSN. Where there is no doctor: can volunteer community health workers in rural Uganda provide integrated community case management? Afr Health Sci. 2017;17(1):237–46.

    Article  PubMed  PubMed Central  Google Scholar 

  15. Legesse H, Degefie T, Hiluf M, Sime K, Tesfaye C, Abebe H, et al. National scale-up of integrated community case management in rural Ethiopia: Implementation and early lessons learned. Ethiop Med J. 2015;2014(52):15–26.

    Google Scholar 

  16. Berhanu D, Avan B. Community Based Newborn Care: Quality of CBNC programme assessment - midline evaluation report. London: IDEAS, London School of Hygiene & Tropical Medicine. IDEAS, London School of Hygiene & Tropical Medicine. 2017.

  17. HEFDC Group. Integrated community case management (iCCM) in sub-Saharan Africa: Successes and challenges with access, speed and quality. Thematic Review Report. 2018.

    Google Scholar 

  18. Bagonza J, Kibira SPS, Rutebemberwa E. Performance of community health workers managing malaria, pneumonia and diarrhoea under the community case management programme in central Uganda: A cross sectional study. Malar J. 2014;13(1):1–10.

    Article  Google Scholar 

  19. Chinbuah MA, Abbey M, Kager PA, Gyapong M, Nonvignon J, Ashitey P, et al. Assessment of the adherence of community health workers to dosing and referral guidelines for the management of fever in children under 5 years: a study in Dangme West District. Ghana Int Health. 2013;5:148–56.

    Article  PubMed  Google Scholar 

  20. Miller NP, Amouzou A, Tafesse M, Hazel E, Legesse H, Degefie T, et al. Integrated Community Case Management of Childhood Illness in Ethiopia : Implementation Strength and Quality of Care. Am J Trop Med Hyg. 2014;91(2):424–34.

    Article  PubMed  PubMed Central  Google Scholar 

  21. Miller NP, Amouzou A, Hazel E, Legesse H, Degefie T, Tafesse M, et al. Assessment of the impact of quality improvement interventions on the quality of sick child care provided by Health Extension Workers in Ethiopia. J Glob Health. 2016;6(2):020404.

    Article  PubMed  PubMed Central  Google Scholar 

  22. Daka DW, Wordofa MA, Woldie M, Persson Å, Berhanu D. Quality of clinical assessment and management of sick children by Health Extension Workers in four regions of Ethiopia : A cross-sectional survey. PLoS One. 2020;15(9):e0239361.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  23. Getachew T, Mekonnen S, Yitayal M, Persson LÅ, Berhanu D. Health Extension Workers’ diagnostic accuracy for common childhood illnesses in four regions of Ethiopia: a cross-sectional study. Acta Paediatr Int J Paediatr. 2019;108(11):2100–6 Available from: https://onlinelibrary.wiley.com/doi/epdf/10.1111/apa.14888.

    Article  Google Scholar 

  24. Beyene H, Hailu D, Tadele H, Persson LÅ, Berhanu D. Insufficient referral practices of sick children in Ethiopia shown in a cross-sectional survey. Acta Paediatr Int J Paediatr. 2020;109(9):1867–74.

    Article  Google Scholar 

  25. Shaw B, Amouzou A, Miller NP, Tafesse M, Bryce J, Surkan PJ. Access to integrated community case management of childhood illnesses services in rural Ethiopia: A qualitative study of the perspectives and experiences of caregivers. Health Policy Plan. 2016;31(5):656–66.

    Article  PubMed  Google Scholar 

  26. UNICEF and PATH. Literature Review on Barriers to Utilization of Health Extension Services : Draft Report. 2016.

    Google Scholar 

  27. Tefera W, Tesfaye H, Bekele A, Kayessa E, Waltensperger KZ, David R. Factors influencing the low utilization of curative child health services in Shebedino District, Sidama Zone Ethiopia. Ethiop Med J. 2014;52(3):109–17.

    PubMed  Google Scholar 

  28. Shaw B, Amouzou A, Miller NP, Tsui AO, Bryce J, Tafesse M, et al. Determinants of utilization of health extension workers in the context of scale-up of integrated community case management of childhood illnesses in Ethiopia. Am J Trop Med Hyg. 2015;93(3):636–47.

    Article  PubMed  PubMed Central  Google Scholar 

  29. Miller NP, Bagheri Ardestani F, Wong H, Stokes S, Mengistu B, Paulos M, et al. Barriers to the utilization of community-based child and newborn health services in Ethiopia: a scoping review. Health Policy Plan. 2021;36(7):1187–96.

    Article  PubMed  PubMed Central  Google Scholar 

  30. Mengistu B, Paulos M, Agonafir N, Ameha A, Legesse H, Dankenbring E, et al. Barriers to the uptake of community-based curative child health services in Ethiopia. BMC Public Health. 2021;21(1):1551. Available from: https://doi.org/10.1186/s12889-021-11558-2.

    Article  PubMed  PubMed Central  Google Scholar 

  31. Berhanu D, Okwaraji YB, Belayneh AB, Lemango ET, Agonafer N, Birhanu BG, et al. Protocol for the evaluation of a complex intervention aiming at increased utilization of primary child health services in Ethiopia: A before and after study in intervention and comparison areas. BMC Health Serv Res. 2010;20:339.

    Article  Google Scholar 

  32. Berhanu D, Okwaraji YB, Defar A, Bekele A, Lemango ET, Medhanyie AA, et al. Does a complex intervention targeting communities, health facilities and district health managers increase the utilisation of community-based child health services? A before and after study in intervention and comparison areas of Ethiopia. BMJ Open. 2020;10(9):e040868 Available from: http://bmjopen.bmj.com/content/10/9/e040868.abstract.

    Article  PubMed  PubMed Central  Google Scholar 

  33. Quach A, Tosif S, Nababan H, Duke T, Graham SM, Were WM, et al. Assessing the quality of care for children attending health facilities: A systematic review of assessment tools. BMJ Glob Heal. 2021;6(10):e006804.

    Article  Google Scholar 

  34. Quach A, Tosif S, Graham SM, von Mollendorf C, Mulholland K, Graham H, et al. Quality of care for children with acute respiratory infections in health facilities: A comparative analysis of assessment tools. J Glob Health. 2022;12:1–9.

    Article  Google Scholar 

  35. World Health Organization. Health Facility Survey: Tool to evaluate the quality of care delivered to sick children attending outpatients facilities (using the Integrated Management of Childhood Illness clinical guidelines as best practices) [Internet]. 2003. Report No.: 9241545860. Available from: https://apps.who.int/iris/handle/10665/42643

  36. Ministry of Health of Ethiopia. The Integrated Community Case Management (iCCM) Chart Booklet Ethiopia. 2014. Available from: http://lifesavingcommodities.org/wp-content/uploads/2014/08/iCCM-English-Chartbooklet-August-2013.pdf.

    Google Scholar 

  37. Okwaraji YB, Hill Z, Defar A, Berhanu D, Wolassa D, Persson LÅ, et al. Implementation of the ‘optimising the health extension program’ intervention in ethiopia: A process evaluation using mixed methods. Int J Environ Res Public Health. 2020;17(16):1–20.

    Article  Google Scholar 

  38. Abtew S, Negatou M, Wondie T, Tadesse Y, Alemayehu WA, Tsegaye DA, et al. Poor Adherence to the Integrated Community Case Management of Newborn and Child Illness Protocol in Rural Ethiopia. Am J Trop Med Hyg. 2022;107(6):1337–44.

    Article  PubMed  PubMed Central  Google Scholar 

  39. Krüger C, Heinzel-Gutenbrunner M, Ali M. Adherence to the integrated management of childhood illness guidelines in Namibia, Kenya, Tanzania and Uganda: evidence from the national service provision assessment surveys. BMC Health Serv Res. 2017;17(1):822. Available from: https://doi.org/10.1186/s12913-017-2781-3.

    Article  PubMed  PubMed Central  Google Scholar 

  40. Getachew T, Abebe SM, Yitayal M, Bergström A, Persson LA, Berhanu D. Health extension workers’ perceived health system context and health post preparedness to provide services: A cross-sectional study in four Ethiopian regions. BMJ Open. 2021;11:e048517.

    Article  PubMed  PubMed Central  Google Scholar 

  41. Avan BI, Berhanu D, Mekonnen Y, Beaumont E, Tomlin K, Allen E, et al. Embedding Community-Based Newborn Care in the Ethiopian health system: lessons from a 4-year programme evaluation. Health Policy Plan. 2021;36(Supplement_1):i22-32. Available from: https://doi.org/10.1093/heapol/czab085.

    Article  PubMed  PubMed Central  Google Scholar 

  42. Chee G, Pielemeier N, Lion A, Connor C. Why differentiating between health system support and health system strengthening is needed. Int J Health Plann Manage. 2013;28:85–94.

    Article  PubMed  Google Scholar 

  43. Prosnitz D, Herrera S, Coelho H, Davis LM, Zalisk K, Yourkavitch J. Evidence of impact: ICCM as a strategy to save lives of children under five. J Glob Health. 2019;9(1):0108801.

    Article  Google Scholar 

  44. Befekadu A, Yitayal M. Knowledge and practice of health extension workers on drug provision for childhood illness in west Gojjam, Amhara. Northwest Ethiopia BMC Public Health. 2020;20:496. Available from: https://doi.org/10.1186/s12889-020-08602-y.

    Article  PubMed  Google Scholar 

  45. Beyene H, Hailu D, Tadele H, Persson LÅ, Berhanu D. A mixed-methods study exploring adherence to the referral of severely sick children in primary health care in Southern Ethiopia. Arch Public Heal. 2021;79(1):159. Available from: https://doi.org/10.1186/s13690-021-00681-6.

    Article  Google Scholar 

  46. Bryce J, Victora CG, Habicht JP, Black RE, Scherpbier RW. Programmatic pathways to child survival: Results of a multi-country evaluation of Integrated Management of Childhood Illness. Health Policy Plan. 2005;20(SUPPL. 1):i5-17.

    Article  PubMed  Google Scholar 

  47. Black RE, Morris SS, Bryce J. Where and why are 10 million children dying every year? Lancet. 2003;361(9376):2226–34. Available from: https://doi.org/10.1016/S0140-6736(03)13779-8.

    Article  PubMed  Google Scholar 

  48. Izudi J, Anyigu S, Ndungutse D. Adherence to Integrated Management of Childhood Illnesses Guideline in Treating South Sudanese Children with Cough or Difficulty in Breathing. Int J Pediatr 2017;1–7.

  49. Carvajal-vélez L, Amouzou A, Perin J, Maïga A, Tarekegn H, Akinyemi A, et al. Diarrhea management in children under five in sub-Saharan Africa : does the source of care matter? A Countdown analysis. BMC Public Health. 2016;16:830. Available from: https://doi.org/10.1186/s12889-016-3475-1.

    Article  PubMed  PubMed Central  Google Scholar 

  50. Soiza RL, Donaldson AIC, Myint PK. The global problem of childhood diarrhoeal diseases: emerging strategies in prevention and management. Ther Adv Infect Dis. 2018;5(1):29–43.

    Google Scholar 

  51. Oresanya O, Counihan H, Nndaliman I, Alegbeleye A, Jiya J, Adesoro O, et al. Effect of community-based intervention on improving access to treatment for sick under-five children in hard-to-reach communities in Niger State, Nigeria. J Glob Health. 2019;9(1):010803.

    Article  PubMed  PubMed Central  Google Scholar 

  52. Shiroya-Wandabwa M, Kabue M, Kasungami D, Wambua J, Otieno D, Waka C, et al. Coaching community health volunteers in integrated community case management improves the care of sick children under-5: Experience from Bondo. Kenya Int J Integr Care. 2018;18(4):1–11.

    Google Scholar 

  53. Leslie HH, Gage A, Nsona H, Hirschhorn LR, Kruk ME. Training and supervision did not meaningfully improve quality of care for pregnant women or sick children in sub-Saharan Africa. Health Aff. 2016;35(9):1716–24.

    Article  Google Scholar 

  54. The Health Foundation. Evidence scan: quality improvement training for healthcare professionals. 2012. Available from: https://www.health.org.uk/sites/health/files/QualityImprovementTrainingForHealthcareProfessionals.pdf.

    Google Scholar 

  55. Wanduru P, Tetui M, Tuhebwe D, Ediau M, Okuga M, Nalwadda C, et al. The performance of community health workers in the management of multiple childhood infectious diseases in Lira, northern Uganda – a mixed methods cross-sectional study. Glob Health Action. 2016;9(1):33194. Available from: https://doi.org/10.3402/gha.v9.33194.

    Article  PubMed  Google Scholar 

  56. Ojoro V, Kisakye A, Musoke D. Factors associated with management of pneumonia among children by Community Health Workers in Abim district Uganda. J Interv Epidemiol Public Heal. 2021;23:4.

    Google Scholar 

  57. Tilahun H, Fekadu B, Abdisa H, Canavan M, Linnander E, Bradley EH, et al. Ethiopia’s health extension workers use of work time on duty: time and motion study. Health Policy Plan. 2017;32(3):320–8. Available from: https://doi.org/10.1093/heapol/czw129.

    Article  PubMed  Google Scholar 

  58. Getachew T, Abebe SM, Yitayal M, Persson LÅ, Berhanu D. Association between a complex community intervention and quality of health extension workers’ performance to correctly classify common childhood illnesses in four regions of Ethiopia. PLoS ONE. 2021;16(3):e0247474.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  59. Cardemil CV, Gilroy KE, Callaghan-Koru JA, Nsona H, Bryce J. Comparison of methods for assessing quality of care for community case management of sick children: an application with community health workers in Malawi. Am J Trop Med Hyg. 2012;87(5 Suppl):127–36.

    Article  PubMed  PubMed Central  Google Scholar 

  60. Goodwin MA, Stange KC, Zyzanski SJ, Crabtree BF, Borawski EA, Flocke SA. The Hawthorne Effect in Direct Observation Research with Physicians and Patients. J Eval Clin Pr. 2017;23(6):1322–8.

    Article  Google Scholar 

  61. Oswald D, Sherratt F, Smith S. Handling the Hawthorne effect : The challenges surrounding a participant observer. Rev Soc Stud. 2014;1(1):53–73 Available from: http://www.rossjournal.co.uk/wp-content/uploads/2016/12/RoSS-Vol1-No1-Oswald-et-al-53-73.pdf.

    Article  Google Scholar 

  62. Mccambridge J, Witton J, Elbourne DR. Systematic review of the Hawthorne effect : New concepts are needed to study research participation effects. J Clin Epidemiol. 2014;67(3):267–77. Available from: https://doi.org/10.1016/j.jclinepi.2013.08.015.

    Article  PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgements

The authors would like to thank the research participants who gave their time to participate in the study and the field research team who collected the data. The authors would also like to thank the survey administration.

Patient and public involvement

Patients and/or the public were not involved in the design or conduct, or reporting or dissemination plans of this research.

Funding

This research project was funded by Bill & Melinda Gates Foundation with a grant to London School of Hygiene & Tropical Medicine (INV-009691). The funder had no role in the study design, collection, management, analysis or interpretation of data.

Author information

Authors and Affiliations

  1. Faculty of Public Health, Department of Health Policy and Management, Jimma University, Jimma, Ethiopia

    Dawit Wolde Daka & Mirkuzie Woldie

  2. Faculty of Public Health, Department of Population and Family Health, Jimma University, Jimma, Ethiopia

    Muluemebet Abera Wordofa

  3. Ethiopian Public Health Institute, Addis Ababa, Ethiopia

    Della Berhanu & Lars Åke Persson

  4. The London School of Hygiene & Tropical Medicine, London, UK

    Della Berhanu & Lars Åke Persson

  5. Fenot Project, University of British Columbia, School of Public Health and Population, Addis Ababa, Ethiopia

    Mirkuzie Woldie

Authors
  1. Dawit Wolde Daka
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Muluemebet Abera Wordofa
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Della Berhanu
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Lars Åke Persson
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Mirkuzie Woldie
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

All authors conceived the study, participated in data collectors training and supervision, and analysis and interpretation of data. DWD prepared the first draft of the manuscript with contributions from MAW, MW, LP and DB. All authors read and commented on the manuscript and approved the final version.

Corresponding author

Correspondence to Dawit Wolde Daka.

Ethics declarations

Ethics approval and consent to participate

Approval to conduct the study was obtained from the ethical review committees at the Ethiopian Public Health Institute (protocol number SERO-012–8-2016; 001 August 2016), London School of Hygiene & Tropical Medicine (protocol number 11235, June 2016) and Jimma University (protocol number IHRPGD/472/2018, August 2018). Study support was secured from the regional and district health authorities in the study area. All methods were carried out in accordance with the relevant guidelines and regulations. Informed consent was taken from the study participants (caregivers and health extension workers). At the beginning of each interview the purpose of the study was explained, and the participants asked if they had any questions. To ensure confidentiality, interviews were conducted in private rooms and names or personal identifiers were not used. Access to data was restricted to authorized research staff. Severely ill children were referred to a nearby health centre and transportation support was provided whenever needed.

Consent for publication

Not applicable.

Competing interests

The authors declare no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Daka, D.W., Wordofa, M.A., Berhanu, D. et al. Quality of sick child management by health extension workers: role of a complex improvement intervention. BMC Health Serv Res 23, 165 (2023). https://doi.org/10.1186/s12913-023-09131-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12913-023-09131-1

Keywords

BMC Health Services Research

ISSN: 1472-6963

Contact us