Skip to main content

Impact of community-based health insurance on health services utilisation among vulnerable households in Amhara region, Ethiopia

Abstract

Background

Ethiopia piloted community-based health insurance in 2011, and as of 2019, the programme was operating in 770 districts nationwide, covering approximately 7 million households. Enrolment in participating districts reached 50%, holding promise to achieve the goal of Universal Health Coverage in the country. Despite the government’s efforts to expand community-based health insurance to all districts, evidence is lacking on how enrolment in the programme nudges health seeking behaviour among the most vulnerable rural households. This study aims to examine the effect of community-based health insurance enrolment among the most vulnerable and extremely poor households participating in Ethiopia’s Productive Safety Net Programme on the utilisation of healthcare services in the Amhara region.

Methods

Data for this study came from Amhara pilot integrated safety net programme baseline survey in Ethiopia and were collected between December 2018 and February 2019 from 5,398 households. We used propensity score matching method to estimate the impacts of enrolment in community-based health insurance on outpatient, maternal, and child preventive and curative healthcare services utilisation.

Results

Results show that membership in community-based health insurance increases the probabilities of visiting health facilities for curative care in the past month by 8.2 percentage points (95% CI 5.3 to 11.1), seeking care from a health professional by 8.4 percentage points (95% CI 5.5 to 11.3), and visiting a health facility to seek any medical assistance for illness and check-ups in the past 12 months by 13.9 percentage points (95% CI 10.5 to 17.4). Insurance also increases the annual household per capita health facility visits by 0.84 (95% CI 0.64 to 1.04). However, we find no significant effects of community-based health insurance membership on utilisation of maternal and child healthcare services.

Conclusions

Findings that community-based health insurance increased outpatient services utilisation implies that it could also contribute towards universal health coverage and health equity in rural and informal sectors. The absence of significant effects on maternal and child healthcare services may be due to the free availability of such services for everyone at the public health facilities, regardless of insurance membership. Outpatient services use among insured households is still not universal, and understanding of the barriers to use, including supply-side constraints, will help improve universal health coverage.

Peer Review reports

Background

United Nations (UN) member countries have committed to achieving universal health care coverage (UHC) by 2030 under the Sustainable Development Goals (SDGs). This target, under SDG 3 (Ensure healthy lives and promote wellbeing for all at all ages), is motivated by recognition of the need for and access to quality essential healthcare services, medicines, and vaccines for all people and to facilitate financial risk protection [1]. However, past studies show gaps towards this goal. For example, in 2013, the median proportion of births attended by a skilled health worker across 75 low and middle-income countries (LMICs) was only 62% [2] and, in 2013 about 400 million people globally lacked access to at least one of the essential healthcare services including family planning, receiving at least four antenatal care (ANC) visits, receiving 3 doses of diphtheria, tetanus, and pertussis (DTP) vaccine, antiretroviral therapy, tuberculosis treatment and children sleeping under insecticide-treated bed nets (ITBNs) [3]. Further, during 2014–2020, only 41% and 52% of children in western and central Africa and eastern and southern Africa, respectively, with symptoms of acute respiratory infection were taken to a health facility [4]. To address these and related gaps, many low-income countries are giving increasing attention to health insurance in efforts to increase health care utilisation and the attainment of UHC [5,6,7]. In this regard, Community-Based Health Insurance (CBHI) has been used as one of the important tools to expand access to healthcare services by the poorest and most vulnerable groups [8, 9].

As part of the country’s efforts to strengthen the supply and increase the demand for health services, Ethiopia implemented a series of health sector development plans in the past two decades, including the last five-year Health Sector Development Programme (HSDP) (2010/11 – 2014/15) [10] and the first Health Sector Transformation Plan (HSTP I) (2015/16—2019/20) [11]. The government of Ethiopia also offers all the services delivered at the health posts as well as maternal (including family planning, antenatal care, delivery, and postnatal care) and child-related health services such as child immunizations delivered at all public health facilities free of charge regardless of socio-economic status [12, 13]. The country also invested heavily in expanding health facilities and development of health professionals to deliver quality healthcare services [14, 15]. The government of Ethiopia also provides a healthcare fee waiver for about 2 million individuals (approximately 10% of the population living below the national poverty line) annually to get healthcare services at no cost [11]. Partly to gradually and systematically replace the healthcare fee waiver scheme [16], the country has also been implementing CBHI since 2011 to further expand access to essential health care services and increase health seeking behaviour of individuals while protecting households against catastrophic health expenditures. Accordingly, some improvements have been registered. For example, the proportion of fully immunised under-one children increased from 24% in 2011 to 39% in 2016 [17] and delivery at a health facility increased from 26% in 2016 to 48% in 2019 [18]. Despite these achievements, critical gaps remain. To mention a few, in 2016, only 31% of under-five children with symptoms of acute respiratory illness (ARI) and 35% of children with a fever sought services from a health care facility or provider [17]. Further, the most recent demographic and health survey (DHS) also reported that only 43% of women had at least four ANC visits during their previous pregnancy and 34% of women received post-natal care (PNC) within two days period [18]. In addition, although the per capita outpatient department visits increased from 0.3 in 2013/14 [14] to 0.9 in 2019, it is still far below the WHO recommendation of 2.5 per capita annual visits [19].

Against the backdrop of the government’s commitments but substantial gaps in some key health outcome indicators, this study examines whether CBHI increases health services utilisation among some of the most vulnerable rural households who participate in the government poverty-targeted social protection programme - the Productive Safety Net Programme (PSNP). Previous studies from LMICs on the impacts of CBHI on health services utilisation find mixed evidence. Various studies show that CBHI enrolment is linked to increased preventive healthcare utilisation such as sleeping under insecticide-treated bed nets or vaccination for children [20, 21], utilisation of outpatients health care [22,23,24,25,26], use of some maternal health care services [27], and better self-reported health and higher perceived quality of services [23,24,25]. In contrast to this, some other studies reported insignificant effects of CBHI membership on the utilisation of inpatient health services [20, 24, 26].

In Ethiopia in particular, studies to date have been conducted on the impacts of CBHI on health service utilisation using data collected during CBHI’s pilot phase [24, 25] and using small-scale household surveys [28, 29]. Past studies generally show that CBHI enrolment is likely to increase healthcare utilisation, decrease costs per visit, better self-reported health, and higher perceived quality of services [23,24,25]. More specifically, Demissie and Negeri [28] find that membership in CBHI is associated with a three-fold increase in the utilisation of outpatient healthcare services in southern Ethiopia. Elsewhere in Ethiopia, Tilahun et al. [29] also find that being a member to CBHI increases healthcare utilisation approximately by 25.2 percentage points. A study by Atnafu et al. [29] also shows that households who were enrolled in CBHI were more likely to use healthcare services than households who were not enrolled. Mebratie et al. [25] find that utilisation of outpatient services in public health facilities increases by 30–41% and the frequency of visits by 45–64% due to membership in CBHI. Similarly, Shigute et al. [30] also reported that CBHI nudges the probability of using modern healthcare services (visiting a modern health care facility for outpatient care services) and the number of visits to modern health facilities among adult members in the aggregated sample. They find a larger impact of CBHI on outpatient health services utilisations for the PSNP sub-sample compared to the pooled sample. Utilisation of child curative care services for an illness in the past 4 weeks also increased due to enrolment in CBHI [31].

Existing studies in Ethiopia have focused on the general population, regardless of households’ participation in other social protection programmes such as Ethiopia’s flagship social protection program, the PSNP, while in the current study, we focus particularly on PSNP-participating households. Thus, CBHI enrolled households in our study could be members of two large-scale social protection programmes: CBHI and PSNP, thereby giving important policy insights on how membership in CBHI and PSNP affects households’ health seeking behaviour. In this regard, we aim to contribute to the scant literature by focusing entirely on PSNP beneficiary households. From a policy perspective, our study gives new evidence to better understand how the integration of social assistance programmes can affect the utilisation of health services among the most vulnerable population. Further, while previous studies examined limited healthcare utilisation indicators, mainly outpatient visits and inpatient services, our study considered several healthcare services, categorized under outpatient, maternal, and child preventive and curative services.

Methods

Policy context

In 2011, the government of Ethiopia piloted CBHI in 13 rural districts (covering about 1.6 million people) targeting rural households and people working in the informal sector. This was scaled up to 161 districts after three years of piloting [32]. As of 2019, the programme covered 7 million households residing in 770 districts throughout the country (i.e., 75% district coverage nationwide). CBHI is currently operating in all regions and Addis Ababa except Somali, Gambella, and Dire Dawa. In the programme districts, 50% of eligible households are currently enrolled and the programme has an 82% renewal rate [33]. Nevertheless, the national level enrolment is still below the target set by the government: 80% of household enrolment and 80% coverage of districts by 2020 [11].

Enrolment in CBHI is conducted voluntarily. The programme uses the core principles of risk-sharing, a community-based decision-making process, and community support. Enrolment is conducted at the household level and all rural households in the district, excluding those formally employed, can join the programme.

The CBHI is a yearly contractual agreement with advance premium payments by the members, and all renewals and new member registrations are conducted for a period of up to three months every year. Currently, the programme has two member types – self-paying and indigent members. The regional and district governments jointly fund the enrolment premiums of indigent households such as the permanent direct support (PDS) clients in the productive safety net programme. For paying members, annual premiums are set based on household sizes. In 2019, the premiums were ETB 240 (USD 8.6) for 1 to 5 member households, ETB 290 (USD 10.4) for 6–7 member households, and ETB 340 (USD 12.2) for households with 8 or more members.

The benefit package of CBHI programme includes all outpatient and inpatient services available in health centres, treatment for cancer, dialysis and organ transplant for renal failure, treatment of major trauma, intensive care unit, hip and knee replacement, and major burns [32]. Services sought at primary, general, and referral public hospitals are also covered following appropriate referral procedures [34]. All services must be sought from public healthcare facilities with contractual agreements with the district CBHI office. CBHI does not cover costs related to tooth implantation, eyeglasses for ophthalmic cases, cosmetic procedures [32], aesthetic surgery, infertility treatment, and organ transplants (except renal, heart, and bone marrow) [34].

Ethiopia’s government also enacted its flagship poverty-targeted social protection programme, the rural Productive Safety Net Programme (PSNP), in 2005. About 85% of the programme beneficiaries are required to work on labour-intensive Public Works (PW) for payments while the other 15%, called the Permanent Direct Support (PDS) clients, who lack labour to participate in public works, receive unconditional cash and/ or food transfers [35]. To integrate various social protection programmes, the government endorsed its National Social Protection Policy (NSPP) in 2014 and launched the National Social Protection Strategy (NSPS) in 2016. However, Hirvonen et al. [36] found limited linkages between these large-scale social protection programmes. The Integrated Safety Net Programme (ISNP) is designed to address this gap. This pilot project, with the technical support from the United Nations Children’s Fund (UNICEF) Ethiopia country office (ECO), aimed to reinforce the linkages between the PSNP and CBHI and leverage the impacts of PSNP to reduce poverty and improve the multidimensional well-being of PSNP-participating households. The efforts to integrate the social protection programmes also assume that increasing coverage of CBHI among PSNP-participating households will increase their health services utilisation and improve health outcomes. The ISNP was launched in 2019 [37].

Study setting

This study used cross-sectional data from the ISNP impact evaluation baseline survey in Amhara region, Ethiopia [38]. The ISNP evaluation is being carried out in 4 rural districts of Amhara region, namely, Libo Kemkem and Dewa Chefa as treatment districts and Ebinat and Artuma Fursi as comparison districts. Households in treatment districts receive additional ('plus') interventions on top of PSNP cash transfers including facilitation to CBHI enrolment, nutrition information through behavioural change communication (BCC) sessions, and case management through social workers and community care coalitions, while those in comparison districts do not get these plus components. While the treatment districts were selected purposively based on the availabilities of CBHI in the district, UNICEF ECO nutrition interventions and linkages to other UNICEF interventions, districts’ accessibility and practicality for UNICEF ECO support, comparisons districts were selected based on their similarities with treatment districts in socio-demographic, health service supply, programme organization, culture/ ethnicity, and ecological characteristics. Thus, the treatment and their respective comparison districts are geographically close and similar culturally and economically. The trial is registered on November 5, 2018, in the Pan African Clinical Trial Registry with trial registration ID—PACTR201902876946874. More information about the overall ISNP evaluation and interventions can be found in the online Additional file 1: Appendix 1. However, in the current study, we do not examine programme impacts of the INSP, but rather we use the baseline data to examine the effects of CBHI on health services utilisation.

Study design and participants

The ISNP evaluation employed a mixed-method study approach. However, this study used the quantitative data generated through household, community, and health facility surveys. Households eligible for the survey include all PSNP-participating rural households in the four districts. The sample size was determined using power calculation based on estimates of baseline means and the expected impacts of indicators. The indicators included individuals’ health services utilisations during the last month, visiting or consultation of a health service provider in the last 4 months, enrolment in CBHI, child nutrition and preventive health indicators, and mothers receiving antenatal care from a skilled provider during the last pregnancy. For each indicator, the sample size was calculated to detect a desired change of delta (δ) with minimum power of 80% under the assumption of simple random sampling and zero non-response rate. Accordingly, a target sample size of 5,400 households was decided, of which 5,398 were interviewed.

Data collection

The household questionnaire was designed to capture a broad range of information both at the individual and household levels such as demographics, educational attainment, health status and utilisation, PSNP participation, asset ownership, food security, and dwelling characteristics. Questionnaire items were drawn from previously implemented questionnaires and validated measures, including from the Transfer Project and other surveys implemented in Ethiopia and Eastern Africa (see Online Additional file 1: Appendix 6 for details about the variables) [39]. Some sections draw directly from other standard surveys such as the Multiple Indicator Cluster Survey (MICS), and instruments were tested in Ethiopia during piloting of the questionnaire at data collection trainings and then adapted as needed. A proxy female respondent from each household (priority was given to the main woman of the household or caregivers of children) was interviewed. Enumerators used electronic tablets installed with programmed survey (Survey Solutions) tools to input data and interviews were administered face-to-face in local languages (Amharic in Libo Kemkem and Ebinat districts and Afan Oromo in Dewa Chefa and Artuma Fursi districts). Baseline data collection was conducted between December 2018 and February 2019.

For the community surveys (one per kebele (village) – the lowest administrative level in Ethiopia), community leaders and knowledgeable individuals in each sector were interviewed. Health care workers or facility administrators were interviewed for the health facility surveys on the facility characteristics/ infrastructure, personnel, and supplies. Data were also collected from official logbooks in all government health care facilities in study communities.

Measurements

The CBHI enrolment is the treatment variable. It is defined as holding a currently valid or renewed CBHI card, which is determined at the household level (i.e., once a household enrols all members of that household are automatically enrolled, except for additional fees required for adult children). Households were coded 1 if they were currently enrolled in CBHI and 0 if they were not enrolled.

Outcomes of interest included primary preventive health services (child received all vaccinations (BCG, three doses of Polio vaccine, three doses of Pentavalent vaccine, and Measles) and mother received at least four ANC services and PNC visits in the past 12 months for children, children sleeping under long-lasting ITBNs, delivery at a health facility, births attended by skilled professionals, and children given deworming in the past 6 months). Child curative services considered in the study included health facility visits to seek treatment for child illness last month and any health facility visits for children in the last 12 months). We also considered outpatient services by members including any facility visits for curative services for illness in the past one month and if they also sought curative cares from health professionals. Data were collected on members’ facility visits to seek medical assistance for an illness and check-ups from health facilities in the past 12 months, and, if yes, the number of visits to a health facility for illness by all members in the household in the past 12 months. We excluded behaviours related to seeking medications over the counter and alternative care services from our analyses. Since CBHI enrolment is at the household level, we aggregated all outcomes at the household level. Accordingly, for outcomes observed at the individual level (adult members and under-five children), we consider the household as a service user if at least one member utilized the service.

Covariate selection for the propensity score matching analysis was guided by the principles that: 1) omission of important variables could seriously increase bias in estimates [40, 41], 2) only those variables that simultaneously influence participation decision and the outcome should be included [42], and 3) selected covariates should not be affected by participation decision, that is variables should either be time-invariant or measured before participation took place [42]. Accordingly, we used previous studies, economic theory, and study context to select covariates. Household head-related factors included sex, age, current marital status, disability, and literacy status. The household-level factors were wealth status, number of household members by age, access to improved water during winter (the dry season in Ethiopia), whether the household worried about food in the last 4 weeks, number of food insecurity months in the last 12 months, having outstanding debt, drought in the last 12 months, total annual income received from PSNP, number of ill household members in the last month, and indices on perceptions and understandings about CBHI generated using Factor Analysis (see Online Additional file 1: Appendix 6 for details). The study also controlled for community and health facility-related characteristics including distance from the village to the nearest health centre (kilometres), distance from the village to the nearest health facility with a doctor (kilometres), whether the nearest health facility admits people covered with CBHI, number of years the village has been in PSNP, and village distance from district capital (kilometres). Estimations also included district fixed effects.

Ethical considerations

The study was approved by the Amhara Public Health Institute (APHI) Research Ethics Review Committee (Reference Number HRTT—03/192/2018). Enumerators received instruction during data collection training about ethical data collection, informed consent, and referral services and procedures. Informed consent was obtained from all survey participants to use their anonymised information.

This study does not involve patients. An inception workshop was conducted to select treatment districts using several social and economic indicators. Findings from the baseline data collection were disseminated in a consultative workshop conducted in August 2019 with the Amhara region and district administrators, Amhara Public Health Institute (APHI) experts, UNICEF Ethiopia staff, and stakeholders from district Bureau of Health (BoH), Bureau of Labour and Social Affairs (BoLSA) and Bureau of Women and Children Affairs (BoWCA), and district CBHI and PSNP coordinators.

Data processing and analysis

We first describe the characteristics of the target population by applying the sampling weights in the descriptive analyses. Individual-level data were aggregated at the household level. All data processing and analyses were conducted using STATA software version 15.1.

To examine the impacts of CBHI enrolment on utilisation of healthcare services, we used propensity score matching (PSM) [43, 44], to account for selection into CBHI based on observable covariates, and then estimate the effect of enrolment on outpatient, maternal, and child healthcare services utilisation.

PSM allows us to construct a comparison group that comprises PSNP participating households but did not join the CBHI programme (non-treated) but with the same probability of participating in CBHI as their enrolled counterparts (treated) based on observable and controlled characteristics. The attainment of PSM’s fundamental assumptions (conditional independence assumption (CIA) or unconfoundedness, and common support) are key to reducing bias arising from observed differences between groups. Accordingly, for CIA to be met, the factors associated with CBHI enrolment among PSNP households and those factors affecting outcomes related to CBHI must be observed, i.e., the selection is solely based on observable characteristics. Further, the common support or overlap assumption also requires that households with the same characteristics (X) have a positive probability of being in both arms and have the same probability of participation between 0 and 1, such that (0 < P(T = 1|X) < 1) [42, 45].

We first calculate the average treatment effect (ATE), at the population level constituting differences between the treated and non-treated groups as E[YiT- Yi C] [46]. Next, following Smith and Todd [44] and Caliendo and Kopeinig [42] and given the above assumptions, we estimate the average treatment effect on the treated (ATT) as follows.

$${\mathrm{ATT}}_{\mathrm{PSM}} = {E}_{P(\mathrm{X}) |\mathrm{T}=1}\{E[{\mathrm{Y}}^{\mathrm{T}}|\mathrm{T }= 1, P(X)]-E[{\mathrm{Y}}^{\mathrm{C}}|\mathrm{T }= 0, P(\mathrm{X})]\}$$

where ATT is the average treatment effect on the treated for outcome Y (mean difference in outcomes between groups over the common support weighted by propensity scores), and T and C denote CBHI enrolled and non-enrolled households. P(X) is the probability of CBHI enrolment given the set of observable covariates X. Both ATE and ATT are calculated using Stata’s Treatment Effects command.

In PSM analyses, we employed a nearest neighbour algorithm with replacement (described in more detail in Additional file 1: Appendix 2). We further performed a sensitivity analysis to examine the robustness of estimates to hidden bias, described in more detail in Additional file 1: Appendix 2.

Results

Characteristics of sample households by CBHI enrolment status

Table 1 presents weighted descriptive statistics of covariates by CBHI enrolment status. Households enrolled with CBHI constituted 64.5% of our sample (n = 5,398). The average composition of households was as follows: 2.24 adults (aged 15–64 years), 1.89 children (aged 0–14 years), and 0.331 elderly aged 65 and above (≥ 65 years). The data also show that 11.9% of household heads were literate, 53.6% were currently married and 44% were females with an average age of about 53 years. We also find that 53.3% of households get water from improved sources during winter, one in every five never worried about food in the last 4 weeks but households reported to have experienced about 3 months of food insecurity in the past 12 months. Further, 17.7% and 17.5% of households have outstanding debts and experienced drought/ shortage of rainfall in the last 12 months, respectively. Households have generally high expectations about the role of CBHI in making healthcare more affordable and seeking the services easier. In addition, while households have appropriate information on how CBHI works on some key aspects, we find that only one-third and close to two-thirds know that CBHI enrolled households need to pay some costs in advance and CBHI covers medical costs related to pregnancy, respectively. Highlighting community characteristics, the study finds that the study communities are located on average 8 kms far from the nearest health centre, 24 kms from the nearest health facility with a doctor, and almost half of all the villages are located between 21 and 40 kms far from the district capital.

Table 1 Sample characteristics for the pooled and insurance-disaggregated households

Bivariate tests show that insured and non-insured households were not statistically different concerning their food insecurity experience in the last 4 weeks, the number of food insecurity months in the last 12 months, knowledge if the premium is not repaid if no medical services were sought, distance to the nearest health centre and the nearest health facility with a doctor, whether the nearest health facility admits people covered with CBHI, and the number of years the villages have been in PSNP.

Insured and Non-Insured groups were significantly different concerning household size by age, head characteristics (literacy, disability, current marital statuses, sex, and age), household profiles (sources of water during winter, having outstanding loans, shock in the past 12 months, income from PSNP, number of ill members in the past month and perceptions about CBHI benefits. Households in both arms also differ in their understandings of whether CBHI covers medical costs related to pregnancy, CBHI fully covers certain drugs or surgery, enrolled members should not pay part of the cost, if services are covered by CBHI, and if insured households need to pay some costs in advance.

Description of outcome variables

We present descriptive statistics of outcome variables by insurance status in Table 2. Members in insured households were more likely to use outpatient healthcare services (sought care for illness last month, members sought care from health professionals, health facility visits for any medical assistance in the past 12 months, and the total number of health facility visits by all members in the past 12 months) compared to those in non-insured households.

Table 2 Health services utilisation characteristics by CBHI enrolment

On the other hand, we find no significant differences between the two groups related to institutional delivery, if the birth was assisted by a skilled provider, and whether mother got four plus ANC from a skilled provider during the current pregnancy. However, we find that mothers of under-five children in insured households were more likely to get ANC from a skilled provider. Further, related to child(ren), those from CBHI enrolled households were more likely to be taken to a health facility for PNC in the past 12 months, have received curative care for illness last month, have received deworming in the last 6 months, slept under insecticide-treated bed net last night, have received all vaccinations, and taken to a health facility in the last 12 months for any health care services.

Impacts of CBHI enrolment on healthcare services utilisation

We presented the detailed information on the matching algorithm utilized using online Additional file 1: Appendix 2, and predictors of CBHI enrolment using Additional file 1: Appendix 3. Information on the quality of propensity score matching including propensity score and covariate balancing are presented in online Additional file 1: Appendix 4, and sensitivity analysis and robustness check in online Additional file 1: Appendix 5.

Table 3 presents the results on the treatment effects. The average treatment effects (ATE) show that CBHI enrolment was associated with an increase in the probability of household members visiting health facilities for curative care in the last month by 8.2 percentage points. Enrolment in CBHI also leads to an increase in the probability of seeking care from a health professional in the last month by 8.4 percentage points. Looking at outpatient health services utilisation in the past 12 months, we observe that the probability that members visited a health facility to seek any medical assistance for illness or check-ups in the past 12 months increases by 13.9 percentage points and the number of health facility visits per household increases by 0.84 as a result of CBHI enrolment. There were no impacts of CBHI enrolment on antenatal care, postnatal care, skilled delivery, and child preventative or curative care services.

Table 3 Treatment effects of CBHI enrolment on health service utilisation

The average treatment effects on the treated (ATT) estimates further strengthen the findings from ATE estimates, indicating CBHI has resulted in more utilisation of outpatient healthcare services among insured households. As expected, ATT estimates are larger than ATE estimates, except for the health facility visits in the past 12 months where the ATT is slightly smaller than the ATE. Among insured households, CBHI enrolment increased the likelihood of seeking healthcare services for illness in the previous month by 9.1 percentage points, seeking healthcare from professional care provider by 9.1 percentage points, and the probability of members visiting health facilities over the past 12 months by 13.8 percentage points. Furthermore, regarding the intensity of healthcare visits, we find that CBHI enrolment among insured households increased the mean number of health facility visits per household by 0.93. Also, we find no significant impacts of CBHI participation on ANC, institutional delivery, PNC, and child preventive and curative health services utilisation among treated households (Table 3).

In our sensitivity analyses (Additional file 1: Appendix 5), we do not find that CBHI enrolment is determined by unobservable characteristics. Moreover, in a robustness check of our PSM findings using a more restricted calliper width and increasing the number of untreated subjects to be matched, we show that the findings described above are robust (Additional file 1: Appendix 5).

Discussion

Statement of principal findings

Household enrolment in CBHI was 64.5%. The study finds that enrolment in CBHI increases the likelihoods of visiting health facilities for curative care in the past one month by 8.2 percentage points, seeking care from a health professional by 8.4 percentage points, visiting a health facility to seek any medical assistance for illness and check-ups in the past 12 months by 13.9 percentage points, and the number of health facility visits per household by 0.84. However, we didn’t find statistically significant impacts of CBHI enrolment on antenatal care, skilled delivery, postnatal care, and child preventative curative services.

Strengths and weaknesses of the study

The study adds insights into the effects of CBHI enrolment on health services utilisation patterns among extremely poor and most vulnerable households targeted by Ethiopia’s cash transfer programme (the PSNP). In addition, the study also provides early and cross-sectional evidence on the potential effects of integrating the two largest social protection programmes on health service utilisations among extremely poor households.

The study has some weaknesses worth mentioning. We used cross-sectional data generated from one region only in the country (out of ten regions and two city administrations) and exclusively PSNP-participating households. Thus, findings cannot be generalized to the whole country which also includes non-PSNP and well-to-do households. In addition, estimates may be biased by self-selection into voluntary CBHI enrolment based on unobservable characteristics and from omitted variables. We also lack information on the temporal ordering of CBHI enrolment and the outcome variables. This could have been addressed well using longitudinal data. Further, the study assumes that CBHI benefit packages and refunding requirements and procedures, which may influence enrolment decisions and service utilisations, are similar across districts.

Comparison with other studies and possible explanations

Our findings that CBHI enrolment led to greater outpatient services use is supported by previous studies in Ethiopia on the general population, including Shigute et al. [30], Mebratie et al. [24], Mebratie et al. [25], and Tilahun et al. [29]. Shigute et al. [30] analysed the effects of CBHI alone and combined with PSNP on the use of modern healthcare utilisation for outpatient care and modern health facility visits in Ethiopia using three rounds of individual-level panel data. In line with our study findings, they also reported that CBHI nudges the probability of using modern healthcare services (visiting a modern health care facility for outpatient care services) by 2.3 percentage points and the number of visits to modern health facilities by 0.07 among adult members in the pooled sample. For the PSNP-only sub-sample, they find that CBHI increases utilisation of modern outpatient healthcare services by 4 percentage points. Although this is larger compared to the pooled sample among adult members, both estimates are by far smaller than the impacts in our study. In contrast to our study, they find no significant impact of CBHI enrolment on the number of modern health facility visits among the PSNP-participating sub-sample. Another study by Mebratie et al. [25] also showed that enrolment in pilot CBHI scheme increased utilisation of outpatient healthcare services at public health facilities by 30–41 percentage points and increases the number of public health facility visits by 0.05–0.07 in the past 2 months.

Some important differences between our and the two studies may have resulted in the variations in the estimated impacts. First, the two existing studies used a more general population (among which a sub-sample of households were participating in PSNP) while our sample is comprised entirely from PSNP-participating households. Second, while data used for both previous studies came from the CBHI pilot phase, our data came from a recent large-scale baseline survey conducted in rural Amhara, after CBHI had been scaled up nationally. Thus, our findings have greater generalizability concerning CBHI impacts among vulnerable groups targeted by the PSNP. Third, related to the recall periods, we used the previous one month to ask about the use of outpatient services by any of the household members for illness, but the 12 months period to ask the number of total health facility visits by all household members for outpatient care. They used the past two months for a recall which may fail to capture some of the health facility visits made in the year compared to the 12-month period. But, their approach is accompanied by less recall biases. However, both studies used panel data while our study relied on cross-sectional data. Tilahun et al. [29], using cross-sectional data from one district in Amhara region, also find that membership in mutual health insurance increases the likelihood of using healthcare by 25.2 percentage points. However, it is not clear if the study households were also participating in PSNP.

Our null findings related to maternal and child healthcare services utilisation and health insurance enrolment are consistent with other studies from different settings, including having received four or more ANC visits in Rwanda [27]. They also find no impact of health insurance on receiving at least four ANC services in Rwanda. On the other hand, Fernandes et al. [47] find that insured women were less likely to use skilled birth attendance during delivery in Jordan. However, our results contrast with maternal and child health-related findings reported elsewhere. Health insurance increases the likelihood of receiving at least four ANC visits in Jordan [47], Ghana and Indonesia [27], increased the probability of health facility-based delivery in Ghana, Rwanda and Indonesia [27], Tanzania [48], and Egypt [49]. In Ethiopia, Atnafu and Gebremedhin [31] find that the CBHI programme has a positive effect on the use of curative healthcare services for children in households with at least one child experienced illness in the past 4 weeks. We posit that the non-significant effects of CBHI enrolment on the maternal and child healthcare services could be due to the free provision of such services in the country at public health facilities. These facilities are also the sole health service providers for CBHI insured households. This means that both insured and non-insured households have equal access to all maternal and child healthcare services at public health facilities. In addition to the free availability of several maternal and child healthcare services at the health posts, information and sensitization efforts such as the behavioural change communications (BCCs) sessions targeting all PSNP households may have resulted in better awareness and knowledge about the importance and availability of maternal and child preventive and curative services in nearby health posts among insured and non-insured households alike. Health posts are the first point of contact public health facilities for rural households in rural villages.

Possible mechanisms

The study also provides explanations of two potential causal pathways between enrolment in CBHI and outpatient health services utilisation. With no appropriate financial mechanisms, healthcare seeking in poorly functioning health systems is associated with a risk of catastrophic expenditures [50]. Borde et al. [51] find that in Ethiopia the average direct out-of-pocket healthcare expenditures were USD 32 per month, the average indirect out-of-pocket healthcare expenditures were USD 15 per month and the average catastrophic healthcare expenditure at 10% of threshold was 40%. Accordingly, consistent with past related studies [52,53,54,55], our first hypothesised pathway is that CBHI may have reduced the high out-of-pocket health spending, thereby encouraging utilisation of healthcare services among the PSNP-participating households. In this regard, an evaluation of the pilot CBHI in Ethiopia also finds that 37% of CBHI members joined the programme to primarily reduce out-of-pocket expenditure when seeking health care, and 35% joined CBHI to seek healthcare more frequently [56].

We also hypothesised that CBHI’s role to empower women could be another pathway linking CBHI enrolment and enhanced utilisation of outpatient healthcare services. In Ethiopia, men are considered to be the primary breadwinners and have the decision-making power in all household financial matters including spending on healthcare. This means that in uninsured households and whenever service seekers have to pay service fees upfront, some members, including women, may not be able to get or delay getting the treatment due to a lack of financial autonomy. In this regard, earlier evidence showed that CBHI empowered women – enabled them to seek essential health care whenever needed without requesting money and permission from male heads of household [57]. In support of this evidence, a recent study by Messner et al. [58] also finds that women in CBHI insured households are more likely to seek treatment for themselves or their children without financial support from a male head. For example, one of the study respondents in Messner et al. [58] study stated that:

“Unfortunately majority of us, women, don’t have income of our own. We rely on our husband’s money in order to pay for the medical bill. But if we have this card, we don’t have to ask our husbands for money whenever we are sick. In addition, our husbands may not be at home when we get sick. Hence, having this card will allow us to go to the health centre without waiting on our husbands.” — Married woman, age 24–45, Tigray.

While there could be more mechanisms, more rigorous studies are needed to fully understand the causal mechanisms between CBHI enrolment and improved outpatient health service utilisations.

Policy implications

The government of Ethiopia implemented several policy measures to enhance households' protection against financial risks in accessing essential health services and to improve health service utilisation. Community-based health insurance is one of these measures. The current health sector transformation plan aims to accelerate the progress towards full coverage of essential health services and protecting people from financial hardship, including those in currently underserved populations [59]. Achieving UHC entails the achievement of all components of UHC (availability of all essential health services at each service delivery with an acceptable level of quality, effective coverage of essential health services, and ensuring financial risk protection) to all population subgroups. Our findings suggest that enrolment in CBHI is one of the promising strategies towards UHC and plays a vital role to help vulnerable and PSNP-participating households to access some of the available essential outpatient services. However, further evidence is still needed in other dimensions of UHC such as on the availability of all essential health services at all public health facilities, mainly at primary health facilities, quality of care, and individual level coverage. Moreover, since enrolment into Ethiopia’s CBHI is voluntary, the poorest non-PSNP households may still be excluded from the programme. A recent study in one of the study districts also finds that extremely poor and most vulnerable households to extreme poverty who are not receiving conditional cash transfers are less likely to join CBHI [60]. To place CBHI better as a tool towards UHC, the government may implement more measures such as universal eligibility for insurance with a substantial premium subsidy and the universal individual-level exemption for some vulnerable groups such as pregnant women from paying premiums [61].

Our study also provides some evidence on the role of CBHI in ensuring equity in healthcare in the informal sector. Related to this, although equity should be looked at both at the CBHI enrolment and service utilisation stages [62], improved utilisation of outpatient healthcare services by the ensured vulnerable households suggests that CBHI also contributes partly towards equity in healthcare among some of the most vulnerable groups in the country. Past studies suggest that enrolment among the poor and marginalized households can be also enhanced through improving roads and public transport systems [62] and premium subsidy and fee waiver [63, 64].

Given that the per capita health facility visits in Ethiopia (0.9 visits annually in 2019) has so far been far below the World Health Organization (WHO) recommended level—2.5 visits per capita per year [65], the significant effect of CBHI enrolment on health facility visits indicates the programme has a promising potential for Ethiopia to reach the WHO recommended level of per capita health facility visit. More importantly, the significant impact of CBHI enrolment on health facility visits among the most vulnerable households underscores the critical role of CBHI to ensure health equity in the country and to leave no one behind.

Future research areas

Existing literature shows that health insurance programmes, including CBHI, are prone to moral hazard problems which occur when enrolment in health insurance is followed by increases in healthcare consumption and a reduction in preventive measures [66,67,68,69]. However, as this is not always the case due to preferred and needed healthcares [70], future studies may investigate whether this problem exists among insured or not in Ethiopia’s CBHI programme. Past studies in other related settings argued that due to low availability and utilisations of healthcare services and high unmet demand, improvements in health services utilisations among such populations may not be due to moral hazard, but the impact of health insurance [21]. Future studies may also explore if an adverse selection problem exists in the CBHI enrolment which in turn could affect the health service utilisation decisions.

Access to information about CBHI benefit packages (entitlements) and available health services at different health facilities could also influence CBHI enrolment decisions as well as health services utilisations. Future studies may investigate how exposure to various information and awareness sessions such as the behavioural change communications (BCCs) and information campaigns affect health services utilisation by PSNP-participating households. Other potential areas of investigation include how perceived or actual institutional arrangements such as refunding and referral systems between health facilities affect health service utilisations. Evidence on the individual level health service utilisation among insured households using CBHI card can also give highlights about the intra-household gender and power dynamics in using specific health services using CBHI card. Finally, future studies may also explore the pro-poorness of the CBHI among PSNP-participating households in terms of their health outcomes.

Conclusions

This study evaluated the impacts of enrolment in CBHI on the utilisation of outpatient, maternal, and child preventive and curative healthcare services among the most vulnerable rural households in Ethiopia. Approximately two-thirds of the sample households are insured in CBHI. We find that enrolment in CBHI was positively associated with using more outpatient healthcare services including visiting health facilities for curative care in the past one month, seeking care from a health professional, visiting a health facility to seek any medical assistance for illness and check-ups in the past 12 months, and the number of health facility visits per household. However, the study finds no significant impacts of membership in CBHI on maternal and child healthcare services. The study provides insights on the role of CBHI among safety net programme beneficiaries to achieve UHC and health equity and increase the per capital annual health facility visits. The evidence can contribute to policy making aimed to integrate the two largest social protection programmes (CBHI and PSNP) in the country and mitigate the adverse impacts of multidimensional poverty.

Availability of data and materials

The datasets generated and/or analysed during the current study are not publicly available since the data is part of an ongoing study which is not yet completed. It is expected to be made available no sooner than one year after the final impact evaluation report is published, pending UNICEF and Government approval and can be available from the corresponding author on reasonable request.

Abbreviations

APHI:

Amhara Public Health Institute

ANC:

Antenatal Care

ARI:

Acute Respiratory Illness

ATE:

Average Treatment Effect

ATT:

Average Treatment Effect on the Treated

BCC:

Behavioural Change Communications

BoH:

Bureau of Health

BoLSA:

Bureau of Labour and Social Affairs

BoWCA:

Bureau of Women and Children Affairs

CBHI:

Community-Based Health Insurance

CIA:

Conditional Independence Assumption

DHS:

Demographic and Health Survey

DTP:

Diphtheria, Tetanus and Pertussis

ECO:

Ethiopia Country Office

ETB:

Ethiopian Birr

HSTP:

Health Sector Transformation Plan

HSDP:

Health Sector Development Programme

ISNP:

Integrated Safety Net Programme

ITBN:

Insecticide-Treated Bednet

LMIC:

Lower- and Middle-Income Countries

MICS:

Multiple Indicator Cluster Survey

MoARD:

Ministry of Agriculture and Rural Development

MoLSA:

Ministry of Labour and Social Affairs

NSPP:

National Social Protection Policy

NSPS:

National Social Protection Strategy

ORT:

Oral Rehydration Therapy

PDS:

Permanent Direct Support

PHC:

Primary Health Care

PNC:

Post-natal Care

PSM:

Propensity Score Matching

PSNP:

Productive Safety Net Programme

PW:

Public Works

SDGs:

Sustainable Development Goals

SPAP:

Social Protection Action Plan

UHC:

Universal Health Coverage

UN:

United Nations

UNICEF:

United Nations Children’s Fund

USD:

United States Dollars

WHO:

World Health Organization

References

  1. United Nations. The sustainable development goals report 2016. New York: United Nations, Department of Economic and Social Affairs; 2016.

    Google Scholar 

  2. WHO, UNICEF. Accountability for maternal, newborn & child survival: the 2013 update. Geneva: World Health Organization and UNICEF; 2013.

  3. World Health Organization, World Bank. Tracking universal health coverage: first global monitoring report. Geneva: World Health Organization; 2015.

    Google Scholar 

  4. UNICEF. Pneumonia: UNICEF global databases, 2021. 2021. Available from: https://data.unicef.org/topic/child-health/pneumonia/.

    Google Scholar 

  5. Lavers T. Towards universal health coverage in Ethiopia’s ‘developmental state’? The political drivers of health insurance. Soc Sci Med. 2019;228:60–7.

    Article  Google Scholar 

  6. Tao W, Zhi, Dang H, Li P, Chuong L, Yue D, et al. Towards universal health coverage: achievements and challenges of 10 years of healthcare reform in China. BMJ Glob Health. 2020;5(3):e002087.

    Article  Google Scholar 

  7. Wagstaff A, Neelsen S. A comprehensive assessment of universal health coverage in 111 countries: a retrospective observational study. Lancet Glob Health. 2020;8(1):e39-49.

    Article  Google Scholar 

  8. Donfouet HPP, Mahieu PA. Community-based health insurance and social capital: a review. Health Econ Rev. 2012;2(1):5.

    Article  Google Scholar 

  9. Thomas TK. Role of health insurance in enabling universal health coverage in India: a critical review. Health Serv Manage Res. 2016;29(4):99–106.

    Article  Google Scholar 

  10. MoH. Health Sector Development Programme IV (HSDP IV): 2010/11–2014/15. Addis Ababa: Federal Democratic Republic of Ethiopia Minstry of Health; 2010.

  11. MoH. Health Sector Transformation Plan (HSTP): 2015/16 - 2019/20 (2008–2012 EFY). Addis Ababa: Ethiopia Federal Ministry of Health; 2015.

  12. MoH. National Rproductive Health Strategy, 2016–2020. Addis Ababa: Federal Democratic Republic of Ethiopia, Ministry of Health; 2016.

    Google Scholar 

  13. MoH. Reproductive, maternal, neonatal and child health program overview and pharmaceuticals management training for pharmacy professionals: participant manual. Addis Ababa: Federal Democratic Republic of Ethiopia, Minstry of Health; 2018.

    Google Scholar 

  14. Alebachew A, Yusuf Y, Mann C, Berman P, FMOH. Ethiopia’s progress in health financing and the contribution of the 1998 health care and financing strategy in Ethiopia. Resource tracking and management project. Boston and Addis Ababa: Harvard T.H. Chan School of Public Health; Breakthrough International Consultancy, PLC; and Ethiopian Federal Ministry of Health; 2015.

    Google Scholar 

  15. MoH. National Human Resources for Health Strategic Plan for Ethiopia 2016–2025. Addis Ababa: Federal Democratic Republic of Ethiopia, Ministry of Health; 2016.

    Google Scholar 

  16. Endale K, Pick A, Woldehanna T. Financing social protection in Ethiopia: a long-term perspective. OECD Development Policy Papers 15. OECD Publishing; 2019.

  17. Central Statistical Agency (CSA) [Ethiopia], ICF. Ethiopia demographic and Health Survey 2016. Addis Ababa and Rockville: CSA and ICF; 2016.

    Google Scholar 

  18. Ethiopian Public Health Institute (EPHI) [Ethiopia] and ICF. Ethiopia Mini Demographic and Health Survey 2019: final report. Rockville: EPHI and ICF; 2021.

    Google Scholar 

  19. MoH. Essential health services package of Ethiopia. Addis Ababa: Federal Democratic Republic of Ethiopia, Ministry of Health; 2019.

    Google Scholar 

  20. Guindon GE. The impact of health insurance on health services utilization and health outcomes in Vietnam. HEPL. 2014;9(4):359–82.

    Article  Google Scholar 

  21. Nshakira-Rukundo E, Mussa EC, Nshakira N, Gerber N, von Braun J. Impact of community-based health insurance on utilisation of preventive health services in rural Uganda: a propensity score matching approach. Int J Health Econ Manag. 2021;21(2):203–27.

    Article  Google Scholar 

  22. Alkenbrack S, Lindelow M. The impact of community-based health insurance on utilization and out-of-pocket expenditures in Lao People’s Democratic Republic: impact evaluation of health insurance. Health Econ. 2015;24(4):379–99.

    Article  Google Scholar 

  23. Atnafu DD, Tilahun H, Alemu YM. Community-based health insurance and healthcare service utilisation, North-West, Ethiopia: a comparative, cross-sectional study. BMJ Open. 2018;8(8):e019613.

    Article  Google Scholar 

  24. Mebratie AD, Sparrow R, Yilma Z, Abebaw D, Alemu G, Bedi A. Impact of Ethiopian pilot community-based health insurance scheme on health-care utilisation: a household panel data analysis. Lancet. 2013;381:S92.

    Article  Google Scholar 

  25. Mebratie AD, Sparrow R, Yilma Z, Abebaw D, Alemu G, Bedi AS. The impact of Ethiopia’s pilot community based health insurance scheme on healthcare utilization and cost of care. Soc Sci Med. 2019;220:112–9.

    Article  Google Scholar 

  26. Thuong NTT, Huy TQ, Tai DA, Kien TN. Impact of health insurance on health care utilisation and out-of-pocket health expenditure in Vietnam. Biomed Res Int. 2020;26(2020):1–16.

    Article  Google Scholar 

  27. Wang W, Temsah G, Mallick L. The impact of health insurance on maternal health care utilization: evidence from Ghana, Indonesia and Rwanda. Health Policy Plan. 2017;32(3):366–75.

    Google Scholar 

  28. Demissie B, Negeri K. Effect of community-based health insurance on utilization of outpatient health care services in Southern Ethiopia: a comparative cross-sectional study. RMHP. 2020;13:141–53.

    Article  Google Scholar 

  29. Tilahun H, Atnafu DD, Asrade G, Minyihun A, Alemu YM. Factors for healthcare utilization and effect of mutual health insurance on healthcare utilization in rural communities of South Achefer Woreda, North West, Ethiopia. Health Econ Rev. 2018;8(1):15.

    Article  Google Scholar 

  30. Shigute Z, Strupat C, Burchi F, Alemud G, Bedi AS. Linking social protection schemes: the joint effects of a public works and a health insurance program in Ethiopia. 2019.

    Google Scholar 

  31. Atnafu A, Gebremedhin T. Community-based health insurance enrollment and child health service utilization in Northwest Ethiopia: a cross-sectional case comparison study. CEOR. 2020;12:435–44.

    Article  Google Scholar 

  32. Ethiopian Health Insurance Agency. Evaluation of community-based health insurance pilot schemes in Ethiopia: final report. Addis Ababa: Federal Democratic Republic of Ethiopia, Ethiopian Health Insurance Agency; 2015.

    Google Scholar 

  33. Ethiopian Health Insurance Agency. CBHI Members’ Regi stration and Contribution, 2011 2020 GC. Addis Ababa: Ethiopian Health Insurance Agency; 2020.

    Google Scholar 

  34. Yilma Z, Mebratie AD, Sparrow R, Dekker M, Alemu G, Bedi AS. Health risk and insurance: impact of Ethiopia’s community based health insurance on household economicwelfare. World Bank Economic Rev. 2015;29:S164–73.

    Article  Google Scholar 

  35. Hoddinott J, Seyoum Taffesse A. Social protection in Ethiopia. In: Cheru F, Cramer C, Oqubay A, editors. The Oxford Handbook of the Ethiopian Economy. Oxford University Press; 2019. p. 411–27. Available from: http://oxfordhandbooks.com/view/10.1093/oxfordhb/9780198814986.001.0001/oxfordhb-9780198814986-e-22. Cited 2020 Jul 23.

  36. Hirvonen K, Bossuyt A, Pigois R. Evidence from the productive safety net programme in Ethiopia: complementarities between social protection and health policies. Dev Policy Rev. 2021;39(4):532–47.

    Article  Google Scholar 

  37. Mussa EC, Otchere F, Vinci V, Reshad A, Palermo T. Linking poverty-targeted social protection and community based health insurance in Ethiopia: enrolment, linkages, and gaps. Soc Sci Med. 2021;286:114312.

    Article  Google Scholar 

  38. ISNP Evaluation Team. Impact evaluation of the integrated safety net programme in the Amhara Region of Ethiopia. final baseline report. Florence: UNICEF Office of Research – Innocenti; 2020.

  39. The Transfer Project. Transfer project instruments. Chapel Hill: Carolina Population Center; 2022. Available from: https://transfer.cpc.unc.edu/instruments/.

    Google Scholar 

  40. Dehejia RH, Wahba S. Causal effects in nonexperimental studies: reevaluating the evaluation of training programs. J Am Stat Assoc. 1999;94(448):1053–62.

    Article  Google Scholar 

  41. Heckman JJ, Ichimura H, Todd PE. Matching as an econometric evaluation estimator: evidence from evaluating a job training programme. Rev Econ Stud. 1997;64(4):605–54.

    Article  Google Scholar 

  42. Caliendo M, Kopeinig S. Some practical guidance for the implementation of propensity score matching. J Economic Surveys. 2008;22(1):31–72.

    Article  Google Scholar 

  43. Abadie A, Imbens GW. Matching on the estimated propensity score. Econometrica. 2016;84(2):781–807.

    Article  Google Scholar 

  44. Smith J, Todd P. Does matching overcome LaLonde’s critique of nonexperimental estimators? J Econom. 2005;125(1–2):305–53.

    Article  Google Scholar 

  45. Heinrich C, Maffioli A, Vazquez G. A primer for applying propensity-score matching. Inter-American Development Bank; 2010. Available from: https://publications.iadb.org/handle/11319/1681?scope=123456789/11&thumbnail=false&rpp=5&page=1&group_by=none&etal=0&filtertype_0=author&filter_0=Heinrich%252C+Carolyn&filter_relational_operator_0=equals. Cited 2017 Jun 23.

  46. Imbens GW. Nonparametric estimation of average treatment effects under exogeneity: a review. Rev Econ Stat. 2004;86(1):4–29.

    Article  Google Scholar 

  47. Fernandes P, Odusina EK, Ahinkorah BO, Kota K, Yaya S. Health insurance coverage and maternal healthcare services utilization in Jordan: evidence from the 2017–18 Jordan demographic and health survey. Arch Public Health. 2021;79(1):81.

    Article  Google Scholar 

  48. Kibusi SM, Sunguya BF, Kimunai E, Hines CS. Health insurance is important in improving maternal health service utilization in Tanzania—analysis of the 2011/2012 Tanzania HIV/AIDS and malaria indicator survey. BMC Health Serv Res. 2018;18(1):112.

    Article  Google Scholar 

  49. Rashad AS, Sharaf MF, Mansour EI. Does public health insurance increase maternal health care utilization in Egypt? J Int Dev. 2019;31(6):516–20.

    Google Scholar 

  50. Kruk ME, Gage AD, Arsenault C, Jordan K, Leslie HH, Roder-DeWan S, et al. High-quality health systems in the sustainable development goals era: time for a revolution. Lancet Glob Health. 2018;6(11):e1196–252.

    Article  Google Scholar 

  51. Borde MT, Kabthymer RH, Shaka MF, Abate SM. The burden of household out-of-pocket healthcare expenditures in Ethiopia: a systematic review and meta-analysis. Int J Equity Health. 2022;21(1):14.

    Article  Google Scholar 

  52. Wang Y, Jiang Y, Li Y, Wang X, Ma C, Ma S. Health insurance utilization and its impact: observations from the middle-aged and elderly in China. Beck EJ, editor. PLoS ONE. 2013;8(12):e80978.

    Article  Google Scholar 

  53. Woldemichael A, Gurara D, Shimeles A. The impact of community based health insurance schemes on out-of-pocket healthcare spending: evidence from Rwanda. International Monetary Fund; 2019. IMF Working Paper No.: WP/19/38.

  54. Khan JAM, Ahmed S, Sultana M, Sarker AR, Chakrovorty S, Rahman MH, et al. The effect of a community-based health insurance on the out-of-pocket payments for utilizing medically trained providers in Bangladesh. Int Health. 2020;12(4):287–98.

    Article  Google Scholar 

  55. Shimeles A. Community based health insurance schemes in Africa: the case of Rwanda. Tunis: African Development Bank (AfDB); 2010. Working Papers Series: 120.

  56. EHIA. Evaluation of community-based health insurance pilot schemes in Ethiopia: final report. Addis Ababa: Federal Democratic Republic of Ethiopia Ethiopian Health Insurance Agency; 2015.

    Google Scholar 

  57. USAID. How Ethiopia is empowering women through community-based health insurance. 2016.

    Google Scholar 

  58. Messner L, Tadesse HA, Godbole-Chaudhuri P, Smith D, Santillán D. Women’s economic empowerment and community-based health insurance: lessons from Ethiopia 2019. Rockville: EnCompass, LLC.; 2019. p. 5.

    Google Scholar 

  59. MoH. Health Sector Transformation Plan II (HSTP II). 2020/21–2024/25, (2013 EFY - 2017 EFY). Addis Ababa: Federal Democratic Republic of Ethiopia, Minister of Health; 2021.

  60. Mussa EC, Agegnehu D, Nshakira-Rukundo E. Impact of conditional cash transfers on enrolment in community-based health insurance among female-headed households in south Gondar zone, Amhara region, Ethiopia. SSM Population Health. 2022;17:101030.

    Article  Google Scholar 

  61. Watson J, Yazbeck AS, Hartel L. Making health insurance pro-poor: lessons from 20 developing countries. Health Syst Reform. 2021;7(2):e1917092.

    Article  Google Scholar 

  62. Parmar D, De Allegri M, Savadogo G, Sauerborn R. Do community-based health insurance schemes fulfil the promise of equity? A study from Burkina Faso. Health Policy Plan. 2014;29(1):76–84.

    Article  Google Scholar 

  63. Palermo TM, Valli E, Ángeles-Tagliaferro G, de Milliano M, Adamba C, Spadafora TR, et al. Impact evaluation of a social protection programme paired with fee waivers on enrolment in Ghana’s National Health Insurance Scheme. BMJ Open. 2019;9(11):e028726.

    Article  Google Scholar 

  64. Zaidi S, Saligram P, Ahmed S, Sonderp E, Sheikh K. Expanding access to healthcare in South Asia. BMJ. 2017;11:j1645.

    Article  Google Scholar 

  65. MoH. Ethiopia health accounts 2016/17. Addis Ababa: Federal Ministry of Health (MOH); 2019.

    Google Scholar 

  66. Ahuja R, Jütting J. Design of incentives in community based health insurance schemes. Indian council for research on international economic relations. New Delhi; 2003. Working Paper No.: 95.

  67. Sapelli C, Vial B. Self-selection and moral hazard in Chilean health insurance. J Health Econ. 2003;22(3):459–76.

    Article  Google Scholar 

  68. Ayana ID. Investigation of Moral Hazard Deportments in community-based health insurance in Guto Gida District, Western Ethiopia: a qualitative study. CEOR. 2020;12:733–46.

    Article  Google Scholar 

  69. Yilma Z, van Kempen L, de Hoop T. A perverse ‘net’ effect? Health insurance and ex-ante moral hazard in Ghana. Soc Sci Med. 2012;75(1):138–47.

    Article  Google Scholar 

  70. Grignon M. Access and Health Insurance. In: Encyclopedia of Health Economics. Elsevier; 2014. p. 13–8. Available from: https://linkinghub.elsevier.com/retrieve/pii/B9780123756787009238. Cited 2022 May 6.

  71. Liu T, Tsang W, Xie Y, Tian K, Huang F, Chen Y, et al. Preferences for artificial intelligence clinicians before and during the COVID-19 pandemic: discrete choice experiment and propensity score matching study. J Med Internet Res. 2021;23(3):e26997.

    Article  Google Scholar 

  72. Austin PC. Statistical criteria for selecting the optimal number of untreated subjects matched to each treated subject when using many-to-one matching on the propensity score. Am J Epidemiol. 2010;172(9):1092–7.

    Article  Google Scholar 

  73. Austin PC. Balance diagnostics for comparing the distribution of baseline covariates between treatment groups in propensity-score matched samples. Stat Med. 2009;28(25):3083–107.

    Article  Google Scholar 

  74. Austin PC. Optimal caliper widths for propensity-score matching when estimating differences in means and differences in proportions in observational studies. Pharmaceut Statist. 2011;10(2):150–61.

    Article  Google Scholar 

  75. Becker SO, Caliendo M. Sensitivity analysis for average treatment effects. Stand Genomic Sci. 2007;7(1):71–83.

    Google Scholar 

  76. Austin PC. Some methods of propensity-score matching had superior performance to others: results of an empirical investigation and Monte Carlo simulations. Biom J. 2009;51(1):171–84.

    Article  Google Scholar 

  77. Ali MS, Prieto-Alhambra D, Lopes LC, Ramos D, Bispo N, Ichihara MY, et al. Propensity score methods in health technology assessment: principles, extended applications, and recent advances. Front Pharmacol. 2019;18(10):973.

    Article  Google Scholar 

  78. Ali MS, Groenwold RH, Klungel OH. Best (but oft-forgotten) practices: propensity score methods in clinical nutrition research. Am J Clin Nutr. 2016;104(2):247–58.

    Article  CAS  Google Scholar 

  79. Rubin DB. Using propensity scores to help design observational studies: application to the tobacco litigation. Health Serv Outcomes Res Method. 2001;2(3):169–88.

    Article  Google Scholar 

Download references

Acknowledgements

The evaluation team would like to acknowledge the support of Martin Romero Martinez in power and sample size calculations. Our sincere appreciation goes to the supervisors and interviewers and, most importantly, the households for their cooperation and generous time in responding to the survey.

Amhara ISNP Evaluation Team

Gustavo Angeles1,4, Maja Gavrilovic1, Essa Chanie Mussa1,2, Frank Otchere1,*, Elsa Valli1, Jennifer Waidler1, Tia Palermo3*, Sarah Quiñones3, Ana Gabriela Guerrero Serdan5, Vincenzo Vinci5, Lisa-Marie Ouedraogo5, Getachew Berhanu Kebede5, Getinet Tadele6*, Sewareg Adamu6, Teketel Abebe6, Yenenesh Tadesse6, Feredu Nega6, Mesay Kebede6, Fekadu Muluye6, Alene Matsentu6 & Daniel Aklilu6

1UNICEF Office of Research—Innocenti, Via degli Alfani 58, 50121 Florence, Italy

2Department of Agricultural Economics, University of Gondar, Gondar, Ethiopia

3Department of Epidemiology and Environmental Health, University at Buffalo (State University of New York), Buffalo, NY 14214-8001 USA

4Department of Maternal and Child Health, UNC Gillings School of Global Public Health, University of North Carolina at Chapel Hill, Chapel Hill, NC. 27516 USA

5UNICEF Country Office of Ethiopia, Box 1169 Addis Ababa, Ethiopia

6Frontieri (Formerly BDS Centre for Development Research), Namibia St., Addis Ababa, Ethiopia

* co-Principal Investigator.

Funding

Funding for this study has been provided by the Swedish International Development Cooperation Agency (Sida).The funding body did not have a role in the design of the study and collection, analysis, and interpretation of data and in writing the manuscript.

Author information

Authors and Affiliations

Authors

Consortia

Contributions

ECM, TP, and FO conceptualized the topic for this manuscript and were responsible for the research design. ECM, TP, GA, and FO planned and conducted the statistical analysis. ECM and TP wrote the first draft of the manuscript. ECM, TP, GA, MK, and FO contributed to the interpretation of analyses and revised the manuscript. Members of the ISNP evaluation team further contributed to the study design and data collection. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Essa Chanie Mussa.

Ethics declarations

Ethics approval and consent to participate

The study was approved by the Amhara Public Health Institute (APHI) Research Ethics Review Committee (Reference Number HRTT—03/192/2018). The study is registered on 19/11/2018 in the Registry for International Development Impact Evaluations (RIDIE) with study registration ID—RIDIE-STUDY-ID-5bf27eb0404a0. Informed consent was obtained from all survey participants aged 18 years and above for interviews and to use their anonymized information. For children below the age of 18 years, we obtained assent of their parents or legal guardian to conduct interviews with them. All methods were performed in accordance with the relevant guidelines and regulations.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1: Appendix 1.

Impact evaluation design details. Appendix 2. Methods: Details on Matching Algorithm and Sensitivity Analysis . Appendix 3. Predictors of enrolment into CBHI. Appendix 4. Propensity Score Matching (PSM) Results. Appendix 5. Sensitivity analysis and robustness check. Appendix 6. Variable types and measurements [71,72,73,74,75,76,77,78,79].

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Mussa, E.C., Palermo, T., Angeles, G. et al. Impact of community-based health insurance on health services utilisation among vulnerable households in Amhara region, Ethiopia. BMC Health Serv Res 23, 55 (2023). https://doi.org/10.1186/s12913-023-09024-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12913-023-09024-3

Keywords