- Open Access
Critical comparative analysis of data sources toward understanding referral during pregnancy and childbirth: three perspectives from Nigeria
BMC Health Services Research volume 21, Article number: 927 (2021)
The highest risk of maternal and perinatal deaths occurs during and shortly after childbirth and is preventable if functional referral systems enable women to reach appropriate health services when obstetric complications occur. Rising numbers of deliveries in health facilities, including in high mortality settings like Nigeria, require formalised coordination across the health system to ensure that women and newborns get to the right level of care, at the right time. This study describes and critically assesses the extent to which referral and its components can be captured using three different data sources from Nigeria, examining issues of data quality, validity, and usefulness for improving and monitoring obstetric care systems.
The study included three data sources on referral for childbirth care in Nigeria: a nationally representative household survey, patient records from multiple facilities in a state, and patient records from the apex referral facility in a city. We conducted descriptive analyses of the extent to which referral status and components were captured across the three sources. We also iteratively developed a visual conceptual framework to guide our critical comparative analysis.
We found large differences in the proportion of women referred, and this reflected the different denominators and timings of the referral in each data source. Between 16 and 34% of referrals in the three sources originated in government hospitals, and lateral referrals (origin and destination facility of the same level) were observed in all three data sources. We found large gaps in the coverage of key components of referral as well as data gaps where this information was not routinely captured in facility-based sources.
Our analyses illustrated different perspectives from the national- to facility-level in the capture of the extent and components of obstetric referral. By triangulating across multiple data sources, we revealed the strengths and gaps within each approach in building a more complete picture of obstetric referral. We see our visual framework as assisting further research efforts to ensure all referral pathways are captured in order to better monitor and improve referral systems for women and newborns.
Despite the 38% reduction in global maternal deaths between 2000 and 2017 , over two-thirds of global maternal deaths occurred in sub-Saharan Africa in 2017 (196,000), with Nigeria alone accounting for 23% of these global maternal deaths . Globally, the highest risk of maternal and perinatal death is around the time of childbirth, with direct obstetric causes (such as severe bleeding, hypertensive disorders, and sepsis) which require urgent intervention, accounting for more than half of maternal deaths [1, 2]. Timely access to skilled health personnel and health facilities capable of providing the requisite care is critical for reducing negative pregnancy outcomes among women and their newborns [3,4,5]. Evidence shows that maternal and perinatal deaths can be prevented if women are at the right level of care to manage complications or if functional referral systems are in place to enable women to reach appropriate health services on time when obstetric complications occur .
Much of the literature around access to care during obstetric emergencies has been framed around Thaddeus and Maine’s seminal three-delays framework . The first delay is in deciding to seek care, the second delay in identifying and reaching a medical facility, and the third delay is in receiving adequate care at the facility. The three-delays framework arose when the vast majority of deliveries in low- and middle-income countries (LMICs) took place in home environments. However, the landscape of childbirth care in LMICs has shifted with a significant rise in the proportion of births in health facilities . Some women bypass the lowest level of care (primary) and directly seek care in higher-level (secondary+) health facilities which should have the capability to manage common complications, although many women in high-mortality settings still give birth in facilities incapable of providing this higher-level care, referred to as comprehensive emergency obstetric care (CEmOC) [9,10,11]. Weak referral systems with little coordination between levels of care, as well as between the public and private sectors, mean that women and their families must frequently navigate the referral process on their own, including arranging their own transport, travelling through often bad road networks, at substantial financial costs [12,13,14,15]. In many sub-Saharan African countries, emergency obstetric referrals are delayed, involve multiple facilities before reaching appropriate care, including back and forth transfer between facilities with similar capabilities, as well as little communication and follow-up between referring and receiving facilities [13, 16].
An effective referral system involves formalised coordination across the health system, including transportation and communication, to ensure women and newborns receive timely access to specialist care in the event of complications . The 2016 Lancet Maternal Health Series highlighted how little is known about the design, use and monitoring of optimal referral pathways to more advanced care . Previous efforts to monitor obstetric referral in LMICs have used aggregated health management information systems (HMIS) or facility survey data [18, 19], and qualitative studies have detailed women’s and families’ experiences of referral [13, 16]. However, few studies have documented what happens during obstetric referral and the outcomes for women and newborns at large scale. A key gap in the literature exists to critically assess how different obstetric referral data sources can address important questions such as: Who is being referred and why? Where are they coming from and going to? How are they travelling and who is travelling with them? And finally, what are the outcomes of women who are referred and their babies? The Coronavirus Disease (COVID-19) pandemic, during which models of care delivery and continuity have been disrupted and adapted to fit the prevailing circumstances, has further exposed the need for a coordinated response across levels of the health system to ensure women and newborns receive appropriate and timely care during complications [10, 20].
The objective of our study is to describe and critically assess the extent to which obstetric referral status and its components can be captured in various existing data collection systems. To construct this case study, we used three independent data sources from Nigeria: a nationally representative household survey, patient records from multiple facilities in a State (sub-national level), and patient records from the apex referral facility in a city (facility level). We report results and discuss issues of data quality, validity, and usefulness to improve and monitor systems of obstetric care provision.
To guide our critical comparative analysis, we iteratively developed a visual conceptual overview, using principles defined by Miles and Huberman . As data inputs, we used our technical knowledge and research experience, a rapid literature review focussing on obstetric referral, and other conceptual approaches and visuals depicting the pathways and journeys of women referred during labour and childbirth [13, 22,23,24,25]. We also engaged with the broader literature on maternal health service utilisation, including issues related to health-seeking behaviour [26, 27], bypassing [28,29,30,31], socio-economic determinants of health [32,33,34], physical availability of care [35, 36], detention of women in facilities due to inability to pay [37, 38], and broader health system design frameworks for maternal and newborn health [10, 17, 39,40,41]. Last, we were informed by issues and questions raised by the intersection of the three datasets used in this analysis.
In the resulting conceptual framework (Fig. 1), we illustrate the various elements of referral and opportunities for capturing data on the process of referral, by showing hypothetical referral pathways of five women. We highlight that in addition to direct referral pathways along the hierarchy of the health system (Woman A), there are several complexities of referral pathways. These include bypassing of facilities during referral (Woman B), “zigzagging” between facilities (Woman C), lateral referrals between facilities of the same level or CEmOC capacity (Woman D), and incomplete referrals, resulting in the woman’s return to the facility of origin, to her home, or her death (Woman E). Within this visual, we also schematically highlight the various aspects of referral, including the reasons for referral, the type (level and sector/ownership) of health facilities involved, time and means of transport, whether the woman was accompanied by a skilled health personnel, whether clinical records and information about the referral were communicated between the referring (origin) facility and the receiving (destination) facility, maternal and perinatal outcomes, and potential sources of data about the referral.
Description of setting and data sources
In Nigeria, formal childbirth care is arranged hierarchically; tertiary healthcare, often provided by University Teaching Hospitals, is at the apex of the system and manages the most difficult cases that are referred from the lower tiers of the health system. Recommendations for managing obstetric complications from the Society of Gynaecology & Obstetrics of Nigeria state that providers should “refer the patient to a higher level of care at any stage if there are challenges with the drugs or delivery” and recommend that the referred patient is accompanied by a healthcare provider and with relevant documentation [42, 43]. However, a systematic review by Hussein and colleagues identified ineffective referral as one of the four main barriers to receiving life-saving obstetric care in Nigeria .
This study includes three data sources (Table 1) on referral for childbirth care: 1) the national Nigeria Demographic and Health Survey (NDHS) 2018, 2) state-level facility patient case notes from all government CEmOC facilities in Lagos state, and 3) patient case notes from University of Benin Teaching Hospital (UBTH) in Benin City, Edo State.
Data source 1 was the 2018 NDHS, a cross-sectional, nationally representative household survey using a multi-stage cluster sampling design. The NDHS used the standard model questionnaires including the Woman’s Questionnaire , which was adapted for country priorities. It also included a new set of questions on obstetric referral (Additional file 1), developed by the co-authors (ER, OMRC, LB) in collaboration with the Nigerian Federal Ministry of Health and implementing agencies. Respondents were women of reproductive age (15–49 years) at the time of the survey, who reported on the circumstances of their live births occurring in a five-year recall period. The unit of analysis was a live birth (multiple births per woman possible).
Data source 2 was a study conducted in Lagos State; data were collected from all 24 government-owned CEmOC facilities, which along with linked primary health care facilities account for two-fifths of all births in Lagos State . Based on Lagos State Ministry of Health data, the facilities conducted between 120 (Apapa General Hospital) and 3681 (Lagos Island Maternity Hospital) deliveries in the year 2018. To capture data, one of the co-authors (ABT) with a team of medical doctors working in Lagos public hospitals reviewed case notes of all pregnant women who presented with obstetric complications at emergency maternity wards of these facilities during the year preceding the survey, including those recorded as ‘booked’ and ‘un-booked’.
Data source 3 was a study conducted in UBTH, the top referral facility for maternity services in Edo State. The facility performs between 3000 and 4000 deliveries annually. We conducted a retrospective review of the medical records of ‘un-booked’ women who were admitted in the perinatal period to the UBTH maternity ward between 1 December 2017 and 31 July 2018. ‘Un-booked’ denotes women who had not received antenatal care at UBTH and were therefore not registered or expected to give birth there. The free-form, handwritten case notes were reviewed by UBTH obstetric residents to extract the relevant data. See Additional file 2 for further study details.
Data collection and definitions
Depending on availability, data were collected on demographic characteristics (including age, marital status, employment and education), obstetric history (parity, gestation, and mode of delivery), clinical management, status and origin of referral, support during referral, mode of travel to reach the receiving facility and pregnancy outcomes for women and newborns.
Across the three sources, we categorised women’s age as < 20 years, 20–34 years and ≥ 35 years. For data sources 2 and 3, women were classified as ‘booked’ if they were registered for antenatal care or delivery in the facility where they received CEmOC. For all data sources, we categorised facility sector as either government (public) or private (includes all for-profit, faith-based, and non-governmental facilities) and additionally distinguished, where possible, by the type or level of facility: hospital, primary or lower level, and others. Where available, we also captured data on women who came from non-facility locations, such as traditional birth attendant (TBA) homes or religious settings (such as churches and mosques).
We classified births as having been referred based on whether women reported that they “came from another health facility” prior to coming to the facility where they delivered (data source 1) or if the medical case notes indicated that the woman had been referred (data sources 2 and 3). In order to assess perinatal outcomes, we used the World Health Organization (WHO)’s definition of the perinatal period to capture > 22 weeks’ gestation and up to 7 days following childbirth. For data source 2, we included women across the entire pregnancy spectrum (conception to 7 days postpartum), but for data source 3, we limited the inclusion criteria to only pregnancies of 23+ completed weeks gestation to reduce potential misclassification of stillbirths and miscarriages due to inaccurate gestational age estimation (Table 1) . We classified mode of delivery as vaginal, caesarean, or evacuation before viability (induced or spontaneous abortion).
We conducted descriptive analyses of the extent to which referral status and components were captured across the three sources. We estimated the proportion of the sample that was referred based on available and feasible denominators. Demographic, pregnancy and referral pathway data were summarised for referred women and presented in tables. Depending on data availability, we summarised and presented data on the day/period of the day the journey to the facility commenced, origin (or referring) facility type, the means of transportation used to reach the facility for delivery, number of referrals made, stop-overs made en route, whether a healthcare worker accompanied the woman from the origin facility to the facility where she gave birth, and whether the woman had a referral note. We presented the extent of missingness for all variables. For data source 1, we used the Sankey pathway to map referral pathways of women across different facility types.
Chi-squared tests were performed to compare proportions giving birth by caesarean as well as maternal and newborn outcomes (maternal death and stillbirth, respectively) between referred and non-referred women. STATA version SE 15.0 (StataCorp, College Station, Texas, USA) was used for data analysis.
We then conducted a critical assessment of the three data sources based on the components of the framework (Fig. 1). We reflected on issues of comparability and the strengths and gaps of the three data sources using a traffic light colour system for ease of display.
Data source 1: NDHS 2018 – national perspective
Among all 34,193 live births in the survey’s five-year recall period, 13,462 (39.4%) were in health facilities. There was a wide variation especially by geographic zone and household wealth (Table 2). Among all live births, 13.1% were in government hospitals, and this was also socio-economically patterned. Nationally, 208 (1.5, 95%CI: 1.3–1.8) of live births in health facilities were reported to have been referred from another health facility. No statistically significant difference in the percentage of referrals was observed by geographic region, urban/rural residence, maternal education, or household wealth. Among births in government hospitals, 2.3% came from referrals; this differed across the regions from 1.0% (South East) to 3.9% (North East).
Among referred cases (n = 208), the facility of origin was majority government lower-level facilities (58.4%); 19.7% came from private facilities, and 21.9% from government hospitals (Table 3). While half of referred cases gave birth in government hospitals (50.4%), 9.4% gave birth in government lower-level, and 40.2% in private facilities. The distribution of referred cases across levels of destination facility showed a large geographic variation. No differences in the distribution of referred cases by type of facility were observed by women’s residence, education, or household wealth. The most common transport used during referral was a private car/taxi (62.8%) or another form of motorised transport (30.2%). Ambulance was reported to have been used by 3.4% of the referred cases. Only a quarter of women said they were accompanied by a health professional during the referral.
Figure 2 shows the flow from the origin (referring out) to destination (receiving in/final place of birth) facility types among women referred during labour or childbirth. Most referrals from government hospitals went to other government hospitals (66.9%), but a substantial proportion of government hospital referrals gave birth in private sector facilities (30.4%). From government lower-level facilities, most referrals went to government hospitals (53.6%), but a sizeable minority went to private facilities (33.3%) and a non-negligible percentage (13.1%) went to other government lower-level facilities. The large majority (71.7%) of referrals from the private sector went to other private sector facilities; there was no distinction between level of private facility in the data.
Table 3 shows a comparison of outcomes between referred and non-referred births in health facilities. Half of referred births were delivered by caesarean, compared to 6.2% of non-referred births in health facilities (p < 0.001). Early neonatal mortality was slightly higher among referred facility births (54 per 1000 live births) compared to 38 per 1000 live births among non-referred facility births. However, this difference was not significant (p = 0.217), potentially due to the small sample size of referred cases.
Data source 2: Lagos state CEmOC facility records – sub-national perspective
Of the 4181 pregnant women who presented with an obstetric emergency at one of the 24 government CEmOC hospitals, 1038 (25%) were referred. When compared to the reported total number of pregnant women (emergency and non-emergency) who presented at one of the 24 government CEmOC hospitals during the study period (30,129), referral rate was 3.4%. Focusing on births and excluding abortions, there were a total of 30,072 births, of which 910 (3.0%) were referred in.
Table 4 provides a summary of the demographic and pregnancy characteristics of the 1038 women in our sample who were referred. Most of the women (72.7%) were within the 20–34-year age category, 94.5% were married, 57.7% were educated and 50.7% were petty traders (self-employed in small businesses). Almost all the women (95.1%) had a singleton gestation and 52.9% delivered by caesarean.
Most of the referred women (76.0%) presented during the week, as opposed to the weekend (24.0%) (Table 5). In terms of their travel to reach facilities, the women’s medical records documented the period of the day during which the women commenced their journeys to the facility in 57.5% of the cases, but almost 97.9% did not state mode of travel to reach the facility. However, among the women with data available, 202 (33.8%) travelled in the morning. Most were referred from government lower-level facilities such as primary health centres (40.9%), followed by private hospitals (22.9%), and other government hospitals (15.9%). Fifty-two women (5.0%) were referred by more than one facility before reaching the final destination facility. Some women were reported to have made a non-referral stops en route the health facility to go to places of worship (church, mosque) or to get an ultrasound done (2.5%). Information on mode of travel to facility was only reported for 22 (2.1%) women. After delivery, 17 women (1.6%) had newborns who were transferred to other hospitals for additional neonatal care, including nursing in available incubators.
Comparing outcomes between referred and non-referred cases, 52.4% (95%CI 51.2–53.5) of referred women delivered by caesarean compared to 43.8% (95%CI 41.3–45.5) of non-referred births in the study hospitals (p < 0.001). There was no statistically significant difference in maternal deaths between referred and non-referred cases. However, there was a statistically significant difference in fresh stillbirths between referred (13.0% (95%CI 12.1–14.6)) and non-referred cases (6.3% (95%CI 5.8–7.7)) (Table 5).
Data source 3: UBTH patient case notes – apex referral hospital perspective
A total of 253 records of women meeting the inclusion criteria were extracted and included in the study. The majority of these un-booked patients came to UBTH from another health facility (n = 196, 77.5%). A further 17.4% (n = 44) came from their home or an unspecified location, and 5.1% (n = 13) came from non-health institutions/locations, including church groups or the home of a TBA.
Table 6 shows the demographic and pregnancy characteristics of the full sample of un-booked women and the subset of those who were referred from a health facility (n = 195, excluding one woman who arrived from another health facility but was not referred formally). The vast majority of women were married and residing in Benin City, and one third of women were admitted for care for their first birth. Compared to all women in the sample, those referred from health facilities had more multiple pregnancies (11.5% vs 14.4%). More than half of women were admitted pre-term (< 37 weeks gestation), with a third of women’s pregnancies recorded as extremely or very pre-term (< 32 weeks).
Among women referred from another health facility (n = 195), more than 80% came from another hospital (Table 7). Among the components of referral, only the presence (or absence) of a referral note was documented consistently in the medical records of the vast majority of women; nearly 60% of women were referred with a note, though the form and content of these referral notes (including previous medical interventions received) varied widely; and not all medical records still contained that original note. Whether there was notification to UBTH prior to the patient’s arrival was documented in the case notes for nearly 60% of women, though this was most often to indicate the lack of notification. In only two cases (1.0%) did the patient record indicate that UBTH received a notification, via telephone call, prior to the woman’s arrival. The type of transport used during the referral and who accompanied the woman was recorded in only 1.0 and 6.7% of patient case notes, respectively.
Table 7 shows a comparison of obstetric outcomes between women referred from another health facility and those not referred. No significant differences in the outcomes of caesarean section or maternal death were noted between those referred and not referred. Among women admitted in labour or before delivery, there were nearly twice the stillbirths among women referred compared to those not referred (23.0% vs 11.8%, p = 0.080).
Table 8 shows a comparison of the three data sources, highlighting the strengths, gaps, and outcome measurement possibilities. One important consideration was the representativeness offered by the samples captured by the different data sources, and their comparability. The two facility-based data sources (2 and 3) were from CEmOC facilities, and women ending their referral pathways at these facilities likely represent the most severe obstetric complications. The NDHS (data source 1) offered nationally representative, population-level estimates of referral prior to childbirth care for deliveries ending in a live birth.
All data sources allowed capture of direct referrals between one referring and receiving facility, while data sources 2 and 3 reported some more complicated referrals to varying degrees (Table 8). The NDHS reported an additional pattern of referral in which women bypassed government facilities (hospitals and lower-level facilities) to private sector facilities. Data source 2 showed other complicated referral pathways that included multiple referrals and neonatal referrals after delivery. It was also able to capture some informal stopovers that women made en route to the destination facilities.
Using the framework of illustrative referral pathways (Fig. 1), we examined which pathways would be captured in each of the three data sources examined here. We determined that the NDHS data source would capture the pathways of Woman A, Woman B and Woman D, as all ended in the woman’s survival and a live birth. The pathways of Woman A and Woman C would be captured in the two facility-based data sources (data sources 2 and 3), and notably, the complicated pathway of Woman C with multiple referrals could be captured as well. As the two facility-based data sources analysed were both conducted in government referral facilities, neither would capture the pathways of Woman B or Woman D, as both journeys ended in private sector facilities. Finally, Woman E’s pathway, though comparatively rare, might be captured in routine HMIS as an “out” referral, it would not be captured in any of the three data sources examined here as her pathway ended with a maternal death at home.
Facility-based data sources (in particular, data source 2) captured referral at any stage of pregnancy, including those that end as ectopic pregnancies or induced abortions. Data source 3 has the potential to capture these data, though the inclusion criteria was limited to 23+ weeks gestation for this particular study. Both facility-based data sources allowed capture of postpartum referral pathways (up to 7 days after delivery) and adverse outcomes, especially maternal morbidity and mortality, as well as stillbirths, whereas the NDHS was limited to only referrals occurring prior to delivery and only to women alive at the time of the survey whose deliveries ended in a live birth. Early neonatal deaths were captured in data source 2, as records of the newborn are inputted in the mothers’ case notes until discharge. However, the linkage between newborns’ and their mothers’ records was not possible in data source 3. The NDHS only allowed capture of early neonatal deaths following referral (Table 8).
The NDHS reported mode of transport, the reason for the referral (including problem during labour or an emergency, non-availability of a health professional, no bed space, or facility not open) and whether the woman was accompanied by a health provider, but such data were not routinely collected in facility-based data sources. On the other hand, the facility-based data sources routinely documented the clinical indication for the referral, and for the most part if a notification was sent prior to arrival and a referral note was presented on arrival (Table 8).
Our analysis offers a critical comparison of data sources on obstetric referral from three contemporaneous studies from a single country setting. The three data sources considered here offer different strengths and gaps, from the national to facility level, in the capture of the extent and components of obstetric referral, going back to the key referral questions that we highlighted: Who is being referred and why? Where are they coming from and going to? How are they travelling and who is travelling with them? And finally, what are the outcomes of women who are referred?
In terms of the ‘who’, we found that the DHS captured a plethora of demographic and socio-economic characteristics, allowing for a richer characterisation of those being referred. On the other hand, the facility-based data sources 2 and 3 mostly captured only basic demographic data which limits their usefulness for analysis comparing referral pathways and outcomes by sub-groups of women. When the numbers were aggregated, we found large differences in the proportion of women in each analysis who were referred, reflecting the different denominators (all facility births vs only those in CEmOC facilities, live births vs all perinatal outcomes) and different timings of the referral (only those referred prior to delivery vs those referred prior, during or up to 7 days after delivery). However, in the one instance where we were able to standardise denominators across the data sources, these (data source 1 and 2) were broadly in agreement. According to the NDHS, the proportion of live births in government hospitals which came from referrals in the South West region of Nigeria where Lagos is situated was 3.2% (95%CI 2.0–5.1). Estimates based on the Lagos State government hospital data (data source 2) was 3.4%, which is within the confidence interval estimate for the larger region. The consistency of the 2018 NDHS and the Lagos State data in measuring the proportion of women referred is particularly important and reassuring, given that these survey questions about referral for childbirth care have not yet been validated in any setting. However, we cannot rule out that women were unable to recall or report on the details of their referral accurately in the NDHS (data source 1). As to the reason (‘why’) for the referral, the facility-based data sources routinely captured clinical indications or complications and to some extent the reason for the referral, as it is part of routine clinical practice. The NDHS asked women to self-report the reason for the referral, but the reliability and understanding of this question is unknown and could be fairly inaccurate, particularly in emergencies.
To understand the potential of the various data sources to capture data on where women are referred from and referred to, we developed a conceptual visualisation of different referral pathways. Our comparative analysis showed that all three data sources allowed capture of direct referrals, from lower-level facilities to hospitals . Many obstetric referral guidelines present referral as hierarchical ‘bottom-up’ travel from lower- to higher-level facilities, as stipulated in the WHO’s Practical Guide for Implementing Safe Motherhood in Countries . However, our findings and others [13, 16, 28,29,30,31] show that women travel across facility levels and sectors in more complex patterns. All data sources used in our comparative study were, to a varying extent, able to reflect some complex referral pathways including lateral referrals . For example, the NDHS was able to show that women bypassed government facilities (hospitals and lower-level facilities) for private sector facilities – another pattern reported in previous studies [28,29,30,31]. Data source 2 highlighted some other complicated referral pathways which included multiple referrals and neonatal referrals for reasons such as use of an incubator, which is not typically available in all hospitals . It was also able to capture some informal stopovers that women made en route to the facilities. Data source 3 was able to capture the sector and level of referring facilities in more granularity and to some extent also the reasons for lateral referrals (such as hospitals lacking equipment or staff to perform caesarean sections).
Components of referral, such as transport or whether a healthcare provider accompanied the woman, were frequently missing from our two facility-based data sources, but these components were more consistently captured in women’s self-report on the NDHS. Our comparison of data sources found that facility-based records often better captured referral components that impacted clinical care, such as the presence of a referral note as such notes often included previously received interventions. During data collection at facilities, it was also observed that referral components were often recorded more completely in the medical records of women with adverse outcomes (including maternal or perinatal deaths). This potentially reflected concerns about the need to comprehensively document what had happened prior to women’s arrival at those facilities.
The data sources offered differing options for examining perinatal outcomes of women who were referred. While it was possible to report number of caesarean deliveries across all data sources, stillbirth was only reported in the facility-based data sources. Early neonatal death (within 7 days of birth) was reported in data sources 1 and 2, though later neonatal deaths (after 7 days) could also be examined in the NDHS. The facility-based data source truncation in documenting neonatal death is intuitive, in the sense that women typically would not stay in a health facility beyond one-week of delivery . In the UBTH data source, the maternity ward case notes only had data on whether the newborn was born alive and left the ward alive. The newborn could have died minutes later during admission to the neonatal intensive care unit, but this was not captured in the women’s maternity ward records. Effective referral for small and sick newborns is a critical factor in reducing neonatal mortality , and future research should examine the possibility of linking maternity and neonatal/paediatric ward records in facility-based data sources, as well as potentially adding questions on newborn referral in household surveys. Finally, the NDHS included a survival bias, collecting data only from women who are alive at the time of the survey and only about their deliveries that ended in a live birth. Last, while we recognise that hospitals (our facility-based data sources) receive some of the most complicated obstetric emergencies, and we must highlight the unacceptably high levels of perinatal mortality among referred cases, including maternal mortality, particularly in Lagos (data 2), and neonatal mortality/stillbirth rates in both data sources 2 and 3.
As the Nigerian government invests in increasing facility-based deliveries, particularly in primary care facilities, there is a growing need to ensure safe, effective referral across all levels of the health system. Altogether, the three data sources used in our study highlight critical action points that can be useful for planning. First, between 16 and 34% of referrals in the three sources originated in government hospitals, suggesting insufficient resources even at this higher level to manage all obstetric cases. Some of the referrals between government hospitals may reflect enhanced capacity or specialisation for complex obstetric or neonatal cases at some hospitals. For example, the substantial proportion of extremely and very preterm pregnancies admitted to UBTH likely reflects the referral centre’s reputation and capacity for neonatal intensive care in Edo State. We also found large gaps in the coverage of key components of referral, finding in the 2018 NDHS analysis that only 3.4% of women used an ambulance and 24.9%, were accompanied by a healthcare professional during their referral, as well as data gaps where this information was not routinely captured in facility-based records. Additionally, the NDHS analysis revealed that a non-negligible proportion (13.1%) of women were referred between government lower-level facilities, and 5.0% of women in the Lagos State analysis had more than one referral, suggesting inefficiencies in the referral system. The health system factors behind these lateral and multiple referrals, including closed or crowded facilities, require further research to address barriers and likely delays to women receiving appropriate care, including communication between facilities during the referral process.
There are some actions that might strengthen the capabilities of the data sources for capturing referral data. With the NDHS and other future DHS surveys, there is a need to consider reframing the survey questions. Additional questions framed to trigger recall of multiple pathways and timeline of referrals, throughout the entire pregnancy and postpartum period, might help to increase capacity of the DHS to demonstrate more complicated referral pathways. However, we observed large numbers of stillbirths, including from referred cases, in the facility-based data that get missed in the restriction of maternity care and referral questions to live births. Going forward, validation studies will be needed by the DHS before recommending the new referral questions to be used more widely , including in cases of stillbirth. Capturing maternal deaths will remain a challenge.
For facility-based data sources, clarification of the definition of ‘booked’ v. ‘un-booked’ is important in fully understanding referral pathways and outcomes. Often being ‘booked’ means the pregnant woman is registered at a facility and has attended at least one antenatal session during which she was seen by a skilled health personnel [51,52,53]. However, is a woman who has been seen by a skilled health personnel at a lower-level facility in the catchment area or in hospital A and now presents in hospital B a ‘booked’ case? If yes, the medical record systems in many LMICs are rarely sufficiently coordinated to make such information linkages . If no, then a clearer definition is needed to move the field forward.
Our analysis highlighted the importance of properly considering obstetric referral between facilities from different sectors and the role of household surveys, or potentially expanding facility-based data sources, to capture private sector referrals. Nigeria’s substantial private sector for maternity care (33.0% of facility deliveries) , particularly in urban centres, challenges efforts to formalise, monitor, and improve referral coordination. Facility-based data sources, including data sources 2 and 3 here and HMIS, are frequently limited to government/public facilities. Referrals ending in the private sector—40.2% of referred cases in the NDHS analysis—would not be captured in these government facility-based data sources. The large geographic variation in referrals to government hospitals observed in the NDHS may reflect a greater availability of private sector facilities in the South East region compared the three northern regions. In strengthening facility-based data sources in both public and private sectors, new variables that allow for comprehensive capture of referral pathways, the reason for referral and clinical indication for referral will be essential.
Strength and limitations
A key strength of our critical comparative analysis is that we took advantage of three unique data sources available to offer perspectives on obstetric referral from the national to sub-national to facility-level. However, these data sources were not designed to answer all the questions posed in this analysis. We were limited in making direct comparisons between the results of the three sources, as they represented overlapping – but not exactly the same – time periods, denominators, and measurement approaches. Additionally, due to small sample sizes, we were limited in conducting sensitivity analyses that would have facilitated more direct comparisons between the facility-based data sources and the NDHS results from the South-West and South-South regions (of which Lagos State and Benin City, Edo State, respectively, are part). Our analysis would have also benefited from HMIS as a fourth complementary source of data on referrals. While we did not have access to these data, we included it in the visual framework to illustrate where outgoing and incoming referrals could be captured via HMIS. Finally, an important consideration of our analyses is that we cannot know if the right women were getting referred, including the extent of women with obstetric complications who should have been referred but were not. The data sources were also limited in assessing the appropriateness of the referral, particularly among referrals from similar level facilities that had the theoretical (if not practical) capability to manage the complication.
In Nigeria, as in many sub-Saharan African countries, there is limited understanding of the pathways of reaching care within the obstetric referral system. As such, we potentially lose vital information which could be useful in programme and policy planning. The analyses in this paper highlight opportunities for further investigation, including referral patterns between facilities of the same level. Our unique examination of multiple data sources on obstetric referral revealed the strengths and gaps within each approach. The scale at which referral research is done (national, sub-national or intra-facility) will depend on available resources, such as the considerable expense and time needed to conduct a national household survey to the relatively low-cost pilot study at an apex facility, as well as the purpose of the investigation. Routine monitoring of obstetric referral, through for example HMIS, will require meaningful resourcing to incorporate new indicators to capture referral and its components as well as inclusion of private sector facilities. However, more rapid, cross-sectional investigations in selected facilities are also possible. This could supplement routine monitoring by targeting data collection from facilities identified as requiring more support or receiving the most urgent cases. Future research in other high mortality contexts should map and examine multiple existing data sources to allow the strengths of each to build a more complete picture of obstetric referral. Our visual framework can assist these efforts to ensure all pathways are captured, and that we retain the woman and her fetus/newborn at the start and centre of each journey.
Availability of data and materials
The NDHS data (data source 1) that support the findings of this study are available from the Demographic and Health Surveys Program but restrictions apply to the availability of these data, which were used with permission for the current study, and so are not publicly available. Data are available, with permission, from the Demographic and Health Surveys Program website.
The datasets from the Lagos State study (data source 2) and the UBTH study (data source 3) that support the findings of this study are available from Dr. Aduragbemi Banke-Thomas (data source 2) and Ms. Emma Radovich (data source 3) but restrictions apply to the availability of these data, which were used under license for the current study, and so are not publicly available. Data are available from the authors upon reasonable request and with permission from Dr. Banke-Thomas and Ms. Radovich for data sources 2 and 3, respectively.
Comprehensive emergency obstetric care
Health management information systems
Low- and middle-income countries
Nigeria Demographic and Health Survey
Traditional birth attendant
University of Benin Teaching Hospital
World Health Organization
WHO, UNICEF, UNFPA, World Bank Group, UNDP. Trends in maternal mortality 2000 to 2017: estimates by WHO, UNICEF, UNFPA, World Bank Group and the United Nations population division [internet]. Geneva: World Health Organization; 2019. p. 1–119. Available from: https://www.unfpa.org/sites/default/files/pub-pdf/Maternal_mortality_report.pdf
Say L, Chou D, Gemmill A, Tunçalp Ö, Moller A-B, Daniels J, et al. Global causes of maternal death: a WHO systematic analysis. Lancet Glob Health. 2014;2(6):e323–33. https://doi.org/10.1016/S2214-109X(14)70227-X.
Campbell OM, Graham WJ. Strategies for reducing maternal mortality: getting on with what works. Lancet. 2006;368(9543):1284–99. https://doi.org/10.1016/S0140-6736(06)69381-1.
Paxton A, Maine D, Freedman L. The evidence for emergency obstetric care. Int J Gynaecol Obstet. 2005;88(2):181–93. https://doi.org/10.1016/j.ijgo.2004.11.026.
WHO, UNFPA, UNICEF. International Confederation of Midwives, International Confederation of Nurses, International Federation of Gynecology and Obstetrics, et al. definition of skilled health personnel providing care during childbirth [internet]. Geneva: World Health Organization; 2018. Available from: https://apps.who.int/iris/bitstream/handle/10665/272818/WHO-RHR-18.14-eng.pdf?ua=1
Nyamtema AS, Urassa DP, Van Roosmalen J. Maternal health interventions in resource limited countries: a systematic review of packages, impacts and factors for change. BMC Pregnancy Childbirth. 2011;11(1):30. https://doi.org/10.1186/1471-2393-11-30.
Thaddeus S, Maine D. Too far to walk: maternal mortality in context. Soc Sci Med. 1994 Apr;38(8):1091–110. https://doi.org/10.1016/0277-9536(94)90226-7.
Doctor HV, Radovich E, Benova L. Time trends in facility-based and private-sector childbirth care: analysis of demographic and health surveys from 25 sub-Saharan African countries from 2000 to 2016. J Glob Health. 2019;9(2):020406. https://doi.org/10.7189/jogh.09.020406.
Montagu D, Sudhinaraset M, Diamond-Smith N, Campbell O, Gabrysch S, Freedman L, et al. Where women go to deliver: understanding the changing landscape of childbirth in Africa and Asia. Health Policy Plan. 2017;32(8):1146–52. https://doi.org/10.1093/heapol/czx060.
Roder-DeWan S, Nimako K, Twum-Danso NAY, Amatya A, Langer A, Kruk M. Health system redesign for maternal and newborn survival: rethinking care models to close the global equity gap. BMJ Glob Health. 2020;5(10):e002539. https://doi.org/10.1136/bmjgh-2020-002539.
Stein DT, Golub G, Rothschild CW, Nyakora G, Cohen J, Mcconnell M. Bypassing high-quality maternity facilities: evidence from pregnant women in peri-urban Nairobi. Health Policy Plan. 2021;36(1):84-92. https://doi.org/10.1093/heapol/czaa092.
Hussein J, Hirose A, Owolabi O, Imamura M, Kanguru L, Okonofua F. Maternal death and obstetric care audits in Nigeria: a systematic review of barriers and enabling factors in the provision of emergency care. Reprod Health. 2016;13(1):47. https://doi.org/10.1186/s12978-016-0158-4.
Elmusharaf K, Byrne E, AbuAgla A, AbdelRahim A, Manandhar M, Sondorp E, et al. Patterns and determinants of pathways to reach comprehensive emergency obstetric and neonatal care (CEmONC) in South Sudan: qualitative diagrammatic pathway analysis. BMC Pregnancy Childbirth. 2017;17(1):1–15.
Hofman JJ, Dzimadzi C, Lungu K, Ratsma EY, Hussein J. Motorcycle ambulances for referral of obstetric emergencies in rural Malawi: do they reduce delay and what do they cost? Int J Gynecol Obstet. 2008;102(2):191–7. https://doi.org/10.1016/j.ijgo.2008.04.001.
Ronsmans C, Etard J-F, Walraven G, Høj L, Dumont A, De Bernis L, et al. Maternal mortality and access to obstetric services in West Africa. Tropical Med Int Health. 2003;8(10):940–8. https://doi.org/10.1046/j.1365-3156.2003.01111.x.
Banke-Thomas A, Balogun M, Wright O, Ajayi B, Abejirinde I-OO, Olaniran A, et al. Reaching health facilities in situations of emergency: qualitative study capturing experiences of pregnant women in Africa’s largest megacity. Reprod Health. 2020;17(1):145. https://doi.org/10.1186/s12978-020-00996-7.
Campbell OMR, Calvert C, Testa A, Strehlow M, Benova L, Keyes E, et al. The scale, scope, coverage, and capability of childbirth care. Lancet. 2016;388(10056):2193–208. https://doi.org/10.1016/S0140-6736(16)31528-8.
Murray SF, Pearson SC. Maternity referral systems in developing countries: current knowledge and future research needs. Soc Sci Med. 2006 May 1;62(9):2205–15. https://doi.org/10.1016/j.socscimed.2005.10.025.
Bailey PE, Awoonor-Williams JK, Lebrun V, Keyes E, Chen M, Aboagye P, et al. Referral patterns through the lens of health facility readiness to manage obstetric complications: national facility-based results from Ghana. Reprod Health. 2019;16(1):19. https://doi.org/10.1186/s12978-019-0684-y.
Semaan A, Audet C, Huysmans E, Afolabi B, Assarag B, Banke-Thomas A, et al. Voices from the frontline: findings from a thematic analysis of a rapid online global survey of maternal and newborn health professionals facing the COVID-19 pandemic. BMJ Glob Health. 2020;5(6):e002967. https://doi.org/10.1136/bmjgh-2020-002967.
Miles MB, Huberman AM. Qualitative data analysis: an expanded source book. Newbury Park: SAGE Publications, Inc; 1994. p. 1–334.
Harahap NC, Handayani PW, Hidayanto AN. Barriers and technologies of maternal and neonatal referral system in developing countries: a narrative review. Informatics Med Unlocked. 2019;15:100184. https://doi.org/10.1016/j.imu.2019.100184.
Hanson C, Schellenberg J. Redesigning maternal health services: is centralisation the answer in low-resource settings? BMJ Glob Health. 2019;4(3):e001488. https://doi.org/10.1136/bmjgh-2019-001488.
Ariadne Labs. The BetterBirth study (November 2014–December 2017): global strategies to end the preventable deaths of women & newborns in childbirth [internet]. Boston; 2019. Available from: https://betterbirth.ariadnelabs.org/wp-content/uploads/sites/4/2019/06/BB-Final-Report-2019-05-13.pdf
Kane S, Jiang H, Tian Y, Mukhopadhyay M, Qian X. Making effective referrals happen: a theory-informed policy analysis. Health Policy Plan. 2020;35(10):1309–17.
Yaya S, Bishwajit G, Uthman OA, Amouzou A. Why some women fail to give birth at health facilities: a comparative study between Ethiopia and Nigeria. PLoS One. 2018;13(5):e0196896. https://doi.org/10.1371/journal.pone.0196896.
Benova L, Campbell OM, Ploubidis GB. A mediation approach to understanding socio-economic inequalities in maternal health-seeking behaviours in Egypt. BMC Health Serv Res. 2015;15(1):1. https://doi.org/10.1186/s12913-014-0652-8.
Mubiri P, Kajjo D, Okuga M, Marchant T, Peterson S, Waiswa P, et al. Bypassing or successful referral? A population-based study of reasons why women travel far for childbirth in eastern Uganda. BMC Pregnancy Childbirth. 2020;20(1):497. https://doi.org/10.1186/s12884-020-03194-2.
Kruk ME, Mbaruku G, McCord CW, Moran M, Rockers PC, Galea S. Bypassing primary care facilities for childbirth: a population-based study in rural Tanzania. Health Policy Plan. 2009;24(4):279–88. https://doi.org/10.1093/heapol/czp011.
Salazar M, Vora K, De Costa A. Bypassing health facilities for childbirth: a multilevel study in three districts of Gujarat, India. Glob Health Action. 2016;9(1):32178. https://doi.org/10.3402/gha.v9.32178.
Shah R. Bypassing birthing centres for child birth: a community-based study in rural Chitwan Nepal. BMC Health Serv Res. 2016;16(1):597. https://doi.org/10.1186/s12913-016-1848-x.
Say L, Raine R. A systematic review of inequalities in the use of maternal health care in developing countries: examining the scale of the problem and the importance of context. Bull World Health Organ. 2007;85(10):812–9. https://doi.org/10.2471/BLT.06.035659.
Graham W, Woodd S, Byass P, Filippi V, Gon G, Virgo S, et al. Diversity and divergence: the dynamic burden of poor maternal health. Lancet. 2016;388(10056):2164–75. https://doi.org/10.1016/S0140-6736(16)31533-1.
WHO. State of inequality: reproductive, maternal, newborn and child health [internet]. Geneva; 2015. Available from: https://www.who.int/docs/default-source/gho-documents/health-equity/state-of-inequality/state-of-inequality-reproductive-maternal-new-born-and-child-health.pdf?sfvrsn=f4034289_2
Wong KLM, Benova L, Campbell OMR. A look back on how far to walk: systematic review and meta-analysis of physical access to skilled care for childbirth in sub-Saharan Africa. PLoS One. 2017;12(9):e0184432. https://doi.org/10.1371/journal.pone.0184432.
Gabrysch S, Campbell OMR. Still too far to walk: literature review of the determinants of delivery service use. BMC Pregnancy Childbirth. 2009;9(1):34. https://doi.org/10.1186/1471-2393-9-34.
Bohren MA, Mehrtash H, Fawole B, Maung TM, Balde MD, Maya E, et al. How women are treated during facility-based childbirth in four countries: a cross-sectional study with labour observations and community-based surveys. Lancet (London, England). 2019;394(10210):1750–63.
Cowgill KD, Ntambue AM. Hospital detention of mothers and their infants at a large provincial hospital: a mixed-methods descriptive case study, Lubumbashi, Democratic Republic of the Congo. Reprod Health. 2019;16(1):111. https://doi.org/10.1186/s12978-019-0777-7.
Gage AD, Carnes F, Blossom J, Aluvaala J, Amatya A, Mahat K, et al. In low- and middle-income countries, is delivery in high-quality obstetric facilities geographically feasible? Health Aff. 2019;38(9):1576–84. https://doi.org/10.1377/hlthaff.2018.05397.
Hanson C, Waiswa P, Pembe A, Sandall J, Schellenberg J. Health system redesign for equity in maternal and newborn health must be codesigned, country led, adapted to context and fit for purpose. BMJ Glob Health. 2020;5(10):e003748. https://doi.org/10.1136/bmjgh-2020-003748.
Straneo M, Hanson C, Fogliati P, Mbaruku GM. Minimum obstetric volume in low-income countries. Lancet. 2017;389(10070):698. https://doi.org/10.1016/S0140-6736(17)30342-2.
SOGON. Protocol on the management of eclampsia [Internet]. Abuja. Report No.: 11. Available from: https://sogon.org/wp-content/uploads/2018/11/Card-Protocol-on-the-Management-of-Eclampsia-Layed.pdf; 2018
SOGON. Postpartum Haemorrhage: Management Guidelines/Protocol [Internet]. Abuja; 2012. (11). Available from: https://sogon.org/wp-content/uploads/2018/11/POST-PARTUM-HAEMORRHAGE.pdf
National Population Commission, ICF International. Nigeria demographic and health survey 2018 [internet]. Abuja and Rockville; 2019. Available from: https://dhsprogram.com/pubs/pdf/FR359/FR359.pdf
Olaitan T, Okafor IP, Onajole AT, Abosede OA. Ending preventable maternal and child deaths in western Nigeria: do women utilize the life lines? PLoS One. 2017;12(5):e0176195. https://doi.org/10.1371/journal.pone.0176195.
Blencowe H, Calvert C, Lawn JE, Cousens S, Campbell OMR. Measuring maternal, foetal and neonatal mortality: challenges and solutions. Best Pract Res Clin Obstet Gynaecol. 2016;36:14–29. https://doi.org/10.1016/j.bpobgyn.2016.05.006.
WHO. Mother-baby package: implementing safe motherhood in countries [internet]. Geneva: (WHO/FHE/MSM/94.11 Rev.1); 1996. Available from: https://apps.who.int/iris/bitstream/handle/10665/63268/WHO_FHE_MSM_94.11_Rev.1.pdf?sequence=1
Campbell OMR, Cegolon L, Macleod D, Benova L. Length of stay after childbirth in 92 countries and associated factors in 30 low- and middle-income countries: compilation of reported data and a cross-sectional analysis from nationally representative surveys. PLoS Med. 2016;13(3):e1001972. https://doi.org/10.1371/journal.pmed.1001972.
Moxon SG, Lawn JE, Dickson KE, Simen-Kapeu A, Gupta G, Deorari A, et al. Inpatient care of small and sick newborns: a multi-country analysis of health system bottlenecks and potential solutions. BMC Pregnancy Childbirth. 2015;15(S2):S7. https://doi.org/10.1186/1471-2393-15-S2-S7.
Benova L, Moller A-B, Hill K, Vaz LME, Morgan A, Hanson C, et al. What is meant by validity in maternal and newborn health measurement? A conceptual framework for understanding indicator validation. PLoS One. 2020;15(5):e0233969. https://doi.org/10.1371/journal.pone.0233969.
Iklaki CU, Inaku JU, Ekabua JE, Ekanem EI, Udo AE. Perinatal outcome in Unbooked teenage pregnancies in the University of Calabar Teaching Hospital, Calabar, Nigeria. ISRN Obstet Gynecol. 2012;2012:1–5. https://doi.org/10.5402/2012/246983.
Failing F, Ripa P, Tefuarani N, Vince J. A comparison of booked and unbooked mothers delivering at the Port Moresby general hospital: a case-control study. P N G Med J. 2004;47(3–4):174–80.
Chigbu B, Onwere S, Kamanu CI, Aluka C, Okoro O, Adibe E. Pregnancy outcome in booked and unbooked mothers in south eastern Nigeria. East Afr Med J. 2009;86(6):267–71. https://doi.org/10.4314/eamj.v86i6.54136.
The authors wish to acknowledge Dr. Emmanuel Meribole, Director, Health Planning, Research & Statistics at the Federal Ministry of Health in Nigeria, for his technical support and efforts to develop and implement the new obstetric referral questions in the 2018 Nigeria Demographic & Health Survey.
We received no specific funding for this study. ER is funded through the Medical Research Council - UK (MR/R022127/1). ABT is funded by the AXA Research Fund as part of his Postdoctoral Fellowship. LB is funded in part by the Research Foundation – Flanders (FWO) as part of her Senior Postdoctoral Fellowship. The funders had no role in the study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Ethics approval and consent to participate
The NDHS (data source 1) received ethical approval from the National Health Research Ethics Committee of Nigeria and the ICF Institutional Review Board; informed consent was obtained from all survey participants . As the Lagos State study (data source 2) involved facilities under various jurisdictions, we were required to obtain ethical and management approval from multiple sources. We obtained ethical approval for the study from the Research and Ethics Committees of the Lagos State University Teaching Hospital (LREC/06/10/1226) and the Lagos University Teaching Hospital (ADM/DCST/HREC/APP/2880). Social approval for the study was received from the Lagos State Government (LSHSC/2222/VOLII/107). For the UBTH study (data source 3), the ethical review committees of University of Benin Teach Hospital (ADM/E 22/A/VOL VII/14581) and the London School of Hygiene & Tropical Medicine (ref: 15480) approved our study. Consent for data extraction of UBTH patient case notes was obtained from the head of the UBTH Department of Obstetrics and Gynaecology. As documented for the NDHS and in those in which we collected data ourselves, privacy and confidentiality of all women were maintained.
All methods were carried out in accordance with relevant guidelines and regulations.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Additional file 1: Appendix 1
Copy of Nigeria 2018 DHS questionnaire, excerpt of obstetric referral questions.
Additional file 2: Appendix 2
Details of study design and sampling for UBTH patient records study (data source 3).
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
About this article
Cite this article
Radovich, E., Banke-Thomas, A., Campbell, O.M.R. et al. Critical comparative analysis of data sources toward understanding referral during pregnancy and childbirth: three perspectives from Nigeria. BMC Health Serv Res 21, 927 (2021). https://doi.org/10.1186/s12913-021-06945-9
- Maternal health
- Newborn health
- Emergency obstetric care
- Health systems
- Facility-based birth
- Medical records
- Household survey