- Study protocol
- Open Access
Action leveraging evidence to reduce perinatal mortality and morbidity (ALERT): study protocol for a stepped-wedge cluster-randomised trial in Benin, Malawi, Tanzania and Uganda
BMC Health Services Research volume 21, Article number: 1324 (2021)
Insufficient reductions in maternal and neonatal deaths and stillbirths in the past decade are a deterrence to achieving the Sustainable Development Goal 3. The majority of deaths occur during the intrapartum and immediate postnatal period. Overcoming the knowledge-do-gap to ensure implementation of known evidence-based interventions during this period has the potential to avert at least 2.5 million deaths in mothers and their offspring annually. This paper describes a study protocol for implementing and evaluating a multi-faceted health care system intervention to strengthen the implementation of evidence-based interventions and responsive care during this crucial period.
This is a cluster randomised stepped-wedge trial with a nested realist process evaluation across 16 hospitals in Benin, Malawi, Tanzania and Uganda. The ALERT intervention will include four main components: i) end-user participation through narratives of women, families and midwifery providers to ensure co-design of the intervention; ii) competency-based training; iii) quality improvement supported by data from a clinical perinatal e-registry and iv) empowerment and leadership mentoring of maternity unit leaders complemented by district based bi-annual coordination and accountability meetings. The trial’s primary outcome is in-facility perinatal (stillbirths and early neonatal) mortality, in which we expect a 25% reduction. A perinatal e-registry will be implemented to monitor the trial. Our nested realist process evaluation will help to understand what works, for whom, and under which conditions. We will apply a gender lens to explore constraints to the provision of evidence-based care by health workers providing maternity services. An economic evaluation will assess the scalability and cost-effectiveness of ALERT intervention.
There is evidence that each of the ALERT intervention components improves health providers’ practices and has modest to moderate effects. We aim to test if the innovative packaging, including addressing specific health systems constraints in these settings, will have a synergistic effect and produce more considerable perinatal mortality reductions.
Pan African Clinical Trial Registry (www.pactr.org): PACTR202006793783148. Registered on 17th June 2020.
There are two million stillbirths globally, and 2.4 million newborns die before reaching one month of age every year [1, 2]. Almost 300,000 women die during pregnancy and childbirth annually . Evidence-based care during the intrapartum period, from the onset of labour to the expulsion of the placenta, carries the greatest lifesaving potential . The importance to address hypoxic-ischaemic insults causing long-term disabilities or perinatal death is increasingly highlighted . Moreover, this period provides an opportunity to prevent 800,000 malnutrition-related child deaths annually by initiating breastfeeding . It is considered a central hub for referral and communication along the continuum of care linking antenatal, postnatal and child health care .
Clear evidence-based guidelines for the provision of routine and emergency care during the intrapartum period are established [8,9,10]. However, evidence suggests that insufficient provider competencies and substandard professional norms rooted in inadequate pre-service training and malfunctioning processes and operations constrain the implementation of such guidelines for maternal and newborn health . Mistreatment of women is also increasingly highlighted as a major challenge during the intrapartum period .
Quality improvement (QI) and training are proven to reduce mortality [13, 14]. A recent study from Uganda and Kenya found that combining training and QI was a successful strategy to achieve more considerable perinatal mortality reductions . Two recent reviews concluded that multi-component strategies addressing several underlying factors related to inadequate care have a larger effect on improving health providers’ practices compared to single component strategies [15, 16]. Therefore, there is a need to test the effectiveness and cost-effectiveness of a multi-component intervention. Further, it is critical to understand what can work in different contexts and if it works, why, through assessing acceptability, adoption, appropriateness, and feasibility of an intervention [14, 17].
In response, we propose developing and evaluating a comprehensive and multilevel intervention termed Action Leveraging Evidence to reduce perinatal Mortality and morbidity in sub-Saharan Africa (ALERT). ALERT will focus on intrapartum care and midwifery with a health care system strengthening lens. ALERT specifically targets hospital maternity units and will include i) end-user participation of women, families, and midwifery providers to co-design the intervention; ii) in-service midwifery competency-based training; iii) empowerment and leadership mentoring of maternity unit leaders, and iv) QI in the maternity ward, supported by district-based bi-annual coordination and accountability meetings (Fig. 1).
Our theory of change can be summarised as follows. End-user participation built around narratives of women, families and midwifery providers is expected to contribute to embed responsiveness and mutual respect in the training and QI. This should lead to improvements in effective communication, respect, dignity and emotional support. Together with the training and mentoring, the co-design is expected to lead to more competent and motivated midwifery providers, thus providing improved care (e.g., improved foetal monitoring, timely decisions, and emergency and client-centred support during labour). In addition, immediate breastfeeding, encouraged for all women - including those experiencing caesarean sections – contributes to improved bonding, nutrition and optimal growth and development in early childhood. Finally, the QI enhances the use of data to make information systems more actionable. QI and the district coordination and accountability mechanism should improve resource allocation efficiency (Fig. 1).
The specific study objectives are:
To assess the ALERT intervention’s impact in hospital maternity units on perinatal and maternal health outcomes, including women’s experience of care.
To evaluate the process of implementation of the intervention to understand what works for whom and under what situation.
To conduct a cost-effectiveness analysis of the ALERT intervention.
We hypothesise that ALERT will i) reduce in-facility early perinatal mortality; ii) reduce perinatal and maternal morbidity; iii) improve evidence-based practices (immediate breastfeeding, experience of care); iv) strengthen communication links between primary care and hospitals as well as ante-, intra-, postnatal and child health care; and v) strengthen professional exchange networks through mentoring for sustained learning and action.
We will use a stepped-wedge cluster-randomised design with a nested process evaluation based on realist evaluation  to evaluate the process of implementation of ALERT to understand what works for whom and under what conditions . We will also conduct a cost-effectiveness analysis to inform scalability. The cluster design was chosen as the intervention will be delivered at the hospital level. Our clusters are defined as a maternity ward of a hospital offering caesarean section and blood transfusion services with a minimum caseload of 2500 births per year. A stepped-wedge design was chosen to mirror scale-up for policy buy-in and for statistical efficiency as we expect larger cluster-level differences . In addition, it enables the realist process evaluation and economic evaluation to take place in hospitals where we expect the intervention to be sufficiently mature in the way it is implemented. This protocol follows CONsolidated Standards of Reporting Trials (CONSORT) for stepped-wedge cluster randomised trial (SW-CRT) (Additional file 1) and the Standards for Reporting Implementation Studies (StaRI) (Additional file 2).
ALERT will be implemented in four hospitals in Benin, Malawi, Tanzania and Uganda. These countries were purposely selected to allow for a range of health system characteristics and implementation challenges. While Malawi, Tanzania and Uganda share many health system characteristics (strong public health structures, nurse-midwifery and non-direct entry into midwifery education), there are also distinct differences (Table 1). For example, Malawi and Tanzania have strong task-shifting policies in maternity care whereby mostly non-physician clinicians perform caesarean sections . In Uganda and Benin, in contrast, caesarean sections are performed exclusively by medical doctors. In Benin, direct entry into midwifery education is practised and maternity care is thus largely provided by midwives.
Targeted sites and participants
The trial will commence April 2021 for 30 months (Fig. 2). Trial hospitals were selected purposely to reflect the range of facilities and include typical hospitals currently caring for 30–50% of all births for the respective country . In March 2020, we consulted with national Ministries of Health and prepared a list of all hospitals meeting the selection criteria of i) minimum caseload of 2500 births per year required based on trial sample size calculation; ii) caesarean section and blood transfusion services available; iii) preferably located in rural districts; and iv) consisting of a mix of typical public but also private-not-for-profit (faith-based) hospitals. We included public and private-not-for-profit hospitals to reflect the typical landscape of hospitals in sub-Saharan Africa and improve our results’ generalizability. We then selected four hospitals in each country (Fig. 3).
The intervention directly targets health care providers involved in intrapartum care and all women who give birth in the participating hospitals during the study period. In this study, the term ‘maternity care providers’ refers to nurses, nurse-midwives, midwives, auxiliary staff and medically trained staff such as obstetricians working in the maternity ward at one of the study facilities. Women will be eligible if they give birth to a newborn weighing ≥1000 g, which is a proxy for viable gestational age in settings with poor gestational age measurement. Women who gave birth in another location but receive care in the hospital after childbirth will not be included in the study as our intervention targets the intrapartum period.
Intervention development was conceived in response to the SC1-BHC-19-2019 call from the European Commission to innovate and evaluate interventions to bridge the knowledge-do gap to improve health during the first 1000 days of life. Further, our intervention links to the 2030 Sustainable Development Goal agenda  and the Survive, Thrive, Transform aspirations of the United Nations .
The ALERT intervention focuses explicitly on the key elements of intrapartum care of i) admission, labour monitoring; ii) immediate maternal and newborn care; and iii) readiness and care for complications (Additional file 3). Thus, ALERT will cover all stages of labour, biologically effective interventions (such as appropriate admission, foetal monitoring, emergency preparedness like reducing time from decision to perform a caesarean section) and improving experience of care (such as promoting companionship and communication in the maternity wards).
Our intervention is based on previous research in conceptualising and evaluating care QI and training interventions [14, 26, 27] and learning from the large Safe Childbirth Checklist trial in India . Key intervention elements are continuous training and QI based on the assumption that the combination of these two is needed to address the underlying causes of inconsistent implementation of evidence-based practices.
Further, intervention development and adaptation rely on end-user participation to consider women, families, and health providers’ perspectives . The design pays attention to the experience of interaction between people and health systems. Understanding health systems responsiveness offers an opportunity to adapt care to changing clients/patients’ needs, promote women’s access to effective interventions and improve the quality of health services, ultimately leading to better health outcomes .
The intervention will include several training modules based on competency-based methodology and using the Laerdal Global health Mama Birthie low-cost models . The training will be made available to maternity providers, similar to the successful Helping Mothers and Babies Survive modules .
Mentorship is increasingly recognised as an effective strategy to improve healthcare quality, either as part of QI bundles or as a stand-alone intervention [32, 33]. The ALERT mentoring and leadership training intervention component will use a cascade approach with i) in-facility clinical mentors linked to the QI approach and training; ii) mentorship from in-country ALERT staff for the head of the maternity unit; and iii) mentoring within the international ALERT team. Mentoring will address individual professional attitudes, inter-professional collaboration (teamwork), leadership strengthening for resource negotiations, and other aspects.
The QI intervention aims to i) support the consistent implementation of the trainings provided; ii) address operational deficiencies identified during the formative research as part of the end-user participation strategies; and iii) support linkages between established maternal death review teams as well as other hospital improvement structures. We will use standard Plan-Do-Study-Act methodology. Data for follow-up will come from the perinatal e-registry or registers adapted to the type of data.
The intervention will be delivered by maternity care providers in the study hospitals and supported by our research teams who are based in national universities and well-placed to deliver training and engage with supporting QI approaches. Local hospital-based training and management resources will be mobilized and integrated. To support the ALERT intervention’s institutionalisation and sustainability, there must be strong leadership from the districts and collaboration with the Ministries of Health, training institutions, and integration into existing QI structures in each country. We further linked our training approach to training resources within the countries, thus trainers of trainers as available at national and subnational level.
In line with Juran’s trilogy and the WHO, we concur that promoting the combination of quality planning, control and improvement allows for more sustainable interventions . The QI intervention will be informed by the collaborative QI approach  and will explicitly link to QI approaches already implemented in the facilities. To bolster knowledge, an adapted QI refresher training will be provided including the PDSA and problem-solving methods. Bottlenecks identified during the health facility assessment, operational deficiencies identified during the ALERT competency-based training sessions, and recommendations arising from the maternal death reviews will be the target of PDSA cycles addressed by the QI team. The hospital-based QI team will be supported by our research team and the head of the maternity unit to develop and implement feasible, small scale solutions.
We recognise the barriers described to consistent implementation of QI particularly in resource-poor and understaffed settings [14, 36, 37]. PDSA cycles, although widely used, have been associated with limited effects [26, 38]. With this in mind, we plan to make adaptations to the collaborative QI approach in order to increase the effectiveness of the ALERT QI package (see Table 2 in additional file 3). By explicitly linking to the existing QI structures including perinatal audit and management, we aim to ease implementation and improve potential scalability [41, 42]. The mentoring approach linking to central national institutions is expected to improve accountability to support the structured and regular implementation of QI and thereby the needed control aspect as well as the link to the local management structures. The end-user participation element of the intervention design will allow the incorporation of quality planning which the WHO is now proposing as an essential component of QI .
This study includes three evaluations; 1) stepped-wedge trial; 2) realist process evaluation and 3) economic evaluation. The methods for each are described below.
Our primary outcome is in-facility early perinatal mortality defined as in-facility (fresh) stillbirth and 24-h neonatal mortality. Selected secondary and process outcomes are listed in Table 2. For a sub-sample of births, we will use lactate measurement using a simple point-of-care test (Nova Biomedical, StatStrip Xpress-I lactate) to obtain an objective measurement of hypoxic-ischaemic insults to be used in conjunction with the more subjective APGAR score due to interrater differences. It is suggested that lactate provides good predictive values on hypoxic-ischaemic insults as conventional pH measurement and base excess [43, 44]. Breastfeeding initiation will be assessed using information recorded in the perinatal e-registry and women’s reports at the time of discharge will be integrated into the exit interviews to determine responsiveness and experience of mistreatment.
Method of data collection
The primary and secondary outcome data will be collected through a perinatal e-registry and exit interviews with women being discharged following childbirth. The perinatal e-registry will include standard indicators of pregnancy risks and care received during the antenatal and perinatal period. The indicators were informed by similar clinical data collection in the European Union  and Tanzania . We will support standardised admission and follow-up case notes to improve continuous documentation during care provision. After short training sessions facilitated by research staff, data will be entered continuously in the maternity ward by midwifery staff or data clerks (based on country preference). Exit interviews will be administered by research staff every six months during the implementation period (six time points) to 50 randomly selected women who had given birth in each hospital. To assess responsiveness and mistreatment, we will use a recently validated questionnaire with some adaptations .
The ALERT perinatal e-registry will provide primary and some secondary outcomes and will be implemented in all study hospitals. All women who meet the eligibility criteria will be included. The perinatal e-registry data will be entered on the maternity ward using the Research Electronic Data Capture (REDCap) platform available on tablets or computers . The programme will have inbuilt ranges and branching logic programmed to improve data quality. Monthly data checking and feedback to providers will also be implemented. Weekly paper-based summary sheets will be used to check data completeness, and double-entry of data for 10% of the records will be done by an external facility supervisor. Supervision structures will include in-hospital supervision by an external resource to the maternity ward and by an ALERT research team data manager.
The Hemming et al. formula for stepped-wedge trials was used to calculate the study’s power . We used intra-cluster correlation coefficients for stillbirth and neonatal mortality from a study in Malawi  and maternal morbidity from a recent trial . The inclusion of 16 hospitals, each with at least 2500 births per year, will give sufficient power (75–80%) to detect a 25% reduction among in-facility early perinatal mortality with baseline rates between 1.4 to 2.0% and 95%-confidence intervals. We also have sufficient power to assess several secondary outcomes, including maternal morbidity (Additional file 4).
Randomisation will be stratified by country to ensure that hospitals are randomly selected and enrolled in six-monthly steps (four hospitals in four steps) in each country. Randomisation was performed by a statistician, independent from the implementation team, once the hospitals had consented to participate in the study. As with all training and QI interventions, we cannot blind participants (hospitals) to the intervention. However, women and families might not be aware of the exact step in the implementation of ALERT at the hospital where they give birth.
The statistical analysis will be “intention-to-treat”, comparing ALERT intervention clusters (hospital maternity wards) with comparison clusters where care is provided according to national standards. We will define a “transition” period of two weeks during which the intervention is provided and adopted by the respective hospitals.
We will use descriptive analysis to review the trends using interrupted time series analysis from the 30 months of data collection through the perinatal e-registry . Seasonal variations will be described (e.g. birth weight and neonatal mortality) [53, 54]. While secular declines in stillbirths and early neonatal mortality have been slow in the past; we expect annual declines of at least 2% . We will review secular trends over strata (countries) and clusters (hospitals) and estimate the heterogeneity of the effects across clusters as advised by Hemming et al. 
Considering the limited number of clusters, we will use generalised estimating equations (GEE) adjusting for clusters and for the small sample . We will adjust for clustering, time-trends and the sequence of inclusion of hospitals  and other methods to perform small-sample adjustments .
Additional sub-group analysis by stratification on select covariates such as birth weight, mode of delivery, time of delivery and type of outcomes will be conducted based on the power and sample size plausibility.
The realist process evaluation
We will assess how the intervention works by assessing how actors take up and implement the intervention components based on mechanisms that are triggered in specific contexts to generate the outcomes. We will analyse the differential effects of interventions in the ALERT settings: why is an intervention successful in one setting but perhaps without effect in another? The evaluation is structured along the realist research cycle , which starts with the development of an initial programme theory (Fig. 4).
The initial programme theory will be developed based on the ALERT theory of change, a review of the most current literature and discussions with ALERT researchers. We will adopt a multiple embedded case study design to test the initial theory. In each country, we will select one hospital where the ALERT intervention is implemented at step 1 of the stepped wedge design and a second hospital involved in step 3. This phased recruitment of facilities will enable us to assess how the length of exposure to the intervention and changes over time influence observed outcomes. Selecting two hospitals per country will allow for cross-case comparison and identifying how mechanisms play out differently in different hospital-specific contexts. In each hospital, data will be collected on the implementation of the intervention, the context, the actors and the processes triggered by the intervention through a document review and interviews with (1) hospital managers, heads of maternity, midwives and district directors of health, and (2) mothers and families. We will also draw upon data from other work packages and participatory reflection sessions at ALERT consortium meetings. Audio-recordings will be done on devices which allow data encryption and in case this is not possible, recordings will be immediately transferred to a computer where data can be encrypted. All recordings will be verbatim transcribed and translated to English where needed. All transcripts will be entered in a NVIVO database and pseudo-anonymized to the highest degree possible using identifiers and codes for key variables. The ICAMO heuristic will be used in the data analysis . The data will first be categorised using the intervention-actor-context-mechanism-outcome configuration. Next, a retroduction approach will be adopted, whereby explanations for the observed outcomes are identified by looking into the mechanisms, actual intervention modalities, actors and context elements. In-case and cross-case analysis will allow for the formulation of the ‘final’ programme theory, which will indicate what it is about the ALERT intervention that works for whom and in which circumstances. This will inform recommendations for scaling up the intervention and tailoring it to different contexts.
The economic evaluation
Closely linked with the realist and effect evaluation will be an economic evaluation of the ALERT intervention. According to Drummond et al., economic evaluation is defined as “the comparative analysis of alternative courses of action in terms of both their costs and consequences” . We propose to evaluate the economic impact of the ALERT intervention by conducting cost-effectiveness analysis, focusing on the mature intervention implemented in step three hospitals. The incremental cost-effectiveness ratio (ICER) will focus on the net costs per one reduction in stillbirth and in-facility perinatal mortality. We will utilise the Consolidated Health Economic Evaluation Reporting Standards (CHEERS) to optimise the reporting of our evaluation .
We will follow the European Union’s open-access policy and strive to make all ALERT training modules, reports, and scientific articles publicly accessible. We will utilise the following dissemination channels: leaflets, a website (alert.ki.se), workshops and meetings at the local (district) and national level, conference presentations (local, national, and international), and peer-reviewed publications and reports. Key stakeholders, including the study participants (i.e., end-users), Ministry of Health policymakers, and other stakeholders interested in improving maternal and child health will be proactively sought out, and findings from the study shared.
Innovation and potential impact
We will test an innovative multi-component intervention that was carefully conceptualised based on previous research [13, 14], which will be further refined based on the formative research. The co-design component recognises the need for continuous adaptations of QI, and we believe this is the first QI initiative in this field explicitly integrating formal end-user participation. The ALERT intervention also uses system thinking principles. In several settings across sub-Saharan Africa, interventions and policies to implement (and mainly maintain) the delivery of quality maternity care show inconsistent results. Quality care challenges are increasingly conceptualized as system-related complex problems.
Our study applies systems thinking by adopting a theory of change approach and implementing a process evaluation that is based on realist evaluation. It not only starts its empirical research from existing knowledge and theories but will also contribute to develop better theories on implementing QI initiatives in maternal health. Furthermore, the realist process evaluation allows for exploring and assessing the complex causal processes underlying the observed outcomes and identifying the required context factors. In that sense, it demonstrates how theory can be used in the three ways described by Nilsen (2015)  (1): to explain how implementation outcomes are shaped (2), to provide a solid foundation for evaluation of the implementation of interventions and (3) to assess and inform the translation of research findings into policy and practice.
High maternal and perinatal mortality rates and the large increases in the proportion of childbirths occurring in health facilities make it paramount to identify and evaluate interventions aimed at reducing mortality during birth, especially since relatively simple, cheap and effective evidence-based interventions are available. While there is good evidence that single component interventions improve health workers’ practices and health outcomes, our hypothesis is that our innovative ALERT package will work synergistically and lead to larger and sustainable reduction in in-facility mortality and morbidity. The element of end-user participation explicitly addresses the need to adapt QI to the needs in the settings . Our attention to leadership and mentoring responds to the findings that more holistic approaches are likely to lead to more ownership and sustainable changes .
We will work in hospitals that operate under resource-limited conditions. Too few midwifery providers care for a growing number of women. The lack of professional midwives is increasingly acknowledged globally . Various pathways in the ALERT intervention aim to strengthen the quality of intrapartum care and midwifery with a view on an enabling environment and improved knowledge management.
In recent years, many resources were committed to improving access to facility-based births to achieve the Millennium Development Goal 5 and now the SDGs – with major success . In view of these developments, quality of care in these facilities needs to be prioritised. We believe that quality of care and the resources available for maternity care must improve as hospitals care for an ever-increasing proportion of births and emergency referrals. Through stakeholder engagement, we anticipate that during the implementation of ALERT, resources available to hospitals, such as staff allocation, investment in physical infrastructure, medicines and medical supplies and other resources will increase. The leadership mentoring and quality of care improvement components of ALERT might contribute to this increase in resources.
Data collection will take place during the SARS-CoV-2 pandemic which impacts all kinds of daily life. This raises the need for innovative adjustments in terms of learning resources and training. As our protocol is affected by the COVID-19 pandemic, we are committed to work on resilient solutions for a post-pandemic situation. We will add knowledge to this new situation with appropriate digitalised technologies with regard to communication, teaching and evaluation.
Rigorous evaluations of multi-component interventions are needed and will add to the existing body of literature on what combination of components are best suited to improve intrapartum quality of care . Since ALERT is a multi-faceted intervention, each of the components will have its own set of implementation strengths and challenges. There is a need to contextualize each component and an opportunity to learn from a feasibility and acceptability perspective within a multi-country setting. Highlighting the necessity of measuring what works where and understanding the acceptability of each of the components in the different contexts.
There are some important methodological considerations for the ALERT trial. Additional variables related to COVID-19 were incorporated in the data collection tools after the initial ethics submission and approved by all institutional review boards as an amendment. The intervention development will consider the changed realities of providing care during the COVID-19 pandemic and post-pandemic period.
One could argue that the generalisability of the results of the stepped wedge study may be limited due to the small number of health facilities and countries included in the study. Furthermore, there may be some selection bias, as the study hospitals are large high-level hospitals that tend to have more high-risk, complicated pregnancies and births. However, because of its comparative design, its building upon existing evidence and theory, and its attention to context, the realist process evaluation’s empirical research will provide insights in the conditions that facilitate or inhibit the ALERT intervention, thus providing relevant information to policymakers in other countries.
Neonatal deaths and some important exposure variables such as gestational age are prone to reporting bias as ultrasound in early pregnancy is not routinely used. While we have designed our perinatal e-registry carefully, challenges in completeness and quality of documentation will need to be considered. Exit interviews to assess responsiveness and mistreatment are challenging as women might feel pressured to hide negative feelings and there are social risks in complaining. Differences in reported negative experiences between facility-based and community-based assessments have been reported . However, funding limitations do not allow us to conduct follow-up visits at home. We will carefully train interviewers to limit the social desirability bias.
Stepped-wedge designs are particularly susceptible to secular changes in the main outcome. Therefore, we will allow for a longer assessment period than a traditional parallel-group trial . However, the ALERT trial is implementing an perinatal e-registry to measure the outcome variable continuously, thus minimizing this challenge. We also plan to examine time trends and seasonality and identify the appropriate method to adjust for this. Finally, over the trial 30-month period, other interventions might occur in the hospitals, making it difficult to disentangle the effect of ALERT.
We believe our comprehensive evaluation using qualitative and quantitative methods will provide important information on the functioning and effects of QI in typical hospitals in sub-Saharan Africa and will further contribute to the evolving literature on the effects and processes of QI in maternal and new-born care.
Not yet recruiting.
Availability of data and materials
Quantitative datasets will be cleaned and made openly available in an open access online repository (Zenodo - https://www.zenodo.org/), after anonymisation alongside with meta-data, to facilitate data sharing and re-use. The training materials created during ALERT, publications, reports will be freely available on the ALERT website and disseminated through the ALERT networks. Qualitative data will not be made available to researchers outside the partner institutions. This decision was approved by the EU and is mainly based on three principles: 1) qualitative data are difficult to interpret or reuse without extensive knowledge of the context and how it was originally collected (i.e. experience and background of the data collector), 2) with the small number of hospitals included in the project it would be difficult to guarantee participants complete anonymity, and 3) the quality of the response may differ if participants knew their spoken word would be made available in an open repository.
Action Leveraging Evidence to Reduce perinatal morTality and morbidity
Incremental cost-effectiveness ratio
Sustainable Development Goals
World Health Organization
UN Inter-agency Group for Child Mortality Estimation. Level and Trends in Child Mortality: Report 2020. New York; 2020.
UN Inter-agency Group for Child Mortality Estimation. A Neglected Tradedy: The global burden of stillbirth. Report 2020. New York, Geneva and Washintgton: UN Inter-agency Group for Child Mortality Estimation; 2020.
WHO, UNICEF, UNFPA, World Bank Group, United Nations Population Division. Maternal mortality: Levels and trends 2000 to 2017. 2019. https://www.who.int/reproductivehealth/publications/maternal-mortality-2000-2017/en/. Accessed 11 Dec 2020.
Bhutta ZA, Das JK, Bahl R, Lawn JE, Salam RA, Paul VK, et al. Can available interventions end preventable deaths in mothers, newborn babies, and stillbirths, and at what cost? Lancet. 2014;384(9940):347–70. https://doi.org/10.1016/S0140-6736(14)60792-3.
Ahmed I, Ali SM, Amenga-Etego S, Ariff S, Bahl R, Baqui AH, et al. Population-based rates, timing, and causes of maternal deaths, stillbirths, and neonatal deaths in South Asia and sub-Saharan Africa: a multi-country prospective cohort study. Lancet Glob Health. 2018;6(12):e1297–e308. https://doi.org/10.1016/S2214-109X(18)30385-1.
Black RE, Victora CG, Walker SP, Bhutta ZA, Christian P, de Onis M, et al. Maternal and child undernutrition and overweight in low-income and middle-income countries. Lancet. 2013;382(9890):427–51. https://doi.org/10.1016/S0140-6736(13)60937-X.
Kerber K, Graft-Johnson J, Bhutta ZA, Okong P, Starrs A, Lawn J. Continuum of care for maternal, newborn, and child health: from slogan to service delivery. Lancet. 2007;370(9595):1358–69. https://doi.org/10.1016/S0140-6736(07)61578-5.
World Health Organization. WHO Recommendations Intrapartum care for a positive childbirth experience. 2018. http://www.who.int/reproductivehealth/publications/intrapartum-care-guidelines/en/. Accessed 29 Mar 2018.
Miller S, Abalos E, Chamillard M, Ciapponi A, Colaci D, Comandé D, et al. Beyond too little, too late and too much, too soon: a pathway towards evidence-based, respectful maternity care worldwide. Lancet. 2016;388(10056):2176–92. https://doi.org/10.1016/S0140-6736(16)31472-6. Review.
Tunçalp Ӧ, Were WM, MacLennan C, Oladapo OT, Gülmezoglu AM, Bahl R, et al. Quality of care for pregnant women and newborns—the WHO vision. Br J Obstet Gynecol. 2015;122(8):1045–9. https://doi.org/10.1111/1471-0528.13451.
Munabi-Babigumira S, Glenton C, Lewin S, Fretheim A, Nabudere H. Factors that influence the provision of intrapartum and postnatal care by skilled birth attendants in low- and middle-income countries: a qualitative evidence synthesis. Cochrane Database Syst Rev. 2017;11(2):CD011558. https://doi.org/10.1002/14651858.CD011558.pub2.
Bohren MA, Vogel JP, Hunter EC, Lutsiv O, Makh SK, Souza JP, et al. The mistreatment of women during childbirth in health facilities globally: a mixed-methods systematic review. PLoS Med. 2015;12(6):e1001847. https://doi.org/10.1371/journal.pmed.1001847.
Walker D, Otieno P, Butrick E, Namazzi G, Achola K, Merai R, Otare C, Mubiri P, Ghosh R, Santos N, Miller L, Sloan NL, Waiswa P, Preterm Birth Initiative Kenya and Uganda Implementation Research Collaborative. Effect of a quality improvement package for intrapartum and immediate newborn care on fresh stillbirth and neonatal mortality among preterm and low-birthweight babies in Kenya and Uganda: a cluster-randomised facility-based trial. Lancet Glob Health. 2020;8(8):e1061-e1e70. https://doi.org/10.1016/S2214-109X(20)30232-1.
Zamboni K, Singh S, Tyagi M, Hill Z, Hanson C, Schellenberg J. Effect of collaborative quality improvement on stillbirths, neonatal mortality and newborn care practices in hospitals of Telangana and Andhra Pradesh, India: evidence from a quasi-experimental mixed-methods study. Implement Sci 2021;16(1). https://doi.org/10.1186/s13012-020-01058-z.
Rowe AK, Rowe SY, Peters DH, Holloway KA, Chalker J, Ross-Degnan D. Effectiveness of strategies to improve health-care provider practices in low-income and middle-income countries: a systematic review. Lancet Glob Health. 2018;6(11):e1163–e75. https://doi.org/10.1016/S2214-109X(18)30398-X.
Rowe AK, Labadie G, Jackson D, Vivas-Torrealba C, Simon J. Improving health worker performance: an ongoing challenge for meeting the sustainable development goals. BMJ. 2018;362:k2813. https://doi.org/10.1136/bmj.k2813.
Siddiqi K, Newell J, Robinson M. Getting evidence into practice: what works in developing countries? Int J Qual Health Care. 2005;17(5):447–54. https://doi.org/10.1093/intqhc/mzi051.
Marchal B, Kegels G, Van Belle S. Realist evaluation in health policy and systems research: theory incarnate. In: Emmel N, Greenhalgh J, Manzano A, Monaghan M, Dalkin S, editors. Doing realist research. London: Sage Publication; 2018.
Puchalski Ritchie LM, Khan S, Moore J. al. e. Low- and middle-income countries face many common barriers to implementation of maternal health evidence products. J Clin Epidemiol. 2016;76(2016):229–37. https://doi.org/10.1016/j.jclinepi.2016.02.017.
Hemming K, Haines TP, Chilton PJ, Girling AJ, Lilford RJ. The stepped wedge cluster randomised trial: rationale, design, analysis, and reporting. Br Med J. 2015;350(feb06 1):h391. https://doi.org/10.1136/bmj.h391.
UNFPA, ICM, WHO. The state of the world's midwifery. A universal pathway. A women's right to health. 2014. https://www.unfpa.org/sites/default/files/pub-pdf/EN_SoWMy2014_complete.pdf. Accessed 27 Mar 2019.
Mullan F, Frehywot S. Non-physician clinicians in 47 sub-Saharan African countries. Lancet. 2007;370(9605):2158–63. https://doi.org/10.1016/S0140-6736(07)60785-5.
Hanson C, Munjanja S, Binagwaho A, Vwalika B, Pembe AB, Jacinto E, et al. National policies and care provision in pregnancy and childbirth for twins in eastern and southern Africa: a mixed-methods multi-country study. PLoS Med. 2019;16(2):e1002749. https://doi.org/10.1371/journal.pmed.1002749.
United Nations. Sustainable development goals. 2015. https://sustainabledevelopment.un.org/sdgs. Accessed 18 Feb 2021.
Every Woman Every Child, United Nations. Every woman every Child‘s global strategy for Women’s, Children’s and adolescents’ health 2016–2013. 2017. https://www.everywomaneverychild.org/ ().
Waiswa P, Manzi F, Mbaruku G, et al. Effects of the EQUIP quasi-experimental study testing a collaborative quality improvement approach for maternal and newborn health care in Tanzania and Uganda. Implement Sci. 2017;12(1):89. https://doi.org/10.1186/s13012-017-0604-x.
Alwy Al-beity F, Pembe A, Hirose A, et al. Effect of the competency-based helping mothers survive bleeding after birth (HMS BAB) training on maternal morbidity: a cluster-randomised trial in 20 districts in Tanzania. BMJ Glob Health. 2019;4(2):e001214. https://doi.org/10.1136/bmjgh-2018-001214.
Semrau KEA, Hirschhorn LR, Marx Delaney M, Singh VP, Saurastri R, Sharma N, et al. Outcomes of a coaching-based WHO safe childbirth checklist program in India. N Engl J Med. 2017;377(24):2313–24. https://doi.org/10.1056/NEJMoa1701075.
Greenhalgh T. Health evidence network synthesis report 49. Cultural context of health: the use of narrative research in the health sector: the World Health Organization. Regional Office for Europe; 2016.
Mirzoev T, Kane S. What is health systems responsiveness? Review of existing knowledge and proposed conceptual framework. BMJ Glob Health. 2017;2(4):e000486. https://doi.org/10.1136/bmjgh-2017-000486.
Laerdal Medical. MamaBirthie. https://laerdal.com/se/products/simulation-training/obstetrics-paediatrics/mamabirthie/. Accessed 18 Feb 2021.
Magge H, Anatole M, Cyamatare FR, Mezzacappa C, Nkikabahizi F, Niyonzima S, et al. Mentoring and quality improvement strengthen integrated management of childhood illness implementation in rural Rwanda. Arch Dis Child. 2015;100(6):565–70. https://doi.org/10.1136/archdischild-2013-305863.
Manzi A, Magge H, Hedt-Gauthier BL, Michaelis AP, Cyamatare FR, Nyirazinyoye L, et al. Clinical mentorship to improve pediatric quality of care at the health centers in rural Rwanda: a qualitative study of perceptions and acceptability of health care workers. BMC Health Serv Res. 2014;14(1):275. https://doi.org/10.1186/1472-6963-14-275.
World Health O. Quality health services: a planning guide. Geneva: World Health Organization; 2020.
Kilo CM. A framework for collaborative improvement: Lessions from the Institute for Healthcare Improvement's breakthrough series. Quality Management in Health Care. 1998;6(4):1–13. https://doi.org/10.1097/00019514-199806040-00001.
Zamboni K, Baker U, Tyagi M, Schellenberg J, Hill Z, Hanson C. How and under what circumstances do quality improvement collaboratives lead to better outcomes? A systematic review. Implement Sci. 2020;15(1). https://doi.org/10.1186/s13012-020-0978-z.
Moore GF, Evans RE, Hawkins J, Littlecott H, Melendez-Torres GJ, Bonell C, et al. From complex social interventions to interventions in complex social systems: future directions and unresolved questions for intervention development and evaluation. Evaluation. 2019;25(1):23–45. https://doi.org/10.1177/1356389018803219.
Larson E, Mbaruku GM, Cohen J, Kruk ME. Did a quality improvement intervention improve quality of maternal health care? Implementation evaluation from a cluster-randomized controlled study. Int J Qual Health Care. 2019;32(1):54–63. https://doi.org/10.1093/intqhc/mzz126.
Afulani PA, Phillips B, Aborigo RA, Moyer CA. Person-centred maternity care in low-income and middle-income countries: analysis of data from Kenya, Ghana, and India. Lancet Glob Health. 2018;7(1):e96–e109. https://doi.org/10.1016/S2214-109X(18)30403-0.
Lewis D, Downe S. FIGO consensus guidelines on intrapartum fetal monitoring: intermittent auscultation. Int J Gynecol Obstet. 2015;131(1):9–12. https://doi.org/10.1016/j.ijgo.2015.06.019.
Zamboni K, Schellenberg J, Hanson C, Betran AP, Dumont A. Assessing scalability of an intervention: why, how and who? Health Policy Plan. 2019;34(7):544–52. https://doi.org/10.1093/heapol/czz068.
Juran JM. The Quality Trilogy. A Universal Approach to Managing for Quality. ASQC 40th Annual Quality Congress; 1986; Anaheim, California; 1986.
Wiberg N, Källén K, Herbst A, Olofsson P. Relation between umbilical cord blood pH, base deficit, lactate, 5-minute Apgar score and development of hypoxic ischemic encephalopathy. Acta Obstet Gynecol Scand. 2010;89(10). https://doi.org/10.3109/00016349.2010.513426.
Allanson E, Waqar T, White C, Tunçalp Ö, Dickinson J. Umbilical lactate as a measure of acidosis and predictor of neonatal risk: a systematic review. BJOG Int J Obstet Gynaecol. 2017;124(4):584–94. https://doi.org/10.1111/1471-0528.14306.
Euro Peristat. Euro Peristat list of indicators. http://www.europeristat.com/images/doc/updated%20indicator%20list.pdf. Accessed 4 Aug 2018.
Kidanto H, Massawe S, Nystrom L, Lindmark G. Analysis of perinatal mortality at a teaching hospital in Dar Es Salaam, Tanzania, 1999-2003. Afr J Reprod Health. 2006;10(2):72–80. https://doi.org/10.2307/30032460.
Afulani PA, Diamond-Smith N, Golub G, Sudhinaraset M. Development of a tool to measure person-centered maternity care in developing settings: validation in a rural and urban Kenyan population. Reprod Health. 2017;14(1):118. https://doi.org/10.1186/s12978-017-0381-7.
Harris PA, Taylor R, Thielke R, Payne J, Gonzalez N, Conde JG. Research electronic data capture (REDCap)--a metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inform. 2009;42(2):377–81. https://doi.org/10.1016/j.jbi.2008.08.010.
Hemming K, Girling A. A menu-driven facility for power and detectable-difference calculation in stepped-wedge cluster-randomized trials. Stata J. 2014;14(2).
Pagel C, Prost A, Lewycka S, Das S, Colbourn T, Mahapatra R, et al. Intracluster correlation coefficients and coefficients of variation for perinatal outcomes from five cluster-randomised controlled trials in low and middle-income countries: results and methodological implications. Trials. 2011;12(1):151. https://doi.org/10.1186/1745-6215-12-151.
Vousden N, Lawley E, Nathan HL, Seed PT, Gidiri MF, Goudar S, et al. Effect of a novel vital sign device on maternal mortality and morbidity in low-resource settings: a pragmatic, stepped-wedge, cluster-randomised controlled trial. Lancet Glob Health. 2019;7(3):e347–e56. https://doi.org/10.1016/S2214-109X(18)30526-6.
Lopez Bernal J, Soumerai S, Gasparrini A. A methodological framework for model selection in interrupted time series studies. J Clin Epidemiol. 2018;103:82–91. https://doi.org/10.1016/j.jclinepi.2018.05.026.
Strand LB, Barnett AG, Tong S. The influence of season and ambient temperature on birth outcomes: a review of the epidemiological literature. Environ Res. 2011;111(3):451–62. https://doi.org/10.1016/j.envres.2011.01.023.
Eriksson L, Nga NT, Hoa DTP, Duc DM, Bergström A, Wallin L, et al. Secular trend, seasonality and effects of a community-based intervention on neonatal mortality: follow-up of a cluster-randomised trial in Quang Ninh province, Vietnam. J Epidemiol Community Health. 2018;72(9):776–82. https://doi.org/10.1136/jech-2017-209252.
Kujala S, Waiswa P, Kadobera D, Akuze J, Pariyo G, Hanson C. Trends and risk factors of stillbirths and neonatal deaths in eastern Uganda (1982–2011): a cross-sectional, population-based study. Tropical Med Int Health. 2017;22(1):63–73. https://doi.org/10.1111/tmi.12807.
Hemming K, Taljaard M, Forbes A. Analysis of cluster randomised stepped wedge trials with repeated cross-sectional samples. Trials. 2017;18(1):101. https://doi.org/10.1186/s13063-017-1833-7.
Hussey MA, Hughes JP. Design and analysis of stepped wedge cluster randomized trials. Contemp Clin Trials. 2007;28(2):182–91. https://doi.org/10.1016/j.cct.2006.05.007.
Fay MP, Graubard BI. Small-sample adjustments for Wald-type tests using Sandwich estimators. Biometrics. 2001;57(4):1198–206. https://doi.org/10.1111/j.0006-341X.2001.01198.x.
Marchal B, Van Belle S, Van Olmen J, Hoerée T, Kegels G. Is realist evaluation keeping its promise? A review of published empirical studies in the field of health systems research. Evaluation. 2012;18(2):192–212. https://doi.org/10.1177/1356389012442444.
Marchal B, Kegels G, Van Belle S. Theory and realist methods. In: Emmel N, Greenhalgh J, Manzano A, Monaghan M, Dalkin S, editors. Doing Realist Research: SAGE Publications; 2018. p. 79–90. https://doi.org/10.4135/9781526451729.n6.
Drummond M, Sculpher M, Claxton K, Stoddart G, Torrance G. Methods for economic evaluation of health care programmes. Forth ed. Oxford: Oxford University Press; 2015.
Husereau D, Drummond M, Petrou S, Carswell C, Moher D, Greenberg D, et al. Consolidated health economic evaluation reporting standards (CHEERS) statement. Value Health. 2013;16(2):e1–5. https://doi.org/10.1016/j.jval.2013.02.010.
Nilsen P. Making sense of implementation theories, models and frameworks. Implement Sci. 2015;10(1):53. https://doi.org/10.1186/s13012-015-0242-0.
Nove A, Friberg IK, De Bernis L, et al. Potential impact of midwives in preventing and reducing maternal and neonatal mortality and stillbirths: a lives saved tool modelling study. Lancet Glob Health. 2021;9(1):e24–32. https://doi.org/10.1016/S2214-109X(20)30397-1.
Montagu D, Sudhinaraset M, Diamond-Smith N, et al. Where women go to deliver: understanding the changing landscape of childbirth in Africa and Asia. Health Policy Plan. 2017. https://doi.org/10.1093/heapol/czx060. [Epub ahead of print].
Kruk ME, Kujawski S, Mbaruku G, Ramsey K, Moyo W, Freedman L. Disrespectful and abusive treatment during facility delivery in Tanzania: a facility and community survey. Health Pol Plan. 2014;33(1):1–8. https://doi.org/10.1093/heapol/czu079.
Hargreaves JR, Copas AJ, Beard E, Osrin D, Lewis JJ, Davey C, et al. Five questions to consider before conducting a stepped wedge trial. Trials. 2015;16(1):350. https://doi.org/10.1186/s13063-015-0841-8.
The ALERT study team is a consortium of researchers and implementers of eight institutions across Europe, Benin, Malawi, Tanzania and Uganda. This group developed the ALERT project and is responsible for implementing and evaluating the multi-faceted intervention. The composition of the group is as follows.
This study is part of the ALERT-project which is funded by the European Commission’s Horizon 2020 (No 847824) under a call for Implementation research for maternal and child health. The contents of this article are solely the responsibility of the authors and do not reflect the views of the European Union (EU). This study proposal has been independently peer-reviewed by the EU. Open Access funding provided by Karolinska Institute.
Ethics approval and consent to participate
Written informed consent will be obtained from each study participant. We received ethical approval from the local and national institutional review boards as follows: Karolinska Institutet, Sweden (Etikprövningsmyndigheten—Dnr 2020–01587). Uganda National Council for Science and Technology (UNCST)— (HS1324ES). Muhimbili University of Health And Allied Sciences (MUHAS) Research and Ethics Committee, Tanzania (MUHAS-REC-04-2020-118) and The Aga Khan University Ethical Review Committee, Tanzania (AKU/2019/044/fb). College of Medicine Research and Ethics Committee (COMREC), Malawi—(COMREC P.04/20/3038). Comité National d’Ethique pour la Recherche en Santé, Cotonou, Bénin—(83/MS/DC/SGM/CNERS/ST). The Institutional Review Board at the Institute of Tropical Medicine Antwerp and The Ethics Committee at the University Hospital Antwerp, Belgium—(ITG 1375/20. B3002020000116).
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Additional file 1.
CONsolidated Standards of Reporting Trials (CONSORT) for stepped-wedge cluster randomised trial (SW-CRT).
Additional file 2.
Standards for Reporting Implementation Studies (StaRI).
Additional file 3.
ALERT intervention description.
Additional file 4.
Sample size calculation (ICC, Inter Cluster Coefficient).
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
About this article
Cite this article
Akuze, J., Annerstedt, K.S., Benova, L. et al. Action leveraging evidence to reduce perinatal mortality and morbidity (ALERT): study protocol for a stepped-wedge cluster-randomised trial in Benin, Malawi, Tanzania and Uganda. BMC Health Serv Res 21, 1324 (2021). https://doi.org/10.1186/s12913-021-07155-z
- Perinatal health
- Maternal health
- Intrapartum care
- Respectful maternity care
- Health system intervention
- Sub-Saharan Africa