Skip to main content

From purists to pragmatists: a qualitative evaluation of how implementation processes and contexts shaped the uptake and methodological adaptations of a maternal and neonatal quality improvement programme in South Africa prior to, and during COVID-19

Abstract

Background

Despite progress, maternal and neonatal mortality and still births remain high in South Africa. The South African National Department of Health implemented a quality improvement (QI) programme, called Mphatlalatsane, to reduce maternal and neonatal mortality and still births. It was implemented in 21 public health facilities, seven per participating province, between 2018 and 2022.

Methods

We conducted a qualitative process evaluation of the contextual and implementation process factors’ influence on implementation uptake amongst the QI teams in 15 purposively selected facilities. Data collection included three interview rounds with the leaders and members of the QI teams in each facility; intermittent interviews with the QI advisors; programme documentation review; observation of programme management meetings; and keeping a fieldwork journal. All data were thematically analysed in Atlas.ti. Implementation uptake varied across the three provinces and between facilities within provinces.

Results

Between March and August 2020, the COVID-19 pandemic disrupted uptake in all provinces but affected QI teams in one province more severely than others, because they received limited pre-pandemic training. Better uptake among other sites was attributed to receiving more QI training pre-COVID-19, having an experienced QI advisor, and good teamwork. Uptake was more challenging amongst hospital teams which had more staff and more complicated MNH services, versus the primary healthcare facilities. We also attributed better uptake to greater district management support. A key factor shaping uptake was leaders’ intrinsic motivation to apply QI methodology. We found that, across sites, organic adaptations to the QI methodology were made by teams, started during COVID-19. Teams did away with rapid testing of change ideas and keeping a paper trail of the steps followed. Though still using data to identify service problems, they used self-developed audit tools to record intervention effectiveness, and not the prescribed tools.

Conclusions

Our study underscores the critical role of intrinsic motivation of team leaders, support from experienced technical QI advisors, and context-sensitive adaptations to maximise QI uptake when traditionally recognised QI steps cannot be followed.

Peer Review reports

Background

Healthcare quality entails the delivery of effective, safe, and people-centered services. Quality is an indicator of how well a health system functions [1]. Quality improvement (QI) is a strategy used for healthcare workers (HCWs) to reconfigure care with existing resources to improve healthcare quality [2], patient health outcomes, and to strengthen HCWs’ professional development [3].

QI programmes, developed in high-income countries, are increasingly used for maternal, neonatal, and child health (MNCH) in low-and-middle income countries (LMICs) [4,5,6]. QI models used in these programmes, such as the Lean, Sigma, QI collaboratives, and Plan-Do-Study-Act cycles (PDSA), have overlapping methodologies. These include data-driven problem identification and assessment of intervention effectiveness [5]. Relevant to this study, is the PDSA model: Plan entails developing the Quality Improvement Plan (QIP), also referred to as a ‘change idea’, and how to measure its effectiveness; Do is implementing the QIP; Study is assessing the QIP effectiveness; and Act is adopting, adapting, or abandoning the QIP [7]. QIPs comprise sets of minor changes tested on a small scale, and when adopted and taken to scale, can result in significant improvements [5].

Other principles such as collaborative learning between teams and using QI experts as mentors, are integral to QI [8,9,10]. Typically, facilities where a QI programme is implemented, will send HCWs for training, who establish a QI team upon their return. A ‘collaborative learning system’ is created amongst these QI teams, who periodically meet for ‘learning and spread workshops’. Here, they present successes and lessons learned that facilitates peer training and collaborative learning [8]. The QI experts, also called ‘mentors’, ‘coaches’, or ‘advisors’, provide technical support to the teams and help them maintain momentum between learning sessions [8].

QI for maternal and neonatal health (MNH) covers care from pregnancy to the first 28 days post-partum. These programmes aim, for example, to promote early registration and attendance of antenatal care; improve pregnancy-induced hypertension management; and introduce triaging at key moments along the care continuum [2, 6, 11]. They also address general topics, such as the quality and use of routine data [12]; facility infection control [13]; and the performance of community healthcare workers (CHWs) who support mothers and neonates [14]. Through improving these, and other service delivery aspects, QI programmes can prevent avoidable maternal and infant mortality.

In South Africa (SA) notable inroads were reported towards reducing maternal and neonatal mortality, and still births. The maternal mortality ratio decreased from 173 per 100,000 live births in 2000 to 127/100,000 in 2020 [15]; the neonatal mortality rate was reduced from 17/1,000 live births in 2000 to 11/1000 in 2021 [16]; and the still birth rate dropped from 21/1,000 live births in 2000, to an estimated 16.2/1,000 in 2020 [17]. COVID-19 impacted these mortality rates negatively in SA. Pattinson et al. compared the April 2020 to March 2021 COVID-19 period with the same period pre-COVID-19, and estimated an increase of 40%, 3% and 10% respectively in maternal and neonatal mortality, and stillbirths [18]. Some maternal and perinatal deaths can be prevented by improving the quality of care [19, 20]. Globally, improving the quality of care can reduce approximately 28% of maternal and neonatal deaths respectively, and 22% of still births [21].

Though QI effectiveness is reported in many MNCH studies [14, 22, 23], improvements are modest in comparison with its potential [24, 25]. An effectiveness review reported overall significant outcomes in MNCH and non-MNCH outcomes, but cautioned against unqualified optimism, as a third of the studies were of poor methodological quality [10]. In this paper we focus on three confounders that impact QI effectiveness, namely implementation processes, contexts, and team leader agency, defined as motivation and taking ownership of their work [26]. An example of implementation processes is employing QI advisors to improve CHW performance [14]. In another review, Taylor and colleagues concluded that inconsistent implementation of QI principles negates positive outcomes. The ‘inconsistency’ mainly refers to teams failing to implement the methodology as it was meant to be [27]. The importance of contextual factors is evident in reported positive associations between management support to frontline HCWs and positive outcomes [28], and in the conclusion drawn in a systematic review that outcomes will improve if QI programmes are embedded in existing structures [29]. Leaders’ impact on team functioning is well documented, for instance when they create psychological safety for members, it improves their learning [30, 31].

The SA National Department of Health (NDoH) led a multi-partner, MNH QI programme, called Mphatlalatsane (meaning ‘the bright star before dawn’), between 2018 and December 2022. The programme aimed to reduce maternal and neonatal mortality, and stillbirth rates by up to 50% in 21 facilities, across four districts in three provinces in SA. In this paper we present the results of a qualitative assessment of facility level implementation processes and contexts, with the aim of understanding how these shaped the Mphatlalatsane QI teams’ uptake and QI methodological fidelity. Elsewhere we will report on the macro and meso level contexts and processes, as this was a separate evaluation piece.

Methods

This was a qualitative evaluation of the Mphatlalatsane QI teams between February 2020 and November 2022, and a sub-study of a larger mixed-methods evaluation of Mphatlalatsane [32]. Ethical approval was obtained from the South African Medical Research Council in 2020 (EC019-11/2019), and Stellenbosch University, South Africa, in 2021 (S21/05/096).

Setting

The Mphatlalatsane intervention was embedded within the existing MNH services and implemented through the national and provincial departments of health. The participating provinces were Mpumalanga, Limpopo, and Eastern Cape (Fig. 1).

Fig. 1
figure 1

Mphatlalatsane implementation districts

The 21 facilities, seven per province, were purposively selected to reflect the referral pathways (Fig. 2) in four districts, and represent below-average to average performance on a peri-natal indicator matrix. The peri-natal indicator matrix was calculated by comparing the routinely collected data, from the NDoH’s District Health Information System, for institutional maternal mortality ratio, institutional neonatal mortality ratio, stillbirth rate, and early neonatal mortality rate. All the facilities conducting deliveries within the district were then ranked, and facilities with the lowest performance in all the indicators were selected for the project (Personal communication)Footnote 1. Three of the districts are largely rural [33,34,35], but 91% of the population in the fourth district, urbanised [33] (see Additional file 1 for the districts’ socio-economic and health indicators). The seven facilities included two primary healthcare (PHC) clinics, feeding into two community health centres (CHCs), which in turn feed into two district hospitals that feed into a regional hospital. A Project Management Steering Committee (PMC) comprising the NDoH and implementation partners oversaw programme implementation.

Fig. 2
figure 2

Referral pathway

The PMC spent most of 2018 and 2019 on preparations and the implementation period commenced with the first QI training of HCWs (September 2019) by the Institute for Healthcare Improvement (IHI), on the PDSA model. To further ensure the programme was embedded within existing healthcare services, the trainees were existing facility staff, nominated by facility management to attend the training. Apart from being senior MNH staff, no other uniform selection criteria were used. Upon returning from the training, the trainees, together with the facility management, appointed one of the trainees as team leader. The trainees, with facility management input, recruited team members from their fellow facility colleagues. Team size ranged from four to 12 members. Districts 1 and 2 were trained in September 2019, and had six months of implementation before the onset of COVID-19. District 1 teams had two more trainings in March 2020 before national COVID-19 lock-down measures were enacted. Districts 3 and 4 teams attended one training in February 2020, with one month of implementation pre-COVID-19 lockdown. The Clinton Health Access Initiative (the programme partner responsible for coordinating the Mphatlalatsane implementation), appointed and funded the QI advisors (interchangeably referred to as ‘advisors’), one each for Districts 1 and 2 respectively, and one who managed Districts 3 and 4. Team leaders and team members did not receive additional payment for participating in Mphatlalatsane. (More detail about the programme design and pre-implementation history can be found here [36].)

Sampling

For this evaluation, we purposively selected 15 of the 21 facilities (Table 1) to represent the range of facility types, MNH services, and rural and urban settings. We also selected well and less well-performing facilities from a pre-intervention readiness assessment from the NDoH. After selecting the facilities, we asked the advisors to confirm that our sample was a true representation of all Mphatlalatsane facilities. One facility declined participation as their QI activities ceased following COVID-19. One facility had two QI teams, the rest one, thus from the 14 facilities, 15 teams participated in the evaluation.

Table 1 Participating facilities

Participants

There were five QI advisors over the implementation period participating in the evaluation. We recruited all team leaders (interchangeably referred to as ‘leaders’), who in turn recruited 47 team members (also referred to as ‘members’), across the 15 teams. Given leader change in two teams, 17 leaders participated.

QI advisors

Over the implementation period (September 2019 to December 2022), there were five advisors. The initially appointed advisors in the Eastern Cape and Mpumalanga resigned respectively in March and July 2021. The new Eastern Cape advisor was appointed in August 2021, leaving these teams without an advisor for four months. The new Mpumalanga advisor was appointed in September 2021, leaving these QI teams without an advisor for one month. The Limpopo advisor resigned in August 2022 but was not replaced. Four advisors had extensive QI training from reputable institutions. These four had between 17 months and 15 years of QI mentoring experience. The five of them were between 30 and 55 years old, with four being female and one, male.

Team leaders

The 17 team leaders were all female. Since the Mphatlalatsane aim was to reduce maternal and perinatal mortality and still births, the facility management selected more senior staff from the maternity wards; one was a doctor and the others, midwives. In the clinics and two CHCs, the leaders were the facilities’ operational managers (OPMs). In the other three CHCs, and all district and regional hospitals, the leaders were OPMs in one of the maternity unit’s wards. Leader demographics were similar across the districts: they were seasoned HCWs with an average of 28 years in nursing, and working for ten years or more at their respective facilities. Leaders had on average eight years’ management experience, except for the District 4 leaders’ who averaged two years’ management experience. The two leader replacements were respectively in District 1 and 2.

Team members

They were predominantly female (n = 45; 96%). Since they were, by team leaders’ and facility management’s choice more junior staff, all were professional nurses, except for one data clerk. Districts 1–3 members were more experienced HCWs, on average 22 years in nursing versus the eight for the District 4 members. Districts 1–3 members had on average been working for 17 years at their respective facilities versus the three years for District 4 members. Though District 4 had two facilities participating in the evaluation, one facility manager opted not to have members participating in the evaluation.

Data collection

The evaluation comprised several data sources and collection methods, summarised in Table 2.

Table 2 Data sources and participant roles

QI advisor interviews and their programme documentation

Data collection with the advisors commenced in February 2020, and continued thereafter approximately every second month until November 2022, totaling 37 interviews. Before data collection, the lead author (WO) briefed them on the evaluation and obtained their signed, informed consent. Most of the interviews were joint interviews, but some individually conducted when all were not available. We used Microsoft Teams  (https://www.microsoft.com/en/microsoft-teams/group-chat-software), for the interviews. The interviews focused on their daily interactions with teams; leaders’ and teams’ performance; and what impacted implementation uptake, including district support. We reviewed their programme documentation for information on implementation processes and progress. The advisors agreed with our description of teams’ methodological adaptations.

Team leader and team member individual/group interviews and team programme documentation

Due to a delay in ethical approval and given COVID-19, WO briefed the facility managers, leaders, and members about the evaluation in April 2021. Participants recruited at the three data collection timepoints (May 2021 - Timepoint 1, September 2021 - Timepoint 2, and September 2022 - Endpoint), received the same briefing. We collected a signed, informed consent letter from participants before the interviews.

We conducted a total of 71 interviews: 32 individual interviews with leaders and 39 individual/group interviews with members (Table 3). The group interviews comprised between two and four participants. All interviews were on average 42 min long. Except for the replacement leaders and one District 2 facility, leaders were interviewed more than once. Members were interviewed once, except in one District 2 facility where some participated in two interviews.

Table 3 Team leader and Team member participants and interviews

All interviews were conducted in-person at facilities, in a private space, and at a time convenient to participants. We asked leaders to identify team members for the evaluation, particularly those who were part of the team since inception. By leader choice, leaders and members were individually interviewed, and the group interviews were either with the leader and team members jointly, or members only. The interviews focused on their training; how the teams were set up and functioned; their successes and challenges; and how COVID-19 impacted service delivery and team functioning. At Timepoint 1 and the Endpoint we reviewed teams’ QI documentation.

PMC: programme documentation and meetings

The PMC allowed the team of the larger evaluation, access to programme documents and meeting minutes. Attending these meetings provided insights into implementation planning, processes, and progress.

Fieldwork journal

WO recorded his reflections of fieldwork and attendance of PMC meetings.

With the participants being conversed in English, all interviews were conducted in English, audio recorded, and transcribed. WO, male, collected all the data.

Analysis

We used the Consolidated Framework for Implementation Research (CFIR) [37] to analyse the factors that shaped implementation uptake, and to interpret the core and peripheral intervention components. The CFIR defines ‘core components’ as the parts without which an intervention is no longer the planned intervention. ‘Peripheral components’ are adaptable components that do not compromise core intervention components.

WO verified the transcripts’ accuracy against the recordings. The transcripts, journal and observation notes were loaded on Atlast.ti, 8.1 (https://atlasti.com/), and analysed. Information from the programme documentation relevant to the evaluation was copied into a Word document and analysed in Atlas.ti. We applied the thematic analysis method developed by Graneheim and Lundman [38]. WO coded Timepoint 1 transcripts, and the first few advisor interviews. Following discussions with XH and TC, the coding list was amended, and thereafter the remaining data was coded. New codes emerging from Timepoint 2 and Endpoint data were added to the initial list. The codes were grouped into categories of sub-themes and these into broader themes that elucidated the factors impacting implementation uptake and implementation fidelity of the QI model. Coding and analysis were refined at regular team meetings between WO, XH, and TC. Results are presented across four themes: (i) implementation processes shaping uptake, (ii) contexts shaping uptake, (iii) leader’s intrinsic motivation shaping uptake, (iv) and methodological fidelity. ‘Processes’ are considered the Mphatlalatsane implementation activities [37], and ‘contexts’, the environment [39], in which these activities were implemented.

We defined ‘Implementation uptake’, or ‘uptake’, as a team’s use of QI methodology to develop, implement, and adopt, adapt, or abandoned a QIP. Given the importance of the advisors in implementation uptake, the uptake period ran from the 1st training until March 2021, before the first advisor resigned: for Districts 1 and 2, the uptake period was between September 2019 and March 2021, and for Districts 3 and 4, between February 2020 and March 2021. ‘Low uptake teams’ were teams who adopted only one adopted QIP during the uptake period, and whose leaders did not report routine use of QI principles to solve problems other than identified for their QIP. ‘High uptake teams’ were those who adopted two or more QIPS during the uptake period, and had leaders reporting routine use of the methodology to address all manner of challenges in the facility. WO, in consultation with XH and TC, did the uptake assessment. No effectiveness data of sustained change idea outcomes were available for high versus low uptake teams, at the time of writing up the results.

Results

Implementation uptake

The timeline (Fig. 3) details the training, COVID-19 and advisor resignations, all events that impacted uptake.

Fig. 3
figure 3

Implementation timeline, September 2019 - December 2022

We assessed eight of the 15 participating teams as high implementation uptake teams (Table 4). Of these eight, five were in District 1, two in District 2, 0 in District 3, and 1 in District 4. There was one low uptake team in District 1, four in District 2, and one each in Districts 3 and 4.

Table 4 Number of high uptake facilities, September 2019 to March 2021, by district and facility type

Key thematic findings

Implementation processes shaping uptake

QI team training quantity

The teams in District 1, the best uptake district, received three trainings over eight days, and these trainees became IHI certified QI champions, i.e. someone who can lead QI activities. The Districts 2–4 teams only attended one, three-day training. All trainees were QI naïve, and eight days of training an advantage over three days, as a low uptake leader commented about receiving only one training:

“You certainly need a good understanding of what’s needed. So, you need training, and not just once-off training, it needs to be constantly refreshed.” (Leader, low uptake team).

An advisor also confirmed the importance of training quantity:

“So, I think another reason why there’s a difference between uptake between Districts 3 and 4, and District 1, is the fact that they had more … formal training with IHI compared to Districts 3–4.” (Advisor).

The leaders provided QI induction to the members, and it is likely that the two more trainings resulted in District 1 teams receiving a more thorough induction compared to the other districts’ teams.

Pre-COVID-19 lead time

Districts 3 and 4 teams had a month post-training implementation with in-person advisor support before COVID-19 lockdown in March 2020, versus the six months’ implementation time and in-person advisor support for Districts 1 and 2 teams. While the lockdown disrupted uptake for all teams, Districts 1 and 2 had a better chance to recover from COVID-19 shocks and regain their pre-COVID lockdown momentum because of a longer lead time. We associated the better uptake in District 2 compared to Districts 3 and 4, with the formers’ longer pre-COVID-19 implementation time, as observed by the Districts 3, 4 advisor:

“Some facilities decided to keep their [first QI] projects that they had started in March [2020],

because they didn’t have time to actually try out their [first] change ideas [before COVID-19 started].” (Advisor).

QI advisors

The QI advisors played a crucial role, in particular supporting low uptake teams as shown in the following quotes:

“Researcher: … are you going to take on another project?

Leader: I’m not sure because Advisor A was supposed to come on the 13th. She didn’t come. So, I don’t know … she said we’ll complete these ones so we [can] take another one.” (Leader, low uptake team).

“… [we did nothing, following the training] until Advisor B came to support us, saying: ‘Hi people, you must start.’” (Leader, low uptake team).

While the advisors’ role was less crucial for the high uptake teams, these teams would also have struggled without their mentoring:

“And then they [advisors] would ask, how are you going to change? Then we told them that we were going to do 'this and this and this’. And then they came and did the support visits and looked at what we were doing.” (Leader, high uptake team).

Whilst the advisors had the same level of dedication, work ethics, and sound interpersonal skills, Districts 3 and 4 shared an initially appointed advisor who did not have the extensive QI training and mentoring experience as her Districts 1 and 2 colleagues. She also had the complexity of interacting with two district management structures. With the advisors being pivotal to uptake, Districts 1 and 2 had an advantage with their more experienced advisors.

Teamwork

High uptake teams had a core team, the leader plus three or four members, responsible for the identification of a service delivery challenge, the root cause analyses, and developing the QIP. They then identified ad-hoc members to implement the QIP. Soliciting the input from the ad hoc members on the QIP ensured their buy-in and made for good teamwork, as a high uptake team member succinctly stated:

“QI is not a one-man (sic) thing.” (Member, high uptake team).

This was in sharp contrast with the views of low uptake leaders who complained about the lack of teamwork:

“Each and every one is busy in their corners …” (Leader, low uptake team).

“When I’m not there, they are not doing it [QIP implementation].” (Leader, low uptake team).

Contexts shaping uptake

COVID-19, March - August 2020

The first two COVID-19 waves, March - September 2020 [18], severely disrupted service delivery at the facilities. Hospitals suffered most because all COVID-19 patients were sent there. In all facilities, team members were redeployed to activities to curb the pandemic, and their workload increased when colleagues were infected and having to isolate; staff assigned to treat a COVID-19 patient in an isolated room left fewer staff in the unit; and COVID-19 protocols demanded additional paperwork:

“Then in the Covid area there are more additional paper to be written [referring to their statistics]. They [district management] phone now and then. They want you for 'this and this’ … A lot of paperwork is done together with the patient who needs special attention. Then really, we experienced a work overload.” (Member, high uptake team).

Most participants also described the emotional trauma they suffered during the early stages of the pandemic:

“… we had one colleague who nursed Patient X … then she [the colleague] was ill, admitted and died … We knew Covid killed somebody … but we never experienced it in our family, so to say. So, when it started coming inside our workplace, families, we were really, really shaken.” (Member, high uptake team).

“For the first time when we heard about the issue of Covid, we were scared and fear of unknown. That is psychologically why we were so affected because we didn’t even know where to start and how to nurse.” (Member, high uptake team).

During lockdown there were initially district moratoriums for the QI advisors to call facilities and conduct in-person facility visits which further impeded QI work. When the moratoriums were lifted, advisors still struggled to get hold of the leaders, and when they did, their support turned into “counselling sessions” (Advisor), because of what they shared with the advisors:

“So, the call can go two ways. You can get them to be calm so that you review it [QI activities], or sometimes they will be on the call as a debriefing, you won’t necessarily get anything out of the QI work but what they’ll be telling you is sort of a debrief on how they struggle with staff shortages, PPE [Personal Protection Equipment], have isolation rooms set up ….” (Advisor).

Facility type

The better uptake of QI in clinics and CHCs compared to hospitals, was likely due to smaller patient volumes and less complex staffing and service arrangements in these facilities: CHCs reported approximately 47 deliveries per month, versus the district hospitals’ approximately 400, and 600 in the regional hospitals. Deliveries in clinics were rare events. As an advisor observed:

“So, the hospitals, whenever I go for facility visits, I make sure that I visit the hospitals because of their complex systems. So, they normally struggle with their QI project.” (Advisor).

Uptake in the hospitals and CHCs also suffered because they rendered 24-hour services, which meant having night duty staff. QI team meetings happened during day time and members moving to night shift, made it challenging to reach them with QI information and activities, as a team member noted:

“Unfortunately, I was night off and I was excluded of the session. Then it’s difficult to reconnect, that is one of the main challenges.” (Member, low uptake team).

Facility context

The District 3 facility was affected by industrial action before and during COVID-19 that were not limited to the Mphatlalatsane team. According to the QI leader this negatively affected her team’s morale given the general disgruntlement in the facility. Consequently, the new District 3 advisor focused on rebuilding team morale:

“Because in a meeting with the team we agree on change ideas that we want to implement. But when they communicate this to the rest of the team, the team does not do as was decided … they are not interested. That is why we have decided to have a session of team building …” (Advisor).

This was how a team member experienced the negative facility context:

“2020 was such a year and we had a lot of strikes here. It was not a happy year here … We were struggling … The old management had left and the new management was starting over, and the staff were not pleased. There was a lot of controversy that was happening.” (Member, low uptake team).

District support

Province-wide travel restrictions, due to budget constraints and not COVID-19, made it very challenging for District 2 management to visit their Mphatlalatsane facilities. While District 1 management often accompanied the advisor on support visits, the District 2 advisor felt the absence of district support:

“With regards to the district supporting QI activities, I have not seen much support mainly because they are unable to travel to the facilities, due to the budget constraints … The only thing that they will do if we are communicating that we will be at facilities, they will try to get some of the local area managers to be part of that support, but the district itself, I think it’s only been once or twice where I’ve had a district person be part of the QI visits.” (Advisor).

To a team leader of a well-performing team, district support was an important motivation for QI uptake:

“They’ll [district management] be supporting us. And the other staff members will see that no, this thing is very real. Yes, it’s very real because even our senior managers are coming in here.” (Team leader, high uptake team).

Team leader’s intrinsic motivation shaping uptake

The following two quotes illustrate how QI resonated differently with high and low uptake leaders:

“Researcher: Can you recall what the training was like?

Leader: Oh, I loved it. It was so exciting … they actually taught us a different way of looking at your problem or your challenges and how to go about identifying and solving your problem. It made sense to me.” (Leader, high uptake team).

Conversely, for this low uptake leader the method did not make sense:

“We are clinicians, we’re not researchers. We don’t know how to do research [referring to the data-driven processes of QI]” (Leader, low uptake team).

This difference in attitude affected leaders’ focus on QI activities, leading some to say their busy schedules precluded team meetings.

“We have planned that we’re going to do that from month-to-month, how is your data, what have you done better … it is not happening because it’s difficult for us to meet.” (Leader, low uptake team).

This is in contrast with a high uptake leader’s positive view of QI:

“Researcher: … do you find it difficult to be involved in Mphatlalatsane as an additional piece of your day-to-day work?

Leader: No. I found Mphatlalatsane as enriching … It’s not an extra load. It’s a powerful project which assists us on how to manage these pregnant women.” (Leader, high uptake team).

Methodological fidelity

All teams were acting like ‘QI purists’ by following their training on the PDSA model to the letter during the pre-COVID-19 lead time. They used data to identify service delivery gaps and draft their ‘Aim and Problem statements’; used prescribed templates for root cause analyses [40], either the Fishbone (mostly), or Process flow methods (occasionally); and meticulously recorded their PDSA cycles. They developed self-initiated audit tools, with auditing defined as monitoring adherence to treatment standards [11], to record the implementation of their QIP interventions. The data from these homegrown tools were then transferred onto run charts to track the effectiveness of the QIPs.

Methodological adaptations due to COVID-19

For five months, (April - August 2020), QI teams hardly managed routine MNH services, let alone continued with their QI work. With in-person advisor support resuming and the number of patients with COVID-19 subsiding around September 2020, most teams (high and low uptake), revived their QIPs, but with several adaptations to their pre-COVID-19 methodology. Though teams kept to data-driven identification of service delivery challenges; did root cause analyses; and still developed audit tools to review QIP effectiveness, the following adaptations were observed:

  1. 1.

    Teams did not maintain their QI documentation, for example they no longer kept typed records of ‘Problem and Aim statements’, root cause analyses, or PDSA cycles;

  2. 2.

    Run charts were not compiled, however, on advisor requests, leaders were able to compile evidence of effectiveness from their audit tools;

  3. 3.

    Weekly team meetings were replaced with sporadic meetings; and

  4. 4.

    Rapid PDSA cycles changed to cycles with no specific time frames.

The first five months of COVID-19 also changed in-person advisor mentoring to remote support through WhatsApp, land-line calls, emails, and an IHI virtual contact tool. This may have contributed to teams feeling less pressured to maintain a purist use of IHI’s PDSA model they were trained on.

Non-COVID-19 factors confounding methodological fidelity

There were two non-COVID-19 issues that may have added to why teams started adapting the QI methodology. Firstly, IHI’s involvement as technical support partner to the advisors ended in mid-2020. Presumably, there was less pressure and encouragement for advisors to strictly adhere to IHI methodology. The second confounder was the high-pressured environment that is typical to high volume labour wards. More than once, participants cited instances when there was simply no time to implement or document their QIPs, as vividly described by this leader:

“And the queue is there, when you are still busy there’s someone who comes, it might happen with that one if she comes, she’s really in labour. Everything must stop. Some, they come at advanced [stage of labour]. When we check, ‘Let’s go to delivery room!’” (Leader, high uptake team).

Discussion

Opening the ‘black box’ of implementation processes and contexts helps understand intervention uptake and adaptations [24, 41], and allows meaningful interpretations of its effectiveness [8]. Our evaluation points to several process and contextual factors that shaped the uptake of a MNH QI initiative in SA public health facilities between September 2019 and March 2021. The evaluation also found that during this period, teams applied methodological adaptions to the QI methodology they were trained on.

COVID-19: a barrier to uptake

COVID-19 was the main contextual barrier to uptake across all the teams in two ways. Firstly, it is well reported how COVID-19 negatively affected HCWs’ mental health: it caused high levels of anxiety; workers developed symptoms of depression and emotional burnout; and some suffered post-traumatic stress disorder [42,43,44]. There is, secondly, also evidence of how the pandemic disrupted healthcare services, from medicine stock outs and reorganising space to have isolation rooms for COVID-19 patients, to managing with less staff when colleagues acquired COVID-19 or died [45,46,47]. This disruption and trauma played out in all the Mphatlalatsane QI teams, and they had to sacrifice their QI work in favour of providing COVID-19 services whilst maintaining routine MNH services. It is also possible that because the advisors played an important role during the first months of COVID-19 in keeping ‘QI on the radar’, that some low-uptake leaders unintentionally became more advisor-dependent than leaders from high-uptake teams.

Explaining implementation uptake variation between districts

The overall uptake of the QI methodology was highest in District 1 teams, followed by District 2, which in turn had better uptake compared to Districts 3 and 4. We attribute this variation to the following differences between the districts. Firstly, quality improvement is “… considered as complex sociocultural interventions that require significant technical and social skills.” ([27] (p. 363). Training, and having sufficient time to put the training into practice, is therefore important. The difference in number of trainings and pre-COVID-19 lead time following the training, help explain the uptake differences between districts. Reinforcing initial training with follow-up events may add to more sustained use of QI methodologies [48].

Secondly, because QI is technically challenging to novice teams, as was the case with the Mphatlalatsane teams, teams are dependent on technical support to master the methodology [27]. Continuous and technically skilled mentoring is needed to support sustained use of PDSA cycles, and to improve its effectiveness [49, 50]. The more QI - skilled advisors initially appointed in Districts 1 and 2 may have facilitated more teams to mature into high uptake teams, compared to the less experienced advisor that was initially appointed for Districts 3 and 4 [51].

Thirdly, higher level support, defined here as ‘district management support’, is a key deciding factor for facility managers’ implementation of new interventions [52]. Our evaluation confirmed that HCWs need the sanctioning from higher-level management to engage with new programmes [4]. We therefore consider the reported difference in district management support a further reason for uptake variance: the low uptake in Districts 3 and 4 tallies with the advisor’s and leaders’ experience of poor district management support, versus the best support reported in District 1. District management visits to the District 1 teams would have validated the teams’ efforts and granted them a platform to raise their concerns and showcase their efforts, which is likely to have resulted in better motivated teams.

Explaining implementation uptake variation between facilities in the same district

Our evaluation highlighted uptake variation within districts. This we attribute firstly to the leaders’ intrinsic motivation to use QI methodology. Team leaders drive the change process [53], and create an environment that ensures members’ active participation [29, 54]. The methodology seemed to resonate well with some leaders, and because it made sense to them, they put more effort into its implementation than leaders with less QI interest. For leaders with less QI appetite, barriers remained barriers, whilst their colleagues with more QI appetite overcame the same barriers. It has been reported that having misgivings about QI, as was the case with some low uptake leaders, often became a barrier to using the methodology [27]. Further analysis is underway to understand why the methodology resonated with some, but not all, leaders.

We secondly surmise that variance within districts related to the difference in the level of teamwork across teams. Quality improvement is synonymous with teamwork [27], and the more effective the team structure and functioning, the more likely implementation uptake will be good. The high uptake teams had a core team, elsewhere referred to as ‘strategic QI team members’ [50], and ad hoc members, with leaders and members attesting to good teamwork. This structure, and a sense of teamwork, were largely absent in low uptake teams.

The importance of context in shaping QI implementation is well documented [27, 39] and we thirdly attribute variance between teams to the facility type, and the wider facility context in which teams functioned. The smaller the facility regarding staff complement, patient caseload, and range of MNH services, the more likely there will be high implementation uptake. In this study, all three selected clinics had high uptake teams and three of the five CHCs, but only two of the seven hospitals had high uptake teams. It is known that MNH healthcare workers in hospitals suffer high levels of burnout and secondary trauma in the normal course of their work [55], and adding QI activities to their work, is likely to be challenging. The importance of the wider facility context was evident in the District 3 facility. The leader had to deal with member apathy that was a spillover from a wider facility context of disgruntled staff. In this way, the wider facility context indirectly contributed to low QI uptake.

COVID-19: facilitating methodological adaptations

It is well reported how COVID-19 facilitated healthcare intervention adaptations [56, 57], and it was no different in the Mphatlalatsane programme. It is the main reason the QI teams stripped the methodology of its administrative requirements by no longer keeping a paper trail of team activities. These changes are in line with McNicholas and colleagues who reported low fidelity to PDSA principles over a three-year period [27], and confirmed in a systematic review which found poor methodological compliance in the use of PDSA components [51]. The effect of adaptations on targeted outcomes were not reported in either of the studies, but both studies concluded that the adaptations ‘probably’ detracted from achieving the full benefits that unabridged PDSA cycles hold. In the parlance of our CFIR theoretical framework, we concluded that how teams kept record of their activities was a peripheral intervention component. The core component was being able to describe their QIPs in sufficient detail to the advisors to make its replication possible, and to have evidence of its effectiveness. However, if staff turnover results in the loss of ‘QI memory’, not having a record of what was done, may become problematic. The teams did not keep up with the rapidness of their earlier PDSA cycles, between two and 10 working days, that usually saw the completion of a QIP within one to three months. Dealing with COVID-19 emergencies and disruptions meant that teams took longer to complete a PDSA cycle, which resulted in QIPs that at times took six months to complete. From our documentation reviews, QIPs that were adopted from these long cycles were not less effective than their pre-COVID rapid QIPs, and we therefore regard how long a QIP cycle takes as also peripheral to the methodology. In addition to the COVID-19 induced adaptations, adaptations to the PDSA model are common. In two reviews on implementation fidelity of this model, it was respectively reported that of 73 articles, only 20% referred to the use of iterative cycles [51], and only 4% of the 72 included studies, adhered to the full Plan-Do-Study-Act sequence [58]. No evidence was offered to explain this, but the authors suggested that either the full process is too much for some to follow [58], and/or in other instances, due to poor recordkeeping [51].

A place for the Mphatlalatsane QI model?

QI purists will probably argue that the Mphatlalatsane QI model cannot be regarded as true to any PDSA model. Taylor and colleagues propose five key components to the PDSA model: iterative cycles, prediction-based test of change, small-scale testing, use of data over time, and documentation [51]. The Mphatlalatsane PDSA model meets only two of these criteria: iterative cycles and data use over time. Yet, it was what HCWs in the context of the COVID-19 crisis and pressured environment of MNH services in hospitals could manage. Participants were clear that their pragmatic version did not render their QIPs less effective than when they practiced standard PDSA methods. Having adapted the model to something these HCWs could manage, also serves as counter to the reality that funder driven programmes often disappear once funding ends [24]. The Mphatlalatsane teams are more likely to sustain self-initiated adaptations and in doing so, continue using QI principles to improve their care. The integration of the QI approach into routine systems increases the probability of sustainability; however additional strategies need to be implemented to ensure sustainability (see Table 5). Time will tell if the Mphatlalatsane QI model will turn a project - driven methodology into standard practice in high uptake teams, and be taken to scale beyond the project.

With the insights from this evaluation, we offer the following recommendations (Table 5).

Table 5 Recommendations

Strengths and limitations

The evaluation benefitted from three data collection time points, and allowed a nuanced understanding of QI uptake and adaptations over time. We interviewed all leaders at each of these time points. This allowed us to establish rapport, and with it, more spontaneous interactions between the researcher and leaders. Interviewing the teams within the facilities gave us insight into their realities, and a better appreciation of how their contexts informed uptake and methodological fidelity.

Our evaluation is limited by contextual issues that the research team had no control over: Firstly, no baseline interviews were conducted when Mphatlalatsane started in September 2019 (Districts 1 and 2), and March 2020 (Districts 3 and 4). Secondly, the final in-field data collection was completed three months before Mphatlalatsane ended. However, the continued advisor interviews did not demonstrate any large changes between the evaluation and implementation completion dates, respectively September and December 2022. Thirdly, no standardised quantitative instrument was used to objectively score the QI teams’ uptake of the intervention. This would have provided additional data to strengthen our qualitative assessment. However, the depth of qualitative discussions provides rich contextual information about QI uptake and adaptations. Finally, we need to acknowledge that the interview data may have been biased in several ways. Since the leaders recruited members, they may inadvertently have chosen members who were favourably disposed towards the QI intervention. Though the interviewer never got the impression that the presence of their leader inhibited members, it may have led to some members feeling less free to share negative perceptions about the leader and team. It may also have happened that some female participants felt less comfortable being interviewed by a male.

Conclusions

Health crises such as COVID-19 put enormous strain on routine MNH services and intervention programmes such as Mphatlalatsane. The Mphatlalatsane experience illustrates that QI mentoring, as offered by experienced QI advisors, is key to implementation uptake. Uptake is also shaped by higher level support for the intervention; leaders’ intrinsic motivation to use QI methodologies; and contexts such as facility type. Our evaluation showed the need for flexibility regarding QI methodological fidelity within complex health systems.

Data Availability

All the transcriptions and analysed data can be obtained, on reasonable request, from the corresponding author.

Notes

  1. Manala Makua, South African National Department of Health, 15 June 2023.

Abbreviations

CHC:

Community health centre

HCW:

Healthcare worker

MNCH:

Maternal, neonatal, and child health

MNH:

Maternal and neonatal health

NDoH:

South African National Department of Health

OPM:

Operational manager

PHC:

Primary healthcare

PMC:

Programme management committee

QI:

Quality improvement

SA:

South Africa

References

  1. World Health Organization. Introducing the WHO quality toolkit: supplemental overview. Geneva: World Health Organization. 2022. Report No.: 9789240043879 (electronic version) 9789240043886 (print version).

  2. World Health Organization. Regional Office for South-East A. Improving the quality of care for mothers, newborns and children in health facilities: learner manual. Version 3. New Delhi: World Health Organization. Regional Office for South-East Asia; 2020 2020.

  3. Batalden PB, Davidoff F. What is “quality improvement” and how can it transform healthcare? Qual Saf Health Care. 2007;16(1):2–3.

    Article  PubMed  PubMed Central  Google Scholar 

  4. Dettrick Z, Firth S, Soto EJ. Do strategies to improve quality of maternal and child health care in lower and middle income countries lead to improved outcomes? A review of the evidence. PLoS ONE. 2013;8(12):1–9.

    Article  Google Scholar 

  5. Garcia-Elorrio E, Rowe SY, Teijeiro ME, Ciapponi A, Rowe AK. The effectiveness of the quality improvement collaborative strategy in low- and middle-income countries: a systematic review and meta-analysis. PLoS ONE. 2019;14(10):e0221919.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  6. Zaka N, Alexander EC, Manikam L, Norman ICF, Akhbari M, Moxon S, et al. Quality improvement initiatives for hospitalised small and sick newborns in low- and middle-income countries: a systematic review. Implement Sci. 2018;13(1):20.

    Article  PubMed  PubMed Central  Google Scholar 

  7. Christoff P. Running PDSA cycles. Curr Probl Pediatr Adolesc Health Care. 2018;48(8):198–201.

    Article  PubMed  Google Scholar 

  8. Hargreaves S, Rustage K, Nellums LB, Bardfield JE, Agins B, Barker P, et al. Do quality improvement initiatives improve outcomes for patients in antiretroviral programs in low- and Middle-Income Countries? A systematic review. J Acquir Immune Defic Syndr. 2019;81(5):487–96.

    Article  PubMed  PubMed Central  Google Scholar 

  9. Improvement IfH. The breakthrough series: IHI’s collaborative model for achieving breakthrough improvement. IHI Innovation Series white paper. IHI Innovation Series white paper. Cambridge: Institute for Healthcare Improvement; 2003.

    Google Scholar 

  10. Wells S, Tamir O, Gray J, Naidoo D, Bekhit M, Goldmann D. Are quality improvement collaboratives effective? A systematic review. BMJ Qual Saf. 2018;27(3):226–40.

    Article  PubMed  Google Scholar 

  11. Browne JL, van Nievelt SW, Srofenyoh EK, Grobbee DE, Klipstein-Grobusch K. Criteria-Based audit of quality of care to women with severe Pre-Eclampsia and Eclampsia in a Referral Hospital in Accra, Ghana. PLoS ONE. 2015;10(4):e0125749.

    Article  PubMed  PubMed Central  Google Scholar 

  12. Lemma S, Janson A, Persson L, Wickremasinghe D, Källestål C. Improving quality and use of routine health information system data in low- and middle-income countries: a scoping review. PLoS ONE. 2020;15(10):e0239683.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  13. Rondinelli I, Dougherty G, Madevu-Matson CA, Toure M, Akinjeji A, Ogongo I, et al. An innovative quality improvement approach for rapid improvement of infection prevention and control at health facilities in Sierra Leone. Int J Qual Health Care. 2020;32(2):85–92.

    Article  PubMed  PubMed Central  Google Scholar 

  14. Horwood C, Butler L, Barker P, Phakathi S, Haskins L, Grant M, et al. A continuous quality improvement intervention to improve the effectiveness of community health workers providing care to mothers and children: a cluster randomised controlled trial in South Africa. Hum Resour health. 2017;15(1):39.

    Article  PubMed  PubMed Central  Google Scholar 

  15. WHO. Trends in maternal mortality 2000 to 2020: estimates by WHO, UNICEF, UNFPA, World Bank Group and UNDESA/Population Division. Geneva: World Health Organization; 2023.

    Google Scholar 

  16. UNICEF. United Nations Inter-agency Group for Child Mortality Estimation (UN IGME). Levels & Trends in Child Mortality: Report 2022, estimates developed by the United Nations Inter-agency Group for Child Mortality Estimation. New York: United Nations Children’s Fund; 2023a.

    Google Scholar 

  17. UNICEF. United Nations Inter-agency Group for Child Mortality Estimation (UN IGME). Never Forgotten: the situation of stillbirth around the globe. New York: United Nations Children’s Fund; 2023b.

    Google Scholar 

  18. Pattinson R, Fawcus S, Gebhardt S, Soma-Pillay P, Niit R, Moodley J. The impact of COVID-19 on use of maternal and reproductive health services and maternal and perinatal mortality 10. South Afr Health Rev. 2021;2021(1):105–19.

    Google Scholar 

  19. Madhi SA, Briner C, Maswime S, Mose S, Mlandu P, Chawana R, et al. Causes of stillbirths among women from South Africa: a prospective, observational study. The Lancet Global Health. 2019;7(4):e503–e12.

    Article  PubMed  Google Scholar 

  20. Rhoda NVS, Gebhard GS, Kauchali S, Barron P. Reducing neonatal deaths in South Africa: Progress and challenges. South Afr Med J. 2018;108(Supplement 1):9–s16.

    Article  Google Scholar 

  21. Chou D, Daelmans B, Jolivet RR, Kinney M, Say L. Ending preventable maternal and newborn mortality and stillbirths. BMJ: Br Med J. 2015;351:h4255.

    Article  Google Scholar 

  22. Barker P, Barron P, Bhardwaj S, Pillay Y. The role of quality improvement in achieving effective large-scale prevention of mother-to-child transmission of HIV in South Africa. AIDS. 2015;29.

  23. Gengiah S, Barker PM, Yende-Zuma N, Mbatha M, Naidoo S, Taylor M, et al. A cluster-randomized controlled trial to improve the quality of integrated HIV-tuberculosis services in primary healthcareclinics in South Africa. J Int AIDS Soc. 2021a;24(9):e25803.

    Article  PubMed  PubMed Central  Google Scholar 

  24. Dixon-Woods MM. Does quality improvement improve quality? Future Hosp J. 2016;3:191–4.

    Article  PubMed  PubMed Central  Google Scholar 

  25. Schouten LMT, Hulscher MEJL, van Everdingen JJE, Huijsman R, Grol RPTM. Evidence for the impact of quality improvement collaboratives: systematic review. BMJ (Clinical research ed). 2008;336(7659):1491–4.

    Article  PubMed  Google Scholar 

  26. Rohrbasser A, Harris J, Mickan S, Tal K, Wong G. Quality circles for quality improvement in primary health care: their origins, spread, effectiveness and lacunae–a scoping review. PLoS ONE. 2018;13(12):e0202616.

    Article  PubMed  PubMed Central  Google Scholar 

  27. McNicholas C, Lennox L, Woodcock T, Bell D, Reed JE. Evolving quality improvement support strategies to improve Plan–Do–Study–Act cycle fidelity: a retrospective mixed-methods study. BMJ Quality & Safety. 2019;28(5):356.

  28. Kaplan HC, Brady PW, Dritz MC, Hooper DK, Linam WM, Froehle CM, et al. The influence of context on quality improvement success in health care: a systematic review of the literature. Milbank Q. 2010;88(4):500–59.

    Article  PubMed  PubMed Central  Google Scholar 

  29. Zamboni K, Baker U, Tyagi M, Schellenberg J, Hill Z, Hanson C. How and under what circumstances do quality improvement collaboratives lead to better outcomes? A systematic review. Implement Sci. 2020;15:1–20.

    Article  Google Scholar 

  30. Adair KC, Quow K, Frankel A, Mosca PJ, Profit J, Hadley A, et al. The Improvement readiness scale of the SCORE survey: a metric to assess capacity for quality improvement in healthcare. BMC Health Serv Res. 2018;18(1):975.

    Article  PubMed  PubMed Central  Google Scholar 

  31. Koeslag-Kreunen M, Van den Bossche P, Hoven M, Van der Klink M, Gijselaers W. When Leadership Powers Team Learning: a Meta-analysis. Small Group Res. 2018;49(4):475–513.

    Article  PubMed  PubMed Central  Google Scholar 

  32. Chetty T, Singh Y, Odendaal W, Mianda S, Abdelatif N, Manda S, et al. Intervention in mothers and newborns to reduce maternal and perinatal mortality in 3 provinces in South Africa using a quality improvement approach: Protocol for a mixed method type 2 hybrid evaluation. JMIR Research Protocols. 2023;12(1):e42041.

  33. Eastern Cape Department of Health. 5 year strategic plan, 2015/16-2019/20. Bisho, Eastern Cape;; 2017.

  34. Ehlanzeni District. Annual report, 2017–2018. Mpumalanga, South Africa; 2019.

  35. Mopani District. Annual report, 2018/19. Limpopo, South Africa; 2019.

  36. Odendaal W, Goga A, Chetty T, Schneider H, Pillay Y, Marshall C, et al. Early reflections on Mphatlalatsane, a maternal and neonatal Quality Improvement Initiative Implemented during COVID-19 in South Africa. Global Health: Science and Practice; 2022.

    Book  Google Scholar 

  37. Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci. 2009;4(1):50.

    Article  PubMed  PubMed Central  Google Scholar 

  38. Graneheim UH, Lundman B. Qualitative content analysis in nursing research: concepts, procedures and measures to achieve trustworthiness. Nurse Educ Today. 2004;24:105–12.

    Article  CAS  PubMed  Google Scholar 

  39. Coles E, Anderson J, Maxwell M, Harris FM, Gray NM, Milner G, et al. The influence of contextual factors on healthcare quality improvement initiatives: a realist review. Syst Reviews. 2020;9(1):94.

    Article  Google Scholar 

  40. Dumenco LMK, George P, McNicoll L, Warrier S, Dollase R. An interactive quality improvement and patient safety workshop for first-year medical student. MedEdPORTAL. 2018;14:10734.

    Article  PubMed  PubMed Central  Google Scholar 

  41. Kringos DS, Sunol R, Wagner C, Mannion R, Michel P, Klazinga NS, et al. The influence of context on the effectiveness of hospital quality improvement strategies: a review of systematic reviews. BMC Health Serv Res. 2015;15(1):1–13.

    Article  Google Scholar 

  42. Braquehais MD, Vargas-Cáceres S, Gómez-Durán E, Nieva G, Valero S, Casas M, et al. The impact of the COVID-19 pandemic on the mental health of healthcare professionals. QJM: An International Journal of Medicine. 2020;113(9):613–7.

    Article  CAS  Google Scholar 

  43. Crippa JAS, Zuardi AW, Guimarães FS, Campos AC, de Lima Osório F, Loureiro SR, et al. Efficacy and safety of Cannabidiol Plus Standard Care vs Standard Care alone for the treatment of emotional exhaustion and burnout among Frontline Health Care Workers during the COVID-19 pandemic: a Randomized Clinical Trial. JAMA Netw Open. 2021;4(8):e2120603–e.

    Article  PubMed  PubMed Central  Google Scholar 

  44. Ouyang H, Geng S, Zhou Y, Wang J, Zhan J, Shang Z, et al. The increase of PTSD in front-line health care workers during the COVID-19 pandemic and the mediating role of risk perception: a one-year follow-up study. Translational Psychiatry. 2022;12(1):180.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  45. Cena L, Rota M, Calza S, Massardi B, Trainini A, Stefana A. Estimating the impact of the COVID-19 pandemic on maternal and perinatal health care services in Italy: results of a self-administered survey. Front Public Health. 2021;9.

  46. Kolié D, Semaan A, Day L-T, Delvaux T, Delamou A, Benova L. Maternal and newborn healthcare providers’ work-related experiences during the COVID-19 pandemic, and their physical, psychological, and economic impacts: findings from a global online survey. PLOS Global Public Health. 2022;2(8):e0000602.

    Article  PubMed  PubMed Central  Google Scholar 

  47. Tran DN, Were PM, Kangogo K, Amisi JA, Manji I, Pastakia SD, et al. Supply-chain strategies for essential medicines in rural western Kenya during COVID-19. Bull World Health Organ. 2021;99(5):388–92.

    Article  PubMed  PubMed Central  Google Scholar 

  48. Taneja G, Sarin E, Bajpayee D, Chaudhuri S, Verma G, Parashar R, et al. Care around Birth Approach: a training, mentoring, and Quality Improvement Model to optimize Intrapartum and Immediate Postpartum Quality of Care in India. Global Health: Science and Practice. 2021;9(3):590.

    PubMed  Google Scholar 

  49. Hutchinson E, Nayiga S, Nabirye C, Taaka L, Westercamp N, Rowe AK, et al. Opening the ‘black box’ of collaborative improvement: a qualitative evaluation of a pilot intervention to improve quality of malaria surveillance data in public health centres in Uganda. Malar J. 2021;20(1):289.

    Article  PubMed  PubMed Central  Google Scholar 

  50. Weberg D. Complexity leadership: a healthcare imperative. Nurs Forum. 2012;47(4):268–77.

    Article  PubMed  Google Scholar 

  51. Taylor MJ, McNicholas C, Nicolay C, Darzi A, Bell D, Reed JE. Systematic review of the application of the plan-do-study-act method to improve quality in healthcare. BMJ Qual Saf. 2013;23(4):290–8.

    Article  PubMed  PubMed Central  Google Scholar 

  52. Ugo O, Ezinne E-A, Modupe O, Nicole S, Winifred E, Kelechi O. Improving quality of Care in Primary Health-Care Facilities in Rural Nigeria: Successes and Challenges. Health Serv Res Managerial Epidemiol. 2016;3:2333392816662581.

    Google Scholar 

  53. Sandberg KC. Leadership in quality improvement. Curr Probl Pediatr Adolesc Health Care. 2018;48(8):206–10.

    Article  PubMed  Google Scholar 

  54. Albritton JA, Fried B, Singh K, Weiner BJ, Reeve B, Edwards JR. The role of psychological safety and learning behavior in the development of effective quality improvement teams in Ghana: an observational study. BMC Health Serv Res. 2019;19(1):385.

    Article  PubMed  PubMed Central  Google Scholar 

  55. Muliira RS, Ssendikadiwa VB. Professional Quality of Life and Associated factors among Ugandan Midwives Working in Mubende and Mityana Rural Districts. Matern Child Health J. 2016;20(3):567–76.

    Article  PubMed  Google Scholar 

  56. Gray SM, Franke T, Sims-Gould J, McKay HA. Rapidly adapting an effective health promoting intervention for older adults—choose to move—for virtual delivery during the COVID-19 pandemic. BMC Public Health. 2022;22(1):1172.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  57. Morgan AR, Hendricks MA, El Ibrahimi S, Hallvik SE, Hatch B, Dickinson C et al. COVID-19-related adaptations to the implementation and evaluation of a clinic-based intervention designed to improve opioid safety. Drugs in context. 2021;10.

  58. Knudsen SV, Laursen HVB, Johnsen SP, Bartels PD, Ehlers LH, Mainz J. Can quality improvement improve the quality of care? A systematic review of reported effects and methodological rigor in plan-do-study-act projects. BMC Health Serv Res. 2019;19(1):683.

    Article  PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgements

Our sincerest appreciation to the five QI advisors for their enthusiastic participation. The data would have been much less rich without their insights and experiences. We are indebted to the frontline healthcare workers who generously shared their time and insights during the evaluation. We also want to acknowledge the provincial and district management staff who supported the evaluation and facilitated our site entry. The South African National Department of Health was the custodian of the Mphatlalatsane programme, and the Clinton Health Access Initiative acted as the Mphatlalatsane implementation secretariat. We are grateful for their support of our evaluation.

Funding

The evaluation was funded by ELMA Philanthropies, an anonymous donor, and the South African Medical Research Council.

Author information

Authors and Affiliations

Authors

Contributions

WO: evaluation protocol, data collection, analyses, and interpretations; drafted the first version of the manuscript. XH, TC: supervised the protocol development, data collection, analyses, and interpretation of the data; provided guidance on the first draft of the paper; finalising the manuscript. MT: supervised the protocol development, data interpretation, finalising manuscript. AG: guidance on protocol development; data interpretation; finalising the manuscript. YS: data interpretation; finalising the manuscript. CM, SK: external consultants to the South African National Department in developing the Mphatlalatsane programme; data interpretation; finalising the manuscript. YP, MM: reviewed and approved the manuscript. YP and MM oversaw the intervention design and Mphatlalatsane implementation, but did not influence the interpretation of data and evaluation results. They provided context to the interpretation of results, given that this is an implementation research study.

Corresponding author

Correspondence to Willem Odendaal.

Ethics declarations

Competing interests

None to declare. ELMA Philanthropies was not involved in any aspect of the design or conduct of the evaluation, nor in interpreting the results or writing of the manuscript.

Ethics approval and consent to participate

We obtained ethical approval for the study from the Human Research Ethics Committee of the South African Medical Research Council (SAMRC) (EC019-11/2019ccc), and the Health Research Ethics Committee of Stellenbosch University (SU), South Africa (S21/05/096). All data collection and analysis methods were carried out in accordance with the guidelines and regulations of the SAMRC and SU Ethics committees, respectively. Signed, informed consent was obtained from all participants.

Consent for publication

Not applicable.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Electronic supplementary material

Below is the link to the electronic supplementary material.

Additional file 1

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Odendaal, W., Chetty, T., Goga, A. et al. From purists to pragmatists: a qualitative evaluation of how implementation processes and contexts shaped the uptake and methodological adaptations of a maternal and neonatal quality improvement programme in South Africa prior to, and during COVID-19. BMC Health Serv Res 23, 819 (2023). https://doi.org/10.1186/s12913-023-09826-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12913-023-09826-5

Keywords