Integrated delivery of family planning and childhood immunisation services: a mixed methods assessment of service responsiveness
BMC Health Services Research volume 22, Article number: 572 (2022)
Postpartum women represent a considerable share of the global unmet need for modern contraceptives. Evidence suggests that the integration of family planning (FP) with childhood immunisation services could help reduce this unmet need by providing repeat opportunities for timely contact with FP services. However, little is known about the clients’ experiences of FP services that are integrated with childhood immunisations, despite being crucial to contraceptive uptake and repeat service utilisation.
The responsiveness of FP services that were integrated with childhood immunisations in Malawi was assessed using cross-sectional convergent mixed methods. Exit interviews with clients (n=146) and audits (n=15) were conducted in routine outreach clinics. Responsiveness scores across eight domains were determined according to the proportion of clients who rated each domain positively. Text summary analyses of qualitative data from cognitive interviewing probes were also conducted to explain responsiveness scores. Additionally, Spearman rank correlation and Pearson’s chi-squared test were used to identify correlations between domain ratings and to examine associations between domain ratings and client, service and clinic characteristics.
Responsiveness scores varied across domains: dignity (97.9%); service continuity (90.9%); communication (88.7%); ease of access (77.2%); counselling (66.4%); confidentiality (62.0%); environment (53.9%) and choice of provider (28.4%). Despite some low performing domains, 98.6% of clients said they would recommend the clinic to a friend or family member interested in FP. The choice of provider, communication, confidentiality and counselling ratings were positively associated with clients’ exclusive use of one clinic for FP services. Also, the organisation of services in the clinics and the providers’ individual behaviours were found to be critical to service responsiveness.
This study establishes that in routine outreach clinics, FP services can be responsive when integrated with childhood immunisations, particularly in terms of the dignity and service continuity afforded to clients, though less so in terms of the choice of provider, environment, and confidentiality experienced. Additionally, it demonstrates the value of combining cognitive interviewing techniques with Likert questions to assess service responsiveness.
Approximately 218 million women have an unmet need for modern contraceptives in low- and middle-income countries , among which postpartum women make up a considerable share [2, 3]. Evidence suggests that the integration of family planning (FP) services with childhood immunisations could help reduce the unmet need among postpartum women by providing repeat opportunities for timely contact with FP services . In some settings, studies have demonstrated that the integration of FP services with childhood immunisations is acceptable to clients and providers, and that it can result in increased contraceptive uptake with little to no negative impact on immunisations [5,6,7,8,9,10]. However, research on the integration of these two services has primarily focused on reproductive and behavioural outcomes and less is known about the client experience. This represents an important gap given the established link between the experiential quality of services and both contraceptive uptake and repeat use of health services [11,12,13,14,15,16].
A better understanding of the responsiveness of FP services that are integrated with childhood immunisations could help inform the design and implementation of high quality integrated FP services that are client-centred and rights-based [12, 17]. Service responsiveness is concerned with whether the experience of an individual’s interaction with a specific health service fulfils a set of ‘legitimate’ expectations or universally accepted ethical principles and non-clinical service standards [18,19,20,21,22]. In a review of factors determining the quality of FP services, Tessema et al. identified several studies investigating the quality of FP services that note the importance of responsiveness . Despite this recognition, only two studies have directly investigated the responsiveness of FP services to date. First, a study in Niger demonstrated that low-cost interventions that improve service responsiveness can increase FP uptake when these services are integrated with curative and under-fives consultations . Second, researchers in Sri Lanka developed an instrument to measure the responsiveness of FP services, assessed their responsiveness, and identified its correlates and determinants [24,25,26]. According to their research, the domains of responsiveness that are most relevant to FP services are the dignity, environment, choice, communication, confidentiality and ease of access afforded to clients .
In 2019, a case study of the responsiveness of FP services that were integrated with childhood immunisations in routine outreach clinics was conducted in Malawi. This case study documented clients’ and providers’ perspectives using mixed methods. The findings presented here comprise the first part of this study, which aimed to assess clients’ experiences of FP services that were integrated with childlhood immunisations and determine the factors associated with perceived responsiveness.
The case study was conducted within a multi-faceted process evaluation carried out in Malawi, Benin, Kenya and Uganda, which interrogated the pathways to outcomes of an NGO-led intervention integrating the delivery of FP services with childhood immunisations in rural areas. In Malawi, the case study took place between June and July 2019 in routine public outreach clinics where the delivery of FP services was integrated into the existing Expanded Programme on Immunisation (EPI), which included childhood immunisations and growth monitoring services.
A cross-sectional convergent mixed methods design was used through which quantitative and qualitative results were combined to generate a comprehensive understanding of clients’ experiences . The selection of this approach was informed by findings from a critical assessment of the WHO’s health systems responsiveness tool, which highlighted the importance of using mixed methods in the assessment of clients’ experiences of outpatient services . Empirical data were collected through clinic audits and exit interviews with clients. Programme monitoring data were also consulted to identify the clinics’ FP client load on the day of the interviews. The methods and results from this study are reported here according to the GRAMMS guidelines for mixed methods studies in health services research .
A detailed account of the intervention that included the integrated delivery of FP services and childhood immunisations in routine outreach clinics is presented elsewhere . In brief, the intervention was carried out between January 2015 and October 2019 in the Blantyre, Thyolo and Mwanza districts of Malawi. In these districts, childhood immunisation coverage was relatively high, and the unmet need for FP among married women was around 19.0% . Broadly, the intervention intended to: 1) strengthen the capacity of providers to deliver quality integrated FP, childhood immunisation, and growth monitoring services in routine outreach clinics; 2) increase the retention of clients and reduce immunisation defaulters; 3) improve the availability of FP and immunisation supplies in clinics; and 4) improve community engagement around FP and immunisation service utilisation.
The outreach clinics included in the intervention were carried out each month during a single day in existing community buildings or in open spaces (e.g., under a tree). In these clinics, the organisation of services followed a defined client flow, which involved: a group health talk during which information about child development, FP, and immunisations was presented; the screening of clients for immunisation and FP services; the provision of growth monitoring and immunisations for children under five years of age; and the delivery of FP counselling and contraceptives . This client flow was designed to streamline service delivery and was based on the assumption that clinics would be supported by a team of community volunteers and staffed by a minimum of four health surveillance assistants (HSAs). In Malawi, HSAs are paid community health workers attached to health centres, and are tasked with a wide range of health promotion responsibilities, including community-based delivery of FP services .
Empirical data collection
Selection of study sites
At the time of data collection, FP services were integrated with childhood immunisations in 91 routine outreach clinics. Due to logistical and time constraints, clinics in Mwanza were excluded from the case study. Only clinics where FP services were integrated with childhood immunisations for 12 months or more prior to the start of data collection were considered for inclusion in the study based on the assumption that assessing the responsiveness in clinics where providers had delivered integrated services for at least a year would generate better insights. Of the 16 clinics that met this inclusion criterion, one was excluded due to a conflict in the data collection schedule. The study was ultimately carried out in 15 clinics across Blantyre (n=7) and Thyolo (n=8) districts, with data collected in each clinic during a single day.
Exit interviews with clients
Exit interviews were conducted in all 15 clinics by a team of nine experienced interviewers using a structured questionnaire. All eligible clients were recruited upon exit from the clinic based on the availability of interviewers until the sample size needs for the wider process evaluation were met. This sample size was based on an assumed percentage use of modern contraceptive methods of 50%, relative error 0.2, and design effect 3.0. Assuming 95% confidence and 80% power, a total of 192 exit interviews were required, with 13 per clinic as a target. Clients included in the responsiveness case study were those who sought both childhood immunisation and FP services on the day of the interview and were 18 years or older.
The structured questionnaire used to carry out interviews was employed in Chichewa and featured questions that were relevant to both this case study and to the wider process evaluation in which it was nested. Responsiveness-related questions focused on eight structural and behavioural domains (Table 1). Clients were asked to rate their experience of these domains using a five-point Likert scale, with responses ranging from ‘very good’ to ‘very bad’. They were also asked elaborative and hypothetical questions based on cognitive interviewing techniques to explain their ratings and to verify their interpretation of the Likert scale [33, 34]. That is, after each Likert question, the following probes were used: ‘can you explain what made you feel this way?’ and/or ‘what would it have taken for you to answer inversely?’. Responses to these questions were noted in English by the interviewers on the questionnaires. Additionally, clients were asked to rank the eight domains from most to least important and to confirm whether or not they had experienced key elements of FP counselling.
The questionnaire was reviewed in-depth by the team of interviewers and piloted in two clinics to address language and logistical issues. The interviewers’ review revealed that ‘confidentiality’ would likely be interpreted by clients as whether the information they shared with providers was kept private. For this reason, a Chichewa word for ‘privacy’ was used, which conveyed confidentiality more broadly in terms of the privacy of information shared and the possibility of interacting with providers without others catching sight or overhearing.
A structured questionnaire was used to perform audits of all 15 clinics on the day of the exit interviews, which documented the clinics’ resources and characteristics. Questions focused on the clinics’ infrastructure, number and cadre of providers, and stocks of FP and immunisation commodities. This questionnaire was piloted alongside the exit interview questionnaire in two clinics.
Data management and analysis
Quantitative data from exit interviews and clinic audits were recorded on paper forms, double entered into EpiData, and exported into STATA 16 for analysis. Descriptive statistics were produced to summarise key clinic, service, and client characteristics. Domain-specific responsiveness scores were then determined using a two-step process. First, clients’ responses to the Likert questions were categorised into ‘positive’ and ‘negative’ ratings, with the middle point (moderate) of the scale added to the negative ratings. The decision to include the middle response among negative ratings was informed by the data from the cognitive interviewing probes, which revealed that moderate ratings predominantly represented negative experiences. Second, responsiveness scores were calculated as the proportion of clients who rated each domain positively (i.e. ‘good’ or ‘very good’). Spearman rank correlation was used to analyse the extent to which responsiveness ratings were correlated and Pearson’s chi-squared test was used to assess the association between responsiveness ratings and clinic-, service- and client-level factors. Additionally, for each respondent, pairwise comparisons of rankings across all domain pairs were carried out and then aggregated across individuals to generate an overall ranking of the relative importance of domains .
Qualitative data from the interviewers’ notes on the clients’ responses to the cognitive interviewing probes were imported into NVivo 12 for analysis. The aim of this analysis was primarily to examine the clients’ understanding of the Likert questions and scales; however further analyses were also performed using an inductive text summary approach to identify dominant themes among the clients’ responses . These themes were then compared to the domain ratings from the exit interviews to explain the clients’ ratings and gain a better understanding of clients’ experiences.
Client and clinic characteristics
A total of 146 exit interviews with clients were included in the case study. In all, 36.3% (n=53) were carried out in Blantyre district and 63.7% (n=93) were conducted in Thyolo district.
Of the clients who took part in the exit interviews, 53.1% were 18-24 years old, 91.8% had completed at least a primary education, and 93.8% were married. All were mothers to at least one child, 27.6% had two children or more under the age of five, 64.1% were repeat contraceptive users (i.e., collecting their usual method at the clinic), 95.6% reported having a husband who supported FP, 70.4% lived less than 45 minutes away from the clinic, 34.0% reported that the clinic where they were interviewed was the only one they used for FP services, and 98.6% said they would recommend the clinic to a friend or family member interested in FP.
Additionally, only a small proportion of clients interviewed reported visiting the clinic with the intention to seek both immunisation and FP services, yet 73.6% of clients in Blantyre and 63.4% in Thyolo had intended to seek both growth monitoring and FP services on the day of the interview (Figure 1).
Overall, services were delivered in sites that lacked appropriate infrastructure and where a considerable number of clients sought services at the same time, which rendered the provision of services a challenge. That is, although 87.0% of respondents attended a clinic that met the staffing standards (four HSAs or more), only 60.3% attended a clinic that had a shelter and 31.0% were served in clinics that had more than one room available for the provision of services. Also, 50.0% sought services in a clinic where FP and childhood immunisations were delivered in the same space and 51.4% were served in a clinic that had a FP client load under 30 (range 12-61) on the day of the interview.
Despite NGO-led initiatives (e.g., training and routine supervision of HSAs) to strengthen the quality of FP counselling in the studied clinics, not all clients interviewed experienced comprehensive FP counselling. As summarised in Table 2, most clients reported only experiencing some elements of FP counselling.
Importance of responsiveness domains
The respondents’ rankings of the eight responsiveness domains’ importance revealed that clients considered the clinic’s environment to be the most important domain. This was followed by confidentiality, service continuity, ease of access, dignity, choice of provider, counselling, and lastly, communication.
Responsiveness scores varied across domains (Table 3), with dignity (97.9%) rated most positively and the choice of provider (28.4%) rated least positively by clients. Overall, little variation was found between districts, and results from the Spearman rank correlation revealed no strong correlations between domain ratings.
Qualitative explanation of responsiveness scores
The analysis of interviewer notes from the cognitive interviewing probes confirmed that the Likert questions and scales were well understood by all respondents. That is, alignment was found between the intent of the questions and the clients’ responses, and the positive/negative nature of the ratings given by clients matched the explanations they provided for these. Additionally, the text summary analysis of this data helped explain the responsiveness scores, whilst revealing important factors influencing the clients’ perceptions. These findings are reported here for each domain.
Among the many clients who rated dignity positively, several linked their rating to receiving the services or the help they felt they needed. Some specified that services were quick, whilst others said clients were not denied services, even when arriving late. Two clients also said they would have rated dignity less favourably if contraceptives were not available in the clinic. However, this domain’s positive ratings were most commonly explained by examples pertaining to the providers’ behaviour. Examples included providers behaving professionally, being kind, greeting clients, not shouting at clients, administering injections gently, and having a positive attitude.
Most clients who rated the service continuity positively said the date of their next visit was either verbally communicated to them or written in their health passport. Among these clients, almost all who reported having the date of their next visit recorded in their health passport rated this domain as 'very good'. Conversely, negative ratings were mainly linked to either not receiving any information about follow-up visits or being told to return within a given period (e.g. after three months) without a specified date.
Clients who rated the communication positively generally felt the information was clear and the advice provided was practical and helpful. They also said providers covered a wide range of topics, including: the benefits of FP, contraceptive options, and the management of side effects from contraceptives. Examples of providers creating a conducive environment for information sharing were also used to explain positive ratings. Such examples included providers 1) speaking loudly to ensure clients could hear the group health talk, 2) creating a friendly environment, and 3) encouraging clients to ask questions. Among the clients who rated this domain negatively, most reported not hearing the heath talk (e.g., because they reached the clinic late) or not receiving any FP counselling, and several said the information they received was incomplete or lacking details.
Ease of access
Many of the clients who rated their ease of access positively reported living near the clinic. Among these clients, several felt access would be an issue if the time needed to travel to the clinic exceeded an hour. Also, positive and negative ratings alike were linked to concerns about physical and personal obstacles. Physical obstacles included: the challenging terrain (e.g., hills); the lack of good roads and appropriate transport; and the rains. The most common personal obstacle stated was illness (theirs or their child’s), which was mentioned by clients who lived at varying distances from the clinic (3-60 minutes). Other personal obstacles mentioned were: 1) caring for a child on the way to the clinic; 2) having other commitments on the day of the clinic; and 3) husbands being unsupportive of FP.
Among the clients who rated the counselling positively, several said the provider discussed their reproductive preferences with them. Of these clients, a few mentioned that they would have given a less positive response if the provider had: 1) not demonstrated an interest in their preferences; 2) not asked them about the number of children they wanted; or 3) not provided advice. Similarly, the majority of clients who rated this domain negatively said the provider was not interested in knowing their preferences and did not ask clients about these. However, by far the most common point made by clients who rated this domain positively was that providers allowed them to make their own choices about the number of children they desired and which contraceptive to use.
Positive ratings of confidentiality were linked to the providers’ individual behaviours. For example, clients who gave positive ratings said providers 1) did not disclose their information or choices to others in the clinic, and 2) took steps to facilitate private discussions with clients, such as speaking with lowered voices or isolating FP clients to enhance privacy. Clients also explained their positive ratings by saying that they were counselled individually, which allowed for private interactions with the provider. Conversely, some negative ratings were linked to having received FP services in groups or in pairs. However, most clients who rated this domain negatively explained that the clinic's shelter and use of space undermined confidentiality. They reported receiving FP counselling and contraceptives in an open space where others could overhear or catch sight of their discussions with the FP provider.
In general, clients’ ratings of the clinic’s enironment were linked to their views on the appropriateness of the clinics’ shelter. Specifically, the absence of a shelter, toilet and water were issues mentioned by clients who rated this domain negatively. Additionally, clients who believed the space in the clinic was adequate and clean (e.g. swept or mopped) mostly rated the clinic’s environment positively; whereas, those who believed the space was insufficient gave a negative rating, even if they felt it was clean. However, most clients who perceived the clinic to be unclean rated this domain negatively.
Choice of provider
Many clients who rated the choice of provider negatively said the way services were organised in the clinic prevented the opportunity to choose a provider. Clients mentioned needing to respect the clinic’s client flow and the pre-determined roles assigned to providers. Also, perceived staff shortages were believed to hinder the clients’ choice of provider. In contrast, the few clients who rated this domain positively said they could choose the provider that served them in the clinic and that it was their right to do so. Overall, some clients viewed all providers as equals and therefore believed having a choice of provider was not necessary, whilst others felt there were differences among the providers’ capacity that justified the need for a choice.
Associations between domain ratings and key factors
Associations between the clients’ ratings of the eight responsiveness domains and the following factors were examined: 1) the clinic’s shelter, number of rooms, use of space for FP and immunisations, FP client load, and staffing level; 2) the eight elements of FP counselling presented in Table 2; and 3) the client's age, education, marital status, number of children, travel time to the clinic, exclusive use of one clinic for FP services, and socio-economic status. No significant associations were found between any of these factors and the clients’ ratings of the dignity and environment domains. All significant associations found are presented in Table 4.
This case study sought to contribute to a deeper understanding of clients’ experiences of FP services that are integrated with childhood immunisations by assessing the responsiveness of these services in terms of eight domains. Overall, the results indicate that in routine outreach clinics, FP services can be responsive when integrated with childhood immunisations, particularly in terms of the dignity and service continuity they afford clients, though less so in terms of the confidentiality, environment, and choice of provider that clients experience. Similar findings were reported by the only other assessment of FP service responsiveness, in which clients in Sri Lanka rated most positively the dignity they experienced and least positively the choice of provider and of contraceptive they were afforded . Despite some lower performing domains, clients interviewed in the case study almost unanimously reported that they would recommend the clinic to a family member or friend interested in FP services. Taken together, these results suggest that the services were likely sufficiently responsive to warrant the repeat use of services, and support the call to integrate FP services with childhood immunisations to reduce the unmet need for contraceptives among postpartum women.
Interestingly, despite being considered most important by clients, the environment and confidentiality were found to be among the responsiveness domains that they rated least postively. This is consistent with findings from the WHO’s general population surveys of health systems responsiveness in which the importance of the environment generally ranked higher among countries with low health expenditure and human development index scores . However, it is possible that the domains considered by clients to be least responsive were also most salient to them, causing clients to rank these among the most important. A notable exception was the choice of provider, which clients’ ranked low both in terms of importance and performance. A possible explanation for this is that clients may not have viewed the choice of provider as a priority given the unmet needs felt in relation to other domains. As De Silva notes, ‘the ability to choose between care providers becomes increasingly important as the other aspects of responsiveness are met’ .
Moreover, six of the eight domains’ ratings were found to be significantly associated with several elements of FP counselling and a few client characteristics. Of note, the communication, choice of provider, confidentiality and counselling ratings were positively associated with the exclusive use of one clinic for FP services. This is consistent with findings from Sri Lanka, where clients’ positive responsiveness ratings were associated with using only one FP clinic within the past year . This suggests that experiences with other services may serve as a benchmark and consequently affect clients’ perceptions of the responsiveness of integrated FP services. The influence of a point of reference on clients’ perceptions may also partly explain the unexpected association found in this study between positive ratings of confidentiality and travelling less than 45 minutes to reach the clinic. That is, it is possible that clients who live near a clinic are less likely to seek services elsewhere and thus to have a benchmark, rendering them less critical of the services they experience. Although this is a plausible explanation that is potentially supported by the data, a more conclusive statement cannot be made given the study’s sampling limitations. Further research examining the influence of such a benchmark on perceptions of responsiveness could help improve the delivery of services. Also, contrary to expectations, the clinic’s shelter, number of rooms, and use of space were not significantly associated with clients’ domain ratings, despite results from the cognitive interviewing probes suggesting that infrastructure deficits (e.g., the absence of a suitable shelter) influenced clients’ perceptions of the environment and the confidentiality they experienced. Likewise, counselling ratings were not significantly associated with hearing the group health talk, nor being told how different contraceptives work. It is possible that these two elements of counselling were less relevant to respondents’ perceptions of the counselling domain as the majority of clients interviewed were repeat service users attending the clinics to collect their usual contraceptive method.
The findings also revealed that clients believed that service responsiveness was influenced by the organisation of services in the clinic and the providers’ individual behaviours. Specifically, group-based services were perceived to be less responsive to clients’ needs than one-on-one services in terms of the confidentiality and counselling afforded to clients. Similarly, due to the client flow adopted in the clinics, clients who missed the health talk because they reached the clinic late were deprived from receiving crucial information. Additionally, the pre-determined roles assigned to providers due to the client flow design were believed to prohibit clients’ choice of provider. This echoes recent findings from other empirical studies that demonstrate the important influence of organisational elements on the integrated delivery of FP and childhood immunisation services [9, 10]. It also highlights the value of service designers and implementers adopting a client-centred approach to service organisation in delivery sites. Additionally, the clarity and consistency of the information providers shared with clients, their respect of clients’ choices, the privacy they facilitated, and the professionalism and kindness they exhibited towards clients were found to be central to clients’ experiences. This supports evidence from other studies, including the Integra initiative, which emphasise the crucial role played by providers in the delivery of integrated services and how their individual performance largely determines the success of integration programmes [11, 38,39,40,41,42].
Furthermore, this study corroborates previous research that established the value of combining cognitive interviewing techniques with Likert questions to test whether questions fulfil their intended purpose [33, 34, 36, 43, 44]; and provides an example of its applicability to the assessment of service responsiveness. The cognitive interviewing probes helped to qualitatively validate the tool used in this study and the clients’ responsiveness scores by confirming that the Likert questions and scale were well understood and accurately interpreted by respondents. The data derived from these probes also yielded important insights into clients’ experiences that would not have otherwise been captured. Using a similar method, Scott et al. demonstrated that Likert questions and scales were not well suited to capturing respondents’ experiences of respectful maternity care in rural northern India . Specifically, they found that Likert response options were often misunderstood, hypothetical questions were commonly misinterpreted, and the translation of standard terms from the literature did not resonate well with respondents in the studied context. It is possible that the successful use of Likert questions in this case study resulted from the approach adopted to refine and pilot the data collection instrument, which was heavily informed by experienced local interviewers. Futher research is needed to examine the applicability of this combination of methods to the assessment of service responsiveness in different contexts.
This study has a few limitations worth noting. First, the exit interviews were susceptible to response biases, such as courtesy and desirability biases. However, the clients’ responses to the cognitive interviewing probes suggest that these biases were likely minimal. Second, in some cases, the providers’ prior knowledge of the researchers’ visit and the presence of the data collection team in the clinics may have prompted providers to alter their delivery of services, rendering them more or less responsive than usual. Third, sub-group analyses and the inferences that could be derived from the quantitative data were restricted by the small sample of clients interviewed. Nonetheless, the findings from the cognitive interviewing probes offer important insights that help mitigate this limitation. And finally, since the study’s primary aim was to assess clients’ experiences of FP services that were integrated with childhood immunisations, comprehensive data were not captured on the growth monitoring services delivered in the studied clinics. This represents an important limitation as the results show that the majority of clients had the intention to seek both growth monitoring and FP services on the day of the exit interviews, which was likely due to the more frequent need for these services compared to scheduled immunisations.
This case study set out to investigate clients’ experiences of FP services that were integrated with childhood immunisations in routine outreach clinics. In doing so, it also demonstrated the value of combining cognitive interviewing techniques with Likert questions to assess service responsiveness. The results from this study establish that in routine outreach clinics, FP services can be responsive when integrated with childhood immunisations, particularly in terms of the dignity and service continuity they afford clients, though to a lesser extent in terms of the confidentiality, environment and choice of provider experienced. The clients’ views of the choice of provider, communication, confidentiality and counselling they experienced were found to be positively associated with the exclusive use of one clinic for FP services, suggesting that having a benchmark may have an important influence on perceptions of responsiveness. The findings also highlight the influence of the organisation of services and of the providers’ individual behaviours on service responsiveness. Further research is therefore needed to interrogate the views of providers and their influence on the responsiveness of FP services that are integrated with childhood immunisations.
Availability of data and materials
The datasets used and/or analysed in the current study, as well as the data collection instruments, are available from the corresponding author on reasonable request.
Expanded Programme on Immunisation
Health surveillance assistant
Sully EA, Biddlecom A, Darroch JE, Riley T, Ashford LS, Lince-Deroche N, et al. Adding it up: Investing in Sexual and Reproductive Health 2019. New York: Guttmacher Institute; 2020.
Moore Z, Pfitzer A, Gubin R, Charurat E, Elliott L, Croft T. Missed opportunities for family planning: An analysis of pregnancy risk and contraceptive method use among postpartum women in 21 low- and middle-income countries. Contraception. 2015;92(1):31–9.
Dev R, Kohler P, Feder M, Unger JA, Woods NF, Drake AL. A systematic review and meta-analysis of postpartum contraceptive use among women in low- and middle-income countries. Reprod Health. 2019;16(1):1–17.
High Impact Practices in Family Planning (HIP). Family Planning and Immunization Integration: Reaching postpartum women with family planning services. Washington, DC: USAID; 2021.
Huntington D, Aplogan A. The integration of family planning and childhood immunization services in Togo. Stud Fam Plann. 1994;25(3):176–83.
Vance G, Janowitz B, Chen M, Boyer B, Kasonde P, Asare G, et al. Integrating family planning messages into immunization services: A cluster-randomized trial in Ghana and Zambia. Health Policy Plan. 2014;29(3):359–66.
Dulli LS, Eichleay M, Rademacher K, Sortijas S, Nsengiyumva T. Meeting Postpartum Womens Family Planning Needs Through Integrated Family Planning and Immunization Services: Results of a Cluster-Randomized Controlled Trial in Rwanda. Glob Heal Sci Pract. 2016;4(1):73–86.
Cooper CM, Fields R, Mazzeo CI, Taylor N, Pfitzer A, Momolu M, et al. Successful proof of concept of family planning and immunization integration in Liberia. Glob Heal Sci Pract. 2015;3(1):71–84.
Cooper CM, Wille J, Shire S, Makoko S, Tsega A, Schuster A, et al. Integrated family planning and immunization service delivery at health facility and community sites in Dowa and Ntchisi districts of Malawi: A mixed methods process evaluation. Int J Environ Res Public Health. 2020;17(12):1–14.
Nelson AR, Cooper CM, Kamara S, Taylor ND, Zikeh T, Kanneh-Kesselly C, et al. Operationalizing integrated immunization and family planning services in rural Liberia: Lessons learned from evaluating service quality and utilization. Glob Heal Sci Pract. 2019;7(3):418–34.
Bossyns P, Miye H, VLerberghe W. Supply-level measures to increase uptake of family planning services in Niger: the effectiveness of improving responsiveness. Trop Med Int Heal. 2002;7(4):383–90.
Jain A, Hardee K. Revising the FP Quality of Care framework in the context of Rights-based Family Planning. Stud Fam Plann. 2018;49(2):171–9.
Harris S, Reichenbach L, Hardee K. Measuring and monitoring quality of care in family planning: are we ignoring negative experiences? Open Access J Contracept. 2016;7:97–108.
Fruhauf T, Zimmerman L, Kibira SPS, Makumbi F, Gichangi P, Shiferaw S, et al. Measuring family planning quality and its link with contraceptive use in public facilities in Burkina Faso, Ethiopia, Kenya and Uganda. Health Policy Plan. 2018;33(7):828–39.
Senderowicz L. Contraceptive Autonomy: Conceptions and Measurement of a Novel Family Planning Indicator. Stud Fam Plann. 2020;51(2):161–76.
Hanefeld J, Powell-Jackson T, Balabanova D. Understanding and measuring quality of care: dealing with complexity. Bull World Heal Organ. 2017;95:368–74.
RamaRao S, Jain AK. Constructing indicators for measurement and improvement of the quality of family planning programs: An example using data on choice from the Philippines, 1997-1998. Quality Measurement in Family Planning: Past, Present, Future: Papers from the Bellagio Meeting on Family Planning Quality. Oakland: Metrics for Management; 2016.
De Silva A. A Framework For Measuring Responsiveness. World Heal Organ. 2000;32:1–42.
Murray CJL, Frenk J. A framework for assessing the performance of health systems. Bull World Health Organ. 2000;78(6):717–31.
Darby C, Valentine NB, Murray CJL, De Silva A. World Health Organization (WHO): Strategy on Measuring Responsiveness. World Heal Organ. 2003;23:1–21.
World Health Organization. The World Health Report. Health Systems: Improving Perfomance. World Heal Organ. 2000;2000:1–206.
Khan G, Kagwanja N, Whyle E, Gilson L, Molyneux S, Schaay N, et al. Health system responsiveness: a systematic evidence mapping review of the global literature. Int J Equity Health. 2021;20(112):1–24.
Tessema GA, Gomersall JS, Mahmood MA, Laurence CO. Factors determining quality of care in family planning services in Africa: A systematic review of mixed evidence. PLoS One. 2016;11(11):1–23.
Perera WLSP, Mwanri L, Seneviratne RDA, Fernando T. Family planning services in Sri Lanka: Clients’ nonmedical expectations and the health systems responsiveness. South East Asia J Public Heal. 2012;2(1):54–9.
Perera WLSP, Mwanri L, de A Seneviratne R, Fernando T. Health systems responsiveness and its correlates: evidence from family planning service provision in Sri Lanka. WHO South-East Asia J Public Heal. 2012;1(4):457–66.
Perera WLSP, Seneviratne R, Fernando T. Development and validation of an instrument assessing Health System Responsiveness of family planning services in Sri Lanka. South East Asia J Public Heal. 2011;1(1):46–52.
Cresswell JW, Plano Clark VL. Designing and Conducting Mixed Methods Research. 3rd ed. California: SAGE Publications, Inc; 2018. p. 520.
Njeru MK, Blystad A, Nyamongo IK, Fylkesnes K. A critical assessment of the WHO responsiveness tool: lessons from voluntary HIV testing and counselling services in Kenya. BMC Health Serv Res. 2009;9(243):1–11.
O’Cathain A, Murphy E, Nicholl J. The quality of mixed methods studies in health services research. J Heal Serv Res Policy. 2008;13(2):92–8.
Hamon JK, Krishnaratne S, Hoyt J, Kambanje M, Pryor S, Webster J. Integrated delivery of family planning and childhood immunisation services in routine outreach clinics: findings from a realist evaluation in Malawi. BMC Health Serv Res. 2020;20(777):1–11.
National Statistical Office (NSO) [Malawi] and ICF. Malawi Demographic and Health Survey 2015-16. Zomba, and Rockville: NSO and ICF; 2017.
Kok M, Tolani M, Mtonga W, Salamba T, Mwabungulu T, Munthali A, et al. Enabling and hindering factors of health surveillance assistants’ roles in the provision of contraceptive services in Mangochi, Malawi. Reprod Health. 2020;17(57):1–13.
Beatty PC, Willis GB. Research synthesis: The practice of cognitive interviewing. Public Opin Q. 2007;71(2):287–311.
Willis GB, Miller K. Cross-cultural cognitive interviewing: Seeking comparability and enhancing understanding. Field Methods. 2011;23(4):331–41.
Huber PJ. Pairwise Comparison and Ranking: Optimum Properties of the Row Sum Procedure. Ann Math Stat. 1963:511–20.
Willis GB. Analysis of the cognitive interview in questionnaire design: Understanding qualitative research. New York: Oxford University Press; 2015. p. 261.
Valentine N, Darby C, Bonsel GJ. Which aspects of non-clinical quality of care are most important? Results from WHO’s general population surveys of “health systems responsiveness” in 41 countries. Soc Sci Med. 2008;66(9):1939–50.
Mutemwa R, Mayhew S, Colombini M, Busza J, Kivunaga J, Ndwiga C. Experiences of health care providers with integrated HIV and reproductive health services in Kenya: A qualitative study. BMC Health Serv Res. 2013;13(18):1–10.
Kumakech E, Andersson S, Wabinga H, Berggren V. Integration of HIV and cervical cancer screening perceptions of healthcare providers and policy makers in Uganda. BMC Public Health. 2014;14(810):1–12.
Milford C, Greener LR, Beksinska M, Greener R, Mabude Z, Smit J. Provider understandings of and attitudes towards integration: Implementing an HIV and sexual and reproductive health service integration model, South Africa. African J AIDS Res. 2018;17(2):183–92.
Church K, Mayhew SH. Integration of STI and HIV prevention, care, and treatment into family planning services: A review of the literature. Stud Fam Plann. 2009;40(3):171–86.
Mayhew SH, Warren CE, Ndwiga C, Narasimhan M, Wilcher R, Mutemwa R, et al. Health systems software factors and their effect on the integration of sexual and reproductive health and HIV services. Lancet HIV. 2020;7(10):e711–20.
Willis GB, Artino AR. What Do Our Respondents Think We’re Asking? Using Cognitive Interviewing to Improve Medical Education Surveys. J Grad Med Educ. 2013;5(3):353–6.
Scott K, Ummer O, LeFevre AE. The devil is in the detail: reflections on the value and application of cognitive interviewing to strengthen quantitative surveys in global health. Health Policy Plan. 2021;36(6):982–95.
Scott K, Gharai D, Sharma M, Choudhury N, Mishra B, Chamberlain S, et al. Yes, no, maybe so: The importance of cognitive interviewing to enhance structured surveys on respectful maternity care in northern India. Health Policy Plan. 2020;35(1):67–77.
We wish to acknowledge the women who participated in this study and thank the Malawi Ministry of Health’s district health teams for their support. We are also grateful to Save the Children’s US and Malawi teams for their invaluable contributions, and wish to thank Jane Bruce for her critical input into the study’s design and analysis and for reviewing an earlier draft of the manuscript.
This study was funded by the Pfizer Foundation. The Pfizer Foundation is a charitable organisation established by Pfizer Inc. and is a separate legal entity from Pfizer Inc. with distinct legal restrictions. The Foundation did not participate in this study nor maintains any position regarding the conclusions drawn in this manuscript.
Ethics approval and consent to participate
Ethics approval was obtained from the National Committee on Research in the Social Sciences and Humanities, Malawi (reference NCST/RTT/2/6) and the ethics committee of the London School of Hygiene & Tropical Medicine, UK (reference 16188). All methods were performed in accordance with the relevant guidelines and regulations of the Declaration of Helsinki, and written informed consent was obtained from all respondents prior to their participation in the study.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Hamon, J.K., Kambanje, M., Pryor, S. et al. Integrated delivery of family planning and childhood immunisation services: a mixed methods assessment of service responsiveness. BMC Health Serv Res 22, 572 (2022). https://doi.org/10.1186/s12913-022-07983-7