Skip to main content

The cost-effectiveness of a proportionate parenting programme for primary caregivers and their child: an economic evaluation using evidence from the E-SEE Trial

Abstract

Background

Behavioural and mental disorders have become a public health crisis; averting mental ill-health in early years can achieve significant longer-term health benefits and cost savings. This study assesses whether the Enhancing Social-Emotional Health and Wellbeing in the Early Years (E-SEE-Steps)—a proportionate universal delivery model comprising the Incredible Babies book (IY-B) and the Incredible Years Infant (IY-I) and Toddler (IY-T) parenting programmes is cost-effective compared to services as usual (SAU) for the primary caregiver, child and dyad.

Methods

Using UK data for 339 primary caregivers from the E-SEE trial, we conducted a within-trial economic evaluation assessing the cost-effectiveness of E-SEE Steps. Health outcomes were expressed in quality-adjusted life-years (QALY) and costs in UK pounds sterling (2018–19). Missing data were populated via multiple imputation and costs and QALYs discounted at 3.5% per annum. Cost-effectiveness results were conducted for primary caregivers, children and dyad using econometric modelling to control for patient co-variables. Uncertainty was explored through scenario and sensitivity analyses.

Results

The average cost of E-SEE Steps intervention was £458.50 per dyad. E-SEE Steps was associated with modest gains in primary caregiver HRQoL but minor decrements in child HRQoL compared to SAU. For primary caregivers, E-SEE Steps was more effective (0.034 QALYs) and more costly (£446) compared to SAU, with a corresponding incremental cost-effectiveness ratio (ICER) of £13,011 per QALY. In children, E-SEE Steps was strictly dominated with poorer outcomes (-0.005 QALYs) and greater costs (£178) relative to SAU. QALY gains in primary caregivers exceeded those QALY losses found in children, meaning E-SEE Steps was more effective (0.031 QALYs) and costly (£621) for the dyad (ICER: £20,062 per QALY). All scenario analyses found E-SEE Steps cost-effective for the dyad at a £30,000 per QALY threshold. Sensitivity analyses found significant cost reductions from expansions in programme delivery and attendance.

Conclusions

E-SEE Steps achieved modest health gains in primary caregivers but small negative effects on children and was more costly than SAU. E-SEE Steps appears cost-effective for the dyad, but the results should be interpreted with caution given the potential detrimental impact on children.

Trial registration

ISRCTN11079129; Pre participant trial enrolment, 11/05/2015

Peer Review reports

Background

Mental health problems have become a public health crisis. In the UK mental health problems represent the largest single cause of ill-health and disability, with 1 in 4 people now experiencing a mental health issue each year [1]. The annual economic costs of mental health problems in the UK stands at approximately £118 billion per year, prompting significant policy interest in preventative interventions, particularly those aimed at improving early cognitive and social development, and in combatting intergenerational transmission of mental and behavioural disorders [1,2,3]. Preventing mental ill-health in early years can alleviate large disease and financial burdens to children, their families and wider society [4, 5].

Ineffective parenting strategies and parental emotional distress are known to impact negatively on child social and emotional wellbeing, while children whose parents have mental health problems are more likely to present with similar problems themselves [6, 7]. Early intervention programmes, targeted at vulnerable child populations, have been shown as effective preventative strategies in a number of settings [8]. Interventions aimed towards improving the home environment, parenting skills, positive parent–child interactions and understanding of child development and safety issues, can act as a more effective, and less costly, alternative to corrective care [9]. Accordingly, UK policy guidelines and recent literature reviews promote interventions which enhance the social and emotional well-being of vulnerable young children, recommending home visits, early education, childcare and parenting programmes [10, 11]. Targeted child services have the potential for longer-term health benefits and cost savings, with positive feedback within and between generations.

The Incredible Babies book (IY-B) is a guide designed to help parents understand and journal a baby’s physical, social, emotional and language development; the Incredible Years (IY) Infant (IY-I) and Toddler (IY-T) parenting programmes are manualised parent education and training interventions which use group-based components and materials to enhance the social and emotional well-being of children aged 0–1 and 1–3 years, respectively [12]. IY programmes have been evaluated in a variety of contexts and shown to confer sizeable benefits, particularly in highly distressed families [13, 14]. The aim of this economic analysis was to consider the cost-effectiveness of E-SEE Steps, a multi-layer intervention combining universal IY-B with targeted IY parenting programmes, using evidence from the E-SEE (Enhancing Social-Emotional Health and Wellbeing in the Early Years) trial.

Methods

E-SEE trial

The E-SEE trial was a community-based pragmatic two-arm randomised controlled trial that evaluated the E-SEE Steps programme compared with services as usual (SAU). At baseline, all intervention parents received IY-B and depending on level of need, as indicated by parental depression scores or child social emotional wellbeing (Patient Health Questionnaire ≥ 5; or Ages and Stages Questionnaire: Social and Emotional, 2nd edition ≥ Monitoring Zone), parents were invited to participate in the IY-I programme (10 weeks, 2 h/week) at 2 months post-baseline and/or the IY-T programme (12 weeks, 2 h/week) at 9 months [15, 16]. The trial recruited parents of children aged 0–2 years from predominately disadvantaged areas in England. Further details about the trial are available elsewhere [17,18,19].

Resource use and costs

Parental- and child-related resource use data was collected from primary-caregivers at baseline, 2-months, 9-months, and 18-months post-baseline follow-up using a modified service use questionnaire. Baseline forms recorded resource use two-months prior to trial entry.

Resource use and costs were grouped into the following categories: intervention-related; primary-care; secondary-care; mental health care; community service; social service; childcare; and absent workdays. Intervention-related unit costs were based on recorded trial costs; childcare costs were informed by relevant surveys [20, 21]; health care, social care and community service costs were sourced from published UK sources [22, 23]; and absent workday productivity losses were estimated using the human capital approach [24]. Costs reflected UK pounds sterling at 2018–19 prices. Unit costs were inflated where necessary [23]. Unit costs are provided in Appendix file 1 in Supplemental Materials.

Resource use from the E-SEE Steps programme comprised: the IY-B books provided to staff and primary caregivers; the staff, materials and operational arrangements used to train group leaders in the IY-I and IY-T programmes; the staff time and materials used in IY-I and IY-T group-sessions; and the follow-up correspondence provided to primary caregivers between group sessions (i.e. letters, texts, phone calls and home visits). Intervention costs were taken from trial records and were applied to primary caregiver costs. To explore the potential for economies-of-scale, intervention-related costs were divided into variable and fixed costs (Appendix 1).

Total costs were aggregated for each primary caregiver, enrolled child and dyad by multiplying the total number of each resource item utilised over the trial period by their respective unit costs and summating. Costs were estimated from three perspectives: 1) a public health sector perspective (NHS and Personal Social Services); 2) a family perspective considering childcare and absenteeism; and 3) a broader perspective encompassing both public- and family-related costs. The base case cost-effectiveness analysis was conducted from a public health sector perspective. Scenario analyses explored alternative costing perspectives and minimum, maximum, and site-specific intervention costs. Sensitivity analyses explored how changes in group-session attendance and the number of programmes a trained practitioner ultimately delivers impacts average programme costs and cost-effectiveness.

Outcomes

The primary outcome used in the cost-effectiveness analysis was quality-adjusted life years (QALYs), a composite measure of health encompassing both morbidity and mortality (with one QALY equalling a year in perfect health).

The HRQoL of primary caregivers was estimated using the EQ-5D-5L questionnaire collected at baseline, 2, 9- and 18-months post-randomisation. The EQ-5D-5L is a descriptive system requiring individuals to rate their health in accordance with five levels of severity across five health dimensions (mobility, self-care, usual activity, pain/discomfort and anxiety/depression), resulting in a total of 3,125 possible health states. In line with guidance from the National Institute for Health and Care Excellence (NICE), base case HRQoL weights were calculated using a published mapping of EQ-5D-5L responses onto those HRQoL values reported from the EQ-5D-3L instrument [25, 26]. Preference values based on a study of population values of the EQ-5D-5L were used in a scenario analysis.

The HRQoL of children was informed using the Strengths and Difficulties Questionnaire (SDQ) completed by primary caregivers at 18 months post-randomisation. The SDQ is a behavioural screening questionnaire designed to measure emotional and behavioural problems for children and young people. A published mapping of SDQ responses onto the Child Health Utility (CHU9D) questionnaire, a generic preference-based measure of paediatric HRQoL, was used to derive study HRQoL weights for children [27]. Baseline HRQoL was assumed to be equal to that reported in SAU at 18 months for both arms as collection of baseline values was not feasible.

Adult and child QALYs were estimated separately using an area under the curve approach with linear interpolation between time points [28].

Analysis

Cost-effectiveness results were calculated over the trial time-horizon (18 months) and were informed using estimates of primary caregiver and child costs and QALYs that control for relevant participant co-variables. Regression analyses controlled for treatment allocation, child age, adult age, child gender, highest qualification, and relationship status. Baseline HRQoL scores were also included as covariates in primary caregiver QALY regression analyses in order to control for imbalances in baseline utility values between arms [29]. Controlling for baseline costs was explored as a scenario analysis [30]. For the cost analysis, generalised linear models using a log link and gamma family form were used to account for the nature of cost data (i.e. mass point at zero, non-negative, skewed) [31]. For the QALY analysis, ordinary least square regressions were used. In line with UK guidelines, costs and QALYs were discounted at 3.5% per annum [25]. Multiple imputation by chained equations with predictive mean matching was used to impute missing cost, outcome and income data; the subsequent analysis of multiple imputed data sets followed Rubin’s rules [32, 33]. Analyses supporting the reliability of the imputation model are provided in Appendix 6 in Supplementary Materials.

Cost-effectiveness results included: adjusted mean cost and QALY estimates, incremental cost-effectiveness ratios (ICERs), incremental net-health benefits (INHB) and probabilities of alternatives being the most costly, effective, and cost-effective strategy. Results were presented for primary caregivers, children, and the dyad (overall) with ICERs representing the cost per additional QALY of E-SEE Steps compared to SAU, and INHB the health gain from E-SEE Steps (in QALYs) above the opportunity cost of its additional expenditure (i.e. the health which would have otherwise been generated elsewhere with those resources) [28]. Monte Carlo simulation using the Cholesky decomposition method of error propagation was employed to capture uncertainty in the estimates [34]. Measures of cost-effectiveness were considered using threshold values used by the UK’s Department for Health [35] (£15,000 per QALY) and National Institute for Health and Care Excellence [25] (£20,000 and £30,000 per QALY). Sensitivity analyses were conducted deterministically. The analysis was prespecified in a health economic analysis plan [19].

Results

Patient data and characteristics

Primary caregivers who informed the economic analysis were female, predominately in cohabiting relationships (89%), had undergone further education (68%), and were broadly representative of the UK’s ethnic background. Enrolled children were on average 6-weeks old at baseline and were gender balanced (49% female). Characteristics were comparable between trial arms. Further details on participant characteristics are reported elsewhere [17]. Missing parent and child baseline characteristics, resource use data and HRQoL outcomes were low (< 10%), income data had an elevated degree of missingness (22%).

Cost analysis

The cost of the E-SEE Steps intervention amounted to £458.50 per primary carer. The main cost drivers were training group leaders (£233.19 per trial participant (50.8%)) and IY-I and IY-T group-session delivery (£196.50 (42.9%)); other programme costs included IY-B book provision (£20 (4.3%)) and contact-related expenses (£8.81 (1.9%)). Average training and group-session costs were highly variable between sites and were contingent on a variety of contextual factors including the number of attendees, catering, venue costs, participant childcare requirements, training expenses and job-profiles of those delivering the course(s). A breakdown of programme costs can be found in Appendix 23 in Supplemental Materials.

For primary caregivers and children, average public sector costs were £401 and £161 higher for E-SEE Steps relative to SAU; cost differentials were predominantly driven by intervention costs and community service utilisation, respectively. From a family perspective, average costs were comparable between arms. E-SEE Steps equated to an additional cost of £526 per family when considering both family and public sector perspectives. Table 1 provides a full cost breakdown.

Table 1 Adult-related and child-related costs by resource category (pounds sterling, 2018/19)

Outcome assessment

Compared to baseline, mapped EQ-5D-3L scores for primary caregivers randomised to E-SEE Steps increased at 2-months and 9-months follow-up, before returning to values comparable with baseline figures and SAU at 18-months; scores were highest in E-SEE Steps at all time points. HRQoL scores using EQ-5D-5L preference values found comparable findings, albeit with higher HRQoL values in both arms. Children randomised to E-SEE Steps reported modest increases in child SDQ distress and impairment scores that translated into small decrements in mapped CHU9D HRQoL scores compared to SAU. Full details of imputed HRQoL scores are available in Table 2.

Table 2 Imputed adult-related and child-related HRQoL outcomes by treatment group and follow-up period

Cost-effectiveness

Table 3 reports the mean trial cost, QALY and cost-effectiveness estimates for the dyad and for primary caregivers and children specifically. In primary caregivers, estimated incremental costs and QALYs equalled £446 and 0.034 for E-SEE Steps, respectively, equating to an ICER of £13,011 per QALY compared to SAU. For children, incremental costs were estimated at £178 with a QALY loss of 0.005 compared to SAU, meaning E-SEE steps was dominated by SAU. Overall, E-SEE Steps was estimated to have an incremental cost of £621, incremental QALY gain of 0.031 (QALY gains in primary caregivers surpassing child QALY decrements) and an ICER of approximately £20,062 per QALY compared to SAU. INHB were positive at all cost-effectiveness thresholds considered in primary caregivers but were negative at £15,000 and £20,000 thresholds overall and at all thresholds for children. Probabilities of cost-effectiveness varied widely and were largely contingent on choice of threshold and perspective. Results suggested significant decision uncertainty with 95% credible intervals for INHB crossing zero and cost and QALY intervals overlapping between E-SEE Steps and SAU. All regression results used to inform the cost-effectiveness analysis are reported in Appendix 4 in Supplemental Materials.

Table 3 Within-trial cost-effectiveness analysis

Scenario and sensitivity analysis

The dyad trial cost, QALY and ICER estimates for a range of scenario analyses are reported in Table 4. Detailed results for each scenario are provided in Appendix 5 in Supplementary Materials. Controlling for baseline costs increased the incremental cost of E-SEE Steps compared to SAU (from £621 to £815), as SAU accrued higher average costs in the two months prior to enrolment in the trial (i.e. controlling for baseline costs reduced the costs attributable to SAU alone relative to E-SEE Steps). As a result, E-SEE Steps had an ICER of £26,312 per QALY.

Table 4 Cost-effectiveness scenario analysis

When using EQ-5D-5L preference weights to measure adult HRQoL, QALY estimates were notably higher compared to base case findings but with E-SEE Steps associated with a smaller QALY gain (0.031 to 0.023) and an ICER of £27,068 per QALY.

Taking a broader costing perspective (public sector and family-related costs) increased overall mean costs in both arms, reduced incremental costs associated with E-SEE Steps compared to base case findings (£621 to £432 – from childcare cost savings) and had an associated ICER of £14,654.

Given the high variability in the attendance of IY-I and IY-T group-sessions during the trial, a best-case scenario assumed all those who attended sessions were in groups at full capacity (12 families). The incremental cost of E-SEE Steps (£312) was approximately half base case values (£621) when run at capacity, with an associated ICER of £9,993 compared to SAU.

E-SEE Steps’ average programme costs were sensitive to changes in number of attendees at group sessions and the number of programmes delivered by each trained practitioner. Group sessions attended by a single primary-caregiver increased intervention costs to an average of £1,423 per family (ICER: £52,110); when attended by two, three or four primary-caregivers average intervention costs reduced to £711 (ICER: £29,137), £475 (ICER: £21,479) and £356 (ICER: £17,650), respectively. Assuming trained group-leaders delivered two, three or four programmes reduced average intervention costs (£486) to £342 (ICER: £17,680), £304 (ICER £16,424) and £284 (ICER: £15,797), respectively. Average intervention costs plateaued to approximately £235 (ICER: £14,300) at 20 programmes delivered per practitioner.

Applying the minimum training expenses and practitioner pay bands observed at trial sites reduced intervention costs by approximately £94 and the associated ICER to £17,017 per QALY. Using the maximum training and staff costs observed across trial sites raised intervention costs by approximately £117 and the associated ICER to £23,820. Results for each specific site fell between the minimum and maximum costing scenarios (Table 4).

Discussion

Our findings suggest the E-SEE Steps programme offers small health gains to primary caregivers with potentially small detrimental impacts on child outcomes. E-SEE Steps would be borderline cost-effectiveness at UK thresholds over an 18-month time horizon. However, the potential for negative impacts on children and for these to be linked with future detrimental outcomes suggest that the cost-effectiveness of the programme is questionable. Gains in HRQoL were experienced solely by primary caregivers; there was no evidence indicating E-SEE Steps enhanced child social emotional wellbeing nor HRQoL. The average intervention costs equated to £458.50 per dyad, overall incremental costs of E-SEE steps amounted to £621 from a public perspective and had an ICER of £20,062 compared to SAU. Decision uncertainty was large, however scenario analyses found E-SEE Steps remained cost-effective at a £30,000 per QALY threshold for a variety of alternate assumptions. Average programme costs were sensitive to changes in the scale of programme delivery and attendance.

Hurt et al.’s systematic review cited insufficient evidence that early-year programmes are effective at improving childhood development up to 24 months postpartum, a conclusion E-SEE Steps has not altered [36]. However, IY programmes have demonstrated efficacy in older child cohorts in a variety of contexts [13]. The magnitude of costs in our study was significantly below previous findings. This was likely driven by the proportionate delivery of parenting programmes in E-SEE which significantly reduced programme costs compared to such previous assessments of universal provision, even with group sizes in E-SEE significantly below those reported elsewhere [37, 38]. Gardner et al.’s [13] economic analysis of 5 randomised trials reported costs for IY parenting interventions ‘as provided’ ranged between £1,496-£1,792. Our findings offered additional support to evidence from Edwards et al. [37] that non-recurrent fixed costs and course attendance significantly contribute to average programme costs and from O’Neill et al. [38] that staff-expenses constitute the largest cost component of delivering group-sessions and that IY programmes are associated with additional service use compared to control. Despite significantly lower costs, cost-effectiveness results for E-SEE Steps were less favourable than previous analyses of IY programmes [37,38,39] that compared different configurations of IY serving older children.

The present study had several strengths. Data was compiled from a multi-centre prospective randomised study which achieved high levels of data completion across a number of validated HRQoL instruments and service use questionnaires. The analysis used methods in line with UK guidance for cost-effectiveness analysis, applied cost-effectiveness thresholds applicable for UK decision making, assessed generalisable health outcomes, controlled for adult and child covariables to address potential baseline imbalances, and explored the impacts alternative methodologies, perspectives and structural assumptions had on base case findings.

Nonetheless, the analysis had a number of weaknesses. First, child outcomes were assessed at a single time point using an instrument not validated for study participants (children 20 months of age) [40], meaning the analysis failed to fully account for potential baseline differences or underlying treatment effect dynamics in children and misaligned the study population with those used to validate the SDQ and map preference weights [27, 40]. Second, the generalisability of base case intervention costs may be limited given the trial incurred no venue costs for hosting parenting programmes, fixed costs were only distributed over small samples and broader implementation costs applicable to national roll-outs were not considered (e.g. process factors including administration, procurement and oversight) [41]. In addition, a voucher scheme used to encourage participation during the trial was not costed in the present analysis thereby potentially underestimating total costs in both arms. Third, conclusions on cost-effectiveness relied on modest interim differentials in parental HRQoL informed by a trial that was not powered to detect for differences in adult HRQoL. Fourth, the economic analysis failed to consider impacts outside the dyad despite the trial collecting partial co-parent data. A wider perspective could provide a more comprehensive account of the health, resource, and earning consequences applicable to a household and wider family when undertaking a parental-programme.

Study results were based on intermediary early-year assessments of children and their primary caregivers; however, the longer-term consequences of E-SEE Steps remain unclear. At later stages of development, children may benefit from parental learnings, reductions in caregiver depression scores and uptakes in community services associated with E-SEE Steps. On the other hand, those child decrements reported may persist into the future, and in the longer-term, exceed those temporary gains in HRQoL observed in adults during the trial. Stakeholders are interested in the long-term returns to investment and the overall cost-effectiveness of public health prevention from early-year services. To better inform decision making, programme evaluations would benefit from: 1) long-term follow-up to better assess final child outcomes; 2) generalisable health-related measures that are valid, appropriate, reliable and responsive across different stages of development in young paediatric populations; and 3) the application of life course modelling to best extrapolate study findings [42,43,44]. Pragmatic observational study designs can help provide longer-term follow-up, larger-scale studies can consider broader operational and contextual factors that may underpin cost-effectiveness, and causal inference methods can provide meaningful estimates of treatment effect in the absence of randomised allocations [41, 45, 46]. Studies that assess longer-term consumption, mortality and HRQoL consequences can benefit from new developments in life-course modelling (e.g. LifeSim) which can extrapolate to ultimate life-time economic, social and health outcomes [44]. Applications of distributional cost-effectiveness and cross‐sectoral frameworks can extend evaluations to consider information about the fairness in the distribution of who gains and who loses from early-year programmes, alternative uses of limited public resources, and best account for the costs and effects that fall on non-health sectors and alternative decision makers [47, 48]

Programmes such as E-SEE Steps with potentially conflicting impacts on adult and child outcomes pose difficult questions for decision making. To what extent should decrements in outcomes for some (e.g. children) be tolerated for benefits to others (e.g. caregivers, siblings, etc.)? Are child-centred interventions ineffective at improving child-outcomes fit for purpose? The E-SEE Steps programme could be considered an effective screening tool for identifying and helping primary caregivers in need of support. Whether the gains in parental HRQoL achieved from doing this constitute a cost-effective allocation of resources is a matter of the perspective, willingness to pay and overarching objectives of decision makers [49].

Conclusions

In summary, the present study found no evidence that E-SEE Steps improved child outcomes, while conclusions around overall cost-effectiveness relied on moderate intermediary gains in parental HRQoL and intervention costs at approximately £460. Future economic evaluations in parenting interventions can go further by assessing follow-up across more child developmental stages, utilising life-course modelling where possible, and considering broader impacts both within families and across wider society.

Availability of data and materials

The data that support the findings of this study are not openly available due to them containing information that could compromise research participant privacy/consent. Requests for participant-level quantitative data and statistical codes should be made to the corresponding author. Data requests will be put forward to members of the original trial management team who will release data on a case-by-case basis.

Abbreviations

ASQ :

Ages & Stages Questionnaires

CHU9D:

Child Health Utility Index – 9 Dimension

CI:

Credible Interval

EQ-5D:

EuroQol—5 Dimension

E-SEE :

Enhancing Social-Emotional Health and Wellbeing in the Early Years

HRQoL:

Health-Related Quality of Life

ICER:

Incremental Cost-Effectiveness Ratio

INHB:

Incremental Net Health Benefit

IY:

Incredible Years

IY-B:

Incredible Years—Book

IY-I :

Incredible Years—Infant

IY-T :

Incredible Years—Toddler

NCE:

National Institute for Health and Care Excellence

NHS:

National Health Service

PHQ:

Patient Health Questionnaire

PSSRU :

Personal social services research unit

QALY:

Quality-Adjusted Life Year

RCT:

Randomised Control Trial

SAU:

Services As Usual

SD:

Standard Deviation

SDQ:

Strengths and Difficulties Questionnaire

UK :

United Kingdom

References

  1. Mental Health Taskforce I. THE FIVE YEAR FORWARD VIEW FOR MENTAL HEALTH. 2016.

  2. Mcdaid D, Park A-L, Davidson G, John A, Knifton L, Morton A, et al. The economic case for investing in the prevention of mental health conditions in the UK [Internet]. 2022. Available from: https://www.mentalhealth.org.uk/publications/mental-health-problems-cost-uk-economy-least-118-billion-year

  3. Davies SC, Lemer C, Strelitz J. Weil L. Our children deserve better: Prevention pays. Lancet. Lancet Publishing Group; 2013. p. 1383–4.

    Google Scholar 

  4. Fergusson DM, Horwood LJ, Ridder EM. Show me the child at seven: the consequences of conduct problems in childhood for psychosocial functioning in adulthood. J Child Psychol Psychiatry. 2005;46:837–49.

    Article  Google Scholar 

  5. Baranne ML, Falissard B. Global burden of mental disorders among children aged 5–14 years. Child Adolesc Psychiatry Ment Health. BioMed Central Ltd.; 2018;12:19.

  6. Webster-Stratton C. Preventing conduct problems in head start children: Strengthening parenting competencies. J Consult Clin Psychol. 1998;66:715–30.

    CAS  Article  Google Scholar 

  7. Webster-Stratton C, Hammond M. Conduct problems and level of social competence in head start children: Prevalence, pervasiveness, and associated risk factors. Clin Child Fam Psychol Rev. Kluwer Academic Publishers; 1998;1:101–24.

  8. Organization WH. Prevention of Mental Disorders EFFECTIVE INTERVENTIONS AND POLICY OPTIONS SUMMARY REPORT A Report of the World Health Organization Prevention of Mental Disorders EFFECTIVE INTERVENTIONS AND POLICY OPTIONS SUMMARY REPORT A Report of the. 2004.

  9. Allen G. Early intervention : the next steps : an independent report to Her Majesty’s Government. TSO (The Stationery Office); 2011.

  10. National Institute for Health and Care Excellence (NICE). Social and emotional wellbeing: early years public health guideline.

  11. Furlong M, McGilloway S, Bywater T, Hutchings J, Smith SM, Donnelly M. Behavioural and cognitive-behavioural group-based parenting programmes for early-onset conduct problems in children aged 3 to 12 years. Cochrane database Syst Rev. 2012;CD008225.

  12. The Incredible Years | Training series for Parents, Teachers, and children [Internet]. Available from: https://incredibleyears.com/

  13. Gardner F, Leijten P, Mann J, Landau S, Harris V, Beecham J, et al. Could scale-up of parenting programmes improve child disruptive behaviour and reduce social inequalities? Using individual participant data meta-analysis to establish for whom programmes are effective and cost-effective. Public Heal Res [Internet]. National Institute for Health Research; 2017 [cited 2021 May 7];5:1–144. Available from: https://www.ncbi.nlm.nih.gov/books/NBK469806/

  14. Webster-Stratton C, Bywater T. The Incredible Years® series: An internationally evidenced multimodal approach to enhancing child outcomes. APA Handb Contemp Fam Psychol Fam Ther Train (Vol 3). American Psychological Association; 2018 [cited 2022 May 18];343–59. Available from: /record/2018–59954–021

  15. Squires J, Bricker D, Twombly E. ASQ:SE-2TM User’s Guide. 2015;320.

  16. Spitzer RL, Kroenke K, Williams JBW. Validation and utility of a self-report version of PRIME-MD: the PHQ primary care study. Primary Care Evaluation of Mental Disorders. Patient Health Questionnaire. JAMA [Internet]. JAMA; 1999 [cited 2022 May 17];282:1737–44. Available from: https://pubmed.ncbi.nlm.nih.gov/10568646/

  17. Tracey Bywater, Vashti Berry, Sarah Blower, Matthew Bursnall, Edward Cox, Amanda Mason-Jones, Sinéad McGilloway, Kirsty McKendrick, Siobhan Mitchell, Kate Pickett, Gerry Richardson, Kiera Solaiman, M. Dawn Teare SW and KW. Social-Emotional Wellbeing: A Proportionate Universal Randomised Controlled Trial of the Incredible Years® Infant and Toddler Parenting Programmes (E-SEE STEPS).

  18. Bywater T, Berry V, Blower SL, Cohen J, Gridley N, Kiernan K, et al. Enhancing Social-Emotional Health and Wellbeing in the Early Years (E-SEE): A study protocol of a community-based randomised controlled trial with process and economic evaluations of the incredible years infant and toddler parenting programmes, delivered . BMJ Open [Internet]. BMJ Publishing Group; 2018 [cited 2021 Apr 22];8:26906. Available from: http://bmjopen.bmj.com/

  19. Enhancing Social-Emotional Health and Wellbeing in the Early Years: A Community-based Randomised Controlled Trial (and Economic) Evaluation of the Incredible Years Infant and Toddler (0–2) Parenting Programmes Project Page [Internet]. Available from: https://www.york.ac.uk/healthsciences/research/public-health/projects/e-see-trial/

  20. Coleman L, Cottell J. Childcare Survey 2019 [Internet]. Available from: www.familyandchildcaretrust.org.

  21. Average childcare costs - Money Advice Service.

  22. National Health Service (NHS) Improvement. Reference costs 2017–18. 2018.

  23. Curtis LA and BA. UNIT COSTS OF HEALTH AND SOCIAL CARE 2019. Kent: Personal Social Services Research Unit; 2019.

  24. Koopmanschap MA, Rutten FFH. A practical guide for calculating indirect costs of disease. Pharmacoeconomics. Springer International Publishing; 1996. p. 460–6.

  25. National Institute of Health and Care Excellence (NICE). Guide to the methods of technology appraisal 2013. 2013.

  26. Van Hout B, Janssen MF, Feng YS, Kohlmann T, Busschbach J, Golicki D, et al. Interim scoring for the EQ-5D-5L: Mapping the EQ-5D-5L to EQ-5D-3L value sets. Value Heal. 2012;15:708–15.

    Article  Google Scholar 

  27. Furber G, Segal L, Leach M, Cocks J. Mapping scores from the Strengths and Difficulties Questionnaire (SDQ) to preference-based utility values. Qual Life Res Qual Life Res. 2014;23:403–11.

    Article  Google Scholar 

  28. Drummond M, Sculpher M, Claxton K, Stoddart G. Methods for the economic evaluation of health care programmes. 2015.

  29. Fenwick E, Claxton K, Sculpher M. Representing uncertainty: The role of cost-effectiveness acceptability curves. Health Econ. 2001;10:779–87.

    CAS  Article  Google Scholar 

  30. Van Asselt ADI, Van Mastrigt GAPG, Dirksen CD, Arntz A, Severens JL, Kessels AGH. How to deal with cost differences at baseline. Pharmacoeconomics. 2009;27:519–28.

    Article  Google Scholar 

  31. Franklin M, Lomas J, Walker S, Young T. An Educational Review About Using Cost Data for the Purpose of Cost-Effectiveness Analysis [Internet]. Pharmacoeconomics. Springer International Publishing; 2019 [cited 2021 Apr 24]. p. 631–43. Available from: https://doi.org/10.1007/s40273-019-00771-y

  32. White IR, Royston P, Wood AM. Multiple imputation using chained equations: Issues and guidance for practice. Stat Med. 2011;30:377–99.

    Article  Google Scholar 

  33. Little RJA, Rubin DB. Statistical analysis with missing data.

  34. Briggs A, Sculpher M, Claxton K. Decision modelling for health economic evaluation. 2006.

  35. Issues Surrounding the Estimation of the Opportunity Cost of Adopting a New Health Care Technology: Areas for Further Research | OHE.

  36. Hurt L, Paranjothy S, Lucas PJ, Watson D, Mann M, Griffiths LJ, et al. Interventions that enhance health services for parents and infants to improve child development and social and emotional well-being in high-income countries: A systematic review. BMJ Open [Internet]. BMJ Publishing Group; 2018 [cited 2021 May 6];8:14899. Available from: http://bmjopen.bmj.com/

  37. Edwards RT, Jones C, Berry V, Charles J, Linck P, Bywater T, et al. Incredible Years parenting programme: cost-effectiveness and implementation. J Child Serv [Internet]. 2016 [cited 2021 May 6];11:25–37.

  38. O’Neill D, McGilloway S, Donnelly M, Bywater T, Kelly P. A cost-effectiveness analysis of the Incredible Years parenting programme in reducing childhood health inequalities. Eur J Heal Econ [Internet]. Springer; 2013 [cited 2021 May 6];14:85–94. Available from: http://www.casemix.ie/.

  39. Muntz R, Hutchings J, Edwards R-T, Hounsome B, O ´ ’céilleachair A. Economic Evaluation of Treatments for Children with Severe Behavioural Problems. J. Ment. Heal. Policy Econ. J Ment Heal. Policy Econ. 2004.

  40. Strengths and Difficulties Questionnaire [Internet]. [cited 2021 Apr 28]. Available from: https://www.corc.uk.net/outcome-experience-measures/strengths-and-difficulties-questionnaire/

  41. Lindsay G, Strand S. Evaluation of the national roll-out of parenting programmes across England: The parenting early intervention programme (PEIP). BMC Public Health [Internet]. BioMed Central; 2013 [cited 2021 Apr 30];13:972. Available from: http://bmcpublichealth.biomedcentral.com/articles/https://doi.org/10.1186/1471-2458-13-972

  42. Wallander JL, Koot HM. UC Merced UC Merced Previously Published Works Title Quality of life in children: A critical examination of concepts, approaches, issues, and future directions. A critical examination of concepts, approaches, issues, and future directions: Publication Date Quality of life in children; 2015.

    Google Scholar 

  43. Germain N, Aballéa S, Toumi M. Measuring health-related quality of life in young children: how far have we come? J Mark Access Heal Policy [Internet]. Informa UK Limited; 2019 [cited 2021 Apr 27];7:1618661. Available from: /pmc/articles/PMC6534256/

  44. Skarda I, Asaria M, Cookson R. LifeSim: A Lifecourse Dynamic Microsimulation Model of the Millennium Birth Cohort in England. medRxiv [Internet]. Cold Spring Harbor Laboratory Press; 2021 [cited 2021 Apr 30];2021.02.12.21251642. Available from: https://doi.org/10.1101/2021.02.12.21251642

  45. Webster-Stratton C, Rinaldi J, Reid JM. Long-Term Outcomes of Incredible Years Parenting Program: Predictors of Adolescent Adjustment*.

  46. Hernán MA, Robins JM. Causal Inference: What If [Internet]. 2020. Available from: https://www.hsph.harvard.edu/miguel-hernan/causal-inference-book/

  47. Walker S, Griffin S, Asaria M, Tsuchiya A, Sculpher M. Striving for a Societal Perspective: A Framework for Economic Evaluations When Costs and Effects Fall on Multiple Sectors and Decision Makers. Appl Health Econ Health Policy [Internet]. Springer International Publishing; 2019 [cited 2021 May 5];17:577–90 Available from: https://doi.org/10.1007/s40258-019-00481-8

  48. Cookson R, Griffin S, Norheim O, Culyer A. Distributional Cost-Effectiveness Analysis: Quantifying Health Equity Impacts and Trade-Offs [Internet]. 2020 [cited 2021 May 7]. Available from: https://books.google.co.uk/books?hl=en&lr=&id=K_7-DwAAQBAJ&oi=fnd&pg=PP1&dq=Distributional+Cost-Effectiveness+Analysis:+Quantifying+Health+Equity+Impacts+and+Trade-Offs&ots=IOyL2QZe2T&sig=nWSzxz2YYU-IwYvDXJWS4Yd5Vic

  49. Claxton K, Walker S, Palmer S, Sculpher M. Appropriate Perspectives for Health Care Decisions. Work Pap [Internet]. Centre for Health Economics, University of York; 2010 [cited 2021 May 7]; Available from: https://ideas.repec.org/p/chy/respap/54cherp.html

  50. Campbell MK, Elbourne DR, Altman DG, Campbell MK. CONSORT statement: extension to cluster randomised trials. bmj.com [Internet]. 2004 [cited 2021 Dec 26];328:702–10. Available from: https://www.bmj.com/content/328/7441/702.short

Download references

Acknowledgements

This study was funded by the National Institute for Health Research's Public Health Research Programme (NIHR PHR 13/93/10). The views expressed are those of the author(s) and not necessarily those of the NHS, the NIHR the Department of Health and Social Care, or the ARCs. We thank the participants and staff who supported this study.

Funding

All authors were supported by the funding grant, NIHR PHR (ref 13/93/10); TB is a Trustee for Children's Early Intervention Trust (CEIT). Early Intervention Wales Training (EIWT) is owned by CEIT and offers training courses, including Incredible Years® (IY). Trustees do not benefit financially from trainings or CEIT/EIWT activities. E-SEE study trainings were arranged via the IY developer in the U.S. TB, SB, and GR are supported by the NIHR Yorkshire and Humber Applied Research Collaboration (ARC-YH).

Author information

Authors and Affiliations

Authors

Contributions

EC, SW, FS and GR developed and conducted the analysis with significant support and input from TB and SB. TB and SB contributed to the design and undertaking of the E-SEE trial. EC drafted the manuscript with substantial input from SW, FS, SB, TB and GR. All authors were involved in the critical revision of the manuscript and approve this submitted version.

Corresponding author

Correspondence to Edward Cox.

Ethics declarations

Ethics approval and consent to participate

The E-SEE study was approved by the National Health Service (NHS) North Wales Research Ethics Committee (REC) 5, Bangor on 22nd May 2015 (REC Reference: 15/WA/0178, IRAS 173946), and by Departmental Ethics Committee, University of York on 10th August 2015 (Reference: FC15/03). All participants provided written informed consent. Trial methods were conducted in accordance with the most recent CONSORT publication guidelines on the analysis of cluster-randomised trials [50].

Consent for publication

Not applicable; individual person data not reported in any form.

Competing interests

TB, SB and GR are supported by the National Institute for Health Research Applied Research Collaboration Yorkshire and Humber. All authors declare no other competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1:

 Table 1. Unit costs. Table 2. Average E-SEESteps programme costs (pounds sterling, 2018/19). Table 3. Average group-session costs for IY-I and IY-T by resource category (pounds sterling, 2018/19). Table 4. Regression analyses. Table 5. Scenario analyses. Table 6. Inspection of standard errors of multiply imputed data on key dependant variables.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Cox, E., Walker, S., Blower, S. et al. The cost-effectiveness of a proportionate parenting programme for primary caregivers and their child: an economic evaluation using evidence from the E-SEE Trial. BMC Health Serv Res 22, 814 (2022). https://doi.org/10.1186/s12913-022-08220-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12913-022-08220-x

Keywords

  • Cost-effectiveness
  • Incredible years
  • RCT
  • E-SEE Steps
  • Parenting strategies
  • Childhood health