Cost-effectiveness of a transdiagnostic psychotherapy program for youth with common mental health problems
BMC Health Services Research volume 22, Article number: 819 (2022)
Our objective was to evaluate the cost-effectiveness of the transdiagnostic psychotherapy program Mind My Mind (MMM) for youth with common mental health problems using a cost-utility analysis (CUA) framework and data from a randomized controlled trial. Furthermore, we analyzed the impact of the choice of informant for both quality-of-life reporting and preference weights on the Incremental Cost-Effectiveness Ratio (ICER).
A total of 396 school-aged (6–16 years) youth took part in the 6-month trial carried out in Denmark. CUAs were carried out for the trial period and four one-year extrapolation scenarios. Costs were based on a combination of budget and self-reported costs. Youths and parents were asked to report on the youth’s quality-of-life three times during the trial using the Child Health Utility 9D (CHU9D). Parental-reported CHU9D was used in the base case together with preference weights of a youth population. Analyses using self-reported CHU9D and preference weights of an adult population were also carried out.
The analysis of the trial period resulted in an ICER of €170,465. The analyses of the one-year scenarios resulted in ICERs between €23,653 and €50,480. The ICER increased by 24% and 71% compared to the base case when using self-reported CHU9D and adult preference weights, respectively.
The MMM intervention has the potential to be cost-effective, but the ICER is dependent on the duration of the treatment effects. Results varied significantly with the choice of informant and the choice of preference weights indicating that both factors should be considered when assessing CUA involving youth.
Mental health disorders affect many children and adolescents below the age of 18 years (herein referred to as youths) [1,2,3]. The most common mental health disorders among youth; mild to moderate symptoms of anxiety, depression, and disruptive behavior disorders have an increased risk of adverse adult outcomes . Several studies have found promising effects of cognitive-behavioral therapy (CBT) programs for these disorders [5,6,7,8,9,10,11,12]. Still, there is limited access to evidence-based programs. Mind My Mind (MMM) is a transdiagnostic CBT-program for indicated prevention and early treatment of anxiety, depression, and behavioral disturbances below the threshold for psychiatric referral. It was designed to address the problem of limited access by providing a feasible program for large-scale implementation. MMM has recently demonstrated superiority over Management As Usual (MAU) in a pragmatic, multi-site, and randomized controlled trial (RCT) .
Despite the abundance of studies investigating interventions for common mental health disorders among youth, evidence of the cost-effectiveness of indicated prevention and interventions is still limited [14,15,16,17,18,19,20]. CBT programs typically involve a considerable cost due to the amount of time delivered by the therapists. The budget impact is likely to be part of the explanation for the limited access to evidence-based programs. This calls for cost-utility analyses (CUA) of evidence-based interventions to inform decision makers.
Analyzing the cost-utility of interventions for youth presents several challenging aspects. While the methodology and the guidelines for estimating Quality-Adjusted Life Years (QALY) in adult populations are well developed, there is less clear guidance for youth populations . Therefore, a recent review, therefore, warrants further empirical evidence on the valuation of youth-specific preference-based measures . In a mental health setting, the choice of informant is especially important, as experiences and preferences across youths and parents are found to vary . Similarly, the preferences of the different quality-of-life health states vary in the mental dimensions when comparing preferences weights derived from youth and adult populations .
In this study, we analyzed the cost-effectiveness of the MMM intervention using a CUA framework. We also present how the CUA results were impacted by choice of informant (patients or parents) and the choice of preference weights (tariffs) used in the QALY estimation. The CUA was based on data collected in the RCT of MMM versus MAU with a trial period of 26 weeks . MMM aims at treating current symptoms and preventing the development of severe mental disorders. To derive an accurate estimate of the long-term effect of an intervention, it is recommended that health effects and costs are extrapolated for as long as they are assumed to differ between the compared interventions. This is often done using decision-analytic modeling that incorporates data from external sources . However, there is limited data to inform modeling in this case. Few studies of CBT programs have long term follow-up. For those that have long term follow-up, beneficial and statistically significant effects are found up to 12 months after the end of treatment [5,6,7,8,9,10,11,12]. Several cohort studies have also shown associations between psychopathological outcomes and later risk of a severe mental disorder [26, 27]. However, the associations have not been investigated in an experimental design, which makes intervention-based improvements uncertain. The limited data and uncertainty about the long-term effects lead us to analyze different possible scenarios of a one-year extrapolation period. This means that we primarily analyzed the treatment effect of MMM, and not the potential preventive effects.
Full details of the trial design are described in separate papers [13, 28]. In brief, the MMM trial was a pragmatic open-label randomized controlled trial carried out in Denmark in a local municipality setting. Participants were randomly allocated on an individual level 1:1 via independent, blinded, computer-generated allocation sequences with variable and unknown block sizes, stratified by geographical region, age-group (6–10 years or 11–16 years) and their top-problem as defined by the children together with their parents (anxiety, depressive symptoms, behavioral problems). The sample size for the trial was based on the effectiveness outcomes of the trial and not HRQOL or costs outcomes. Data used in the present analyses were collected at baseline, end-of-treatment (week 18), and follow-up (week 26). The trial was approved by the local scientific ethics committee (Journal nr.:H-17011408). The study was registered at ClinicalTrials.gov (Identifier NCT03535805).
A total of 396 (197 randomized to MMM and 199 to MAU) youth aged 6–16 years were enrolled in the trial. A two-stage standardized visitation based on parental referral was implemented in the Educational-psychological advisory service in the four participating municipalities to identify study participants. Further description of the visitation procedure is available elsewhere . Eligibility criteria were: 1) Age between 6 to 16 years, 2) being in 0-9th grade, 3) having a parent-reported score on The Strength and Difficulties Questionnaire (SDQ) above a cut-off based on the top 10% of mental health problems in the general age-matched Danish population , and 4) having anxiety, depressive symptoms, or behavioral problems as the top-problem based on the standardized assessments in the visitation procedure. Youth with a prior diagnosis of any developmental or mental disorder, including autism spectrum disorder, attention-deficit/hyperactivity disorder, psychotic disorder, eating disorder, severe obsessive–compulsive disorder, repeated self-harm, alcohol or psychoactive drug abuse, or with signs of intellectual disability were not eligible for the trial. Further description of the participants is available elsewhere [13, 28].
The MMM intervention is a transdiagnostic, manualized, modular CBT-program comprising 9–13 individual sessions plus a booster-session targeting anxiety, depression and/or behavioral problems. All treatment was delivered by trained local psychologists from the Educational-psychological advisory service in the four municipalities. The treatment was supervised by psychologists from the regional Child and Adolescent Mental Health Services (CAMHS). For further description of the training see Table SM1 in the supplementary material. Youth randomized to MMM were not eligible for other therapeutic interventions offered by the municipalities during the treatment and follow-up period. They could seek help from other health care professionals, e.g. general practitioners (GP). If the mental health condition of the youth progressed to the level at which specialized treatment was indicated according to standard guidelines, they were referred to CAMHS at any point during the trial .
Youth and parents in the MAU group were offered two care-coordination visits to help coordinate usual care in the municipality. These visits were not a standard part of usual care in the municipalities but were introduced in the trial period to make sure the services provided under MAU were salient to the parents and to reduce the risk for attrition. The treatment offered in MAU varied considerably from no intervention to individual and group therapy, and parental training. Psychologists trained in MMM did not conduct care-coordination visits or provide any kind of therapy to the MAU group. The youth in the MAU group could also seek help from other health care professionals or be referred to CAMHS.
Perspective and time horizon
The CUAs were conducted from an extended health sector perspective and included the costs of all interventions directed toward the individual youth’s mental health problems no matter the provider of services. No data was available on indirect interventions like e.g. teacher support and broader class-based preventive interventions.
The base case analysis had a 26-week time horizon consistent with the trial length. As outlined in the Background section the lack of data limits the possibilities of carrying out formal decision analytic modelling. Instead four one-year extrapolations scenarios of the development in HRQOL were analyzed using individual-level data (see Fig. 1): 1) Temporary or catch-up effect, 2) Maintained effect, 3) Back to baseline, 4) Continuing trend from end-of-treatment to follow-up. In scenario 1 we assumed that the effect of MMM was either temporary or there was a catch-up effect from the worst performing group so that the MMM and the MAU group would end up having the same average health state utility value (HSUV) one year after the last observed time point (week 26). The incremental QALY-gain is the same independently of which group is assumed to be steady and which group is assumed to change in mean HSUV, thus, the scenarios were analyzed as one. In scenario 2 we assumed that both groups would have the same HSUV one year after follow-up as they had at follow-up. In scenario 3 we assumed that the trial period only had a temporary effect, so that one year after follow-up, all youth would have the same HSUV as they had at baseline. In scenario 4 we assumed that the trend in the period from end-of-treatment (week 18) to follow-up in which only a booster-session was given, would continue for one year. For scenario 4 we also assumed the highest and lowest HSUV at the extrapolation timepoint to be the highest and lowest observed HSUV. Given that there are no direct intervention driven costs after the trial period had ended, we assumed no group difference in costs during the one-year extrapolation in all analyses of the scenarios, as we have no evidence to the contrary.
All costs were estimated at the individual participant level. All data on the Mind My Mind intervention was based on collected administration data during the trial. Data on individual MAU and other health care use were collected by standardized parent-reported questionnaires at end-of-treatment and follow-up. Table SM1 in the supplementary material provides information on the specific cost components, assumptions, sources of unit costs, and cost estimates. All costs are presented in Euros (€). We converted the Danish kroner (DKK) costs using the currency rate DKK100 = €13.38.
Mind My Mind
The intervention costs comprise the cost of training the psychologists and the supervisors, the costs of materials for the intervention, and the salaries of the psychologists and supervisors. The training costs were divided equally among youth to estimate individual-level costs. As the training of the psychologists can be considered an investment, the full return of the training will not be achieved within the trial period. This was addressed in a sensitivity analysis.
Management as usual
The MAU costs comprise the cost of the care-coordination visits and costs of individual and group therapy, and parent psychoeducation provided by the municipality.
Other health care use
The other costs included in the analyses comprise health care use related to mental health problems including visits to the GP, pediatrician, CAMHS, and private-sector psychologists.
The health effects are expressed in QALY. To calculate QALYs, the youth’s health states must be determined, and each state must be given a utility. In the base case, health states were defined using parent’s answers to The Child Health Utility 9-Dimension (CHU9D), and the utilities associated with each health state were derived from tariffs based on preferences of youth aged 11–17 years.
CHU9D is a generic preference-based health-related quality of life (HRQOL) measure constructed for use in youth. CHU9D has nine items with five levels of severity representing nine dimensions of HRQOL: Worried, Sad, Pain, Tired, Annoyed, Schoolwork/homework, Sleep, Daily routine, and Activities . CHU9D is validated in mental health settings [31, 32]. Parents and youth both completed the CHU9D questionnaire online at baseline, end-of-treatment and a follow-up. For consistency with the primary clinical outcome of the trial , and due to the lower proportion of missing data, parents’ responses were used in the base case.
A validation of CHU9D in a mental health setting has been done using blinded data from the MMM trial , but there are no Danish tariffs for CHU9D. In the study, two sets of tariffs were investigated: 1) preferences of Australians aged 11–17 years from the general population (N = 1,982) , 2) preferences of the adult general population in the United Kingdom (N = 300) . The validation study showed that CHU9D is an appropriate HRQOL measure for use in mental health trials, and that the preference weights generated from the adolescent population resulted in larger mean differences between groups with different levels of mental health problems . Based on these findings and the sample size of the populations the tariffs of Australians aged 11–17 years were used in the present base case.
Descriptive analyses were carried out to determine how to handle missing outcome data following a guide for handling missing data in cost-effectiveness analyses conducted within randomized trials . There were no missing baseline CHU9D values: there were 57 (14%) missing at end-of-treatment, and 63 (16%) at follow-up. For the self-reported cost components there were 59 (15%) missing at end-of-treatment and 63 (16%) at follow-up. In total, 74 (19%) had a missing value at any timepoint. There was a higher proportion of missing values in the MAU group compared to the MMM group for both utilities and costs (74 (24%) versus 48 (18%) missing at any time point). Logistic regression models found the treatment group to be the only statistically significant predictor of missing values when investigating baseline utility, sex, age-group, region, and top problem (anxiety, depression, or behavioral difficulties). Based on the findings, it was assumed that the probability of data being missing was independent of unobserved characteristics, hence, the data were treated as being missing at random within each group.
Multiple-imputation using chained-equations was performed on utility score level and cost-component level. Due to the nature of utility scores and costs, predictive mean matching was used in the imputation. Twenty imputations were performed based on the proportion of missing data . Imputations were performed separately for each trial group. To be consistent with the analysis of the clinical outcomes , the imputation models included baseline utility, sex, age-group, region, and top problem. After imputation, incremental QALYs and costs were calculated as the mean of the incremental QALY estimates and incremental costs estimates, respectively, generated in each imputed dataset following Rubin’s rule . The distributions of the observed and imputed values confirmed the validity of the imputation procedure. Complete case analysis was conducted, confirming the robustness of the imputations. The analysis is available in the supplementary material Table SM2.
Data analysis and results
The RCT found that the MMM intervention leads to significantly better clinical outcomes than MAU with a group difference in SDQ Impact score decrease of 1.10 (95% CI 0.75–0.145) . We thus expected positive incremental QALY results. The results of the CUAs are therefore presented as the Incremental Cost-Effectiveness Ratio (ICER):
Estimates of costs and effects were calculated using Seemingly Unrelated Regression models . Adjustment for baseline utility were included in the estimation of QALYs to account for the imbalance between treatment groups . P-values below 0.05 were considered statistically significant. All analyses were performed in STATA-15 .
Sample uncertainty was examined using non-parametric bootstrapping with 10,000 iterations. Bootstrap samples of 396 were drawn from each of the 20 multiple imputed datasets, and the difference in net benefit between the groups was calculated for each bootstrap sample given different thresholds . The proportion of bootstrap samples in which the net benefit is positive represents the probability that the treatment is cost-effective for each imputed dataset. The probability is then averaged across all the imputed datasets to construct cost-effectiveness acceptability curves.
The psychologist’s training can be considered an investment in which the full return is based on the number of youths each psychologist treated. The restricted trial-period makes the number of youths each psychologist treated lower than the full potential. We therefore conducted sensitivity analyses, in which we assumed the number of treated youths per psychologist to be the highest number one psychologist treated within the trial-period.
The impact of the choice of the informant who evaluates the youth’s health state (the parent or the youth) and the tariffs that are subsequently applied (youth’s or adult’s) to estimate QALYs were explored by conducting a sensitivity analysis using youth’s responses to CHU9D, and another sensitivity analysis using the tariffs derived from a general adult population.
Furthermore, sensitivity analyses of the one-year extrapolation period were performed by estimating ICERs for alternative time periods (6 and 18 months) in the four extrapolation scenarios presented in Perspective and time horizon section.
MMM was estimated to cost €3,471 on average per youth. The cost of the different components of MMM, including the training of psychologists, is available in the supplementary material Table SM1. The cost of training a psychologist was €9,178 and €12,119 for training a supervisor. The cost of the training was divided equally among the youth randomized to MMM. This made the number of treated youths per psychologist in the trial period the most determinant factor of the total cost of the intervention. On average each psychologist treated 8.2 youth, with the highest number being 20 youth for one psychologist. If all trained psychologists treated 20 youths, the average cost would be €2,476.
The costs of MMM, MAU, and other health care utilization are presented in Table 1. The 199 youths allocated to MAU received an average of 1.6 coordinating visits. 198 (95%) received at least one coordinating visit. The mean incremental costs for MMM were €2,981. MAU and private-sector psychologists were the primary sources of costs difference besides MMM. There were no other statistically significant differences in other health care utilization.
MMM had a non-statistically significant higher baseline utility and statistically significant higher utility at both end-of-treatment and follow-up. MMM gained 0.360 QALY in the period and MAU 0.337 QALY. After adjusting for baseline utility, the incremental QALYs were estimated to be 0.017 for MMM. Table 2 presents the utilities for the observed mean values.
The four one-year extrapolation scenarios are illustrated in Fig. 1 with the mean HSUV for the two groups at the three observed time points and at the extrapolated time point (week 78) one year after the last observed time point (week 26). The counter-intuitive development in scenario 4 with decreasing mean HSUV was due to a higher number of youths reaching the HSUV ceiling level of 1 during the extrapolation period than the number reaching the floor level of 0.053.
All four scenarios resulted in statistically significant higher incremental QALYs compared with the base case. Adjusted for baseline utility the mean incremental QALY were 0.059 (95% CI: 0.023–0.101) for scenario 1, 0.104 (95% CI: 0.056–0.151) for scenario 2, 0.061 (95% CI:0.032–0.089) for scenario 3, and 0.126 (95% CI: 0.065–0.186) for scenario 4.
The ICER was estimated to be €170,465 per QALY gained for the restricted base case analysis.
The analyses of the four one-year scenario extrapolations resulted in the following ICERs: €50,480 per QALY gained for scenario 1, €28,659 per QALY gained for scenario 2, €49,069 per QALY gained for scenario 3, and €23,653 per QALY gained for scenario 4. The cost-effectiveness acceptability curves (CEAC) are shown in Fig. 2.
The ICER was €114,713 when assuming each psychologist would be able to treat 20 youth each instead of the average of 8.2 that was observed in the trial-period.
To analyze the sensitivity of the duration of the scenario extrapolations on results, the ICERs were calculated using the same assumptions but changing the period from 1 year to 6 and 18 months, respectively. For the 6 month scenario, the ICERs ranged from €41,245 to €77,894. For the 18 months scenarios the ICERs range from €16,659 to €37,339. All ICERs and CEACs are available in the supplementary materials Table SM3 and Fig. SM1.
The base case ICER is based on QALYs estimated using parent-reported CHU9D and tariffs based on the preferences of a youth population. Table 3 shows the results of two separate analyses. One in which the self-reported CHU9D is used in the QALY estimation instead of the parent-reported, and another analysis in which the tariffs are based on preferences of an adult population rather than on a youth population. The two analyses resulted in non-statistically significantly lower incremental QALYs compared to the base case. The ICER was €40,292 (24%) higher than the base case when using self-reported CHU9D and €121,451 (71%) higher when using the tariffs based on an adult population. CEACs are available in the supplementary materials Fig. SM2.
The ICER found in the base case with the time horizon restricted to the trial time period was €170,465. There is no explicit willingness-to-pay in Denmark. The estimate is, however, higher than what would be considered standard willingness to pay per QALY. For the scenarios with a continuing effect (scenarios 2 and 4), the ICERs were below €30,000, and the MMM intervention had a 90% probability of being cost-effective at a willingness to pay per QALY gained of €41,000 (see Fig. 2). For scenarios 1 and 3, assuming temporary effects, the ICERs were estimated to be around €50,000. The sensitivity analyses addressing the assumption of a one-year extrapolation period showed that all scenarios resulted in ICERs below €40,000 when an 18-month extrapolation period was assumed. In contrast only scenarios 2 and 4 had ICERs below €50,000, when a 6-month extrapolation period was assumed.
In light of the large proportion of youth suffering from common mental health disorders and the promising effects of CBT-programs, it is surprising that there is limited access to evidence-based programs. MAU was chosen as a comparator in the trial as no evidence-based programs are widely accessible for youths with common mental health problems. Coordination visits were offered in order to ensure that all parents in the MAU group were made aware of the services the municipalities offered under MAU. This enhanced the MAU and incurred a minor cost given the time used by professional from the municipality, furthermore, the enhancement might have had a positive effect for the MAU group which would limit the relative effect of MMM. Most evidence-based CBT-programs are problem-specific and only relevant for a part of the population with common mental health problems. Instead, the transdiagnostic and modular approach in MMM made it possible to offer treatment to a large and heterogeneous population of youth with emotional and behavioral problems. A considerable part of the costs of delivering MMM is associated with the training of psychologists and supervisors. The high training costs support the choice of offering the transdiagnostic MMM instead of traditional CBT-programs as this avoids parallel training costs for three single-disorder programs to target the same group of youth. The sensitivity analysis showed that the cost estimate decreased by 33% when assuming each psychologist would treat 20 youth instead of the average of 8.2 in the trial-period. The high costs were partly due to the training being held at a hotel, including the stay costs. If the same level of training can be delivered in a different setup, for example online, there could potentially be significant savings, but this remain uncertain.
Due to the short observation period, we only considered the immediate effects of the MMM intervention. As outlined in the Background section it is hypothesized that the observed positive effect of MMM will generate long-term preventive effects by lowering the risk of future severe mental disorders . If this is the case, MMM may be considerably more cost-effective than our results suggest, both due to the health effects and also due to the potential cost savings, as access to CAMHS is associated with substantial health care costs .
In this study, we applied a health care sector perspective. A previous review has, however, shown that the majority of costs of mental disorders among youth are in other sectors, primarily the education and social sectors . Furthermore, we have not included the parents’ costs and benefits in this study. Positive spillover effects for parents are often observed in interventions that benefit their offspring . We lack data on these broader costs and benefits, but given the positive effects of MMM compared to MAU, it is possible that a cost-effectiveness analysis with a societal perspective would generate lower ICERs than observed in this study.
The HRQOL at baseline in our trial was similar irrespective of whether reported by the youth or the parent. However, at end-of-treatment and follow-up, the youth rated their HRQOL lower than their parents did in both groups. The self-reported CHU9D resulted in a 24% higher ICER. We could only identify one other CUA that reports CHU9D for both informants . In that study, surprisingly, almost no difference in the QALY-gain was found when comparing across informant types. Our findings align better with previous findings from a review of other preference-based HRQOL instruments used in youth, that concludes that youth and parental responses are not interchangeable .
The impact of using the adult tariffs from the UK (rather than the youth tariffs from Australia) was even greater making the ICER 71% higher. This difference may be driven by the youth population placing greater weight on the mental health dimension of CHU9D compared to adults . However, there are other methodological differences between the two tariffs besides the age and nationality of the samples they are based on, which could also explain some of the difference. The youth tariffs are derived using discrete-choice experiments and a smaller sample time-trade-off experiment with young adults to anchor the tariffs , while the adult tariffs are derived using a standard gamble experiment .
For health technology assessment agencies that aim for comparability across cost-effectiveness studies, our finding that QALY estimates are highly sensitive to the choice of informant with respect to both HRQOL reporting and tariffs, warrants attention. Since these choices are not trivial, they should be further scrutinized in developing guidelines for CUA of interventions for youth.
Whether the MMM intervention is cost-effective depends on the duration of treatment effects and the intervention’s preventive impact. Restricting the analysis period to the trial period resulted in a cost per QALY-gained well above the standard willingness to pay. Applying four different one-year extrapolation scenarios resulted in ICERs within a range that is likely to be considered cost-effective. An additional important source of variation in ICER estimates was the choice of an informant for HRQOL and tariffs. This is a methodological aspect that warrants further attention.
Decisions on introducing MMM should consider the many uncertainties. It may be difficult to generate more precise information on the long-term effects of MMM via RCTs. However, future registry based studies can contribute to advancing understanding of the preventive effects of MMM.
Availability of data and materials
The pseudonymous data can be made available from 6 months after the publication date of this Article, and with no end date. Proposals for the use of data and requests for access should be directed to email@example.com. To gain access, researchers will need to sign a data access agreement with the Research Unit of the Child and Adolescent Mental Health Centre—Capital Region of Denmark, Copenhagen, Denmark.
Child and Adolescent Mental Health Services
Child Health Utility 9D
Children and adolescents
Cost-effectiveness acceptability curves
Health-related quality of life
Health state utility value
Management As Usual
Mind My Mind
Quality Adjusted Life Years
Randomized controlled trial
The Incremental Cost Effectiveness Ratio
The Strength and Difficulties Questionnaire
Patel V, Saxena S, Lund C, et al. The Lancet Commission on global mental health and sustainable development. Lancet. 2018;392:1553–98.
Polanczyk GV, Salum GA, Sugaya LS, Caye A, Rohde LA. Annual research review: a meta-analysis of the worldwide prevalence of mental disorders in children and adolescents. J Child Psychol Psychiatry. 2015;56:345–65.
Dalsgaard S, Thorsteinsson E, Trabjerg BB, et al. Incidence rates and cumulative incidences of the full spectrum of diagnosed mental disorders in childhood and adolescence. JAMA Psychiatry. 2020;77:155.
Copeland WE, Wolke D, Shanahan L, Costello EJ. Adult functional outcomes of common childhood psychiatric problems: a prospective, longitudinal study. JAMA Psychiatry. 2015;72:892.
Schwartz C, Barican JL, Yung D, Zheng Y, Waddell C. Six decades of preventing and treating childhood anxiety disorders: a systematic review and meta-analysis to inform policy and practice. Evid Based Ment Health. 2019;22:103–10.
Zhou X, Zhang Y, Furukawa TA, et al. Different types and acceptability of psychotherapies for acute anxiety disorders in children and adolescents. JAMA Psychiatry. 2019;76:41–50.
Zhou X, Hetrick SE, Cuijpers P, et al. Comparative efficacy and acceptability of psychotherapies for depression in children and adolescents: a systematic review and network meta-analysis. World Psychiatry. 2015;14:207–22.
Hetrick SE, Cox GR, Witt KG, Bir JJ, Merry SN. Cognitive behavioural therapy (CBT), third-wave CBT and interpersonal therapy (IPT) based interventions for preventing depression in children and adolescents. Cochrane Database Syst Rev. 2016. https://doi.org/10.1002/14651858.CD003380.pub4.
Eckshtain D, Kuppens S, Ugueto A, Ng MY, Vaughn-Coaxum R, Corteselli K, Weisz JR. Meta-analysis: 13-year follow-up of psychotherapy effects on youth depression. J Am Acad Child Adolesc Psychiatry. 2020;59:45–63.
Waddell C, Schwartz C, Andres C, Barican JL, Yung D. Fifty years of preventing and treating childhood behaviour disorders: a systematic review to inform policy and practice. Evid Based Ment Health. 2018;21:45–52.
Furlong M, McGilloway S, Bywater T, Hutchings J, Smith SM, Donnelly M. Cochrane review: behavioural and cognitive-behavioural group-based parenting programmes for early-onset conduct problems in children aged 3 to 12 years (review). Evid-Based Child Health Cochrane Rev J. 2013;8:318–692.
James AC, James G, Cowdrey FA, Soler A, Choke A. Cognitive behavioural therapy for anxiety disorders in children and adolescents. Cochrane Database Syst Rev. 2015. https://doi.org/10.1002/14651858.CD004690.pub4.
Jeppesen P, Wolf RT, Nielsen SM, et al. Effectiveness of transdiagnostic cognitive-behavioral psychotherapy compared with management as usual for youth with common mental health problems: a randomized clinical trial. JAMA Psychiatry. 2020. https://doi.org/10.1001/jamapsychiatry.2020.4045.
Hamilton MP, Hetrick SE, Mihalopoulos C, Baker D, Browne V, Chanen AM, Pennell K, Purcell R, Stavely H, McGorry PD. Identifying attributes of care that may improve cost-effectiveness in the youth mental health service system. Med J Aust. 2017. https://doi.org/10.5694/mja17.00972.
Creswell C, Violato M, Cruddace S, Gerry S, Murray L, Shafran R, Stein A, Willetts L, McIntosh E, Cooper PJ. A randomised controlled trial of treatments of childhood anxiety disorder in the context of maternal anxiety disorder: clinical and cost-effectiveness outcomes. J Child Psychol Psychiatry. 2020;61:62–76.
Creswell C, Violato M, Fairbanks H, White E, Parkinson M, Abitabile G, Leidi A, Cooper PJ. Clinical outcomes and cost-effectiveness of brief guided parent-delivered cognitive behavioural therapy and solution-focused brief therapy for treatment of childhood anxiety disorders: a randomised controlled trial. Lancet Psychiatry. 2017;4:529–39.
Lynch FL, Dickerson JF, Clarke G, et al. Cost-effectiveness of preventing depression in at-risk youth: post-intervention and two-year follow-up. Psychiatr Serv Wash DC. 2019;70:279–86.
Tie H, Krebs G, Lang K, Shearer J, Turner C, Mataix-Cols D, Lovell K, Heyman I, Byford S. Cost-effectiveness analysis of telephone cognitive–behaviour therapy for adolescents with obsessive–compulsive disorder. BJPsych Open. 2019. https://doi.org/10.1192/bjo.2018.73.
Jolstedt M, Wahlund T, Lenhard F, Ljótsson B, Mataix-Cols D, Nord M, Öst L-G, Högström J, Serlachius E, Vigerland S. Efficacy and cost-effectiveness of therapist-guided internet cognitive behavioural therapy for paediatric anxiety disorders: a single-centre, single-blind, randomised controlled trial. Lancet Child Adolesc Health. 2018;2:792–801.
Dickerson JF, Lynch FL, Leo MC, DeBar LL, Pearson J, Clarke GN. Cost-effectiveness of cognitive behavioral therapy for depressed youth declining antidepressants. Pediatrics. 2018. https://doi.org/10.1542/peds.2017-1969.
Hill H, Rowen D, Pennington B, Wong R, Wailoo A. A review of the methods used to estimate and model utility values in NICE technology appraisals for paediatric populations. 2019. (NICE DSU report).
Rowen D, Rivero-Arias O, Devlin N, Ratcliffe J. Review of valuation methods of preference-based measures of health for economic evaluation in child and adolescent populations: where are we now and where are we going? Pharmacoeconomics. 2020;38:325–40.
De Los RA, Cook CR, Gresham FM, Makol BA, Wang M. Informant discrepancies in assessments of psychosocial functioning in school-based services and research: review and directions for future research. J Sch Psychol. 2019;74:74–89.
Ratcliffe J, Huynh E, Stevens K, Brazier J, Sawyer M, Flynn T. Nothing about us without us? A comparison of adolescent and adult health-state values for the child health utility-9D using profile case best-worst scaling: adolescent versus adult values for the CHU-9D. Health Econ. 2016;25:486–96.
Drummond MF, Sculpher MJ, Claxton K, Stoddart GL, Torrance GW. Methods for the economic evaluation of health care programmes. Oxford: Oxford University Press; 2015.
Stringaris A, Goodman R. The value of measuring impact alongside symptoms in children and adolescents: a longitudinal assessment in a community sample. J Abnorm Child Psychol. 2013;41:1109–20.
Nielsen LG, Rimvall MK, Clemmensen L, Munkholm A, Elberling H, Olsen EM, Rask CU, Skovgaard AM, Jeppesen P. The predictive validity of the Strengths and Difficulties Questionnaire in preschool age to identify mental disorders in preadolescence. PLoS One. 2019;14:e0217707.
Wolf RT, Puggaard LB, Pedersen MMA, et al. Systematic identification and stratification of help-seeking school-aged youth with mental health problems: a novel approach to stage-based stepped-care. Eur Child Adolesc Psychiatry. 2021. https://doi.org/10.1007/s00787-021-01718-5.
Wolf RT, Jeppesen P, Gyrd-Hansen D, The CCC2000 Study Group, Oxholm AS. Evaluation of a screening algorithm using the Strengths and Difficulties Questionnaire to identify children with mental health problems: a five-year register-based follow-up on school performance and healthcare use. PLoS One. 2019. https://doi.org/10.1371/journal.pone.0223314.
Stevens K. Developing a descriptive system for a new preference-based measure of health-related quality of life for children. Qual Life Res. 2009;18:1105–13.
Furber G, Segal L. The validity of the Child Health Utility instrument (CHU9D) as a routine outcome measure for use in child and adolescent mental health services. Health Qual Life Outcomes. 2015;13:22.
Wolf RT, Ratcliffe J, Chen G, Jeppesen P. The longitudinal validity of proxy-reported CHU9D. Qual Life Res. 2021. https://doi.org/10.1007/s11136-021-02774-9.
Ratcliffe J, Huynh E, Chen G, Stevens K, Swait J, Brazier J, Sawyer M, Roberts R, Flynn T. Valuing the Child Health Utility 9D: using profile case best worst scaling methods to develop a new adolescent specific scoring algorithm. Soc Sci Med. 2016;157:48–59.
Stevens K. Valuation of the child health utility 9D index. Pharmacoeconomics. 2012;30:729–47.
Faria R, Gomes M, Epstein D, White IR. A guide to handling missing data in cost-effectiveness analysis conducted within randomised controlled trials. Pharmacoeconomics. 2014;32:1157–70.
White IR, Royston P, Wood AM. Multiple imputation using chained equations: issues and guidance for practice. Stat Med. 2011;30:377–99.
Rubin D, Schenker N. Multiple imputation in health-care databases: an overview and some applications. Stat Med. 1991;10:585–98.
Willan AR, Briggs AH, Hoch JS. Regression methods for covariate adjustment and subgroup analysis for non-censored cost-effectiveness data. Health Econ. 2004;13:461–75.
Manca A, Hawkins N, Sculpher MJ. Estimating mean QALYs in trial-based cost-effectiveness analysis: the importance of controlling for baseline utility. Health Econ. 2005;14:487–96.
StataCorp. Stata statistical software: release 15. College Station: StataCorp LLC; 2017.
Efron B. Missing data, imputation, and the bootstrap. J Am Stat Assoc. 1994;89:14.
Snell T, Knapp M, Healey A, Guglani S, Evans-Lacko S, Fernandez J-L, Meltzer H, Ford T. Economic impact of childhood psychiatric disorder on public sector services in Britain: estimates from national survey data. J Child Psychol Psychiatry. 2013;54:977–85.
Tubeuf S, Saloniki E-C, Cottrell D. Parental health spillover in cost-effectiveness analysis: evidence from self-harming adolescents in England. Pharmacoeconomics. 2019;37:513–30.
Khadka J, Kwon J, Petrou S, Lancsar E, Ratcliffe J. Mind the (inter-rater) gap. An investigation of self-reported versus proxy-reported assessments in the derivation of childhood utility values for economic evaluation: a systematic review. Soc Sci Med. 2019;240:112543.
The private, noncommercial health science research project Mind My Mind was initiated by Psykiatrifonden. Birthe Wielandt Houe acted as project manager on behalf of Psykiatrifonden. The randomized controlled effectiveness trial was conducted through close collaboration between Psykiatrifonden, the principal investigator (Pia Jeppesen), the participating municipalities, and the regional child and adolescent mental health centers. Psykiatrifonden held the legal responsibility as the data controller for the Web-based data collection.
This study was supported by unrestricted grants from TrygFonden and the Lundbeck Foundation. The funding agencies were not involved in the study design, data collection, analysis and interpretation, the writing of the manuscript, or the decision on submission for publication.
Ethics approval and consent to participate
All the experiment protocol involving humans was in accordance with the Declaration of Helsinki. Ethical approval of the Mind My Mind study was provided by the Regional Committee on Health Research Ethics in the Capital Region of Denmark, Journal-nr.: H-17011408. Participation was voluntary, and data was kept confidential. The parents gave written consent to the study participation.
Consent for publication
RTW, LBP, MMAP, AKP, WKS, KJP, SPN, DGH, MT, NB, PHT and PJ declare that they have no conflict of interest. CUC has been a consultant and/or advisor to or has received honoraria from: Acadia, Alkermes, Allergan, Angelini, Axsome, Gedeon Richter, Gerson Lehrman Group, IntraCellular Therapies, Janssen/J&J, LB Pharma, Lundbeck, MedAvante-ProPhase, Medscape, Neurocrine, Noven, Otsuka, Pfizer, Recordati, Rovi, Sumitomo Dainippon, Sunovion, Supernus, Takeda, and Teva. He has provided expert testimony for Janssen and Otsuka. He served on a Data Safety Monitoring Board for Lundbeck, Rovi, Supernus, and Teva. He received royalties from UpToDate and grant support from Janssen and Takeda. He is also a stock option holder of LB Pharma.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Cost components, assumptions, and sources of unit costs. Table SM2. Complete cases analysis. Table SM3. Sensitivity scenarios. Fig. SM1. Cost Effectiveness Acceptability Curves for 6- and 18-months scenarios. Fig. SM2. Cost Effectiveness Acceptability Curves for sensitivity analyses results with self-reported CHU9D and adult tariffs.
About this article
Cite this article
Wolf, R.T., Jeppesen, P., Pedersen, M.M.A. et al. Cost-effectiveness of a transdiagnostic psychotherapy program for youth with common mental health problems. BMC Health Serv Res 22, 819 (2022). https://doi.org/10.1186/s12913-022-08187-9
- Behavioral problems
- Cognitive behavioral intervention
- Preference weights