- Research article
- Open Access
Simulation modeling for stratified breast cancer screening – a systematic review of cost and quality of life assumptions
BMC Health Services Research volume 17, Article number: 802 (2017)
The economic evaluation of stratified breast cancer screening gains momentum, but produces also very diverse results. Systematic reviews so far focused on modeling techniques and epidemiologic assumptions. However, cost and utility parameters received only little attention. This systematic review assesses simulation models for stratified breast cancer screening based on their cost and utility parameters in each phase of breast cancer screening and care.
A literature review was conducted to compare economic evaluations with simulation models of personalized breast cancer screening. Study quality was assessed using reporting guidelines. Cost and utility inputs were extracted, standardized and structured using a care delivery framework. Studies were then clustered according to their study aim and parameters were compared within the clusters.
Eighteen studies were identified within three study clusters. Reporting quality was very diverse in all three clusters. Only two studies in cluster 1, four studies in cluster 2 and one study in cluster 3 scored high in the quality appraisal. In addition to the quality appraisal, this review assessed if the simulation models were consistent in integrating all relevant phases of care, if utility parameters were consistent and methodological sound and if cost were compatible and consistent in the actual parameters used for screening, diagnostic work up and treatment. Of 18 studies, only three studies did not show signs of potential bias.
This systematic review shows that a closer look into the cost and utility parameter can help to identify potential bias. Future simulation models should focus on integrating all relevant phases of care, using methodologically sound utility parameters and avoiding inconsistent cost parameters.
Stratified breast screening aims at improving routine screening by allowing a stratification between risk groups. Stratified screening protocols could then be developed for high-risk and low-risk groups, and the balance between harmful and beneficial screening effects could be recalibrated. Owing to the complex nature of stratified screening programs and the massive cost implications of randomized control trials, simulation modeling is often the only method available or feasible for economic evaluation. Health economic modeling aims to support political decision-making, but its results are often very diverse. Part of this diversity was found to be related to a significant diversity in simulation techniques and modeling approaches.
A recent review by Elkin et al.  compared simulation models for stratified cancer interventions in 2011 with the aim of evaluating the risk stratification mechanism, which they call the targeting mechanisms. They found that the targeting mechanism is rarely included in the decision analytical models, but influences the results of cost-effectiveness studies substantially. Three years later, Hatz et al.  provided an overview of health economic assessments of personalized medicine. The authors summarized how stratified approaches do not necessarily lead to superior or inferior cost-effectiveness compared with existing health care approaches. They also found that stratified screening was often more cost-effective than stratified treatment but, overall, the variation in these studies was too substantial to reach a conclusion. Koleva-Kolarova et al.  reviewed simulation models for population-based screening programs with the aim of providing recommendations for future modeling endeavors. They assessed seven original models and compared disease, population and intervention input parameters as well as modeling approach and outcomes. They found that all of them predicted mortality reduction similar to randomized control trials. However, all of them were also prone to bias, mainly due to a lack of external validation and due to “lack of systematic evaluation of evidence to calibrate the input parameters” 
Owing to the large variety in personalization approaches, systematic reviews struggle with comparing the specific stratification suggestions in the complex continuum of care for breast cancer. Onega et al.  realized that a conceptual model for the comparison of stratified screening approaches was required and suggested a framework based on the steps of care delivery in stratified screening. Their framework described the complete continuum of breast screening from risk assessment to treatment and thus supported the assessment of the care continuum in simulation models for stratified screening. A systematic review focusing on the integration of the phases of care and an assessment of the cost and utility parameters used in each of the phases thus might be helpful to further assess the simulation models and evaluate if the underlying structural assumptions are appropriate for the respective research task.
This article describes such a systematic review and presents an analysis of cost and utility parameters using the Onega framework . It assesses simulation models for stratified breast cancer screening according to the integration of the phases of care delivery and illustrates the variation in cost and utility parameters. By focusing on their validity and their potential impact on results, the importance of the respective phase of care for the evaluation can be assessed and potential of bias can be identified. Its aim is not to evaluate if stratified screening is superior to routine screening, but to evaluate the economic modeling approaches in this field.
Identifying research evidence
Stratification can be used in many areas of the breast cancer patient pathway. Onega et al.  describe a framework for stratified screening for breast cancer. We used an adaptation of their framework to categorize screening approaches into clusters focusing on risk assessment, detection, diagnosis or breast cancer treatment. This study focuses on approaches aiming at the stratification of patient groups into risk levels and the selection of the best screening strategy for each risk group.
The systematic literature search and the study selection closely follow the guidelines of the PRISMAFootnote 1 statement . The search strategy uses very broad descriptions for stratification (or personalization), the screening for breast cancer and also for studies including cost-effectiveness. The search strategy uses MEDLINEFootnote 2 databases (also including the MEDLINE in-process and non-indexed database), Embase database, Centre for Reviews and Dissemination (CRD) databases (providing access to DARE,Footnote 3 NHS EEDFootnote 4 and HTAFootnote 5 databases) and Econlit databases. Search terms included “economic evaluation”, “cost”, “benefits and harms”, “screening”, “breast cancer”, “mammography”, “magnetic resonance imaging”, “personalized”, “risk-stratified” and “targeted”. Keywords and synonyms were used in titles and abstracts. The search string for each database can be found in Additional file 1: supplementary material S1.
Since the terminology for simulation modeling is quite diverse, no specific search term was used for the database search. The search strategy thus was designed to identify economic evaluations for personalized breast cancer screening. In order to identify simulation models, all identified economic evaluation were screened for the population in their methodology. If simulated or hypothetical populations were used, studies were identified as simulation models. Studies of interest use comparative simulation approaches and compare a variety of screening strategies, of which one needs to be routine mammography screening and at least one needs to suggest a stratified screening approach. They do not necessarily need to reflect the current technology or current research, but rather a fitting economic evaluation. The literature search results are then filtered using the following inclusion criteria:
Indication: Exclusively breast cancer
Focus on new screening strategies, not on methods to increase participation in existing strategies.
Study type: Economic evaluation using simulation modeling
Evaluation approach: Comparison of risk-stratified screening vs one-size-fits all screening
Exclusion criteria further filter out non-peer-reviewed publications such as conference abstracts, commentaries or study protocols, economic evaluations with updates, economic evaluations that do not use a simulation approach or only review other simulations, economic evaluations that do not use utility values, studies focusing primarily on women with a specific socio-economic or racial background, which are not comparable to other studies. The literature search and evaluation were conducted with the help of a second researcher and a review protocol.
Literature appraisal and data extraction
Literature appraisal is based on an overview of reporting guidelines  and challenges in the field of the economic evaluation of personalized medicine as formulated by Annemans et al. . The overview  compares the most commonly used quality appraisal tools for health economic modeling [9,10,11]. The list extracted from this review  adds additional elements . Annemans et al.  described ten challenges in the economic evaluation of personalized medicine. While some of these items are already adequately reflected in existing quality appraisal tools, such as the importance of defining the scope of the economic evaluation, others are not yet completely addressed, for example the special importance of incorporating both test and intervention specifications into the model. This quality appraisal helps to establish a benchmark for a comparison of the study quality for economic evaluations in personalized medicine. A second researcher validated the quality appraisal. Additional file 1: Supplementary material S2 includes the checklist and explanation of the new items as well as an illustration of the definition of good quality used for the quality criteria.
Data extraction utilizes the framework in Fig. 1. The framework uses four phases of care delivery in the patient’s pathway: risk assessment, screening, diagnostic work up and treatment. In each of these phases, costs can occur and quality of life can be affected. Data extraction focuses on the price parameters of technologies and quality of life decrement used in each of these phases. All monetary parameters are standardized to 2014 USD, as the latest available year of purchasing power-parity-based (PPP) exchange rates, and USD, as the most common currency. Quality of life decrements are reported as percentages from the base value in order to normalize utilities between studies using age-specific utility weights and studies assuming perfect health independent of age.
The search was run on 17th August 2017 and identified 2656 studies, 1251 from Embase, 944 from MEDLINE, 69 from Pre-MEDLINE, 379 from CRD and 5 from Econlit and 8 additional references per hand search. After removing duplicates, 1878 studies were assessed for inclusion criteria. Of these, 771 studies did not focus on breast cancer, 652 were not cost-effectiveness studies, 144 did not focus on screening, 107 studies did not assess personalized approaches and 134 studies focused on strategies for raising screening uptake or re-attendance. 70 studies remained and were assessed for eligibility. Of these, 52 studies were excluded because they were conference abstracts, outdated versions of newer publications, study protocols or comments on other papers, did not describe results for risk groups, focused on co-morbid study populations, did not apply health economic models, did not measure quality of life with utilities or only described models without implementing them. In all, 18 studies fulfilled all criteria and were included in this review. The PRISMA flow chart (Fig. 2) illustrates the results of the literature search .
In 18 studies, three distinct clusters of stratification approaches were identified. One cluster focuses on stratified screening in the general population, one focuses on a pre-selected high-risk population and one evaluates newly introduced risk assessment technologies. Table 1 provides an overview of suggested personalization approaches, risk factors used for stratification, the routine strategy used for comparison, and effects on cost, utilities and the incremental cost-effectiveness ratio (ICER).
Cluster 1: Personalized screening in the general population
Studies in cluster 1 use risk factors describing moderate risk to generate risk clusters. These risk factors are for example familial risk, age, breast density, history of biopsy and others. Schousboe et al.  and Vilaprinyo et al.  use a relative risk of 1.5 for women with breast cancer history in a first-degree relative or previous biopsy and a spread of relative risk between 0.49 and 1.97 for the four categories of breast density. Sprague et al.  and Tosteson et al.  use only breast density as a risk factor. Sprague et al.  use the same relative risks between 0.5 and 2.0 as Schousboe et al.  and Vilaprinyo et al. . However, Tosteson et al.  use only two categories of breast density with relative risks of 0.66 and 1.5; a much narrower risk spectrum. Stout et al.  uses only breast density, however with a scale between 1.0 and 4.35 and the necessary adjustment of lifetime risk. Trentham-Dietz et al.  use undefined relative risks between 1 and 4 and accordingly focus only on women with normal or increased risk, but they do not include women with relative risks below 1 as the other studies.
Sprague et al.  evaluate supplemental ultrasonography for women at moderate risk due to high breast density. Tosteson et al.  evaluate digital mammography compared to screen-film mammography for women at moderate risk; a suggestion, which is already outdated since most mammographic center are already using digital mammography in the USA today . The other studies in cluster 1 suggest personalized screening frequencies. Stout et al.  evaluate extending screening from 50 to 40 years and increasing the screening frequency from biennial to annual for women with high breast density. Schousboe et al. , Vilaprinyo et al.  and Trentham-Dietz et al. , suggest triennial mammography screening for 50-year-old women with normal risk annual or biennial intervals for high-risk women at 40 or 45 years.
Cluster 2: Screening women at high risk
In cluster 2, studies focus on identifying the right screening technology for women already identified with high risk of breast cancer. Most studies focus on BRCA1/2Footnote 6 positive women, only three studies [19,20,21] focus on other sources of high risk. Ahern et al.  suggest alternating magnetic resonance imaging (MRI) and mammography plus clinical breast examinations (CBE) every year instead of screening only with MRI every two years for women with lifetime risk over 25% at 25 years. Pataky, Ismail et al.  focus on women with pre-selected high breast density. They evaluate using annual mammography screening instead biennial for this risk group.
The other studies in cluster 2 focus on BRCA1/2 positive women. Studies suggest stratification by adding MRI for women at very high risk. Cott Chubiz et al.  suggest alternating MRI and mammography every 6. The other studies [23,24,25,26] propose annual screening using both technologies. Taneja et al.  use a single screening event instead of repeated screening.
Cluster 3: Additional risk assessment plus screening
In cluster 3, studies assess the introduction of additional risk assessment to stratify women according to their risk. The focus in these studies is on an earlier stage of the care continuum compared to the studies in cluster 1 and 2. Ozanne and Esserman  evaluate atypia testing to identify women for tamoxifen prevention. Manchanda et al.  evaluate BRCA gene testing compared to an assessment of family history in an Ashkenazi-Jewish population, who have a very high risk of carrying BRCA positive genes . Folse et al.  compare the Gail tool  to 7SNPFootnote 7 genetic testing to select women for routine or intensive screening.
Quality assessment using quality appraisal checklist
Figure 3 presents the results of the quality assessment with the help of the criteria list. When assessing the quality of simulation studies, the quality of the actual simulation can only be assessed as far as all quality-relevant items are reported in the main article, supplementary information or referenced articles and websites. In some cases, the actual quality of the simulation model might be higher, but cannot be assessed since the relevant items were not reported in the article or referenced article.
Overall reporting quality is mixed
The criteria list includes 40 items with 40 positive answers as the maximum possible score. Longer bars in Fig. 3 indicate higher numbers of positive answers and thus high quality, whereas shorter or missing bars indicate lower quality. The bars use different colors to identify the quality categories. The complete checklist and an explanation of the additional criteria can be accessed in Additional file 1: supplementary material S2. Figure 3 shows that no article actually reaches 40: the highest scores are 38 by Vilaprinyo et al.  and 36 by Schousboe et al. . Both studies supply extensive supplementary material describing important assumptions and calculations in their simulation and thus reach the highest transparency. The lowest scores are 22  and 25 [19, 23]. All clusters have at least one study with a quality of 30 or more positive answers, but there is significant heterogeneity regarding reporting quality in all clusters.
Personalized screening imposes challenges on decision analytic modeling
Two items should be explicitly highlighted, since they reflect the challenges of reporting stratified screening . Annemans et al.  raised the issue that interventions of personalized medicines always consist of a combination of diagnostic and treatment with a degree of uncertainty in both technologies, which is not always adequately reflect in economic modeling. Their suggestions for good quality were translated into questions reflecting the context of stratified screening, which was described detail in the Additional file 1: supplementary material S2. Two of these questions are especially interesting, these questions are: 1) Is the strategy in focus described as a combination of risk assessment and screening technology? 2) Are all key input parameters incorporated into risk assessment and screening technology?
Most studies do not adequately report or reflect how risk assessment and intervention are combined.
All studies in cluster 1 and 3 explicitly mention the risk stratification and suggest screening technologies for each group. In cluster 2, risk assessment is routinely not integrated into the models. Only Plevritis et al.  explicitly mention the risk assessment leading into the stratified strategy. Regarding question 2), none of the studies incorporates all key input parameters. Studies in cluster 1 and 2 do not integrate risk assessment consistently. Potential utility effects of knowing to be at higher risk thus were not assessed. Screening is integrated as a cost driver, but is not consistently allowed to have quality of life effects. Especially studies in cluster 3 often exclude disutility from screening and diagnostic work up. However, while the integration of all relevant phases of care is desirable, there are reasons why certain elements might be out of the scope for the individual economic evaluation. The next paragraph discusses the scope and assumptions in each cluster in greater depth.
Phases of care delivery
Table 2 shows the integration of the four phases of care delivery as reflected by cost and utility parameter in each specific phase. Accordingly, the gaps in the care delivery are especially interesting.
Disutility from risk assessment is not adequately reflected
For studies in cluster 1, risk assessment can be implemented without considerable cost implication, since all personalization suggestions utilize risk factors that usually are already available after the first screening. Most risk factors, such as family history with breast cancer, previous biopsies and age at menarche or menopause are readily collected at the first screening visit or are available through the first screening, in the case of the density of breast tissue. It is thus reasonable that risk assessment may not introduce additional cost. However, knowing to be at higher risk after risk assessment may cause distress  and thus may affect quality of life.
Risk assessment is not necessarily perfect
Especially in cluster 2, these quality of life detriments may be substantial since women are at very high risk and thus anxiety and worry leading to quality of life losses are higher. Plevritis et al. , though not implementing it as a standard, acknowledge this effect in the assessment of BRCA positive women by testing potential utility losses after risk assessment and the effects of reassurance through negative screening in a sensitivity analysis.Footnote 8 Excluding the risk assessment can limit the generalizability of results. The assumption underlying these studies is that at-risk women can be perfectly identified through established systems. However, genetic testing or risk assessment based on risk calculation does not always deliver perfect information [34, 35].
Screening can affect quality of life
Most studies in clusters 1 and 2 include short-term utility loss from mammography screening. Only six studies [12, 13, 15, 19, 23, 27] do not integrate utility loss or at least test it in sensitivity analysis. Among the studies not integrating utility losses, those suggesting adjusted screening frequencies [12, 13, 19] may overestimate the utility gains from more intensive screening.
Cost and disutility from diagnostic work up are most often included
Diagnostic work up, most importantly invasive procedures, are accompanied with temporal utility loss . While mostly included, five studies [15, 19, 23, 27, 31] do not integrate these losses and thus overestimate the quality of life improvements from intensified screening. Two studies in cluster 3 do not include screening and diagnostic work up at all, despite using mammography screening to detect breast cancers [28, 29]. They assume that screening and diagnostic work up stay unaffected and thus are not integral to their evaluation.
Data sources of cost parameters and perspectives
Table 2 also shows the data sources of cost parameters and the perspective of the economic evaluation. When cost parameters are based on national tariffs, they represent what the service provider charges from the national cost carrier for providing the health service. This is often the case in studies, which choose the perspective of national cost carriers. It might however not represent the actual resource consumption experienced at societal level. Instead of using payments, authors can use information from cost-of-illness studies, reflecting the actual cost occurred for service delivery. If used consistently, both types of information lead to consistent decision-making [37, 38], but special attention must be paid if cost parameters are mixed from both types of sources.
The three studies from the Cancer Intervention and Surveillance Modeling Network (CISNET) [14, 16, 17] use the same cost parameters. They use Medicare reimbursement charges and treatment cost estimates from an excess costing study . The latter does, however, use prices from the same Medicare reimbursement catalogue, which is why they still represent the cost occurred at national payer (Medicare).
Cott Chubiz et al.  and Lee et al.  mix charges from the physician fee schedule for screening and biopsy cost estimation and add treatment expenditure from an excess costing study  with treatment cost for older women from a micro-costing study . While both studies reference the same sources, the actual direct treatment cost are significantly different even after accounting for price inflation between the price years.
Pataky, Ismail et al.  combine screening and diagnostic work up cost from the screening program  and treatment charges from the medical services fee schedule . Manchanda et al.  use mostly national tariffs from the National Institute for Health and Care Excellence (NICE), but in absence of a NICE unit price for genetic testing and counselling, they use cost estimates from trial data .
While most studies use the payer/provider perspective, five studies do not explicitly mention which perspective they chose [17, 22, 28, 29, 31]. Four studies explicitly stated that they use the societal perspective [15, 19, 24, 26]; all but one  adequately include cost occurring at patient level.
Screening parameters and diagnostic work up
Table 3 presents the input parameters for screening and diagnostic work up phases. In cluster 1, screening prices are very homogenous (see Additional file 1: supplementary material S4 for details). The actual price for a lifetime of screening shows a considerable range, but the difference between lower and higher risk women is in almost all studies between US $2000 and US $2500. Vilaprinyo et al.  use a very different price range for Spain. For diagnostic work up, the CISNET studies [14, 16, 17] use the same cost and utility parameters.
Personalized screening women with lifetime risk between 15% and 25% costs between US $1276 and US $20,550
In cluster 2, the screening proposals show bigger variation in screening cost. The three studies focusing on women between 15% and 25% lifetime risk [19,20,21] propose screening strategies for US $1276 (annual mammography), US $19,382 (for annual screening with alternating MRI and mammography) or US $20,550 (for annual MRI). One study  does not include utility loss from screening and diagnostic work up, while the other studies include at least utility losses from diagnostic work up.
BRCA gene carriers cost between US $7659 and US $31,635 depending on MRI cost and intensity
In cluster 2, proposals for BRCA positive women [22, 24,25,26] vary in lifetime screening cost between US $5945and US $31,635. One strategy with very high screening frequency but low cost  suggests 23 MRI screening events and 43 screening events from the age of 25 to 75 in a woman’s lifetime for US $7659. Pataky, Armstrong et al.  use significantly cheaper MRI cost, which explains why lifetime screening cost are comparatively low. For the other strategies, the actual prices are very similar (Additional file 1: supplementary material section S4); cost differences thus derive from the screening modality. Cott Chubiz et al.  suggest annual alternation of MRI and mammography from 50 years on. At the age of 70, each women thus would undergo 20 MRI and 20 mammography screenings for US $14,060. Two studies [23, 26] combine MRI and mammography every year, but limit screening to 35 to 54 years. In total, this sums up to 19 MRI and 19 mammography screenings for US $17,613. The remaining cost differences comes from slightly more expensive MRI screening (US $856 vs US $506). Norman et al.  suggest a very similar combined screening strategy for the UK, which has significantly cheaper screening prices, which explains also the significantly cheaper lifetime screening cost of US $5945. The most expensive strategy  consists of annual MRI and mammography from the age of 25 to 70, summing up to 45 MRI and 45 mammography screenings. For the diagnostic work up, three of the studies use very similar prices. Only one study  uses significantly lower price compared to the other studies, reflecting the price levels in the Canadian health system. The consistent use of low prices leads to more affordable screening and diagnostic work up. In the Canadian health system due to the lower screening prices compared to American health system, even very intensive MRI screening can be cost-effective.
Additional risk assessments require more research
In cluster 3, initial risk assessment leads into risk stratification. Risk assessment costs from US $101 (for BRCA testing in Ashkenazi-Jewish women) over US $272 (for atypia testing using random fine-needle aspiration) to US $3677 (for 7SNP testing). Folse et al.  suggest annual MRI for high-risk women after 7SNP testing, which costs US $24,325 for 35 screenings between 30 and 70 years. In contrast, Manchanda et al.  estimate that 35 screening events of MRI and mammography cost only US $14,800 for high-risk women after BRCA testing. The cost difference derives from price differences in MRI screening, which is only US $318  compared to US $695 . Owing to the price assumptions of MRI screening, the actual screening cost in Manchanda et al.  are higher. Ozanne and Esserman  suggest tamoxifen prevention (US $24,140 for women between 40 and 70) for high risk and mammography screening for low-risk women; however, they do not report the actual cost of mammography screening. It is thus unclear if all relevant cost are included.
False positive results mostly result in quality of life detriments, but extent varies
Screening produces false positive results, which may affect quality of life. While most studies analyze utility losses from diagnostic work up, seven studies exclude these effects and thus overestimate quality of life from screening [15, 19, 23, 27,28,29, 31]. Ozanne and Esserman  propose tamoxifen prevention as a screening replacement and underestimate potential quality of life losses associated with false positive screening results. The actual effect on quality of life varies in its extent and duration. In general, studies reflect a short-term (1 to 5 weeks) significant impact (10 to 30%) on quality of life. Over the course of a complete year, quality of life is reduced by 0.33% to 1.15%, which is also in line with the other studies using a yearly average. Only Moore et al.  assume a significant long-term effect of 11% over a complete year, which is higher than suggested by other studies [36, 45, 46]. Closer inspection of the health utilities however reveals that there is currently no methodologically sound set of health utilities for screening and diagnostic work up. Utilities implemented so far are either assumption-based or from expert interviews. This might explain why most studies restrain from implementing disutility from screening and diagnostic work up, despite there being some evidence that quality of life might be affected. The uncertainty of this parameter, however, is sometimes reflected in the sensitivity analyses. We did find that three studies tested disutility from screening [14, 21, 26]. Disutility from diagnostic work up was tested more frequently in cluster 1 (all but two studies [15, 17]) and cluster 2 (all but three studies [19, 23, 27]).
Table 4 shows cost of and utility loss from treatment as well as the probabilities of treatment. The following section discusses four noteworthy differences in the assumptions utilized for the treatment phase.
Studies vary in the treatment of in situ cancers
While most studies include the treatment of in situ cancers and the corresponding utility loss, six studies do not include in situ cancer treatment [13, 19, 21, 23, 26, 29]. More intensified screening, especially MRI screening, usually to a higher identification of in situ cancers [47, 48].
Treatment costs are not consistent through the course of the disease
Almost all studies use stage-specific cost of treatment, only two studies [23, 29] do not distinguish stage-specific treatment cost, which reduces the benefit of early detection. Among the rest, four studies stand out which use lower treatment cost for metastatic disease than regional disease [15, 22, 24, 25]. Naturally, earlier diagnosis is less beneficial under this assumption. Similarly, another study uses lower end of life cost for metastatic patients than for regional cancer patients , which also reduces potential savings from early detection and contradicts the other studies.
While most studies do not use end of life cost for other causes of death, Cott Chubiz et al.  integrate these alternative end of life costs. In their study, non-breast cancer mortality is more expensive than mortality from ductal carcinoma in situ (DCIS), local or regional carcinoma. Only distant carcinoma are more expensive than dying from other causes. The assumption that women dying from DCIS is cheaper than women dying from other causes is not plausible. DCIS are by definition nonlethal; DCIS mortality thus can only consist of the cost of dying from other causes in women with DCIS. The question arises why women with DCIS are being treated differently than women without DCIS in their last life year.
Utility parameters for treatment are based on one of two EQ-5D sets or assumptions
One of two sources are routinely being used for the health utility in cluster 1: A Swedish study , which uses an English time-trade-off (TTO) tariff on a Swedish population. Or an EQ-5D estimate from Stout et al. , which applies a tariff based partly on assumptions for breast cancer utility loss and an American (TTO) tariff  for healthy individuals to the Medical Expenditure Panel Survey [15, 50]. There are significant differences in these EQ-5D estimates. For example, the Swedish study  estimates 25% utility loss for metastatic disease, while the Stout utility set [14,15,16, 22, 24] uses 40% utility loss.
On one hand, there is the question if transferring the Lidgren tariff to the American setting is valid. On the other hand, the Stout utility set uses expert interviews for the disutility from screening and diagnostic work up, which certainly requires additional validation. While both EQ-5D sets have their pitfalls, they are methodological more robust than what is being used in cluster 2 and 3. Only one study in cluster 2 and cluster 3 use similar EQ-5D sets, while the other studies rely completely on assumptions, survey from very small samples, mixed sources or expert opinions.
Treatment parameters are not routinely included in sensitivity analyses
The cost parameters for treatment show substantial variation in the studies and thus the question arises if changes in the cost parameter affect results. Ten studies check variations in the cost parameter with sensitivity analyses. However, none of those studies with sensitivity analyses report that results were sensitive to changes in treatment cost. Surprisingly, the three studies with the highest lifetime risk do not check robustness when treatment costs changed [22, 24, 26]. In these studies, in which the likelihood of breast cancer is very high, the cost of treatment could be a sensitive parameter. Screening prices are subject to sensitivity analyses in 14 studies, and seven studies find results to be sensitive to changes in screening prices, mostly referring to changes in the price of MRI screening. The simulation of Manchanda et al.  is the only one suggesting MRI screening, without checking if the MRI price is a sensitive parameter. Most of these nine studies also change utility losses from breast cancer; only two studies vary only the cost parameters. Only one study finds that results are sensitive to changes in utility changes . Additional file 1: Supplementary Table S6 provides a full overview of the sensitivity analyses.
This systematic review assessed 18 simulation models for stratified approaches towards breast cancer screening. The approaches were clustered into three distinct groups. 1) A group of studies suggesting stratification of the general population, 2) a group of studies stratifying a pre-selected high-risk population and 3) a group of studies suggesting new risk assessment technologies. Quality appraisal was conducted using modified quality checklist . Reporting quality was very diverse with only two studies [12, 13] in cluster 1 fulfilling 30 or more items of the 40-item quality checklist. In cluster 2 and 3, four studies [22, 24,25,26] and one study  had good quality using the same criteria of 30 items. In addition to the quality appraisal, simulation models were assessed for consistency in integrating all relevant phases of care, methodological sound utility parameters and the consistency and appropriateness of cost input parameters.
Gaps in the phases of care
Studies often do not integrate in situ cancers into their models. Intensified screening often leads to higher detection of in situ carcinoma , especially if screened with MRI [47, 48]. In situ carcinoma may or may not progress to invasive cancers. Schiller-Fruhwirth et al.  identified the uncertainty about the biological relation between in situ and invasive cancers to be the root of the differences in modeling. However, treatment guidelines usually recommend treatment of in situ cancers [54, 55]. With increased screening, diagnosis of in situ carcinoma will increase and thus treatment of in situ cancers should be included in the economic evaluation. Simulation models thus do not capture all screening effects if in situ cancers are not integrated [13, 19, 21, 23, 26, 29].
The simulation models often do not integrate all relevant phases of care. Especially potential utility losses from screening and diagnostic work up are not routinely integrated. Only eleven studies integrate these utility losses, but nine studies do not address them [12, 13, 15, 19, 23, 27,28,29, 31]. This analysis has shown that there are currently no methodologically sound utility weights for screening and biopsy, but there is evidence that quality of life is affected at least in the short-term in screening and more importantly in diagnostic work up. By not including these utility decrements, the assumption of zero utility loss is automatically used, which does not reflect the underlying uncertainty and potentially biases the assessment of screening effects.
Utility parameters are assumption-based, used out of their original context, or methodological not sound
Among the studies suggesting stratified screening for the general population, there are noteworthy differences. Two studies use EQ-5D utility estimates from a Swedish population for an American health care setting, which might raise the question if the Swedish estimates can be transferred to the American population. The utility estimates are significantly different compared to an American EQ-5D tariff based on similar methods. The lack of precise utility parameters was identified as a potential bias in many simulation studies . Three of the studies [14, 16, 17] with lower scores in the quality appraisal utilized more than one simulation model. This research design produces higher robustness, since up to five simulation models evaluate the same strategy. On the downside though, the adaption of these models to the new research question is not reported in sufficient detail, which leads to lower reporting quality. However, all three studies integrate all relevant phases of care and use consistent cost and utility parameter, which is why these models produce currently the best available evidence for stratification screening in the general population. In the other clusters, only two studies [24, 31] use the American EQ-5D utility set for treatment effects on quality of life. The other studies use either sets based on assumption or on surveys from very small samples.
Inconsistencies in cost parameters
On the side of the cost assumptions, four studies use inconsistent treatment parameters. Four studies use parameters for the treatment of metastatic disease, which is substantially cheaper than treatment of earlier cancer [15, 22, 25, 26]. Two studies do not distinguish the specific cancer stage in treatment [23, 29] and one study has lower end of life cost for more advanced cancers . These sets of parameters appear implausible and contradict the intuition from the other simulation models. With these inconsistencies in the cost parameters, cost savings from earlier detection and treatment is reduced and the cost impact of screening is potentially biased.
This systematic review has some limitations. The focus on evaluations comparing stratified against routine screening lead to a very low number of studies, which does not necessarily represent the complete spectrum of stratified approaches. By using this restriction, many economic evaluations in the field of personalized screening may not have been part of this study. However, this systematic review assesses the integration of the care delivery framework. The integration is necessarily required for evaluations who compare risk-adapted screening against routine screening, but might not necessarily be required for studies focusing only on stratified strategies. An assessment based on the care delivery framework thus would not be fair judgement for these evaluations, which is why the studies in focus here are only those who compare personalized screening against routine screening.
The quality appraisal uses sum scores of positive answers. Sum-scores might create a misleading picture of the importance of each of the underlying questions, since they put equal weight on every question. This is in general not the intention of the quality checklists; however, this assumption allows getting a first overview before illustrating selected items in detail. In addition, quality appraisal can only assess methods and parameters if they are reported in the article, which might not always represent the true effort put into the simulation model.
This review compares cost parameters across countries using international purchasing power parities. Although this method eliminates currency and purchasing power differences, it does not take into account the health system related differences in national tariffs. In the process of standardizing parameters, additional calculations were required to enable comparison. Whenever approximations were calculated, it was indicated in the text or in a footnote.
While essential steps of this systematic review, such as the literature search and quality appraisal, used two researchers, a single reviewer conducted data extraction and analysis. For transparency, all extracted data are however presented in extensive Additional file 1: supplementary material.
In this assessment, three research clusters were identified suggesting stratified screening for the general population, pre-selected high-risk populations and by using new risk assessment technologies. In 18 studies, potential biases were identified that might affect the generalizability of the respective simulation results. These potential biases consist of not integrating all relevant phases of care, using utility parameters, which are based on assumptions, are transferred out of their original context, are methodologically not sound, or by using incompatible or inconsistent cost parameters. Of 18 studies, only three studies did not show sign of potential bias.
By assessing cost and utility parameter in each phase of breast cancer care, additional insights into the validity of these simulation models could be gained. These insights could not be gotten with traditional checklist-based quality appraisals. This assessment has shown that a closer look into the cost and utility parameter can help to identify potential problems.
The challenges for decision analytical modeling, which derive from the increased complexity from personalized interventions and the interaction between risk assessment and surveillance, are not yet adequately met. Future health economic models need to pay close attention to the integration of all relevant phases of care. If methodological sound utility parameters are not available, sensitivity analyses need to be applied to reflect the underlying uncertainty regarding quality of life effects from screening and diagnostic work up. Cost parameters require close attention in order to avoid inconsistency or implausible sets for cost parameters.
Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA)
Medical Literature Analysis and Retrieval System (MEDLINE)
Database of Abstracts of Reviews of Effects (DARE)
National Health Service Economic Evaluation Database (NHS EED)
Health Technology Assessment (HTA)
BRCA1 or BRCA2 stands for the breast cancer susceptibility gene 1 or 2.
7SNP stands for 7 single nucleotide polymorphism.
Sensitivity analyses are in the supplementary material S6.
seven single nucleotide polymorphism
breast cancer susceptibility gene 1 or 2
clinical breast examination
Cancer Intervention and Surveillance Modeling Network
Centre for Reviews and Dissemination
Database of Abstracts of Reviews of Effects
ducal carcinoma in situ
health technology assessment
incremental cost-effectiveness ratio
International Society for Pharmacoeconomics and Outcomes Research
Medical Literature Analysis and Retrieval System
magnetic resonance Imaging
- NHS EED:
National Health Service Economic Evaluation Database
National Institute for Health and Care Excellence
purchasing power parity
Preferred Reporting Items for Systematic Reviews and Meta-Analyses
quality-adjusted life years
visual analogue scale
Elkin EB, Marshall DA, Kulin NA, Ferrusi IL, Hassett MJ, Ladabaum U, Phillips KA. Economic evaluation of targeted cancer interventions: critical review and recommendations. Genet Med. 2011;13(10):853–60.
Hatz MH, Schremser K, Rogowski WH. Is individualized medicine more cost-effective? A systematic review. PharmacoEconomics. 2014;32(5):443–55.
Koleva-Kolarova RG, Zhan Z, Greuter MJ, Feenstra TL, De Bock GH. Simulation models in population breast cancer screening: a systematic review. Breast. 2015;24(4):354–63.
Koleva-Kolarova RG, Zhan Z, Greuter MJ, Feenstra TL, De Bock GH. To screen or not to screen for breast cancer? How do modeling studies answer the question? Curr Oncol. 2015;22(5):e380–2.
Onega T, Beaber EF, Sprague BL, Barlow WE, Haas JS, Tosteson AN, DS M, Armstrong K, Schapira MM, Geller B, et al. Breast cancer screening in an era of personalized regimens: a conceptual model and National Cancer Institute initiative for risk-based and preference-based approaches at a population level. Cancer. 2014;120(19):2955–64.
Moher D, Liberati A, Tetzlaff J, Altman DG, Group P. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med. 2009;6(7):e1000097.
Bennett C, Manuel DG. Reporting guidelines for modeling studies. BMC Med Res Methodol. 2012;12:168.
Annemans L, Redekop K, Payne K: Current Methodological Issues in the Economic Assessment of Personalized Medicine. JVAL 2013, 16(Supplement):S20-S26.
Husereau D, Drummond M, Petrou S, Carswell C, Moher D, Greenberg D, Augustovski F, Briggs AH, Mauskopf J, Loder E, et al. Consolidated health economic evaluation reporting standards (CHEERS) statement. BMC Med. 2013;11(1):80.
Weinstein MC, O'Brien B, Hornberger J, Jackson J, Johannesson M, McCabe C, Luce BR. Principles of good practice for decision analytic modeling in health-care evaluation: report of the ISPOR task force on good research practices—modeling studies. Value Health. 2003;6(1):9–17.
Philips Z, Ginnelly L, Sculpher M, Claxton K, Golder S, Riemsma R, Woolacoot N, Glanville J. Review of guidelines for good practice in decision-analytic modeling in health technology assessment. Health Technol Assess. 2004;8(36):iii. -iv, ix-xi, 1-158
Schousboe JT, Kerlikowske K, Loh A, Cummings SR. Personalizing mammography by breast density and other risk factors for breast cancer: analysis of health benefits and cost-effectiveness. Ann Intern Med. 2011;155(1):10–20.
Vilaprinyo E, Forné C, Carles M, Sala M, Pla R, Castells X, Domingo L, Rue M. The interval cancer study G: Cost-effectiveness and harm-benefit analyses of risk-based screening strategies for breast cancer. PLoS One. 2014;9(2):e86858.
Sprague BL, Stout NK, Schechter C, van Ravesteyn NT, Cevik M, Alagoz O, Lee CI, van den Broek JJ, Miglioretti DL, Mandelblatt JS, et al. Benefits, harms, and cost-effectiveness of supplemental ultrasonography screening for women with dense breasts. Ann Intern Med. 2015;162(3):157–66.
Tosteson AN, Stout NK, Fryback DG, Acharyya S, Herman BA, Hannah LG, Pisano ED, Investigators D. Cost-effectiveness of digital mammography breast cancer screening. Ann Intern Med. 2008;148(1):1–10.
Stout NK, Lee SJ, Schechter CB, Kerlikowske K, Alagoz O, Berry D, Buist DSM, Cevik M, Chisholm G, de Koning HJ et al: Benefits, Harms, and Costs for Breast Cancer Screening After US Implementation of Digital Mammography. JNCI Journal of the National Cancer Institute 2014, 106(6):dju092-dju092.
Trentham-Dietz A, Kerlikowske K, Stout NK, Miglioretti DL, Schechter CB, Ergun MA, van den Broek JJ, Alagoz O, Sprague BL, van Ravesteyn NT, et al. Tailoring breast cancer screening intervals by breast density and risk for women aged 50 years or older: collaborative modeling of screening outcomes. Ann Intern Med. 2016;
Nelson H, Cantor A, Humphrey L, Fu R, Pappas M, Daeges M, Griffin J. Screening for breast cancer: a systematic review to update the 2009 U.S. preventive services task force recommendation. In: Evidence Synthesis No 124 AHRQ Publication No 14–05201-EF-1. Agency for Healthcare Research and Quality: Rockville, MD; 2016.
Ahern CH, Shih YC, Dong W, Parmigiani G, Shen Y. Cost-effectiveness of alternative strategies for integrating MRI into breast cancer screening for women at high risk. Br J Cancer. 2014;111(8):1542–51.
Pataky R, Ismail Z, Coldman AJ, Elwood M, Gelmon K, Hedden L, Hislop G, Kan L, McCoy B, Olivotto IA, et al. Cost-effectiveness of annual versus biennial screening mammography for women with high mammographic breast density. J Med Screen. 2014;21(4):180–8.
Moore SG, Shenoy PJ, Fanucchi L, Tumeh JW, Flowers CR. Cost-effectiveness of MRI compared to mammography for breast cancer screening in a high risk population. BMC Health Serv Res. 2009;9(1):9.
Cott Chubiz JE, Lee JM, Gilmore ME, Kong CY, Lowry KP, Halpern EF, McMahon PM, Ryan PD, Gazelle GS. Cost-effectiveness of alternating magnetic resonance imaging and digital mammography screening in BRCA1 and BRCA2 gene mutation carriers. Cancer. 2013;119(6):1266–76.
Norman RP, Evans DG, Easton DF, Young KC. The cost-utility of magnetic resonance imaging for breast cancer in BRCA1 mutation carriers aged 30-49. Eur J Health Econ. 2007;8(2):137–44.
Lee JM, McMahon PM, Kong CY, Kopans DB, Ryan PD, Ozanne EM, Halpern EF, Gazelle GS. Cost-effectiveness of breast MR imaging and screen-film mammography for screening BRCA1 gene mutation carriers. Radiology. 2010;254(3):793–800.
Pataky R, Armstrong L, Chia S, Coldman AJ, Kim-Sing C, McGillivray B, Scott J, Wilson CM, Peacock S. Cost-effectiveness of MRI for breast cancer screening in BRCA1/2 mutation carriers. BMC Cancer. 2013;13(1):339.
Plevritis SK, Kurian AW, Sigal BM, Daniel BL, Ikeda DM, Stockdale FE, Garber AM. Cost-effectiveness of screening BRCA1/2 mutation carriers with breast magnetic resonance imaging. JAMA : the journal of the American Medical Association. 2006;295(20):2374–84.
Taneja C, Edelsberg J, Weycker D, Guo A, Oster G, Weinreb J. Cost effectiveness of breast cancer screening with contrast-enhanced MRI in high-risk women. J Am Coll Radiol. 2009;6(3):171–9.
Ozanne EM, Esserman LJ. Evaluation of breast cancer risk assessment techniques: a cost-effectiveness analysis. Cancer Epidemiol Biomark Prev. 2004;13(12):2043–52.
Manchanda R, Legood R, Burnell M, McGuire A, Raikou M, Loggenberg K, Wardle J, Sanderson S, Gessler S, Side L, et al. Cost-effectiveness of population screening for BRCA mutations in Ashkenazi jewish women compared with family history-based testing. J Natl Cancer Inst. 2015;107(1):380.
Neuhausen S, Gilewski T, Norton L, Tran T, McGuire P, Swensen J, Hampel H, Borgen P, Brown K, Skolnick M, et al. Recurrent BRCA2 6174delT mutations in Ashkenazi Jewish women affected by breast cancer. Nat Genet. 1996;13(1):126–8.
Folse HJ, Green LE, Kress A, Allman R, Dinh TA. Cost-effectiveness of a genetic test for breast cancer risk. Cancer Prev Res. 2013;6(12):1328–36.
Gail MH, Brinton LA, Byar DP, Corle DK, Green SB, Schairer C, Mulvihill JJ. Projecting individualized probabilities of developing breast cancer for white females who are being examined annually. J Natl Cancer Inst. 1989;81(24):1879–86.
Smith AW, Dougall AL, Posluszny DM, Somers TJ, Rubinstein WS, Baum A. Psychological distress and quality of life associated with genetic testing for breast cancer risk. Psychooncology. 2008;17(8):767–73.
Berry DA, Iversen ES Jr, Gudbjartsson DF, Hiller EH, Garber JE, Peshkin BN, Lerman C, Watson P, Lynch HT, Hilsenbeck SG, et al. BRCAPRO validation, sensitivity of genetic testing of BRCA1/BRCA2, and prevalence of other breast cancer susceptibility genes. J Clin Oncol. 2002;20(11):2701–12.
Bansal A, Critchfield GC, Frank TS, Reid JE, Thomas A, Deffenbaugh AM, Neuhausen SL. The predictive value of BRCA1 and BRCA2 mutation testing. Genet Test. 2000;4(1):45–8.
de Haes JC, de Koning HJ, van Oortmarssen GJ, van Agt HM, de Bruyn AE, van Der Maas PJ. The impact of a breast cancer screening programme on quality-adjusted life-years. Int J Cancer. 1991;49(4):538–44.
Cohen DJ, Breall JA, Ho KK, Weintraub RM, Kuntz RE, Weinstein MC, Baim DS. Economics of elective coronary revascularization. Comparison of costs and charges for conventional angioplasty, directional atherectomy, stenting and bypass surgery. J Am Coll Cardiol. 1993;22(4):1052–9.
Drummond MF, Sculpher MJ, Torrance GW, O'Brien BJ, Stoddard GL: Methods for the economic evaluation of health care Programmes, 3rd edn. Oxford: Oxford University Press; 2005.
Yabroff KR, Lamont EB, Mariotto A, Warren JL, Topor M, Meekins A, Brown ML. Cost of care for elderly cancer patients in the United States. J Natl Cancer Inst. 2008;100(9):630–41.
Oestreicher N, Ramsey SD, McCune JS, Linden HM, Veenstra DL. The cost of adjuvant chemotherapy in patients with early-stage breast carcinoma. Cancer. 2005;104(10):2054–62.
Mandelblatt JS, Schechter CB, Yabroff KR, Lawrence W, Dignam J, Extermann M, Fox S, Orosz G, Silliman R, Cullen J, et al. Toward optimal screening strategies for older women. Costs, benefits, and harms of breast cancer screening by age, biology, and health status. J Gen Intern Med. 2005;20(6):487–96.
BC Cancer Agency: Screening Mammography Program: 2010 Annual Report. In. Vancouver, BC: BC Cancer Agency; 2010.
BC Medical Services Commission. Payment schedule. In. Ministry of Health Services: Province of British Columbia; 2007.
Manchanda R, Loggenberg K, Sanderson S, Burnell M, Wardle J, Gessler S, Side L, Balogun N, Desai R, Kumar A, et al. Population testing for cancer predisposing BRCA1/BRCA2 mutations in the Ashkenazi-Jewish community: a randomized controlled trial. J Natl Cancer Inst. 2015;107(1):379.
Tosteson AN, Fryback DG, Hammond CS, Hanna LG, Grove MR, Brown M, Wang Q, Lindfors K, Pisano ED. Consequences of false-positive screening mammograms. JAMA Intern Med. 2014;174(6):954–61.
Gram IT, Lund E, Slenker SE. Quality of life following a false positive mammogram. Br J Cancer. 1990;62(6):1018–22.
Burstein HJ, Polyak K, Wong JS, Lester SC, Kaelin CM. Ductal carcinoma in situ of the breast. N Engl J Med. 2004;350(14):1430–41.
Baur A, Bahrs SD, Speck S, Wietek BM, Kramer B, Vogel U, Claussen CD, Siegmann-Luz KC, Breast MRI. Of pure ductal carcinoma in situ: sensitivity of diagnosis and influence of lesion characteristics. Eur J Radiol. 2013;82(10):1731–7.
Lidgren M, Wilking N, Jönsson B, Rehnberg C. Health related quality of life in different states of breast cancer. Qual Life Res. 2007;16(6):1073–81.
Stout NK, Rosenberg MA, Trentham-Dietz A, Smith MA, Robinson SM, Fryback DG. Retrospective cost-effectiveness analysis of screening mammography. J Natl Cancer Inst. 2006;98(11):774–82.
Hanmer J, Lawrence WF, Anderson JP, Kaplan RM, Fryback DG. Report of nationally representative values for the noninstitutionalized US adult population for 7 health-related quality-of-life scores. Medical decision making : an international journal of the Society for Medical Decision Making. 2006;26(4):391–400.
Independent UK. Panel on breast cancer screening: the benefits and harms of breast cancer screening: an independent review. Lancet. 2012;380(9855):1778–86.
Schiller-Fruhwirth IC, Jahn B, Arvandi M, Siebert U. Cost-effectiveness models in breast cancer screening in the general population: a systematic review. Appl Health Econ Health Policy. 2017;15(3):333–51.
Treatment of Ductal Carcinoma in Situ [https://www.cancer.org/cancer/breast-cancer/treatment/treatment-of-breast-cancer-by-stage/treatment-of-ductal-carcinoma-in-situ-dcis.html].
Kreienberg R, Albert U-S, Follmann M, Kühn T, Wöckel A, Zemmler T. Interdisziplinäre S3-Leitlinie für die Diagnostik, Therapie und Nachsorge des Mammakarzinoms - Langversion. In.: Leitlinienprogramm. Onkologie. 2012;
Dolan P. Modeling valuations for EuroQol health states. Med Care. 1997;35(11):1095–108.
Bonomi AE, Boudreau DM, Fishman PA, Ludman E, Mohelnitzky A, Cannon EA, Seger D. Quality of life valuations of mammography screening. Qual Life Res. 2008;17(5):801–14.
Johnston K, Brown J, Gerard K, O'Hanlon M, Morton A. Valuing temporary and chronic health states associated with breast screening. Soc Sci Med. 1998;47(2):213–22.
Schleinitz MD, DePalo D, Blume J, Stein M. Can differences in breast cancer utilities explain disparities in breast cancer care? J Gen Intern Med. 2006;21(12):1253–60.
Surveillance E, and End Results (SEER) Program: SEER*Stat Database: Incidence - SEER 18 Regs Research Data + Hurricane Katrina Impacted Louisiana Cases, Nov 2015 Sub (1973–2013 varying) - Linked To County Attributes - Total U.S., 1969–2014 Counties, National Cancer Institute, DCCPS. In. Edited by Surveillance Research Program SSB; 2015.
This systematic literature review was conducted with the help of two additional researchers. Mrs. Laura Kölbl applied the literature search terms based on the study protocol and verified the relevance of identified literature. Mr. Nathanael Beck supported the quality appraisal as a second evaluator.
Availability of data and materials
Ethics approval and consent to participate
Consent for publication
The author(s) declare that they have no competing interests.
About this article
Cite this article
Arnold, M. Simulation modeling for stratified breast cancer screening – a systematic review of cost and quality of life assumptions. BMC Health Serv Res 17, 802 (2017). https://doi.org/10.1186/s12913-017-2766-2
- Utility Parameters
- Personalized Breast Cancer Screening
- Medical Literature Analysis And Retrieval System (MEDLINE)
- Stratified Screening
- Utility Loss