Skip to main content
  • Research article
  • Open access
  • Published:

Cost effectiveness analysis of Year 2 of an elementary school-located influenza vaccination program–Results from a randomized controlled trial

Abstract

Background

School-located vaccination against influenza (SLV-I) has the potential to improve current suboptimal influenza immunization coverage for U.S. school-aged children. However, little is known about SLV-I’s cost-effectiveness. The objective of this study is to establish the cost-effectiveness of SLV-I based on a two-year community-based randomized controlled trial (Year 1: 2009–2010 vaccination season, an unusual H1N1 pandemic influenza season, and Year 2: 2010–2011, a more typical influenza season).

Methods

We performed a cost-effectiveness analysis on a two-year randomized controlled trial of a Western New York SLV-I program. SLV-I clinics were offered in 21 intervention elementary schools (Year 1 n = 9,027; Year 2 n = 9,145 children) with standard-of-care (no SLV-I) in control schools (Year 1 n = 4,534 (10 schools); Year 2 n = 4,796 children (11 schools)). We estimated the cost-per-vaccinated child, by dividing the incremental cost of the intervention by the incremental effectiveness (i.e., the number of additionally vaccinated students in intervention schools compared to control schools).

Results

In Years 1 and 2, respectively, the effectiveness measure (proportion of children vaccinated) was 11.2 and 12.0 percentage points higher in intervention (40.7 % and 40.4 %) than control schools. In year 2, the cost-per-vaccinated child excluding vaccine purchase ($59.88 in 2010 US $) consisted of three component costs: (A) the school costs ($8.25); (B) the project coordination costs ($32.33); and (C) the vendor costs excluding vaccine purchase ($16.68), summed through Monte Carlo simulation. Compared to Year 1, the two component costs (A) and (C) decreased, while the component cost (B) increased in Year 2. The cost-per-vaccinated child, excluding vaccine purchase, was $59.73 (Year 1) and $59.88 (Year 2, statistically indistinguishable from Year 1), higher than the published cost of providing influenza vaccination in medical practices ($39.54). However, taking indirect costs (e.g., averted parental costs to visit medical practices) into account, vaccination was less costly in SLV-I ($23.96 in Year 1, $24.07 in Year 2) than in medical practices.

Conclusions

Our two-year trial’s findings reinforced the evidence to support SLV-I as a potentially favorable system to increase childhood influenza vaccination rates in a cost-efficient way. Increased efficiencies in SLV-I are needed for a sustainable and scalable SLV-I program.

Peer Review reports

Background

Seasonal influenza poses a substantial disease burden on children [1, 2]. In 2008, the United States Advisory Committee on Immunization Practices (ACIP), the American Academy of Pediatrics (AAP) and the American Academy of Family Physicians (AAFP) recommended universal annual seasonal influenza vaccination for all children aged 6 months to 18 years [3]. This recommendation was designed to protect children because influenza is a common cause of pediatric outpatient visits [46], hospitalizations [714] and deaths [15, 16]. Further, by reducing spread of disease, influenza vaccination for children can also reduce influenza-related morbidity and mortality among adults [1719] as well as school absenteeism among children and teachers [20].

Despite these recommendations, vaccination coverage among school-aged children remains far below the most recent version of the Healthy People 2020 goal of 70 % coverage for all children [21, 22]. For the 2012–13 influenza season, only 58.6 % of 5–12 year olds and 42.5 % of 13–17 year olds received influenza vaccination [22]. Vaccinating all children within their primary care practices is a major challenge.

To attempt to increase vaccination coverage among school-aged children, some communities have implemented school-located vaccination against influenza (SLV-I) [2325]. Cawley and associates conducted a systematic literature review and concluded that SLV-I is a promising option to achieve the expanded ACIP influenza vaccination recommendation [26]. They highlighted the need for well-controlled trials to establish the cost-effectiveness of specific influenza vaccination strategies. Some experts believe that “the greatest need for future U.S. [SLV-I] program implementation is the development of a financially sustainable model that can be replicated annually on a national scale” [23].

We conducted a community-based randomized controlled trial (RCT) of SLV-I among elementary school children in Monroe County, New York, during the fall seasons of 2009 and 2010 to examine the effectiveness (i.e., improvement in influenza vaccination rates), cost, and cost-effectiveness of SLV-I. The demonstration project’s design and effectiveness for Years 1 and 2 have been reported [27]. In addition, we have reported the project’s cost-effectiveness for Year 1 [28], which was the 2009 H1N1 pandemic year, and therefore unusual [2729]. Analyzing the project’s Year 2 cost-effectiveness, a more typical influenza season than Year 1, could yield unique contributions to the literature. Specifically, the SLV-I program’s Year 2 might have been more efficient than Year 1 because of increased staff efficiency or program improvements (e.g., due to low utilization of a second clinic at each school in Year 1, only one clinic per school was offered in Year 2). Conversely, Year 2 might have been less efficient than Year 1 because of the parent demand in Year 1 being increased partly by the H1N1 influenza pandemic.

This paper reports on the Year 2 cost and cost-effectiveness of this SLV-I model, and compares these with corresponding values for Year 1. Our hypotheses were that the average cost-per-vaccinated child in SLV-I during Year 2 would be (1) lower than that observed in Year 1 and (2) comparable or lower than that observed in medical practices [30], when accounting for the costs to deliver vaccines and parents’ costs to visit medical practices for their child’s influenza vaccination. Our supplemental hypothesis was that in a Year 2 cost-effectiveness analysis, SLV-I could be cost-saving for society compared to “no vaccination.”

Methods

The methods for data collection and analysis in Year 2 followed those in Year 1 [27, 28]. The study designs of Years 1 and 2 of this study were the same, with randomization of elementary schools into 21 intervention (SLV-I) schools (9027 students in Year 1; 9145 students in Year 2) and control schools (10 schools, 4534 students in Year 1; 11 schools, 4796 students in Year 2) (Table 1). Randomization assignments from Year 1 generally remained constant in Year 2 [27]. Based on the New York State Immunization Information System data, influenza vaccine coverage in 2008 (prior to Year 1) was similar for students in SLV-I and control schools (P > 0.2) [27]. The number of vaccination clinics at each school (two-per-school in Year 1; one-per-school in Year 2) differed by year. To make a fair comparison between the costs of the program in Years 1 and 2, we did not include vaccinations delivered at the second in-school clinic in Year 1. Our cost effectiveness analysis models derived all of the effectiveness parameters and most of the cost parameters from our community-based RCT (the Trial Registration Number for the RCT is ClinicalTrials.govNCT01224301). The Research Subjects Review Boards of the University of Rochester and the Monroe County Department of Public Health approved this study, including the informed consent procedure, in 2009.)

Table 1 Vaccination rates in school-located seasonal influenza vaccination (SLV-I) schools and control schools during Year 1 (2009–2010 season) and Year 2 (2010–2011 season)

SLV-I clinics were held between 11/03/09 and 11/20/09 in Year 1 and between 11/2/2010 and 11/18/2010 in Year 2. A vaccination vendor administered either live attenuated (LAIV) or inactivated (TIV) seasonal influenza vaccines. Influenza vaccinations administered in the SLV-I clinics were recorded in the mass vaccinator’s database and analyzed in this study. Influenza vaccination rates outside the SLV-I clinics for both intervention and control schools were assessed by review of New York State Immunization Information System (NYIIS).

Cost-effectiveness analysis (CEA)

We estimated the incremental cost-effectiveness ratio (ICER) by dividing the incremental cost (i.e., the difference in cost of vaccination in intervention schools minus the cost of vaccination in control schools (i.e., a reference group)) by the incremental effectiveness (i.e., the number of additionally vaccinated students in intervention schools compared to control schools). Both effectiveness and cost measures are defined below.

Effectiveness measure

We defined effectiveness as the difference between the proportion of students who received ≥1 seasonal influenza vaccine anywhere (either at school or elsewhere) among students enrolled in intervention vs. control schools. This broad effectiveness measure was used because the intervention’s communication activities could have motivated parents to have their children vaccinated at either a medical practice or their schools.

Cost measures

We calculated all costs in 2010 US $, adjusting with the consumer price index (CPI) when needed [31]. We estimated three “program costs” incurred by this study: (A) school costs, (B) project coordination costs, and (C) vendor costs, as well as two indirect costs averted by having the SLV-I program: (D) averted parents’ costs (i.e., costs to visit medical practices for a child’s influenza vaccination) and (E) costs averted by disease prevention (i.e., both reduced influenza-related medical costs among all household members and reduced loss of parental productivity related to caring for a sick child). “Net Cost” was defined as “Program costs” (A + B + C) less averted parent costs (D). “Societal Cost” was defined as “Program costs” (A + B + C) less costs averted by influenza prevention (E).

Program cost components

Component A (school cost) included non-labor material cost (e.g., supplies and expenses associated with distributing information to parents) and labor costs. We calculated labor cost by multiplying the self-reported school staff hours by the national mean wage of a relevant job category as of May 2010 [32]. Component B (project coordination cost) included the cost incurred by coordinating activities, but excluded research and evaluation costs.

Component C (vendor costs) comprised the vendor’s labor (C1) and material costs, including broad items such as vaccine purchase, the refrigerator for vaccines and supplies. The vendor’s vaccine purchase costs were modeled in two ways. Our primary analysis, from the societal perspective, assigned a vaccine purchase cost (C2) of $12.06/dose for Year 2, which is the weighted average prices of federal Vaccine-For-Children (VFC) doses ($10.94 per dose; 52 % of all doses) and non-VFC doses ($13.26; 48 %) as of May 2010, listed on the CDC website [33]. These prices assumed that 80 % and 20 % of doses administered in this demonstration project were TIV and LAIV, respectively, in each year, as was observed in this trial’s Year 1. [28] Our supplemental analysis, assuming that VFC doses were free, was performed from the alternative perspective of school districts, health departments, and insurers (we included administration costs for private and VFC vaccine). In accordance with the Year 1 trail’s observation, the Year 2 analysis assumed that 52 % of students were VFC-eligible and, therefore, there was no charge to the vendor or families for their vaccine. Consequently, the cost item (C3) is the weighted average of VFC-dose ($0 per dose; 52 % of all doses) and non-VFC dose ($13.26; 48 %). However, it should be noted that these vaccine doses were not “free” from a societal perspective. Similarly, the vaccine prices for Year 1 were cited from the CDC website as of May 2009 [34].

Components D and E

The Components D and E estimated the averted cost for a household with a child protected by influenza vaccine, compared to a household with an unvaccinated child. These cost estimates were assumed to be constant across two years when expressed in 2010 US $.

Averted parent costs (D) were derived previously [28] and included the cost of parents’ time [3537] (two hours at the national median hourly wage of $21.25) and transportation ($6.42) [38]. Because some children would have had a medical visit to their primary care practice for reasons other than influenza vaccination during the influenza vaccination season, we took this into account. The sum of these averted costs ($21.25*2 h + $6.42 = $48.92) was discounted by 27.1 % (to $35.66) because the Medical Expenditure Panel Survey (MEPS) [39] showed that 27.1 % of children aged 7 to 12 years had ≥1 primary care visit between October and January (corresponding to typical influenza vaccination season). Also, these costs (D) do not include any medical expenditure, either paid by parents or incurred at medical practices.

The costs averted by disease prevention (component E) were derived from the literature. Based on findings from a large controlled clinical SLV-I trial, Schmier et al. estimated the averted medical expenditure as $121.46 and the averted productivity loss as $88.99 (both adjusted to 2010 dollars) per household, comparing the average costs per household between intervention and control schools during an influenza season [40]. The former averted medical expenditure represents the difference in direct influenza disease costs between intervention and control schools, including the costs for outpatient, emergency department, hospitalization, prescribed medication and over-the-counter medication [40]. The latter averted productivity loss accounted for the forgone income of a parent who was absent from work to take care of his/her influenza-infected child [40].

In the Schmier study [40], the average costs averted by disease prevention (component E) were $210.45 (=$121.46 + $88.99) per household comparing the intervention households (with a 47 % child vaccination rate) and the control households (with a 2 % child vaccination rate). On the other hand, because our study’s Component E represents the per-household averted cost comparing between households with a 100 % child vaccination rate and those with a 0 % child vaccination rate, the component E is expected to be at least $210.45. However, since the composition and household size were not assessed in our study unlike the Schmier study (i.e., 2.59 children and 2.0 adults per household), we made a conservative estimate for the component E as $210.45.

Managing uncertainty

To address the uncertainty of the cost parameters in our model, we conducted a Monte Carlo simulation in summing the component costs, (A), (B) and (C1), to estimate subtotal costs and total costs. We defined a triangular distribution with modal, minimum and maximum values for each component cost. The modal value was assumed to be equal to the overall mean cost of all SLV-I schools. The minimum and the maximum values, for the components (A) and (C1), were determined among the eleven data points from the individual SLV-I schools, according to our Year 1 analysis, since school-related costs appeared to vary widely by school [28]. Regarding the component B (project coordination cost), we used 4 data points derived from 4 groups of schools based on the geographic area (urban/rural) and the intensity of an intervention outreach activity (high/low). The mean and the 95 % confidence interval (CI) of the simulation results with 10,000 iterations were reported, where 95 % CI was assumed to be equal to the range of the 2.5th and 97.5th quantiles of the iterations.

Comparison with practice-located vaccination

We determined that SLV-I would be less costly than practice-located vaccination if the estimated cost-per-vaccinated child for SLV-I were below the median/mean ($22.17/$39.54 in 2010 US $) cost-per-vaccinated child for practice-located influenza vaccination as reported in our past study [28, 30]. For this comparison, we excluded the vaccine purchase cost from both SLV-I costs and medical practices’ costs [28, 30]. Finally, we subtracted the averted parent’s costs (Component D = $35.66) from the program costs of the SLV-I program.

Results

Effectiveness measures

The overall influenza vaccination rates (including vaccinations received in schools and at provider’s offices) in Years 1 and 2 were 40.7 % and 40.4 %, respectively, among children attending SLV-I schools compared to 29.5 % and 28.4 %, respectively, among those attending control schools (Table 1). Thus, the net effects of SLV-I was an 11.2 percentage point higher vaccination rates in Year 1 and a 12.0 percentage point higher vaccination rate in Year 2, suggesting a substantial impact of SLV-I in both the H1N1 Year 1 and the more typical seasonal influenza season in Year 2. These overall influenza vaccination rates of the SLV-I schools were slightly lower than among those aged 5–12 years enrolled in two nationally representative studies (i.e., National Health Interview Survey (NHIS) and National Immunization Survey (NIS)), e.g., 41.3 %-42.2 % during Year 1 and 45.9 %-54.7 % during Year 2 [41].

Cost measures

Table 2 Cost-effectiveness analysis of school-located seasonal influenza vaccination (SLV-I) during the 2009–2010 season (Year 1)a and the 2010–2011 season (Year 2) (all 2010 US $)b; Unit is incremental cost-effectiveness ratio (ICER)c [$-per-incremental-student-vaccinated in the school-located seasonal influenza vaccination (SLV-I), compared to control schools]

The number of students vaccinated in SLV-I schools (Table 1) was used as the denominator for the cost measure estimation and cost effectiveness analysis. The project coordination cost (B) per vaccinated-child was higher in Year 2 than Year 1, ($32.33 vs. $25.35), more than offsetting increased efficiencies in other costs (Table 2). In contrast, school costs (A) per vaccinated-child were lower in Year 2 than Year 1, ($8.25 vs. $9.92) as were the vendor costs (C) per vaccinated-child ($28.74 vs. $33.99). Since the vaccine purchase costs (C2) could vary substantially depending on the proportion of vaccine-for-children (VFC) eligible children, we made separate costs estimates: (i) including the vaccine administration cost only (C1) and (ii) additionally including the vaccine purchase cost (C2).

Cost effectiveness analysis (CEA)

Comparison between years 1 and 2

The Subtotal and Total costs in Table 2 present the CEA results, i.e., ICER estimates based on the Monte Carlo simulation, that enable us to compare the overall SLV-I program performance between Years 1 and 2. Our results showed that the ICER estimates for all types of Subtotal and Total costs were not significantly different between Years 1 and 2. Thus, our first hypothesis -- that the average cost per vaccinated child in SLV-I schools would be lower during Year 2 than Year 1–was not supported. Note that despite differences in point (mean) estimates, there was marked overlap in the 95 % CIs between Years 1 and 2.Footnote 1

Comparison with practice-located vaccination

When we consider only program costs, we find that SLV-I costs were higher than costs observed in medical practices. Specifically, based on the Subtotal Program Cost 2 (based only on Components A + B + C1), the mean ICER estimates were $59.73 in Year 1 and $59.88 in Year 2. These mean estimates and the lower bounds of 95 % CI $48.26 in Year 1 and $47.69 in Year 2) were all higher than previously reported corresponding costs in medical practices (median/mean = $22.17/$39.54) [28, 30].

When also considering indirect averted parent costs (D) (Total Net Cost 2: Components A + B + C1–D), the mean ICER estimates would decline to $23.96 in Year 1 and $24.07 in Year 2. These mean ICER estimates in both years fall between the 25th percentile ($13.88) and the mean ($39.54) cost for providing influenza vaccination in medical practices [28, 30], supporting our second hypothesis that SLV-I costs would be comparable or lower than practice-based influenza vaccination costs when including indirect averted parent costs (Component D).

When including indirect costs averted by disease prevention (E), the mean ICER estimate for Year 2 became negative ((A + B + C)–E = $71.74 - $210.45 = −$-138.71) (results not shown in Table 2). Negative ICER values indicate that SLV-I is cost saving compared to “no vaccination” from a broader societal perspective.

Finally, we performed two sets of break-even analyses for CEA in Year 2 only: (1) Based on the Total Net Cost 3 [(program costs − parent costs) = (A + B + C − D)], we estimated the threshold level of in-school vaccination necessary for SLV-I to be cost-saving to society, even if averted costs due to medical expenditures and lost productivity were not included. This would be achieved if the in-school net vaccination rate were to increase from the actual level (11.4 % in Year 2) to at least 24.0 %, assuming no change in vaccination rates ‘elsewhere.’ (2) Based on the Subtotal Program Cost 2 (A + B + C1), we estimated the level of in-school vaccination necessary for mean cost in SLV programs and medical practices to be equivalent, even if averted parents’ costs to visit a medical practice (D) were not included. This would be achieved if the in-school vaccination rate were at least 17.6 %, assuming no change in vaccination rates ‘elsewhere.’

Discussion

We had hypothesized that the SLV-I program would become more efficient in Year 2 of implementation, but found that the costs and cost-effectiveness of SLV-I were comparable in Year 2, a routine seasonal influenza vaccination year, compared to Year 1, the year of pandemic H1N1. Project coordination costs (Component B) were higher in Year 2 than 1, more than offsetting improved efficiencies in other costs. A detailed comparison between the two years offers useful policy implications for SLV-I and can help set future goals to improve the overall cost-effectiveness of SLV-I during a more typical season. Additionally, analyses of both Years 1 and 2 showed that SLV-I could be cost-saving to society, compared to “no vaccination,” if savings from the increase in disease prevention under the SLV program (Component E) were included.

Comparison with vaccination in medical practices

When considering program costs alone, the cost to vaccinate a child in SLV-I was higher than the previously calculated cost to vaccinate a child in primary care practices in the same community. When considering program plus averted parent costs for transportation and time lost from work (i.e., cost component (D)), the cost to vaccinate a child in SLV-I was comparable or lower than that in primary care practices. Communities interested in implementing SLV-I will naturally focus on the difference between program costs and revenues received from SLV-I in determining feasibility and sustainability of SLV-I.

Comparison between year 1 and year 2

Project coordination costs (Component B): The major reason why the SLV-I project was not more cost-effective in Year 2 than Year 1 was that the project coordination costs (Component B) increased during Year 2, more than offsetting decreases in school and vendor costs (Components A and C). In Year 2 pre-season, an additional four weeks was available for planning leading to more time being devoted to the process. Variation in responsibility for some tasks in Years 1 and 2 among school staff and project administrative staff may have led to changes in Components A and B across years. Because of this, we also compared the sum of Components of A and B -- $35.27 (Year 1) was still lower than $40.58 (Year 2). Given the realities of busy school personnel and the reduction in school nurses nationwide, we believe that for SLV-I to be sustainable, work by school staff would need to be minimized, with the possible exception of a special pandemic season. Thus, it is possible that the costs noted in Year 2 may represent a more generalizable estimate. Regardless of the reasons for the high costs, it is clear that for SLIV to be sustainable and scalable, fieldwork costs outside of the school-based costs would need to be lower than we experienced. Further studies are needed to assess the degree to which fieldwork costs can be reduced, e.g., costs to coordinate five school-districts in our trial which imposed much higher burdens compared a single school-district trial [42].

Comparison of year 2 trial with other studies

Our Year 2 intervention had a moderate impact on influenza vaccination uptake with an improvement of 12 percentage points (pp). This impact was higher than that found in other trials, such as those using text message reminders (3.7 pp) [43], mail reminders (6.5 pp) [44], and provider prompts (4.0 pp but statistically insignificant) [45].

The overall vaccination coverage rates found in our trial was in the range of rates noted in other studies. For example, SLV-I trials at the state level in Hawaii and the three-county level in Minnesota resulted in very high vaccination rates of 46 % [25] and 41 % [46], respectively; however these were not clinical trials, no control schools existed, and the papers did not report what percent of vaccinations were delivered in school versus in physician offices. In an SLV-I trial at nineteen elementary schools in California, coverage varied by school, with 26.9 %-46.6 % of children in each school receiving at least one dose of influenza vaccine with a large impact due to SLV-I; however in this setting control schools had virtually zero vaccination rates [47].

Unlike other SLV-I trials, our SLV-I trial billed insurers (or parents if insurance coverage was unknown) for vaccines and vaccine administration. We contracted with a for-profit vendor that delivered the in-school vaccinations, which were purchased through routine channels or obtained through VFC program. Consequently, the cost estimates from our study are greater than those in other SLV-I trials that did not include vaccine cost and\or the cost to bill insurance or Medicaid for vaccines or vaccine administration. The cost estimates in other studies in this section were all adjusted to 2010 US $ with medical care CPI [31]. For instance, our estimate of $59.88 per vaccinated-child was much lower than that by Kansagra et al. ($80.92) [48], but considerably higher than that by Schmier and colleagues ($6.98) [40], Hull and associates ($10.11) [46], Effler et al. ($15.66) [25], and Kemp and colleagues ($24.69) [49]. Among these five studies, only Kansagra et al. and Effler et al. reported the detailed cost items within the administration cost. Concerning the labor cost estimates, our estimate ($39.13 per vaccinated-child) was slightly larger than $33.17 estimated by Kansagra et al. [48], and much larger than $12.19 estimated by Effler et al. [25]. The latter lower estimate may have been partly due to economies of size of their large state-wide program, vaccinating 63,153 children after targeting all children aged 5–13 in Hawaii [25]. Additionally, the studies by Effler et al. [25] or Hull et al. [46] did not seek third party reimbursement, which was included as part of the vendor’s administrative cost (for the billing process) in our study. Parents were not billed for any fees in the study by Kemp et al. [49], although our cost estimates includes the vendor’s billing process costs for parents.

Extensive project staff time was needed to manage parents’ consent forms–all done on paper -- which included details of about patient insurance. More efficient consent systems could reduce future SLV-I program costs [50, 51].

Material costs incurred by schools and the project coordinators were $4.69 per vaccinated-child, which was similar to $5.72 (adjusted to 2010 US $ with medical care CPI) reported by Effler et al. [25]. However, our estimate of the vendor’s material cost, $13.43 per vaccinated-child, was much higher than that of $1.64 by Effler et al. [25]. This difference can be partly explained by our study’s broader cost definition including items such as the refrigerator for vaccines and non-medical supplies.

Other studies also have concluded that SLV-I may be cost saving to society, when considering broader indirect costs [40, 52]. Using secondary datasets only, White and associates estimated that group-based influenza vaccination was cost-saving, i.e., saving $6.40 and $55.82 per vaccination, as compared to individual vaccination at a medical practice and no-vaccination, respectively [52]. Schmier et al. analyzed their primary data to conclude that SLV-I is cost-saving to society, saving $170.31 on average among all households in intervention schools [40].

In summary, our study, based upon a real-world demonstration and including billing of third party payers, had higher program costs than most prior SLV-I studies, resulting in lower cost-effectiveness. Our findings regarding indirect parent or societal costs were in line with those of other studies.

Potential limitations

There was uncertainty in cost estimates in Year 1 that may affect the comparison with Year 2. As discussed in the paper describing Year 1 [28], it is difficult to accurately allocate the fixed costs between first clinics and second clinics during Year 1 due to the limited available data.

Another limitation is the potentially limited generalizability of our estimates, which may have been affected by multiple factors. The effectiveness of SLV-I is sensitive to the proportion of local children vaccinated by medical practices prior to the school vaccine clinics. For instance, in an area where medical practices vaccinate a high proportion of children, a SLV-I program may have a smaller impact on vaccination coverage. Hence, our SLV-I effectiveness estimates are likely to be most applicable to other areas where the vaccination rates achieved by medical practices are similar to those in our study site, i.e., less than one-third of children were vaccinated pre-intervention. Second, since influenza vaccination rates may be influenced by a host of seasonal influenza factors (e.g., disease severity [53], vaccine availability [54], media coverage [55]) SLV-I vaccination coverage in school and, consequently, effectiveness estimates could differ from year to year.

Different methods were used to ascertain the vaccinated status between intervention schools (based on the vendor’s records and New York State Immunization Information System (NYSIIS)) and control schools (NYSIIS records only). This difference could affect the effectiveness measure within a year, but would not affect the comparison between Years 1 and 2.

Finally, we derived indirect costs from the literature, not from our trial. Since we utilized a national-level median hourly wage among working adults for estimating the indirect cost component D, averted parents’ costs, these estimates are expected to be reasonably generalizable. Since the magnitude of the other indirect component (E, costs saving from disease prevention) might be sensitive to the estimation methods and the seasons analyzed, component E-related results were not presented in Tables. Our analysis excluded some relevant, but unmeasured, indirect costs such as costs due to disruptions of the school day by SLV-I, and cost savings from decreased absenteeism.

Policy implications

Our findings from a real-world demonstration project indicated that while SLV-I is effective in improving influenza vaccination rates in school-aged children, project coordination costs (Component B) remained high during a second project year. High project coordination costs (Component B), driven by a substantial amount of effort needed to obtain informed consent and to manage implementation of the project, more than offset lower school and vendor costs (Components A and C). Project coordination costs (Component B) would need to be reduced through strategies such as an efficient parent consent and communication system. Overall, the per-vaccinated child cost estimates of our SLV-I were higher than those in medical practices and also higher than typical reimbursement rates. While our current cost estimates favor SLV-I over medical practices when we account for averted parental costs to visit medical practices (Component D), such cost-savings to parents may not be considered by health systems responsible for SLV-I. Thus, while costs are not the only consideration in setting up and sustaining SLV-I [56, 57], the program costs for SLV-I should be lower than practice-located costs, or at least lower than or equal to reimbursement rates for SLV-I to be sustained.

Finally, achieving higher in-school vaccination coverage would improve cost-effectiveness. For example, in this study a net vaccination rate of 17.6 % (rather than 11.4 % found in Year 2) would lead to SLV-I cost estimates being lower than those in medical practices.

Conclusions

Our two-year trial’s findings reinforced the evidence to support SLV-I as a potentially favorable system to increase childhood influenza vaccination rates in a cost-efficient way, but increased efficiencies in SLV-I are needed for a sustainable and scalable SLV-I program.

Notes

  1. For instance, using our primary effectiveness measure (i.e., columns labeled “vaccinated anywhere” in Table 2), the mean ICER estimate based on Total Program Cost 1 was $71.74 per incremental-student-vaccinated in Year 2, which was lower than $71.78 in Year 1. However, because the estimated 95 % CI in Year 2 ($59.75, $84.47) overlaps with that in Year 1 ($60.32, $83.77), there is no significant difference in Total Program Cost 1 between Years 1 and 2.

Abbreviations

AAFP:

American academy of family physicians

AAP:

American academy of pediatrics

ACIP:

advisory committee on immunization practices

CEA:

cost-effectiveness analysis

CI:

confidence interval

ICER:

incremental cost-effectiveness ratio

LAIV:

live attenuated influenza vaccine

NYIIS:

New York State immunization information system

RCT:

randomized controlled trial

SLV-I:

school-located vaccination against influenza

TIV:

trivalent influenza vaccine

VFC:

vaccine-for-children

References

  1. O’Brien MA, Uyeki TM, Shay DK, Thompson WW, Kleinman K, McAdam A, et al. Incidence of outpatient visits and hospitalizations related to influenza in infants and young children. Pediatrics. 2004;113(3 Pt 1):585–93.

    Article  PubMed  Google Scholar 

  2. Neuzil KM, Zhu Y, Griffin MR, Edwards KM, Thompson JM, Tollefson SJ, et al. Burden of interpandemic influenza in children younger than 5 years: a 25-year prospective study. J Infect Dis. 2002;185(2):147–52.

    Article  PubMed  Google Scholar 

  3. Fiore AE, Shay DK, Broder K, Iskander JK, Uyeki TM, Mootrey G, et al. Prevention and control of influenza: recommendations of the Advisory Committee on Immunization Practices (ACIP), 2008. MMWR Recomm Rep. 2008;57(RR-7):1–60.

    PubMed  Google Scholar 

  4. Poehling KA, Edwards KM, Weinberg GA, Szilagyi P, Staat MA, Iwane MK, et al. The underrecognized burden of influenza in young children. N Engl J Med. 2006;355(1):31–40.

    Article  CAS  PubMed  Google Scholar 

  5. Bourgeois FT, Valim C, Wei JC, McAdam AJ, Mandl KD. Influenza and other respiratory virus-related emergency department visits among young children. Pediatrics. 2006;118(1):e1–8.

    Article  PubMed  Google Scholar 

  6. Neuzil KM, Mellen BG, Wright PF, Mitchel Jr EF, Griffin MR. The effect of influenza on hospitalizations, outpatient visits, and courses of antibiotics in children. N Engl J Med. 2000;342(4):225–31.

    Article  CAS  PubMed  Google Scholar 

  7. Simonsen L, Fukuda K, Schonberger LB, Cox NJ. The impact of influenza epidemics on hospitalizations. J Infect Dis. 2000;181(3):831–7.

    Article  CAS  PubMed  Google Scholar 

  8. Glezen WP, Decker M, Perrotta DM. Survey of underlying conditions of persons hospitalized with acute respiratory disease during influenza epidemics in Houston, 1978–1981. Am Rev Respir Dis. 1987;136(3):550–5.

    Article  CAS  PubMed  Google Scholar 

  9. Izurieta HS, Thompson WW, Kramarz P, Shay DK, Davis RL, DeStefano F, et al. Influenza and the rates of hospitalization for respiratory disease among infants and young children. N Engl J Med. 2000;342(4):232–9.

    Article  CAS  PubMed  Google Scholar 

  10. Mullooly JP, Barker WH. Impact of type A influenza on children: a retrospective study. Am J Public Health. 1982;72(9):1008–16.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  11. Ampofo K, Gesteland PH, Bender J, Mills M, Daly J, Samore M, et al. Epidemiology, complications, and cost of hospitalization in children with laboratory-confirmed influenza infection. Pediatrics. 2006;118(6):2409–17.

    Article  PubMed  Google Scholar 

  12. Coffin SE, Zaoutis TE, Rosenquist AB, Heydon K, Herrera G, Bridges CB, et al. Incidence, complications, and risk factors for prolonged stay in children hospitalized with community-acquired influenza. Pediatrics. 2007;119(4):740–8.

    Article  PubMed  Google Scholar 

  13. Iwane MK, Edwards KM, Szilagyi PG, Walker FJ, Griffin MR, Weinberg GA, et al. Population-based surveillance for hospitalizations associated with respiratory syncytial virus, influenza virus, and parainfluenza viruses among young children. Pediatrics. 2004;113(6):1758–64.

    Article  PubMed  Google Scholar 

  14. Zhou H, Thompson WW, Viboud CG, Ringholz CM, Cheng PY, Steiner C, et al. Hospitalizations associated with influenza and respiratory syncytial virus in the United States, 1993–2008. Clin Infect Dis. 2012;54(10):1427–36.

    Article  PubMed  PubMed Central  Google Scholar 

  15. Finelli L, Fiore A, Dhara R, Brammer L, Shay DK, Kamimoto L, et al. Influenza-associated pediatric mortality in the United States: increase of Staphylococcus aureus coinfection. Pediatrics. 2008;122(4):805–11.

    Article  PubMed  Google Scholar 

  16. Centers for Disease C, Prevention. Influenza-associated pediatric deaths--United States, September 2010-August 2011. MMWR Morb Mortal Wkly Rep. 2011;60(36):1233–8.

    Google Scholar 

  17. Poehling KA, Szilagyi PG. Not just for kids: new paradigms for vaccine delivery in pediatrics. Acad Pediatr. 2009;9(5):293–4.

    Article  PubMed  Google Scholar 

  18. Fiore AE, Epperson S, Perrotta D, Bernstein H, Neuzil K. Expanding the recommendations for annual influenza vaccination to school-age children in the United States. Pediatrics. 2012;129 Suppl 2:S54–62.

    Article  PubMed  Google Scholar 

  19. Longini Jr IM. A theoretic framework to consider the effect of immunizing schoolchildren against influenza: implications for research. Pediatrics. 2012;129 Suppl 2:S63–7.

    Article  PubMed  Google Scholar 

  20. King Jr JC, Beckett D, Snyder J, Cummings GE, King BS, Magder LS. Direct and indirect impact of influenza vaccination of young children on school absenteeism. Vaccine. 2012;30(2):289–93.

    Article  PubMed  Google Scholar 

  21. Centers for Disease Control and Prevention (CDC). Healthy people 2020 Topics & Objectives– Immunization and Infectious Diseases. Atlanta, GA. http://www.healthypeople.gov/2020/topics-objectives/topic/immunization-and-infectious-diseases/objectives. Accessed 11 Nov 2015.

  22. Centers for Disease Control and Prevention (CDC). Healthy people 2020 Topics & Objectives– Immunization and Infectious Diseases, IID-12.11 Increase the percentage of children aged 6 months through 17 years who are vaccinated annually against seasonal influenza. http://www.healthypeople.gov/2020/data-search/Search-the-Data?nid=6359. Accessed 11 Nov 2015.

  23. Hull HF, Ambrose CS. Current experience with school-located influenza vaccination programs in the United States: a review of the medical literature. Hum Vaccin. 2011;7(2):153–60.

    Article  PubMed  PubMed Central  Google Scholar 

  24. Wilson D, Sanchez KM, Blackwell SH, Weinstein E, El Amin AN. Implementing and sustaining school-located influenza vaccination programs: perspectives from five diverse school districts. J Sch Nurs. 2013;29(4):303–14.

    Article  PubMed  Google Scholar 

  25. Effler PV, Chu C, He H, Gaynor K, Sakamoto S, Nagao M, et al. Statewide school-located influenza vaccination program for children 5–13 years of age, Hawaii, USA. Emerg Infect Dis. 2010;16(2):244–50.

    Article  PubMed  PubMed Central  Google Scholar 

  26. Cawley J, Hull HF, Rousculp MD. Strategies for implementing school-located influenza vaccination of children: a systematic literature review. J Sch Health. 2010;80(4):167–75.

    Article  PubMed  Google Scholar 

  27. Humiston S, Schaffer S, Szilagyi P, Long C, Chappel T, Blumkin A, et al. Seasonal influenza vaccination at school: a randomized controlled trial. Am J Prev Med. 2014;46(1):1–9.

    Article  PubMed  Google Scholar 

  28. Yoo BK, Humiston SG, Szilagyi PG, Schaffer SJ, Long C, Kolasa M. Cost effectiveness analysis of elementary school-located vaccination against influenza--results from a randomized controlled trial. Vaccine. 2013;31(17):2156–64.

    Article  PubMed  PubMed Central  Google Scholar 

  29. Centers for Disease Control and Prevention (CDC). 2009 H1N1 Vaccination Recommendations. http://www.cdc.gov/h1n1flu/vaccination/acip.htm. 2009. Accessed 28 Nov 2013.

  30. Yoo BK, Szilagyi PG, Schaffer SJ, Humiston SG, Rand CM, Albertin CS, et al. Cost of universal influenza vaccination of children in pediatric practices. Pediatrics. 2009;124 Suppl 5:S499–506.

    Article  PubMed  PubMed Central  Google Scholar 

  31. U.S. Bureau of Labor Statistics. Public Data Query -- Consumer Price Index.http://www.bls.gov/data/#prices. Accessed 11 Nov 2015.

  32. U.S. Bureau of Labor Statistics. May 2010 Occupational Employment and Wage Estimates -- National Cross-Industry estimates. http://www.bls.gov/oes_dl.htm. 2010. Accessed 5 Jul 2013.

  33. Centers for Disease Control and Prevention (CDC). Vaccines for Children Program (VFC): Archived CDC Vaccine Price List as of May 14, 2010: Pediatric Influenza Vaccine Price List. http://www.cdc.gov/vaccines/programs/vfc/awardees/vaccine-management/price-list/2010/2010-05-14.html. 2010. Accessed 20 Jun 2013.

  34. Centers for Disease Control and Prevention (CDC). Vaccines for Children Program (VFC): Archived CDC Vaccine Price List as of May 26, 2009: Pediatric Influenza Vaccine Price List. http://www.cdc.gov/vaccines/programs/vfc/awardees/vaccine-management/price-list/2009/2009-05-26.html. Accessed 11 Nov 2015.

  35. Prosser LA, Bridges CB, Uyeki TM, Hinrichsen VL, Meltzer MI, Molinari NA, et al. Health benefits, risks, and cost-effectiveness of influenza vaccination of children. Emerg Infect Dis. 2006;12(10):1548–58.

    Article  PubMed  PubMed Central  Google Scholar 

  36. Luce BR, Manning WG, Siegel JE, Lipscomb J. Estimating Costs in Cost-Effectiveness Analysis. In: Gold MR, Siegel JE, Russell LB, Weinstein MC, editors. Cost-Effectiveness in Health and Medicine. USA: Oxford University Press; 1996. p. 176–83.

    Google Scholar 

  37. U.S. Bureau of Labor Statistics. Occupational Employment Statistics: May 2009 National Occupational Employment and Wage Estimates, United States. http://www.bls.gov/oes/2009/may/oes_nat.htm. 2010. Accessed 8 Jan 2013.

  38. Luce BR, Nichol KL, Belshe RB, Frick KD, Li SX, Boscoe A, et al. Cost-effectiveness of live attenuated influenza vaccine versus inactivated influenza vaccine among children aged 24–59 months in the United States. Vaccine. 2008;26(23):2841–8.

    Article  PubMed  Google Scholar 

  39. Agency for Healthcare Research and Quality (AHRQ). Medical Expenditure Panel Survey. Rockville, MD, http://meps.ahrq.gov/mepsweb/. Accessed 17 Feb 2012.

  40. Schmier J, Li S, King Jr JC, Nichol K, Mahadevia PJ. Benefits and costs of immunizing children against influenza at school: an economic analysis based on a large-cluster controlled clinical trial. Health Aff (Millwood). 2008;27(2):w96–w104.

    Article  Google Scholar 

  41. Santibanez TA, Lu PJ, O’Halloran A, Meghani A, Grabowsky M, Singleton JA. Trends in childhood influenza vaccination coverage--U.S., 2004–2012. Public Health Rep. 2014;129(5):417–27.

    PubMed  PubMed Central  Google Scholar 

  42. Carpenter LR, Lott J, Lawson BM, Hall S, Craig AS, Schaffner W, et al. Mass distribution of free, intranasally administered influenza vaccine in a public school system. Pediatrics. 2007;120(1):e172–8.

    Article  PubMed  Google Scholar 

  43. Stockwell MS, Kharbanda EO, Martinez RA, Vargas CY, Vawdrey DK, Camargo S. Effect of a text messaging intervention on influenza vaccination in an urban, low-income pediatric and adolescent population: a randomized controlled trial. JAMA. 2012;307(16):1702–8.

    Article  CAS  PubMed  Google Scholar 

  44. Dombkowski KJ, Harrington LB, Dong S, Clark SJ. Seasonal influenza vaccination reminders for children with high-risk conditions: a registry-based randomized trial. Am J Prev Med. 2012;42(1):71–5.

    Article  PubMed  Google Scholar 

  45. Szilagyi PG, Serwint JR, Humiston SG, Rand CM, Schaffer S, Vincelli P, et al. Effect of provider prompts on adolescent immunization rates: a randomized trial. Acad Pediatr. 2015;15(2):149–57.

    Article  PubMed  Google Scholar 

  46. Hull HF, Frauendienst RS, Gundersen ML, Monsen SM, Fishbein DB. School-based influenza immunization. Vaccine. 2008;26(34):4312–3.

    Article  PubMed  Google Scholar 

  47. Pannaraj PS, Wang HL, Rivas H, Wiryawan H, Smit M, Green N, et al. School-located influenza vaccination decreases laboratory-confirmed influenza and improves school attendance. Clin Infect Dis. 2014;59(3):325–32.

    Article  PubMed  PubMed Central  Google Scholar 

  48. Kansagra SM, McGinty MD, Morgenthau BM, Marquez ML, Rosselli-Fraschilla A, Zucker JR, et al. Cost comparison of 2 mass vaccination campaigns against influenza A H1N1 in New York City. Am J Public Health. 2012;102(7):1378–83.

    Article  PubMed  PubMed Central  Google Scholar 

  49. Kempe A, Daley MF, Pyrzanowski J, Vogt T, Fang H, Rinehart DJ, et al. School-located influenza vaccination with third-party billing: outcomes, cost, and reimbursement. Acad Pediatr. 2014;14(3):234–40.

    Article  PubMed  Google Scholar 

  50. Asay GR, Cho BH, Lorick SA, Tipton ML, Dube NL, Messonnier ML. Coordination costs for school-located influenza vaccination clinics, Maine, 2009 H1N1 pandemic. J Sch Nurs. 2012;28(5):328–35.

    Article  PubMed  Google Scholar 

  51. Cho BH, Asay GR, Lorick SA, Tipton ML, Dube NL, Messonnier ML. Costs of school-located influenza vaccination clinics in Maine during the 2009–2010 H1N1 pandemic. J Sch Nurs. 2012;28(5):336–43.

    Article  PubMed  Google Scholar 

  52. White T, Lavoie S, Nettleman MD. Potential cost savings attributable to influenza vaccination of school-aged children. Pediatrics. 1999;103(6):e73.

    Article  CAS  PubMed  Google Scholar 

  53. Yoo BK, Kasajima M, Fiscella K, Bennett NM, Phelps CE, Szilagyi PG. Effects of an ongoing epidemic on the annual influenza vaccination rate and vaccination timing among the Medicare elderly: 2000–2005. Am J Public Health. 2009;99 Suppl 2:S383–8.

    Article  PubMed  PubMed Central  Google Scholar 

  54. Yoo BK, Kasajima M, Phelps CE, Fiscella K, Bennett NM, Szilagyi PG. Influenza vaccine supply and racial/ethnic disparities in vaccination among the elderly. Am J Prev Med. 2011;40(1):1–10.

    Article  PubMed  Google Scholar 

  55. Yoo BK, Holland ML, Bhattacharya J, Phelps CE, Szilagyi PG. Effects of mass media coverage on timing and annual receipt of influenza vaccination among Medicare elderly. Health Serv Res. 2010;45(5 Pt 1):1287–309.

    Article  PubMed  PubMed Central  Google Scholar 

  56. Rand CM, Humiston SG. A shot in the arm: not as simple as it would seem. Acad Pediatr. 2012;12(1):13–4.

    Article  PubMed  Google Scholar 

  57. Kempe A, Wortley P, O’Leary S, Crane LA, Daley MF, Stokley S, et al. Pediatricians’ attitudes about collaborations with other community vaccinators in the delivery of seasonal influenza vaccine. Acad Pediatr. 2012;12(1):26–35.

    Article  PubMed  Google Scholar 

  58. U.S. Bureau of Labor Statistics. May 2009 Occupational Employment and Wage Estimates -- National Cross-Industry estimates. http://www.bls.gov/oes/2009/may/oes_nat.htm. Accessed 11 Nov 2015.

  59. Lieu TA, Capra AM, Makol J, Black SB, Shinefield HR. Effectiveness and cost-effectiveness of letters, automated telephone messages, or both for underimmunized children in a health maintenance organization. Pediatrics. 1998;101(4):E3.

    Article  CAS  PubMed  Google Scholar 

Download references

Acknowledgements

Supported by the Centers for Disease Control and Prevention, Grant #: 055215–002

“School-Based Influenza Immunization Program”

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Byung-Kwang Yoo.

Additional information

Competing interests

Regarding consulting arrangements, the following three organizations have paid Dr. Sharon Humiston, directly as a consultant in the past 12 months (as of January 9, 2015). These organizations are (a) Immunization Action Coalition (Type: Not for profit; Funding Source: Various), (b) Medstudy (Type: Private; Funding Source: Medstudy fees), and (c) University of Rochester Medical Center (Type: Private; Funding Source: Society for Adolescent Health & Medicine).

The findings and conclusions in this report are those of the authors and do not necessarily represent the views of the Centers for Disease Control and Prevention, US Department of Health and Human Services.

Authors’ contributions

BY conceived of the study, participated in the design of the study, performed the empirical analyses, drafted the manuscript. SH conceived of the study, participated in the design of the study and coordination and helped to draft the manuscript. PS participated in the design of the study and helped to draft the manuscript. SS participated in the design of the study and helped to draft the manuscript. CL participated in the design of the study and coordination and helped to draft the manuscript. MK participated in the design of the study and helped to draft the manuscript. All authors read and approved the final manuscript.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Yoo, BK., Humiston, S.G., Szilagyi, P.G. et al. Cost effectiveness analysis of Year 2 of an elementary school-located influenza vaccination program–Results from a randomized controlled trial. BMC Health Serv Res 15, 511 (2015). https://doi.org/10.1186/s12913-015-1169-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12913-015-1169-5

Keywords