- Research article
- Open Access
Use of low-value pediatric services in the Military Health System
BMC Health Services Research volume 20, Article number: 770 (2020)
Low-value care (LVC) is understudied in pediatric populations and in the Military Health System (MHS). This cross-sectional study applies previously developed measures of pediatric LVC diagnostic tests, procedures, and treatments to children receiving care within the direct and purchased care environments of the MHS.
We queried the MHS Data Repository (MDR) to identify children (n = 1,111,534) who received one or more of 20 previously described types of LVC in fiscal year 2015. We calculated the proportion of eligible children and all children who received the service at least once during fiscal year 2015. Among children eligible for each measure, we used logistic regressions to calculate the adjusted odds ratios (AOR) for receiving LVC at least once during fiscal year 2015 in direct versus purchased care.
All 20 measures of pediatric LVC were found in the MDR. Of the 1,111,534 eligible children identified, 15.41% received at least one LVC service, and the two most common procedures were cough and cold medications in children under 6 years and acid blockers for infants with uncomplicated gastroesophageal reflux. Eighteen of the 20 measures of pediatric LVC were eligible for comparison across care environments: 6 were significantly more likely to be delivered in direct care and 10 were significantly more likely to be delivered in purchased care. The greatest differences between direct and purchased care were seen in respiratory syncytial virus testing in children with bronchiolitis (AOR = 21.01, 95% CI = 12.23–36.10) and blood tests in children with simple febrile seizure (AOR = 24.44, 95% CI = 5.49–108.82). A notably greater difference of inappropriate antibiotic prescribing was seen in purchased versus direct care.
Significant differences existed between provision of LVC services in direct and purchased care, unlike previous studies showing little difference between publicly and privately insured children. In fiscal year 2015, 1 in 7 children received one of 20 types of LVC. These proportions are higher than prior estimates from privately and publicly insured children, suggesting the particular need to focus on decreasing wasteful care in the MHS. Collectively, these studies demonstrate the high prevalence of LVC in children and the necessity of reducing potentially harmful care in this vulnerable population.
Healthcare costs in the United States have steadily increased over the last 20 years , reaching an estimated $2.9 trillion in spending in 2014 . While this accounts for nearly $10,000 per person per year in 2017 , this expenditure does not necessarily translate into better health outcomes. Between 10 and 14% of all-payer healthcare spending represents inefficiencies in care delivery and overtreatment . At best, these interventions provide no benefit to the patient, and at worst, they potentiate harm. Such care is broadly defined as “low-value care (LVC) or overuse” [5, 6]. Efforts such as Choosing Wisely , launched in 2012, have attempted to raise awareness regarding LVC across 500 physician-identified procedures that provide little to no patient benefit. However, these efforts do not provide a means of measuring low value care in a system.
Based on these lists, researchers have developed tools for examining LVC in large-scale claims data. For example, Schwartz et al. (2014) found that 25 to 42% of elderly Medicare beneficiaries received at least 1 of 26 low-value services in 2009, resulting in $1.9 billion to $8.5 billion in expenditures . Segal, et al. (2014) produced a list of 20 “indicator procedures” representative of broader overuse within a large healthcare system . This list was later applied to the Military Health System (MHS) by Koehlmoos, et al. (2019), who demonstrated the existence of LVC for the first time in the MHS among the adult beneficiaries . Similarly, Chua et al. (2016) developed a novel set of 20 claim-based measures for measuring overuse in the pediatric population . The study found that at least 1 in 10 commercially insured US children received one or more low-value pediatric services during 2014, resulting in $27.0 million in unnecessary spending, of which $9.2 million was paid out-of-pocket (33.9%).
The MHS provides care through a bifurcated system in which beneficiaries may receive Direct Care (DC) from providers at military treatment facilities (MTFs) including hospitals, major medical centers, and clinics, in the US and overseas; or Purchased Care (PC) through regional, non-exclusive civilian providers who accept the TRICARE insurance benefit. Building on the previous work, this study aimed to determine the degree of overuse for 20 previously published measures within the pediatric population of the MHS, as well as compare DC and PC systems for use of LVC. Results are expected to inform discussion of current plans to restructure the MHS, particularly the proposed shift of care for non-active duty beneficiaries including children to the civilian purchased care sector .
Data source and study design
We conducted a cross-sectional analysis of the 2015 Military Health System Data Repository (MDR) claims database. The MDR captures both encounter and claims data of care delivered at Military Treatment Facilities (MTFs/direct care) and at civilian fee-for-service facilities (purchased care) covered by TRICARE. TRICARE is the MHS insurance product, which provides universal coverage to approximately 9.4 million members. TRICARE beneficiaries include 20% active-duty military personnel and 80% retirees or family members, and are likely representative of the U.S. population under age 65 [13,14,15,16]. TRICARE does not include care delivered in combat zones, or through Veterans Affairs (VA) hospitals which are part of a separately administered system. TRICARE data have previously been employed in several studies designed to evaluate the quality of healthcare delivery in a variety of clinical contexts including surgical care, women’s health and pediatrics [17,18,19].
Utilizing the Defense Enrollment Eligibility Reporting System (DEERS), this study identified 1,111,534 children and adolescents aged 0 to 18 years old, who were dependents of active duty and retired service members, and dependent survivors; and enrolled in TRICARE Prime benefits for the full 2015 fiscal year. As the MHS follows the Federal fiscal year calendar, the selection of dates for analysis includes October 1, 2014-September 30, 2015, and does not include the ICD-10-CM transition in October 2015. Selecting children who were dependents of active duty and retired service members, and dependent survivors ensured the study population would consistently utilize the MHS, and also eliminated the possibility of the older population (those aged 17 and 18) having enlisted status as either active duty or reservists and National Guard service members.
Construction of low-value service measures
We adopted all 20 LVC measures in pediatric services developed by Chua et al. (2016) and which are reported here exactly as previously described . No license was required in order to use this tool. Eleven of these measures were tests (6 diagnostic and 5 imaging), and the remainder were pharmaceuticals [11, 20]. Pharmaceutical codes for this study were adapted from the Market Scan therapeutic codes as used by Chua et al., and assessed in the MDR according to their American Hospital Formulary Service (AHFS) identification, as shown in Additional file 1. Because many measures reported by Chua, et al. (2016) excluded children with specific diagnosis or procedure codes in previous claims, we used the fiscal year 2014 MDR records as a “look-back period” for the identification of LVC measures in fiscal year 2015. Due to the unavailability of exact birth date in the datasets, this study was not able to exclude infants aged < 90 days or neonates aged <= 28 days, and reduced the exclusion criteria to include all infants aged 0 years. This will only influence Measure 3, Testing for Respiratory Syncytial Virus (RSV) in Children with Bronchiolitis, and Measure 8, Ultrasound in Children with Cryptorchidism. We used the narrow, more specific versions of the measures developed by Chua et al. (2016) .
We calculated the proportion of children eligible for the measure who received the service at least once during fiscal year 2015, the number of services received per 100 eligible children, the proportion of children in the overall sample who received the service at least once during fiscal year 2015, and the proportion of children in the overall sample who received at least 1 of the 20 low value services during fiscal year 2015. In order to compare LVC measures in direct care vs. purchased care, patients were identified by the following criteria: 1) patients were assigned to direct or purchased care based on whether their primary care manager was in direct or purchased care, 2) those without a primary care manager were excluded, and 3) those who received any care in both direct and purchased care during fiscal year 2015 were excluded. Among children eligible for each measure, logistic regressions, adjusted by age and gender, were performed to compare the likelihood LVC in direct vs. purchased care. Due to the measure constructs and pharmacy data elements, we were unable to make comparisons in two measures (12: Cough and cold medications in children under 6 years, and 20: Acid blockers for infants with uncomplicated gastroesophageal reflux). All analyses were performed using SAS version 9.4 (SAS Institute, Inc., Cary, NC). The work was found exempt by the Institutional Review Board of the Uniformed Services University of the Health Sciences.
Our study identified 1,111,534 eligible children (Table 1). Slightly more than 50% were male and 49% were female. The children were almost evenly split between the three age categories (0–5 year, 6–12 years, and 13–18 years) at 32.7, 37, and 30.3% respectively. In terms of primary care network, 68% of children were registered to the Direct Care setting and 31.5% were registered to receive care at civilian clinics and facilities in the Purchased Care setting.
All 20 measures of low value care were found in the MDR (Table 2). As seen in Table 2, the number of children receiving each test, procedure, or treatment varied from 39 for neuroimaging in simple febrile seizures, to 108,574 for cough and cold medications in children under 6 years. Per 100 children in denominator, the lowest rate of use was sinus imaging for children with acute sinusitis (0.19) and the greatest rate of use was oral antibiotics for acute otitis media with effusion (41.32). Overall, 15.41% of children in our study population received at least one indicator of low-value care by the narrow measure constructs, and a total of 1,106,366 children from our study population were the eligible for the comparison analysis of direct (n = 755,741) vs. purchased care (n = 350,625).
This study also compared results from DC vs PC (Table 3). Six services were significantly more likely in direct care, with the greatest differences observed in blood tests in children with simple febrile seizure (AOR = 24.44, 95% CI = 5.49–108.82) and testing for respiratory syncytial virus (RSV) in children with bronchiolitis (AOR = 21.01, 95% CI = 12.23–36.10). The service with the lowest odds of occurrence in direct care was cervical cancer screening with HPV test, or Papanicolau test (Pap smear) in children (AOR = 0.07, 95% CI = 0.05–0.09). Two services showed no statistical difference: ultrasound in children with cryptorchidism (AOR = 0.68, 95% CI = 0.44–1.06) and neuroimaging in children with simple febrile seizure (AOR = 1.42, 95% CI = 0.37–5.42). All measures of inappropriate antibiotic prescribing practices (measures 13 to 17) were least likely to occur in direct care, with the lowest odds observed in oral antibiotics for tonsillectomy (AOR = 0.14, 95% CI = 0.08–0.25).
In this study, 1 in 7 MHS children received at least one of 20 low-value services during fiscal year 2015. Rates of low-value service use differed according to whether care was delivered in direct versus purchased care, with 6 services significantly more likely to be delivered in direct care and 10 services significantly more likely to be delivered in purchased care. A greater difference in antibiotic prescription practices was also observed, with all 5 services more likely to be received in purchased versus direct care.
The MHS, due to its bifurcated structure, enables a comparison of the provision of care under different payment models, and is especially relevant to discussions of the MHS transition to a high-reliability organization focused on value-based care. Simultaneously, the MHS is planning to reduce the numbers of its uniformed providers, including those providing pediatric care, by 17,000 positions in order to fulfill priorities focused on military readiness . Such changes would shift the vast majority of pediatric services for TRICARE beneficiaries to purchased care. In this context, the discussion of low-value pediatric care is both timely and relevant, as it provides an opportunity to reduce costly care that provides no benefit, reduce harm to patients, and repurpose existing resources for more efficient and appropriate use of care. Therefore, this study informs discussion by identifying opportunities to improve pediatric care across the MHS, and evaluating differences in low-value pediatric care between the DC and PC environments.
We found that six low-value procedures are significantly more likely to be provided in direct care: skin prick or IgE blood test for atopic dermatitis, testing for RSV in children with bronchiolitis, blood tests for simple febrile seizure, face or nose radiograph for children with head or face trauma, sinus imaging in children with acute sinusitis, and short-acting beta-antagonists for bronchiolitis. The prevalence of face or nose radiographs after trauma may reflect current military focus on preventing traumatic brain injury, which originates from practice management implications in the adult population. One set of procedures, performing HPV test or Pap smear on children, was much less likely to be performed in direct vs. purchased care. The lower rate in direct care may be the result of outsourcing of care to civilian facilities rather than an overt focus on providing fewer of these procedures across the MHS.
Further insight is gained from comparing rates in the MHS to those seen in private insurance systems. Chua, et al.  reported that 9.6% of children received at least one low-value procedure during 2014. In contrast, 15.4% of children in the MHS received at least one low-value procedure during 2015. A follow-up study by Chua, et al.  found 1 in 9 publicly insured and 1 in 11 privately insured children receiving LVC in 2014, concurring with earlier findings and demonstrating relatively little difference between their two payment systems.
Significant differences in the rates of two services involving the prescription of oral antibiotics were observed in the MHS compared to publicly and privately insured children. In this study, 9.8% of the eligible population of military children received oral antibiotics for acute otitis externa, and 9.1% received oral antibiotics after tonsillectomy. These rates are significantly lower than those found by Chua, et al. (2020) in publicly and privately insured children, with 25.3% of publicly insured and 24.3% of privately insured children receiving oral antibiotics for acute otitis externa, and 29.0% of publicly insured and 27.5% of privately insured children receiving oral antibiotics after tonsillectomy.
Another notable difference was found in the prescription of cough and cold medicines. In this study, 30% of the eligible population of military children received one or more cough or cold medicines during the study period, in contrast to the previously-reported 8.5% of publicly insured and 3.2% of privately insured children [11, 20]. A review of coding indicates that this is a true difference and not due to different definitions of these medications between studies. Although the reason for this difference cannot be determined from the data set, it may be due to the availability of these medications in the MHS formulary, in which they can be obtained at no cost to the patient when obtained at a Military Treatment Facility or at a very low co-payment at a networked pharmacy, vs. other systems in which the patient bears some cost in obtaining them from a pharmacy or as an over-the-counter product.
A notable finding is the difference in antibiotic prescription patterns between purchased and direct care. In all five cases, children in the direct care system were less likely to receive low-value antibiotic prescriptions (oral antibiotics for acute upper respiratory infection, for otitis media with effusion, for otitis externa, for bronchiolitis, and after tonsillectomy) than in the purchased care system. This is a particular concern in light of current discussions of antibiotic-resistant disease driven in part by inappropriate prescribing practices, although data did not illustrate the reason for the difference between the two care systems.
Strengths and limitations
There are several notable strengths in this investigation. The population is comprised of a large number of children and adolescents (n = 1,111,534) who receive care through universal insurance, and as such, may provide a model for practice patterns in the setting of insurance expansion in the greater US population. Additionally, the provision of care through different practice environment presents opportunities to examine the effect of fixed-fee (direct care) or fee-for-service (purchased care) payment models on the delivery of low-value care. Notably for this study, it appears that low-value pediatric care is provided with variation between the fixed-fee vs. fee-for-service system, with greater use of low-value antibiotic treatment taking place in the purchased care sector. This is in similar to previous studies in the MHS adult population which showed utilization of less-invasive procedures, and greater adherence to treatment guidelines, in direct care [10, 16, 21, 22]. Our current findings suggest that current plans to shift pediatric health services in the MHS to purchased care may result in an increase in the use of some low value services while increasing the inappropriate use of antibiotics.
We also recognize several limitations in this work. First, the use of administrative data renders it susceptible to any errors in coding at the provider level, and does not capture the nuances of care in which use of low value procedures may be clinically appropriate. Second, given the use of de-identified data, this study does not have full date of birth for its patients, so that tests provided to children in the first year of life may not be accurately captured.
Using 20 previously developed measures, this study found evidence of low-value care in pediatric health services in the MHS. Significant differences existed between the provision of low value services in direct and purchased care settings, as well as between the MHS and previous research relying on patients with private insurance. Further research is needed to understand the etiologies behind these differences. In the current period of MHS reform, as pediatric health services are increasingly shifted to the purchased care, the results of our work indicate that such policies may result in increases in low value care and associated expenditures including an increased risk of inappropriate antibiotic use.
Availability of data and materials
The data that support the findings of this study are available from the United States Defense Health Agency. Restrictions apply to the availability of these data, which were used under federal Data User Agreements for the current study, and so are not publicly available.
American Hospital Formulary Service
Adjusted Odds Ratio
Defense Enrollment Eligibility Reporting System
Department of Defense
Low Value Care
Military Health System Data Repository
Military Health System
Respiratory Syncytial Virus
Dieleman, et al. US spending on personal health care and public health, 1996–2013. JAMA. 2016;316(24):2627–46. https://doi.org/10.1001/jama.2016.16885.
Centers for Medicare & Medicaid Services. National health expenditure data: historical. https://www.cms.gov/research-statistics-data-and-systems/statistics-trends-and-reports/nationalhealthexpenddata/nationalhealthaccountshistorical.html. Accessed 13 July 2018.
Organization for Economic Co-operation and Development. OECD Health Statistics 2018 - Frequently Requested Data. OECD; 2018. http://www.oecd.org/els/health-systems/OECD-Health-Statistics-2018-Frequently-Requested-Data.xls. Accessed 28 Feb 2019.
Berwick DM, Hackbarth AD. Eliminating waste in US health care. JAMA. 2012;307(14):1513. https://doi.org/10.1001/jama.2012.362.
Morgan DJ, Brownlee S, Leppin AL, et al. Setting a research agenda for medical overuse. BMJ. 2015;351. https://doi.org/10.1136/bmj.h4534.
Chan KS, Chang E, Nassery N, Chang H-Y, Segal JB. The state of overuse measurement: a critical review. Med Care Res Rev. 2013;70(5):473–96. https://doi.org/10.1177/1077558713492202.
American Board of Internal Medicine. Choosing Wisely | Promoting conversations between providers and patients 2016. Retrieved February 14, 2016, from http://www.choosingwisely.org/.
Schwartz AL, Landon BE, Elshaug AG, Chernew ME, McWilliams JM. Measuring low-value care in Medicare. JAMA Intern Med. 2014;174(7):1067–76.
Segal JB, Bridges JFP, Chang HY, et al. Identifying possible indicators of systematic overuse of health care procedures with claims data. Med Care. 2014;52(2):157–63. https://doi.org/10.1097/MLR.0000000000000052.
Koehlmoos T, Koehlmoos T, Madsen C, Banaag A, Haider A, Schoenfeld A, Weissman J. Assessing low-value health services in the military health system. Health Aff. 2019;38(8):1351–7.
Chua K, Schwartz AL, Volerman A, et al. Use of low-value pediatric services among the commercially insured. Pediatrics. 2016;138(6):e20161809.
Office of the Undersecretary of Defense for Personnel and Readiness. Report to the Congressional Defense Committees. "Restructuring and Realignment of Military Medical Treatment Facilities." Pub. L. No 114–328. 19 February, 2020.
Zogg CK, Jiang W, Chaudhary MA, Scott JW, Shah AA, Lipsitz SR, Weissman JS, Cooper Z, Salim A, Nitzschke SL, Nguyen LL, Helmchen LA, Kimsey L, Olaiya ST, Learn PA, Haider AH. Racial disparities in emergency general surgery: do differences in outcomes persist among universally insured military patients? J Trauma Acute Care Surg. 2016;80(5):764–77. https://doi.org/10.1097/TA.0000000000001004.
Schoenfeld AJ, Makanji H, Jiang W, Koehlmoos T, Bono CM, Haider AH. Is there variation in procedural utilization for lumbar spine disorders between a fee-for-service and salaried healthcare system? Clin Orthop Relat Res. 2017;475:2838–44. https://doi.org/10.1007/s11999-017-5229-5.
Schoenfeld AJ, Jiang W, Harris MB, et al. Association between race and postoperative outcomes in a universally insured population versus patients in the state of California. Ann Surg. 2017;266(2):267–73. https://doi.org/10.1097/SLA.0000000000001958.
Schoenfeld AJ, Kaji AH, Haider AH. Practical guide to surgical data sets: military health system Tricare encounter data. JAMA Surg. 2018;153(7):679–80. https://doi.org/10.1001/jamasurg.2018.0480.
Chaudhary MA, Leow JJ, Mossanen M, Chowdhury R, Jiang W, Learn PA, Weissman JS, Chang SL. Patient driven care in the management of prostate cancer: analysis of the United States military healthcare system. BMC Urol. 2017;17(1):56.
Ranjit A, Jiang W, Zhan T, Kimsey L, Staat B, Witkop CT, Little SE, Haider AH, Robinson JN. Intrapartum obstetric care in the U.S. Military: Comparison of military and civilian systems within TRICARE. Birth. 2017. https://doi.org/10.1111/birt.12298.
Madenci AL, Armstrong LB, Kwon N, Jiang W, Wolf LL, Koehlmoos TP, Ricca RL, Weldon CB, Haider AH, Weil BR. Incidence and risk factors for sepsis after childhood splenectomy. J Pediatr Surg. 2018. https://doi.org/10.1016/j.jpedsurg.2018.06.024 [Epub ahead of print].
Chua K-P, Schwartz AL, Volerman A, Conti RM, Huang ES. Differences in the receipt of low-value services between publicly and privately insured children. Pediatrics. 2020;145(2):e20192325. https://doi.org/10.1542/peds.2019-2325 Epub 2020 Jan 7.
Nguyen LL, Smith AD, Scully RE, Jiang W, Learn PA, Lipsitz SR, Weissman JS, Helmchen LA, Koehlmoos T, Hoburg A, Kimsey LG. Provider-induced demand in the treatment of carotid artery stenosis: variation in treatment decisions between private sector fee-for-service vs salary-based military physicians. JAMA Surg. 2017;152(6):565–72.
Dietrich E, Santiago C, Leroux T, Helgeson M, Richard P, Koehlmoos T. Assessing practice pattern differences in the treatment of acute low back pain in the United States military health system. BMC Health Serv Res. 2018;18(1):720. https://doi.org/10.1186/s12913-018-3525-8.
We acknowledge the work of Dr. Kao-Ping Chua and team, whose tool describing 20 measures of low-value pediatric care we adapted in full, and which are reported here exactly as written. No license was required in order to use this tool.
This study was funded through the Comparative Effectiveness and Provider-Induced Demand Collaboration (EPIC) / Low-Value Care in the National Capital Region Project, by the United States Defense Health Agency, Grant # HU0001-11-1-0023. The funding agency played no role in the design, analysis, or interpretation of findings. The contents, views or opinions expressed in this presentation are those of the author(s) and do not necessarily reflect official policy or position of Uniformed Services University of the Health Sciences, the Department of Defense, or Departments of the Army, Navy, or Air Force, or the Henry M. Jackson Foundation for the Advancement of Military Medicine, Inc. Mention of trade names, commercial products, or organizations does not imply endorsement by the U.S. Government.
Ethics approval and consent to participate
Due the secondary analysis of existing, de-identified data, this study was deemed exempt from human subjects review by the Institutional Review Board of the Uniformed Services University of the Health Sciences. Because of these conditions, written consent to participate, including by parents or guardians for children under 18, is not applicable. Permission and conditions for use of these data were granted by the United States Defense Health Agency.
Consent for publication
Due to the secondary analysis of de-identified data, consent for publication is not applicable.
The authors declare that we have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Koehlmoos, T.P., Madsen, C., Banaag, A. et al. Use of low-value pediatric services in the Military Health System. BMC Health Serv Res 20, 770 (2020). https://doi.org/10.1186/s12913-020-05640-5
- Low-value care
- Child health
- Military health system
- Big data