Payer leverage and hospital compliance with a benchmark: a population-based observational study
BMC Health Services Research volume 7, Article number: 112 (2007)
Since 1976, Medicare has linked reimbursement for hospitals performing organ transplants to the attainment of certain benchmarks, including transplant volume. While Medicare is a stakeholder in all transplant services, its role in renal transplantation is likely greater, given its coverage of end-stage renal disease. Thus, Medicare's transplant experience allows us to examine the role of payer leverage in motivating hospital benchmark compliance.
Nationally representative discharge data for kidney (n = 29,272), liver (n = 7,988), heart (n = 3,530), and lung (n = 1,880) transplants from the Nationwide Inpatient Sample (1993 – 2003) were employed. Logistic regression techniques with robust variance estimators were used to examine the relationship between hospital volume compliance and Medicare market share; generalized estimating equations were used to explore the association between patient-level operative mortality and hospital volume compliance.
Medicare's transplant market share varied by organ [57%, 28%, 27%, and 18% for kidney, lung, heart, and liver transplants, respectively (P < 0.001)]. Volume-based benchmark compliance varied by transplant type [85%, 75%, 44%, and 39% for kidney, liver, heart, and lung transplants, respectively (P < 0.001)], despite a lower odds of operative mortality at compliant hospitals. Adjusting for organ supply, high market leverage was independently associated with compliance at hospitals transplanting kidneys (OR, 143.00; 95% CI, 18.53 – 1103.49), hearts (OR, 2.84; 95% CI, 1.51 – 5.34), and lungs (OR, 3.24; 95% CI, 1.57 – 6.67).
These data highlight the influence of payer leverage–an important contextual factor in value-based purchasing initiatives. For uncommon diagnoses, these data suggest that at least 30% of a provider's patients might need to be "at risk" for an incentive to motivate compliance.
Recently, an article in the Los Angeles Times cited that "about a fifth of federally funded (heart, liver, and lung) transplant programs fail to meet the government's minimum standards" and "perform too few operations to ensure competency" . After being picked up by the Associated Press and several other major media outlets, the Times' article garnered the attention of Senator Charles Grassley (Chairman of the Senate Finance Committee), prompting him to begin a federal inquiry. Senator Grassley "has ordered investigations (and) demanded answers after ... reports detailing dangerous lapses in oversight of the national transplantation system." . In response, Dr. Mark McClellan, a former senior administrator for the Centers for Medicare and Medicaid Services, has spoken out in defence of Medicare's transplant monitoring program . Currently, empirical data addressing the concerns germane to this emerging policy debate are lacking.
Medicare's "minimum standards" for transplant programs, and issues surrounding hospital compliance with these benchmarks, have been in existence for thirty years. Since 1976, hospitals performing kidney transplants under the Medicare program have been required to meet benchmarks for accreditation, including kidney transplant volume . With its successive coverage announcements for heart, liver, and lung transplants [5–7], Medicare has mandated similar volume standards, thereby linking benchmarking to reimbursement for all major solid organ transplants. However, as the Times' report illustrates, hospital compliance with these benchmarks varies widely . Even prior to the recent media attention, concerns have been raised regarding the appropriateness of Medicare's standards and a possible lack of rigorous transplant program supervision . These factors may explain, in part, the observed low rates of hospital compliance. Another important contextual factor may be Medicare's leverage with hospitals as a payer of transplantation services to promote compliance (i.e., payer market leverage).
Under the 1972 Social Security Act Amendments, Medicare guaranteed coverage to all patients with chronic renal failure requiring hemodialysis . These benefits extend to kidney transplant services, as well. Thus, Medicare's stake in kidney transplantation is significant. However, no such entitlement presently exists for patients with other chronic disease states that commonly lead to organ transplantation; therefore, Medicare's payer market leverage is expected to be lower for other organ sites.
For this reason, we examined hospital transplant program compliance with Medicare's volume-based criteria, as well as the relationship between Medicare's market leverage and hospital benchmark compliance using national discharge data. Because payer market leverage is a likely determinant of the effectiveness of contemporary pay-for-performance programs [10–12], the Medicare experience has implications beyond the current debate surrounding transplant programs. As the ability of value-based purchasing initiatives to improve healthcare quality relies on provider compliance, this study provides empirical data that characterize the relationship between leverage and compliance.
Data from the Healthcare Cost and Utilization Project's Nationwide Inpatient Sample (NIS) between years 1993 and 2003 were used in this analysis. The NIS is a 20% stratified sample of all hospital discharges in the U.S. and consists of uniform hospital discharge summaries from non-federal acute-care hospitals throughout the U.S. . It is a useful dataset for multi-year longitudinal studies. To date, more than 25 manuscripts have been published using multiple years of the NIS that cover a breadth of healthcare topics, including solid organ transplantation [14–17]. In accordance with the Code of Federal Regulations Title 45 Subpart A Section 46.101 paragraph b subparagraph 4, Institutional Review Board approval was waived for this study.
Using International Classification of Disease, 9th Revision, Clinical Modification (ICD-9) procedure codes, we identified patients undergoing kidney (55.6, 55.69), liver (50.5, 50.51, 50.59), heart (33.6, 37.5), lung (33.5, 33.50, 33.51, 33.52), and combined heart-lung (33.6) transplants. Because Medicare has separate participation requirements for pediatric transplant programs, subjects under 18 years of age were excluded. Based upon this sampling methodology, a cohort was identified consisting of 29,272 kidney, 7,988 liver, 3,530 heart, and 1,880 lung transplants that were performed at 173, 88, 100, and 66 hospitals, respectively. Data on patient demographics (age, gender, race/ethnicity, admission acuity, diagnosis codes and primary payer) and hospital characteristics (teaching, profit, and proprietary status, urban/rural location, geographic census region, and hospital bed capacity) were also abstracted from the NIS. Secondary ICD-9 diagnosis codes were used to identify a set of 30 comorbidities as described by Elixhauser .
After aggregating data on each transplant recipient's primary payer to the hospital-level, a binary variable was constructed, identifying those hospitals performing transplants with a high proportion of Medicare patients. The literature suggests that an incentive applying to less than 15% to 20% of a provider's patients is unlikely to alter provider behavior ; therefore, an indicator variable was constructed to identify hospitals where 20% of transplants, by type, were reimbursed through Medicare and thereby distinguish those hospitals in which Medicare had low vs. high market leverage.
To estimate the supply of available donor organs, each hospital performing transplants was assigned to one of the 11 U.S. regions created by the United Network for Organ Sharing (UNOS), based on the hospital's two-letter state postal code as provided by the NIS. Data from UNOS on the number of donors recovered in the U.S. by organ type  were then merged with the study population files on UNOS region and year.
Ascertainment of hospital volume compliance
The number of transplant procedures performed at each hospital was ascertained using a unique hospital identification code. Based on Medicare's coverage announcement for lung transplants , combined heart-lung transplants were counted toward both the heart and lung case volume totals for an individual hospital. Each hospital was assigned a volume for each year it participated. Each individual hospital-year was considered independently. Binary variables were then constructed indicating whether the hospital-year was compliant with Medicare's volume benchmark for each transplant type. The hospital-year volumes and binary volume compliance variables were then assigned to the discharge records that emanated from them. This was done for each transplant type, using those minimum volume requirements specified in the Federal Register. Specifically, hospitals were required to perform a minimum of 15, 12, 12, and 10 kidney, liver, heart, and lung transplants, respectively, over a 12-month period for Medicare approval [4–7].
The primary outcomes for this study were the proportion of hospitals performing transplants compliant with Medicare's volume criteria and patient-level operative mortality, defined as death prior to hospital discharge.
With the hospital-year as the unit of analysis, bivariate comparisons were performed for volume compliant and non-compliant hospitals based on transplant procedure strata. These comparisons focused on hospital structural attributes, as well as the clinical characteristics of their patients. T-tests were performed for continuous variables, and chi-square tests were performed for categorical variables.
The relationship between hospital volume compliance and Medicare market share was examined through logistic regression techniques with the use of robust variance estimates to adjust for potential cluster effects . The concern for cluster effects arose because of the potential for a hospital to be included in a multiple number of years, which could induce a correlation and would require adjustment.
For these models, the unit of analysis was the hospital-year. The outcome was CMS volume benchmark compliance. The exposure was high Medicare market leverage (the binary variable described above). Given the well-documented regional variation in transplantation , these models were adjusted for donor organ supply, introduced as a continuous count. The count of donor organ supply was UNOS-region specific, into which each hospital was sorted. These models were also adjusted for hospital case mix. For this, patient-level data were aggregated to the hospital level in order to derive a mean count of the Elixhauser codes  specific for the four different transplant procedures, which described each hospital's "typical" patient.
Medicare's coverage announcement for lung transplants was made in 1995 . This allowed for a secondary analysis, in which the odds of volume compliance as a function of Medicare's market share were compared prior to (1993 to 1994) and after (1995 to 2003) the specification of minimum caseloads.
Next, the relationship between patient-level operative mortality and hospital volume compliance was examined using generalized estimating equations (GEE). Given that not all of the hospitals were represented in multiple years of our sampling frame, the data did not represent a true panel structure. However, there was potential correlation between observations as patients were clustered within hospitals. Therefore, GEE models with a logit link and an exchangeable correlation matrix were fitted to produce a population-averaged odds ratio (OR) and a robust estimator to correct the standard errors for the potential correlation of observations within hospitals .
For our analysis of operative mortality (outcome), our unit of analysis was at the patient level. Our exposure was hospital-level volume benchmark compliance. Each model was adjusted for patient age, gender, race, comorbidity, and insurance type, as well as treatment year, teaching status, for-profit status, ownership, hospital bed capacity and census region. Case-mix adjustment was accomplished using a subset of the Elixhauser comorbidity flags , in which those comorbidities directly related to the principal diagnosis were removed.
In addition to the analysis using these basic GEE models, sensitivity analyses were conducted to test the potential affect of several assumptions. In particular, hospital participation in the NIS varies by year with some hospitals included in multiple years. Specifically, 111, 54, 60, and 40 hospitals performing kidney, liver, heart, and lung transplants were sampled in multiple years. To determine whether those with more frequent participation had an undue influence on the results, a dataset was constructed that included a randomly selected year of data only for those hospitals that were sampled multiple times as part of the NIS sampling frame. The operative mortality analyses were then repeated using this new dataset. Since the results remained consistent across these analyses, only those results from the primary GEE models are reported. All statistical analyses were two-tailed, with a 5% significance level, and were conducted using Stata version 9.0 (Stata Corp, College Station, Texas).
Over the study interval, Medicare was the primary payer for 57% of kidney, 28% of lung, 27% of heart, and 18% of liver transplants (P < 0.001). The proportion of hospitals compliant with Medicare's volume benchmarks varied by transplant type, ranging from as low as 24% of hospitals performing lung transplants in 1995 to as high as 96% of hospitals performing kidney transplants in 2003. Average compliance for hospitals performing kidney transplants was 85%, 75% for liver transplants, 44% for heart transplants, and 39% for lung transplants (P < 0.001). Temporal changes in volume compliance status stratified by transplant type are depicted in Figure 1. Patients receiving kidney transplants at volume compliant hospitals were generally older, and a higher proportion were male when compared to those treated at non-compliant hospitals (Table 1). A higher proportion of volume compliant kidney and liver transplant hospitals were teaching facilities with a larger bed capacity than non-compliant hospitals (Table 2).
Further, high Medicare market leverage was found to be independently associated with hospital volume compliance for hospitals performing kidney [OR, 143.00; 95% confidence interval (CI), 18.53–1103.49], heart (OR, 2.84; 95% CI, 1.51 – 5.34), and lung (OR, 3.24; 95% CI, 1.57 – 6.67) transplants. A similar association, although not statistically significant (OR, 1.87; 95% CI, 0.87 – 4.04), was found for hospitals performing liver transplants. For those years of the study interval (1993 to 1994) during which no lung transplant minimum caseloads were specified, the OR for volume compliance was 1.38 (95% CI, 0.15 – 12.66). Following Medicare's coverage announcement, the OR rose to 3.73 (95% CI, 1.70 – 8.19).
Unadjusted operative mortality rates were 1% for kidney, 9% for liver, 9% for heart, and 11% for lung transplants. Results from the adjusted models are presented in Tables 3, 4, 5, 6. Patients undergoing liver transplantation at non-compliant hospitals had a significantly greater risk of operative mortality (OR, 1.50; 95% CI, 1.12 – 2.02), even after adjustment for age, gender, race, comorbidity status, treatment year, and insurance type. A trend toward greater operative mortality risk was also observed for non-compliant hospitals performing kidney, heart, and lung transplantation, although these results did not reach statistical significance.
Consistent with lay press reports, we have demonstrated substantial hospital non-compliance with Medicare's volume-based benchmarks for heart and lung transplant programs. We found that benchmark compliance varies by transplant type despite the fact that patients undergoing liver transplantation at volume compliant hospitals have lower odds of operative mortality. Importantly, benchmark compliance was observed to vary with Medicare's market share for each organ type, with compliance being greatest among hospitals performing kidney transplants, where Medicare was the primary payer for 57% of discharges. In contrast, benchmark compliance was lowest for lung transplantation, a procedure where Medicare was the primary payer for only 28% of cases.
Medicare's policy for transplant programs is predicated on the assumption that hospital compliance with volume standards will translate into better patient outcomes. Along this line of thinking, Medicare has linked both transplant program accreditation and procedural reimbursement to the attainment of its benchmarks. While Medicare's volume thresholds were initially set without any evidence base, substantial literature has since been published documenting higher mortality after selected high risk procedures, including organ transplantation, at low-volume centers [23–27]. Despite this, these data suggest that even the combination of a valid benchmark and a powerful incentive (accreditation and reimbursement in this case) may be insufficient to ensure uniform hospital/provider compliance.
Accordingly, these data highlight the importance of other contextual factors (e.g., payer leverage) on the success of performance-based incentive programs. Efforts to motivate providers through financial incentives are thought to have a limited effect unless the payer promoting the incentive program represents a substantial proportion of the provider's practice [11, 12]. It is estimated that an incentive program applying to less than 15% to 20% of a provider's patient panel is unlikely to induce provider response . For infrequent diagnoses and procedures–heart and lung transplants in this study–these data suggest that such leverage may be inadequate to motivate change.
These findings must be considered in the context of several limitations. To begin, donor organs represent a scarce commodity with a relatively fixed supply and an inelastic demand . As such, concerns surround not only the attainability of Medicare's volume benchmarks, but also Medicare's ability to leverage its market share to affect hospital compliance. With an estimated 14,000 kidney, 5,000 liver, 2,000 heart, and 1,000 lung transplants performed annually  at 244 kidney, 123 liver, 135 heart, and 68 lung transplant centers nationwide , Medicare's volume thresholds would appear reasonable if the distribution of donor organ supply was equitable across centers.
Second, in this study, high Medicare market share was independently associated with higher odds of compliance, even after adjustment for regional donor organ supply. However, our adjustment for supply alone may be imperfect, as compliance among hospitals performing liver transplantation, for which Medicare has the smallest market share, was similar to that of kidney transplantation rather than heart or lung transplantation. This indicates that there may be other factors influencing the caseload size for hospitals (e.g., the number of patients with end stage renal disease in the nearby area). Nevertheless, this study highlights the interplay between market share and supply as potential determinants of compliance with volume-based benchmarks.
A third limitation concerns this study's observational design. Given the inherent endogeneity of the data, the directionality of the association between Medicare market share and hospital compliance cannot be directly discerned. For example, what we have interpreted as a leverage effect may instead be a selection effect. However, these data do suggest a trend towards increasing compliance across transplant types following Medicare's successive transplant coverage decisions (Figure 1) [4–7]. Further, we are reassured by the results from our secondary analysis in which we examined the relationship between compliance and Medicare market share for lung transplants in the absence of a minimum threshold.
Fourth, transplant-relevant clinical endpoints are limited within these administrative data. While alternative transplant outcomes (e.g., incidence of delayed graft function and graft survival) would have made this analysis richer, we could only examine the clinical and resource use information included in a typical discharge abstract. Moreover, our primary measure, operative mortality, is an infrequent event, particularly following kidney transplant . Though a significant difference in patient mortality for liver transplantation was demonstrated at volume compliant vs. non-compliant hospitals, the ability to detect a difference for kidney, heart, and lung transplants was perhaps limited by sample size. Further investigation is, therefore, warranted to examine the effect of volume compliance on more common, long-term outcomes using clinical data.
Finally, comment can only be made on a hospital's attainment of Medicare's transplant volume benchmarks. A hospital's actual Medicare accreditation status cannot be ascertained within the NIS. Medicare requires that transplant programs undergo review every three years; however, even prior to the recent Los Angeles Times report, the Office of the Inspector General raised questions about the rigor of this oversight . A new rule change has been proposed to address these concerns , but current lack of enforcement may contribute to the relatively low compliance among heart and lung transplant programs.
This study provides a nationally representative estimate of hospital compliance with Medicare's volume criteria for transplant programs and suggests the potential influence of payer market share in motivating benchmark compliance. While others have suggested that an incentive applying to less than 15% to 20% of a provider's patient panel is unlikely to induce provider response , these findings would indicate that for infrequent diagnoses and procedures, more than 30% of provider's patients might need to be impacted by an incentive in order to motivate change. These data also have implications for Medicare's current pay-for-performance initiatives . For those public health issues that disproportionately affect patients under age 65, Medicare may lack the leverage to alter provider behavior. Given the fragmented nature of the U.S. healthcare system, multilateral efforts between Medicare and other payers may, therefore, be necessary to achieve the intended aims of specific value-based purchasing initiatives.
Weber T, Ornstein C: 20% of U.S. transplant centers are found to be substandard. Los Angeles Times. June 29, 2006
Weber T, Ornstein C: Report on transplant programs prompts inquiry by U.S. Senator. Los Angeles Times. June 30, 2006
Ornstein C: Medicare's transplant monitoring defended. Los Angeles Times. July 4, 2006
Conditions for ESRD coverage. 1976, 42 CFR 405.2130
Medicare Program: Criteria for Medicare coverage of heart transplants–HCFA. Notice of HCFA ruling. Fed Regist. 1987, 52: 10935-10951.
Medicare Program: Criteria for Medicare coverage of adult liver transplants–HCFA. Final notice. Fed Regist. 1991, 56: 15006-15018.
Medicare Program: Criteria for Medicare coverage of lung transplants–HCFA. Notice with comment period. Fed Regist. 1995, 60: 6537-6547.
Department of Health and Human Services: Medicare approved heart transplant centers. OIG Report No. OEI-01-02-00520. 2005
Rettig RA: Implementing the End-Stage Renal Disease Program of Medicare. 1980, Santa Monica: Rand
Dudley RA: Pay-for-performance research: how to learn what clinicians and policy makers need to know. JAMA. 2005, 294: 1821-1823. 10.1001/jama.294.14.1821.
Epstein AM, Lee TH, Hamel MB: Paying physicians for high-quality care. New Engl J Med. 2004, 350: 406-410. 10.1056/NEJMsb035374.
Rosenthal MB, Fernandopulle R, Song HR, Landon B: Paying for quality: providers' incentives for quality improvement. Health Aff (Millwood). 2004, 23: 127-141. 10.1377/hlthaff.23.2.127.
Houchens RL, Elixhauser A: Using the HCUP nationwide inpatient sample to estimate trends. HCUP Methods Series Report #. 2005, U.S. Agency for Healthcare Research Web site, April 30, 2005, [http://www.hcup-us.ahrq.gov/reports/methods.jsp] -01
Xiao H, Campbell ES, Song KS: A trend analysis of organ transplantation among ethnic groups. J Natl Med Assoc. 2002, 94: 15-20.
Birmkeyer JD, Siewers AE, Finlayson EV, et al: Hospital volume and surgical mortality in the United States. N Engl J Med. 2002, 346: 1128-1137. 10.1056/NEJMsa012337.
Ritchie JL, Maynard C, Chapko MK, Every NR, Martin DC: Association between percutaneous transluminal coronary angioplasty volumes and outcomes in the Healthcare Cost and Utilization Project 1993–1994. Am J Cardiol. 1999, 83: 493-497. 10.1016/S0002-9149(98)00901-1.
Konety BR, Allareddy V, Modak S, Smith B: Mortality after major surgery for urologic cancers in specialized urology hospitals: are they any better?. J Clin Oncol. 2006, 24: 2006-2012. 10.1200/JCO.2005.04.2622.
Elixhauser A, Steiner C, Harris DR, Coffey RM: Comorbidity measures for use with administrative data. Med Care. 1998, 36: 8-27. 10.1097/00005650-199801000-00004.
United Network for Organ Sharing Web site. [http://www.unos.org]
Rogers WH: Regression standard errors in clustered samples. Stata Technical Bulletin. 1992, 13: 19-23.
Ellison MD, Edwards LB, Edwards EB, Barker CF: Geographic differences in access to transplantation in the United States. Transplantation. 2003, 76: 1389-1394. 10.1097/01.TP.0000090332.30050.BA.
Chao EC: Structured correlation in models for clustered data. Stat Med. 2006, 25: 2450-2468. 10.1002/sim.2368.
Begg CB, Cramer LD, Hoskins WJ, Brennan MF: Impact of hospital volume on operative mortality for major cancer surgery. JAMA. 1998, 280: 1747-1751. 10.1001/jama.280.20.1747.
Birkmeyer JD, Finlayson SR, Tosteson AN, Sharp SM, Warshaw AL, Fisher ES: Effect of hospital volume on in-hospital mortality with pancreaticoduodenectomy. Surgery. 1999, 125: 250-256.
Axelrod DA, Guidinger MK, McCullough KP, Leichtman AB, Punch JD, Merion RM: Association of center volume with outcome after liver and kidney transplantation. Amer J Transplant. 2004, 4: 920-927. 10.1111/j.1600-6143.2004.00462.x.
Edwards EB, Roberts JP, McBride MA, Schulak JA, Hunsicker LG: The effect of the volume of procedures at transplantation centers on mortality after liver transplantation. New Engl J Med. 1999, 341: 2049-2053. 10.1056/NEJM199912303412703.
Hosenpud JD, Breen TJ, Edwards EB, Daily OP, Hunsicker LG: The effect of transplant center volume on cardiac transplant outcome. A report of the United Network for Organ Sharing Scientific Registry. JAMA. 1994, 271: 1844-1849. 10.1001/jama.271.23.1844.
Ojo AO, Heinrichs D, Emond JC, McGowan JJ, Guidinger MK, Delmonico FL, Metzger RA: Organ donation and utilization in the USA. Amer J Transplant. 2004, 4 (Suppl): 27-37. 10.1111/j.1600-6135.2004.00396.x.
Organdonor.gov Web site. [http://www.organdonor.gov]
Scientific Registry of Transplant Recipients Web site. [http://www.ustransplant.org]
Hospital conditions of participation: Requirements for approval and re-approval of transplant centers to perform organ transplants. 42 CFR Parts 405, 482, and 488 (proposed). 2005
Centers for Medicare and Medicaid Services Web site. [http://www.cms.hhs.gov/HospitalQualityInits/35_HospitalPremier.asp]
The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1472-6963/7/112/prepub
JH is supported by an NIH research training grant (T32 DK007758). The NIH had no role in the design and conduct of the study; collection, management, analysis, and interpretation of the data; and preparation, review, or approval of the manuscript.
The author(s) declare that they have no competing interests.
JH participated in the this study's conception and design, the acquisition of data, the analysis and interpretation of data, drafting of the manuscript, critical revision of the manuscript, and all of the statistical analyses. SL participated in the analysis and interpretation of data, drafting of the manuscript, critical revision of the manuscript, all statistical analyses, and supervision of this study. DM participated in this study's conception and design, the interpretation of data, and critical revision of the manuscript. SD participated in the analysis and interpretation of data, critical revision of the manuscript, and all statistical analyses. BH participated in this study's conception and design, the acquisition of data, analysis and interpretation of data, drafting of the manuscript, critical revision of the manuscript, administrative and technical support, and supervision of this study.
John M Hollingsworth, Sarah L Krein, David C Miller, Sonya DeMonner contributed equally to this work.
Authors’ original submitted files for images
Below are the links to the authors’ original submitted files for images.
About this article
Cite this article
Hollingsworth, J.M., Krein, S.L., Miller, D.C. et al. Payer leverage and hospital compliance with a benchmark: a population-based observational study. BMC Health Serv Res 7, 112 (2007). https://doi.org/10.1186/1472-6963-7-112
- Lung Transplant
- Nationwide Inpatient Sample
- Transplant Program
- Generalize Estimate Equation Model
- Primary Payer