Identifying individual hospital levels of maternal care using administrative data

Abstract

Background

The goal of regionalized perinatal care, specifically levels of maternal care, is to improve maternal outcomes through risk-appropriate obstetric care. Studies of levels of maternal care are limited by current approaches to identify a hospital’s level of care, often relying on hospital self-reported data, which is expensive and challenging to collect and validate. The study objective was to develop an empiric approach to determine a hospital’s level of maternal care using administrative data reflective of the patient care provided and apply this approach to describe the levels of maternal care available over time.

Methods

Retrospective cohort study of mother-infant dyads who delivered in California, Missouri, and Pennsylvania hospitals from 2000 to 2009. Linked mother-infant administrative records with an infant born at 24–44 weeks’ gestation and a birth weight of 400–8000 g were included. Using the American College of Obstetricians and Gynecologists and the Society for Maternal Fetal Medicine descriptions of levels of maternal care, four levels were classified based on the appropriate location of care for patients with specific medical or pregnancy conditions. Individual hospitals were assigned a level of maternal care annually based on the volume of patients who delivered reflective of the four classified levels as determined by International Classification of Diseases and Current Procedural Terminology.

Results

Based on the included 6,895,000 mother-infant dyads, the obstetric hospital levels of maternal care I, II, III and IV were identified. High-risk patients more frequently delivered in hospitals with higher level maternal care, accounting for 8.9, 10.9, 13.8, and 16.9% of deliveries in level I, II, III and IV hospitals, respectively. The total number of obstetric hospitals decreased over the study period, while the proportion of hospitals with high-level (level III or IV) maternal care increased. High-level hospitals were located in more densely populated areas.

Conclusion

Identification of the level of maternal care, independent of hospital self-reported variables, is feasible using administrative data. This empiric approach, which accounts for changes in hospitals over time, is a valuable framework for perinatal researchers and other stakeholders to inexpensively identify measurable benefits of levels of maternal care and characterize where specific patient populations receive care.

Introduction

One approach to address issues in maternal health, such as the rising maternal mortality rates [1] and burden of severe maternal morbidity [2], is to improve the regionalization of perinatal care. The goal of regionalization is “to improve patient outcomes by directing patients to facilities with optimal capabilities for a given type of illness or injury” [3]. Hospital levels of care, a fundamental aspect of regionalization, describe the types of hospital-based services available to patients, which in turn describes the types of patients who can be adequately cared for at a certain hospital. Motivated by the American Academy of Pediatrics (AAP) levels of neonatal care, which have been associated with improved neonatal outcomes [4,5,6,7,8,9,10], levels of maternal care were first published in the United States (US) by the American College of Obstetricians and Gynecologists (ACOG) and the Society for Maternal-Fetal Medicine (SMFM) in 2015 and updated in 2019 [11, 12]. The ACOG/SMFM statement describes level I care as basic care, level II as specialty care, level III as subspecialty care, and level IV as care provided in Regional Perinatal Health Care Centers [11, 12].

However, the level of maternal care provided at individual hospitals is currently not easily accessible or publicly available. While some states in the US have active levels of maternal care verification programs, these programs are resource intensive requiring significant time and financial support. Most research studies depend on hospital self-reported measures, such as those from research surveys, the American Hospital Association (AHA) annual survey, or the Centers for Disease Control and Prevention’s Levels of Care Assessment Tool (CDC LOCATe), to determine the available level of maternal care [13,14,15,16]. These self-report measures, though, are often overstated by hospitals [17]. Thus, the level of care based on the characteristics of patients who actually received care in a given hospital may more accurately reflect the level of care available. To advance perinatal regionalization research, knowledge of associated patient outcomes, and optimize risk-appropriate care delivery, alternate approaches to ascertain the level of maternal care provided at hospitals is needed.

The objective of this study was to develop an empiric approach to determine the level of maternal care available at a hospital using administrative data reflective of the patient care provided. The secondary objective was to apply this approach to describe available levels of maternal care over time. To achieve these objectives, we leveraged a cohort of almost seven million linked mother-infant administrative records reflecting all births in California, Missouri, and Pennsylvania between 2000 and 2009. This study provides an alternate framework for level of care determination, new insights into how available levels of maternal care change over time, and data to inform future research regarding levels of maternal care.

Materials and methods

Study design

This is a retrospective, population-based cohort study of hospital-based deliveries in California, Missouri, and Pennsylvania from January 1, 2000 to December 31, 2009 using linked state-level hospital administrative data, birth certificates, and death certificates. California, Missouri, and Pennsylvania were chosen given the availability of valid, accessible, mother-infant linked data, representing diverse populations, and different perinatal care systems. The state-level hospital administrative data includes data on all hospital discharges including International Classification of Diseases (ICD) and Current Procedural Terminology (CPT) codes associated with the hospitalization. Birth and death certificates contain validated variables including birth weight, gestational age, mode of delivery [18], race/ethnicity [19], and insurance [20].

Linkage of mother-infant data was performed by the individual states prior to data distribution. Using previously published methods, the mother-infant match rate was 94% [21]. Of the unmatched records, more than 80% of the unmatched birth certificates were missing a hospital identifier, suggesting delivery at home or in a birthing center, and the remainder were unmatched secondary to coding errors. Unmatched records had gestational age and racial/ethnic distributions similar to the matched records. Unmatched records were excluded from the study. Infant records were included if the infant’s gestational age was between 24 and 44 weeks and the birthweight was between 400 and 8000 g and did not exceed five standard deviations from the mean for gestational age. Records with an incorrect or abnormal hospital identifier were also excluded. This study was deemed exempt by the Institutional Review Board at the Children’s Hospital of Philadelphia, as it did not meet the criteria for human subjects research.

Study variables

Based on the AGOG/SMFM description of levels of maternal care (Table 1), relevant study variables were identified (Table 2). Univariate analyses of patient characteristics included maternal demographics, maternal comorbid and pregnancy associated conditions, and neonatal characteristics. The complete list of associated ICD-9 and CPT codes are included in the Additional file 1, ICD-9 and CPT Codes for Study Variables.

Table 1 Characteristics of Levels of Maternal Care and Associated Thresholds for Empiric Levels of Maternal Care

Table 2 Maternal and Infant Characteristics Delivering in Non-Obstetric and Obstetric Hospitals by Empiric Maternal Level of Care in California, Missouri, and Pennsylvania, 2000–2009

Level of maternal care

The ACOG/SMFM statement describes levels of maternal care as basic care (level I), specialty care (level II), subspecialty care (level III), and Regional Perinatal Health Care Centers (level IV) (Table 1). The statement provides the associated definition, capabilities, and health care providers for each level of maternal care [11, 12]. In the 2015 statement, examples of appropriate patients for each level of maternal care were also provided [11]. We used the information in the ACOG/SMFM statements, specifically the examples of appropriate patients which should reflect hospital capabilities and health care providers, to empirically classify hospitals into one of the four levels of maternal care based on the types of patients that a hospital with that level should have treated in that year. Empiric levels of maternal care were solely based on patient data and did not include direct measures of hospital capabilities or health care providers. We considered hospitals with < 100 deliveries/year non-obstetric hospitals.

We used the aforementioned ACOG/SMFM examples of appropriate patients and state-level hospital administrative data, ICD-9 and CPT codes, to assign hospitals an empiric level of maternal care. We assigned an empiric level of maternal care to each hospital based on a threshold number of appropriate patients per year (Table 1). We determined the threshold of appropriate ‘high-risk’ patients for each level of maternal care by first examining Youden’s index, a summary measure of the Receiver Operating Characteristic curve that supports selection of optimal threshold values, the sensitivity, and specificity for each type of high-risk patient (Supplemental Table 1) [22]. Then, given the potential for an urgent, emergent, or unexpected delivery at a low-level hospital of a patient whose condition may warrant a higher level of maternal care, we examined the face validity of the Youden-based cutpoints while considering the volume of patients indicating a hospital’s intent to deliver different types of appropriate patients and clinically does not differ between states (Supplemental Table 1). For example, to differentiate between level II and III hospitals, the optimal cutpoint per Youden’s index for the number of patients with severe hypertension or eclampsia before 34 weeks’ gestation was 2 (sensitivity 95%, specificity 96%, area under ROC curve 0.95) and directly informed our threshold of ≥3/year. For previous cesarean section and a placenta previa, the optimal cutpoint was 1, which was deemed clinically inappropriate as it is plausible that 0–2 patients/year may present to a level II hospital and require urgent delivery, thus we identified an alternate threshold (≥3/year) to maximize correct classification. Hospitals had to meet 2 of 3 high-risk patient thresholds to be categorized as a level II, 3 of 4 high-risk patient thresholds to be categorized as a level III, and both high-risk patient thresholds to be categorized as a level IV (Table 1). Hospitals had to meet more than one threshold criteria because levels of maternal care describe hospitals with the ability to care for more than one type of high-risk patient while meeting all criteria for level II or III was thought to be too stringent and could increase misclassification. Potential inconsistencies (e.g., hospitals with varying levels of maternal care each year) in the assignment of a hospital’s empiric level of maternal care were discussed amongst authors until agreement was reached. Levels were assigned annually to account for changes in hospital services and obstetric unit closures [11, 12]. We examined the distribution of high-risk patients delivering across our empiric levels of maternal care as a basic validation assessment [23]. Verification of individual hospitals level of maternal care are not yet publicly available in the states studied.

Data analysis

Determination of the empiric level of maternal care was conducted by year and state. Descriptive analyses were completed for the cohort and stratified by state secondary to differences in perinatal health systems. The number of non-obstetric hospitals and obstetric hospitals with level I, II, III, and IV maternal care were calculated. Stata version 15 (StataCorp, College Station, TX) was used for the univariate analyses, which compared patient characteristics of non-obstetric hospitals and the four levels of maternal care using Pearson Chi-Squared and Kruskal-Wallis tests. The hospital location geocodes were used to construct maps overlying the population density using ArcGIS (Esri, Redlands, CA).

Results

The analytic cohort included 6,895,600 mother-infant dyads (Fig. 1) who delivered at more than 500 hospitals over 10 years. The characteristics of patients delivering in non-obstetric and obstetric hospitals of varying levels of maternal care differed (Table 2). Non-obstetric hospitals cared for more patients with public insurance, whereas, high-risk patients such as those of higher maternal age and with those with comorbid and pregnancy associated conditions delivered at hospitals with a higher level of maternal care, as shown by the Table columns with the percentage of patients with each condition by level of care. When stratifying by state, the increased proportion of high-risk patients delivering in higher level hospitals persisted (Tables 2, 3 and 4 in Supplemental materials). Additionally, there was an increased percentage non-Hispanic Blacks and Asian/Pacific Islanders in hospitals with higher level maternal care, reflecting the co-located nature of these populations in the states studied and high level centers in metropolitan areas.

Fig. 1

Cohort Identification Flow Diagram

The total number of hospitals, both obstetric and non-obstetric, declined during the study period. In 2000, 491 of 528 hospitals were identified as obstetric hospitals, whereas at the end of the study period, 2009, 418 of 442 hospitals were identified as obstetric hospitals. Similarly, in 2000, 37 of 528 hospitals were non-obstetric and by 2009, 24 of 442 hospitals were non-obstetric. The decrease in obstetric and non-obstetric hospitals resulted in an increase of births in obstetric hospitals from 93 to 94.6%. Maps of each state illustrate the distribution of non-obstetric and obstetric hospitals by their empiric level of maternal care in 2009 (Fig. 2). Hospitals with higher levels of maternal care and in close proximity to one another were consistently in urban areas with higher population density. The number of obstetric hospitals decreased in all states over the study period, by 3% in Missouri, 12% in California, and 26% in Pennsylvania, primarily from reductions in the number of hospitals providing level I and II care (Fig. 2).

Fig. 2

Distribution of Non-obstetric and Obstetric Hospitals and Available Empiric Levels of Maternal Care. Geographic distribution and associated number of non-obstetric and obstetric hospitals by level of maternal care in California, Missouri, and Pennsylvania from 2000 to 2009 with maps illustrating the distribution of institutions in 2009

Based on the empiric levels of maternal care, the majority of women delivered at hospitals with level II care, 41.8, 37.0, and 43.1% in California, Missouri, and Pennsylvania, respectively (Table 2). The proportion of deliveries at a non-obstetric hospital in Missouri (0.9%) was almost five times higher than Pennsylvania (0.2%) and 10 times higher than California (0.08%). The proportion of deliveries in hospitals with level I maternal care varied widely, from 3.6% in California to 12.1% in Missouri and 16.9% in Pennsylvania. The frequency of women in Missouri (35.6%) delivering at a hospital with level IV maternal care was nearly double that of Pennsylvania (16.3%) and California (13.3%).

Discussion

In this study, we developed an empiric approach to determine levels of maternal care at individual hospitals in California, Missouri, and Pennsylvania using administrative data. Applying this approach, high-risk patients more frequently delivered at hospitals with higher levels of maternal care, which is consistent with risk-appropriate care delivery. During the study period the number of obstetric hospitals decreased by nearly 15%. As expected, hospitals with higher levels of maternal care were in metropolitan centers. To our knowledge, this is the first study to describe an empiric approach to determine the available level of maternal care using administrative data reflective of the patient care provided, independent of self-reported hospital services and subspecialist availability.

Identifying levels of maternal care using only administrative data has not been described in the literature, however using ICD codes to identify levels of maternal care may be preferable to other methods. First, as more recent data become available and ICD codes are revised, variable crosswalks (i.e. ICD-9 to ICD-10) will make the continued application of this approach feasible. Second, ICD codes determine diagnosis-related group (DRG) codes which determine payment, thus the ICD codes associated with patients should reflect conditions that warrant billing, increasing reliability. Third, hospitals unreliably self-assess their capabilities, with 18% of neonatal units overestimating and 50% obstetric units incorrectly reporting their level of care in prior audits [17, 24]. Fourth, our approach accounts for the dynamic nature of maternal care delivery as we determine the level of care annually and the empirically derived levels reflect the care actually being provided increasing its relevance. Fifth, in the US there is limited oversight regarding where pregnant patients deliver and although maternal risk assessment during the antenatal period or at the time of delivery may identify high-risk patients and clinicians may recommend delivery in a hospital with higher level care, ultimately the location of maternal care often reflects personal choice and is influenced by free market economics. Finally, an analogous empiric methodologic approach has been utilized in studies of neonatal levels of care, associated with outcomes, and used to inform neonatal regionalization efforts supporting the validity of this approach [9, 10].

Previous studies of levels of maternal care are currently limited by a lack of national level reports and reliance on self-reported survey measures to determine the level of care. The prior literature, though, supports the need to accurately identify the level of maternity care provided by hospitals. Consistent with our findings, two cross-sectional studies by Srinivas et al. and Easter et al. reflective of nine and seven states respectively, reported high risk patients are more likely to be managed in high level hospitals [13, 14]. Easter et al. also reported 2.4% of patients delivered in a hospital with an inappropriate level of maternal care, though it is unclear if these deliveries were emergent or in a hospital with a hospital-perceived higher level of care [14]. To date, data regarding maternal levels of care and outcomes are mixed as Srinivas et al. found women with cardiac conditions had a significantly lower odds or mortality when delivering in a level I compared to a level IV hospital [13] while Vanderlaan et al. found no difference in maternal outcomes by level of maternal care in Georgia [15]. The variation we report in levels of maternal care between states and nearly 15% decrease in the total number of obstetric hospitals, is also consistent with previous literature [25]. The decrease in available obstetric services after obstetric hospital closures has been associated with increased travel distance to an obstetric hospital, increased delivery outside of the hospital or delivery at a hospital without obstetric services, and increased perinatal and neonatal mortality [26,27,28], outcomes highlighting the potential need for perinatal regionalization.

Our methodology offers researchers and leaders in perinatal care delivery and policy another approach to more systematically and widely identifying levels of maternal care. Compared to surveys or site visits, this empiric approach is much less resource intensive and more accessible. Importantly, this ICD code based approach, allows for international applications, as ICD codes are used in over 100 countries worldwide [29]. Studying the empiric levels of maternal care provided across countries may illuminate how and where obstetric care is being delivered and facilitate more meaningful international comparisons. As new data are available, applying this approach to other epochs, states, and countries should be pursued. This research may expedite further studies of levels of maternal care leading to a better understanding the measurable benefits of levels of maternal care and allowing for the characterization of specific patient populations who may benefit from a particular level of maternal care.

Strengths and limitations

One of the primary limitations of this approach is the inability to validate the empiric level of maternal care assigned to each hospital with an external data source. Unlike the level of neonatal or trauma care available at a hospital, which have been the focus of national surveys, inventories, and verification programs, such data are not yet available for maternal care [30,31,32]. This potential approach is also complicated by issues obtaining linked mother-infant records and survey data with hospitals over-reporting their capabilities [17]. As described by Easter el al, the delivery of high-risk patients at hospitals with low level maternal care may have influenced the level of maternal care assignments [14]. Our approach acknowledges this possibility and thus the classifications of the four levels of maternal care each incorporate multiple types of high-risk patients. Another limitation is that non-hospital births, such as those occurring at home or in non-hospital affiliated birth centers, are not included in this dataset. Indications for delivery in the non-hospital setting or a specific level of maternal care cannot be determined. This methodology does not incorporate information on hospital capabilities and providers, though to some extent the care provided to patients should reflect available hospital services and providers. Strengths of our study include that it describes the actual level of care provided to patients, which is important to consider when assessing associations with outcomes. Additionally, we assigned the level of maternal care independent of self-reported measures. This approach is significantly less expensive and provides level of maternal care data much more quickly than and onsite survey approach. Finally, the use of ICD codes allows for application of the approach outside of the US.

Conclusions

This study describes an approach to identify and assign hospital levels of maternal care. Additionally, this study highlights the evolving landscape of available obstetric services and provides new opportunities to study levels of maternal care. Given the current rates of maternal morbidity and mortality in the US and intent for levels of maternal care to improve perinatal care, a systematic, widely available, efficient approach to identifying levels of maternal care and study associations is crucial to optimize and improve perinatal outcomes.