Skip to content

Advertisement

  • Research article
  • Open Access
  • Open Peer Review

This article has Open Peer Review reports available.

How does Open Peer Review work?

Leaving the emergency department without complete care: disparities in American Indian children

  • Tess L. Weber1,
  • Katherine M. Ziegler2,
  • Anupam B. Kharbanda3,
  • Nathaniel R. Payne3,
  • Chad Birger1 and
  • Susan E. Puumala1Email author
BMC Health Services ResearchBMC series – open, inclusive and trusted201818:267

https://doi.org/10.1186/s12913-018-3092-z

Received: 21 November 2017

Accepted: 3 April 2018

Published: 10 April 2018

Abstract

Background

Children who leave the emergency department (ED) without complete evaluation or care (LWCET) have poorer outcomes in general. Previous studies have found that American Indian (AI) children have higher rates of LWCET than other racial or ethnic groups. Therefore, this study aims to examine LWCET in AI children by exploring differences by ED location and utilization patterns.

Methods

This is a retrospective cohort study of five EDs in the upper Midwest between June 2011 and May 2012. We included all visits by children aged 0–17 who identified as African American (AA), AI or White. Logistic regression was used to determine differences in LWCET by race and ED location controlling for other possible confounding factors including sex, age, insurance type, triage level, distance from ED, timing of visit, and ED activity level.

Results

LWCET occurred in 1.73% of 68,461 visits made by 47,228 children. The multivariate model revealed that AIs were more likely to LWCET compared to White children (Odds Ratio (OR) = 1.62, 95% Confidence Interval (CI) = 1.30–2.03). There was no significant difference in LWCET between AA and White children. Other factors significantly associated with LWCET included triage level, distance from the ED, timing of visit, and ED activity level.

Conclusion

Our results show that AI children have higher rates of LWCET compared to White children; this association is different from other racial minority groups. There are likely complex factors affecting LWCET in AI children throughout the upper Midwest, which necessitates further exploration.

Keywords

PediatricEmergency departmentAmerican IndianDisparities

Background

Leaving the emergency department (ED) without complete evaluation and treatment is a growing issue that can lead to serious medical conditions, additional cost, recurring ED/primary care visits, hospitalization or other preventable, adverse events [14]. Leaving without complete evaluation and treatment (LWCET) is frequently related to lack of timely treatment and length of stay before being seen, often resulting from overcrowded EDs [14]. Previous research has shown that racial and ethnic minorities have longer wait times than non-Hispanic White patients [2, 3, 5, 6]. This may be due, in part, to differential usage and care patterns in EDs, particularly in pediatric populations [58].

This is especially concerning among American Indian (AI) children, who have higher overall ED visit rates and more visits per child compared to other racial/ethnic groups [7]. Many factors contribute to this discrepancy, including a higher burden of chronic disease, substance abuse disorders, injuries (both intentional and unintentional), low insurance rates and lack of access to quality care [711]. Furthermore, many AI children lack a medical home, and therefore rely heavily on the ED for primary health care [8, 10].

Previous research has shown that AI children are more likely to LWCET [12]; however, no studies have thoroughly analyzed the patterns of use and care at the ED among AI children. This study aimed to examine LWCET in AI children by exploring possible differences by ED location and utilization patterns in a multi-center cohort of EDs in the upper Midwest.

Methods

Study design and sample

A cross-sectional study of pediatric ED visits from five EDs in the upper Midwest was performed. Included were all visits by children aged 0–17 years to one of the five EDs between June 2011 and May 2012. Analysis was limited to three racial groups (African American (AA), AI, and White). Approval from all Institutional Review Boards providing data was obtained, along with a waiver of informed consent.

Statistical analysis

LWCET was the primary outcome measure, defined as leaving the ED without complete evaluation or treatment and recorded as a binary yes/no variable. Our primary exposure variable of interest was race, limited to AA, AI, and White since few other races were common at all of our study sites. Age was categorized as less than 1 year, 1–4 years, 5–10 years, and 11–17 years old. Insurance type was defined as private and medical assistance (MA)/other. A two-level triage variable was created where the three highest and two lowest triage levels were combined. High triage included emergent, critical and acute visits, while low triage included urgent and non-urgent visits. Sex was categorized as male and female. Timing of visit was developed based on day and time of visit to the ED. Categories included: weekday business hours, evening hours during a weekday, night hours during a weekday, and weekends. ED setting was categorized into rural or urban, where urban was an ED located in a city with a population of 100,000 people or more. Distance from the ED was based on the patient’s zip code, and categorized as 5 miles or less and more than 5 miles to the ED.

An important source of variation to consider in examining LWCET is how busy the ED is at the time the patient presents. For each site, we used partial least squares approach for structural equation models to construct a formative latent variable which measured the ED activity level. This variable takes into account the number of patients in each triage level at the emergency department as well as the time of day the patient arrived. The analysis was completed using the semPLS package in R with the centroid weighting scheme using R, version 3.2.3 (www.r-project.org). From this analysis, we created a standardized score for the activity level for each visit such that each site had a mean activity level near zero with positive number indicating increased activity and negative number indicating decreased activity. We checked basic validity of this construct by assessing its correlation with time to examination and found a Spearman’s rank correlation of 0.29 indicating a modest level of association.

Descriptive analysis including counts and percentages are reported. Univariate analyses were performed using logistic regression with only that variable and a random study site effect. Logistic regression with a random effect for study site was used to determine differences in LWCET by race and ED location controlling for other possible confounding factors including age, insurance type, triage level, sex, timing of visit, distance from the ED and ED activity level. Unadjusted and adjusted odds ratios are reported with 95% confidence intervals. Multiple imputations analysis was completed to examine the impact of missing data, which ranged from 0.04–1.08%. All logistic regression and imputations analyses were performed using SAS version 9.4, SAS Institute, Cary, NC.

Results

Demographics

During the 11-month study period, a total of 68,461 visits by 47,228 children were included in the analysis. Overall 1181 (1.73%) visits ended in LWCET (Table 1). The majority of visits were made by males (52.95%) and children between the ages of 1–4 (39.66%). Over half of the ED visits were made by White children (53.50%), while 36.66% and 9.84% were by AA and AI children, respectively. Most visits were triaged at less severe levels (57.10%) and were made by children with MA or other insurance (62.59%).
Table 1

Descriptive characteristics by leaving without complete evaluation and treatment (LWCET) status

Variable

Total (N = 68,461)

No LWCET (n, %)

LWCET (n, %)

p-value*

Sex

0.09

 Female

32,207

31,680 (47.09)

527 (44.62)

 

 Male

36,254

35,600 (52.91)

654 (55.38)

 

Race

< 0.001

 AA

25,099

24,595 (36.55)

504 (42.68)

 

 White

36,624

36,094 (53.65)

530 (44.88)

 

 AI

6738

3591 (9.80)

147 (12.45)

 

Age (years)

0.04

 < 1

10,183

10,007 (14.87)

176 (14.90)

 

 1–4

27,152

26,646 (39.60)

506 (42.85)

 

 5–10

17,405

17,109 (25.43)

296 (25.06)

 

 11–17

13,721

13,518 (20.09)

203 (17.19)

 

Insurance

0.09

 Private

25,578

25,165 (37.42)

413 (35.00)

 

 MA/Other

42,853

42,086 (62.58)

767 (65.00)

 

Triage Level

< 0.001

 Less Severe

39,092

38,279 (57.50)

813 (70.70)

 

 More Severe

28,631

28,294 (42.50)

337 (29.30)

 

Distance from ED (miles)

0.0014

 ≤ 5

34,043

33,401 (49.69)

642 (54.36)

 

 > 5

34,363

33,824 (50.31)

539 (45.64)

 

Timing

< 0.001

 Weekday Business Hours

18,233

17,931 (26.65)

302 (25.57)

 

 Weekday Evening Hours

17,772

17,412 (24.88)

360 (30.48)

 

 Weekday Night Hours

10,608

10,400 (15.46)

208 (17.61)

 

 Weekend

21,848

21,537 (32.01)

311 (26.33)

 

24 Hour Repeat Visits

< 0.001

 No Repeat Visits

67,308

66,192 (98.38)

1116 (94.50)

 

 Repeat Visit

1153

1088 (1.62)

65 (5.50)

 

48 Hour Repeat Visits

< 0.01

 No Repeat Visits

66,324

65,240 (96.97)

1084 (91.79)

 

 Repeat Visit

2137

2040 (3.03)

97 (8.21)

 

LWCET indicates leaving without complete evaluation and treatment; AA African American, AI American Indian, ED Emergency Department

*P-values were produced by Chi-squared tests

The proportion of less severe triage scores was higher among children who LWCET compared to those who did not LWCET (70.70% vs. 57.50%), while percentages of more severe triage scores were lower among children who LWCET compared to those who did not LWCET (42.50% vs. 29.30%; Table 1). The proportion of return visits to the ED at ≤24 and ≤ 48 h was higher among LWCET visits (1.56% vs. 5.21% and 2.99% vs. 8.14% respectively, P < 0.001).

Univariate analysis

AI children were more likely to LWCET compared to White children (Table 1). Children who LWCET were more likely to be triaged with less severe level (70.70%, P < 0.001), travel 5 miles or less to the ED (54.36%, P = 0.0014), be males (55.38%, P < 0.001), and visit during weekday evening hours (30.48%, P < 0.001) as compared to children who did not LWCET.

Multivariate analysis

In the multivariate model there was a significant association between race and LWCET, where AI children had higher odds of LWCET than White children (OR = 1.62, 95% CI = 1.30–2.03; Table 2). There was no significant difference in LWCET between AA children and White children.
Table 2

Odds ratios of leaving without complete evaluation and treatment (LWCET)

Variable

Unadjusted

95% CI

Adjusted

95% CI

Imputed

95% CI

Sex

 Female

0.91

0.81–1.02

0.88

0.79–0.99

0.90

0.80–1.01

Race

 AA

1.40

1.23–1.58

1.06

0.90–1.24

1.05

0.89–1.23

 AI

1.52

1.26–1.82

1.62

1.30–2.03

1.63

1.31–2.03

Age (years)

 < 1

0.93

0.78–1.10

0.88

0.73–1.05

0.91

0.76–1.08

 5–10

0.91

0.79–1.05

0.89

0.77–1.04

0.91

0.78–1.05

 11–17

0.79

0.67–0.93

0.89

0.75–1.05

0.90

0.76–1.06

Insurance

 Private

0.90

0.80–1.02

1.05

0.90–1.22

1.03

0.89–1.20

Triage Level

 More Severe

0.56

0.49–0.64

0.63

0.55–0.73

0.63

0.55–0.73

Distance from ED (miles)

 > 5

0.83

0.74–0.93

0.86

0.76–0.98

0.86

0.77–0.98

Timing

 Weekday Evening Hours

1.23

1.05–1.43

1.02

0.86–1.20

1.05

0.89–1.23

 Weekday Night Hours

1.19

0.99–1.42

1.43

1.18–1.71

1.41

1.18–1.69

 Weekend Hours

0.86

0.73–1.01

0.79

0.67–0.93

0.80

0.68–0.94

ED Activity Level

 

1.26

1.19–1.33

1.32

1.24–1.39

1.30

1.23–1.38

CI indicates confidence interval; AA African American, AI American Indian, ED Emergency Department

Triage level was significantly associated with LWCET, where children with more severe triage scores had lower odds of LWCET compared to those with less severe scores (OR = 0.63, CI = 0.55–0.73). Visits that occurred during weekday night hours had odds 1.43 times higher of LWCET compared to visits during weekday business hours (CI = 1.18–1.71). Children who lived further than 5 miles from the ED had lower odds of LWCET (OR = 0.86, CI = 0.76–0.98). ED activity level was also found to be associated with LWCET, where a busier ED had higher odds of resulting in LWCET (OR = 1.32, CI = 1.24–1.33).

Imputations analysis

Results from imputations analysis revealed slight differences in associations with LWCET due to missing data values. For example, the odds of LWCET for children who lived further than five miles from the ED was found to be significantly lower compared to children who lived within five miles (OR = 0.86, CI = 0.77–0.98). In addition, the odds of LWCET for visits during weekend hours was significantly lower compared to visits during weekday business hours (OR = 0.80, CI = 0.68–0.94).

Discussion

This study examined LWCET among pediatric patients in a multi-center cohort of EDs in the upper Midwest. Overall, 1.7% of pediatric visits resulted in LWCET. While these rates of LWCET are relatively low compared to other hospital settings, [1, 13, 14] results from this study found that AI children were significantly more likely to LWCET compared to white patients, which merits further discussion. Other factors associated with increased odds of LWCET included less severe triage score, presenting to the ED during weekday hours, and ED activity level.

Previous studies have found that patients who live closer to the ED have higher odds of leaving prematurely [1, 14]. This was also seen in our study, where children who lived further than 5 miles from the ED have slightly lower odds of LWCET (OR = 0.86, CI = 0.76–0.98). The assumption for this may be that patients who live closer to the ED may be more likely to use ED services than seeking other medical care because it may be quicker or more accessible than other options. Similarly, these patients may also leave the ED without being seen because they can return if necessary.

As location of the site could have been a factor in racial differences and LWBS, we tested the interaction between site and race and found no significant relationship. One may assume that the reason for differences in AI children may be because they are visiting rural EDs that may have fewer resources and longer wait times, resulting in a higher rate of LWCET. However, no difference in LWCET was seen between sites, and a higher amount of LWCET in AI children was seen regardless of ED location.

Both MA insurance and race may be proxies for low socioeconomic status, and patients with MA insurance often use the ED as a substitute for primary care [5, 12]. A previous study found that patients with low-income and poor, or no insurance, were more likely to leave without being seen [15]. However, no significant association was seen between LWCET and insurance in our study. This suggests that other factors, including social or cultural may be of importance when exploring the reasons for why AI children LWCET, and could explain why we observed a different association between AI children and LWCET than we observed with AA children.

Unique to our study, we examined the relationship of LWCET and the ED activity level. As previous research suggests [14], our results showed a significant association with higher ED activity levels and increased odds of premature departure. This may be associated with time of arrival, as EDs are undoubtedly busier at varying times. We also found a significant association with time of arrival and LWCET. Patients who presented to the ED on weekdays between 10 pm and 7 am had odds of LWCET 1.43 times higher than patients who arrived during weekday business hours. Contrary to previous research [1], however, our study found a lower rate of LWCET during the weekends.

The strongest predictor of LWCET was race. Previous studies have also found racial disparities among patient wait times and LWCET in the ED [2, 3, 5, 7, 16, 17]. We observed a significant relationship between AI children and LWCET while accounting for potential confounding factors. In our study, AI children had 1.62 times higher odds of LWCET compared to White children, whereas no significant difference was observed for AA children compared to White children. A similar study by Bourgeois et al. (2008) also found that AI children had higher odds of LWCET than White children [12]. This persistent increase in LWCET among AI children indicates significant disparities in ED care in this disadvantaged population, and merits further investigation.

Discrimination, or perceived discrimination, may play a role [18]. One study indicated that AI parents were 25 times more likely to perceive racial discrimination in a health care setting than non-Hispanic White patients [19]. Several studies have noted minority patients are often assigned less urgent triage scores, have longer wait times, and are less likely to receive pain medications in ED settings [2022]. This may be due, in part, to health care providers’ conflicting attitudes towards patients who use the ED for non-urgent conditions [23]. Many social determinants may factor into these use patterns and lead to overuse and lower quality care. Understanding use and care patterns among AI pediatric patients in the ED will result in a more comprehensive picture of health care in this population. Interventions to address issues of ED use and care could lead to substantially improved ED outcomes for AI children.

Strengths

This study had several strengths. The data encompasses five EDs with a larger proportion of AI children that allows us to look at patterns in LWCET in this specific minority group not currently explained within the literature. While limited by medical record data, we were still able to account for several confounders such as distance from ED, ED setting, timing of visit, and the level of traffic within the ED. The development of our ED activity level allows us to look more into the environment of the ED, while other studies have only focused on the day and time of visit without accounting for how busy the ED is at the time of visit.

Limitations

There are potential limitations to this study. First, these data may not be representative of the AI children outside of the Upper Midwest since many regional differences may affect the relationship between race and LWCET; therefore, no assumptions should be made about generalizability outside this region. Furthermore, while we did attempt to account for differences by site by including it as a random effect in our model, the diversity of each site may affect the results and the EDs included may not be a random sample of the population of EDs that serve AI children. Finally, medical record data did not allow us to determine at what point in the visit children LWCET or for what reason, therefore we are only able to suggest further exploration into this observed relationship to better inform possible intervention efforts.

Conclusions

Results of this study show a significant relationship between LWCET and race. Specifically, AI children have a significantly higher rate of LWCET compared to White children regardless of ED location. This was not seen among AAs. This implies that underlying factors attribute to AI children LWCET throughout the upper Midwest.

Abbreviations

AA: 

African American

AI: 

American Indian

CI: 

95% Confidence interval

ED: 

Emergency department

LWCET: 

Leaving without complete evaluation and treatment

MA: 

Medical assistance

OR: 

Odds ratio

Declarations

Funding

National Institute on Minority Health and Health Disparities of the National Institutes of Health, Award Number U54MD008164. The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health.

Availability of data and materials

The de-identified datasets analyzed during the current study are available from the corresponding author on reasonable request.

Authors’ contributions

TLW wrote the first draft of the manuscript, carried out the statistical analyses, and finalized the manuscript. KMZ participated in study design, data acquisition, assisted in data interpretation and reviewed and revised the manuscript. ABK participated in study design, data acquisition, assisted in data interpretation and reviewed and revised the manuscript. NRP participated in study design, data acquisition, assisted in data interpretation and reviewed and revised the manuscript. CB participated in the statistical analysis of the data and reviewed and revised the manuscript. SEP led the design the study, assisted with the statistical analysis and data interpretation, and reviewed and finalized the manuscript. All authors approved the final manuscript as submitted and take full responsibility for its content.

Ethics approval and consent to participate

Approval was obtained by Sanford Health Institutional Review Board, Children’s Hospitals and Clinics of Minnesota Institutional Review Board, and Regional Health Institutional Review Board (accepted Sanford Health Institutional Review Board review) and a waiver for informed consent was granted.

Competing interests

The authors declare that they have no competing interests.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Authors’ Affiliations

(1)
Sanford Research, Sioux Falls, USA
(2)
Colorado School of Public Health at the University of Colorado at Denver, Aurora, USA
(3)
Children’s Hospitals and Clinics of Minnesota, Minneapolis, USA

References

  1. Goldman RD, Macpherson A, Schuh S, Mulligan C, Pirie J. Patients who leave the pediatric emergency department without being seen: a case-control study. Can Med Assoc J. 2005;172:39–43.View ArticleGoogle Scholar
  2. Johnson M, Myers S, Wineholt J, Pollack M, Kusmiesz AL. Patients who leave the emergency department without being seen. J Emerg Nur. 2009;35:105–8.View ArticleGoogle Scholar
  3. Sonnenfeld N, Pitts SR, Schappert SM, Decker SL. Emergency department volume and racial and ethnic differences in waiting times in the United States. Med Care. 2012;50:335–41.View ArticlePubMedGoogle Scholar
  4. Rowe BH, Channan P, Bullard M, Blitz S, Saunders LD, Rosychuk RJ, Lari H, Craig WR, Holroyd BR. Characteristics of patients who leave emergency departments without being seen. Acad Emergy Med. 2006;13:848–52.View ArticleGoogle Scholar
  5. James CA, Bourgeois FT, Shannon MW. Association of race/ethnicity with emergency department wait times. Pediatrics. 2005;115:e310–5.View ArticlePubMedGoogle Scholar
  6. Park CY, Lee MA, Epstein AJ. Variation in emergency department wait times for children by race/ethnicity and payment source. Health Serv Res. 2009;44:2022–39.View ArticlePubMedPubMed CentralGoogle Scholar
  7. Bourgeois FT, Shannon MW, Stack AM. "left without being seen": a national profile of children who leave the emergency department before evaluation. Ann Emerg Med. 2008;52:599–605.View ArticlePubMedGoogle Scholar
  8. Flores G, Tomany-Korman SC. Racial and ethnic disparities in medical and dental health, access to care, and use of services in US children. Pediatrics. 2008;121:e286–98.View ArticlePubMedGoogle Scholar
  9. Schubot D. South Dakota youth risk behavior survey. Pierre, SD: Coordinated School Health; 2011.Google Scholar
  10. Barradas DT, Kroelinger CD, Kogan MD. Medical home access among American Indian and Alaska native children in 7 states: National Survey of Children's health. Mater Child Health. 2012;16(Suppl 1):S6–13.View ArticleGoogle Scholar
  11. Flores G, Lin H. Trends in racial/ethnic disparities in medical and oral health, access to care, and use of services in US children: has anything changed over the years? Int J Equity Health. 2013;12:10.View ArticlePubMedPubMed CentralGoogle Scholar
  12. Harrison B, Finkelstein M, Puumala S, Payne NR. The complex association of race and leaving the pediatric emergency department without being seen by a physician. Pediatr Emerg Care. 2012;28:1136–45.View ArticlePubMedGoogle Scholar
  13. Gaucher N, Bailey B, Gravel J. For children leaving the emergency department before being seen by a physician, counseling from nurses decreases return visits. Int Emerg Nurs. 2011;19:173–7.View ArticlePubMedGoogle Scholar
  14. Gaucher N, Bailey B, Gravel J. Who are the children leaving the emergency department without being seen by a physician? Acad Emerg Med. 2011;18:152–7.View ArticlePubMedGoogle Scholar
  15. Hsia RY, Asch SM, Weiss RE, Zingmond D, Liang LJ, Han W, McCreath H, Sun BC. Hospital determinants of emergency department left without being seen rates. Ann Emerg Med. 2011;58:24–32. e23View ArticlePubMedPubMed CentralGoogle Scholar
  16. Pham JC, Ho GK, Hill PM, McCarthy ML, Pronovost PJ. National study of patient, visit, and hospital characteristics associated with leaving an emergency department without being seen: predicting LWBS. Acad Emerg Med. 2009;16:949–55.View ArticlePubMedGoogle Scholar
  17. Johnston V, Bao Y. Race/ethnicity-related and payer-related disparities in the timeliness of emergency care in U.S. emergency departments. J Health Care Poor Underserved. 2011;22:606–20.View ArticlePubMedGoogle Scholar
  18. Puumala SE, Burgess KM, Kharbanda AB, Zook HG, Castille DM, Pickner WJ, Payne NR. The role of Bias by emergency department providers in Care for American Indian Children. Med Care. 2016;54:562–9.View ArticlePubMedPubMed CentralGoogle Scholar
  19. Call KT, McAlpine DD, Johnson PJ, Beebe TJ, McRae JA, Song Y. Barriers to care among American Indians in public health care programs. Med Care. 2006;44:595–600.View ArticlePubMedGoogle Scholar
  20. Goyal MK, Kuppermann N, Cleary SD, Teach SJ, Chamberlain JM. Racial disparities in pain Management of Children with Appendicitis in emergency departments. JAMA Pediatr. 2015;169:996–1002.View ArticlePubMedPubMed CentralGoogle Scholar
  21. Okunseri C, Okunseri E, Chilmaza CA, Harunani S, Xiang Q, Szabo A. Racial and ethnic variations in waiting times for emergency department visits related to nontraumatic dental conditions in the United States. J Am Dent Assoc. 2013;144:828–36.View ArticlePubMedPubMed CentralGoogle Scholar
  22. Vigil JM, Coulombe P, Alcock J, Kruger E, Stith SS, Strenth C, Parshall M, Cichowski SB. Patient ethnicity affects triage assessments and patient prioritization in U.S. Department of Veterans Affairs emergency departments. Medicine. 2016;95:e3191.View ArticlePubMedPubMed CentralGoogle Scholar
  23. Salami O, Salvador J, Vega R. Reasons for nonurgent pediatric emergency department visits: perceptions of health care providers and caregivers. Pediatr Emerg Care. 2012;28:43–6.View ArticlePubMedGoogle Scholar

Copyright

© The Author(s). 2018

Advertisement