Emergency department consultations for respiratory symptoms revisited: exploratory investigation of longitudinal trends in patients’ perspective on care, health care utilization, and general and mental health, from a multicenter study in Berlin, Germany
BMC Health Services Research volume 22, Article number: 169 (2022)
Only few studies of emergency department (ED) consulters include a longitudinal investigation. The EMACROSS study had surveyed 472 respiratory patients in eight inner-city EDs in Berlin in 2017/2018 for demographic, medical and consultation-related characteristics. This paper presents the results of a follow-up survey at a median of 95 days post-discharge. We aimed to explore the post hoc assessment of ED care and identify potential longitudinal trends.
The follow-up survey included items on satisfaction with care received, benefit from the ED visit, potential alternative care, health care utilization, mental and general health, and general life satisfaction. Univariable between-subject and within-subject statistical comparisons were conducted. Logistic regression was performed for multivariable investigations of determinants of dropout and of retrospectively rating the ED visit as beneficial.
Follow-up data was available for 329 patients. Participants of lower education status, migrants, and tourists were more likely to drop out. Having a general practitioner (GP), multimorbidity, and higher general life satisfaction were determinants of response. Retrospective satisfaction ratings were high with no marked longitudinal changes and waiting times as the most frequent reason for dissatisfaction. Retrospective assessment of the visit as beneficial was positively associated with male sex, diagnoses of pneumonia and respiratory failure, and self-referral. Concerning primary care as a viable alternative, judgment at the time of the ED visit and at follow-up did not differ significantly. Health care utilization post-discharge increased for GPs and pulmonologists. Self-reported general health and PHQ-4 anxiety scores were significantly improved at follow-up, while general life satisfaction for the overall sample was unchanged.
Most patients retrospectively assess the ED visit as satisfactory and beneficial. Possible sex differences in perception of care and its outcomes should be further investigated. Conceivable efforts at diversion of ED utilizers to primary care should consider patients’ views regarding acceptable alternatives, which appear relatively independent of situational factors. Representativeness of results is restricted by the study focus on respiratory symptoms, the limited sample size, and the attrition rate.
German Clinical Trials Register (DRKS00011930); date: 2017/04/25.
Emergency departments (ED) are designated to provide care for urgent and serious conditions. Rising numbers of ED visits are reported from many international health care settings [1, 2], and consultations by patients with supposedly less urgent symptoms are frequently discussed as a booster of utilization in this context [3, 4]. Underlying reasons are multi-faceted, including issues of health literacy, health-related anxiety, and access barriers in primary care [5,6,7]. In this complex debate, directing blame on presumedly irresponsible patients is oversimplifying and inexpedient .
The mixed-methods EMACROSS (Emergency and Acute Care for Respiratory Diseases beyond Sectoral Separation) study investigated ED utilization in patients with respiratory complaints. Such are a frequent consultation trigger, and causes encompass a broad spectrum of serious (e.g. respiratory failure, pneumonia) as well as more trivial (e.g. upper respiratory tract infections) conditions. The main study module was a multicenter survey of 472 ED consulters , and baseline data (at index ED visit) showed a mixed picture: on the one hand, half of the patients in the cohort had a chronic pulmonary condition, a third reported repeated ED visits, and respiratory failure was diagnosed in ~ 20%. On the other hand, about 40% were triaged in lower urgency MTS (Manchester Triage System) categories 4 or 5, and more than 60% were treated as ED outpatients. The subgroup of self-referred walk-in patients showed lesser acute and chronic morbidity, and we could identify determinants of such consultations, including younger age and having no regular attachment to a general practitioner (GP). Concerning consultation motives, personal distress and access problems in ambulatory care were stated most frequently, while convenience reasons appeared of comparably minor importance. The results thus seemed not to indicate prevalent careless utilization of EDs as an easy primary care substitute. The situation is similar for patients arriving with emergency medical services (EMS): in a subgroup investigation published recently , the proportion of cases qualifying as potential primary care patients was quite low, particularly if considering patients’ views of the adequate setting. In the EMACROSS baseline survey, only 23% of patients had considered a GP visit a viable alternative to ED care.
However, our data was collected at the time of ED presentation, patients’ judgment being presumably influenced by the complaints’ frequent association with situational distress and anxiety. This potentially applies to all facets of patients’ appraisal of their ED visit: necessity and benefit of treatment received, satisfaction with care, etc. Whether patients’ views on ED consultations remain constant in the longer term or do change with timely distance to the event thus is an interesting question. Reports on consulters’ post hoc perspective on ED visits from survey studies are scarce. Longitudinal quantitative studies mainly focus on disease-specific course and prognostic impact, or health care utilization measures (e.g. [11,12,13,14]). Qualitative publications have investigated patients’ views on their consultations in-depth [6, 8, 15] and are very helpful to understand motives and decision-making. Nevertheless, they have no longitudinal approach and samples are inherently small.
The three-month follow-up survey presented in this paper therefore investigated how respiratory patients retrospectively assess their ED consultation. The investigations were conducted with an explorative intent and altogether had pilot character. We aimed to explore whether patients are content with the visit when reviewing it with temporal distance. Additionally, we looked at personal health care utilization and self-reported general health and life satisfaction after the event as compared to the baseline, as potential indicators of the ED visits’ consequences. A further research aim was the investigation of dropout determinants by comparison of follow-up responders to non-responders.
Study design and conduct of EMACROSS have been described in detail in a previous publication on the baseline data . To give readers a condensed overview, we outline the principal study features in the following sections and provide details on collection of the follow-up data presented in this article.
Research network, setting, and recruitment
EMACROSS was conducted within the Berlin-based network EMANet (Emergency and Acute Medicine Network for Health Care Research Berlin) , which investigates acute care in eight hospital EDs in Berlin’s central district, including two university medical centers. Its focus was on ED consulters with respiratory symptoms. Recruitment was carried out between 1st of June 2017 and 30th of November 2018. Patients were eligible if presenting with a respiratory complaint (e.g. cough, dyspnea, wheeze etc.), fit to give written informed consent, and proficient in one of the survey languages. Recruitment focus was placed on regular physicians’ office hours as to our interest in choosing the ED versus conceivable alternative care, supplemented by intermittent eligibility screening off-hours (weekend, evenings) guided by a general target corridor rather than a strict pre-defined schedule.
All participants took part in the main study module, a quantitative survey with a tablet-based 43-item questionnaire (see supplement to ). Qualitative semi-structured interviews were additionally conducted with a subsample . Secondary data from hospital records provided supplementary information, e.g. concerning ED and hospital diagnoses. Baseline survey participants were contacted again three months after the index ED visit by study personnel for a follow-up interview. This was preferably conducted by phone, but patients could opt for a written questionnaire if they preferred this. If patients could repeatedly not be reached by phone, they were likewise mailed a paper-based questionnaire. To maximize follow-up yield, municipal resident register information was obtained if participants could repeatedly not be reached, to ascertain whether the participants changed address or died since the index ED visit. Active follow-up efforts were concluded if unsuccessful after six weeks; written questionnaires returned at any later date were not discarded to minimize information loss.
The follow-up survey included items on satisfaction with care received in the ED (5-point Likert scale) and on whether patients had benefited from the ED visit in their own view (dichotomous item, yes/no). If applicable, reasons for dissatisfaction with care as well as for assessing the visit as beneficial were inquired. A dichotomous question on whether general practitioner treatment would have been a viable alternative was also included to capture self-assessment of the ED visits’ necessity. The baseline survey had also comprised this item. Other questions covered patients’ health care utilization (HCU) after discharge from the ED (or from an ensuing inpatient stay). Further items on general and mental health (see section “Variable definitions, data preparation” below) were adopted from the baseline assessment  to investigate eventual longitudinal changes. Two versions of the questionnaire were used for inpatients and outpatients, with questions and phrasing slightly adapted to fit the care level received. Some questions, e.g. concerning reasons for not being satisfied or for appraising the ED visit as beneficial, were posed openly and matched by study personnel to a list of pre-formulated options, to allow participants to more freely relate their views. Mentioned aspects not represented by this catalogue were documented in free text. In case of written questionnaires, respective items were posed as multiple-choice with the additional option of adding reasons not listed.
Variable definitions, data preparation
Demographic and medical characteristics of the cohort were assessed at study baseline (index ED visit), either from the survey or from ED and hospital records. For variable definitions and data preparation of this dataset, we refer to the detailed outline in our previous publication . In the three-month follow-up survey, a number of variables were defined and assessed identically to the baseline survey: general health with a 100-point visual analogue scale (0 = worst imaginable health, 100 = best imaginable health), mental health with the PHQ-4 instrument (possible scores of 0–12 and sub-scores of 0–6 for anxiety and depression) , general life satisfaction with the short scale L1 (0–10 point Likert scale; 0 = not satisfied at all, 10 = very satisfied) . HCU questions were adapted from the German Health Interview and Examination Survey for Adults (DEGS)  and assessed consultation frequencies of GPs, medical specialists, emergency departments, inpatient care, and urgent primary care on-call services, for the period since the index visit. The abovementioned scales and tools represent validated and established instruments (PHQ-4, short scale L1, general health visual analogue scale, HCU assessment), while the remainder of the survey items was newly developed on a theoretical basis. To compare HCU data collected at follow-up to the baseline survey, in which consultation frequencies had been assessed for a retrospective six months, corresponding utilization was calculated for a three-month period (90 days). For baseline data, this meant halving six-month numbers, while for follow-up data, the individual time between index visit and follow-up was considered. This approach is equivalent in principle to commonly performed standardizations of HCU data to uniform time frames (e.g. annualization) . For some questions exclusive to the follow-up survey (e.g. reasons for non-satisfaction, or for rating the visit as beneficial), multiple answers were allowed, resulting in multi-response data. As to missing data, it was decided to refrain from using statistical techniques like multiple imputation, as missingness was not of a major dimension. Neither could we be sure whether the missing at random assumption applied.
Data from questions exclusive to the follow-up survey was analyzed and summarized descriptively. Cross-sectional group comparisons (= between-subject comparisons) were conducted with the χ2 test for categorical and the Mann-Whitney-U-test for continuous variables. For correlation of binary variables, Pearson’s phi coefficient was used.
Determinants of dropout and of patients rating the ED visit as beneficial were investigated by logistic regression. The aim was to identify contributive – and potentially explanatory – factors and explore their impact on the outcomes’ probability. The decision to investigate these two outcomes by multivariable analyses was taken for specific reasons. Concerning dropout determinants, a detailed investigation was deemed important as to its impact on the validity of the study results. As to patient assessment of the ED visit as beneficial (or not), this was considered an especially interesting – although explorative – outcome. For the regression analyses, a set of variables of interest as potential contributive factors or control variables was compiled and univariable statistics conducted (χ2 test for categorical and Mann-Whitney-U-test for continuous variables). Non-significance of variables did not result in compulsory rejection, variables being retained if e.g. deemed important from a theoretical viewpoint or as a control variable . We constructed a preliminary multivariable model and observed the effects of discarding and re-adding variables. Models including different sets of variables were compared as to fit and accuracy by the Hosmer Lemeshow test, Nagelkerke’s R2, and AUC (area under the ROC curve) . We did not use an automated variable selection method as to avoid associated model bias .
Longitudinal comparisons (= within-subject comparisons) were conducted with the McNemar test for categorical and the Wilcoxon signed-rank test for continuous variables. The significance level for all analyses was set at 0.05. Analyses were performed in SPSS Version 27 (IBM Corp., Armonk, NY, USA) and R 3.6.2 (R Foundation for Statistical Computing, Vienna, Austria).
Follow-up yield and characteristics of responders vs. non-responders
Of the 472 patients in the baseline cohort, 329 could be reached by follow-up efforts. Interviews were conducted with 266 participants, while 63 returned a printed questionnaire. The dropout rate was 30.3%, with Table 1 showing reasons for participants being lost to follow-up. We know of 15 patients (3.18%) who died in the period between index visit and intended follow-up.
Median follow-up time (distance to baseline) was 95 days, with a range of 82 to 206 days. Most patients were followed up at three to four months after the index visit, with the 95th percentile of follow-up length at 133 days.
Table 2 summarizes basic demographic and medical characteristics of the total baseline cohort and the subgroup of patients with available follow-up.
In the regression model of dropout determinants (434 cases, Nagelkerke’s R2 0.232, AUC 0.75, Hosmer-Lemshow test χ2 10.341, df = 8, p = 0.242), lower probabilities of response to follow-up could be seen for first-generation migrants (OR 0.340, 95% CI [0193;0.599], p < 0.001, reference category: no migration and travel characteristic present) and tourists (OR 0.033, 95% CI [0.009;0.128], p < 0.001, same reference category). Patients with high educational status (OR 2.042, 95% CI [1.035;4.032], p = 0.040, reference category: low educational status) and multimorbidity (OR 1.947, 95% CI [1.136;3.338], p = 0.015) showed higher likelihood to take part in the follow-up survey. This was also the case for patients reporting to have a GP (OR 2.296, 95% CI [1.187;4.441], p = 0.014), and patients with higher general life satisfaction ratings (OR 1.125, 95% CI [1.029;1.231], p = 0.010). Sex and age were included in the model as control variables.
A closer look at the 15 patients who reportedly died prior to intended follow-up shows that these were of high age (mean ~ 80 years) and predominantly male. Morbidity indicators (e.g. urgent triage categories, high share of chronic illness, respiratory failure diagnosed in nearly half, high rate of hospital admission) show that many were already very ill at the time of the index ED visit. It must be noted that death during the designated follow-up period was confirmed in these cases either by relatives reached by our contact efforts, or official municipal register information. Causes or manner of death were not investigated. For some patients (who e.g. moved to another country), no such data was available, so we cannot be absolutely certain that all patients listed in Table 1 as “could not be reached” were still alive three months after the ED index visit.
Post hoc assessment of the ED visit
Retrospective satisfaction ratings regarding the ED visit were high, with 79.7% (of 325 patients with data for this item) of affirmative answers on the 5-point Likert scale (ratings “very satisfied” or “satisfied”). Of the 66 patients who did not rate satisfaction in favorable categories, reasons for not being satisfied were inquired (multiple answers possible). Most frequent complaints were about waiting times (n = 42, 63.6%), symptoms not being taken seriously (n = 15, 22.7%), insufficient treatment for acute complaint (n = 16, 24.2%), unfriendly staff (n = 11, 16.7%) and lack of information regarding treatment (n = 8, 12.1%). Distribution of the dissatisfaction reasons stated did differ between the sexes. Symptoms not being taken seriously were criticized by 17.2% of men vs. 27.0% of women, insufficient treatment by 20.7% of men vs. 27.0% of women, unfriendly staff was reported by 20.7% of men vs. 13.5% of women, and lack of information received by 6.9% of men and 16.2% of women. As to waiting times there was no marked difference (62.1% in men, 64.9% in women).
In the index visit survey, patients had also been asked to rate their satisfaction with current ED treatment in a Likert-scaled item corresponding to the follow-up question. Of 281 follow-up patients with a respective baseline rating available, 87.9% had then selected “very satisfied” or “satisfied”, and rating in a thus combined category was concordant to the retrospective assessment at follow-up in 216 cases (76.9%). There were no significant longitudinal differences for satisfaction ratings if assessed by Wilcoxon signed-rank test (Likert scale interpreted as quasi-continuous, p = 0.432) or McNemar test (scale dichotomized in top two vs. other categories, p = 0.120). Data did not show a marked difference between consulters coming to the ED during office hours vs. off-hours (p = 0.423, Mann-Whitney-U-test, 325 cases).
Two hundred fifty-eight participants (81.4% of 317 patients with data for this item) stated that they had benefited from their ED visit. When inquired about reasons for assessing the ED visit as beneficial, aspects reported by 256 cases included the initiation of a necessary inpatient or outpatient treatment (50.4%), personal reassurance (46.1%), prevention of aggravation by timely intervention (47.3%), the detection of the complaints’ cause (40.6%) and feeling relieved (35.2%). Assessment of the ED visit as beneficial was moderately correlated with satisfaction (binarized to “very satisfied” / “satisfied” categories vs. other categories), with a phi coefficient of 0.52 (p < 0.001).
Univariable statistics indicated that patients with a pneumonia diagnosis did retrospectively assess the ED consultation significantly more frequently as beneficial (p = 0.010), as well as patients with respiratory failure (p = 0.001), while this was not the case for COPD, Asthma, RTI, or Upper Airway diagnoses. A rating of the visit as beneficial was also significantly more frequent in male patients (p = 0.001), patients triaged as of high urgency (p = 0.026) and self-referrers (p = 0.025). Male sex, pneumonia, respiratory failure, and self-referral were confirmed as determinants of retrospectively assessing the ED visit as beneficial in a subsequent multivariable logistic model controlling for demographics (age, education, and migration). Triage was no longer significant in the multivariable analysis (Table 3). An additional graphical representation of the regression results is included in the Additional file 1 (Supplementary Fig. 1).
Further morbidity markers (diagnoses of asthma, RTI, upper respiratory conditions, presence of a chronic pulmonary condition), as well as variables on out-of-hours consultation, symptom-associated distress at baseline, and attachment to a GP, were also evaluated for the multivariable model, but did not show themselves relevant contributive factors.
We also explored possible associations of the manner of follow-up response (telephone vs. writing) regarding ratings of satisfaction and subjective benefit from the ED visit. As to satisfaction, there were differences: in the telephone group, 82.5% rated satisfaction in the two top categories, while only 67.7% did so in written questionnaires (p = 0.009, χ2 test). This did not apply to rating the ED visit as beneficial, where proportions corresponded (81.7 and 80.0%, p = 0.771). Data did neither suggest an influence of follow-up time on either outcome, which was explored by comparing patients followed up at up to 95 days (median follow-up time) and at more than 95 days.
When revisiting their ED consultation at follow-up, 66 participants (21.4% of 309 cases with available data) believed a GP could also have solved their problem. This corresponds to the overall assessment in the baseline survey, where 20.6% (of 277 cases followed up with baseline data available for this item) considered primary care a suitable alternative in their acute situation. There was no significant difference between time points (McNemar test p = 0.332, 260 cases).
Health care utilization
For the time after the ED visit, 94.8% reported at least one contact with a health care provider or institution. Table 4 summarizes HCU during follow-up.
Compared to self-reported HCU in the baseline survey, increases were seen for GPs and pulmonologists, while longitudinal differences in ED and medical specialist consultations were not significant. The total of hospital inpatient days was also significantly higher in the period after the index ED visit, with mean numbers of hospital days almost doubled from pre-baseline for patients who had a hospital stay during the follow-up period. In the subgroup of hospital utilizers, ED utilization also showed a marked longitudinal increase (pre mean 0.5, SD 0.7; post mean 1.0, SD 1.5; p = 0.003). Figure 1 visualizes the longitudinal trends in HCU.
General and mental health
Self-reported general health on the 100-point visual analogue scale improved significantly between baseline and follow-up (pre mean 45.7, SD 24.9; post mean 61.5, SD 24.9; Wilcoxon signed-rank test p < 0.001, 316 cases). General life satisfaction was not changed (p = 0.092, 308 cases). As to mental health, PHQ-4 anxiety and depression scores decreased over time (both p < 0.001, 309 and 313 cases). Detailed results for general and mental health outcomes can be found in the Additional file 1 (supplementary Table 1).
Summary of findings
This study is one of very few quantitative longitudinal investigations focused on ED patients’ perspective rather than morbidity outcomes or re-admission determinants. Follow-up data was available for 329 patients at a median time of 95 days after baseline. Retrospective satisfaction ratings were high, waiting times constituting the most frequent reason for not being satisfied. Ratings did not significantly change from baseline. Male sex was indicated as a determinant of assessing the ED visit as beneficial by logistic regression, with pneumonia, respiratory failure, and self-referral as additional contributive factors. A corresponding share of participants at baseline and follow-up opined that a GP could have provided adequate alternative treatment, with no significant longitudinal difference.
HCU in the total follow-up cohort did increase for GPs and pulmonologists, while there was no longitudinal difference for ED consultations. Self-reported general health improved significantly between baseline and follow-up, as well as PHQ-4 scores. General life satisfaction was not changed.
Participants of lower educational status, migrants, and tourists were more likely to drop out of the study, while having a GP, as well as both multimorbidity and higher general life satisfaction, were independent determinants of response to the follow-up survey.
Results in context
Post hoc assessment of the ED visit
The retrospective view on ED care and its consequences was assessed by more than one question in this survey. We opted for a combination of items to capture dimensions of what could be described as patients’ “happiness” or “contentedness” with an ED visit. Patients surveys differ from consumer satisfaction surveys, as they have to consider both the process and the outcomes of care, as has been discussed by e.g. Hudak et al. . A concept of being “happy” with what happened at the ED and resulted from it thus includes organizational aspects (e.g. experiencing care as timely, friendly and professional), which was mainly captured by our items on satisfaction. However, it also encompasses the question of whether the consequences were positive health-wise: the visit should have contributed to improving health, or alleviating health-related concerns. This was aimed for by the question on “benefit” associated with the visit. Overall, we can derive from the items that only a minority of patients (~ 20%) is retrospectively discontent with an aspect of the ED visit, which is comparable in dimension to other investigations . Regarding satisfaction, areas of criticism also correspond to core problems identified by previous studies, like waiting times or interpersonal behavior [27, 28].
Concerning determinants of a “beneficial” judgment, differences in self-referrers and patients with more severe conditions seem not so surprising, as these may subjectively profit the most, concerning either reassurance or intervention in an urgent health crisis. For critically ill patients, the outcome is key, and aspects of comfort and service lose importance, which has been described as “the point of view paradox” . The sex differences seen are more puzzling to interpret: why do males rate the visits’ consequences more positively in retrospect? Literature on sex differences in assessment of emergency care mainly focuses on its role as a determinant of satisfaction, and results are conflicting: while some studies report higher service satisfaction in females [30, 31], many others did not show a difference [32, 33]. However, while sex is reported in most satisfaction evaluations and there is an abundancy of research on sex differences regarding ED treatment and outcome of specific conditions (including respiratory ), we could not identify any pertinent literature on sex-specific self-assessment of ED care as beneficial, or a related concept. Theoretically, the tendency of males in our sample to judge the benefit of care greater could be rooted in gender differences concerning perception of symptoms  or stress and anxiety , but this is certainly quite speculative. More concerningly, the results could indicate a genuine care gap with a tendency towards suboptimal care for women with respiratory complaints, as has been reported for cardiovascular conditions [37, 38]. Research suggesting a possible gender bias in e.g. diagnosing and managing COPD points in a similar direction, but these investigations were performed in a non-hospital setting [39, 40]. Differences in dissatisfaction reasons reported by men and women in our survey may also hint at women feeling undertreated and underinformed to a greater degree, with the obvious caveats of small patient numbers and a descriptive level. This issue clearly needs to be pursued in further studies.
The question of conceivable alternative care constitutes a further interesting facet of patients’ post hoc view on ED care. Interestingly, our study shows that this assessment does not change over time. This consistency suggests that patients’ judgment regarding the suitable care sector for a given situation is not markedly contorted by the acute experience of symptoms at the time of their ED consultation Conceivably, patients could have felt more urgent at the index visit than they might do in retrospect when revisiting the event, but this does not appear to be the case. While others have quantified proportions of non-urgent ED cases (e.g. ), with average reported rates amounting to more than 30% , it should be noted that we did not analyze patient data to delineate “real emergencies” vs. non-urgent cases, as it was not out aim to verify or disprove patient judgment. However, reasons why patients would prefer the ED go beyond medical considerations , and views might differ markedly from health professionals’ assessments [42, 43]. Results from the qualitative EMACROSS module have correspondingly illustrated the importance of patients’ self-assessment as genuine emergencies in urgent need of medical attention . Looking at triage categories in our study, 57.1% of the patients stating that a GP would have been a viable alternative were initially triaged in non-urgent levels 4 and 5, as compared to only 35.0% in the group that retrospectively viewed the ED as without alternative (p = 0.001). This accredits patients’ judgments with a degree of validity.
Health care utilization
Considering that many ED patients receive the discharge recommendation to visit an ambulatory provider for follow-up checks or prescription of medications, the longitudinal rise in respective visits is not surprising. However, increasing effects on HCU triggered by medication changes associated with the ED visit (such were reported by a quarter) might be short-term and revert to earlier levels in the further course , which we do not know as to the relatively short follow-up period. Concerning this question, it would be instructive to know about the exact time points of post-discharge provider visits, but this would require respective administrative secondary data.
Neither is it clear whether HCU reports do indicate a prevailing decline in health after the ED visit. Supposedly, ED visits and emergency house calls would potentially have spiked as well if this were the case. The rise in hospital days, but not ED visits, seems to suggest that this may be mainly due to health problems requiring elective hospital treatment. However, a corresponding recommendation was reported by only ~ 8%, while the share of patients requiring hospital care between index visit and follow-up is considerably larger. Data also showed that, while not significantly changed in the overall cohort, ED utilization increased for the subgroup of patients with a hospital stay during follow-up. This hints at frequent non-elective hospital admissions via ED visits in this population.
This is interesting in connection with the discussion of ED visits’ role as a “sentinel event” for worsening health, which has been claimed especially for older and sicker populations and return visits [46, 47]. In our cohort comprising both younger and generally healthy persons as well as the aged and multimorbid, this is less pronounced than in studies with e.g. heart failure patients, for which repeat hospitalizations and ED visits are part of a typical trajectory of end-stage disease . For our population, HCU data suggests that the notion of ED utilization as an early indicator of worsening health status is probably true for a share of patients, but not for the majority. It must be borne in mind however, that our data describes only patients surviving until they could be followed up, the 15 patients with the direst consequences not being represented. On the other hand, non-response to follow-up was greater for healthier participants, for which the ED visit might have been of minor impact.
General and mental health
A detailed analysis of general health and life satisfaction has been recently published for the entirety of the EMANet studies , of which EMACROSS represents one of three sub-projects. Self-reported health in ED patients across different symptom spectrums was found considerably lower compared to representative samples of German adults (visual analogue scale mean of ~ 77) , which corresponds to findings of poor self-reported health in other ED populations [51, 52]. Based on these results, it was concluded that ED visits indicate a serious health event with acute impact on well-being . Our longitudinal data however shows tendential regression towards “average” population levels: acute events seemingly loose its repercussion over time. This is in line with findings from a longitudinal ED study of patients with lower respiratory tract infections and cardiac diseases, in which negative affects decreased during follow-up . The striking longitudinal difference in self-reported general health suggests that baseline ratings probably rather reflect the acute event-related plight of the emergency than health status in general. The same could be the case for PHQ-4 scores, which are intended to cover anxiety and depression symptoms over the past two weeks, as opposed to symptom-related distress associated with the acute situation. Longitudinal trends give reason to suspect that the ED situation may have influenced judgment here. Thus, the PHQ-4, having been originally validated in a primary care setting , may be less suitable for assessing mental health in ED research, which should be considered when planning future studies. In our EMANet sister study EMASPOT focusing on patients with cardiac complaints and comorbid mental health conditions, the more extended PHQ-9 and GAD-7 were used as screening tools, and results regarding diagnostic accuracy indicate that these might be more suitable in an ED population . Others have correspondingly reported good reliability and validity for the PHQ-9 in the ED . Another conceivable explanation for the longitudinal improvement in mental health symptom burden in our cohort could be rooted in mental health conditions going along with and aggravating somatic symptoms like breathlessness . Thus, acute episodes of depression or anxiety might have played a role in triggering respiratory ED consultations, and remission over time  could have caused part of the trends seen. It must be noted in this regard that PHQ-4 scores at follow-up in our population were higher than reported from other evaluations of longitudinal trends in unselected medical ED patients , which may also reflect the specific nature of respiratory symptoms .
Life satisfaction ratings seem to be more constant, being less health-related and thus presumedly entailing a lesser potential for situational distortion. In our analysis of the whole EMANet cohort, life satisfaction also appeared a rather stable construct less affected by acute circumstances . Ratings also correspond in dimension to representative evaluations of the general population . Furthermore, consistency of life satisfaction ratings over time does support the impression of ED visits not constituting a clear sentinel for deterioration of health for most of our population.
Determinants and implications of dropout
Survey non-response is frequently not at random but associated with patient characteristics and health-related outcomes [60, 61], and the demographic and medical diversity of ED consulters may promote disproportional susceptibility to attrition. Certain groups have been identified by others as tendentially more prone to drop out of longitudinal studies: patients with low socioeconomic and educational status, members of ethnic minorities, as well as patients with mental health problems [62,63,64,65]. This corresponds to lower education status and migration history identified as determinants of dropout in our study. Concerning education, this association did only show in the regression analysis, which underscores the importance of investigating dropout by multivariable methods. Reasons for selective non-response of migrants have been discussed, conceivable explanations encompassing language barriers and difficulties to be reached . Loss of tourists to follow-up is also not surprising, as such tendentially younger and more mobile patients may have utilized the ED more “casually”, as the most obvious place to turn to when ill while on travel, for lack of knowledge about conceivable alternative options. Such consulters could potentially be less interested to take part in a study follow-up and might be more difficult to reach, with the additional issue of language barriers. On the other hand, presence of chronic conditions (as indicated by the multimorbidity variable) and attachment to a GP may characterize people for which the ED visit could have had larger impact on their health and health care situation. These may have been more motivated to take part in the follow-up survey. While the post-ED death rate in our study does not seem to be unusually high [67, 68], death has to be considered as a source of attrition bias as well, especially concerning data on HCU: very ill and/or old people who died prior to intended follow-up may also have been high-volume utilizers in the last period of their life . This is inherently not represented in our data.
Firstly, we must stress that the results presented must be regarded with due interpretative caution considering the limited sample size of this follow-up study. While the dropout rate corresponds in dimension to other longitudinal survey studies following up ED visits [70, 71], potential attrition-related distortion of data is an issue of concern, as discussed above. We did investigate and present non-responder characteristics comprehensively and discussed potential distortions of results. Encouragingly, the influence of differential dropout on association estimates has been suggested as modest in several investigations [65, 72,73,74].
As to the retrospective nature of the follow-up survey, recall bias may also threaten validity. Such has been described as potentially considerable for HCU data . While there is no consensus on optimal length of recall periods, better accuracy of self-reported HCU has been reported for shorter time frames, compared to e.g. yearly assessment . Then again, tendential overreporting has been problematized for shorter periods .
Use of Likert scales for ED patient satisfaction is common , but they have been criticized as potentially skewed, low-dimensional and prone to ceiling effects . By combining the satisfaction item with the question on benefit from the visit, our questionnaire intended to capture the whole spectrum of “good” or “bad” that subjectively comes out of a consultation, beyond process-oriented patient satisfaction. However, we must stress that this approach had an explorative character, as there currently is no established tool which integrates both satisfaction and outcome aspects. Existing validated instruments like the Consumer Emergency Care Satisfaction Scale (CECSS)  e.g. capture process aspects comprehensively, but do not include views on outcome. However, there are promising approaches: for patient-reported outcomes, Canadian researchers have recently published a validation study of a tool (PROM-ED)  aimed at capturing cardinal outcome domains identified from qualitative data .
Regarding the validity of patient-reported care satisfaction, the difference in ratings derived from telephone interviews vs. written questionnaires suggests that social desirability bias might be an important concern, dissatisfaction having been potentially more freely expressed in writing. Ratings of the visit as beneficial may be less affected by this bias source, as no differences could be noted. The discrepancy to satisfaction ratings underscores the notion that this survey item in fact captures a concept distinct from process-oriented satisfaction. As to validity, it must also be noted that this follow-up study had an explorative rather than confirmatory character. While validated scales and items were used if available (e.g. PHQ), many items were newly formulated on a theoretical basis, and we cannot be sure whether data sufficiently reflects the intended constructs. Additionally, some results could be spurious as to the problem of multiple univariable statistical testing. As to multivariable investigations, the models reported are also considerably more explorative and less supported by prior knowledge than e.g. clinical risk factor models. This calls for caution regarding any causal inference from these models. Interpretation of effect estimates of covariate factors is also problematic . Potential bias resulting from missing data is a problem in many surveys as well as in secondary data analyses. Missingness in single variables was mostly well below 5%, but had cumulating effects in the multivariable models using listwise deletion which may have influenced results.
Lastly, we must stress that our population consisted exclusively of patients with respiratory symptoms and results may reflect the specific nature of such (e.g., association of acute dyspnea with situational anxiety). The focus of recruitment on regular office hours also limits representativeness. Thus, inferences may not be readily generalizable to unselected ED patient populations.
Our results indicate that most patients in this respiratory cohort are content with the ED visit and its outcome. Satisfaction with the care process could be improved by efforts to shorten waiting times and by working on seemingly trivial interpersonal aspects: friendly and respectful interaction, showing empathy with patients’ concerns, etc. However, patients are more than just customers , and thus subjective benefit from a consultation could be considered the more important outcome compared to a pleasant user experience.
In the debate concerning non-urgent ED visits, diversion to primary care is often proposed. Our data shows that self-assessment regarding the adequate care setting remains constant with distance of time to the ED visit. This suggests that patient judgments are rooted in more than situational anxiety. It would thus seem sensible for any efforts of redirecting utilizers to primary care to consider patients’ views and preferences adequately to assure acceptance. Patient-reported judgment however does not tell us whether primary care would have in fact been an appropriate alternative from a medical point of view.
ED consultations in our cohort do not indicate imperative deterioration of health in their aftermath, and life post-visit for many seems to go “back to normal”, especially if no underlying chronic illness is present. This may be symptom-specific however, as respiratory complaints do not always indicate serious disease.
Lastly, our study suggests that sex differences in perception of care and outcome may constitute a topic not yet studied sufficiently in health services research – in the ED and other settings. The trends suggested by our study should be further investigated in gender-focused ED research.
Availability of data and materials
The datasets used and analyzed during this study are available from the corresponding author on reasonable request. Raw data is not deposited publicly, as this is not explicitly covered by participants’ informed consent.
Emergency and Acute Care for Respiratory Diseases beyond Sectoral Separation
Manchester Triage System
Emergency medical services
Emergency and Acute Medicine Network for Health Care Research Berlin
Health care utilization
Patient Health Questionnaire
Area under the curve
Receiver operating characteristic
Comparative Analysis of Social Mobility in Industrial Nations
Chronic obstructive pulmonary disease
International Classification of Diseases
Respiratory tract infection
Consumer Emergency Care Satisfaction Scale
Patient-Reported Outcome Measure for Emergency Department Care
Generalized Anxiety Disorder Scale
Systematic Screening for Comorbid Psychological Conditions in Cardiac ACSC Patients with Multimorbidity in the ED
Pines JM, Hilton JA, Weber EJ, Alkemade AJ, Al Shabanah H, Anderson PD, et al. International perspectives on emergency department crowding. Acad Emerg Med. 2011;18(12):1358–70.
Morley C, Unwin M, Peterson GM, Stankovich J, Kinsman L. Emergency department crowding: a systematic review of causes, consequences and solutions. PLoS One. 2018;13(8):e0203316.
Lega F, Mengoni A. Why non-urgent patients choose emergency over primary care services? Empirical evidence and managerial implications. Health Policy. 2008;88(2–3):326–38.
Penson R, Coleman P, Mason S, Nicholl J. Why do patients with minor or moderate conditions that could be managed in other settings attend the emergency department? Emerg Med J. 2012;29(6):487–91.
Uscher-Pines L, Pines J, Kellermann A, Gillen E, Mehrotra A. Emergency department visits for nonurgent conditions: systematic literature review. Am J Manag Care. 2013;19(1):47–59.
Schmiedhofer M, Mockel M, Slagman A, Frick J, Ruhla S, Searle J. Patient motives behind low-acuity visits to the emergency department in Germany: a qualitative study comparing urban and rural sites. BMJ Open. 2016;6(11):e013323.
Cowling TE, Cecil EV, Soljak MA, Lee JT, Millett C, Majeed A, et al. Access to primary care and visits to emergency departments in England: a cross-sectional, population-based study. PLoS One. 2013;8(6):e66699.
Durand A-C, Palazzolo S, Tanti-Hardouin N, Gerbeaux P, Sambuc R, Gentile S. Nonurgent patients in emergency departments: rational or irresponsible consumers? Perceptions of professionals and patients. BMC Res Notes. 2012;5:525.
Holzinger F, Oslislo S, Möckel M, Schenk L, Pigorsch M, Heintze C. Self-referred walk-in patients in the emergency department - who and why? Consultation determinants in a multicenter study of respiratory patients in Berlin, Germany. BMC Health Serv Res. 2020;20(1):848.
Holzinger F, Oslislo S, Resendiz Cantu R, Möckel M, Heintze C. Diverting less urgent utilizers of emergency medical services to primary care: is it feasible? Patient and morbidity characteristics from a cross-sectional multicenter study of self-referring respiratory emergency department consulters. BMC Res Notes. 2021;14(1):113.
Brown CJ, Kennedy RE, Lo AX, Williams CP, Sawyer P. Impact of emergency department visits and hospitalization on mobility among community-dwelling older adults. Am J Med. 2016;129(10):1124.e9–e15.
Rosychuk RJ, Holroyd BR, Zhang X, Rowe BH, Graham MM. Sex differences in outcomes after discharge from the emergency department for atrial fibrillation/flutter. Can J Cardiol. 2017;33(6):806–13.
Quintana JM, Esteban C, Garcia-Gutierrez S, Aguirre U, Gonzalez N, Lafuente I, et al. Predictors of hospital admission two months after emergency department evaluation of COPD exacerbation. Respiration. 2014;88(4):298–306.
Lin MP, Burke RC, Orav EJ, Friend TH, Burke LG. Ambulatory follow-up and outcomes among Medicare beneficiaries after emergency department discharge. JAMA Netw Open. 2020;3(10):e2019878.
Kraaijvanger N, Rijpsma D, Willink L, Lucassen P, van Leeuwen H, Edwards M. Why patients self-refer to the emergency department: a qualitative interview study. J Eval Clin Pract. 2017;23(3):593–8.
Schmiedhofer M, Inhoff T, Krobisch V, Schenk L, Rose M, Holzinger F, et al. EMANet: a regional network for health services research in emergency and acute medicine. Z Evid Fortbild Qual Gesundhwes. 2018;135-136:81–8.
Oslislo S, Heintze C, Möckel M, Schenk L, Holzinger F. What role does the GP play for emergency department utilizers? A qualitative exploration of respiratory patients’ perspectives in Berlin, Germany. BMC Fam Pract. 2020;21(1):154.
Kroenke K, Spitzer RL, Williams JB, Lowe B. An ultra-brief screening scale for anxiety and depression: the PHQ-4. Psychosomatics. 2009;50(6):613–21.
Beierlein C, Kovaleva A, László Z, et al. Eine Single-Item-Skala zur Erfassung der Allgemeinen Lebenszufriedenheit: Die Kurzskala Lebenszufriedenheit-1 (L-1). Mannheim: Leibniz-Institute für Sozialwissenschaften (Gesis); 2014.
Rattay P, Butschalowsky H, Rommel A, Prutz F, Jordan S, Nowossadeck E, et al. Utilization of outpatient and inpatient health services in Germany: results of the German Health Interview and Examination Survey for Adults (DEGS1). Bundesgesundheitsblatt Gesundheitsforschung Gesundheitsschutz. 2013;56(5–6):832–44.
Palli SR, Xie B, Chastek B, Elliott CA, Bengtson LGS. Comparison of COPD health care utilization and associated costs across patients treated with LAMA+LABA fixed-dose therapies. J Manag Care Spec Pharm. 2021;27(7):810–24.
Heinze G, Wallisch C, Dunkler D. Variable selection - a review and recommendations for the practicing statistician. Biom J. 2018;60(3):431–49.
Stoltzfus JC. Logistic regression: a brief primer. Acad Emerg Med. 2011;18(10):1099–104.
Smith G. Step away from stepwise. J Big Data. 2018;5(1):32.
Hudak PL, McKeever P, Wright JG. The metaphor of patients as customers: implications for measuring satisfaction. J Clin Epidemiol. 2003;56(2):103–8.
Pitrou I, Lecourt AC, Bailly L, Brousse B, Dauchet L, Ladner J. Waiting time and assessment of patient satisfaction in a large reference emergency department: a prospective cohort study, France. Eur J Emerg Med. 2009;16(4):177–82.
Soares AM, Farhangmehr M. Understanding patient satisfaction in a hospital emergency department. Int Rev Public Nonprofit Mark. 2015;12(1):1–15.
Nerney MP, Chin MH, Jin L, Karrison TG, Walter J, Mulliken R, et al. Factors associated with older patients’ satisfaction with care in an inner-city emergency department. Ann Emerg Med. 2001;38(2):140–5.
Schwab RA. Emergency department customer satisfaction: the point of view paradox. Ann Emerg Med. 2000;35(5):499–501.
Son H, Yom YH. Factors influencing satisfaction with emergency department medical service: patients’ and their companions’ perspectives. Jpn J Nurs Sci. 2017;14(1):27–37.
Abolfotouh M, Al-Assiri M, Alshahrani R, Almutairi Z, Hijazi R, Alaskar A. Predictors of patient satisfaction in an emergency care centre in central Saudi Arabia: a prospective study. Emerg Med J. 2016;34:1–7.
Natesan P, Hadid D, Harb YA, Hitti E. Comparing patients and families perceptions of satisfaction and predictors of overall satisfaction in the emergency department. PLoS One. 2019;14(8):e0221087.
Goldwag R, Berg A, Yuval D, Benbassat J. Predictors of patient dissatisfaction with emergency care. Isr Med Assoc J. 2002;4(8):603–6.
Singh AK, Cydulka RK, Stahmer SA, Woodruff PG, Camargo CA Jr, Investigators ftMARC. Sex differences among adults presenting to the emergency department with acute asthma. Arch Int Med. 1999;159(11):1237–43.
van Wijk CMTG, Kolk AM. Sex differences in physical symptoms: the contribution of symptom perception theory. Soc Sci Med. 1997;45(2):231–46.
Patel R, Biros MH, Moore J, Miner JR. Gender differences in patient-described pain, stress, and anxiety among patients undergoing treatment for painful conditions in the emergency department. Acad Emerg Med. 2014;21(12):1478–84.
Gargano JW, Wehner S, Reeves MJ. Do presenting symptoms explain sex differences in emergency department delays among patients with acute stroke? Stroke. 2009;40(4):1114–20.
D’Onofrio G, Safdar B, Lichtman JH, Strait KM, Dreyer RP, Geda M, et al. Sex differences in reperfusion in young patients with ST-segment–elevation myocardial infarction. Circulation. 2015;131(15):1324–32.
Chapman KR, Tashkin DP, Pye DJ. Gender bias in the diagnosis of COPD. Chest. 2001;119(6):1691–5.
Delgado A, Saletti-Cuesta L, López-Fernández LA, Gil-Garrido N, Luna del Castillo JD. Gender inequalities in COPD decision-making in primary care. Respir Med. 2016;114:91–6.
O’Keeffe C, Mason S, Jacques R, Nicholl J. Characterising non-urgent users of the emergency department (ED): a retrospective analysis of routine ED data. PLoS One. 2018;13(2):e0192855.
Gill JM, Riley AW. Nonurgent use of hospital emergency departments: urgency from the patient’s perspective. J Fam Pract. 1996;42(5):491–6.
Morgans A, Burgess SJ. What is a health emergency? The difference in definition and understanding between patients and health professionals. Austral Health Rev. 2011;35(3):284–9.
Oslislo S, Kümpel L, Cantu RR, Möckel M, Heintze C, Holzinger F. Bin ich ein Notfall? Notfallempfinden und Entscheidungskompetenz in akuten Situationen: eine qualitative Erhebung bei Notaufnahmepatient*innen. Z Evid Fortbild Qual Gesundhwes. 2021;165:43–50.
Stempel DA, Roberts CS, Stanford RH. Treatment patterns in the months prior to and after asthma-related emergency department visit. Chest. 2004;126(1):75–80.
Lowthian J, Straney LD, Brand CA, Barker AL, Smit PV, Newnham H, et al. Unplanned early return to the emergency department by older patients: the safe elderly emergency department discharge (SEED) project. Age Ageing. 2016;45(2):255–61.
Bernstein E. Repeat visits by elder emergency department patients: sentinel events. Acad Emerg Med. 1997;4(6):538–9.
Bakal JA, McAlister FA, Liu W, Ezekowitz JA. Heart failure re-admission: measuring the ever shortening gap between repeat heart failure hospitalizations. PLoS One. 2014;9(9):e106494.
Schneider A, Riedlinger D, Pigorsch M, Holzinger F, Deutschbein J, Keil T, et al. Self-reported health and life satisfaction in older emergency department patients: sociodemographic, disease-related and care-specific associated factors. BMC Public Health. 2021;21(1):1440.
Janssen B, Szende A. Population norms for the EQ-5D. In: Szende A, Janssen B, Cabases J, editors. Self-reported population health: an international perspective based on EQ-5D. Dordrecht: Springer; 2014.
Baggio S, Iglesias K, Hugli O, Burnand B, Ruggeri O, Wasserfallen J-B, et al. Associations between perceived discrimination and health status among frequent emergency department users. Eur J Emerg Med. 2017;24(2):136–41.
Koivunen M, Harju S, Kauko T, Välimäki M. Alcohol risk drinking, quality of life and health state among patients treated at the sobering unit in the emergency department – one year follow-up study. Int Emerg Nurs. 2017;31:22–9.
Faessler L, Brodbeck J, Schuetz P, Haubitz S, Mueller B, Perrig-Chiello P. Medical patients’ affective well-being after emergency department admission: the role of personal and social resources and health-related variables. PLoS One. 2019;14(3):e0212900.
Figura A, Kuhlmann SL, Rose M, Slagman A, Schenk L, Möckel M. Mental health conditions in older multimorbid patients presenting to the emergency department for acute cardiac symptoms: cross-sectional findings from the EMASPOT study. Acad Emerg Med. https://doi.org/10.1111/acem.14349 Online ahead of print.
Barbic S, MacEwan WG, Leon A, Chau S, Barbic D. LO60: validation of the PHQ-9 as a screen for depression in the emergency department. CJEM. 2017;19(S1):S48.
Currow DC, Chang S, Reddel HK, Kochovska S, Ferreira D, Kinchin I, et al. Breathlessness, anxiety, depression, and function–the BAD-F study: a cross-sectional and population prevalence study in adults. J Pain Symptom Manag. 2020;59(2):197–205.e2.
Whiteford HA, Harris MG, McKeon G, Baxter A, Pennell C, Barendregt JJ, et al. Estimating remission from untreated major depression: a systematic review and meta-analysis. Psychol Med. 2012;43(8):1569–85.
Faessler L, Kutz A, Haubitz S, Mueller B, Perrig-Chiello P, Schuetz P. Psychological distress in medical patients 30 days following an emergency department admission: results from a prospective, observational study. BMC Emerg Med. 2016;16(1):33.
Halpin D, Hyland M, Blake S, Seamark C, Pinnuck M, Ward D, et al. Understanding fear and anxiety in patients at the time of an exacerbation of chronic obstructive pulmonary disease: a qualitative study. JRSM Open. 2015;6(12):2054270415614543.
Chatfield MD, Brayne CE, Matthews FE. A systematic literature review of attrition between waves in longitudinal studies in the elderly shows a consistent pattern of dropout between differing studies. J Clin Epidemiol. 2005;58(1):13–9.
Fan W, Yan Z. Factors affecting response rates of the web survey: a systematic review. Comput Hum Behav. 2010;26(2):132–9.
Canivet C, Nilsson A, Björk J, Moghaddassi M, Östergren P-O. Assessment of selection bias due to dropouts in the follow-up of the Scania Public Health Cohort. Scand J Public Health. 2020;49(4):457–64.
Eisner NL, Murray AL, Eisner M, Ribeaud D. A practical guide to the analysis of non-response and attrition in longitudinal research using a real data example. Int J Behav Dev. 2018;43(1):24–34.
Gustavson K, von Soest T, Karevold E, Røysamb E. Attrition and generalizability in longitudinal studies: findings from a 15-year population-based study and a Monte Carlo simulation study. BMC Public Health. 2012;12(1):918.
Tin Tin S, Woodward A, Ameratunga S. Estimating bias from loss to follow-up in a prospective cohort study of bicycle crash injuries. Inj Prev. 2014;20(5):322–9.
Maehler DB, Martin S, Rammstedt B. Coverage of the migrant population in large-scale assessment surveys. Experiences from PIAAC in Germany. Large-Scale Assess Educ. 2017;5(1):9.
Hofman SE, Lucke JA, Heim N, de Gelder J, Fogteloo AJ, Heringhaus C, et al. Prediction of 90-day mortality in older patients after discharge from an emergency department: a retrospective follow-up study. BMC Emerg Med. 2016;16(1):26.
Genao L, Durheim MT. Early and long-term outcomes of older adults after acute care encounters for chronic obstructive pulmonary disease exacerbation. Ann Am Thorac Soc. 2015;12(12):1805–12.
Öhlén J, Jakobsson Ung E, Bergh I, Odén A, Gaston Johansson F. Utilization of health-care services at the end-of-life. Health Policy. 2007;82(3):276–87.
Hall AG, Schumacher JR, Brumback B, Harman JS, Lutz BJ, Hendry P, et al. Health-related quality of life among older patients following an emergency department visit and emergency department-to-home coaching intervention: a randomized controlled trial. Int J Care Coord. 2017;20(4):162–70.
Nicks BA, Shah MN, Adler DH, Bastani A, Baugh CW, Caterino JM, et al. Minimizing attrition for multisite emergency care research. Acad Emerg Med. 2017;24(4):458–66.
Osler M, Kriegbaum M, Christensen U, Lund R, Nybo Andersen AM. Loss to follow up did not bias associations between early life factors and adult depression. J Clin Epidemiol. 2008;61(9):958–63.
Kempen GI, van Sonderen E. Psychological attributes and changes in disability among low-functioning older persons: does attrition affect the outcomes? J Clin Epidemiol. 2002;55(3):224–9.
Wolke D, Waylen A, Samara M, Steer C, Goodman R, Ford T, et al. Selective drop-out in longitudinal studies and non-biased prediction of behaviour disorders. Br J Psychiatry. 2018;195(3):249–56.
Hunger M, Schwarzkopf L, Heier M, Peters A, Holle R. Official statistics and claims data records indicate non-response and recall bias within survey-based estimates of health care utilization in the older population. BMC Health Serv Res. 2013;13:1.
Short ME, Goetzel RZ, Pei X, Tabrizi MJ, Ozminkowski RJ, Gibson TB, et al. How accurate are self-reports? Analysis of self-reported health care utilization and absence when compared with administrative data. J Occup Environ Med. 2009;51(7):786–96.
Brusco NK, Watts JJ. Empirical evidence of recall bias for primary health care visits. BMC Health Serv Res. 2015;15(1):381.
Trout A, Magnusson AR, Hedges JR. Patient satisfaction investigations and the emergency department: what does the literature say? Acad Emerg Med. 2000;7(6):695–709.
Voutilainen A, Pitkäaho T, Kvist T, Vehviläinen-Julkunen K. How to ask about patient satisfaction? The visual analogue scale is less vulnerable to confounding factors and ceiling effect than a symmetric Likert scale. J Adv Nurs. 2016;72(4):946–57.
Kristensson J, Ekwall A. Psychometric properties of the consumer emergency care satisfaction scale. J Nurs Care Qual. 2008;23:277–82.
Vaillancourt S, Cullen JD, Dainty KN, Inrig T, Laupacis A, Linton D, et al. PROM-ED: development and testing of a patient-reported outcome measure for emergency department patients who are discharged home. Ann Emerg Med. 2020;76(2):219–29.
Vaillancourt S, Seaton MB, Schull MJ, Cheng AHY, Beaton DE, Laupacis A, et al. Patients’ perspectives on outcomes of care after discharge from the emergency department: a qualitative study. Ann Emerg Med. 2017;70(5):648–58.e2.
Westreich D, Greenland S. The table 2 fallacy: presenting and interpreting confounder and modifier coefficients. Am J Epidemiol. 2013;177(4):292–8.
The authors would like to thank the participating hospitals in the EMANet research network, namely Charité – Universitätsmedizin Berlin (Campus Charité Mitte and Campus Virchow-Klinikum), St. Hedwig Hospital (Alexianer St. Hedwig-Krankenhaus Berlin), Elisabeth Hospital (Evangelische Elisabeth Klinik der Paul-Gerhardt Diakonie), Franziskus Hospital (Franziskus-Krankenhaus Berlin), German Armed Forces Hospital Berlin (Bundeswehr Krankenhaus Berlin), German Red Cross Hospital Berlin-Mitte (DRK Kliniken Berlin-Mitte), and the Berlin Jewish Hospital (Jüdisches Krankenhaus Berlin). The authors would like to thank all study participants as well as all EMANet researchers and study personnel responsible for study planning, patient recruitment, and data management.
Open Access funding enabled and organized by Projekt DEAL. This study is part of the project EMANet, which is funded by the Federal Ministry of Education and Research (BMBF), grant numbers 01GY1604 and 01GY1914. The funding body had no role in the design and conduct of the study, data collection, analysis, and interpretation of the data, nor in the preparation, review, and approval of the manuscript.
Ethics approval and consent to participate
The study was approved by the ethics committee of Charité – Universitätsmedizin Berlin (EA1/361/16). Written informed consent was obtained from all participants. All methods were performed in accordance with the relevant guidelines and regulations.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Forest plot of odds ratios from logistic regression model of rating ED visit as beneficial. Supplementary table 1. Self-reported general health, life satisfaction, and mental health measures, longitudinal comparison (baseline / follow-up).
About this article
Cite this article
Holzinger, F., Oslislo, S., Kümpel, L. et al. Emergency department consultations for respiratory symptoms revisited: exploratory investigation of longitudinal trends in patients’ perspective on care, health care utilization, and general and mental health, from a multicenter study in Berlin, Germany. BMC Health Serv Res 22, 169 (2022). https://doi.org/10.1186/s12913-022-07591-5
- Emergency department
- Patient satisfaction
- Health care utilization
- Respiratory conditions