Predicting the need for supportive services after discharged from hospital: a systematic review
BMC Health Services Research volume 20, Article number: 161 (2020)
Some patients admitted to acute care hospital require supportive services after discharge. The objective of our review was to identify models and variables that predict the need for supportive services after discharge from acute care hospital.
We performed a systematic review searching the MEDLINE, CINAHL, EMBASE, and COCHRANE databases from inception to May 1st 2017.
We selected studies that derived and validated a prediction model for the need for supportive services after hospital discharge for patients admitted non-electively to a medical ward. We extracted cohort characteristics, model characteristics and variables screened and included in final predictive models. Risk of bias was assessed using the Quality in Prognostic Studies tool.
Our search identified 3362 unique references. Full text review identified 6 models. Models had good discrimination in derivation (c-statistics > 0.75) and validation (c-statistics > 0.70) cohorts. There was high quality evidence that age, impaired physical function, disabilities in performing activities of daily living, absence of an informal care giver and frailty predict the need for supportive services after discharge. Stroke was the only unique diagnosis with at least moderate evidence of an independent effect on the outcome. No models were externally validated, and all were at moderate or higher risk of bias.
Deficits in physical function and activities of daily living, age, absence of an informal care giver and frailty have the strongest evidence as determinants of the need for support services after hospital discharge.
This review was registered with PROSPERO #CRD42016037144.
Patients discharged from hospital often have impaired ability to perform instrumental activities of daily living (IADLs - e.g. meal preparation, managing finances or house work) and activities of daily living (ADLs – e.g. dressing, bathing and toileting) . While many patients eventually recover to their pre-hospital level of function, 30–50% never do . This is especially true for frail elderly patients with multiple comorbidities, who often require community based supportive services, or transition to a long-term care facility to meet their care needs .
Matching a patient’s need for assistance to appropriate support services is important as it can minimize the risk of unplanned readmissions and adverse events post discharge . However, assessing the need for assistance requires resources. Early prediction of a patient’s need for support services after hospital discharge could improve patient care and reduce costs. This could be achieved by completing assessments of functional status early in the hospital course, in order to facilitate timely coordination of community services or alternate discharge locations.
Several models have been proposed to predict the location of discharge or the level of supportive services required after discharge. However, there is only one review of tools to predict location of discharge and it only used qualitative synthesis to describe them . No review has compared validated models that predict the need for supportive services after discharge to home or an institutional setting. Given the importance of identifying individuals in need of post-discharge services, and the heterogeneity of models and predictors in the literature to date, our primary objective was to identify validated models that predict the need for any support service after discharge from a non-elective general medicine hospitalization, and evaluate the strength of evidence for predictor variables.
This systematic review is reported according to the Preferred Reporting Items for Systematic reviews and Meta-analyses (PRISMA) checklist with the protocol published and registered at PROSPERO (Protocol #CRD42016037144) [6, 7].
We included retrospective and prospective studies that derived and validated a predictive model for the need for supportive services for adults (≥18 years of age) discharged from a non-elective general medical inpatient ward or medical sub-specialty ward. We defined supportive services as medical care or formal assistance with IADLS or ADLs at home or in an institutional environment (e.g., skilled nursing facility). We excluded studies of patients admitted to rehabilitation hospitals and studies where patients were discharged to a rehab hospital or long-term acute care hospital that was not the final discharge destination. We limited the review to validated models to avoid variables that have spurious associations with the outcome due to random chance or overfitting . Internal validation will not detect all over fitting but in order to increase the number of studies in our review we considered a model validated if it had at a minimum performed internal validation.
Literature search and information sources
Our search strategy was designed in an iterative process with the assistance of a medical information specialist. We used medical subject headings (MeSH) terms and free text terms representing the included study types, population, and outcomes. To account for geographical variations in describing supportive services we included terms such as home care, skilled nursing facility, care home, and nursing home (see Additional file 1). Our search strategy formatted for MEDLINE can be found in Additional file 1. We searched the MEDLINE, CINAHL, EMBASE, and COCHRANE databases from inception to May 1st 2017 with no limitation based on language. We hand searched the reference lists of published systematic reviews, and eligible studies. Duplicates were removed prior to stage 1 screening.
Study selection and data collection
The title and abstract of all references were screened for eligibility independently by two reviewers (DIM, JN, or BN). Studies written in a language other than English were translated using Google© Translate prior to screening . Full-text articles for all potentially eligible papers were obtained and reviewed in duplicate by two independent reviewers. Data extraction was performed independently and in duplicate with all eligibility and extraction disagreements resolved by consensus. Screening and data extraction were performed with Distiller SR® (Ottawa, Canada).
The data extraction was guided by the Checklist for critical Appraisal and data extraction for systematic Reviews of prediction Modelling Studies (CHARMS) . Our data extraction form was pilot tested on for 2 studies, modified and then used for the remaining studies. All data extraction was performed in duplicate with disagreements resolved by consensus. We extracted study characteristics including setting, design, prognostic variable collection timeframe, and sample size for the derivation and validation cohorts. We collected patient characteristics including the mean age of participants, most common admitting diagnoses, and predictor variables used in model development. We collected model characteristics including variable selection method, method of screening variables for inclusion, and variables included in the final model, discrimination and calibration.
Synthesis of results
Our primary analysis was a narrative description of models that predict the need for supportive services after discharge, and the predictor variables included in the models.
Risk of bias and quality of evidence
Two reviewers (DK and DIM) independently used the Quality In Prognosis Studies (QUIPS) tool to assess the methodological quality of each study with disagreements resolved by discussion and consensus .
The quality of evidence for each predictor variable was summarized using the Grading of Recommendations Assessment, Development and Evaluation (GRADE) tool that has been adapted for use in narrative systematic reviews of prognostic studies . Predictor variables that were associated with the outcome in a single study were not included in the strength of evidence analysis.
Causal pathway creation
We constructed a causal pathway using the predictor variables identified in our review, informed by the concepts of directed acyclic graphs . Directed acyclic graphs are a graphical method for representing causal relationships. Predictor variables that were associated with the outcome only in univariable analysis but not in multivariate analyses were assumed to be confounders or to be indirectly causing the outcome through a more direct effect mediator . The causal pathway construction was guided by the review results and by the expert knowledge of the authors in an iterative process.
Role of the funding source
No funding source.
Our predefined search strategy identified 3361 titles; none were identified through searching reference lists of published systematic reviews, and review of included study reference lists identified 1 more. The screening process and reasons for exclusion at each step are presented in Fig. 1.
We identified 6 studies describing 6 prediction models that that met our inclusion criteria, which included 7075 patients [15,16,17,18,19,20]. Four studies were from North America, one from Australia, and one from Europe. Four included general medicine patients and two included specific subpopulations that could be cared for on a general medical ward (stroke patients and patients with advanced cirrhosis) (Table 1).
The mean age of patients in the derivation cohorts ranged from 55 to 83 years.
Risk of Bias
The risk of bias for included studies was moderate to high for most studies (Table 2).
Inadequate description of the source population’s inclusion and exclusion criteria was found in 5 of 6 included studies.
Four studies used univariable analysis to screen for predictors to be used for modeling while the other two studies used clinical reasoning to select predictor variables. To build the final model, five prediction models used various automated selection algorithms while one included all the variables that were hypothesized to be predictive (Table 3).
Four models used predictors that were available with in the first 24 h of hospital admission while two models used variables collected throughout the hospital stay. All prediction models had a binary outcome as the dependent variable; however, each study defined the outcome differently (Table 3). Four models defined the outcome as a place (home, care facility, or rehabilitation hospital) while two models defined the outcome as the need for support services after discharge. Model discrimination was generally good (range derivation C-statistics 0.75–0.85) and similar but slightly lower in the validation cohorts (range validation C-statistics 0.70–0.80) with one study not reporting discrimination statistics. Two models tested calibration with the Hosmer-Lemeshow goodness of fit test and found no evidence of poor fit. Other calibration metrics, such as calibration plots, were not reported.
All variables associated with the need for post discharge supportive services in predictive models are presented in Table 3. Many variables were associated with the outcome in univariable analysis in a single study but not in multivariate analyses. Variables present in 2 or more studies were assessed for the strength of evidence using the GRADE tool (Table 4).
Strength of Evidence + very low; ++ low; +++ moderate; ++++ high. The overall quality of evidence for a factor is rated as high if it comes from explanatory research aimed at understanding causal pathways (phase of investigation 3) or moderate if it comes from prediction research aimed at identifying associations (phase of investigation 2). The quality of the evidence is then downgraded if there are study limitations, inconsistency, indirectness, imprecision or publication bias. The quality is upgraded if there is moderate or large effect size ore and exposure-response gradient identified .
There is high quality evidence that age, impaired physical function, ADL disabilities, and frailty increase the probability of needing supportive services after discharge. There is moderate evidence that a diagnosis of stroke, IADL disabilities and receiving supportive services prior to hospital admission increase the probability of needing supportive services after discharge. Interestingly a greater number of comorbidities was a significant predictor in univariable analyses in 3 studies but not in any multivariate analyses. Indicators of absent support at home (marital status and absence of an informal care giver) had moderate-weak evidence of predicting discharge with supportive services. Lastly several specific diagnoses (heart failure, metastatic cancer and heart valve disease) had weak to very week evidence for predicting the need for supportive services.
We constructed a causal pathway to explain the relationships between the predictor variables and the outcome (Fig. 2). Activities of daily living and the presence of a care giver at home directly affected the need for supportive services after discharge whereas age and comorbidities act by their effects on physical function and cognitive function to affect ADL disabilities. Stroke directly causes ADL and IADL disabilities while the causative impact of other specific diagnoses is less certain.
Our systematic review identified 6 validated models that predict the need for supportive services after discharge from a non-elective medical admission. All models had good discrimination, although there was at least a moderate risk of bias for all studies and no models were externally validated. Furthermore, other important model characteristics, such as calibration that indicates if the predicted risk is similar to the actual risk, were not reported for most models. Our GRADE analysis suggests that age, impaired physical function, ADL disabilities and frailty all have high quality evidence as factors that predict the need for supportive services after discharge.
Accurate prediction of the need for supportive services after discharge may be useful to target patients who would benefit most from discharge planning interventions. Several studies have shown that discharge planning interventions are associated with small reductions in length of stay and fewer readmissions but do not impact resource utilization or patient mortality . Discharge planning interventions themselves are resource intensive and should be allocated to patients who will benefit the most . Future models to predict patients who will benefit from personalized discharge planning should explore using the 15 variables identified in our review. A model building process that starts with all 15 variables we identified may result in a model with more predictive power that those we identified.
Our review included far fewer studies than other recent reviews because we excluded studies that performed no model validation. Notably none of the studies we included were externally validated calling into question the generalizability to other populations. Validation is a crucial step in model development as it assesses whether the model accurately represents the real world [8, 23]. Despite limiting our inclusion criteria to studies with validated models, several methodologic concerns remained. Only 1 model used the recommended best practice of using clinical reasoning to guide variable selection and final model building . The rest of the models used univariable analysis to select variables and then an automated selection algorithm for model building. This process can result in inaccurate or false relationships between predictors and the outcome by accidentally conditioning on a collider . Any model that seeks to explain the causes of an outcome needs to start with a clinical reasoning or a formal causal hypothesis so that appropriate potential causal factors and confounders can be included, thereby avoiding false or inaccurate effect estimates. Making causal hypotheses explicit is critical to furthering the field and allowing critical appraisal by peers.
Consistent with previous studies, we found that impairments in physical function and ADL disabilities are strong predictors of the need for supportive services after discharge [26, 27]. This is intuitive because support for ADLs is a primary service offered across the spectrum of supportive living options. Numerous medical diagnoses, illness severity scores, and comorbidity scores were associated with the need for supportive services after discharge in univariable analysis but most of them were excluded in variable selection processes. This likely occurred because comorbidities increase the need for services after discharge primarily by their impact on physical and cognitive function as illustrated in our causal pathway (Fig. 2). Once physical and cognitive function are directly measured and added to the model the other down variables that impact function are no longer significant predictors.
Marital status and living with an informal care giver were both negatively associated with the need for supportive services after discharge. Clearly, an informal caregiver may reduce the need for formal caregiving by assisting with ADLs and IADLs . Informal caregivers may also impact the need for supportive services by providing emotional support and reducing loneliness . Several studies in our review found a univariable association between measures of mental health and need for supportive services but the associations were not significant in final multivariate models.
Interestingly none of the included studies tested income or financial resources as predictors. The omission is likely pragmatic but considering the importance of these variables for other health outcomes we suggest that the predictive contribution of financial resources or other proxies of socioeconomic status should be considered in future derivation of models predicting need for supportive services . Financial resources may not be as strong of a predictor in countries with publicly funded healthcare.
Significance and limitations
Our findings add to the literature by distilling the key variables that predict the need for supportive services after discharge and synthesizing a cohesive theory of how each variable contributes to the need for supportive services. Based on our causal pathway, accurate assessment of ADL and IADLs of hospitalized patients may be the best method to determine if support will be needed after discharge.
Our review has several limitations. Our outcome was broadly defined as supportive services after discharge and each study defined the outcome differently. Therefore, we do not know if the predictor variables we identified apply to all types of supportive services. Another limitation is that we did not specify when each predictor variable was measured. For example, assessing ADL disability on the day of admission or 1 week into the admission will likely have different value as a predictor but we did make this distinction. Lastly, we did not search gray literature so we may have missed studies that were never published and indexed in a database.
There were also several limitations due to the available studies. None of the included studies measured function in the weeks and months prior to hospital admission or looked at how different causes of acute illness affect functional recovery. We were also unable to perform meta-analysis as each study specified a slightly different outcome.
The need for supportive services post discharge can be predicted with reasonable accuracy by existing models. However, none have excellent discrimination and no model includes all variables that we identified to be associated to with needing supportive services after discharge. Our causal pathway suggests that a thorough assessment of functional status and the absence of an informal care giver directly cause a person to need supportive services. A model that includes all directly causative variables accurately measured will likely have more predictive power than existing models. Flagging patients who may not be able to return to their previous residence can facilitate communication about planning for care and may allow health care organizations use personnel resources more effectively. The primary barrier to creating such a model is the practicality of obtaining the required data in the context of a study or in real world use.
Availability of data and materials
All data generated or analysed during this study are included in this published article.
Hirsch CH, Sommers L, Olsen A, Mullen L, Winograd CH. The natural history of functional morbidity in hospitalized older patients. J Am Geriatr Soc. 1990;38(12):1296–303.
Kleinpell RM, Fletcher K, Jennings BM. Reducing Functional Decline in Hospitalized Elderly. In: Hughes RG, editor. Patient Safety and Quality: An Evidence-Based Handbook for Nurses. Rockville (MD): Agency for Healthcare Research and Quality; 2008.
Covinsky KE, Palmer RM, Fortinsky RH, Counsell SR, Stewart AL, Kresevic D, Burant CJ, Landefeld CS. Loss of independence in activities of daily living in older adults hospitalized with medical illnesses: increased vulnerability with age. J Am Geriatr Soc. 2003;51(4):451–8.
Sager MA, Franke T, Inouye SK, Landefeld CS, Morgan TM, Rudberg MA, Sebens H, Winograd CH. Functional outcomes of acute medical illness and hospitalization in older persons. Arch Intern Med. 1996;156(6):645–52.
Liebzeit D, King B, Bratzke L. Measurement of function in older adults transitioning from hospital to home: an integrative review. Geriatr Nurs. 2018;39(3):336–43.
Kobewka DM, McIsaac D, Chasse M, Thavorn K, Mulpuru S, Lavallee LT, English S, Presseau J, Forster AJ. Risk assessment tools to predict location of discharge and need for supportive services for medical patients after discharge from hospital: a systematic review protocol. Syst Rev. 2017;6(1):8.
Moher D, Shamseer L, Clarke M, Ghersi D, Liberati A, Petticrew M, Shekelle P, Stewart LA. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement. Syst Rev. 2015;4:1.
Harrell FE Jr, Lee KL, Mark DB. Multivariable prognostic models: issues in developing models, evaluating assumptions and adequacy, and measuring and reducing errors. Stat Med. 1996;15(4):361–87.
Balk EM, Chung M, Chen ML, Trikalinos TA, Kong Win Chang L. AHRQ Methods for Effective Health Care. In: Assessing the Accuracy of Google Translate to Allow Data Extraction From Trials Published in Non-English Languages. Rockville (MD): Agency for Healthcare Research and Quality (US); 2013.
Moons KG, de Groot JA, Bouwmeester W, Vergouwe Y, Mallett S, Altman DG, Reitsma JB, Collins GS. Critical appraisal and data extraction for systematic reviews of prediction modelling studies: the CHARMS checklist. PLoS Med. 2014;11(10):e1001744.
Hayden JA, van der Windt DA, Cartwright JL, Cote P, Bombardier C. Assessing bias in studies of prognostic factors. Ann Intern Med. 2013;158(4):280–6.
Huguet A, Hayden JA, Stinson J, McGrath PJ, Chambers CT, Tougas ME, Wozney L. Judging the quality of evidence in reviews of prognostic factor research: adapting the GRADE framework. Syst Rev. 2013;2:71.
Shrier I, Platt RW. Reducing bias through directed acyclic graphs. BMC Med Res Methodol. 2008;8(1):70.
Richiardi L, Bellocco R, Zugna D. Mediation analysis in epidemiology: methods, interpretation and bias. Int J Epidemiol. 2013;42(5):1511–9.
Fairchild DG, Hickey ML, Cook EF, McCarthy RM, Rossi LP, Timmons SC, Mangione CM, Lee TH. A prediction rule for the use of postdischarge medical services. J Gen Intern Med. 1998;13(2):98–105.
Mehta KM, Pierluissi E, Boscardin WJ, Kirby KA, Walter LC, Chren MM, Palmer RM, Counsell SR, Landefeld CS. A clinical index to stratify hospitalized older adults according to risk for new-onset disability. J Am Geriatr Soc. 2011;59(7):1206–16.
Basic D, Shanley C. Frailty in an older inpatient population: using the clinical frailty scale to predict patient outcomes. J Aging Health. 2015;27(4):670–85.
Stineman MG, Kwong PL, Bates BE, Kurichi JE, Ripley DC, Xie D. Development and validation of a discharge planning index for achieving home discharge after hospitalization for acute stroke among those who received rehabilitation services. Am J Phys Med Rehab. 2014;93(3):217–30.
Tapper EB, Finkelstein D, Mittleman MA, Piatkowski G, Lai M. Standard assessments of frailty are validated predictors of mortality in hospitalized patients with cirrhosis. Hepatology. 2015;62(2):584–90.
Louis Simonet M, Kossovsky MP, Chopard P, Sigaud P, Perneger TV, Gaspoz JM. A predictive score to identify hospitalized patients' risk of discharge to a post-acute care facility. BMC Health Serv Res. 2008;8:154.
Goncalves-Bradley DC, Lannin NA, Clemson LM, Cameron ID, Shepperd S. Discharge planning from hospital. Cochrane Database Of Syst Rev. 2016;(1):Cd000313.
Laramee AS, Levinsky SK, Sargent J, Ross R, Callas P. Case management in a heterogeneous congestive heart failure population: a randomized controlled trial. Arch Intern Med. 2003;163(7):809–17.
Dales LG, Ury HK. An improper use of statistical significance testing in studying covariables. Int J Epidemiol. 1978;7(4):373–5.
Sun GW, Shook TL, Kay GL. Inappropriate use of bivariable analysis to screen risk factors for use in multivariable analysis. J Clin Epidemiol. 1996;49(8):907–16.
Cole SR, Platt RW, Schisterman EF, Chu H, Westreich D, Richardson D, Poole C. Illustrating bias due to conditioning on a collider. Int J Epidemiol. 2010;39(2):417–20.
Harrison JK, Walesby KE, Hamilton L, Armstrong C, Starr JM, Reynish EL, MacLullich AMJ, Quinn TJ, Shenkin SD. Predicting discharge to institutional long-term care following acute hospitalisation: a systematic review and meta-analysis. Age Ageing. 2017;46(4):547–58.
Hoogerduijn JG, Schuurmans MJ, Duijnstee MS, de Rooij SE, Grypdonck MF. A systematic review of predictors and screening instruments to identify older hospitalized patients at risk for functional decline. J Clin Nurs. 2007;16(1):46–57.
Roth DL, Perkins M, Wadley VG, Temple EM, Haley WE. Family caregiving and emotional strain: associations with quality of life in a large national sample of middle-aged and older adults. Qual Life Res. 2009;18(6):679–88.
Russell DW, Cutrona CE, de la Mora A, Wallace RB. Loneliness and nursing home admission among rural older adults. Psychol Aging. 1997;12(4):574–89.
Andresen EM, Miller DK. The future (history) of socioeconomic measurement and implications for improving health outcomes among African Americans. J Gerontol A Biol Sci Med Sci. 2005;60(10):1345–50.
This research did not receive any funding from agencies in the public, commercial, or not-for-profit sectors.
Ethics approval and consent to participate
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Predicting need for supportive services. Database: Ovid MEDLINE(R) Epub Ahead of Print, In-Process & Other Non-Indexed Citations, Ovid MEDLINE(R) Daily and Ovid MEDLINE(R) < 1946 to Present> Search Strategy: Search strategy formatted for MEDLINE.
About this article
Cite this article
Kobewka, D.M., Mulpuru, S., Chassé, M. et al. Predicting the need for supportive services after discharged from hospital: a systematic review. BMC Health Serv Res 20, 161 (2020). https://doi.org/10.1186/s12913-020-4972-6