Skip to main content
Download PDF

Key aspects related to implementation of risk stratification in health care systems-the ASSEHS study

BMC Health Services Research volume 17, Article number: 331 (2017) Cite this article

Abstract

Background

The lack of proven efficacy of new healthcare interventions represents a problem for health systems globally. It is partly related to suboptimal implementation processes, leading to poor adoption of new interventions. Activation of Stratification Strategies and Results of the interventions on frail patients of Healthcare Services (ASSEHS) EU project (N° 2013 12 04) aims to study current existing health Risk Stratification (RS) strategies and tools on frail elderly patients. This paper aims at identifying variables that make the implementation of population RS tools feasible in different healthcare services.

Methods

Two different methods have been used to identify the key elements in stratification implementation; i) a Scoping Review, in order to search and gather scientific evidence and ii) Semi-structured interviews with six key experts that had been actively involved in the design and/or implementation of RS strategies. It aims to focus the implementation construct on real-life contextual understandings, multi-level perspectives, and cultural influences.

Results

A Feasibility Framework has been drawn. Two dimensions impact the feasibility of RS: (i) Planning, deployment and change management and (ii) Care intervention. The former comprises communication, training and mutual learning, multidisciplinarity of the team, clinicians’ engagement, operational plan and ICT display and functionalities. The latter includes case finding and selection of the target population, pathway definition and quality improvement process.

Conclusions

The Feasibility Framework provides a list of key elements that should be considered for an effective implementation of population risk stratification interventions. It helps to identify, plan and consider relevant elements to ensure a proper RS implementation.

Peer Review reports

Background

European Health Systems and services move towards proactive, anticipatory and integrated care [1, 2]. Health care systems need to provide services using an adequate level of resources. Population health management is enhanced by using tools to stratify people with chronic diseases and/or frailty according to their risk [2,3,4,5,6]. Risk Stratification (RS) has a long history in American health systems. [7] Its use in European public health care provision environments is still at an initial stage. There is a growing number of research work and scientific literature about RS methodologies in Europe. Most of them relate to the validation of risk algorithms. [4, 8] There are few descriptions of the implementation process [8] or policy experiences [9]. The identification of the key issues in RS implementation can help the organizations to optimize the process.

RS tools can help to identify complex high-risk patients and maintain these patients on the radar of the Health Services and enhance Population health management [10]. It facilitates appropriate coverage of proactive health interventions. It also boosts the coordination between primary, secondary and social care. RS can identify patients that can benefit most of common shared objectives between the different providers.

Multi-morbid patients use up to 50 times more health care resources than non-chronic patients [11]. This is partly due to the reactive and fragmented way in which care is delivered [12]. Multidimensional and multidisciplinary integrated care approaches are more effective and efficient to ensure quality and continuity of care [12]. They can diminish or delay the occurrence of unwanted events and improve patient’s wellbeing and system sustainability [13].

The suboptimal implementation processes of new interventions, leads to their diminished efficacy. Implementation research has emerged the last decade to help understand the nature of these problems and narrow down the gap between knowledge and practice [14]. Implementation of evidence-based interventions is not always achieved [15]. Feasibility has been identified, among others, as a key area in the design and implementation of evidence-based interventions [16].

Activation of Stratification Strategies and Results of the interventions on frail patients of Healthcare Services (ASSEHS) EU project (N° 2013 12 04) [17] is an international attempt to bring together professionals involved in risk stratification work from Health Services, Academia and Research centres of European Countries. The aims were to study current health risk stratification strategies and tools and to understand the challenges involved in extending their use on frail elderly patients. ASSEHS is in line with the B3 Action Plan of the European Innovation Partnership on Active and Healthy Ageing (EIP on AHA).

Objectives

General objective: to draw a framework to assess the feasibility of implementing Population Risk Stratification strategies.

Specific objectives:

  • ▪ To identify the key elements described in the literature, focusing on barriers and facilitators at the macro, meso and micro levels of management and clinical practice in healthcare systems.

  • ▪ To structure the key aspects identified within a framework relevant to the feasibility of risk stratification implementation.

Methods

Two different methods have been used to identify the key elements in stratification implementation; i) A Scoping Review, in order to search and gather scientific evidence and ii) Semi-structured interviews with six key experts that had been actively involved in the design and/or implementation of RS strategies.

Scoping review

A scoping review has been carried out following a five step procedure [18]. It comprised: 1) Identifying the research question, 2) Identifying relevant studies, 3) Selecting the key studies, 4) Charting the data, 5) Collating, summarizing, and reporting result. For further information of the scoping review, see Mora J et al. [19].

Only documents describing RS implementation experiences or addressing key aspects of this process were eligible. The scoping review was conducted in May 2014. Searches were carried out by an expert medical librarian.

Identifying the research question

The first step was to identify and assess the key terms of search in natural language (See Additional file 1: Annex 1_ Search question). Then, a strategy of generic search was defined, composed by controlled vocabulary (Medical Subject Headings designed-MeSH, Emtree and other thesauri terms) and free speech, considering synonyms, abbreviations, acronyms, and plural spelling variations, later finding was adjusted redefining and adjusting to the most relevant terms.

The strategies were complemented by field identifiers, wildcards, proximity operators and Boolean operators. This strategy was validated through a virtual consultation with experts and was adapted later to the different sources of information and selected resources. (See Additional file 2: Annex 2: Search Strategy).

The search strategy was tested in a single database (Pubmed) to ensure that the terms and connectors chosen provided relevant results for the scope of the research. No further changes were introduced in the search strategy. It was then applied in other relevant databases:

  • MEDLINE (Pubmed)

  • EMBASE.com

  • The Cochrane Library (Wiley platform)

  • CINAHL

  • PsycINFO

  • CRD

  • Google scholar

  • TripDatabase

  • Lilacs

To facilitate reading and data analysis, language of the publications was restricted to Spanish, English and French.

Identifying relevant studies

The implementation of the search strategy in the selected databases resulted in 982 papers found. In a first screening, the title and abstract were analyzed to ensure their eligibility within the RS subject. Two hundred one papers were selected for further analysis.

Selecting key studies

A second screening was done, analyzing if the papers were focused on RS implementation. The analysis was based on the title and abstract, and reading of the complete paper when needed. Seventy three papers were prioritized. They included implementation information such as:

  1. 1.

    Can we identify interventions (in Europe) where RS approaches have been used?

  2. 2.

    Do they describe the implementation process?

  3. 3.

    Do they provide information on barriers and facilitators?

  4. 4.

    Which are the barriers?

  5. 5.

    Which are the facilitators?

  6. 6.

    How to overcome barriers?

  7. 7.

    Where else can we find this information?

  8. 8.

    Can we identify names of Key Informants?

Forty three papers were added to the search through a snowball process. Snowballing refers to using the reference list of a paper or the citations to the paper to identify additional papers [20].

All 116 papers were read (73 plus 43). Thirty four papers relevant to the process of implementing a RS tool in real life were finally selected.

Figure 1 shows a diagram of the process followed for the selection of the papers for critical reading. The screening of the papers at all stages was made by peers (JM, MD, LP, CD), and disagreements were solved through further discussion and analysis between the individuals or through the view of a third one.

Fig. 1
figure 1

Scoping Review Process Workflow

Full size image

Charting the data: table of evidence

A table of evidence was designed to identify elements relevant in the process of RS implementation. Critical reading of the 34 papers selected was performed by four peers. Each paper was read at least by two people. The table of evidence contained general information of the source (name of the document or type of information described,) and the key implementation aspects identified.

Collating, summarizing and reporting results

A thematic analytic construction was used to identify prominent or recurrent topics, summarize the findings and develop categories under thematic headings. Summary tables, providing descriptions of the key points were produced [21]. Items related with implementation were identified in each paper. They were grouped in broader topics. Information related to the features and impact of the tool was excluded. A comparison-iterative method of content analysis was performed. Each category was searched for in the entire data set and all instances were compared, until no new categories could be identified [22]. Categories were grouped according to their subject. They were integrated in two major dimensions, one comprising planning and organization categories, the other those more related with clinical management.

Interviews with key experts

To further develop and validate the scoping review findings, a qualitative methodology approach was used. It aimed to understand concepts in their natural context, emphasizing the meaning, experience and views of experts in this area. The purpose is to focus and the implementation construct on real-life contextual understandings, multi-level perspectives, and cultural influences [23].

Semi-structured interviews with six experts on implementation of population risk stratification strategies in health care systems were done [24]. They explored the conditions of a system that allow optimal introduction of risk stratification tools in the Health System, the facilitators and barriers in the process and to identify mistakes made in implementation or that could affect the implementation.

Qualitative data analysis included literal transcription and content analysis of narratives by inductive method of reading and re-coding [25]. With these results the dimensions and categories of the framework were reexamined, as a check of validity, focusing in identifying new relevant items for inclusion or changes in the meaning and boundaries of the previous categories [26]. The dimensions were defined according to the phase of the implementation process. Categories were allocated to each of these phases.

Results

Results of the scoping review

Thirty four articles were selected on the scoping review (Fig. 1). In the process of critical reading, different recurrent items were identified and summarized in 34 topics (Table 1). These topics were further synthesized according to their subject through a comparison-iterative process, identifying similarities or differences, into a first framework draft with 23 categories. Each category could comprise one or more topics, depending on their meaning, scope and association. A new iteration allowed to connect the categories in broader headings and culminated in a framework with seven dimensions (Table 2).

Table 1 Topics identified
Full size table
Table 2 Draft framework
Full size table

This first framework draft includes many elements of an intervention implementation such as costs, ethics, planning, deployment and change management.

Results of the semi-structured interviews to key experts: refinement of the assessment framework

Practical information generated through the implementation process of RS strategies was collected in order to refine the framework developed during the scoping review. The relevant concepts related to facilitators and barriers relevant in implementation were identified. Meanings and categories’ boundaries were redefined. The dimensions were defined according to the focus in the implementation process, planning and organization for one side and clinical management for the other. Categories were allocated to each of these dimensions.

Final feasibility framework

The final framework was reduced to two dimensions (Table 3). The first one includes all the categories related with planning, organizational and managerial issues. The second one comprises those aspects related to patient selection and clinical care.

Table 3 Feasibility Final Framework
Full size table

Planning, deployment and change management dimension includes six categories. Communication involves the process of explaining the purpose and outcomes of RS to health professionals. Training and mutual learning comprises the activities performed so as the professional become competent in the use of RS. Multidisciplinarity has to do with the degree the team leading RS deployment. It includes a variety of health professionals, managers, ICT professionals, epidemiologists and others. Clinicians’ engagement refers to topics such as the mechanisms and degrees of professionals’ accountability, commitment and involvement. Operational plan focuses on the way resources, activities, quality and implementation has been defined. ICT-Information display and functionalities includes the devices and applications used, their purpose, usability, flexibility, performances and support.

Care intervention includes three categories. Case finding is the selection, identification and enrollment of the target population. The pathway definition and implementation involves the organized clinical intervention processes with the patients including the follow up and monitoring. Quality assessment and improvement process is related to the evaluation and changes introduced during the implementation process.

Discussion

The poor implementation of interventions of proven efficacy is an issue for health systems. Implementation research tries to understand these problems and close the gap between knowledge and practice [27]. It is defined as the scientific study of strategies aimed at promoting the adoption of clinical research findings in routine clinical practice in a systematic, widespread, sustainable and continued way [28]. Identifying the key aspects related to implementation will help to better deploy risk stratification tools in health care systems [29]. ASSEHS has developed a framework using a scoping review together with an experts’ consultation process. They are complementary methods that contribute to a comprehensive approach to the problem.

The Feasibility Framework refinement was based on experts’ information. It is information rooted in real life circumstances. The Feasibility Framework elements should be considered for an effective implementation of population risk stratification interventions. They can be applied to in any health systems.

Planning, deployment and change management is one of those dimensions. A high-quality operational plan establishing the agenda and the strategic goals and objectives is needed. Having trained people qualified in RS is “a must” [30]. Clinicians’ engagement is a sine qua non requirement. If we can achieve the engagement of innovators and early adopters, the rest will follow their steps. Communication, not only of the RS tool’s characteristics, but also of its aims, is a key element for its feasibility [5]. Clinicians have to see the point of RS. Otherwise it will be really difficult to implement. Clinical group consists of different profiles. It is indispensable to have a multidisciplinary team leading the RS deployment [1]. Each and every one of the professional profiles involved is important. Good ICT systems have been identified as critical in risk stratification deployment.

Care intervention dimension has a paramount importance. Case finding and selecting the population groups allows focusing efforts and resources. The aim is to target persons that can get more benefit from programs designed for chronic patients [31]. Pathway definition and implementation have to be considered. Continuous improvement procedures, including quality assessment and improvement processes, enhances feasible RS interventions.

These findings are in line with the Consolidated Framework for Implementation Research [13]. It establishes a list of constructs that have been associated with effective implementation of evidence based interventions.

There are limitations in this study. Implementation of risk stratification tools involves other aspects apart from feasibility. Aspects related to the quality and availability of the data or the stratification algorithms has not been dealt with. Another limitation is that the number of experts did not ensure information obtained reached the point of data saturation. Experts’ empirical experiences were focused on their concrete reality. To reduce these biases, efforts were made to include worldwide references and publications during the literature review. The study has been based on NHS tyoe system. The experience of RS in insurance based health systems, has to be further studied.

Conclusions

RS implementations feasibility is related to two different areas: organizational and management factors and patient selection and clinical care. The implementation strategy has to include planning of resources and organization of the deployment. Different issues regarding clinicians are critical and should not be underestimated. The functionalities of the ICT tools and the quality management of the process should not be lost of sight.

RS for health care provision has a long history in private health systems, but its application in public health care provision environments is still in an initial stage. Identifying the elements to consider in the implementation of RS can help to optimize its deployment and adoption. This framework is a conceptual model offering a broader theoretical understanding of risk stratification implementation. It aims to help to plan and guide the process of its deployment.

References

  1. Lewis G, Curry N, Bardsley M. Choosing a predictive risk model: a guide for commissioners in England. Nuffeild Trust. November 2011. Available in https://www.nuffieldtrust.org.uk/files/2017-01/choosing-predictive-risk-model-guide-for-commissioners-web-final.pdf.

  2. Predictive Modeling in Action. How “Virtual Wards” Help High-Risk Patients Receive Hospital Care at Home - 1430_lewis_predictive_modeling_in_action_virtual_wards_intl_brief.pdf [Internet]. Available from: http://www.commonwealthfund.org/~/media/files/publications/issue-brief/2010/aug/1430_lewis_predictive_modeling_in_action_virtual_wards_intl_brief.pdf. Accessed 15 Apr 2016.

  3. Freund T, Peters-Klimm F, Boyd CM, Mahler C, Gensichen J, Erler A, et al. Medical Assistant–Based Care Management for High-Risk Patients in Small Primary Care Practices: A Cluster Randomized Clinical Trial. Ann Intern Med. 2016;164:323–30. doi:10.7326/M14-2403.

  4. Sauto R,  Saenz De Ormijana A,  Orueta JF et al. A qualitative study on clinicians’ perceptions about the implementation of a population risk stratification tool in primary care practice of the Basque Health Service. BMC Family Practice. 2014;15:150. doi:10.1186/1471-2296-15-150.

  5. Yi C. Developing decision trees to classify patients suited for similar interventions by combining clinical judgments with Leeds Risk Stratification Tool. London.: London School of Economics and Political Science; 2012.

    Google Scholar 

  6. Lewis G H Next Steps for Risk Stratification in the NHS. NHS Discussion Paper.  21 January 2015 available at https://www.england.nhs.uk/wp-content/uploads/2015/01/nxt-steps-risk-strat-glewis.pdf.

  7. Kansagara D, Englander H, Salanitro A. Risk prediction models for hospital readmission: a systematic review. JAMA. 2011;306:1688–98. doi:10.1001/jama.2011.1515.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  8. Hopfe M, Stucki G, Marshall R, Twomey CD, Üstün TB, Prodinger B. Capturing patients’ needs in casemix: a systematic literature review on the value of adding functioning information in reimbursement systems. BMC Health Serv. Res. 2015;16:40. doi:10.1186/s12913-016-1277-x.

  9. Health D of. Screening/case finding-National Service Frameworks: a practical aid to implementation in primary care. 2002 [cited 2016 Apr 15]. Available from: http://webarchive.nationalarchives.gov.uk/+/www.dh.gov.uk/en/Publicationsandstatistics/Publications/PublicationsPolicyAndGuidance/DH_4006872

  10. Friedman DJ, Starfield B. Models of Population Health: Their Value for US Public Health Practice, Policy, and Research. Am J Public Health. 2003;93(3):366–9.

    Article  PubMed  PubMed Central  Google Scholar 

  11. Yoon J, Zulman D, Scott JY, Maciejewski ML. Costs associated with multimorbidity among VA patients. Med Care. 2014;52 Suppl 3:S31–6.

    Article  PubMed  Google Scholar 

  12. Institute of Medicine. Crossing the Quality Chasm: A New Health System for the Twenty-first Century. Washington: National Academy Press; 2001. http://www.nap.edu/openbook.php?isbn=0309072808.

    Google Scholar 

  13. Busse R, Stahl J. Integrated Care Experiences and Outcomes In Germany, The Netherlands, And England. Health Aff. 2014;33(9):1549–58.

    Article  Google Scholar 

  14. Peters DH, Tran N, Adam T, Ghaffar A. Implementation research in health: a practical guide. Alliance for Health Policy and Systems Research, World Health Organization. 2013.

    Google Scholar 

  15. Grimshaw JM, Eccles MP. Is evidence-based implementation of evidence-based care possible? MJA. 2004;180:S50–1. https://www.mja.com.au/system/files/issues/180_06_150304/gri10746_fm.pdf.

    PubMed  Google Scholar 

  16. Bowen DJ, Kreuter M, Spring B, et al. How We Design Feasibility Studies. Am J Prev Med. 2009;36(5):452–7. doi:10.1016/j.amepre.2009.02.002.

    Article  PubMed  PubMed Central  Google Scholar 

  17. de Manuel Keenoy E, David M, Mora J, Prieto L, Domingo C, Orueta J, et al. Activation of Stratification Strategies and Results of the interventions on frail patients of Healthcare Services (ASSEHS) DG Sanco Project No. 2013 12 04. Eur Geriatr Med. 2014;5(5):342–6.

    Article  Google Scholar 

  18. Arksey H, O’Malley L. Scoping studies: towards a methodological framework. Int J Soc Res Methodol. 2005;8(1):19–32.

    Article  Google Scholar 

  19. Mora J, De Massari D, Pauws S, op den Buijs J, David M, Prieto L, et al. Selection of the method to appraise and compare health systems using risk stratification: the ASSEHS approach. Aging Clin Exp Res. 2015;27(6):767–74.

    Article  CAS  PubMed  Google Scholar 

  20. Greenhalgh T, Peacock R. Effectiveness and efficiency of search methods in systematic reviews of complex evidence: audit of primary sources. Br Med J. 2005;331(7524):1064–5. doi:10.1136/bmj.38636.593461.68.

    Article  Google Scholar 

  21. Dixon-Woods M, Agarwal S, Jones D, Young B, Sutton A. Synthesising qualitative and quantitative evidence: a review of possible methods. J Health Serv Res Policy. 2005;10(1):45–53.

    Article  PubMed  Google Scholar 

  22. Mays N, Pope C. Assessing quality in qualitative research. Br. Med. J. 2000;320(7226):50–52.

  23. Creswell JW, Klassen AC, Plano Clark VL, Cregg Smith KC. Best Practices for Mixed Methods Research in the Health Sciences. Office of Behavioral and Social Sciences Research (OBSSR) in. 2011. https://www2.jabsom.hawaii.edu/native/docs/tsudocs/Best_Practices_for_Mixed_Methods_Research_Aug2011.pdf. Accessed 12 Feb 2012.

  24. Luborsky MR, Rubinstein RL. Sampling in Qualitative Research: Rationale, Issues, and Methods. Res Aging. 1995;17(1):89–113. doi:10.1177/0164027595171005.

    Article  PubMed  PubMed Central  Google Scholar 

  25. Pope C, Mays N. Reaching the parts other methods cannot reach: an introduction to qualitative methods in health and health services research. BMJ. 1995;311:42–5.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  26. Lambert H, McKevitt C. Anthropology in health research: from qualitative methods to multidisciplinarity. Br Med J. 2002;325(7357):210–3.

    Article  Google Scholar 

  27. McGlynn EA, Asch SM, Adams J, Keesey J, Hicks J, DeCristofaro A, et al. The Quality of Health Care Delivered to Adults in the United States. N Engl J Med. 2003;348(26):2635–45.

    Article  PubMed  Google Scholar 

  28. Curran GM, Bauer M, Mittman B, Pyne JM, Stetler C. Effectiveness-implementation hybrid designs: combining elements of clinical effectiveness and implementation research to enhance public health impact. Med Care. 2012;50(3):217–26.

    Article  PubMed  PubMed Central  Google Scholar 

  29. Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci. 2009;4:50.

    Article  PubMed  PubMed Central  Google Scholar 

  30. Johns Hopkins risk tool used in South. [cited 2016 Apr 21]. Available from: http://www.digitalhealth.net/news/27490/johns-hopkins-risk-tool-used-in-south

  31. Dueñas-Espín I, Vela E, Pauws S, Bescos C, Cano I, Cleries M, et al. Proposals for enhanced health risk assessment and stratification in an integrated care scenario. BMJ Open. 2016;6(4):e010301.

    Article  PubMed  PubMed Central  Google Scholar 

  32. Asthana S, Gibson A. Setting health care capitations through diagnosis-based risk adjustment: A suitable model for the English NHS? Health Policy. 2011;101(2):133–9.

    Article  PubMed  Google Scholar 

  33. Brilleman SL, Gravelle H, Hollinghurst S, Purdy S, Salisbury C, Windmeijer F. Keep it simple? Predicting primary health care costs with clinical morbidity measures. J Health Econ. 2014;35:109–22.

    Article  PubMed  PubMed Central  Google Scholar 

  34. Goldfield N. The evolution of diagnosis-related groups (DRGs): from its beginnings in case-mix and resource use theory, to its implementation for payment and now for its current utilization for quality within and outside the hospital. Qual Manag Health Care. 2010;19(1):3–16.

    Article  PubMed  Google Scholar 

  35. Guillén A, Colás J, Gutiérrez G. Risk assessment and patient stratification using implantable medical devices. The funding for personal health programs. Conf Proc Annu Int Conf IEEE Eng Med Biol Soc IEEE Eng Med Biol Soc Annu Conf. 2011;2011:884–7.

    Google Scholar 

  36. Huntley AL, Johnson R, Purdy S, Valderas JM, Salisbury C. Measures of multimorbidity and morbidity burden for use in primary care and community settings: a systematic review and guide. Ann Fam Med. 2012;10(2):134–41.

    Article  PubMed  PubMed Central  Google Scholar 

  37. Lewis GH. “Impactibility models”: identifying the subgroup of high-risk patients most amenable to hospital-avoidance programs. Milbank Q. 2010;88(2):240–55.

    Article  PubMed  PubMed Central  Google Scholar 

  38. Lynch JP, Forman SA, Graff S, Gunby MC. High-risk population health management-achieving improved patient outcomes and near-term financial results. Am J Manag Care. 2000;6(7):781–91.

    CAS  PubMed  Google Scholar 

  39. Majeed A, Bindman AB, Weiner JP. Use of risk adjustment in setting budgets and measuring performance in primary care II: advantages, disadvantages, and practicalities. BMJ. 2001;323(7313):607–10.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  40. Newcomer R, Harrington C, Kane R. Implementing the second generation social health maintenance organization. J Am Geriatr Soc. 2000;48(7):829–34.

    Article  CAS  PubMed  Google Scholar 

  41. Richardson D, Tarnow-Mordi WO, Lee SK. Risk adjustment for quality improvement. Pediatrics. 1999;103(1 Suppl E):255–65.

    CAS  PubMed  Google Scholar 

  42. Freund T, Wensing M, Geissler S, Peters-Klimm F, Mahler C, Boyd CM, et al. Primary care physicians’ experiences with case finding for practice-based care management. Am J Manag Care. 2012;18(4):e155–61.

    PubMed  PubMed Central  Google Scholar 

  43. Hoult J, Matheson H. Long-term conditions. Spot future patients to find tomorrow’s savings. Health Serv J. 2013;123(6340):26–8.

    PubMed  Google Scholar 

  44. Predictive Modeling in Action: How “Virtual Wards” Help High-Risk Patients Receive Hospital Care at Home - 1430_lewis_predictive_modeling_in_action_virtual_wards_intl_brief.pdf. [cited 2016 May 9]. Available from: http://www.commonwealthfund.org/~/media/files/publications/issue-brief/2010/aug/1430_lewis_predictive_modeling_in_action_virtual_wards_intl_brief.pdf

  45. Panattoni LE, Vaithianathan R, Ashton T, Lewis GH. Predictive risk modelling in health: options for New Zealand and Australia. Aust Health Rev Publ Aust Hosp Assoc. 2011;35(1):45–51.

    Article  Google Scholar 

  46. Lewis G. Predicting Who Will Need Costly Care. How Best To Target Preventive Health, Housing and Social Programmes. 2008.

    Google Scholar 

  47. Baer HJ, Schneider LI, Colditz GA, Dart H, Andry A, Williams DH, et al. Use of a Web-based Risk Appraisal Tool for Assessing Family History and Lifestyle Factors in Primary Care. J Gen Intern Med. 2013;28(6):817–24.

    Article  PubMed  PubMed Central  Google Scholar 

  48. Freund T, Gondan M, Rochon J, Peters-Klimm F, Campbell S, Wensing M, et al. Comparison of physician referral and insurance claims data-based risk prediction as approaches to identify patients for care management in primary care: an observational study. BMC Fam Pract. 2013;14:157.

    Article  PubMed  PubMed Central  Google Scholar 

  49. Freund T, Mahler C, Erler A, Gensichen J, Ose D, Szecsenyi J, et al. Identification of patients likely to benefit from care management programs. Am J Manag Care. 2011;17(5):345–52.

    PubMed  Google Scholar 

  50. Health D of. Screening/case finding - National Service Frameworks: a practical aid to implementation in primary care. 2002 [cited 2016 May 9]. Available from: http://webarchive.nationalarchives.gov.uk/+/www.dh.gov.uk/en/Publicationsandstatistics/Publications/PublicationsPolicyAndGuidance/DH_4006872

  51. Johns Hopkins risk tool used in South. [cited 2016 May 9]. Available from: http://www.digitalhealth.net/news/27490/johns-hopkins-risk-tool-used-in-south

  52. Sintchenko V, Usherwood T, Coiera E. Are clinicians’ information needs and decision support affected by different models of care? Experimental study. Stud Health Technol Inform. 2007;129(Pt 2):895–9.

    PubMed  Google Scholar 

  53. Zhao Y, Ash AS, Ellis RP, Slaughter JP. Disease burden profiles: an emerging tool for managing managed care. Health Care Manag Sci. 2002;5(3):211–9.

    Article  PubMed  Google Scholar 

  54. Gomaa WH, Morrow T, Muntendam P. Technology-Based Disease Management: A Low-Cost, High-Value Solution for the Management of Chronic Disease. Dis Manag Health Outcomes. 2001;9(10):577–88.

    Article  Google Scholar 

  55. Smith H, White T. Feasibility of a structured risk assessment tool in general adult psychiatry admissions. Psychiatr Bull. 2007;31(11):418–20.

    Article  Google Scholar 

  56. Majeed A, Bindman AB, Weiner JP. Use of risk adjustment in setting budgets and measuring performance in primary care I: how it works. BMJ. 2001;323(7313):604–7.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  57. Skinner KM, Miller DR, Lincoln E, Lee A, Kazis LE. Concordance between respondent self-reports and medical records for chronic conditions: experience from the Veterans Health Study. J Ambulatory Care Manage. 2005;28(2):102–10.

    Article  PubMed  Google Scholar 

  58. Smidth M, Christensen MB, Fenger-Grøn M, Olesen F, Vedsted P. The effect of an active implementation of a disease management programme for chronic obstructive pulmonary disease on healthcare utilization-a cluster-randomised controlled trial. BMC Health Serv Res. 2013;13:385.

    Article  PubMed  PubMed Central  Google Scholar 

  59. Muggah E, Graves E, Bennett C, Manuel DG. Ascertainment of chronic diseases using population health data: a comparison of health administrative data and patient self-report. BMC Public Health. 2013;13:16.

    Article  PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgements

The authors acknowledge the contributions of the ASSEHS study group. The members of the ASSEHS study group are given below: E de Manuel, J Mora, M David, L Prieto, A Fullaondo, I Erreguerena, C Martinez-Carazo, A Giné March; Kronikgune, International Center for Research in Chronicity, Spain. C Domingo, E Millan, J Orueta, M Ogueta; Osakidetza, Basque Public Health Provider, Spain. Esnaola S; Department of Health, Basque Government, Spain. E Valıa, F Rodenas; Polibienestar Institute-University of Valencia, Spain. S Pauws, J op den Buijs, D De Massari, M Asim; Philips Electronics Nederland B.V. acting through Philips Research. J Contel; Generalitat de Catalunya, Spain. T Martı; Fundacio Ticsalut, Spain. I Baroni, M Romano, M Nalin; Telbios S.p.a, Italy. F Avolio; F Robusto, V Lepore; Regional Healthcare Agency of Puglia, Italy. J Bousquet, A Bedbrook, R Bourret; Centre hospitalier regional universitaire de Montpellier, Montpellier, France.

Funding

The Activation of Stratification Strategies and Results of the interventions on frail patients of Healthcare Services (ASSEHS) project was funded by the European Community’s Health Programme under grant agreement n° 20131204 signed with the Executive Agency for Health and Consumers.

Availability of data and materials

Studies from academic sources were identified by searching the following electronic databases and research registers: MEDLINE (Pubmed), EMBASE.com, The Cochrane Library (Wiley platform), CINAHL, PsycINFO, CRD, Google scholar, TripDatabase and Lilacs.

Authors’ contributions

EM is the principal investigator and guarantor of the scientific quality of the ASSEHS project and along with ASSEHS study group (DM, MN, TM, FA and JB) conceived the idea and designed research project. JM designed the scoping review and along with MD, LP, CD and MPG conducted it and revised the articles. Together with AGM, who carried out the structured interviews to key experts, and CM made the refinement and designed the Feasibility Framework. EM, AGM, JM and CM drafted the initial version and oversaw revisions of this paper. All the authors critically read and approved the final manuscript.

Competing interests

The authors declare that they have no competing interests.

Consent for publication

All authors give their permission for publication.

Ethics approval and consent to participate

This article does not contain any studies with human and participants or animals performed by any of the authors. Interviews were exempt from requiring submission to ethics committee. Interviewees gave verbal consent to participate. For this type of study informed consent is not required. Relevant legislation: REGULATION (EU) No 536/2014 OF THE EUROPEAN PARLIAMENT AND OF THE COUNCIL of 16 April 2014 on clinical trials on medicinal products for human use, and repealing Directive 2001/20/EC.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Author information

Authors and Affiliations

  1. Kronikgune-Centro de Investigación en Cronicidad, Bilbao, Basque Country, Spain

    Joana Mora, Miren David Iturralde, Lucía Prieto, Catalina Martínez-Carazo, Anna Giné March & Esteban de Manuel Keenoy

  2. Osakidetza-Basque Health Service, Bilbao, Spain

    Cristina Domingo

  3. Laval University, Québec, Canada

    Marie-Pierre Gagnon

  4. Philips Electronics Nederland B. V., Eindhoven, Netherlands

    Daniele De Massari

  5. Fundació Ticsalut, Catalonia, Spain

    Tino Martí

  6. Telbios S.p.a., Milan, Italy

    Marco Nalin

  7. ARES Puglia, Gallipoli, Italy

    Francesca Avolio

  8. Centre hospitalier régional universitaire de Montpellier, Montpellier, France

    Jean Bousquet

  9. Kronikgune -Centro de Investigación en Cronicidad, Torre del BEC, Ronda de Azkue, 1, 48902, Barakaldo, Bizkaia, Spain

    Esteban de Manuel Keenoy

Authors
  1. Joana Mora
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Miren David Iturralde
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Lucía Prieto
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Cristina Domingo
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Marie-Pierre Gagnon
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Catalina Martínez-Carazo
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Anna Giné March
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Daniele De Massari
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Tino Martí
    View author publications

    You can also search for this author in PubMed Google Scholar

  10. Marco Nalin
    View author publications

    You can also search for this author in PubMed Google Scholar

  11. Francesca Avolio
    View author publications

    You can also search for this author in PubMed Google Scholar

  12. Jean Bousquet
    View author publications

    You can also search for this author in PubMed Google Scholar

  13. Esteban de Manuel Keenoy
    View author publications

    You can also search for this author in PubMed Google Scholar

Consortia

all ASSEHS group

  • E. de Manuel
  • , J. Mora
  • , M. David
  • , L. Prieto
  • , A. Fullaondo
  • , I. Erreguerena
  • , C. Martinez-Carazo
  • , A. Giné March
  • , C. Domingo
  • , E. Millan
  • , J. Orueta
  • , M. Ogueta
  • , S. Esnaola
  • , E. Valıa
  • , F. Rodenas
  • , S. Pauws
  • , J. op den Buijs
  • , D. De Massari
  • , M. Asim
  • , J. Contel
  • , T. Martı
  • , I. Baroni
  • , M. Romano
  • , M. Nalin
  • , F. Avolio
  • , F. Robusto
  • , V. Lepore
  • , J. Bousquet
  • , A.. Bedbrook
  •  & R. Bourret

Corresponding author

Correspondence to Esteban de Manuel Keenoy.

Additional files

Additional file 1: Annex 1.

Search question into PICO format. Search question organized in Problem/target population, Tool/Intervention, Comnparator and Outcomes. (DOCX 14 kb)

Additional file 2: Annex 2.

Search Strategy. Key words used in the literature scoping review. (DOCX 13 kb)

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Mora, J., Iturralde, M.D., Prieto, L. et al. Key aspects related to implementation of risk stratification in health care systems-the ASSEHS study. BMC Health Serv Res 17, 331 (2017). https://doi.org/10.1186/s12913-017-2275-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12913-017-2275-3

Keywords

BMC Health Services Research

ISSN: 1472-6963

Contact us