Measures for the integration of health and social care services for long-term health conditions: a systematic review of reviews
BMC Health Services Research volume 20, Article number: 358 (2020)
As people are living longer with higher incidences of long-term health conditions, there is a move towards greater integration of care, including integration of health and social care services. Integrated care needs to be comprehensively and systematically evaluated if it is to be implemented widely. We performed a systematic review of reviews to identify measures which have been used to assess integrated care across health and social care services for people living with long-term health conditions.
Four electronic databases (PUBMED; MEDLINE; EMBASE; Cochrane library of systematic reviews) were searched in August 2018 for relevant reviews evaluating the integration of health and social care between 1998 and 2018. Articles were assessed according to apriori eligibility criteria. A data extraction form was utilised to collate the identified measures into five categories.
Of the 18 articles included, system outcomes and process measures were most frequently identified (15 articles each). Patient or carer reported outcomes were identified in 13 articles while health outcomes were reported in 12 articles. Structural measures were reported in nine articles. Challenges to measuring integration included the identification of a wide range of potential impacts of integration, difficulties in comparing findings due to differences in study design and heterogeneity of types of outcomes, and a need for appropriate, robust measurement tools.
Our review revealed no shortage of measures for assessing the structures, processes and outcomes of integrated care. The very large number of available measures and infrequent use of any common set make comparisons between schemes more difficult. The promotion of core measurement sets and stakeholder consultation would advance measurement in this area.
People are living longer with higher incidences of long-term health conditions now spanning low, middle and high income countries . In response to challenges in rising complex care needs, the integration of care is increasingly appearing on the global agenda with aims of a person-centred approach facilitating both patient and service benefit . Programmes aiming to provide integrated care continue to gather pace, however, further work is needed to identify specific aspects of integration which determine their effectiveness [3,4,5].
Integration of health and social care services has been a long term policy goal of successive governments within the United Kingdom. Strategies to break down barriers and form partnerships in the provision of health and social care have particularly sought to support people with multiple long-term health conditions [6,7,8]. The National Health Service (NHS) Long Term Plan further advocates for closer integration of services giving patients more control over the services they receive . Whilst there is clear policy support for integration, the move away from siloed working towards a more collaborative approach to health and social care is challenging. In this context, The Department of Health and Social Care, NHS England and NHS Improvement have recognised the need to clearly define outcomes which they seek to achieve for patients and how they should be assessed .
A wide range of definitions and concepts of integrated care exist . Whilst most forms of integration relate to healthcare integration, they can also include integration between healthcare and social care services. NHS England considers integrated care to be:
“person-centred, coordinated, and tailored to the needs and preferences of the individual, their carer and family. It means moving away from episodic care to a more holistic approach to health, care and support needs, that puts the needs and experience of people at the centre of how services are organised and delivered.” .
The term integration itself can be further described as the methods, processes and models used to bring about this improved style of coordinated care .
The lack of conceptual clarity around integration makes it challenging to identify important outcomes of care and how they should be assessed or measured. It is generally assumed that a more joined up approach to care improves experiences and outcomes for patients and service users through becoming more person centred and reducing system duplication. Although integration has been shown to improve staff and patient perceived quality of care, increase patient satisfaction and improve access to care , a more robust evidence base is needed to support these wider assumptions of improvement. A strong evidence base also needs to be extended to assess system and organisational challenges such as cultural differences and data sharing difficulties .
There is clearly a drive towards health and social care integration to improve services for patients, however, measuring impact is a challenge . Being able to measure integrated care in a consistent and systematic way is essential for key stakeholders, such as health and social care professionals or policymakers, to advance the design and implementation of a successful integrated health and social care system. Researchers within the integrated care field also need a cohesive measurement strategy so that their research can contribute to an evidence base that can be compared and contrasted meaningfully. With this context in mind, this systematic review sought to identify reviews of effectiveness of integrated care to establish which measures have been used to evaluate the integration of health and social care services for people with long-term conditions. For the purposes of this article, integrated care refers to the integration of health and social care services. We consider ‘social care’ to refer to care that is delivered through a wide range of organisations and professionals within the community, and includes any care and support provided outside traditional health services. For the purposes of this review, the term ‘measure’ is used to refer to any tool used to assess structures, processes or outcomes of care, either from the patients’, carers’, clinicians’ or system perspective.
A search was performed across four electronic databases (PUBMED; MEDLINE; EMBASE; Cochrane library of systematic reviews) to identify both systematic and non-systematic reviews of literature regarding the integration of health and social care. See Additional file 1 for search strategy used.
Searches were limited to abstracts and titles only. Additional limits applied were, a publication date from 01/01/1998 to 31/08/2018, to reflect the time period in which integration initiatives have largely been introduced, and restrictions to the adult population. Searches were limited to English language only. Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines were followed .
Study selection and data extraction procedures
Study selection was carried out in two phases. Eligibility was assessed through abstract screening performed by LK and HC against study selection criteria (see Table 1). A third reviewer, MP, screened abstracts where uncertainty of inclusion arose. Full papers were sourced for potentially eligible reviews and underwent further examination by LK and HC to determine if they met the review inclusion and exclusion criteria.
A data extraction form, which included headings relating to the review’s aims, population, methodology and reported measures, was developed in EXCEL. Data extraction headings were tested by extracting data from three articles (by LK, HC and MP). Data for the remaining articles were extracted by one researcher (LK or HC), but in cases of uncertainty, the second researcher independently extracted data from the same article and results discussed until a consensus was reached.
Extraction of results
Integrated care measures reported in each review were extracted and collated in a spreadsheet under headings guided by Donabedian’s distinctions between structures (where a measure reflects attributes of the healthcare service, for example, the adequacy of facilities and equipment or staff to patient ratios), processes (where a measure reflects the way systems work to deliver desired outcomes, for example, patient waiting time) and outcomes (where a measure assesses impact on the patient or system, for example reduced length of stay, decreased mortality, and patient experience) [17, 18]. For the purposes of this review, the third component, outcomes, was sub-divided into System Outcomes, Health Outcomes and Patient- and Carer-Reported Outcomes. Once the range of measures were identified, they were extracted and summarised within a spreadsheet. Next, a count of reviews that presented data for structures, processes and outcome (sub-divided into system, health and patient/carer-reported outcomes) headings was produced (see Table 2). The identified measures were summarised, presented in the results section and in Table 3.
This review was not limited to a specific review design but aimed to provide a broad overview of measures used in the evaluation of integrated care. As such we did not systematically evaluate the methodological rigour of each review. The research design is however outlined for each review.
Search results and review characteristics
Initial searches retrieved 5410 references from electronic databases. After duplicates were removed, 2971 citation records were screened resulting in 71 full text articles for further eligibility assessment. After assessing full text articles, 18 met the inclusion and exclusion criteria (Fig. 1 for PRISMA flow diagram). The main reasons for exclusion among the full text papers included the absence of social care studies in the results or a study design other than a review.
The numbers of articles included in each review article ranged from 9  to 300 . Where reported, reviews reported studies as being conducted in Canada (n = 13), Europe (n = 13), USA (n = 11), Australia and New Zealand (n = 8), Asia (n = 5) and Africa (n = 1). Reviews were described as: umbrella review (n = 1), systematic review (n = 7), realist review (n = 1), narrative review (n = 1), literature review (n = 3), knowledge synthesis (n = 1), meta-analysis (n = 1), scoping review (n = 1) and other/non-systematic review (n = 1). A final article, a development of methodological approaches for evaluating integrated care programmes (n = 1), was included as it encompassed a narrative literature review on existing integrated care programme outcomes. Population groups included adults and older people with long-term conditions in a range of health and social care settings.
Measures used to evaluate health and social care integration
Table 2 provides a summary of the measures identified in the included review articles. The most frequently reported measures were system outcomes and processes, both appearing in 15 articles. Patient- or carer-reported outcomes were identified in 13 articles while health outcomes were reported in 12 articles. The category with the fewest reported measures was structural measures with nine review articles identifying their presence.
A range of measures for evaluating structural and organisational aspects of integrated care were identified in nine review articles (Table 3). Six articles identified studies which measured aspects of the workforce including staff effectiveness, productivity, competency, cohesion, staff communication, task completion, role performance [15, 23, 30, 34], teamwork between providers [21, 30] and physician integration in provider collaboration [15, 33]. Structural measures which evaluated communication across providers and information sharing were also identified in six review articles. Logistics and suitability of information sharing and co-location  were identified as important aspects for evaluation. In addition, coordination and communication between services and organisations [15, 21, 30, 33, 34], transition policies, efficiency in assessments, case prioritisation, connections with partner organisations, case and care management [15, 22, 30, 33] were evaluated. IT systems and data management [15, 22, 33] were measures of successful mechanisms of information sharing. Two articles reported the assessment of the workplace ethos towards the integration of care [15, 22], whilst three outlined measures of budget compatibility and resources [15, 22, 31]. Further organisational measures identified are reported in Table 3.
Process measures were identifed in 15 review articles. The most frequently reported categories included performance measures and the measurement of patient, family or carer perspectives of processes of care. Performance measures were included in seven reviews which predominantly consisted of quality-related measures assessing staff and patient perceived quality, quality standards [13, 15, 21, 28, 31], quality of care transistion  and, quality of care planning and performance management . Other measures of performance included waiting times for treatment , assessement  and timeliness of the transfer of information . Further measures of performance are outlined in Table 3.
Thirteen review articles included measures on patient, family, carer and provider perspectives of processes of care. Patients’ perspectives were evaluated through the measurement of patient satisfaction, experience, preferences met, involvement in decision making and, incidents of complaints [13, 15, 20, 21, 23, 29,30,31,32, 34]. Measurement of levels of empowerment and empathy [15, 30, 32], person centeredness [20, 24], personal respect (dignity, confidentiality, autonomy, comfort) [15, 34], compassionate care and, preferred place of death  were also identified. Assessment of patient needs were reported in four review articles [13, 22, 32, 34]. Measures of carer experiences and satisfaction [23, 31] were identified in two reviews whilst measures of provider experience [13, 15, 21, 22, 34] were identified in five reviews.
System outcomes were identified in 15 articles mostly identifying measures of health and social care utilisation which broadly covered admissions, discharge and length of stay [13, 19, 21,22,23,24,25,26,27,28,29,30,31,32]; and measures evaluating the number of services used [13, 21,22,23, 26, 28,29,30,31,32, 34]. Costs were evaluated in 13 articles [13, 19, 21,22,23,24, 26,27,28,29,30,31,32]. Measures of accessibility to resources , services  and culturally appropriate care, specialty or sub-specialty care [21, 24, 26, 34] were reported in five articles. Further details of system outcome measures, including financial, employment, and health claims  and vocational status  are presented in Table 3.
Twelve review articles reported the measurement of health outcomes. The majority of these reported the measurement of clinical health, for example, mortality, blood pressure and various condition specific measures [21, 23,24,25,26,27,28,29, 31, 32, 34]. Clinician rated measures of disability and function were reported within six review articles [22,23,24, 27, 28, 32] whilst five reported the use of proxy (clinician- or caregiver-rated) mental health or behavioural measures [22, 23, 25, 28, 32].
Patient- and carer-reported outcomes
Thirteen review articles reported the use of patient- and carer-reported outcomes. Patient health and well-being measures, for example, quality of life and coping with everyday life, were identified in nine articles [22, 23, 25,26,27, 29,30,31, 34], whilst patient-reported physical health featured in eight [23, 25, 27,28,29,30,31, 34]. Patient-reported psychological and social measures were identified in eight articles, for example, measures of mood, psychological well-being, depression and anxiety [23,24,25,26, 28, 29, 31, 34]. Carer-reported measures featured in eight articles and measured areas of carers’ quality of life, mood, distress and burden, and time spent caring [23,24,25,26, 29,30,31,32, 34]. Family involvement in care was also reported in one article . Further patient-reported outcomes identified (for example, activation and engagement ) are reported in Table 3.
Challenges in measuring the integration of care
There was broad consensus among the reviews that findings regarding the outcomes of integrated care should be treated with caution as current evidence is limited, inconsistent or descriptive [13, 25, 26, 28]. Challenges to measuring the effects of the integration of care included the identification, and appropriate measurement of, a wide range of mechanisms and outcomes which may be impacted across conceptually diverse interventions [22, 28, 33]. Comparisons between studies included within the reviews were considered difficult due to the heterogeneity of outcomes and study design [22, 24, 28]. Few studies reported within study comparison, for example, usual care versus integration of care, making it difficult to determine effectiveness . Where studies included a control group, it was possible to demonstrate impacts on the costs of integrated care comparatively across three countries . More recently, the development of a methodological approach which uses a broad evaluation framework and the use of Multi-Criteria Decision Analysis has shown the potential of cross country intervention comparisons . Here the authors identify and define uniform outcomes for use across 17 programmes and further identify additional programme specific outcomes where relevant.
A number of reviews highlighted the need to ensure appropriate, valid and reliable measures to advance the measurement of integrated care and to support the development of clinical guidelines [20, 26, 33]. One extensive review of structure and process measures, reported a need for higher quality measures with better measurement properties . Whilst they report the majority of measures focusing on care integration and patient-centred care, they highlight a need for less studied constructs, such as care continuity/comprehensive care and care-coordination/case management to become integral in new measures that may need to be developed. In contrast, a knowledge synthesis of domains and tools measuring progress towards integrated care reported the existence of many tools measuring care coordination, patient engagement and team effectiveness or performance, yet few tools for performance management and information systems, alignment of organisational goals and allocation of resources .
There is increased recognition of a need for services to bring together a range of professionals and skills from across the health and social care sectors. This integration of care is intended to benefit the service user. Integrated care systems are being implemented; it is vital that assessments of these systems are carried out in a systematic and meaningful way. To do this, appropriate measures of integration need to be established and agreed upon. This review sought to identify measures of integrated care which have been used across both health and social care settings in populations with long-term health conditions.
Eighteen review articles met our inclusion criteria. These articles highlighted an abundance of measures of integration across a spectrum of structures, processes and outcomes. System outcomes and process measures were amongst the most frequently reported measures. This is unsurprising given that system outcome measures largely measured health and social care utilisation and costs, while process measures tended to measure quality, performance and experiences of care. Such system outcomes and process measures are required in the provision of health services [35, 36] and may therefore be considered the most accessible and familiar measures with which to evaluate integrated care in addition to reflecting the priorities of health and social care professionals and decision makers. Despite the drive for integration to provide person-centred and tailored care to benefit the patient, the measurement of patient and carer outcomes were identified slightly less frequently than system outcomes or process measures.
Whilst measures broadly grouped into structural, process and outcome measures, it is of note that we have chosen to include patient experience within the category of process measures. Patient reported experience measures (PREMs) are distinct from patient- or carer-reported outcomes in that, rather than measuring outcomes from the patient or carer perspective, they focus on understanding the patients’ views and experiences of receiving care . Patient Reported Outcome Measures (PROMs) and patient reported experience measures are however frequently used in parallel to gain a picture of both processes and outcomes of care and have been shown to be positively correlated [38, 39]. Patient experience measures appeared frequently in this review, which reflects the emphasis placed upon the coordinated and improved experiences of services in the integration of care services. Despite the debate around the categorisation of the measurement of patient experiences, this review indicates experiences of care are considered an important aspect of patient benefit within the integrated care field.
The findings of this review show a wide range of measures currently being used when assessing integrated care. To facilitate an established body of evidence and advance the evaluation of integrated care programs, standardised measurement sets may help to guide researchers in their choice of tools and study designs. Using a core set of measures would be helpful in the comparison of different schemes and aid the establishment of a clear body of evidence to inform health and social care professionals and policy makers when taking the integration agenda forward. Developing a consensus on core measurement sets however is challenging, not least due to complexity of establishing what an important outcome may be . Guidance may be taken from the vast array of work already carried out to establish core outcome sets for use in clinical research and other healthcare contexts . The development and use of relevant core measurement sets, such as those developed for the Core Outcome Measures in Effectiveness Trials (COMET) initiative to assess effectiveness in trials or the International Consortium for Health Outcomes Measurement (ICHOM) to assess value in health care  may help guide and aid comparisons between interventions . Core measurement sets would provide a consensus on important structural measures, process measures and outcomes to measure in future interventions. Measures developed by organisations such as QualityWatch will also be invaluable in the development of a core set to assess policy impact on the quality of care and patient benefit . To get a clearer understanding of measures that are of interest, consultation with stakeholders working in both healthcare and social care settings is vital in steering future recommendations of appropriate measures. In order to improve awareness and support for core measurement sets within integrated care, it would be beneficial to draw on experiences of those in the health outcomes field who advocate for clear channels of communication between key stakeholders .
Further exploring relationships between measurement categories may serve to further advance the assessment of integration, for example, how processes impact on outcomes in integrated care settings. Methods which may develop this thinking include the use of logic models which can lay out and unpick understandings of how interventions achieve their intended impacts whilst also identifying factors which underpin the process . Such methods have been explored by the Social Care Institute for Excellence to map enablers, components, outcomes and long-term impacts of integrated care and represent important work in this area . Realist reviews, such as Kirst et al. , can also offer insight into the relationships between context, mechanism and action in integrated care programs and identify necessary processes for successful implementation. Unpacking relationships and potential links between structures, processes and, ultimately, outcomes within the integrated care setting is vital in measuring integration success.
Despite a central aim of this review to focus on measures of health and social care integration, the reviews included predominantly focused on healthcare measures. For example, only two reviews identified the inclusion of a significant range of social care measures such as financial, employment and health claims . Measures such as the Adult Social Care Outcomes Toolkit (ASCOT) provide well validated instruments to assess outcomes of social care. Whilst many of the structural and process measures may seem suitable for use in the health care sector, further evidence is needed to evaluate the usefulness of these measures in social care. The large number of healthcare measures may reflect a more developed landscape of quality measures in the health services sector, however it is important to utilise appropriate measures in future evaluations of social care services.
A strength of this study is the rigorous and systematic process of the literature search, carried out in line with PRISMA guidelines . To the best of our knowledge, these findings report a unique overview of all reviews conducted to date which outline measures of health and social care integration. Despite a carefully devised research question and design, a number of challenges were encountered. Firstly, a lack of clarity within articles regarding the inclusion of social services meant it was at times difficult to establish which reviews should be included. Furthermore, on closer inspection of full text articles, many articles which indicated they were reviewing assessments of health and social care integration, had minimal to no social care content in the studies which they identified. Finally, it is possible that ambiguity in how aspects of integration were measured resulted in the misclassification of some measures. These challenges were addressed through assessments of eligibility and the classification of measures by two authors, drawing on a third author where uncertainty arose. Whilst it was outside the scope of this study, it is important to note that some relevant reviews may have been found in reference lists or in grey literature had they been included in our searches.
An abundance of structural, process and outcome measures to evaluate the integration of health and social care were identified within this review of reviews. However there is no agreement as to a core set of measures, nor was there always clarity about how certain structures, processes and outcomes were measured. Having clearer agreements on which structures, processes and outcomes are important, and specific measures to assess them, would be helpful in evaluating and comparing different schemes and interventions of integration. The use of methods to identify core sets for structures, processes and outcomes of integration interventions would encourage standardisation of measures in evaluations, facilitate reviews and ultimately better support use of evidence by policy makers and service providers. Further exploration of methods, such as logic models or realist reviews, to unpack relationships between components of integrated care may further support a consensus set of measures.
Availability of data and materials
All data generated or analysed during this study are included in this published article and its supplementary information files.
Adult Social Care Outcomes Toolkit
Core Outcome Measures in Effectiveness Trials
International Consortium for Health Outcomes Measurement
National Health Service
Patient Reported Experience Measure
Preferred Reporting Items for Systematic Reviews and Meta-Analyses
Patient Reported Outcome Measure
Garin N, Koyanagi A, Chatterji S, Tyrovolas S, Olaya B, Leonardi M, Lara E, Koskinen S, Tobiasz-Adamczyk B, Ayuso-Mateos JL, Haro JM. Global multimorbidity patterns: a cross-sectional, population-based, multi-country study. J Gerontol A Biol Sci Med Sci. 2016;71(2):205–14.
World Health Organisation. Framework on integrated, people-centred health services. 2016. http://apps.who.int/iris/bitstream/10665/174536/1/9789241564977_eng.pdf?ua=1. Accessed 11 Feb 2019.
Hopman P, de Bruin SR, Forjaz MJ, Rodriguez-Blazquez C, Tonnara G, Lemmens LC, Onder G, Baan CA, Rijken M. Effectiveness of comprehensive care programs for patients with multiple chronic conditions or frailty: a systematic literature review. Health Policy. 2016;120(7):818–32.
de Bruin SR, Versnel N, Lemmens LC, Molema CCM, Schellevis FG, Nijpels G, Baan CA. Comprehensive care programs for patients with multiple chronic conditions: a systematic literature review. Health Policy. 2012;107(2–3):108–45.
Allen D, Gillen E, Rixson L. The effectiveness of integrated care pathways for adults and children in health care settings: a systematic review. JBI Libr Syst Rev. 2009;7(3):80–129.
National Health Service. Five Year Forward View. 2014. https://www.england.nhs.uk/wp-content/uploads/2014/10/5yfv-web.pdf. Accessed 8 Feb 2019.
Mujica-Mota RE, Roberts M, Abel G, Elliott M, Lyratzopoulos G, Roland M, Campbell J. Common patterns of morbidity and multi-morbidity and their impact on health-related quality of life: evidence from a national survey. Qual Life Res. 2015;24(4):909–18.
House of Commons Health and Social Care Committee. Integrated care: organisations, partnerships and systems. 2018. https://publications.parliament.uk/pa/cm201719/cmselect/cmhealth/650/650.pdf. Accessed 8 Feb 2019.
National Health Service. The NHS Long Term Plan. 2019. https://www.longtermplan.nhs.uk/wp-content/uploads/2019/01/nhs-long-term-plan.pdf. Accessed 8 Feb 2019.
Armitage GD, Suter E, Oelke ND, Adair CE. Health systems integration: state of the evidence. Int J Integr Care. 2009;9(2) https://doi.org/10.5334/ijic.316.
National Health Service England. Integrated care and support. https://www.england.nhs.uk/ourwork/part-rel/transformation-fund/. Accessed 1 Feb 2019.
Shaw S, Rosen R, Rumbold B. What is integrated care? Research report. The Nuffield Trust. 2011. https://www.nuffieldtrust.org.uk/files/2017-01/what-is-integrated-care-report-web-final.pdf. Accessed 8 Feb 2019.
Baxter S, Johnson M, Chambers D, Sutton A, Goyder E, Booth A. The effects of integrated care: a systematic review of UK and international evidence. BMC Health Serv Res. 2018;18(1):350.
Forder J, Caiels J, Harlock J, Wistow G, Malisauskaite G, Peters M, Marczak J, D’Amico F, Fernandez JL, Fitzpatric R, Jones K. A system-level evaluation of the better care fund: final report. Quality and Outcomes of Person-Centred Care Policy Research Unit. 2018. https://www.pssru.ac.uk/pub/5424.pdf. Accessed 8 Feb 2019.
Suter E, Oelke ND, da Silva Lima MAD, Stiphout M, Janke R, Witt RR, Van Vliet-Brown C, Schill K, Rostami M, Hepp S, Birney A, Al-Roubaiai F, Marques GQ. Indicators and measurement tools for health systems integration: a knowledge synthesis. Int J Integr Care. 2017;17(6):4.
Moher D, Liberati A, Tetzlaff J, Altman DG. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. BMJ. 2009;339:b2535.
National Health Service Improvement. Quality, service improvement and redesign tools: a model for measuring quality care. Online library of quality, service improvement and redesign tools. 2018. https://improvement.nhs.uk/documents/2135/measuring-quality-care-model.pdf. Accessed 8 Feb 2019.
Donabedian A. Evaluating the quality of medical care. 1966. Milbank Q. 2005;83(4):691–729.
Damery S, Flanagan S, Combes G. Does integrated care reduce hospital activity for patients with chronic diseases? An umbrella review of systematic reviews. BMJ Open. 2016;6(11):e011952 https://doi.org/10.1136/bmjopen-2016-011952.
Bautista MAC, Nurjono M, Lim YW, Dessers E, Vrijhoef HJ. Instruments measuring integrated care: a systematic review of measurement properties. Milbank Q. 2016;94(4):862–917.
Busse R, Stahl J. Integrated care experiences and outcomes in Germany, the Netherlands, and England. Health Aff. 2014;33(9):1549–58.
Cameron A, Lart R, Bostock L, Coomber C. Factors that promote and hinder joint and integrated working between health and social care services: a review of research literature. Health Soc Care Community. 2014;22(3):225–33.
Laver K, Lannin NA, Bragge P, Hunter P, Holland AE, Tavender E, O'Connor D, Khan F, Teasell R, Gruen R. Organising health care services for people with an acquired brain injury: an overview of systematic reviews and randomised controlled trials. BMC Health Serv Res. 2014;14:397.
Rutten-van Molken M, Leijten F, Hoedemakers M, Tsiachristas A, Verbeek N, Karimi M, Bal R, de Bont A, Islam K, Askildsen JE, Czypionka T, Kraus M, Huic M, Pitter JG, Vogt V, Stokes J, Baltaxe E, SELFIE consortium. Strengthening the evidence-base of integrated care for people with multi-morbidity in Europe using Multi-Criteria Decision Analysis (MCDA). BMC Health Serv Res. 2018;18:576.
Backhouse A, Ukoumunne OC, Richards DA, McCabe R, Watkins R, Dickens C. The effectiveness of community-based coordinating interventions in dementia care: a meta-analysis and subgroup analysis of intervention components. BMC Health Serv Res. 2017;17(1):717.
Soto TA, Bell J, Pillen MB. Literature on integrated HIV care: a review. AIDS Care. 2004;16(Suppl 1):S43–55.
Tummers JF, Schrijvers AJ, Visser-Meily JM. Economic evidence on integrated care for stroke patients; a systematic review. Int J Integr Care. 2012;12:e193.
Davies SL, Goodman C, Bunn F, Victor C, Dickinson A, Iliffe S, Gage H, Martin W, Froggatt. A systematic review of integrated working between care homes and health care services. BMC Heal Serv Res. 2011;11:320.
Eklund K, Wilhelmson K. Outcomes of coordinated and integrated interventions targeting frail elderly people: a systematic review of randomised controlled trials. Health Soc Care Community. 2009;17(5):447–58.
Kirst M, Im J, Burns T, Baker GR, Goldhar J, O’Campo P, Wojtak A, Wodchis WP. What works in implementation of integrated care programs for older adults with complex needs? A realist review. Int J Qual Heal Care. 2017;29(5):612–24.
Mason A, Goddard M, Weatherly H, Chalkley M. Integrating funds for health and social care: an evidence review. J Health Serv Res Policy. 2015;20(3):177–88.
Stewart MJ, Georgiou A, Westbrook JI. Successfully integrating aged care services: a review of the evidence and tools emerging from a long-term care program. Int J Integr Care. 2013;13:e003.
Strandberg-Larsen M, Krasnik A. Measurement of integrated healthcare delivery: a systematic review of methods and future research directions. Int J Integr Care. 2009;9:e01.
Valaitis RK, Carter N, Lam A, Nicholl J, Feather J, Cleghorn L. Implementation and maintenance of patient navigation programs linking primary care with community-based health and social services: a scoping literature review. BMC Health Serv Res. 2017;17(1):116.
Monitor. Detailed requirements for quality reports 2015/16. 2016. https://assets.publishing.service.gov.uk/government/uploads/system/uploads/attachment_data/file/509825/Detailed_req_for_qual_repts_2016_complete_final.pdf. Accessed 14 Feb 2019.
Care Quality Commission. The five key questions we ask. 2019. https://www.cqc.org.uk/what-we-do/how-we-do-our-job/five-key-questions-we-ask. Accessed 14 Feb 2019.
Reay N. How to measure patient experience and outcomes to demonstrate quality in care. Nurs Times. 2010;106(7):12–4.
Kingsley C, Patel S. Patient-reported outcome measures and patient-reported experience measures. BJA Educ. 2017;17(4):137–44.
Fitzpatrick R, Peters M, Doll H, Harris R, Jenkinson C, Playford D, Ziebland S. The needs and experiences of services by individuals with long-term progressive neurological conditions, and their carers. A benchmarking study. 2010. http://www.netscc.ac.uk/hsdr/files/project/SDO_FR_08-1610-123_V01.pdf. Accessed 25 Feb 2019.
Moloney RM, Messner DA, Tunis SR. The increasing complexity of the core outcomes landscape. J Clin Epidemiol. 2019;116:150–4.
ICHOM. Healthcare Improvement. Patient-Reported Outcomes. https://www.ichom.org/. Accessed 18 Feb 2020.
Williamson PR, Altman DG, Bagley H, Barnes KL, Blazeby JM, Brookes ST, Clarke M, Gargon E, Gorst S, Harman N, Kirkham JJ, McNair A, CAC P, Schmitt J, Terwee CB, Young B. The COMET Handbook: version 1.0. Trials. 2017;18(S3):280.
QualityWatch. Are patients benefitting from integrated care?. 2019. https://www.nuffieldtrust.org.uk/public/files/2019-01/integrated_care/. Accessed 14 Feb 2019.
Baxter SK, Blank L, Woods HB, Payne N, Rimmer M, Goyder E. Using logic model methods in systematic review synthesis: describing complex pathways in referral management interventions. BMC Med Res Methodol. 2014;14(1):62.
Social Care Institute for Excellence. Logic model for integrated care. 2017. https://www.scie.org.uk/integrated-health-social-care/measuring-progress/logic-model. Accessed 14 Feb 2019.
This paper reports independent research funded by the Policy Research Programme (PRP) in the Department of Health and Social Care England, which supported the Quality and Outcomes of Person-centred Care Policy Research Unit (QORU), and subsequently the National Institute for Health Research (NIHR) Policy Research Programme for the NIHR Policy Research Unit on Quality, Safety, and Outcomes of Health and Social Care (PR-PRU-1217-20702). This study was also funded by the NIHR Collaboration for Leadership in Applied Health Research and Care (CLAHRC) Oxford at Oxford Health NHS Foundation Trust. The views expressed in this publication are those of the authors and not necessarily those of the NIHR or the Department of Health and Social Care.
Ethics approval and consent to participate
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Kelly, L., Harlock, J., Peters, M. et al. Measures for the integration of health and social care services for long-term health conditions: a systematic review of reviews. BMC Health Serv Res 20, 358 (2020). https://doi.org/10.1186/s12913-020-05206-5