- Research article
- Open Open Peer Review
Organising health care services for people with an acquired brain injury: an overview of systematic reviews and randomised controlled trials
BMC Health Services Researchvolume 14, Article number: 397 (2014)
Acquired brain injury (ABI) is the leading cause of disability worldwide yet there is little information regarding the most effective way to organise ABI health care services. The aim of this review was to identify the most up-to-date high quality evidence to answer specific questions regarding the organisation of health care services for people with an ABI.
We conducted a systematic review of English papers using MEDLINE, EMBASE, PsycINFO, CINAHL and the Cochrane Library. We included the most recently published high quality systematic reviews and any randomised controlled trials, non-randomised controlled trials, controlled before after studies or interrupted time series studies published subsequent to the systematic review. We searched for papers that evaluated pre-defined organisational interventions for adults with an ABI. Organisational interventions of interest included fee-for-service care, integrated care, integrated care pathways, continuity of care, consumer engagement in governance and quality monitoring interventions. Data extraction and appraisal of included reviews and studies was completed independently by two reviewers.
A total of five systematic reviews and 21 studies were included in the review; eight of the papers (31%) included people with a traumatic brain injury (TBI) or ABI and the remaining papers (69%) included only participants with a diagnosis of stroke. We found evidence supporting the use of integrated care to improve functional outcome and reduce length of stay and evidence supporting early supported discharge teams for reducing morbidity and mortality and reducing length of stay for stroke survivors. There was little evidence to support case management or the use of integrated care pathways for people with ABI. We found evidence that a quality monitoring intervention can lead to improvements in process outcomes in acute and rehabilitation settings. We were unable to find any studies meeting our inclusion criteria regarding fee-for-service care or engaging consumers in the governance of the health care organisation.
The review found evidence to support integrated care, early supported discharge and quality monitoring interventions however, this evidence was based on studies conducted with people following stroke and may not be appropriate for all people with an ABI.
Acquired brain injury is the most common cause of disability worldwide [1–3]. The term ABI encompasses a number of different conditions including traumatic brain injury, hypoxic brain injury, stroke and brain tumour . These conditions may cause a complex combination of symptoms that require treatment from multiple health professionals. The effects of an ABI may be long-lasting and result in the need for long-term management . The incidence of ABI, frequency of limitations in functional ability that results from ABI, and costs associated with long term care mean that it is important that policy makers and health care organisations use the most effective and efficient methods to organise patient care.
Currently, the organisation of health care services for ABI varies across healthcare settings and countries and there is a lack of synthesised information regarding effective organisational interventions. Structuring services for people with an ABI is complex due to differences in case presentation, occupational goals and medical and functional needs. Differences between ABI aetiologies also lead to variation; the effects of stroke on the brain are much more focal in nature whereas TBI tends to lead to more generalised damage . The needs of patients with ABI are often diverse , for example patients with stroke are more likely to be older, retired and may have made previous adjustments to their lifestyle due to ageing, whereas patients with traumatic brain injury tend to be of working age and are more likely to have family and work commitments. That said, the number of elderly people with TBI is on the rise and these patients tend to have worse medical outcomes than elderly stroke patients . Despite differences in characteristics and treatment goals, people with an ABI from all diagnoses are often treated in the same care settings and by the same health care team and indeed, current research suggests that care on a mixed neurological rehabilitation unit is not inferior to care in a diagnostic-specific rehabilitation unit . Understanding the research underpinning care provision across ABI is important because optimising care coordination can maximise rehabilitation potential, therefore optimising independence and quality of life.
One such source of evidence available to guide clinical care is the Evidence Based Review of Moderate to Severe Acquired Brain Injury (ABIEBR) (https://www.abiebr.com) . The ABIEBR is a continually updated review of evidence based interventions for persons with ABI. The ABIEBR includes several recommendations related to the organisation of care including: that care should be provided by dedicated multidisciplinary teams; with adherence to acute care guidelines, that rehabilitation should be provided early and at high intensity; and patients should have access to long term support and specialist programs (such as vocational rehabilitation). These recommendations were based on studies identified in their search; many of these were of low quality and thus the authors conclude that there is currently “insufficient evidence to draw any conclusions regarding the ideal structure of a complete model of ABI care” (p55). The definition of ABI used in the ABIEBR does not include stroke and thus, the large amount of research related to stroke is not considered in their summaries to date. The objective of this review was to identify the most up-to-date, high quality sources of evidence to answer specific questions of interest regarding organising health services for people with an acquired brain injury, inclusive of stroke.
This systematic review was undertaken to inform the development of a new brain injury rehabilitation unit. The research team were therefore interested in organisational interventions, that is, interventions that relate to the structure or delivery of health services. The research team identified seventeen relevant systematic review questions from the Cochrane Effective Practice and Organisation of Care (EPOC) Group taxonomy of interventions. The questions were presented to key stakeholders in the brain injury rehabilitation unit and the key stakeholders voted for the questions that were perceived to be of highest priority. Key stakeholders included ABI clinicians, healthcare administrators and researchers. Six research questions related to the organisation of health care services were addressed within this systematic review (see list of Research questions). A protocol for the review was developed and registered with PROSPERO prior to undertaking the search . As the review involved the synthesis of already published research, ethics approval was not required.
Types of studies
The first step in the search was to identify high quality published systematic reviews for each question. Systematic reviews were not excluded on the basis of the types of primary studies included. Where there were more than one systematic review we included the most recent high quality review (as assessed using the AMSTAR checklist). We also included primary studies that were published subsequently to systematic reviews to ensure that we included the most recent evidence (see PRISMA flow diagram). Studies were considered if they were randomised controlled trials (RCTs), non-randomised controlled trials (NRCTs), controlled before after studies (CBAs) or interrupted time series studies (ITSs). Where we were unable to identify any systematic reviews to address a research question we summarised studies of the aforementioned designs. Studies published prior to 1980 were not included; the cut-off date was chosen in order to ensure consistency with the ABIEBR. Conference proceedings were not included. Details of SRs and studies omitted from this review and the reasons for omission are presented in an Additional file 1 (see file).
Types of participants
Participants in included reviews and studies were aged ≥ 16 years with an acquired brain injury (as a result of trauma, lack of oxygen to the brain, stroke, tumours, infection, poisoning or substance abuse)  utilising acute care or rehabilitation services.
Types of interventions
We included interventions that evaluated: (1) fee-for-service versus no fee-for-service or partial fee-for-service, (2) formal integration of services versus non-integrated care. Integrated care was defined as care provided by the same multidisciplinary team (this may have involved any configuration of medical, nursing or allied health) in comparison to care provided by two or more teams of any configuration. The multidisciplinary team providing the seamless care must have had the same direct management however may not have involved the same personnel) (3) care based on integrated care pathways versus usual care. An integrated care pathway (ICP) defines the expected course of events in the care of patients with a particular condition within a set time frame; ICPs are documented and staff are expected to adhere to the ICP. In order to be considered in this review, the pathway needed to be multidisciplinary (direct expected care behaviours in two or more professional groups). (4) a program of continuity of care versus no follow up, usual care or a lower quality model of continuity of care (eg fewer contacts involved). Studies examining the effect of follow up or case management within the same organisation or referral to one or more other organisations were included. The follow up was for any health care service (rehabilitation, counselling, or medication review) and was arranged following discharge from acute care or rehabilitation services. Case management was defined as the coordination of multidisciplinary care and reconciling this with patient needs. To be classified as case management, services needed to involve three or more of the following processes: entry screening, assessment, planning, coordination, monitoring and review, exit/closure planning, (5) consumer participation in governance versus no consumer participation or an alternative model of consumer participation, and (6) presence of quality monitoring systems versus no quality monitoring system or an alternative system.
Types of outcome measures
The primary outcome measure was patient outcome. This included outcomes measured at the level of activity or participation, health related quality of life, or mortality. The secondary outcomes were resource use, quality of care outcomes (such as adherence to recommended care) and participant satisfaction. Reviews or studies were not excluded based on the outcomes assessed.
The research questions addressed within the review are presented below:
Does the presence of a ‘fee-for-service’, paid either by the individual or insurer, improve outcomes for patients with ABI or the organisation in comparison to those where the individual or insurer does not pay ‘fee-for-service’?
Does an integrated care model where acute and rehabilitation, or admitted and community/ambulatory services are provided under one management team improve outcomes for patients with ABI or the organisation compared with care provided by separate management teams?
Does the use of an integrated care pathway (ICP) result in improved outcomes for the patient or the organisation compared to care which does not routinely adhere to an ICP?
Does enhancing the continuity of care by providing or organising follow up or case management improve outcomes for patients with ABI or the organisation in comparison to care where these services are not provided?
Does engaging consumers in governance of the health care organisation improve outcomes for patients with ABI or the organisation in comparison to models where there is no consumer participation in governance?
Does the presence or organisation of quality monitoring systems improve outcomes for patients with ABI or the organisation compared with those lacking quality monitoring systems?
The following electronic databases were searched for eligible reviews and studies: Medline (Ovid) 1980-Week 4 January 2013; PsycINFO (Ovid) 1980-Week 4 January 2013; EMBASE (Ovid) 1980-Week 4 January 2013 and CINAHL (Ebsco) 1980-21st February 2013. The search strategy was developed (by KL in consultation with all authors) for use in Ovid and adapted for CINAHL (see Additional file 2 MEDLINE search strategy). The Cochrane Library (Cochrane Database of Systematic Reviews, Database of Abstracts of Reviews and Effects and the Cochrane Central Register of Controlled Trials) was searched on the 26th of January 2013 using the MESH terms ‘stroke’ and craniocerebral trauma’. The Cochrane EPOC Group trials register was searched on the 13th of February 2013.
Data collection and analysis
One author (KL) reviewed all titles and abstracts elicited in the search to determine whether they met the inclusion criteria. Papers identified as being potentially relevant were obtained in full text and reviewed independently by two people (KL and LP). Disagreements were resolved by discussion or moderation by a third author (NL). Reasons for the exclusion of studies obtained in full text were recorded. The following data was extracted by one author (KL) and checked for accuracy by a second person (LP): review or study authors, date of publication, setting, study design, participant eligibility criteria, number of participants, intervention details, comparator details, type and timing of outcome measures, results and the authors’ conclusion. Studies were assessed independently by two people (KL and LP or DW) using the AMSTAR checklist  for systematic reviews, PEDro scale  for RCTs or Downs and Blacks Scale  for all other study designs.
The details of the included papers were summarised by research question and study type and presented in tables. No additional quantitative synthesis was conducted. Levels of evidence were described using the classification system used within the ABIEBR  which was based on the levels of evidence used by the United Stated Agency for Health Care Policy and Research Guidelines for Stroke Rehabilitation. Within this classification system, evidence is described as Level I if the findings are supported by the results of one or more RCTs of at least good quality (PEDro ≥ 6) and Level II if the findings are supported by a single RCT of at least “fair quality” (RCT <6 PEDro), NRCTs and Cohort studies.
The search resulted in 11,880 citations of which 11,301 were excluded because the abstract revealed the study did not meet the inclusion criteria. Full text articles were obtained for the remaining 579 citations. A further 519 studies were excluded because they did not meet the inclusion criteria. We identified a total of 15 SRs, 43 RCTs and two NRCTs that addressed the study design, types of participants and intervention relevant to this review. We then reviewed the papers to identify the most recent, high quality systematic reviews and subsequently published studies; we included a total of five SRs, 20 RCTs and one NRCT in this final review. (Refer to Figure 1 PRISMA flow diagram).
We were unable to identify any SRs or studies meeting our inclusion criteria that addressed the research questions relating to fee-for-service or consumer involvement. Results for the remaining research questions are summarised below.
Description of reviews and studies
We were unable to identify any SRs that examined the effectiveness of integrated care (where acute and rehabilitation, or admitted and community/ambulatory services were provided under one management team) compared to care provided by different management teams for people with an ABI. Three RCTs [14–16] were identified as meeting the inclusion criteria for this research question (See Table 1). No NRCT, CBA or ITS studies were identified which addressed this research question.
One RCT conducted in Norway (n = 320) compared a ‘chain of care’ provided by one team from the acute stroke unit to the community with a more fragmented care approach . The ‘chain’ started in the acute stroke unit, involved facilitation of discharge and coordination of additional rehabilitation and follow up in the community. The second trial (n = 81) also compared integrated care from the acute stroke unit to the home with usual care which involved at least two different health care teams . The team providing the care were associated with the stroke unit and provided outreach rehabilitation in the home. Finally, a three-armed trial compared comprehensive stroke unit care which comprised acute care and rehabilitation to acute care provided by a mobile stroke team on general wards to care provided by a domiciliary stroke team . There were several differences between the interventions provided in each of the study arms within this trial and the level of integration of care was one of several elements that varied. Consistent across all of the included studies (n = 3), was that they all recruited stroke survivors who predominantly had a moderate level of disability.
Quality of reviews and studies
The three included RCTs were all conducted in Europe and assessed as being of good quality (PEDro score ≥6/10) with large sample sizes (n = 81 to n = 320).
Effects of interventions
Two of the RCTs reported on mortality; of these, one of the trials found that there were reduced odds of mortality in the integrated care group at three, six and 12 months (OR 0.37; 95%CI 0.21 to 0.66 at 12 months)  whereas the other RCT found that there were similar levels of mortality between groups . All three included RCTs reported on participants’ level of dependence in activities of daily living following intervention [15–17]. While one of the RCTs found no significant differences between groups , the others both reported more favourable outcomes for the integrated care group; Indredavik and colleagues (2000) reported that a higher proportion of participants were independent six months after stroke as measured using the Rankin Scale (65% vs 52%, odds ratio (OR) = 1.72; 95% CI 1.10 to 2.70) . In addition, Kalra and colleagues found that more participants in the integrated care group had a favourable outcome on the Barthel Index (scores 15–20 out of 20) than those receiving care from the mobile stroke team at three (OR 1.16; 95% CI 1.02 to 1.32) and 12 months (OR 1.27; 95% CI 1.12 to 1.44) . Two of the RCTs reported on the impact on health related quality of life. One of the RCTs found no significant differences between groups  whereas the other RCT found that participants in the intervention group reported significantly improved quality of life (mean score 78.9 vs 75.2) .
All three RCTs reported on length of stay with variability in the findings. One RCT found that the total duration of hospital stay was similar between groups  while the remaining studies both reported a positive effect of the intervention on length of hospital stay. One RCT found that there was a 52% reduction in length of hospital stay for the integrated care group (mean of 14 days vs 29 days)  and the other found that the combined stroke unit plus rehabilitation unit length of stay was statistically shorter in the integrated care group (mean of 19 days vs 31 days) . Finally, one of the RCTs assessed participant satisfaction and found that the group receiving integrated care reported statistically significant higher satisfaction with active participation in treatment program planning .
In summary, there is Level I evidence from three RCTs that the provision of integrated care may result in similar or reduced levels of mortality and similar or improved functional outcome when compared with a more fragmented approach. Furthermore, integrated care models used between the acute and home rehabilitation setting may result in a significantly reduced length of stay in acute services.
Description of reviews and studies
We identified a Cochrane Review published in 2004  and a RCT published in 2011  that assessed the effects of integrated care pathways (ICPs) in stroke care (See Table 2). No NRCT, CBA or ITS studies were identified which addressed this research question. The Cochrane Review conducted by Kwan and colleagues included ten studies (three RCTs, seven NRCTs) with a total of 2013 participants. Care pathways were defined as a plan of care that “involved two or more of the following aspects of care: assessment, investigation, diagnosis, or treatment and involved two or more disciplines” . The care provided for the control group was poorly described in all studies although appeared to be usual care and studies took place in both acute care and rehabilitation units. The included RCT conducted by Middleton and colleagues used a cluster design to evaluate the use of an ICP designed to manage fever, hyperglycaemia and swallowing on an acute stroke unit . The trialists randomised 19 Australian acute stroke units and obtained data for 1696 participants.
Quality of reviews and studies
The Cochrane Review was of high quality meeting 7 of the 11 AMSTAR criteria however the authors reported that care needed to be taken in interpretation of the results as there were issues with the methodology and reporting of included studies.
The RCT conducted by Middleton and colleagues was of high quality (PEDro score = 9/10).
Effects of interventions
The SR and RCT both reported mortality rates post-intervention. The SR was unable to find any effects on mortality associated with use of an ICP. In contrast, the RCT found that patients receiving the intervention were significantly less likely to be dead or dependent at 90 days than patients receiving usual care (42% vs 58%, difference in absolute change = 15.7% (95% CI 5.8 to 25.4)). The SR and RCT both examined effects on quality of life; the SR identified evidence (based on one RCT ) that self-reported quality of life was significantly lower in the ICP group at six months whereas the RCT found that patients in the ICP group were more likely to have higher scores on the physical health component of the quality of life assessment tool (difference in absolute change = 3.4 (95% CI 1.2 to 5.5)) .
The SR and RCT both reported on resource use; the SR reported that readmissions to hospital were lower in the ICP group (based on one RCT and one NRCT (OR 0.11, 95% CI 0.03 to 0.39). The data from the SR related to length of stay was conflicting with two RCTs [19, 20] finding increased length of stay and two NRCTs [21, 22] finding shorter length of stay in the ICP group. The RCT conducted by Middleton and colleagues found no significant differences in length of hospital stay between groups . The SR examined the effects of ICP use on patient satisfaction and found some evidence (based on one randomised study  that patient satisfaction (as rated on a scale of one to ten) was significantly lower in participants receiving care based on an ICP (Weighted Mean Difference (WMD) -1.1, 95% CI −1.91 to −0.29).
Based on the available evidence from one SR, there is currently a lack of evidence supporting the implementation of ICPs to improve patient outcomes for people with ABI and limited evidence that ICPs may reduce patient satisfaction and quality of life compared to usual care. However, there is conflicting Level I evidence from one high quality RCT that a specific pathway used on an acute stroke unit to manage fever, hyperglycaemia and swallowing can improve patient outcome of death or dependency at 90 days compared with usual care .
Continuity of care
A large number of reviews and studies were identified which addressed this research question. The purpose and content of intervention approaches varied and to assist in interpretation we categorised these into three main approaches: ‘continuity of care - case management’, ‘continuity of care - early supported discharge’ and ‘continuity of care - short term program based on consultation’. The ‘short term program’ category involved interventions that were short (one to three sessions), delivered by a health professional and focussed on assessment and subsequent referral to other agencies. In all categories interventions were conducted either face-to-face, via telephone calls or using a combination of these methods. Details of the individual studies are presented in Table 3 and findings are summarised by intervention category.
Continuity of care - case management
Description of reviews and studies
In the category of case management we included two SRs due to differences in the participants involved; one involved only people with stroke and the other involved only people with TBI. A Cochrane review published by Ellis and colleagues in 2010 included 16 RCTs that examined the effectiveness of stroke liaison workers for patients following stroke . We found one RCT (n = 380) published after the search date of the SR that examined the effects of a six month case management intervention for people with stroke on discharge from acute care. In addition, a systematic review published in 1999 examined the effectiveness of case management for patients following traumatic brain injury . Since then, three RCTs involving people with a TBI have assessed the evidence for a case management intervention [26–28]. Another RCT examined the evidence for case management focussed on returning people with an ABI to work . The participant group comprised seven people with TBI, six people with cerebral infarcts, seven people with intracranial haemorrhage and two people with other diagnoses.
Quality of reviews and studies
The SR involving people with stroke was recently published, involved a large number of RCTs (n = 16) and addressed the majority of the AMSTAR criteria (8/11) . In contrast, the SR involving people with TBI  was published in 1999 and addressed few of the AMSTAR criteria (3/11). Their review comprised three low quality studies, one of which was randomised. The RCT conducted with stroke survivors was of high quality (PEDro 8/10). The three RCTs conducted with people with a TBI were of good quality (PEDro ≥6/10) whereas the RCT conducted with people with an ABI was of poorer quality (PEDro 4/10) and involved a small number of participants (n = 22).
Effects of interventions
The SR conducted with stroke survivors found that there were no differences between groups on mortality at follow up . Both SRs [23, 25] and two of the RCTs [26, 28] reported on levels of dependence in ADL function post intervention. Both SRs found that there were no significant differences between groups. However, Ellis and colleagues found in a subgroup analysis that stroke survivors with mild to moderate disability (Barthel score of 15 to 19) who received case management were more likely to be have a significant reduction in dependence (OR 0.62, 95% CI 0.44 to 0.87) in comparison to those who did not receive case management. One RCT conducted with people with TBI found that patients receiving case management had improved functional status (on a composite outcome measure) at follow up however the magnitude of the effect was unclear , whereas another RCT involving people with TBI found there were no significant differences between groups in ADL function measured using the Functional Independence Measure and Disability Rating Scale at follow-up . Both SRs and four of the RCTs reported on levels of participation at follow up. The SR involving stroke survivors found that there were no significant differences between groups at follow up. The SR involving people with a TBI reported that there was some evidence (based on two NRCTs) that case management improved vocational status. The three RCTs conducted with people with TBI showed conflicting results; two of the RCTs were unable to find differences between groups in participation outcomes [26, 28] whereas the other RCT found that people in the intervention group reported less impact on work and leisure roles than those in the control group at follow up . The RCT involving people with an ABI provided a case management intervention focussed on returning people to work and found that at six month follow up a higher number of people from the intervention group were employed (64% vs 36%) . One SR  and five RCTs [24, 26–29] examined the effects of case management intervention on quality of life. The SR and four of the RCTs found there were no differences in outcomes between groups [23, 24, 26, 27, 29]. The remaining study found that the intervention group had significantly better adjusted mean scores on the Euroqol (0.78 vs 0.67) .
The SR involving stroke survivors reported on participant satisfaction ; they found evidence (based on three RCTs included in their review) suggesting that participants receiving case management were more satisfied that someone had listened to them (OR 1.58, 95% CI 1.14 to 2.19).
In summary, one systematic review containing 16 RCTs and one RCT published since the review suggest that there are few overall significant benefits in providing case management services for people with stroke however there may be some benefits in providing case management for people with mild to moderate levels of disability. In addition, case management may increase satisfaction with care. One systematic review and four RCTs provided inconclusive evidence regarding the effectiveness of case management for people with TBI.
Continuity of care - Early supported discharge (ESD)
Description of reviews and studies
We identified a Cochrane review published in 2012 that examined the effect of early supported discharge programs after stroke . Early supported discharge was defined in the review as “any intervention that aimed to accelerate discharge from hospital with the provision of support (with or without a 'therapeutic' rehabilitation intervention) in a community setting”. The review included 14 RCTs. No RCT, NRCT, CBA or ITS studies were identified which were published subsequently to this review and addressed this research question.
Quality of reviews and studies
The review was well reported, addressing 9 out of 11 of the AMSTAR criteria.
Effects of interventions
The SR reported on level of dependence in ADL and found that based on the results of nine trials there were no significant differences between groups. However, the SR found that patients receiving an ESD program were marginally more independent in extended ADL (standardised mean difference (SMD) 0.12 (95% CI 0.00 to 0.25)). The SR found no significant effect on quality of life or mortality. However, when assessing the outcome of death or dependency they found strong evidence that ESD programs led to similar or improved functional outcome (OR 0.80 (95% CI 0.67 to 0.97)) . Subgroup analysis showed that patients with mild to moderate levels of disability (initial Barthel index >9/20) appeared to benefit most from ESD intervention however, it should be noted that the benefits associated with ESD were not always sustained at longer term follow up assessment .
The SR reported on the effect on length of stay and found ESD intervention was associated with a significant reduction in length of stay in acute care equivalent to approx seven days (Mean Difference (MD) -6.84 (95% CI −11.20 to −2.49)). Overall patients receiving ESD services were significantly more likely to report satisfaction with care services (OR 1.60, 95% CI 1.08 to 2.38, P = 0.02).
In summary, there is Level I evidence that ESD programs can improve functional outcomes, reduce length of stay and increase patient satisfaction. The authors of the review reached a consensus that the important factors of the ESD service included delivery of therapy in the home setting and coordinated multidisciplinary care. The greatest benefits were seen where the ESD team coordinated the hospital discharge, post-discharge care and delivery of home rehabilitation and support.
Continuity of care - Short term programs
Description of reviews and studies
We identified six RCTs in this category [31–36]; three of these studies involved people with a traumatic brain injury and the remaining involved people with stroke. No SRs, NRCT, CBA or ITS studies were identified which addressed this research question. The purpose of the intervention, and health professionals delivering the intervention in this category varied greatly. Study interventions included: visits from a geriatric rehabilitation physician or physiotherapist , assessment conducted by a stroke nurse six months after stroke , follow up in a multidisciplinary TBI clinic , routine follow up approximately one week post TBI from an occupational therapist or psychologist [34, 35] and follow up one month following discharge after stroke .
Quality of reviews and studies
As seen in Table 3, PEDro scores for included studies tended to be low and scores ranged from 2/10 to 8/10.
Effects of interventions
There were few significant findings in favour of short term programs of continuity of care. One RCT reported on mortality outcomes and found no significant differences between groups . Two RCTs reported on level of dependence in ADL and found no significant differences between groups [31, 32]. Five RCTs reported on participation outcomes; three of these found no significant differences between groups [31–33]. The remaining two RCTs were conducted with people with TBI and found that people in the control group were significantly more likely to have difficulties in participation (as measured by the Rivermead Head Injury follow up Questionnaire) than those in the intervention group [34, 35]. Two RCTs examined effects on quality of life and were unable to identify significant benefits associated with intervention [33, 36].
One of the RCTs assessed participant satisfaction and found that patients receiving the intervention reported that they were more satisfied with the information provided to them and the planning prior to their return home compared with usual care .
In summary, we identified a number of studies evaluating short term programs however, low study quality and clinical heterogeneity means that it is difficult to draw conclusions about these studies.
Description of reviews and studies
We included one SR , five RCTs [20, 38–41] and one NRCT  that addressed this question (See Table 4). No CBA or ITS studies were identified which addressed this research question. The SR conducted by Parker and colleagues (2012) examined one aspect of quality monitoring; that is whether the evaluation of compliance with quality metrics or public reporting improved patient outcomes including mortality, disability, quality of life or patient satisfaction. They included 14 observational studies that examined compliance with quality metrics and two observational studies that examined public reporting; all studies took place in acute stroke settings. Four of the primary studies (3 RCTs, 1 NRCT) included in our review aimed to improve compliance with interventions regarded as best practice in acute care (for example, increasing the rates of thrombolysis to appropriate patients) [38–40, 42]. The quality monitoring intervention approaches used within these studies varied (Table 4). Two RCTs examined quality monitoring interventions in a stroke rehabilitation setting [20, 41]. The processes involved in the interventions were different however, the aim of both interventions was to improve team functioning and involved strategies such as audit, feedback and team training
Quality of reviews and studies
The SR addressed 3 of the 11 AMSTAR criteria. The RCTs ranged in quality; two were of lower quality with PEDro scores of 4/10  and 5/10 . The remaining three RCTs were of good quality (≥6/10 on the PEDro scale) [38–40]. The NRCT scored 13/26 on the Downs and Black Scale reflecting methodological weaknesses .
Effects of interventions
The SR reported broadly on the effect on patient outcomes (which included mortality, disability, quality of life and patient satisfaction). They found conflicting evidence as approximately half of the sixteen studies included in the review found mostly positive relationships with patient outcome whereas the other half reported either limited or no significant relationship . One good quality RCT reported on mortality following intervention and found no significant differences between groups . Three RCTs reported on participants’ level of dependence in ADLs post intervention [20, 38, 41]. Findings were mixed; one of the RCTs found no significant difference  whereas another reported that patients in the intervention group made more improvement on the motor component of the Functional Independence Measure (13.6% absolute difference in percentage of patients gaining more than 23 points) . In contrast, Dirks and colleagues found that although the quality monitoring intervention achieved their goal of increasing thrombolysis rates, patients in the intervention group were less likely to have a good clinical outcome (Modified Rankin Scale <3) at 3 months (adjusted OR, 0.56 (95% CI 0.42 to 0.74) . This same RCT found there were no significant differences between groups in quality of life .
Three RCTs reported on resource use. One RCT found that there were some cost savings associated with the intervention due to lower hospital admission costs (difference -$455 USD; 95% CI -$232 to -$679 USD) . However, two RCTs conducted in stroke rehabilitation settings found no significant differences between groups in length of stay [20, 41]. Three RCTs [38–40] and one NRCT  reported on the effect of the quality monitoring intervention on process measures. The study conducted by Dirks and colleagues found that rates of thrombolysis were increased in the intervention group (44.3% vs 39.8% in the control group (difference 4.5%; 95% CI 3.1% to 5.9%) . Johnston and colleagues found that standardised stroke discharge orders increased the rates of ‘optimal treatment’ in individual patients (from 37% to 45%)  and Hinchey and colleagues found significant improvements in achieving one of four targeted process outcomes (98% in the intervention group compared to 87% in the control group) which was discharging a patient with atrial fibrillation on warfarin. Only one of the studies was unable to find any significant benefits in favour of the intervention group on process outcomes . One RCT reported on participant satisfaction and found that patients in the intervention group reported significantly lower levels of satisfaction with intervention (mean 7.7 vs 8.8) .
In summary, level I evidence from one systematic review and six clinical trials indicates that while some improvements in processes outcomes have been associated with quality monitoring interventions, the effects on patient and health system outcomes are not consistent. There is not clear evidence supporting a particular approach to quality monitoring, and the primary studies evaluating these interventions were of variable methodological quality.
This review addressed six research questions; we found eligible papers to address four of these six questions. We included five systematic reviews and 21 trials (20 of which were randomised) in this review to answer these four questions. The majority of studies involved people with stroke rather than TBI, and most of the studies involved participants with mild to moderate levels of disability rather than people with a severe ABI. The RCTs were of mixed quality; most (n = 13, 65%) were assessed as being good quality with a PEDro score of ≥6/10.
Overall we found some evidence from three RCTs supporting integrated care models, and strong evidence from one systematic review for the use of early supported discharge teams after stroke. We found there was little evidence (based on one systematic review and one RCT) to support case management services for people with stroke and there was insufficient evidence from which to draw conclusions regarding case management for people with TBI (based on one systematic review and four RCTs). There was little evidence from one systematic review and one RCT to support the use of integrated care pathways and while some quality monitoring interventions have lead to improvements in patient care, results are inconsistent and there is insufficient evidence to support one particular quality monitoring approach (based on one systematic review and six clinical trials).
This review is the first known review of its type in ABI and provides useful information for health care service providers, funding bodies or policy makers wishing to establish or modify existing services for people with an ABI. This review complements the ABIEBR  module on models of care by including studies involving people with stroke and thus synthesising a larger body of literature.
The interventions of interest within this review were complex interventions; this presents issues in interpretation of the research. For example, the studies examining the effect of integrated care compared different interventions in which the degree of integration was only one of the possible explanatory variables. The study conducted by Kalra and colleagues compared comprehensive stroke care provided in a discrete location with care provided by a mobile stroke team . It is possible that benefits in the comprehensive care group were related to other factors such as the dedicated nursing staff on the comprehensive unit.
Our finding regarding the lack of evidence for integrated care pathways warrants further discussion. The systematic review by Kwan and colleagues was published in 2002 and only identified three RCTs. The RCTs failed to identify any significant benefits following the introduction of ICPs and suggest that a “one size fits all” approach does not work. However, two of these RCTs [20, 43] were poorly reported and published in the early 1990s and as such, findings from these studies may be of limited relevance to current clinical practice. The more recent RCT conducted by Middleton and colleagues  was of high quality and much more specific in nature than the ICPs included within the 2002 systematic review. This type of pathway may be more effective and further high quality research is warranted to determine the effect of similar pathways for other impairments following ABI.
Evaluation of quality monitoring interventions is challenging in that the different quality monitoring interventions may vary in their effectiveness and their effectiveness may in turn vary in different contexts and settings. The baseline performance of the multidisciplinary team, receptiveness to intervention and the drivers of change in each setting may also influence the outcome, and should thus be reported in any trial. It is possible that clinicians may respond more positively to feedback regarding individual performance outcomes than team outcomes; this was also not addressed in any of the included studies. The majority of reviews and studies included within this review relate to people with mild to moderate levels of disability in terms of their level of independence in activities of daily living. The focus on people with less severe disability may partly relate to the nature of the research questions. Case management or follow up programs tend to be directed at people returning to their own home who are less severely disabled than those discharged to residential care services. This may also be due to the presence of less research related to people with higher levels of disability who may be excluded from studies due to communication or cognitive impairment. However, long term care for people with severe levels of disability is costly and people with severe levels of disability may gain more from interventions directed at improving their quality of life. More research is required to evaluate the best methods of organising health care services for this group. Most of the included studies also recruited people with stroke rather than other forms of ABI. As previously described, in most settings worldwide people with an ABI tend to be treated by the same team in the same settings; therefore researchers should consider a pragmatic approach by including all patients with ABI. While the needs and goals of people with different diagnoses may vary, there are areas of commonalities and the needs of all people with an ABI should be considered in the establishment of services.
There are some limitations associated with this review. Firstly, although we included research designs of the highest quality, the way in which some studies were reported suggests that they were susceptible to bias and therefore results should be interpreted with caution. All studies were appraised and results of the appraisal were presented in Tables 1, 2, 3 and 4. In addition, studies of particularly high or low quality were noted in the text. Our search for eligible studies was highly sensitive yielding a large volume of titles and abstracts; however it is possible that publication bias is present as we excluded conference proceedings and did not search clinical trial registries or contact authors. Furthermore, one author (KL) screened titles and abstracts identified from the search and one person (KL) extracted data (checked by a second author (LP)). We also did not include studies published prior to 1980 and those published in languages other than English.
We summarised the evidence using the same classification system as the ABIEBR to ensure consistency however, this was at the expense of using other more highly regarded systems such as GRADE . There are many factors involved in designing or reviewing health care services. This review addresses specific organisational interventions but does not address issues such as the level of staffing and personnel that should be involved in providing care.
Based on the evidence identified in the review we identified several implications for the establishment or review of the organisation of health care services for people with ABI. We have also identified areas in which there is conflicting evidence and where more evidence is required. Our findings suggest: there is Level I evidence that improved outcomes, including a shorter length of stay, are possible under an integrated care model where acute, rehabilitation, and community/ambulatory services are provided under one management team; there is Level I evidence that compliance with a specific integrated care pathway in the acute setting may result in improved patient outcomes and reduced mortality in stroke patients; case management after inpatient rehabilitation for stroke patients is associated with few reported benefits for stroke survivors; case management for patients with TBI has not yet been well studied; and there is conflicting evidence that quality monitoring interventions may lead to improved patient outcomes however at present, no particular quality monitoring approach can be recommended.
Australian Bureau of Statistics: Disability, ageing and carers: summary of findings, Australia. ABS cat no 4430.0. 2004, ABS: Canberra
Faul M, Xu L, Wald M, Coronado V: Traumatic brain injury in the United States: emergency department visits, hospitalizations, and deaths. 2010, Atlanta: Centers for Disease Control and Prevention, National Center for Injury Prevention and Control
Key facts and statistics: Key facts and statistics. https://www.headway.org.uk/key-facts-and-statistics.aspx.
Australian Institute of Health and Welfare: National community services data dictionary. Cat. no. HWI 91. 2006, Canberra: AIHW
Turner-Stokes L, Wade D: Rehabilitation following acquired brain injury: concise guidance. Clin Med. 2004, 4 (1): 61-65. 10.7861/clinmedicine.4-1-61.
Cramer C, Sur M, Dobkin B, O'Brien C, Sanger T, Trojanowski J, Rumsey J, Hicks R, Cameron J, Chen D, Chen W, Cohen L, DeCharms C, Duffy C, Eden G, Fetz E, Filart R, Freund M, Grant S, Haber S, Kalivas P, Kolb B, Kramer A, Lynch M, Mayberg H, McQuillen P, Nitkin R, Pascual-Leone A, Reuter L, Schiff N, et al: Harnessing neuroplasticity for clinical applications. Brain. 2011, 134 (6): 1591-1609. 10.1093/brain/awr039.
Stein S, Georgoff P, Meghan S, Mirza K, Sonnad SS: 150 years of treating severe traumatic brain injury: A systematic review of progress in mortality. J Neurotrauma. 2010, 27 (7): 1343-1353. 10.1089/neu.2009.1206.
Stroke Unit Trialists’ Collaboration: Organised inpatient (stroke unit) care for stroke. Cochrane Database Syst Rev. 2007, CD000197-Art. No.: CD000197. doi:10.1002/14651858.CD000197.pub2, 4
ERABI: Evidence-Based Review of Moderate to Severe Acquired Brain Injury. 2012
Laver K, Lannin N, O'Connor D, Bragge P, Hunter P, Khan F, Holland A, Teasell R, Gruen R: Organising health care services for people with an acquired brain injury requiring acute care or rehabilitation services. PROSPERO. 2013
Shea B, Grimshaw J, Wells G, Boers M, Andersson N, Hamel C, Porter A, Tugwell P, Moher D, Bouter L: Development of AMSTAR: a measurement tool to assess the methodological quality of systematic reviewa. BMC Med Res Methodol. 2007, 7 (10).
Moseley A, Herbert R, Sherrington C, Maher C: Evidence for physiotherapy practice: a survey of the Physiotherapy Evidence Database (PEDro). Aust J Physiother. 2002, 48: 43-49. 10.1016/S0004-9514(14)60281-6.
Downs S, Black N: The feasibility of creating a checklist for the assessment of the methodological quality both of randomised and non-randomised studies of health care interventions. J Epidemiol Community Health. 1998, 52: 377-384. 10.1136/jech.52.6.377.
Indredavik B, Fjaertoft H, Ekeberg G, Loge A, Morch B: Benefit of an extended stroke unit service with early supported discharge: a randomized, controlled trial. Stroke. 2000, 31 (12): 2989-2994. 10.1161/01.STR.31.12.2989.
vanHolmqvist L, vVon KL, Kostulas V, Holm M, Widsell G, Tegler H, Johansson K, Almazan J, de Pedro-Cuesta J: A randomized controlled trial of rehabilitation at home after stroke in southwest Stockholm. Stroke. 1998, 29 (3): 591-597. 10.1161/01.STR.29.3.591.
Kalra L, Evans A, Perez I, Knapp M, Donaldson N, Swift C: Alternative strategies for stroke: a prospective randomised controlled trial. Lancet. 2000, 356: 894-899. 10.1016/S0140-6736(00)02679-9.
Kwan J, Sandercock P: In-hospital care pathways for stroke. Cochr Database Syst Rev (Online). 2004, 2: CD002924.
Middleton S, McElduff P, Ward J, Grimshaw JM, Dale S, D'Este C, Drury P, Griffiths R, Cheung NW, Quinn C, Evans M, Cadilhac D, Levi C, QASC Trialists Group: Implementation of evidence-based treatment protocols to manage fever, hyperglycaemia, and swallowing dysfunction in acute stroke (QASC): a cluster randomised controlled trial. Lancet. 2011, 378 (9804): 1699-1706. 10.1016/S0140-6736(11)61485-2.
Sulch D, Perez I, Melbourn A, Kalra L: Randomized controlled trial of Integrated (managed) Care Pathway for stroke rehabilitation. Stroke. 2000, 31 (8): 1929-1934. 10.1161/01.STR.31.8.1929.
Falconer JA, Roth EJ, Sutin JA, Strasser DC, Chang RW: The critical path method in stroke rehabilitation: lessons from an experiment in cost containment and outcome improvement. QRB Qual Rev Bull. 1993, 19 (1): 8-16.
Odderson I, McKenna B: A model for management of patients with stroke during the acute phase: Outcome and economic implications. Stroke. 1993, 24: 1823-1827. 10.1161/01.STR.24.12.1823.
Ross G, Johnson D, Kobernick M: Evaluation of a critical pathway for stroke. J Am Osteopath Assoc. 1997, 97 (5): 269-276.
Ellis G, Mant J, Langhorne P, Martin D, Winner S: Stroke liason workers for stroke patients and carers: an individual patient data meta-analysis. Cochrane Database Syst Rev. 2010, 5: Art. No.: CD005066. doi:10.1002/14651858.CD005066.pub2
Allen K, Hazelett S, Jarjoura D, Hua K, Wright K, Weinhardt J, Kropp D: A randomized trial testing the superiority of a postdischarge care management model for stroke survivors. J Stroke Cerebrovasc Dis. 2009, 18 (6): 443-452. 10.1016/j.jstrokecerebrovasdis.2009.02.002.
Patterson PK, Maynard H, Chesnut RM, Carney N, Mann NC, Helfand M: Evidence of case management effect on traumatic-brain-injured adults in rehabilitation. Care Manag J. 1999, 1 (2): 87-97.
Bell K, Brockway J, Hart T, Whyte J, Sherer M, Fraser R, Temkin N, Dikmen S: Scheduled telephone intervention for traumatic brain injury: a multicenter randomized controlled trial. Arch Phys Med Rehabil. 2011, 92 (10): 1552-1560. 10.1016/j.apmr.2011.05.018.
Bell K, Hoffman J, Temkin N, Powell J, Fraser R, Esselman P, Barber J, Dikmen S: The effect of telephone counselling on reducing post-traumatic symptoms after mild traumatic brain injury: a randomised trial. J Neurol Neurosurg Psychiatry. 2008, 79 (11): 1275-1281. 10.1136/jnnp.2007.141762.
Bell KR, Temkin NR, Esselman PC, Doctor JN, Bombardier CH, Fraser RT, Hoffman JM, Powell JM, Dikmen S: The effect of a scheduled telephone intervention on outcome after moderate to severe traumatic brain injury: a randomized trial. Arch Phys Med Rehabil. 2005, 86 (5): 851-856. 10.1016/j.apmr.2004.09.015.
Trexler LE, Trexler LC, Malec JF, Klyce D, Parrott D: Prospective randomized controlled trial of resource facilitation on community participation and vocational outcome following brain injury. J Head Trauma Rehabil. 2010, 25 (6): 440-446. 10.1097/HTR.0b013e3181d41139.
Fearon P, Langhorne P, Early Supported Discharge Trialists: Services for reducing duration of hospital care for acute stroke patients. Cochrane Database Syst Rev. 2012, 9: Art. No.: CD000443. doi:10.1002/14651858.CD000443.pub3
Andersen H, Schultz-Larsen K, Kreiner S, Forchhammer B, Eriksen K, Brown A: Can readmission after stroke be prevented? Results of a randomized clinical study: a postdischarge follow-up service for stroke survivors. Stroke. 2000, 31 (5): 1038-1045. 10.1161/01.STR.31.5.1038.
Forster A, Young J, Green J, Patterson C, Wanklyn P, Smith J, Murray J, Wild H, Bogle S, Lowson K: Structured re-assessment system at 6 months after a disabling stroke: a randomised controlled trial with resource use and cost study. Age Ageing. 2009, 38 (5): 576-583. 10.1093/ageing/afp095.
Ghaffar O, McCullagh S, Ouchterlony D, Feinstein A: Randomized treatment trial in mild traumatic brain injury. J Psychosom Res. 2006, 61 (2): 153-160. 10.1016/j.jpsychores.2005.07.018.
Wade DT, Crawford S, Wenden FJ, King N, Moss NE: Does routine follow up after head injury help? A randomised controlled trial. J Neurol Neurosurg Psychiatry. 1997, 62 (5): 478-484. 10.1136/jnnp.62.5.478.
Wade DT, King NS, Wenden FJ, Crawford S, Caldwell FE: Routine follow up after head injury: a second randomised controlled trial. J Neurol Neurosurg Psychiatry. 1998, 65 (2): 177-183. 10.1136/jnnp.65.2.177.
Ytterberg C, Anderson M, Britton M: How do stroke patients fare when discharged straight to their homes? A controlled study on the significance of hospital follow-up after one month. Scand J Rehabil Med. 2000, 32 (2): 93-96. 10.1080/003655000750045613.
Parker C, Schwamm LH, Fonarow GC, Smith EE, Reeves MJ: Stroke quality metrics: systematic reviews of the relationships to patient-centered outcomes and impact of public reporting. Stroke. 2012, 43 (1): 155-162. 10.1161/STROKEAHA.111.635011.
Dirks M, Baeten SA, Dippel DW, van Exel NJ, van Wijngaarden JD, Huijsman R, Koudstaal PJ, Niessen LW, Practise I: Real-life costs and effects of an implementation program to increase thrombolysis in stroke. Neurology. 2012, 79 (6): 508-514. 10.1212/WNL.0b013e31826356bf.
Johnston SC, Sidney S, Hills NK, Grosvenor D, Klingman JG, Bernstein A, Levin E: Standardized discharge orders after stroke: results of the quality improvement in stroke prevention (QUISP) cluster randomized trial. Ann Neurol. 2010, 67 (5): 579-589.
Lakshminarayan K, Borbas C, McLaughlin B, Morris NE, Vazquez G, Luepker RV, Anderson DC: A cluster-randomized trial to improve stroke care in hospitals. Neurology. 2010, 74 (20): 1634-1642. 10.1212/WNL.0b013e3181df096b.
Strasser DC, Falconer JA, Stevens AB, Uomoto JM, Herrin J, Bowen SE, Burridge AB: Team training and stroke rehabilitation outcomes: a cluster randomized trial. Arch Phys Med Rehabil. 2008, 89 (1): 10-15. 10.1016/j.apmr.2007.08.127.
Hinchey JA, Shephard T, Tonn ST, Ruthazer R, Hermann RC, Selker HP, Kent DM: The Stroke Practice Improvement Network: a quasiexperimental trial of a multifaceted intervention to improve quality. J Stroke Cerebrovasc Dis. 2010, 19 (2): 130-137. 10.1016/j.jstrokecerebrovasdis.2009.03.016.
Schull D, Tosch P, Wood M: Clinical nurse specialists as collaborative care managers. Nurs Manage. 1992, 23: 30-33.
GRADE Working Group: Grading quality of evidence and strength of recommendations. BMJ. 2004, 328 (7454): 1490.
The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1472-6963/14/397/prepub
This project is funded by the Transport Accident Commission (TAC), through the Institute for Safety, Compensation and Recovery Research (ISCRR). DO’C is supported by an Australian NHMRC Public Health Fellowship (606726).
The authors wish to thank their colleagues for their assistance in preparation of this document: Loyal Pattuwage for his assistance in searching the literature, data extraction and appraisal of methodological quality of included studies; Dina Watterson for her assistance in data extraction and appraisal of methodological quality of included studies; Ornella Clavisi for her advice on the protocol and search strategy, Lisa Gill for feedback on the research questions included in the review; and Michelle Fiander for her assistance in searching the Cochrane EPOC Group trials register.
The authors declare that they have no competing interests.
KL: Kate Laver is the guarantor of the review. Contributions included co-ordinating the review, drafting the protocol, developing the search strategy, conducting the search, extracting data from the trials, entering data, data analysis and drafting the final manuscript. NL: Contributions included initiation and conceptualisation of study design, reviewing and editing the protocol and search strategy, data selection and extraction (arbiter), data analysis and interpretation, and editing all manuscripts including final manuscript. PB: Contributions included reviewing and editing the protocol and search strategy, data interpretation, and editing all manuscripts including final manuscript. PH: Contributions included reviewing and editing the protocol and search strategy, data interpretation, and editing all manuscripts including final manuscript. AH: Contributions included reviewing and editing the protocol and search strategy, data interpretation, and editing all manuscripts including final manuscript. FK: Contributions included reviewing and editing the protocol, and editing all manuscripts including final manuscript. DO’C: Contributions included data interpretation, and editing all manuscripts including final manuscript. ET: Contributions included data interpretation, and editing all manuscripts including final manuscript. RT: Contributions included reviewing and editing the protocol, data interpretation, and editing all manuscripts including final manuscript. RG: Contributions included reviewing and editing the protocol, and editing all manuscripts including final manuscript. All authors read and approved the final manuscript.
Electronic supplementary material
Authors’ original submitted files for images
About this article
- Brain injuries
- Craniocerebral trauma
- Systematic review
- Case management
- Delivery of health care
- Quality assurance (Health Care)