Is cost effectiveness sustained after weekend inpatient rehabilitation? 12 month follow up from a randomized controlled trial
BMC Health Services Research volume 15, Article number: 165 (2015)
Our previous work showed that providing additional rehabilitation on a Saturday was cost effective in the short term from the perspective of the health service provider. This study aimed to evaluate if providing additional rehabilitation on a Saturday was cost effective at 12 months, from a health system perspective inclusive of private costs.
Cost effectiveness analyses alongside a single-blinded randomized controlled trial with 12 months follow up inclusive of informal care. Participants were adults admitted to two publicly funded inpatient rehabilitation facilities. The control group received usual care rehabilitation services from Monday to Friday and the intervention group received usual care plus additional Saturday rehabilitation. Incremental cost effectiveness ratios were reported as cost per quality adjusted life year (QALY) gained and for a minimal clinical important difference (MCID) in functional independence.
A total of 996 patients [mean age 74 years (SD 13)] were randomly assigned to the intervention (n = 496) or control group (n = 500). The intervention was associated with improvements in QALY and MCID in function, as well as a non-significant reduction in cost from admission to 12 months (mean difference (MD) AUD$6,325; 95% CI −4,081 to 16,730; t test p = 0.23 and MWU p = 0.06), and a significant reduction in cost from admission to 6 months (MD AUD$6,445; 95% CI 3,368 to 9,522; t test p = 0.04 and MWU p = 0.01). There is a high degree of certainty that providing additional rehabilitation services on Saturday is cost effective. Sensitivity analyses varying the cost of informal carers and self-reported health service utilization, favored the intervention.
From a health system perspective inclusive of private costs the provision of additional Saturday rehabilitation for inpatients is likely to have sustained cost savings per QALY gained and for a MCID in functional independence, for the inpatient stay and 12 months following discharge, without a cost shift into the community.
Australian and New Zealand Clinical Trials Registry November 2009 ACTRN12609000973213.
The role of rehabilitation within a health service is to achieve and maintain optimal functioning for the patient . Rehabilitation services are available across a variety of settings including acute hospitals, inpatient rehabilitation facilities or in the community [1,2]. There is emerging evidence of short term clinical and economic gains for the provision of additional weekend rehabilitation services for inpatients including likely cost savings associated with a reduction in hospital length of stay, as well as higher functional status and improved quality of life on discharge from rehabilitation [3,4].
There is an important distinction between achieving short term gains following an intervention and sustaining these gains over the medium and longer term . The success of rehabilitation may initially focus on the point of discharge from the rehabilitation program, but there is also value in evaluating the sustainability of this success. Measuring success for inpatient rehabilitation may include reporting gains in functional status or quality of life using specific outcome measures , or it may take a broader view that reports the ability to return to the community, participate in the workforce and resume usual societal roles . No matter the viewpoint, sustainability of the intervention is an important consideration to measuring the success of inpatient rehabilitation.
Another consideration in measuring the success and sustainability of rehabilitation is understanding the resource impact on the health system and the broader community beyond discharge from the rehabilitation facility. In the 12 months following discharge from rehabilitation, patients have a high rate of health care and community resource use, such as readmission to inpatient health services, visits to allied health professionals, and the use of informal care which can increase the burden on the community [7,8]. An economic evaluation limited to the perspective of the inpatient rehabilitation facility will miss the ongoing health and community resources utilized once the patient has been discharged to the community. Taking a broader health system perspective inclusive of private costs and a longer follow up period will capture these additional resources.
Providing additional Saturday rehabilitation is likely to be cost saving per quality adjusted life year (QALY) gained and for a minimal clinical important difference (MCID) in functional independence from the perspective of the individual health service including the 30 day period following discharge . However, the resource impact on the broader health system is not known in the 12 month period following discharge and whether the cost and clinical outcome results favoring additional Saturday rehabilitation are sustained in the medium and longer term. The aim of this study was to determine from a health system perspective inclusive of private costs if the likely short-term cost effectiveness of providing an additional Saturday rehabilitation service to inpatients in addition to Monday to Friday compared to Monday to Friday rehabilitation alone, is sustained 12 months following discharge from rehabilitation.
Research design and intervention
An economic evaluation alongside a randomized controlled trial from a health system perspective inclusive of private costs from admission until 12 months following discharge, was completed comparing usual care Monday to Friday rehabilitation to Monday to Saturday rehabilitation. Saturday rehabilitation consisted of a one hour scheduled Physiotherapy session and a one hour scheduled Occupational Therapy session. Full details of the protocol , the clinical outcomes  and an economic evaluation of the clinical trial with a 30 day follow up period from the perspective of the health service  have been published elsewhere. The trial was registered with the Australian and New Zealand Clinical Trials Registry (ACTRN12609000973213) prior to patient recruitment. This economic evaluation follows the recommendations of the Consolidated Health Economic Evaluation Reporting Standards (CHEERS) Checklist .
The economic evaluation has taken a health system perspective inclusive of private costs. Out-of-pocket costs for access to medical, non-medical services and pharmaceuticals have been included in this analysis. Informal care was also included on the assumption that its availability meant that health system costs were reduced. For example, without the availability of informal care at discharge, length of stay may have increased, or patients may have been discharged with additional formal community-based health services. We do not consider this economic evaluation to be from a broader societal perspective as productivity changes have not been incorporated.
Participants, recruitment and setting
Recruitment occurred from July 2010 until June 2011 and participants were included if they were 18 years or older and required acute inpatient rehabilitation at one of the two facilities participating in the trial . The economic analysis included the initial rehabilitation admission and had a primary endpoint 12 months following discharge from rehabilitation, with an interim endpoint 6 months following discharge from rehabilitation.
Administrative data were obtained from the primary health service for the initial rehabilitation admission and for any admission in the period 12 months following discharge. The data were at the individual level and included the reason for admission, diagnosis related group (DRG), length of stay, as well as resource use and cost. In addition, data from Medicare for medical services and pharmaceuticals (Pharmaceutical Benefits Scheme (PBS)) were obtained for each consenting participant for the 12 months following discharge (Tables 1 and 2).
Health service utilization questionnaire
As the administrative data were limited to acute episodes (including acute phase rehabilitation) for the primary health service and non-hospital health care for Medicare (for example medical and pharmaceuticals), a self-reported health service utilization questionnaire was designed to supplement these data (Additional file 1). The questionnaire was completed for participants at 6 and 12 months following discharge from rehabilitation, administered by assessors blinded to group allocation. Participants reported admissions and length of stay of acute or rehabilitation hospital admissions in facilities outside of the primary health service, as well as primary care. There were no double counting of Medicare and primary health service data in the self-reported health service utilization data because the self-reported data were checked against both the Medicare and primary health service data. Where we had recorded the same services, these were removed from the self-reported data. For example, General Practitioner community visits were reported in both the self-reported and Medicare data, hence they were removed from the self-reported data prior to the final analyses. The number and type of non-Medicare health care visits, over-the-counter medications and the assistance of carers were also collected. Carers included community paid carers (for example a patient care attendant) and informal unpaid carers (for example a family member).
All costs were reported as 2012/2013 Australian dollars (AUD$) (international currency conversion available http://www.xe.com/currencyconverter/#converter ). Administrative cost data collected for the primary health service, Medicare and PBS covered three financial years. Inflation rates of 3.7% and 7.2% respectively, were applied to the 2010/2011 and 2011/2012 data consistent with the health care inflation rate of the national Consumer Price Index .
Self-reported health service utilization costs for hospital admissions outside of the primary health service were calculated as an average cost per day, based on data from the primary health service for acute and rehabilitation admissions in 2012/2013. Out-of-pocket costs were included in the charges reported in the Medicare data for medical and non-medical services and pharmaceuticals. The cost of non-Medicare health care services was based on charges for community allied health services from the Victorian Transport Accident Commission . Over-the-counter medications were costed according to the actual drug used (Tables 1 and 2) . Informal (unpaid) care was costed using the total hours reported by patients multiplied by the hourly rate for a community health care attendant, to represent the true resource cost of an equivalent formal health care professional.
Clinical outcomes measures
The EuroQol (EQ-5D-3L) questionnaire [15,16] was used to measure patient health related quality of life and was reported as a utility index score. A MCID in quality of life was based on the recommendation to use half a standard deviation of the baseline score . Applied to the quality of life utility index score in this study, an increase of 0.18 represented a MCID in quality of life . Functional independence was measured using the FIM  administered by credentialed assessors. An increase in the FIM score of 22 points (scores range from 18, lowest function, to 126, highest function) was considered to be a MCID in functional independence based on previous literature . Both outcome measures were administered on admission (baseline) and 6 and 12 months following discharge from rehabilitation by assessors blind to group allocation.
Mean cost difference was determined between the two groups using an independent t-test at 6 months and at 12 months . Cost data in an economic evaluation is typically positively skewed and this is often due to a small number of patients with high costs, although with samples of greater than 150 participants it is reported that the t-test is generally robust . To acknowledge the potential for skewed cost data, we have presented the mean, SD and range for all cost data, as well as the p-value for the t-test and the non-parametric equivalent, the Mann–Whitney U test for total costs at 6 and 12 months. Between group differences in the quality of life utility score and the functional independence score were calculated with analysis of covariance (ANCOVA) using the baseline score as covariate [22,23]. To further address the potential for a skewed distribution of costs and outcomes, relative risks (RRs) were used to calculate the proportion of participants achieving a MCID in the quality of life utility score and the functional independence score at 6 and 12 months following discharge . Analysis was completed using intention-to-treat principles. Missing clinical outcome data and resource use (due to non-consent for the release of Medicare and PBS data or failure to complete the health utilization questionnaire at 6 or 12 months) were managed using a multiple imputation method via chained equations imputation generating 5 imputed datasets [4,24]. Where participants had died (confirmed by the next of kin at the 6 or 12 month survey), they were included in the analyses, with total costs weighted by time in the study. As the exact date of death was unknown, the last date of service from the Medicare data was used as a proxy. For example, if a death was confirmed at the 12 month survey, and the last Medicare service was at 9 months, it was assumed that the person participated in 75% of the follow up period, and costs were weighted at .75. Incident rate ratios (IRR) were analysed for each of the resources in the follow up period to report the difference in event rate between the control and intervention groups.
Incremental cost effectiveness ratios (ICERs) and their associated confidence intervals (CIs) for quality of life utility and functional independence scores were calculated at the sample level using the bootstrap method (5000 repetitions) . Individual ICERs were used to generate confidence ellipses and cost effectiveness acceptability curves (CEACs), using the central limit theorem, to illustrate cost effectiveness across a range of willingness-to-pay values . The use of either the central limit theorem or the bootstrapping method is appropriate to obtain uncertainty around the mean difference when there is a moderate to large sample size (n > 50), even when data are highly skewed . While the ellipses provide important information relating to the statistical significance of the intervention under review, the CEACs allow comparison between different interventions. The ICER for the quality of life utility score represents the cost per QALY gained. The ICER for a one point change in the functional independence score was multiplied to report the cost difference for a 22 point change in the functional independence score, representing the marginal cost for a MCID in functional independence.
Analyses were completed with IBM SPSS Statistics Version 21 , STATA Version 12  and the ICER, CI, CI ellipse and CEAC were completed with software in Microsoft Excel (spreadsheet available from Nixon RM, Wonderling D, Grieve RD. 2010) . All statistical tests were conducted at a 5% level of significance and reported with 95% confidence intervals (CI) unless otherwise stated.
A number of sensitivity analyses were performed on the total cost at 6 and 12 months. Two assumptions were made for informal care; the first was to reduce the self-reported amount by 50%, the second was to remove it altogether. Fifty percent meant that the hours were capped at 12 hours per day representative of a nursing shift. Removing informal care was to allow comparison with previous literature, where the inclusion of informal care is inconsistent, reported in less than 10% of cost utility analyses [28,29].
Data from the self-reported health service utilization questionnaire were adjusted to address the uncertainty of recall bias. To determine the direction and amount of adjustment, we compared community General Practitioner (GP) visits recorded in the Medicare administrative data to self-reported data for those participants who were alive at 12 months, had completed both the 6 and 12 month questionnaires and for whom we had 12 months of Medicare data. In addition, self-reported health service utilization data were removed so that only administrative data from the primary health service and Medicare were included, to account for unpredictable variability in self reporting.
Statement of ethics approval
The study obtained ethics approval from Eastern Health Research and Ethics Committee (reference number E58 09/10) and La Trobe University Human Research Ethics Committee (reference number FHEC10/14), including participant consent to meet requirements for Medicare and PBS data. All patients gave informed written consent prior to taking part.
A total of 996 patients were randomized to the control group (n = 500) or the intervention group (n = 496) with the flow of patients through the trial reported elsewhere . Patients had a mean age of 74 years (standard deviation (SD) 13) and 631 (63%) were women. The groups appeared similar for diagnosis and co-morbidities and included 581 (58%) with an orthopedic diagnosis, and 203 (20%) with a neurological diagnosis.
At 12 months, 101 participants had died (intervention group n = 52, control group n = 49) and at 6 months, 65 participants had died (intervention group n = 31, control group n = 34). At 12 months, 82% (n = 812) of the total participants were available for follow up and had completed the health service utilization questionnaire (intervention group n = 401, control group n = 411). Of the 812 participants, there were 460 living at home independently (intervention group n = 231, control group n = 229) and a further 229 living at home with the support of formal or informal carers (intervention group n = 114, control group n = 115).
Values were imputed for the missing data from the 83 participants (8%) who were alive and did not complete the health service questionnaire at 12 months, and for the 52 participants who did not consent to Medicare and PBS data (5%). Administrative data were available from the primary health service for all participants (100%) for the period between the initial rehabilitation admission and 12 months following discharge from rehabilitation.
Cost and utilization data
The mean total cost for the initial rehabilitation admission and the 12 months following discharge from rehabilitation was $61,859 (SD 79,798) for the intervention group and $68,184 (SD 82,922) for the control group, with a mean cost difference of -$6,325 (95% CI −16,730 to 4,081; t test p = 0.23 and MWU p = 0.06) in favor of the intervention group (Table 1). The mean total cost for the initial rehabilitation admission and the 6 months following discharge from rehabilitation was $37,170 (SD 44,351) for the intervention group and $43,615 (SD 49,806) for the control group, with a mean cost difference of -$6,445 (95% CI −9,522 to −3,368; t test p = 0.04 and MWU p = 0.01) in favor of the intervention group (Table 2).
Mean hospital length of stay for all admissions to the primary health service during the 12 months following discharge from rehabilitation was 10.3 days (SD 24.5; n = 496) for the intervention group and 15.2 days (SD 37.4; n = 500) for the control group, with a mean difference of −4.9 days (95% CI −9.0 to −0.9; p = 0.02) in favor of the intervention group (Table 1). The intervention group had an observed event rate of 29% (IRR 0.71; 95% CI 0.52 to 0.96) less than the control group for the risk of readmission to either the primary health service or to another health service over the 12 months following discharge, and an event rate of 34% (IRR 0.66; 95% CI 0.45 to 0.98) less than the control group over 6 months following discharge. Cost and utilization data relating to other health care services, Medicare, PBS and self-reported health utilization data included in the economic evaluation are reported in Tables 1 and 2. For most individual health services there was a pattern of less resource utilization and less cost that favored the intervention group, although these differences were not statistically significant. Excluding readmission to either the primary health service or to another health service, all other health services had a non-significant difference in the observed event rate between the control and the intervention groups, for the 6 and 12 month periods following discharge.
Clinical outcomes measures
Difference between the intervention and control groups for the health related quality of life utility index score was non-significant between admission and 12 months following discharge from rehabilitation (MD 0.01, 95% CI −0.04 to 0.05; p = 0.77) and at 6 months following discharge (MD 0.03, 95% CI −0.01 to 0.08; p = 0.15) (Table 3). At 12 months, participants in the intervention group were 11% more likely to achieve a MCID in health related quality of life utility index score (RR 1.11; 95% CI 1.00 to 1.24) and at 6 months they were 19% more likely to do so (RR 1.19; 95% CI 1.06 to 1.34), compared to the control group. The difference between the intervention and control groups for the functional independence score was non-significant between admission and 12 months following discharge from rehabilitation (MD 1.3, 95% CI −0.9 to 3.5; p = 0.24), although the intervention group had a higher positive change between admission and 6 months following discharge (MD 2.0, 95% CI 0.0 to 4.0; p = 0.05) (Table 3). Participants in the intervention group were not more likely to achieve a MCID in their functional independence score at either 12 months (RR 1.07; 95% CI 0.96 to 1.20) or at 6 months following discharge (RR 1.06; 95% CI 0.94 to 1.19) compared to the control group.
Incremental cost effectiveness ratio
In summary, the results indicate that the intervention is associated with lower costs and improved health outcomes. The ICER and associated 95% CIs may be interpreted as follows; each of the ICERs are positive which represents a cost saving to the health system. When the lower value of the 95% CI is negative, this represents a potential additional cost, and when the lower value of the 95% CI is positive, this represents a potential cost saving. Each of the upper values of the reported 95% CIs are positive which represents a potential cost saving. The ICER for the initial rehabilitation admission and the 12 months following discharge from rehabilitation reported a non-significant cost saving of $282,144 (95% CI −1,074,914 to 1,520,885) per QALY gained for the intervention group compared to the control group. The ICER for this same period reported a non-significant cost saving of $10,199 (95% CI −63,526 to 81,511) for a one point change in the functional independence score for the intervention group compared to the control group; or a cost saving of $200,797 (95% CI −1,300,355 to 1,572,604) for a MCID in functional independence for the intervention group compared to the control group.
The ICER was statistically significant at 6 months following discharge showing a cost saving of $112,320 (95% CI 6,556 to 336,631) per QALY gained for the intervention group compared to the control group. The ICER for this same period reported a non-significant cost saving of $2,540 (95% CI −14,972 to 24,597) for a one point change in the functional independence score for the intervention group compared to the control group, or a non-significant cost saving of $99,580 (95% CI −254,401 to 543,098) for a MCID in functional independence for the intervention group compared to the control group.
The ICER point estimation and the confidence interval ellipses (50%, 75% and 95%) for the 6 and 12 months following discharge from rehabilitation are presented in Figure 1. The confidence ellipses show that most of the 50%, 75% and 95% confidence intervals sit within the bottom right quadrant of the cost effectiveness plane and only a small portion falls in the upper right or lower left quadrants .
Cost effectiveness acceptability curve
For the initial rehabilitation admission and in the 12 months following discharge from rehabilitation, the curves were relatively flat. For a willingness to pay of $50,000 there was 98% certainty of cost effectiveness for a QALY gained or for a MCID in functional independence (Figure 2). Alternatively for this same time period, for a willingness to pay of zero dollars, there was 97% certainty of cost effectiveness for a QALY gained or for a MCID gained in functional independence.
For the initial rehabilitation admission and in the 6 months following discharge from rehabilitation the curves were relatively flat. For a willingness to pay of $23,000 there was almost 100% certainty of cost effectiveness for a QALY gained or for a MCID gained in functional independence (Figure 2). Alternatively for this same time period, for a willingness to pay of zero dollars, there was 98% certainty of cost effectiveness for a QALY gained or for a MCID gained in functional independence.
Reducing the amount of informal care by 50% over the 12 months following discharge from rehabilitation resulted in a non-significant mean cost difference of -$5,518 (95% CI −12,155 to 1,119; p = 0.10) in favor of the intervention group. Reducing the amount to zero resulted in a significant mean cost difference of -$4,711 (95% CI −9,132 to −290; p = 0.04) in favor of the intervention group (Table 4).
Of the 752 participants with complete data at 12 months, there were 9,419 self-reported community GP visits compared to 10,855 visits recorded by Medicare for claims for GP services. This suggests under reporting of self-reported primary health care services. Based on these data, the number of self-reported health services utilized in the 12 months following discharge from rehabilitation was inflated by 15%. This resulted in a non-significant mean cost difference of -$6,660 (95% CI −18,346 to 5,026; p = 0.26) in favor of the intervention group; reducing the amount to zero resulted in a significant mean cost difference of -$4,089 (95% CI −6,165 to −2,012; p = 0.05) in favor of the intervention group (Table 4).
The sensitivity analyses were repeated for the period between the initial rehabilitation admission and in the 6 months following discharge with similar findings that all significantly favored the intervention group (Table 4).
From a health system perspective inclusive of private costs, the provision of a Saturday rehabilitation service to inpatients in addition to Monday to Friday, improved QALYs as well as functional status, and reduced costs compared with usual Monday to Friday care at both 6 and 12 months following discharge from rehabilitation.
One explanation for why the intervention was cost effective at 6 months and possibly cost effective at 12 months was that participants who received the additional Saturday rehabilitation were discharged at a higher level of functional independence  and therefore were equipped to live independently in the community with less dependence on community health services. An interpretation is that the quantity of inpatient rehabilitation does matter; for the patient population in our trial most functional gains occurred during the inpatient stay, with minimal gains following discharge. For example in the current trial, participants in the intervention group had significant gains in their FIM score from admission to discharge (26%), with lesser gains from discharge to 6 months (2%) and no change from 6 to 12 months . These results support previous studies that report most functional gains occur in the initial rehabilitation period and after this functional status largely remains the same [31,32]. Health service resource and cost data that favored the intervention group were realized between admission and 6 months (p = 0.04) but not between 6 and 12 months following discharge.
During the initial inpatient rehabilitation admission there was a potential cost saving from a reduction in length of stay. However, this needs to be considered in the context of the direct additional costs to run a Saturday rehabilitation program . The additional resources required for a Saturday service include therapist time, space, equipment and consumable items. On average these additional resource costs for providing the additional Saturday rehabilitation service were less than $200 per admission, in comparison with the overall observed saving of over $1,600 per admission . This demonstrates that the additional costs of running the Saturday service were offset by a substantial saving over the duration of the rehabilitation admission.
From admission to 12 months following discharge most of the savings to the health system occurred from the reduction in hospital readmissions, with no significant differences in community care services, including medical services. There was no observed cost shift into the community; in fact there was an ongoing cost saving to the community that included reduced readmissions to the primary and other health services. A cost shift may involve reporting false “savings” based on redistributing the cost from one health service into the broader community health systems ; this would be evident if the intervention group had reduced health service utilization in the inpatient stay, but had higher health service utilization across any or all of the other health services in the 12 months following discharge. This was not the case. The intervention group had reduced health service utilization during their inpatient stay with ongoing reduced health service utilization in the 12 months following discharge. These results are consistent with other inpatient rehabilitation intervention studies that report that cost savings during the initial rehabilitation period are associated with a reduced length of stay, and with no cost shift following discharge [8,34].
Another example of cost shift is the reliance on informal care once the patient is discharged from the rehabilitation facility. That is, the cost of care is shifted from the health system into the household and it is frequently family and friends who provide the unpaid care. In addition to this being reported as a potential cost shift, there needs to be consideration of the burden that this may place on the household . In Australia, it is estimated that the annual cost of replacing informal care with paid care is $4.8 billion . Despite this substantial cost to society, support for the inclusion of informal care in an economic evaluation, is not consistent [28,29,37,38]. The scope of this economic evaluation included the utilization of informal care which represented 43% of the total costs. Sixteen percent of our participants had survived a stroke and the cost of informal care was within the range of costs reported by other studies with a stroke cohort where informal care represented 4% to 55% of the total costs [7,8,39]. Contributing to this variation could be different methods for costing informal care, such as allotting one-third the cost of the average national wage , price equivalence to the cost of hostel care , the minimum wage , the cost of a home help worker  or our method of uncapped actual daily hours valued at that of an equivalent paid formal carer. The variation in including the cost of informal care, together with the variation of assumptions of costing of informal care, supported our sensitivity analyses that varied, and removed the cost of informal care. When the amount of informal care was reduced to zero, the observed difference in total cost at 12 months following discharge between the intervention and control groups was significant and in favor of the intervention group.
This economic evaluation has implications for both health service managers, and policy makers. The provision of an additional Saturday inpatient rehabilitation service provided benefits that reduced short term costs to the health service and reduced the medium term costs across the health system including a reduction in hospital readmissions that could potentially free up inpatient beds . In support of this, participants who received additional Saturday rehabilitation had a mean reduction of 4.9 days (95% CI −9.0 to −0.9; p = 0.02; IRR 0.71; 95% CI 0.52 to 0.96) in admission to hospital in the 12 months following discharge from rehabilitation compared with the control group. The implication is a win-win intervention for the health service, the health system and the patient. In Australia, health care is funded by the government at both national and state levels, as well as by private insurers. At the national level, primary health care is publically funded by Medicare and this includes community based health care services (e.g. a general practitioner or medical specialist), whereas the state government is responsible for the provision of public hospital services, such as the rehabilitation inpatient admissions included in this clinical trial . Funding for public hospital acute and rehabilitation services is via the Australian government and based on a single episode of care; as such readmissions that occur in the 12 month follow up period after the initial rehabilitation hospital episode in this clinical trial are funded as a separate episode of care. Therefore, under output based funding public hospitals have an incentive to discharge acute (including acute phase rehabilitation) patients as early as possible. This contrasts with the private system where private insurance funding may be a per diem amount or a fixed amount for the episode. Theoretically, as the results of our trial show a reduction in total cost, both public and private hospitals should be willing to implement weekend acute rehabilitation services. However, cost savings may be realised at the broader hospital level while the spending and staffing decisions may be realised at the department level, so without resource reallocation and collaboration, the provision of a weekend service may be difficult to implement.
The strengths of this economic evaluation are that it was completed alongside a blinded, fully powered randomized controlled trial and it used an appropriate alternative intervention, as only 30% of Australian rehabilitation inpatient health services offer a weekend physiotherapy service . Other strengths included access to complete clinical cost data on all patients across the primary health service, Medicare and PBS administrative data as well as the inclusion of informal care. A range of rehabilitation diagnoses and patients with a language other than English as their first language were included in the trial representing a general rehabilitation population. A limitation of using a self-reported health service utilization tool is recall bias; however, the sensitivity analysis addressed this by varying the value of this self-reported data. The wide and uneven distribution of the CIs around the ICER are difficult to interpret [43,44], however they have been reported as the sample size is large  and the non-parametric bootstrap method was used . The CI ellipses for the ICERs show that most of the 75% and 95% CIs fall within the bottom right hand quadrant. This suggests that the intervention is dominant over the comparator of usual care. This study did not include the wider economic impact from a societal perspective including factors such as return to work, the costs of travel or the cost of nursing home placement. The impact on return to work for this study has been reported elsewhere . Therefore, we are confident that the results are generalizable across public acute phase inpatient rehabilitation settings. There were minor variations to the trial protocol. These included the use of multiple imputation rather than the carry forward technique for missing data, consistent with recent recommendations , as well as a reduced data collection period due to a higher than expected rate of participant recruitment. Future research may focus on translation research designed for successful and sustained implementation of this additional Saturday rehabilitation service.
From a health system perspective inclusive of private costs and informal care, the provision of a rehabilitation service to inpatients on a Saturday in addition to Monday to Friday compared to Monday to Friday rehabilitation alone, is likely to have sustained cost savings per QALY gained and for a MCID in functional independence during the inpatient stay and up to 12 months following discharge from rehabilitation.
Analysis of covariance
Cost effectiveness acceptability curve
Consolidated health economic evaluation reporting standards
Diagnosis related group
- EQ-5D-3 L:
FIM, Functional independence measure
Incremental cost effectiveness ratio
Incident rate ratios
Minimal clinical important difference
Mann–Whitney U test
Pharmaceutical benefit scheme
Quality adjusted life year
Visual analogue scale
Stucki G, Cieza A, Melvin J. The international classification of functioning, disability and health: A unifying model for the conceptual description of the rehabilitation strategy. J Rehabil Med. 2007;39(4):279–85.
Brusco NK, Taylor NF, Watts JJ, Shields N. Economic evaluation of adult rehabilitation: a systematic review and meta-analysis of randomized controlled trials in a variety of settings. Arch Phys Med Rehabil. 2014;95(1):94–116.
Brusco NK, Watts JJ, Shields N, Taylor NF. Are weekend inpatient rehabilitation services value for money? An economic evaluation alongside a randomized controlled trial with a 30 day follow up. BMC Med. 2014;12:89. doi:10.1186/1741-7015-12-89.
Peiris C, Shields N, Brusco NK, Watts JJ, Taylor NF. Additional Saturday rehabilitation improves functional independence and quality of life and reduces length of stay: a randomized controlled trial. BMC Med. 2013;11:198.
Bowman CC, Sobo EJ, Asch SM, Gifford AL, HHQER Initiative. Measuring persistence of implementation: QUERI Series. Implement Sci. 2008;3(1):21.
Brusco NK, Watts JJ, Shields N, Chan SP, Taylor NF. Does additional acute phase inpatient rehabilitation help people return to work? A subgroup analysis from a randomized controlled trial. Clin Rehab. 2014;28(8):754–61.
Anderson C, Mhurchu CN, Rubenach S, Clark M, Spencer C, Winsor A. Home or hospital for stroke rehabilitation? Results of a randomized controlled trial II: cost minimization analysis at 6 months. Stroke. 2000;31(5):1032–7.
Kalra L, Evans A, Perez I, Knapp M, Swift C, Donaldson N. A randomised controlled comparison of alternative strategies in stroke care. Health Technol Assess. 2005;9(18):iii–iv. 18.
Taylor NF, Brusco NK, Watts JJ, Shields N, Peiris C, Sullivan N, et al. A study protocol of a randomised controlled trial incorporating a health economic analysis to investigate if additional allied health services for rehabilitation reduce length of stay without compromising patient outcomes. BMC Health Serv Res. 2010;10:308.
Husereau D, Drummond M, Petrou S, Carswell C, Moher D, Greenberg D, et al. Consolidated Health Economic Evaluation Reporting Standards (CHEERS) - explanation and elaboration: a report of the ISPOR Health Economic Evaluation Publication Guidelines Good Reporting Practices Task Force. Value Health. 2013;16(2):231–50.
Cochrane Economics Methods Group. http://www.xe.com/currencyconverter/#converter. 2015. [Accessed April 2015].
Australian Government. Australian Bureau of Statistics’ consumer price index. http://www.abs.gov.au/ausstats. 2012. [Accessed May 2012].
Transport Accident Commission fee schedule [Victoria, Australia]. http://www.tac.vic.gov.au/providers/fees-and-policies. 2014. [Accessed May 2014].
Pharmacy Direct Australia. www.pharmacydirect.com.au. 2014. [Accessed January 2014].
Group EQ. EuroQol - a new facility for the measurement of health-related quality of life. Health Policy. 1990;16(3):199–208.
Dolan P. Modeling valuations for EuroQol health states. Med Care. 1997;35(11):1095–108.
Norman GR, Sloan JA, Wyrwich KW. Interpretation of changes in health-related quality of life: the remarkable universality of half a standard deviation. Med Care. 2003;41(5):582–92.
Hamilton BB, Granger CV. Disability outcomes following inpatient rehabilitation for stroke. Phys Ther. 1994;74(5):494–503.
Beninato M, Gill-Body KM, Salles S, Stark PC, Black-Schaffer RM, Stein J. Determination of the minimal clinically important difference in the FIM instrument in patients with stroke. Arch Phys Med Rehabil. 2006;87(1):32–9.
Mihaylova B, Briggs A, O’Hagan A, Thompson SG. Review of statistical methods for analysing healthcare resources and costs. Health Econ. 2011;20(8):897–916.
Thompson SG, Barber JA. How should cost data in pragmatic randomised trials be analysed? British Med J. 2000;320(7243):1197.
Vickers AJ. Parametric versus non-parametric statistics in the analysis of randomized trials with non-normally distributed data. BMC Med Res Methodol. 2005;5(1):35.
Vickers AJ, Altman DG. Statistics notes: analysing controlled trials with baseline and follow up measurements. BMJ. 2001;323(7321):1123–4.
Sterne JA, White IR, Carlin JB, Spratt M, Royston P, Kenward MG, et al. Multiple imputation for missing data in epidemiological and clinical research: potential and pitfalls. BMJ. 2009;338:b2393.
Nixon RM, Wonderling D, Grieve RD. Non‐parametric methods for cost‐effectiveness analysis: the central limit theorem and the bootstrap compared. Health Econ. 2010;19(3):316–33.
IBM Corp. IBM SPSS Statistics for Windows, Version 21.0. Armonk, NY: USA IBM Corp; 2012.
StataCorp. Stata Statistical Software: Release 12. College Station, TX: USA StataCorp LP; 2011.
Hutubessy R, Chisholm D, Edejer TT. Generalized cost-effectiveness analysis for national-level priority-setting in the health sector. Cost Eff Resour Alloc. 2003;1(1):8.
Stone PW, Chapman RH, Sandberg EA, Liljas B, Neumann PJ. Measuring costs in cost-utility analyses. Int J Technol Assess Health Care. 2000;16(01):111–24. doi:doi:null.
Briggs A, Fenn P. Confidence intervals or surfaces? Uncertainty on the cost‐effectiveness plane. Health Econ. 1998;7(8):723–40.
Jones CA, Beaupre LA, Johnston D, Suarez-Almazor ME. Total joint arthroplasties: current concepts of patient outcomes after surgery. Clin Geriatr Med. 2005;21(3):527–41.
Kwakkel G, Kollen B, Wagenaar R. Long term effects of intensity of upper and lower limb training after stroke: a randomised trial. J Neurol Neurosurg Psychiatry. 2002;72(4):473–9.
Porter ME. A strategy for health care reform—toward a value-based system. N Engl J Med. 2009;361(2):109–12.
van den Hout W, Tijhuis G, Hazes J, Breedveld F, Vlieland TV. Cost effectiveness and cost utility analysis of multidisciplinary care in patients with rheumatoid arthritis: a randomised comparison of clinical nurse specialist care, inpatient team care, and day patient team care. Ann Rheum Dis. 2003;62(4):308–15.
Doran T, Drever F, Whitehead M. Health of young and elderly informal carers: analysis of UK census data. BMJ. 2003;327(7428):1388.
Australian Government. Still putting in. http://www.nationalseniors.com.au/be-informed/research/publications/still-putting-in. 2009. [Accessed May 2012].
van den Berg B, Brouwer WB, Koopmanschap MA. Economic valuation of informal care: An overview of methods and applications. Eur J Health Econ. 2004;5(1):36–45.
Andersson A, Levin L-Å, Emtinger BG. The economic burden of informal care. Int J Technol Assess Health Care. 2002;18(01):46–54.
Dewey HM, Thrift AG, Mihalopoulos C, Carter R, Macdonell RA, McNeil JJ, et al. Cost of stroke in Australia from a societal perspective results from the North East Melbourne Stroke Incidence Study (NEMESIS). Stroke. 2001;32(10):2409–16.
Fatovich D, Nagree Y, Sprivulis P. Access block causes emergency department overcrowding and ambulance diversion in Perth, Western Australia. Emerg Med J. 2005;22(5):351–4.
Australian Government. http://www.aihw.gov.au/australias-health/2014/health-system/. [Accessed October 2014].
Shaw KD, Taylor NF, Brusco NK. Physiotherapy services provided outside of business hours in Australian hospitals: a national survey. Physiother Res Int. 2013;18(2):115–23.
Jones AM. The Elgar companion to health economics. Glos, United Kingdom: Edward Elgar Publishing; 2012.
Glick HA, Doshi JA, Sonnad SS, Polsky D. Economic evaluation in clinical trials. Oxford, United Kingdom: Oxford University Press; 2014.
We thank Victor Brusco for the development and ongoing maintenance of the primary database used throughout the clinical trial; the project officers (Casey Peiris, Renita Yap, Belinda Haines, Clarissa Koukounas and Glenys Harrison); the data entry and follow up phone call assessors (Sarah Foster, Rhonda Povah, Haley Tkatchyk, and Tanya Johansen); as well as all the rehabilitation doctors (Genevieve Kennedy and Kwong Teo), physiotherapists, occupational therapists and allied health assistants at Angliss Hospital and Peter James Centre who supported this project. This work was supported by a NHMRC PhD scholarship for author Natasha K Brusco (Grant Number APP1017877) and by a NHMRC Partnership Grant (Grant Number 541958) between Eastern Health and La Trobe University. These funding sources did not have a role in the clinical trial or economic evaluation design, data collection, analysis or interpretation; in the writing of the report; or in the decision to submit the article for publication. The researchers operated independent of the funding sources.
The authors declare that they have no competing interests.
NKB, JJW, NS and NFT conceived the clinical trial and economic evaluation design, analyzed the data, interpreted the results and drafted the manuscript. NFT and NKB are the guarantors. All authors had access to all of the data in the economic evaluation and can take responsibility for the integrity of the data and the accuracy of the data analysis. All authors read and approved the final manuscript.
About this article
Cite this article
Brusco, N.K., Watts, J.J., Shields, N. et al. Is cost effectiveness sustained after weekend inpatient rehabilitation? 12 month follow up from a randomized controlled trial. BMC Health Serv Res 15, 165 (2015). https://doi.org/10.1186/s12913-015-0822-3