An outreach intervention to implement evidence based practice in residential care: a randomized controlled trial [ISRCTN67855475]
© Crotty et al; licensee BioMed Central Ltd. 2004
Received: 24 October 2003
Accepted: 06 April 2004
Published: 06 April 2004
The aim of this project was to assess whether outreach visits would improve the implementation of evidence based clinical practice in the area of falls reduction and stroke prevention in a residential care setting.
Twenty facilities took part in a randomized controlled trial with a seven month follow-up period. Two outreach visits were delivered by a pharmacist. At the first a summary of the relevant evidence was provided and at the second detailed audit information was provided about fall rates, psychotropic drug prescribing and stroke risk reduction practices (BP monitoring, aspirin and warfarin use) for the facility relevant to the physician. The effect of the interventions was determined via pre- and post-intervention case note audit. Outcomes included change in percentage patients at risk of falling who fell in a three month period prior to follow-up and changes in use of psychotropic medications. Chi-square tests, independent samples t-test, and logistic regression were used in the analysis.
Data were available from case notes at baseline (n = 897) and seven months follow-up (n = 902), 452 residential care staff were surveyed and 121 physicians were involved with 61 receiving outreach visits. Pre-and post-intervention data were available for 715 participants. There were no differences between the intervention and control groups for the three month fall rate. We were unable to detect statistically significant differences between groups for the psychotropic drug use of the patients before or after the intervention. The exception was significantly greater use of "as required" antipsychotics in the intervention group compared with the control group after the pharmacy intervention (RR = 4.95; 95%CI 1.69–14.50). There was no statistically significant difference between groups for the numbers of patients "at risk of stroke" on aspirin at follow-up.
While the strategy was well received by the physicians involved, there was no change in prescribing patterns. Patient care in residential settings is complex and involves contributions from the patient's physician, family and residential care staff. The project highlights challenges of delivering evidence based care in a setting in which there is a paucity of well controlled trial evidence but where significant health outcomes can be attained.
While some of the frailest members of our community live in residential care, their medical care is widely believed to be suboptimal. It is unclear to what extent the problems with treating this group is the result of lack of knowledge, discomfort about the risk/benefit profile of treatments in the very old or structural issues within residential care which inhibit clinical effectiveness. There is some evidence that improvements in prescribing can be achieved using outreach visits and educational strategies such as "academic detailing" with providers in residential care . However there has been no examination of this approach when applied to the implementation of clinical guidelines within residential care.
Two key health areas for older adults in residential care are falls and stroke prevention. Falls and consequent injuries are a major public health problem in nursing home residents and herald a functional decline and loss of independence [2, 3]. Achieving reductions in falls in residential care settings has proved difficult. While a trial in two nursing homes  and a trial using geriatric assessment  failed to reduce fall rates, a multidisciplinary consultative program targeting the 25% of nursing home patients at highest risk for falls was able to demonstrate a reduction in the number of falls . The key elements of this program were an interdisciplinary approach with the appointment of a falls coordinator at each facility with responsibility for the implementation of the program.
Stroke is a leading cause of disability for elderly Australians . While there is robust evidence that secondary prevention (identification and treatment of high risk groups) can improve outcomes with significant reductions in morbidity and death [8, 9], there is also evidence that primary care physicians are failing to apply this evidence in residential care settings. For example, only 40% of patients in one survey of secondary stroke prevention in nursing homes were shown to be adequately anticoagulated .
While outreach visit programs have been effective approaches to implementing evidence based practice in other primary care settings  they are yet to be evaluated in residential care. Therefore, the aim of the SAFIRE (Strokes And Falls In Residential care Evaluation) project was to examine the impact of an outreach visit intervention, targeting falls reduction and stroke prevention in a residential care setting. Our hypothesis was that prescribing patterns and risk factor modification would occur more frequently in those facilities who had received the outreach intervention than in those who had not.
The SAFIRE project was a randomised controlled trial involving a multifaceted intervention conducted in residential care facilities in metropolitan Adelaide, South Australia. Ethics approval was granted by the Research and Ethics Committee, Repatriation General Hospital, Adelaide.
Facilities were chosen across the metropolitan health areas of Adelaide, South Australia. Each region was randomly allocated as intervention or control. The first facility to be included in the study was selected at random and matched to a facility in another region to avoid overlap of physicians. The remaining facilities were selected in the same manner until the cumulative number of residents met the estimated sample size required (n = 20 facilities, 10 hostels – low level care and 10 nursing homes – high level care). The sample size was calculated assuming a 10% reduction in falls rate in the intervention group and estimated to be 348. All randomisation was conducted using a computer-generated random allocation program by a person external to the project. Figure 1 presents a visual description of the study design. Informed consent was obtained from the resident or their next of kin in order to access case notes. A list of all primary care physicians attending each facility and the number of patients they treated was drawn up. Commencing with those physicians with the largest number of patients they were approached to take part in the study. Six physicians per facility (120 in total) were recruited for the study and all were only treating patients in either the intervention region or the control region.
All patients/carer of the participating residential care facilities were approached for consent to allow an audit of the clinical practice in each facility. Case notes were audited by nurses blinded to allocation for demographic information, diagnoses and stroke risk factors. Medication charts were reviewed for prescription and administration of any psychotropic and/or antihypertensive medication and use of aspirin or warfarin. Information was also collected on the number of falls and injurious falls in the last 12 months from incident report forms at each facility. Seven months after baseline measures were taken, the case note audit was repeated for all consenting residents.
Intervention physicians received two, 30 min detailing visits by a pharmacist in their surgeries. The key messages combined the evidence based guidelines on falls prevention [12, 13] with information from the case note audit and survey and included: the benefits of the use of aspirin in residents with increased stroke risk, the monitoring and treatment of hypertension, the benefits of the use of warfarin in residents with atrial fibrillation, and the risk of psychotropic drug use. There is little evidence specific to patients in residential care settings for the management of stroke risk factors. We adhered to guidelines for community based patients eg WHO guidelines for hypertension  and consulted with experts in the area. Physicians were also provided with detailed audit information on the facility where the physician worked including falls rates, psychotropic prescribing patterns, stroke risk reduction practices (BP monitoring, aspirin and warfarin use). The use of pharmacists to provide this information has been used in previous studies in this region and was familiar and acceptable to the physicians.
One nurse per facility was appointed as a link nurse. The link nurses underwent four two-hour sessions in change management, management of the behavioural symptoms of dementia, medication management and falls prevention techniques. In addition, a pharmacist visited each facility and spoke to staff on reducing the use of psychotropic medications.
The primary outcome for the project was the three month fall rate prior to the follow-up assessment. Secondary outcomes included 12 month fall rate, rate of injurous falls, recorded blood pressure readings from previous three months, prescription and administration of any psychotropic medication, prescription of aspirin or warfarin, or an antihypertensive, Modified Barthel Index – Activity of Daily Living (ADL) score , Nursing Home Life-Space Diameter – Mobility score  and The Nursing Home Problem Behaviour Scale .
To assess the reliability of the case note data extraction and reduce inter-observer error, five percent of records from the first audit had data extracted twice and 10% of records were extracted twice from the second. Reliability (measured by Pearson's correlation coefficient for continuous variables and % agreement for categorical variables) was 95% or greater on demographic and drug usage data.
Descriptive data are reported as percentages and means and standard deviation. Chi-squared tests were used for assessing differences in proportions between study groups, whereas Student's t tests were used to compare means. Relative risks for the effect of the intervention after adjusting for age, gender, level of care, dementia status, and baseline levels of the outcome measure were undertaken using generalized linear models. To account properly for the cluster randomisation design used, the facility was recognised as the primary sampling unit in all analyses. All statistical analyses were undertaken using the STATA statistical package .
Twenty facilities were involved in the trial; 10 hostels (low level facilities) and 10 nursing homes (high level facilities). The total number of potential participants for the first case note audit was 1061 and of these, 897 (85%) consented to participate. Next of kin consent was obtained in 50.4% (range 26–80% for facilities) of cases. At the second audit 1055 potential participants were available, 902 (85%) consented to involvement with 46.7% requiring next of kin consent. Two hundred and two people (22.5%) who participated at the first audit were not available at the second due to various reasons including death and moving facility. The attrition rate was as high as 37% in some facilities but there were no overall differences in attrition rate between the intervention and control facilities (p = 0.086). Those participants that were missing at the second audit were more likely to be male (p =< 0.001) and be older (p = 0.003) than participants available for follow-up at the second audit. There was no difference in the number of those diagnosed with dementia (p = 0.884), having antipsychotics or benzodiazepines administered regularly (p = 0.40 and p = 0.346 respectively), or having fallen in the previous three months (p = 0.768). Of the 121 primary care physicians approached to participate, 98 (81%) consented with 61 attending intervention and 37 attending control facilities, respectively. GPs in the control region had larger numbers of patients under their care. These physicians cared for 59% of the residential care residents whose notes were audited.
Characteristics of residents at baseline (n = 715).
Characteristics of residents at baseline
Control (n = 334)
Intervention (n = 381)
83.4 ± 7.9
84.7 ± 7.7
Gender – Male (%)
Diagnosis of dementia in case notes n (%)
Diagnosis of depression in case notes n (%)
Length of Stay in residential care facility (days)
40.1 ± 39.5
35.7 ± 39.5
Length of Stay – less than 3 months (%)
Length of Stay – less than 12 months (%)
Documented "not for resuscitation" in case notes (%)
Mean number of unplanned hospital visits in prior 3 months*
0.08 ± 0.38
0.05 ± 0.25
Fall rates and use of psychotropic drugs in control and intervention facilities, before and after implementation of the intervention.
Control (n = 334)
Intervention (n = 381)
Residents who fell in 3 months prior (%)
0.86 – 1.58
Any psychotropics (%)
0.69 – 1.15
0.82 – 1.05
Marked PRN (& not Reg.)
0.79 – 2.77
Residents Prescribed Any Benzodiazepines
0.69 – 1.15
Residents Prescribed Long Acting Benzodiazepines
0.56 – 1.03
Residents Prescribed Short Acting Benzodiazepines
0.70 – 1.28
Any Administered Regularly
0.69 – 1.09
Any Marked PRN (& not Reg.)
0.62 – 2.73
0.69 – 1.34
0.87 – 1.18
Marked PRN (& not Reg.)
1.69 – 14.50
With the exception of one measure we were unable to detect statistically significant differences between the groups for the psychotropic drug use of the patients before or after the intervention. The exception was significantly greater use of "as required" antipsychotics in the intervention group compared with the control group after the pharmacy intervention (RR = 4.95; 95%CI 1.69–14.50) (Table 2).
Blood pressure recording, patients at risk of stroke and use of aspirin and warfarin in control and intervention facilities, before and after implementation of the intervention.
BP Recorded in prior 3 months
0.80 – 1.11
BP recorded and Systolic BP > 140 mm Hg‡
0.69 – 1.47
BP recorded and Diastolic BP > 90 mm Hg‡
At Risk of Stroke
0.39 – 1.08
0.89 – 1.06
Residents at risk of stroke and on Aspirin§
0.29 – 1.00
Residents with Atrial Fibrillation recorded
0.54 – 1.49
% of Residents with Atrial Fibrillation recorded on Warfarin||
0.23 – 3.59
A systematic review of interventions designed to change physician's performance reported that outreach visits were an effective strategy . Furthermore, the more educational methods are used the greater the chance of changing practice . This randomised controlled trial used outreach visits incorporating audit, feedback and education. Despite the previous success of this approach in a residential care setting , we were unable to detect a change in the management of patients at risk of falls or stroke in the participating residential care facilities.
Some aspects of the trial design may have reduced the likelihood of an effect. The timeframe of the trial limited the level of involvement of the facilities and impacted on the sustainability of any changes. The rate of reporting of falls increased in both groups probably reflecting an increase in the awareness and documentation of falls and the rate of attrition of residents over the period of follow-up was higher than expected with 23% of residents moving or dying during the period of the trial. There were also difficulties with delivering the message in the residential care setting with a high turnover of staff. The attrition rate of staff was 13% in a six month period and a number of physicians attending the facilities had only one or two patients. Participating physicians cared for 59% of the residential care residents whose notes were audited and the omission of the other GPs may have diluted the overall effect. Many of these limitations may have impacted on the results found however we did conduct a satisfaction survey with residential care staff and focus groups with the facility staff and physicians which indicated that the detailing visits were important in increasing awareness, this is the subject of a separate manuscript. Both intervention and control facilities were audited at the beginning and end of the study and this scrutiny may have impacted on reporting and recording practices in both groups affecting the recording of outcomes eg falls.
This project highlighted many barriers to the successful implementation of evidence based clinical practice in residential care. Collection of data via case note audit required patient consent and for around 50% of residents this involved next of kin consent. Developing evidence based guidelines for managing patients in residential care was limited by the few trials including adults over 80 years of age. Furthermore, there were complexities in the development of best clinical management. An example of this was the recommended use of aspirin or warfarin to reduce stroke risk versus the potential for bleeding complications.
Structural issues in residential care may impact on the way that care is delivered. The decision to use many medications, particularly psychotropic medications, is influenced by a variety of people including the patient, residential care staff and the patient's next of kin as well as the physician. Carers, rather than nurses, are responsible for most of the day-to-day monitoring of residents behaviours and interventions focusing on professionals such as doctors and nurses may not be sufficient in this setting. In Australia current funding arrangements for residential care include few incentives for either physicians or residential care administration staff to improve clinical care and accreditation processes largely focus on accommodation issues rather than health care. General practitioners are under-supported due to an absence of medical advisory boards, a lack of audit, review and monitoring systems and communication difficulties between physicians, nursing staff and carers.
We were pleased, however, to find substantial interest in this trial from both the facilities and the physicians who visit them. This has resulted in commitment to a further project examining methods for enhancing communication within residential care facilities via case conferencing. This trial also resulted in the establishment of links between the hospital and residential care with future educational courses underway.
This project found that while an outreach visit strategy was well received by physicians and facility staff involved it did not result in changes to the clinical management of residents. It highlighted the challenges of delivering evidence based care in a setting in which there is a paucity of well controlled trial evidence but where significant health outcomes can be attained. Residential care is a unique primary care setting. Interventions designed to change patient care require the inclusion of their usual physician and other individuals involved with the patient such as the residential care staff and next of kin. Furthermore, implementing evidence based practice in residential care setting represents a substantial challenge due to the lack of good quality evidence.
MC conceived of the study, participated in its design and coordination, and drafted the manuscript.
CW participated in the design and coordination of the study.
DR participated in the design and coordination of the study.
JH drafted the manuscript.
DW participated in the design and coordination of the study.
PF participated in the design and coordination of the study.
AE participated in the design of the study and performed the statistical analyses.
All authors read and critically reviewed drafts of the manuscript.
This research was supported by the National Health & Medical Research Council Evidence Based Clinical Practice Research Program (Grant No 98/31401). We acknowledge the assistance of Rachel Wundke (RN) and Marisa Barbarioli.
- Avorn J, Soumerai SB, Everitt DE, Ross-Degnan D, Beers MH, Sherman D, Salem-Schatz SR, Fields D: A randomized trial of a program to reduce the use of psychoactive drugs in nursing homes. New Engl J Med. 1992, 327: 168-173.View ArticlePubMedGoogle Scholar
- Tinetti ME: Factors associated with serious injury during falls by ambulatory nursing home residents. J Am Geriatr Soc. 1987, 35: 664-668.View ArticleGoogle Scholar
- Lord SR: Falls in the elderly: admissions, bed use, outcome and projections. Med J Aust. 1990, 153: 117-118.PubMedGoogle Scholar
- Province MA, Hadley EC, Hornbrook MC, Lipsitz LA, Phillip Miller J, Mulrow CD, Ory MG, Sattin RW, Tinetti ME, Wolf SL: The effects of exercise on falls in elderly patients: a preplanned meta-analysis of the FICSIT trials. JAMA. 1995, 273: 1341-1347. 10.1001/jama.273.17.1341.View ArticlePubMedGoogle Scholar
- Rubenstein LZ, Robbins AS, Josephson KR, Schulman BL, Osterweil D: The value of assessing falls in an elderly population. Ann Intern Med. 1990, 113: 308-316.View ArticlePubMedGoogle Scholar
- Ray WA, Taylor JA, Meador KG, Thapa PB, Brown AK, Kajihara HK, Davis C, Gideon P, Griffin MR: A randomised trial of a consultation service to reduce falls in nursing homes. JAMA. 1997, 278: 557-662. 10.1001/jama.278.7.557.View ArticlePubMedGoogle Scholar
- Mathers C, Vos T, Stevenson C: The burden of disease and injury in Australia. AIHW cat.no. PHE 17, Canberra: AIHW. 1999Google Scholar
- Collins R, Peto R, MacMahon S, Hebert P, Fiebach NH, Eberlein KA, Godwin J, Qizilbash N, Taylor JO, Hennekens CH: Blood pressure, stroke and coronary heart disease: part 2. Short term reductions in blood pressure: overview of randomized drug trials in their epidemiological context. Lancet. 1990, 335: 827-838. 10.1016/0140-6736(90)90944-Z.View ArticlePubMedGoogle Scholar
- Antiplatelet Trialists' Collaboration: Collaborative overview of randomized controlled trials of antiplatelet therapy-I: Prevention of death, myocardial infarction and stroke by prolonged antiplatelet therapy in various categories of patients. Br Med J. 1994, 308: 81-106.View ArticleGoogle Scholar
- Gurwitz JH, Monett J, Rochon PA, Eckler MA Avorn J: Atrial fibrillation and stroke prevention with warfarin in the long-term care setting. Arch Intern Med. 1997, 157: 978-984. 10.1001/archinte.157.9.978.View ArticlePubMedGoogle Scholar
- Soumerai SB: Principles and uses of academic detailing to improve the management of psychiatric disorders. Int J Psychiatry in Medicine. 1998, 28: 81-96.View ArticleGoogle Scholar
- Gillespie LD, Gillespie WJ, Cumming R, Lamb SE, Rowe BH: Interventions to reduce the incidence of falling in the elderly (Cochrane Review). In: The Cochrane Library. 1998, Oxford: Update Software, 3
- South East Institute of Public Health (SEIPH): Guidelines for the prevention of falls in older people. Health Promotion Division of the Department of Health. 1998Google Scholar
- Guidelines subcommittee: 1999 World Health Organization International Society of Hypertension guidelines for the management of hypertension. J Hypertens. 1999, 17: 151-183. 10.1097/00004872-199917020-00001.Google Scholar
- Collin C, Wade DT, Davies S, Horne V: The Barthel ADL Index: a reliability study. Int Disabil Stud. 1998, 10: 63.Google Scholar
- Tinetti ME, Ginter SF: The Nursing Home Life-Space Diameter: a measure of extent and frequency of mobility among nursing home residents. Am Geriat Soc. 1990, 38: 1311-1315.View ArticleGoogle Scholar
- Ray WA, Taylor JA, Lichtenstein MJ, Meador KG: The Nursing Home Behavior Problem Scale. J Gerontol. 1992, 47 (1): M9-16.View ArticlePubMedGoogle Scholar
- StataCorp. Stata Statistical Software, Release 7.0. College Station, TX: Stata Corporation. 2001
- Davis DA, Thomson MA, Oxman A, Haynes BR: Changing physician performance: a systematic review of the effect of continuing medical educational strategies. JAMA. 1995, 274: 700-705. 10.1001/jama.274.9.700.View ArticlePubMedGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1472-6963/4/6/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article: verbatim copying and redistribution of this article are permitted in all media for any purpose, provided this notice is preserved along with the article's original URL.