Compliance with clinical guidelines for whiplash improved with a targeted implementation strategy: a prospective cohort study
© Rebbeck et al.; licensee BioMed Central Ltd. 2013
Received: 12 February 2013
Accepted: 30 May 2013
Published: 13 June 2013
Implementation strategies for clinical guidelines have shown modest effects in changing health professional’s knowledge and practice, however, targeted implementations are suggested to achieve greater improvements. This study aimed to examine the effect of a targeted implementation strategy of the Australian whiplash guidelines on health professionals’ knowledge, beliefs and practice and to identify predictors of improved knowledge.
94 health professionals (Physiotherapists, Chiropractors and Osteopaths) who manage whiplash participated in this study. Prior to their inclusion in the study, health professionals were classified as compliant with clinical guidelines for whiplash (n = 52) or non-compliant (n = 42), according to a record of clinical practice. All participants completed a 2- day interactive workshop with outcomes measured at baseline and 3 months following the workshop. The workshop was delivered by opinion leaders, with the educational content focused on the pre-identified knowledge and practice gaps in relation to clinical guidelines for whiplash. Knowledge and health professional beliefs were assessed by a questionnaire and professional practice by record of clinical practice.
Participants significantly increased knowledge (p < 0.0001) and were more likely to be compliant with the guidelines at follow-up (compliant at baseline 58%, follow-up 79%, p = 0.002). Health professional belief systems significantly changed to be more behavioural (p = 0.02) and less biomedical (p = 0.000). Predictors of improved knowledge were baseline knowledge (parameter estimate = -0.6, p = 0.000) and profession (parameter estimate = -3.8, p = 0.003) (adj R2 = 35%).
A targeted implementation strategy improved health professional’s knowledge and clinical practice so that they became more compliant with clinical guidelines for whiplash. In addition health professionals’ belief systems significantly changed to be more behavioural in orientation. Baseline knowledge and profession predicted 35% of the variance in improved knowledge.
KeywordsImplementation Interactive education Clinical guidelines Whiplash
Clinical guidelines for whiplash were developed in Australia [1, 2] for the purpose of improving professional practice, and ultimately changing health outcomes for people with whiplash. Allied health professionals such as physiotherapists, chiropractors and osteopaths were one of the key targets for implementation of the Australian whiplash guidelines, because they are the most commonly consulted health practitioners for the management of whiplash. It is widely reported that dissemination of clinical guidelines alone is unlikely to change health professional’s knowledge or practice . Rather it is suggested that targeted and active implementation strategies need to be used, and barriers to implementation identified, in order to change both professional knowledge and practice.
Active implementation strategies have been effective in changing health professional’s knowledge and practice, however only moderate effects are reported. For example, the most successful implementation strategies identified in Cochrane systematic reviews have reported an absolute risk difference of 6% (95% CI 1.8-15.9) for improving use of endorsed professional practices with a continuing education intervention  and 12% (CI 6-14.5) for the use of opinion leaders . To date there is only one systematic review that has examined the effect of active implementation strategies amongst allied health professionals including physiotherapists and chiropractors . This systematic review reported similarly modest effects  suggesting room for improvement. Given this, it appears an examination of factors that may improve guideline adherence is warranted.
To date only a few studies have examined barriers to implementation of guidelines amongst health professionals such as physiotherapists and chiropractors. The beliefs of health professionals have been suggested as a factor that would influence behaviour change. Most whiplash guidelines [7–10], including the Australian guidelines [1, 2] advocate for an active and behavioural approach to management. It has been suggested that when health professionals have a strong biomedical belief system, health practices are less likely to change to align with a more behavioural approach, such as those endorsed in the guidelines [11–14]. Furthermore, professional background may explain the differences in these belief systems . Professional background and the belief system of the health professional are therefore potential factors that may arise as barriers to implementation.
Other factors have been identified as effect modifiers to compliance with guidelines amongst allied health professionals. These include the experience of the health professional , whether the implementation strategy focuses on changing simple or complex behaviours [4, 16], perceived advantage of using the guideline  and compatibility between current practice and recommendations . In our previous cluster randomised controlled trial (RCT)  implementing guidelines for whiplash, we found that both knowledge and clinical practice were largely consistent with guideline recommendations at baseline, with most physiotherapists already using active treatments. We hypothesised, therefore, that if health professional knowledge and practice were less compliant with guidelines at baseline, the effect on learning should be improved. In order to test this hypothesis, it would be necessary to include a sample of participants whose knowledge and practice was identified as non-compliant with guidelines at baseline.
The primary aim of this study was therefore, to describe and evaluate the effect of a targeted implementation strategy on the knowledge, practice and beliefs of allied health professionals managing patients with whiplash. In addition, this study aimed to identify factors that predicted learning in relation to clinical guidelines for whiplash.
Study design and setting
We conducted a prospective longitudinal study to evaluate the outcomes from a targeted implementation strategy on practitioner knowledge, practice and belief systems and to identify factors that predicted learning. The study was set in educational venues (conference rooms) in Sydney Australia and was approved by the Human Research Ethics Committee at the University of Sydney.
Development of the implementation strategy
The implementation strategy was developed by the authors, the guideline developers and representatives from the target markets (the ‘working party’). Key target markets for guideline implementation were determined as: allied health professionals (physiotherapists, chiropractors and osteopaths), general practitioners, insurance personnel and consumers (people with whiplash). Different versions of the guidelines were developed for each of these target markets [see maa.nsw.gov.au] and specific strategies developed accordingly (eg ). This paper evaluates the effect of the strategy developed for allied health professionals.
The broad implementation strategy chosen for health professionals was to provide interactive education using opinion leaders, given the positive effects demonstrated in our previous trial , as well as evidence from systematic reviews [4–6]. One key difference with the current strategy, was that education was provided to three different professions (physiotherapy, chiropractic and osteopathy). Opinion leaders from each health profession were therefore identified by the working party and approached to provide the education.
Key messages of the whiplash guidelines for allied health professionals
Response consistent with guideline recommendations
Appropriate assessment and classification of whiplash
Classifies whiplash according to the Quebec Task Force (QTF)  4 grade classification system
Response to question 2 on the record of clinical practice
Appropriate measure of outcome
Uses a validated measure of outcome for whiplash such as the Neck Disability Index or the Patient Specific Functional Scale.
Response to question 4 on the record of clinical practice
Identification of those with poor prognosis
Identifies predictors of poor prognosis including high initial pain and high initial disability.
Response to question 6 on the record of clinical practice
Provides primarily activating treatments
Provided active treatment guidelines including exercise and advice
Response to question 5 on the record of clinical practice
Appropriate assessment: Included basic assessment of range of motion and palpation in order to classify whiplash, and advanced assessment such as cold and pressure sensitivity and assessment of motor function. 2) Use of functional outcome measures: included discussion on reliability and responsiveness of various outcome measures in whiplash order to measure progress 3) Identification of patients with a poor prognosis: included assessing high initial pain intensity and disability with validated instruments such as the Visual Analogue Pain Scale (VAS) and the Neck Disability Index in order to identify people who have a higher probability of not recovering; 4) Providing activating information as per recommendations in the guideline that every whiplash patient at the first consultation should receive treatments which are largely activating advice and exercises.
A third key difference with the current implementation strategy was the recruitment strategy chosen to ensure that a proportion of the participants would be non-compliant with guidelines at entry to the study. Our prior experience had revealed that health professionals who volunteer for studies are more likely to be compliant with guidelines , hence leaving minimal scope to improve learning or compliance.
The working party decided to measure compliance with guidelines for this study by evaluating responses to a standard record of clinical practice. This was believed by the authors to be the measure that would most accurately reflect actual clinical practice. The record of clinical practice is a standard form used to report assessment findings and treatment choices to compulsory third party insurers in Australia. Non-compliance with clinical guidelines was considered as failure to adhere to at least three of the four key messages outlined above. In order to increase the likelihood of including participants who may be non-compliant with guidelines, we set up two participant recruitment strategies as outlined below.
Recruitment by insurers. Personnel working for compulsory third party (CTP) insurers were asked to review past records of clinical practice submitted by health professionals to the insurer. If they considered the responses on these records to be non-compliant on at least three of the four key messages, they were asked to provide this list of health professionals to the MAA.
Recruitment by advertisement. A further group of participants was recruited through advertising on professional association websites and newsletters. These included the three targeted health professions: the Australian Physiotherapy Association, the Chiropractor’s Association of Australia and the Australian Osteopathic Association.
The MAA then invited the health professionals identified by both methods to participate in the study. Once the health professional agreed to participate, their contact details were provided to the authors.
Prior to attending education, all participants were assessed at baseline for professional knowledge, professional practice/ compliance with clinical guidelines and beliefs.
Professional knowledge was evaluated using a questionnaire adapted from that used by Rebbeck et al. . Questions tested participant’s knowledge of each of the four key messages. The score range was from 0 (knowledge minimal and inconsistent with guidelines) to 39 (knowledge maximal and consistent with guidelines).
Professional practice/ compliance
Professional practice and compliance with clinical guidelines was evaluated by responses to a recent record of clinical practice. Each participant submitted a recent (within the past month) record of clinical practice for a patient with whiplash assessed by them. Responses recorded on the recent clinical record were then assessed independently by two authors (TR and LM) and categorized as compliant or non-compliant with guideline recommendations against each of the four criteria (Table 1). A participant was then classified at baseline as overall compliant with clinical guidelines if their answers were consistent with at least three of the criteria. Differences were resolved by consensus between the two authors. This method ensured baseline compliance was assessed consistently.
Beliefs of participating professionals were assessed using an adapted version of the Pain Attitudes and Beliefs Scale for Physiotherapists (PABS) . The questionnaire was adapted by replacing the words ‘low back pain’ with ‘whiplash’. The PABS questionnaire gives a score for biomedical beliefs (ranging from 14 to 84) and a score for behavioural beliefs (ranging from 6 to 36).
The intervention was a two day interactive continuing educational workshop. Two workshops were offered within a six month period to cater for participant availability. Educational content was delivered by research and clinical opinion leaders in whiplash in Australia.
Primary outcomes assessed were change in professional knowledge and professional practice. The secondary outcome was change in health professional’s beliefs. All outcomes were assessed at baseline and at three months after completion of the intervention.
Predictors of learning
The second aim of this study was to identify variables that may predict learning. Learning was defined as improvement in knowledge calculated as post knowledge questionnaire score – baseline knowledge questionnaire score. Predictor variables included demographic information (such as age, years of experience, profession and higher degree qualification) and the baseline measures such as compliance classification (compliant vs non compliant), biomedical belief score, behavioural belief score, and knowledge score. Lastly we used a measure of health professional confidence in their knowledge in our prediction model. This was assessed by asking health professionals how confident they felt in their knowledge related to three key messages in the guidelines (confidence in classifying patients, in predicting recovery and in treating patients). The confidence measure had been found to be related to compliance amongst general practitioners, and was being used in a concurrent study . We were interested to see if this would also be a factor with other health professionals. Confidence was rated on a scale from 1 (don’t know) to 6 (very confident). The score range was 3 (minimal confidence) to 18 (maximum confidence).
Data were analysed using PASW statistics for windows version 18.
Changes in continuous outcomes were assessed using ANOVA comparing baseline with post intervention scores and groups.
A McNemar’s test was used to assess changes in professional practice by comparing the number of professionals considered compliant with clinical guidelines at baseline with the number considered compliant post intervention.
Predictors of learning were analysed using multiple linear regression. A univariate linear regression was conducted to evaluate univariate associations of each one of the predictors of learning. All variables with p values greater than 0.25 in the univariate analyses were included in the multivariate model. A Backward elimination procedure was used (excluding non-significant predictors, p < 0.05) until only significant predictors remained in the model.
Baseline demographic details for participants in each classification
Complaint at baseline N = 51
Non-complaint at baseline N = 42
Years of experience
Profession (n/ %)
Knowledge score (0 to 39) Mean (SD)
Biomedical score (14 to 84)
Behavioural score (6 to 36)
Confidence score (3 to 18) Mean (SD)
Change in professional knowledge, practice and belief systems
Baseline and post interventions scores for professional’s knowledge, beliefs and practice
Knowledge (0 to 39) Mean (SD)
P = 0.000
Biomedical belief (14 to 84)
P = 0.000
Behavioural belief (6 to 36)
P = 0.02
P = 0.002
1. Give WAD classification
P < 0.0001
2. Use appropriate measure of outcome
P = 0.06
3. Identifies those with poor prognosis
P = 0.167
4. Provides primarily activating treatments
P = 0.63
Twenty one percent more participants were considered compliant with guidelines post intervention (79%) compared with (58%) at baseline (Table 3). This difference was statistically significant (p = .002). Of the four key criteria against which compliance was measured, participants improved their compliance significantly with the ability to classify whiplash (p < .0001) and did not improve with any other individual area. It was noted that compliance with two of the criteria (using functional outcome measures) and using activating treatments was already high at baseline (77% and 69% respectively).
Percentage of health professionals able to identify factors related to non-recovery at baseline and post-intervention
Post intervention %
High initial pain intensity1
High initial disability1
Crash related factors2
Predictors of learning
Univariate and multivariate models for predicting learning (post knowledge score – baseline knowledge score) related to whiplash clinical guidelines
Years of experience
Biomedical score (baseline)
Behavioural score (baseline)
Baseline knowledge score
Final Model: Multivariate analysis
Baseline knowledge score
Following a targeted implementation strategy there were large improvements in health professional’s knowledge of whiplash management, beliefs about pain and clinical practice so that it aligned more closely with recommendations in guidelines for whiplash. As hypothesised, knowledge improvement was greatest in practitioners with low baseline knowledge and those whose professional background was physiotherapy. This information may be useful for organisations that implement guidelines, suggesting that educational resources may be best directed at practitioners whose knowledge of the guidelines is poor at baseline. It remains to be tested, whether this strategy would in turn result in greater health outcomes for patients with whiplash.
The improvement in knowledge and clinical practice after the active implementation strategy used in this study would be considered large, when considering previously published effect sizes. It should be remembered that this study in not an RCT, so direct comparisons of effect sizes cannot be made. However, the aim of this study was to prove a concept, namely that those with poor baseline knowledge and compliance would learn more. The proven concept was that low baseline knowledge significantly contributed to the size of the learning effect. Identifying such practitioners is practical in whiplash, because it is a condition primarily arising from a motor vehicle accident and treatment is commonly regulated by insurers, where information regarding health professional knowledge about guidelines can be easily obtained. The results of this study therefore have implications for organisations implementing guidelines for whiplash. They suggest that by measuring baseline knowledge through a questionnaire, implementation costs could be saved by directing education at practitioners with low knowledge, rather than attempting to educate all practitioners.
A key difference in this study to the previous RCT conducted by the authors  was the recruitment strategy, aimed to include practitioners whose baseline compliance with guidelines was low. The current strategy appeared effective, given that a considerable proportion (46%) of our participants were assessed as non-compliant at baseline. We hypothesised, however, that non-compliance at baseline would be a predictor of learning, and did not find this. Explanations for this may be statistical, namely we classified people dichotomously as compliant or non-compliant, rather than using a continuous variable that may be more responsive or predictive, as suggested by systematic reviewers . Alternatively, it may be that other factors are more predictive of outcome, such as baseline knowledge and professional background proved to be in this study. In Forsetlund et al's (2009) systematic review, which reviewed the effect of interventions most like ours, significant effect modifiers included the intensity of the education, attendance at education, complexity of the targeted behaviours and seriousness of the outcome. The interpretation of our results together with that of Forsetlund et al (2009) would suggest that known effect modifiers should be considered in future implementation strategies, and that measures of baseline compliance should be a continuous rather than dichotomous variable.
Barriers to implementation have been identified and addressed in order to improve compliance with guidelines in the medical field [21, 22]. However, only recently have data been available for allied health professions such as physiotherapy in terms of implementation strategies. Authors of these studies suggest that clinicians use guidelines if recommendations are similar to their usual practices  and beliefs  or they can perceive an advantage from using them  and note deviation from guidelines if practitioners have little experience with managing the condition . However to date such factors have only accounted for a small percentage of the variance in predicting guideline adherence. For example practitioner factors including perceived advantage accounted for 5.6% of the variance in a model to explain determinants of guideline adherence by physiotherapists to the Dutch guidelines for LBP . The two factors found to predict knowledge to be more consistent with guideline recommendations in our study were low baseline knowledge and profession, accounting for 35% of the variance. Because these data predict a high variance, they suggest that our identified factors should be considered when designing future implementation strategies.
The finding that profession predicted learning in our study warrants further discussion. We found that physiotherapists learned more than chiropractors or osteopaths. These results may reflect the fact that opinion leaders providing the education program were mainly physiotherapists and could have added their experiences and perspectives to the program. However, the content of the clinical guidelines advocate more active (exercise) approaches that may be more familiar to physiotherapists than chiropractors. Recent debates have suggested that if practitioners have more biomedical beliefs that they are less likely to advocate for an active approach than practitioners that have more behavioural beliefs [11, 12]. Therefore, we measured the beliefs of practitioners using the PABS  questionnaire, but did not find beliefs to be a predictor of learning. However when we compared beliefs between practitioners, we found that whilst behavioural orientation was similar between professionals, chiropractors and osteopaths had statistically higher biomedical scores than physiotherapists (p = 0.01) which may explain our data. This finding is similar to that reported by Pincus et al.  where chiropractors were found to have a more biomedical approach to managing low back pain than physiotherapists . Implementation scientists therefore may need to consider professions and their beliefs when developing an implementation strategy.
In conclusion, factors including low baseline knowledge and profession should be considered when designing future implementation strategies for whiplash guidelines. Based on these data, it is recommended to target the strategy to the identified gaps in the knowledge and to the specific profession. It is hypothesised and remains to be tested as to whether such a strategy will in turn improve health outcomes for patients with whiplash.
LM holds postdoctoral fellowship from the Canadian Institutes for Health Research and a stipend incentive from the Alberta Innovates Health Solutions. CM’s research fellowship is funded by the Australian Research Council. The study was funded by the Motor Accidents Authority (MAA) of New South Wales Australia. We would like to thank the MAA project managers: Liz Gee, Darnel Murgatroyd and Leonie McDonald, the opinion leaders who provided the education: Professor Michele Sterling, Dr Andrew Leaver, Dr Mark Stewart and Dr Peter Bull and the participating physiotherapists, osteopaths and chiropractors.
- MAA: © Motor accidents authority of New south Wales. Summary guidelines for the management of acute whiplash-associated disorders for health professionals. 2007, http://www.maa.nsw.gov.au, 2.Google Scholar
- TRACsa: © South Australian centre for trauma and injury recovery. Clinical guidelines for best practice management of acute and chronic whiplash-associated disorders. 2008, http://www.clinicalguidelines.gov.au.Google Scholar
- Farmer AP, Legare F, Turcot L, Grimshaw J, Harvey E, McGowan J, Wolf FM: Printed educational materials: effects on professional practice and health care outcomes. Cochrane Database Syst Rev. 2008, Art. No.:CD004398. (in press), 3Google Scholar
- Forsetlund L, Bjorndal A, Rashidian A, Jamtvedt G, O’Brien MA, Wolf F, Davis D, Odgaard-Jensen J, Oxman AD: Continuing education meetings and workshops: effects on professional practice and health care outcomes. Cochrane Database Syst Rev. 2009, Art. No.: CD003030. (in press), 2Google Scholar
- Flodgren G, Parmelli E, Doumit G, Gattellari M, O’Brien MA, Grimshaw J, Eccles MP: Local opinion leaders: effects on professional practice and health care outcomes. Cochrane Database Syst Rev. 2007, Art. No.: CD000125. (in press), 1Google Scholar
- van der Wees PJ, Jamtvedt G, Rebbeck T, de Bie R, Dekker J, Hendriks EJM: Multifaceted strategies may increase implementation of physiotherapy clinical guidelines: a systematic review. Aust J Physiother. 2008, 54: 233-241. 10.1016/S0004-9514(08)70002-3.View ArticlePubMedGoogle Scholar
- Keuter EJ, Minderhold JM, Verhagen AP, Valk M, Rosenbrand CJ: The multidisciplinary guideline ’Diagnosis and treatment of people with whiplash-associated disorder I or II. Ned Tijdschr Geneeskd. 2009, 153: p B7.Google Scholar
- Moore A, Jackson A, Jordan A, Hammersley S, Hill J, Mercer C: Clinical guidelines for the physiotherapy management of whiplash associated disorder. 2005, London: © Chartered Society of Physiotherapy, http://www.csp.org.uk/publications/clinical-guidelines-management-whiplash.Google Scholar
- Scholten-Peeters GGM, Verhagen AP, Bekkering GE, Van Der Windt DA, Barnsley L, Oostendorp RA, Hendriks EJ: Prognostic factors of whiplash-associated disorders: a systematic review of prospective cohort studies. Pain. 2003, 104: 303-322. 10.1016/S0304-3959(03)00050-2.View ArticlePubMedGoogle Scholar
- Verhagen AP, Scholten-Peeters GG, van Wijngaarden S, de Bie RA, Bierma-Zeinstra SM: Conservative treatments for whiplash. Cochrane Database Syst Rev. 2007, CD003338. (in press)Google Scholar
- Ostelo RWJ, den Berg SGM S-v, Vlayen JWS, Linton SJ, Morley S, Assendelft WJ: Health care provider’s attitudes and beliefs towards chronic low back pain: the development of a questionnaire. Man Ther. 2003, 8: 214-222. 10.1016/S1356-689X(03)00013-4.View ArticlePubMedGoogle Scholar
- Overmeer T, Boersma K, Denison E, Linton SJ: Does teaching physical therapists to deliver a biopsychosocial treatment program result in better patient outcomes?: a randomized controlled trial. Phys Ther. 2011, 91: 804-819. 10.2522/ptj.20100079.View ArticlePubMedGoogle Scholar
- Pincus T, Foster N, Vogel S, Santos R, Breen A, Underwood M: Attitudes to back pain amongst musculoskeletal practitioners: a comparison of professional groups and practice settings using the ABS-mp. Man Ther. 2007, 12: 167-175. 10.1016/j.math.2006.06.005.View ArticlePubMedGoogle Scholar
- Cote AM, Durand MJ, Tousignant M, Poitras S: Physiotherapists and use of low back pain guidelines: a qualitative study of the barriers and facilitators. J Occup Rehab. 2009, 19: 94-105. 10.1007/s10926-009-9167-2.View ArticleGoogle Scholar
- van der Wees PJ, Hendriks EJM, Jansen MJ, van Beers H, de Bie RA, Dekker J: Adherence to physiotherapy clinical guideline acute ankle injury and determinants of adherence: a cohort study. BMC Musculoskelet Disord. 2007, 8: 45-10.1186/1471-2474-8-45.View ArticlePubMedPubMed CentralGoogle Scholar
- Lugtenberg M, Burgers JS, Westert GP: Effects of evidence-based clinical practice guidelines on quality of care: a systematic review. Qual Saf Health Care. 2009, 18: 385-392. 10.1136/qshc.2008.028043.View ArticlePubMedGoogle Scholar
- Rutten G, Kremers S, Rutten S, Harting J: A theory-based cross-sectional survey demonstrated the important role of awareness in guideline implementation. J Clin Epidemiol. 2009, 62: 167-176. 10.1016/j.jclinepi.2008.04.004.View ArticlePubMedGoogle Scholar
- Rebbeck T, Maher CM, Refshauge K: Evaluating two implementation strategies for whiplash guidelines in physiotherapy: a cluster randomised trial. Aust J Physiother. 2006, 52: 165-174. 10.1016/S0004-9514(06)70025-3.View ArticlePubMedGoogle Scholar
- Rebbeck T, Macedo L, Paul P, Trevena L, Cameron I: General practitioners knowledge of whiplash guidelines improved with online education. Aust Health Review. 2013, SubmittedGoogle Scholar
- Spitzer W, Skovron M, Salmi L, Cassidy J, Duronceau J, Suissa S: Scientific monograph of Quebec task force on whiplash associated disorders: redefining ‘whiplash’ and its management. Spine. 1995, 20: 1-73. 10.1097/00007632-199501000-00001.View ArticleGoogle Scholar
- Hakkennes S, Dodd K: Guideline implementation in allied health professions: a systematic review of the literature. Qual Saf Health Care. 2008, 17: 296-300. 10.1136/qshc.2007.023804.View ArticlePubMedGoogle Scholar
- Moulding N, Silagy C, Weller D: A framework for effective management of change in clinical practice: dissemination and implementation of clinical practice guidelines. Qual Health Care. 1999, 8: 177-183. 10.1136/qshc.8.3.177.View ArticlePubMedPubMed CentralGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1472-6963/13/213/prepub