Assessment of the multidisciplinary education for a major change in clinical practice; a prospective cohort study
© Wright et al; licensee BioMed Central Ltd. 2009
Received: 05 April 2008
Accepted: 11 February 2009
Published: 11 February 2009
New approaches are often introduced to the neonatal intensive care unit (NICU) and other areas of the health service in either a haphazard or cataclysmic fashion. The needs of staff education are often addressed incompletely or too late. Rarely is education assessed after the introduction of a major change. We changed the basis of our NICU respiratory support. We conducted a major educational and support program before this intervention. This study documented and assessed the educational components of this change in our health service provision.
Senior medical and nursing staff attended training abroad and an education program was applied for one year prior to the change. Multidisciplinary educational support for doctors, nurses and allied health was continued after the change. Assessment was by anonymous questionnaire, prior to change, at one and at nine months. Our hypothesis was that dissatisfaction with education would be greatest at one month.
Both theory education and practical education aspects of the new approach were rated as good to very good and this did not change with time. Difficulty of applying the technique was rated as ambivalent initially but decreased significantly over 9 months until it was rated easy to very easy (p < 0.001). Over all, the change was rated by staff as beneficial, both at the end of the education period and at nine months, with no decrease at one month.
If education and training reaches all staff, with a system of mutual and continued support, even large changes in clinical practice can be achieved without the dissatisfaction with the educational process that is often otherwise seen.
Neonatal intensive care is an area of medical and nursing care that has been an early convert to evidence-based approaches; the origins of the Cochrane Collaboration are to be found in perinatal medicine . This means that new technologies and innovative approaches are also integral to this still developing field of care. As in other areas of health service, in our extensive experience, over three countries, these new approaches are introduced to the neonatal intensive care unit in a less than ideal way, often in a haphazard and piecemeal fashion. Alternately they may be introduced in a cataclysmic, overnight manner, with no prior education or appropriate support for the medical and nursing staff. Neither approach favours education, understanding or co-operation between staff . The needs of staff education are often addressed after the change has occurred and may be incomplete, leading to neglect of some staff, such as those on night duty . Rarely is there assessment of any educational approaches that are undertaken, even after the introduction of a major change.
Much of the care in neonatal intensive care units through the 1990s had been centred on improving the ventilatory support provided to sick infants using more and more complex technology. After reviewing the evidence and the experience of a number of other centres, we decided to switch to a system of respiratory support that was less invasive and might lead to less iatrogenic damage and thus reduce our incidence of chronic lung disease (CLD) [4–6], a condition with both short term and long term morbidity and mortality for premature infants. We planned to change to a Continuous Positive Airway Pressure (CPAP) based respiratory support, as used in the Columbia Presbyterian Medical Center in New York, as the model for our approach to respiratory care in the neonatal intensive care unit, following a report of its successful implementation away from the immediate support of the Columbia unit . Briefly, this approach centres around the aggressive use of short-prong nasal CPAP, permissive hypercarbia, targeted oxygen saturations and an increased use of blood gas trends, but is more fully described elsewhere [4, 7–9]
We conducted an extensive and prolonged educational and support program, prior to, during and after the introduction of this intervention. The purpose of this study was to document and assess the educational components of this change in our service provision.
For one year prior to the change, education was conducted. Senior medical staff attended training abroad and then a nurse educator and a clinical nurse specialist visited further units overseas for practical experience. A program of education and assessment of that education was devised, using a variety of modalities suitable for adult learners . Three small-group fixed resource sessions were written covering the theory of Columbia Respiratory Care (CRC) and the practical aspects of the CPAP system to be introduced. Two of these sessions were didactic in nature, based around a series of slides, but with frequent 2-way interaction with the multidisciplinary learners throughout the presentation. The third was a hands-on session allowing a small group to gain practical experience with the CPAP system equipment to be used, in a controlled environment using manikins. These three presentations were repeated over a 3 month period until all day and night staff had had the opportunity to attend each session at least once. With well over 100 staff, many on fractional appointments or on a casual list, this typifies the difficulties facing services such as ours. Many staff chose to attend a session on more than one occasion and this was encouraged. Sessions were attended by nursing staff, medical staff and a number of allied health staff working on the neonatal unit. Practical skills were reinforced by a further visit from external experts that had been involved in original research dealing with this approach to respiratory care of the newborn . Outside learning, with links to further resources provided, was encouraged but not documented. Anecdotally this was taken up by very few. The change to CRC was undertaken on a pre-set date, with the approach to a number of areas basic to neonatal intensive care changing overnight. The clinical aspects involved in our change to CRC have been reported  and our outcomes have been assessed by prospective cohort studies [11, 12].
After the change had taken place further support was provided by a series of group meetings, attended by both medical and nursing staff, allowing practical solutions to problems to be devised and disseminated through mutual support among the staff. Further information and attention to detail was highlighted by a series of newsletters over the first 6 months, in addition to constant nurse educator support.
We assessed our educational interventions by means of an anonymous questionnaire [see Additional file 1] administered the week prior to the change and then repeated at one month and nine months after the change. Our hypothesis was that any dissatisfaction with education would be greatest at one month. Our sample size was calculated (Statmate, GraphPad Software Inc, San Diego, CA) to demonstrate a 25% decrease in satisfaction with the education received around the time of a major change. The questionnaire asked about the suitability of educational input, both theoretical and practical, about the appropriateness of support for the change, perceived ease of application of the techniques and perceived overall benefit of the new system. Answers were recorded on a 9 centimetre linear scale with annotation to indicate the scale running from very favourable to very adverse, with ambivalence at the mid point. Annotations were transcribed into results in centimetres and analysed as continuous variables (median and interquartile ranges). Data was not normally distributed so was analysed with non-parametric methods, using Instat (GraphPad Software Inc, San Diego, CA).
Results were available for 62 subjects; repeated analysis was available for 48 members of staff, including senior and junior medical staff and a cross-section of the nursing staff who work within our service. Analysis, using Mann Whitney, of those subjects where repeated measures were available revealed no differences from the pooled analysis, and therefore further analysis was carried out, using Wilcoxon signed rank, on the subset where paired sampling was available. No detailed data were available on those that did not respond to the survey but the proportion of medical to nursing staff was no different and the proportion of part-time to full time staff within the unit was no different between the sampled population and the unit as a whole (p > 0.05).
Ease of application
In contrast to the more common methods of introduction of change in many healthcare environments, we devised a specific education program intended to inform and empower all members of staff including senior medical staff, junior medical staff, nurse practitioners, permanent and casual nursing staff and our allied health staff. In addition we continued the support and the education process for some months after the change to CRC was introduced.
A number of problems with the introduction of innovation are predictable in the NICU environment, including but not restricted to, a large complement of staff, large proportion of staff with short hours and a large staff complement on night shifts . Our previous experience of the introduction of much lesser changes, in a less organised, way led to our hypothesis that dissatisfaction would be maximal at one month. Protocol and guidelines are a well established part of the neonatal intensive care environment, making sudden change in many areas a potential threat to sometimes long established local norms.
The education prior to a major innovation has been compared to the process of marketing of an idea and has many features in common with commercial marketing. Landrum looked at this process in the context of innovation in a hospital environment; the marketing involved in the "persuasion" component of Roger's theory is clearly applicable to a variety of clinical environments . Our results are compatible with successful "marketing" of the proposed changes, in that the respondents unanimously considered it of benefit prior to the commencement of any change. A study of the introduction of changes in asthma management in Dutch primary health care, using the diffusion of innovation model , again showed success and related this partly to the relationship between the demonstration of successful results and continued enthusiasm for the innovations. In our study we also demonstrated both a real improvement and continued perceived effectiveness. The demonstration of improved introduction of innovations has been shown in medical education where immediate feedback of results is provided using live patient simulators . In other healthcare settings innovation has not been associated with sustained change when the perceived benefit has not been apparent . Our use of a graded approach over a long period in part represents resource restriction but also represents the view expressed by innovation and management expert W. Edwards Deming that "Long-term commitment to new learning and new philosophy is required of any management that seeks transformation. The timid and the fainthearted, and the people that expect quick results, are doomed to disappointment" .
In summary we have shown that with a large effort, ensuring that education and training reach all staff and with a system of mutual and continued support, even large changes in clinical practice within a health service can be achieved and sustained. We have shown that this can be done in the neonatal intensive care unit without the dissatisfaction with the process of change that we have so often seen.
neonatal intensive care unit
chronic lung disease
Continuous Positive Airway Pressure
Columbia Respiratory Care.
The authors would like to acknowledge the valuable assistance of Ms K Evans, Clinical Nurse Specialist, in the administration of the staff questionnaire.
- Chalmers I, Enkin M, Keirse MJNC: Effective care in pregnancy and childbirth. 1989, New York: Oxford University PressGoogle Scholar
- Walsh M: Nursing Frontiers: accountability and boundaries of care. 2000, Oxford: Butterworth-Heinemann, 141-150.Google Scholar
- McCarthy KA: Breaking tradition. A night shift educator. Crit Care Nurse. 2004, 24 (3): 78-79.Google Scholar
- Avery ME, Tooley WH, Keller JB, Hurd SS, Bryan MH, Cotton RB, Epstein MF, Fitzhardinge PM, Hansen CB, Hansen TN, et al: Is chronic lung disease preventable? A survey of 8 centers. Pediatrics. 1987, 19: 26-30.Google Scholar
- Furman L, Baley J, Borawski-Clark E, Aucott S, Hack M: Hospitalisation as a measure of morbidity among very low birthweight infants with chronic lung disease. J Pediatr. 1996, 128: 447-52. 10.1016/S0022-3476(96)70353-0.View ArticlePubMedGoogle Scholar
- Graziani LJ, Spitzer AR, Mitchell DG, Merton DA, Stanley C, Robinson N, McKee L: Mechanical ventilation in preterm infants: neurosonographic and developmental studies. Pediatrics. 1992, 90: 515-522.PubMedGoogle Scholar
- De Klerk A: Successful implementation of Columbia respiratory support system. Proceedings of 1st Annual Congress of the Perinatal Society of Australia and New Zealand: 16–24 March, 1997; Freemantle, Australia. Sydney, PSANZ. 1997, A50.Google Scholar
- De Klerk AM, De Klerk RK: Nasal continuous positive airway pressure and outcomes of preterm infants. J Paediatr Child Health. 2001, 37 (2): 161-167. 10.1046/j.1440-1754.2001.00624.x.View ArticlePubMedGoogle Scholar
- Graham S: Continuous positive airway pressure. Journal of Neonatal Nursing. 2004, 10: 130-134.Google Scholar
- Caffarelia R: Planning programs for adult learners: A practical guide for educators, trainers and staff developers. 1994, San Francisco: Jossey BassGoogle Scholar
- Stark M, Gill AW, Glover RM, Wake CH, Wright IMR: The preterm infant with respiratory symptoms – are major adverse respiratory outcomes preventable?. Proceedings of 4th Annual Congress of the Perinatal Society of Australia and New Zealand: March 12–15, 2000;Brisbane, Australia. Sydney, PSANZ. 2000, 7.Google Scholar
- Holberton J, Gill AW, Glover RM, Wake CH, Wright IMR: The term infant admitted with respiratory symptoms – Does a CPAP-based approach improve outcomes?. Proceedings of 4th Annual Congress of the Perinatal Society of Australia and New Zealand: March 12–15, 2000; Brisbane, Australia. Sydney, PSANZ. 2000, 74.Google Scholar
- Rogers EM: Diffusion of Innovation. 1983, New York, The Free Press, Simon & SchusterGoogle Scholar
- Landrum BJ: Marketing innovations to nurses, Part 2: Marketing's role in the adoption of innovations. J Wound Ostomy Continence Nurs. 1998, 25 (5): 227-232.View ArticlePubMedGoogle Scholar
- Meertens RM: Monitoring the dissemination of an educational protocol on pediatric asthma in family practice: a test of associations between dissemination variables. Health Education & Behavior. 1999, 26 (1): 103-120. 10.1177/109019819902600109.View ArticleGoogle Scholar
- Krick HJ, Thomas JW, Wu YC: Dissemination of an innovative technical therapy through an evaluated practical workshop using live patient simulators. Journal of Medical Education. 1981, 56 (7): 607-609.PubMedGoogle Scholar
- Kristal AR, Biener L, Varnes J, Feng Z, Glanz K, Stables G, Chamberlain RM, Probart C: Durability and diffusion of the nutrition intervention in the Working Well Trial. Preventive Medicine. 1998, 27 (5): 668-673. 10.1006/pmed.1998.0342.View ArticlePubMedGoogle Scholar
- Edwards Deming W: Out of the crisis. 2000, Cambridge, MA, MIT PressGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1472-6963/9/28/prepub