- Research article
- Open Access
- Open Peer Review
Multiple factors influence compliance with colorectal cancer staging recommendations: an exploratory study
BMC Health Services Researchvolume 8, Article number: 34 (2008)
For patients with colorectal cancer (CRC) retrieval by surgeons, and assessment by pathologists of at least 12 lymph nodes (LNs) predicts the need for adjuvant treatment and improved survival. Different interventions (educational presentation, engaging clinical opinion leaders, performance data sent to hospital executives) to improve compliance with this practice had variable results. This exploratory study examined factors hypothesized to have influenced the outcome of those interventions.
Semi-structured interviews were conducted with 26 surgeons and pathologists at eleven hospitals. Clinicians were identified by intervention organizers, public licensing body database, and referral from interviewees. An interview guide incorporating open-ended questions was pilot-tested on one surgeon and pathologist. A single investigator conducted all interviews by phone. Transcripts were analyzed independently by two investigators using a grounded approach,ho then compared findings to resolve differences.
Improvements in LN staging practice may have occurred largely due to educational presentations that created awareness, and self-initiated changes undertaken by pathologists. Executives that received performance data may not have shared this with staff, and opinion leaders engaged to promote compliance may not have fulfilled their roles. Barriers to change that are potentially amenable to quality improvement included perceptions about the practice (perceived lack of evidence for the need to examine at least 12 LNs) and associated responsibilities (blaming other profession), technical issues (need for pathology assistants, better clearing solutions and laboratory facilities), and a lack of organizational support for multidisciplinary interaction (little communication between surgeons and pathologists) or quality improvement (no change leaders or capacity for monitoring).
Use of an exploratory approach provided an in-depth view of the way that numerous factors amenable to quality improvement influenced the adoption of new CRC LN staging recommendations. Continued interventions targeting physicians and executives, in the absence of a receptive organizational infrastructure, may be fruitless. Individualized rather than regional or punitive performance data, coupled with increased organizational capacity for change may stimulate greater surgical and organizational response to quality improvement. Descriptive or experimental studies are needed to test these hypotheses.
Treatment of colorectal cancer (CRC) involves surgical removal of the tumor and mesenteric lymph nodes (LN). Subsequent decisions about the need for additional treatment are partially based on whether pathologic findings demonstrate the presence of cancer in the LNs, since adjuvant chemotherapy confers a 15% absolute survival benefit for those with LN metastases . Inadequate LN harvest has been associated with decreased survival, so several international cancer control agencies, including the National Cancer Institute, American Joint Committee on Cancer, and the International Union Against Cancer now recommend examination of a minimum of 12 LNs to optimize CRC staging [2, 3].
We conducted a population-based study revealing that 27% of eligible CRC patients in the province of Ontario, Canada had an adequate LN assessment . Dual efforts were consequently undertaken to improve this practice. In 2004 our group launched a randomized study (RCT) to examine the effect of engaging local surgeon or pathologist opinion leaders at participating hospitals on LN staging practice compared with a visiting educational presentation delivered to surgeons and pathologists (ISRCTN56824239) . At the same time the provincial cancer agency (PCA) developed a series of CRC performance measures . In 2005 the PCA distributed regional performance data to hospital CEOs and Chiefs of Surgery, including compliance with CRC LN staging recommendations. One year later the PCA reported that 58% of eligible CRC surgeries had 12 or more lymph nodes reported, a large change from the 27% revealed by population-based study, but this varied considerably across regions (range 33% to 92%) so there remained a need for ongoing quality improvement. Then the RCT was concluded and found that LN staging practice had improved in both the control and experimental arms of the trial . There was no significant difference between the two arms in proportion of patients with 12 or more LN removed (64% control, 76% experimental). There was no consistent effect of academic status or hospital volume on LN retrieval rates. This study did not reveal how changes were achieved, or the factors influencing LN staging practice, information that could guide quality improvement efforts to further improve compliance.
The interventions employed by these initiatives, performance data, educational presentation and opinion leaders, represent distinct strategies for influencing care delivery. Public reporting of performance data has improved outcomes in some circumstances, for example, decreased mortality after cardiac surgery, but research suggests that such data has little effect on physician practice [8–11]. Managers are thought to be a better target for performance data because they wish to enhance their hospital's public image, particular if performance accountability agreements are in place . Even so, it appears that managers may use performance data only when working in an institution that fosters a culture of quality, which suggests that organizational factors may be just as important as the information delivery mechanism .
Numerous interventions directed at physicians can improve compliance with practice recommendations but not across all conditions or settings of care, again highlighting the importance of organizational context . For example, outreach visits involving educational presentations have been most useful for promoting prescribing practice . Although opinion leaders appear to reduce non-compliance with desired practice, their effect appears comparable to that of educational visiting presentations or distribution of performance data, and studies have inconsistently described the actions of opinion leaders so the way they exert an effect in different contexts is not known . Furthermore, the impact of these interventions has been largely examined under rigorous experimental conditions, which measure specific outcomes, but provide little insight on the circumstances underlying those findings, or guidance on how to best implement those strategies in the real world.
Several factors are known to enable or hamper the adoption of a new practice including the mechanism by which information about the practice is delivered, attributes of the practice, physician characteristics, and elements of the practice environment [17–19]. In particular, the importance of organizational capacity for facilitating change is increasingly evident [20–24]. A meta-analysis of data from 81 studies examining interventions designed to increase the use of screening services for colon, breast and cervical cancer by physicians found that organizational change strategies influenced use of services more than reminders, feedback of performance data, education, financial incentives, legislative action, or mass media campaign . It is thought that organizational capacity includes the ability to identify, interpret, share and apply new knowledge or technology . However, it is not known what organizational structures and processes optimize the adoption of different innovative practices.
Compliance with LN staging recommendations has improved, but inconsistently. The way in which different, theoretically-promising interventions, including performance data, educational presentation and opinion leaders may have had an effect on LN staging practice is unknown. It is possible that some organizations responded differently because they better processed and applied the information that was delivered through these interventions. No studies have investigated the factors that influence CRC LN staging practice. To reveal issues amenable to quality improvement we examined how interventions used to deliver LN staging information, and the characteristics of LN staging practice, physicians, and their environment contributed to changes in practice. The findings could be used to optimize the design of ongoing quality improvement efforts. They would also increase our understanding of how to better equip organizations to support changes in practice, and apply change interventions in a more effective manner.
With no previous research to understand perspectives on LN staging practice an exploratory approach was employed, involving qualitative analysis of interviews with relevant stakeholders, to gather detailed information about how individuals and their organizations responded to CRC LN staging information delivered through one of three interventions (performance data, educational presentation, opinion leader) .
The study was conducted in community hospitals that had received CRC LN staging information through one of three interventions as identified with documentation from the PCA and RCT investigator. This included 11 educational presentation-only hospitals, nine opinion leader strategy hospitals, and ten performance data hospitals. Details about the interventions are described in Table 1. Ethical approval for the study was granted by the University of Toronto.
Sample Selection and Recruitment
Standard qualitative research principles were applied to determine recruitment methods and sample size . First, all general surgeons and pathologists involved in CRC LN retrieval and assessment at eligible hospitals were identified from RCT investigator notes, searching a publicly available database of the physician licensing body, and asking study participants for the names of surgeons or pathologists at their hospital. They were invited to participate by regular mail. Consecutive, consenting physicians (convenience sampling) were recruited to represent both professions and different hospitals in a variety of health regions exposed to the three interventions (purposive sampling). The initial sampling target was one surgeon and one pathologist at each of two hospitals per intervention group for a minimum goal of 12 interviews. Hence, additional recruitment was restricted to hospitals with which initial responders were associated, and included faxing the study invitation to non-responders along with a follow-up phone call, and requesting referrals from those interviewed. For qualitative research the goal is to collect very detailed information from cases representative of different groups, rather than from a large overall number of cases. Analysis is concurrent with data collection, and sampling is deemed sufficient when no further new information emerges (informational redundancy) from successive interviews within groups (theoretical sampling) .
Research on factors influencing changes in practice, including perceived attributes of the practice, physician characteristics, and organizational practice environment informed data collection [17–19] These are listed and defined in Table 2. Physician characteristics (specialization, sex, years in practice, and collegial networking) were collected by one-page survey included with the invitation mailing. Telephone interviews with surgeons and pathologists collected information on perceived attributes of LN staging practice (advantage, trialability, compatibility, uncertainty, complexity), practice environment (leadership, communication infrastructure, support for quality improvement), and how individuals or their organizations responded to the interventions to which they were exposed. An interview guide incorporating open-ended questions was developed and pilot-tested on one surgeon and pathologist, and refined based on their feedback. A single investigator (ARG), blinded to actual LN staging practice outcomes, conducted all interviews between February and June 2006, and an external professional transcribed audio-recordings.
A grounded approach was used to analyze interview transcripts in an inductive, iterative manner . Ideas were allowed to emerge from the data using the constant comparative technique, where transcripts are repeatedly read to identify and define important, unique themes relevant to study objectives . These functions were managed without the assistance of analytic software, but each round of data analysis was thoroughly documented. To enhance reliability of the findings, two investigators (ARG, FCW) independently reviewed the transcripts and identified themes, then met to compare the findings and resolve differences through discussion. Transcript text was organized within tables by theme, intervention and type of physician to compare and interpret the factors influencing LN staging practice.
Interviews were conducted with 17 surgeons and nine pathologists whose characteristics are shown in Table 3. This included five surgeons and three pathologists from three of 11 eligible hospitals in three different health regions exposed to the educational presentation-only; six surgeons and three pathologists from five of nine eligible hospitals in three different health regions exposed to the opinion leader strategy; and six surgeons and three pathologists from three of ten eligible hospitals in three different health regions exposed to performance data. Hence, opinions were gathered from individuals at several different hospitals representing each of three information delivery interventions and seven different health regions. The way in which characteristics of LN staging practice, physicians and their organizations influenced response to educational presentation, opinion leader and performance data interventions is discussed here with representative quotes identified by an anonymous code.
Awareness of the interventions
Awareness differed by professional and intervention group. Of 26 participating surgeons and pathologists, 25 (96%) were aware that 12 or more LN should be examined for accurate CRC staging. When asked how they learned about the LN staging recommendations surgeons and pathologists across all intervention groups (20/26, 77%) cited the educational presentation. Clinicians in the other intervention groups were less aware of the strategies or information that had been applied as part of those initiatives. Of nine surgeons and pathologists at hospitals exposed to the opinion leader strategy, four mentioned awareness of this initiative. Of nine surgeons and pathologists at hospitals receiving performance data, five were unaware of that information.
Changes in practice
Profession, but not type of intervention exposure seemed to influence changes in LN staging practice. Most pathologists reported speaking with local colleagues – I was the only pathologist who attended that meeting but disseminated that to other pathologists here (P506), and those at other hospitals – we spoke to neighboring hospitals and eventually found [a clearing agent] we were happiest with (P553). Some hospitals hired additional personnel to accommodate new requirements for LN staging – We hired a pathology assistant that grosses the majority of those specimens (P562). Pathologists also reported changes to specimen preparation and analysis – I'm slicing everything up in two millimeter sections throughout the entire specimen (P573) and pathology reporting practices – I put a comment down [in pathology report] that after careful assessment I can only find this many nodes (P560) to ensure that surgeons were aware of the thoroughness of their assessment.
In contrast, few surgeons reported changes to their own surgical technique for extracting specimens that might be more likely to yield the minimum number of LNs – the type of oncology operation I do is unchanged. I don't think that makes a big difference (S537), or discussion with surgical colleagues about the need for quality improvement subsequent to interventions – we haven't really discussed it amongst ourselves (S505). Occasionally, if surprised by a low LN count, surgeons might ask the pathologist to take another look (537) or they might review the specimen with the pathologist (547).
Factors influencing response
Perceptions about certain aspects of LN staging practice and associated responsibilities, technical issues related to surgery and pathology, and lack of organized communication and support for quality improvement may have been barriers to change. This did not appear to vary by profession or type of intervention.
Characteristics of surgeons and pathologists (Table 3) did not appear to influence response to CRC LN information, however, it is notable that half of the clinicians reported networking with internal colleagues only once per year or never, as this correlates with the reported limited interaction among and between the two professional groups engaged in LN staging.
Attributes of LN staging practice
Clinicians were asked several questions to elicit their views on the nature of LN staging practice, and understand how easily the new recommendations for retrieval and assessment of a minimum of 12 nodes could be adopted. There was some variability in responses by physician group but this primarily reflected professional role. Particularly relevant quotes are summarized in Additional File 1.
All surgeons and pathologists understood the clinical implications of LN staging but many questioned the evidence behind the minimum 12 LN recommendation, and its association with patient outcomes.
Participants said they had autonomy over this practice and could therefore modify it if necessary, but several blamed the lack of compliance and quality control on the other profession, or acknowledged that such beliefs existed.
Surgeons said they were already practicing appropriate surgical technique that would yield the required number of LNs. In contrast pathologists, who had reported several changes to their LN assessment and reporting practices, expressed concern over the associated increase in time and effort required to achieve recommended LN counts.
Information on staging practice was not unwelcome. Pathologists said that receiving such information made them realize why the practice was clinically important. Surgeons said that LN counts provided them with feedback on the quality of their surgical technique. However, both groups expressed concern about potential punitive implications of non-compliance.
Several technical and logistical aspects of LN staging practice could be influencing compliance with practice recommendations. Barriers of LN sample preparation and examination noted by pathologists included the need for additional help from pathology assistants, ineffectiveness of clearing solutions, and insufficient or unsafe laboratory facilities. Both surgeons and pathologists said that achieving a tissue sample containing a minimum of 12 LNs was dependent on surgical technique. However, compliance with staging recommendations may not be achievable in all patients given confounding factors such as physiology, comorbid conditions, cancer stage, and tumor location.
Participants were asked to describe formal or organized directives, means of communication, or quality improvement tools or initiatives that either directly or indirectly supported changes to LN staging practice. Little interaction occurred between surgeons and pathologists before, or after the interventions. Sometimes this was deliberate – they don't tell me how to do my job, I'm not gonna tell them how to do their job (502), and sometimes this was due to lack of structures to promote interaction – in this hospital we don't have venues for interaction like rounds (531), or incompatible scheduling – all departments have rounds at the same time so it's not feasible to attend each (566). As a result some surgeons said they never speak with pathologists (572) and were not familiar with the process pathologists use (S504) to examine LN specimens. Pathologists did not know what constraints there are on the surgeon (P573) when extracting the specimens. Neither group knew whether members of the other profession at their hospital had implemented any changes in their practice.
One hospital only had undertaken a formal quality improvement process by performing a prospective audit and sharing the data with both surgeons and pathologists. Otherwise, most surgeons and pathologists were unaware of whether they were meeting LN staging recommendations – I don't have any idea how successful we are in achieving that goal (S542). This information was not collected by their hospital and available to them electronically, nor did they have the time or means to conduct their own audits by reviewing individual patient medical records – we don't have a mechanism in place to evaluate, out of all the cases I've done in the last year, how many met the standards (P506).
When asked what strategies might improve LN staging practice, several surgeons and pathologists thought compliance would be enhanced with more manpower in the form of pathology assistants. Participants recommended greater interaction between surgeons and pathologists since LN staging involved a shared responsibility. They suggested that tumor boards are probably a great help (S502), or rounds or education programs with surgeons and pathologists together (S521). Both groups emphasized that comparative performance data was important, but recommended more granular data, surgeon by surgeon, pathologist by pathologist (S515) to identify more precisely where changes in practice were required, rather than the regional data that had been distributed by the PCA.
The purpose of this study was to examine how various factors influenced the outcome of different interventions implemented to increase compliance with LN staging recommendations, identify how this practice could be further improved, and generate knowledge on the structures and processes required in health delivery organizations to better adopt innovative clinical practices. No studies had qualitatively investigated this practice and, in taking an exploratory approach, several actionable issues were identified for practice and ongoing research.
Improvements in LN staging practice may have occurred largely due to educational presentations that created awareness about the new recommendations, and self-initiated changes undertaken by pathologists. There was little awareness of other interventions, so executives and managers that received performance data may not have shared this with staff, and opinion leaders engaged to promote compliance with the new practice may not have fulfilled their intended roles. Barriers to change that are potentially amenable to quality improvement included perceptions about the practice (lack of awareness of evidence for the need to examine a minimum of 12 LNs) and associated responsibilities (blaming other profession), technical issues (increased pathology effort, need for pathology assistants, better clearing solutions and laboratory facilities), and a lack of organizational support for multidisciplinary interaction (little formal or informal communication within and between surgical and pathology departments) or quality improvement (no leadership for change or capacity for monitoring).
Most surgeons in this study indicated they were not compelled to change their surgical technique but both surgeons and pathologists acknowledged that type of cancer and tumor location made LN retrieval challenging, and that the amount of tissue collected partially determined whether a minimum of 12 LN could be assessed. This study was not designed to examine individual lymph node recovery rates of participating surgeons, but future research might investigate whether and how surgical outcomes could be improved for cases with challenging tumor locations, and whether surgical decision-making or technical skill influence tissue retrieval . Surgical judgment, largely based on personal assessments about technical ability, knowledge and experience, may not be amenable to modification using traditional continuing education due to a limited capacity of physicians to self-assess. Indeed, a number of studies have found sub-optimal performance in physicians who were the least skilled but the most confident in their technical ability . A Cochrane review of 118 trials found that audit and feedback can be effective in improving clinical practice when individuals are able to compare their own performance with that of peers, data is provided periodically on an ongoing basis, and is delivered verbally or by senior colleagues . Therefore, if it were found that surgical lymph node retrieval warranted improvement, individualized, comparative performance feedback could raise self-awareness of potential deficits in technical ability, and perhaps prompt alternative surgical approaches.
Participants said that more opportunities for fostering interaction between surgeons and pathologists must be created and supported. There is growing evidence that multidisciplinary collaboration improves health care team effectiveness and patient outcomes . One option to consider is the tumor board or multidisciplinary cancer conference (MCC). These are regularly scheduled multidisciplinary meetings to prospectively review individual cancer patients and formulate appropriate management plans . Several studies suggest that MCCs can improve compliance with practice recommendations but more research is required to understand how MCCs can be most effectively implemented [36–40].
Organizations monitoring, or attempting to influence performance cannot rely on distribution targets such as executives or clinical opinion leaders for communication of information to those engaged in the practice, or to implement change initiatives. Instead, performance reporting should be coupled with incentives for change. At this time the impact of pay-for-performance is unclear, and our participants were concerned about its implications . They also requested individualized versus regional performance data. Research has shown that response to performance data is improved when the intent is explicitly non-punitive, and individual performance is compared to that of peers [42, 43]. Additional research is necessary to understand alternative non-financial rewards. We learned that CRC staging based on 12 LNs is not possible in all patients due to physiologic characteristics, and nature and location of the cancer. Organizations monitoring LN staging must therefore ensure that performance data is adjusted for these factors, otherwise compliance could be under-reported.
However, even when coupled with appropriate incentives, interventions are likely to have little impact when the target lacks a receptive infrastructure. Institutional capacity for change may be a strong predictor for the adoption of innovations, and this includes the actions of managers [20–24]. For example, in American hospitals found to be high-performing for use of beta-blockers after acute myocardial infarction, managers ensured that resources were available to support changes, and actively promoted interdepartmental collaboration . A survey of 1,784 American hospitals found that high involvement of managers in quality improvement significantly decreased inpatient mortality for several conditions . Further investigations are required to describe and evaluate the structures and processes that contribute to quality improvement capacity.
Several limitations are inherent in the exploratory design of this study. First, the expressed opinions are particular to the involved participants, and their geographic and health system environment, and therefore may not be applicable to health professionals in other settings. However, such research is meant to generate hypotheses that can be tested through further descriptive research performed elsewhere. Second, recruitment in qualitative research typically involves a small number of participants that are not randomly selected, potentially biasing data collection. To mitigate this concern and optimize validity, we used purposive sampling so that a variety of possible opinions were collected from individuals representing several different hospitals within each intervention group and across different health regions. Furthermore, we achieved informational redundancy, both by profession and intervention group, underscoring the validity of our findings. Still, studies involving larger samples of hospitals and health professionals should be conducted to confirm the influence of opportunities for collegial interaction and organizational capacity for quality improvement on LN staging practice, as well as other clinical innovations.
Use of an exploratory approach provided an in-depth view of the way that numerous factors amenable to quality improvement influenced the adoption of new CRC LN staging recommendations. In particular, lack of organizational infrastructure to coordinate and monitor changes in practice, and support multidisciplinary interaction may have limited the response to CRC LN staging recommendations. Individualized rather than regional or punitive performance data, coupled with increased organizational capacity for change may stimulate greater surgical and organizational response to quality improvement. Descriptive or experimental studies are needed to test these hypotheses.
Figueredo A, Fine S, Maroun J, Walker-Dilks C, Wong S: Adjuvant therapy for stage III colon cancer after complete resection. Cancer Prev Control. 1997, 1: 304-319.
Hammond ME, Fitzgibbons PL, Compton CC, Grignon DJ, Page DL, Fielding LP, Bostwick D, Pajak TF: College of American Pathologists Conference XXXV: solid tumor prognostic factors-which, how and so what? Summary document and recommendations for implementation. Arch Pathol Lab Med. 2000, 124: 958-965.
Chang GJ, Rodriguez-Bigas MA, Skibber JM, Moyer VA: Lymph node evaluation and survival after curative resection of colon cancer: systematic review. J Natl Cancer Inst. 2007, 99: 433-441. 10.1093/jnci/djk092.
Wright FC, Law CH, Last L, Khalifa M, Arnaout A, Naseer Z, Klar N, Gallinger S, Smith AJ: Lymph node retrieval and assessment in stage II colorectal cancer: a population-based study. Ann Surg Oncol. 2003, 10: 903-909. 10.1245/ASO.2003.01.012.
Wright FC, Law CH, Last LD, Klar N, Ryan DP, Smith AJ: A blended knowledge translation initiative to improve colorectal cancer staging [ISRCTN56824239]. BMC Health Serv Res. 2006, 6: 4-10.1186/1472-6963-6-4.
Gagliardi AR, Simunovic M, Langer B, Stern H, Brown AD: Development of quality indicators for colorectal cancer surgery, using a 3-step modified Delphi approach. Can J Surg. 2005, 48: 441-452.
Wright FC, Gagliardi AR, Law CHL, Last LD, Klevan AE, Hongjinda S, Stitt LW, Klar N, Ryan DP, Smith AJ: A randomized controlled trial to improve lymph node assessment in stage II colon cancer. Arch Surg.
Hibbard JH, Stockard J, Tusler M: Does publicizing hospital performance stimulate quality improvement efforts?. Health Aff. 2003, 22: 89-94. 10.1377/hlthaff.22.2.84.
Hannan EL, Kilburn H, Racz M, Shields E, Chassin MR: Improving the outcomes of coronary artery bypass surgery in New York State. J Am Med Assoc. 1994, 271: 761-766. 10.1001/jama.271.10.761.
Marshall MN, Shekelle PG, Leatherman S, Brook RH: The public release of performance data. J Am Med Assoc. 2000, 283: 1866-1874. 10.1001/jama.283.14.1866.
Melick CF, Buchbinder D, Coll DP, Moore S, Lee CC, Surysekar K, Wang TW, Forgione DA: The effects of knowledge management on surgeon behavior. J Health Care Finance. 2004, 31: 31-40.
Galvin RS, McGlynn EA: Using performance measurement to drive improvement: a road map for change. Med Care. 2003, 48-60. Suppl 1
Ginsburg LS: Factors that influence line managers' perceptions of hospital performance data. Health Serv Res. 2003, 38: 261-286. 10.1111/1475-6773.00115.
Eccles M, Grimshaw J, Walker A, Johnston M, Pitts N: Changing the behavior of healthcare professionals: the use of theory in promoting the uptake of research findings. J Clin Epidemiol. 2005, 58: 107-112. 10.1016/j.jclinepi.2004.09.002.
O'Brien MA, Oxman AD, Davis DA, Haynes RB, Freemantle N, Harvey EL: Educational outreach visits: effects on professional practice and health care outcomes. Cochrane Database Syst Rev. 1997, 4: CD000409.
Doumit G, Gattellari M, Grimshaw J, O'Brien MA: Local opinion leaders: effects on professional practice and health care outcomes. Cochrane Database Syst Rev. 2007, 1: CD000125.
Davis D, Taylor-Vaisey A: Translating guidelines into practice. A systematic review of theoretic concepts, practical experience and research evidence in the adoption of clinical practice guidelines. Can Med Assoc J. 1997, 157: 408-416.
Allery LA, Owen PA, Robling MR: Why general practitioners and consultants change their clinical practice: a critical incident study. Br Med J. 1997, 314: 870-874.
Lemieux-Charles L, McGuire WL: What do we know about health care team effectiveness? A review of the literature. Med Care Res Rev. 2006, 63: 263-300. 10.1177/1077558706287003.
Kaluzny AD, Gentry JT, Veney JE: Innovations of health services: A comparative study of hospitals and health departments. Milbank Mem Fund Q Health Soc. 1974, 52: 51-58. 10.2307/3349503.
Guo KL: Leadership processes for re-engineering changes to the health care industry. J Health Organ Manag. 2004, 18: 435-446. 10.1108/14777260410569993.
Fleuren M, Wiefferink K, Paulussen T: Determinants of innovation within health care organizations. Int J Qual Health Care. 2004, 16: 107-123. 10.1093/intqhc/mzh030.
Mannion R, Davies HTO, Marshall MN: Cultural characteristics of "high" and "low" performing hospitals. J Health Organ Manag. 2005, 19: 431-439. 10.1108/14777260510629689.
Greenhalgh T, Robert G, Macfarlane F, Bate P, Kyriakidou O: Diffusion of innovations in service organizations: Systematic review and recommendations. Milbank Q. 2004, 82: 581-629. 10.1111/j.0887-378X.2004.00325.x.
Stone EG, Morton SC, Hulscher ME, Maglione MA, Roth EA, Grimshaw JM, Mittman BS, Rubenstein LV, Rubenstein LZ, Shekelle PG: Interventions that increase use of adult immunization and cancer screening services: a meta-analysis. Ann Intern Med. 2002, 136: 641-51.
Barnsley J, Lemieux-Charles L, McKinney MM: Integrating learning into integrated delivery systems. Health Care Manage Rev. 1998, 23: 18-28.
Green J, Britten N: Qualitative research and evidence based medicine. Br Med J. 1998, 316: 1230-1232.
Strauss A, Corbin J: Basics of qualitative research: grounded theory procedures and techniques. 1990, Newbury Park, CA: Sage
Auerbach CF, Silverstein LB: Qualitative data: an introduction to coding and analysis. 2003, New York, New York: University Press
Pope C, Ziebland S, Mays N: Analysing qualitative data. Br Med J. 2000, 320: 114-116. 10.1136/bmj.320.7227.114.
Yule S, Flin R, Paterson-Brown S, Maran N: Non-technical skills for surgeons in the operating room:A review of the literature. Surgery. 2006, 139: 140-149. 10.1016/j.surg.2005.06.017.
Davis DA, Mazmanian PE, Fordis M, Van Harrison R, Thorpe KE, Perrier L: Accuracy of physician self-assessment compared with observed measures of competence: a systematic review. J Am Med Assoc. 2006, 296: 1094-1102. 10.1001/jama.296.9.1094.
Jamtvedt G, Young JM, Kristoffersen DT, O'Brien MA, Oxman AD: Audit and feedback: effects on professional practice and health care outcomes. Cochrane Database Syst Rev. 2006, 2: CD000259.
Haward R, Amir Z, Borrill C, Dawson J, Scully J, West M, Sainsbury R: Breast cancer teams: the impact of constitution, new cancer workload, and methods of operation on their effectiveness. Br J Cancer. 2003, 89: 15-22. 10.1038/sj.bjc.6601073.
Wright FC, DeVito C, Langer B, Hunter A, the Expert Panel on Multidisciplinary Cancer Conference Standards: Multidisciplinary Cancer Conferences: A systematic review and development of practice standards. Eur J Cancer. 2007, 43: 1002-1010. 10.1016/j.ejca.2007.01.025.
Abraham NS, Gossey JT, Davila JA, Al-Oudat S, Kramer JK: Receipt of recommended therapy by patients with advanced colorectal cancer. Am J Gastroenterology. 2006, 101: 1320-1328. 10.1111/j.1572-0241.2006.00545.x.
Newman EA, Guest AS, Helvie MA, Roubidoux MA, Chang AE, Kleer CG, Diehl KM, Cimmino VM, Pierce L, Hayes D, Newman LA, Sabel MS: Changes in surgical management resulting from case review at breast cancer multidisciplinary tumour board. Cancer. 2006, 107: 2346-2351. 10.1002/cncr.22266.
Chang JH, Vines E, Bertsch H, Fraker DL, Czerniecki BJ, Rosato EF, Lawton T, Conant EF, Orel SG, Schuchter L, Fox KR, Zieber N, Glick JH, Solin LJ: The impact of a multidisciplinary breast cancer center on recommendations for patient management: the University of Pennsylvania experience. Cancer. 2001, 91: 1231-1237. 10.1002/1097-0142(20010401)91:7<1231::AID-CNCR1123>3.0.CO;2-K.
Blazeby JM, Wilson L, Metcalfe C, Nicklin J, English R, Donovan JL: Analysis of clinical decision-making in multi-disciplinary cancer teams. Ann Oncol. 2006, 17: 457-460. 10.1093/annonc/mdj102.
Rowe JW: Pay-for-performance and accountability: related themes in improving health care. Ann Intern Med. 2006, 145: 695-699.
Hysong SJ, Best RG, Pugh JA: Audit and feedback and clinical practice guideline adherence: Making feedback actionable. Implement Sci. 2006, 1: 9-10.1186/1748-5908-1-9.
Kiefe CI, Allison JJ, Dale WilliamsO, Person SD, Weaver MT, Weissman NW: Improving quality improvement using achievable benchmarks for physician feedback. J Am Med Assoc. 2001, 285: 2871-2879. 10.1001/jama.285.22.2871.
Bradley EH, Holmboe ES, Mattera JA, Roumanis SA, Radford MJ, Krumholz HM: The roles of senior management in quality improvement efforts: what are the key components?. J Healthc Manag. 2003, 48: 15-28.
Weiner BJ, Alexander JA, Shortell SM, Baker LC, Becker M, Geppert JJ: Quality improvement implementation and hospital performance on quality indicators. Health Serv Res. 2006, 41: 307-334. 10.1111/j.1475-6773.2005.00483.x.
The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1472-6963/8/34/prepub
This study was enabled by funding from the University of Toronto, Faculty of Medicine Dean's Fund New Staff Grant. The sponsor had no role in the design, conduct or reporting of the study.
The author(s) declare that they have no competing interests.
ARG obtained funding for the study, conceived and designed the study, acquired data, analyzed and interpreted data, and prepared the manuscript. FCW contributed to design of the study, assisted with data analysis and contributed to preparation of the manuscript. MAK contributed to design of the study, assisted with interpretation of the data, contributed to preparation of the manuscript. AJS assisted with interpretation of the data and contributed to preparation of the manuscript. All authors read and approved the final manuscript.