Engaging primary care practitioners in quality improvement: making explicit the program theory of an interprofessional education intervention
© Vachon et al.; licensee BioMed Central Ltd. 2013
Received: 8 November 2012
Accepted: 11 March 2013
Published: 20 March 2013
The scientific literature continues to advocate interprofessional collaboration (IPC) as a key component of primary care. It is recommended that primary care groups be created and configured to meet the healthcare needs of the patient population, as defined by patient demographics and other data analyses related to the health of the population being served. It is further recommended that the improvement of primary care services be supported by the delivery of feedback and performance measurements. This paper describes the theory underlying an interprofessional educational intervention developed in Quebec’s Montérégie region (Canada) for the purpose of improving chronic disease management in primary care. The objectives of this study were to explain explicitly the theory underlying this intervention, to describe its components in detail and to assess the intervention’s feasibility and acceptability.
A program impact theory-driven evaluation approach was used. Multiple sources of information were examined to make explicit the theory underlying the education intervention: 1) a literature review and a review of documents describing the program’s development; 2) regular attendance at the project’s committee meetings; 3) direct observation of the workshops; 4) interviews of workshop participants; and 5) focus groups with workshop facilitators. Qualitative data collected were analysed using thematic analysis.
The theoretical basis of the interprofessional education intervention was found to be work motivation theory and reflective learning. Five themes describing the workshop objectives emerged from the qualitative analysis of the interviews conducted with the workshop participants. These five themes were the importance of: 1) adopting a regional perspective, 2) reflecting, 3) recognizing gaps between practice and guidelines, 4) collaborating, and 5) identifying possible practice improvements. The team experienced few challenges implementing the intervention. However, the workshop’s acceptability was found to be very good.
Our observation of the workshop sessions and the interviews conducted with the participants confirmed that the objectives of the education intervention indeed targeted the improvement of interprofessional collaboration and quality of care. However, it is clear that a three-hour workshop alone cannot lead to major changes in practice. Long-term interventions are needed to support this complex change process.
KeywordsInterprofessional continuing education Quality improvement Primary care practice Program theory-driven evaluation
In Canada, 16 million people or 50.6% of the Canadian population  live with a chronic disease . It has been acknowledged that managing these diseases is a complex process and that both the economic and social burdens are significant . For example, at the beginning of this millennium, the Public Health Agency of Canada estimated the direct and indirect costs of cardiovascular diseases at $18.5 billion a year , which is about 1.5% of the 2012 GDP . Patient numbers are growing rapidly due to the aging of the population and the greater longevity of people with chronic conditions . In addition, many studies have shown a major gap between usual and best practices in the screening, diagnosis, and treatment of chronic diseases . The challenge faced by practitioners and their organizations in developing and maintaining evidence-based practices is enormous.
Knowledge translation and interprofessional collaboration are two important components of continuous quality improvement of healthcare services. According to the Chronic Care Model [7, 8], services delivered to patients should be coordinated and based on the best available evidence. However, this requires a paradigm shift in the way we think about medical care: instead of focusing on the acute needs of individual patients, the Chronic Care Model calls for a thoughtful, organized, proactive approach to improving the healthcare of a patient population . A report issued by Quebec’s public health agency (the Institut national de santé publique du Québec, or INSPQ), based on consultation with experts and a literature review, described the main barriers to implementation of integrated primary healthcare in this province: lack of a clinical-practices information system that could be used to support clinical decision making, remuneration of healthcare professionals in a way that promotes ad hoc services rather than the actions required for chronic disease management, lack of organization and delivery of multidisciplinary services in primary care, and lack of an evaluation and feedback culture to facilitate the continuous quality improvement of these services .
The scientific literature continues to advocate interprofessional collaboration (IPC) as a key component of primary care. According to D'Amour and collaborators, collaboration is composed of two key elements: the construction of a collective action that addresses the complexity of client needs, and the construction of a team dynamic that integrates each professional’s perspective and in which team members respect and trust each other . Based on a recent Cochrane review, practice-based interventions aimed at increasing interprofessional collaboration through practice changes can improve healthcare and patient outcomes, and have generally proved to be less costly for front-line services . However, high-quality evidence from multi-method studies is still lacking. The College of Family Physicians of Canada (CFCP) has identified some important success factors for interdisciplinary collaboration in primary healthcare, the most important one being investing time in intra-group and inter-disciplinary communication . Processes such as team meetings and current practice audits may also influence interprofessional teamwork. Population and specific-patient needs’ assessments should be key determinants in deciding what kinds of teams are required and how to define interdisciplinary collaboration . The CFCP recommended that primary care groups be created and configured to meet the healthcare needs of the patient population, as defined by patient demographics and other data analyses related to the health of the population being served.
It further recommended that improvement of primary care services be supported by the delivery of feedback and performance measurements . Although providing feedback can be effective, its effects are generally small to moderate. In a recent systematic Cochrane review , the effect of using audits and feedback was found to vary widely across the included studies, and the quality of the evidence was moderate. The recommendations made following this extensive review were that feedback may be most effective when it reports greater gaps in health professionals’ performance, is provided more than once (both verbally and in writing), and includes targets and an action plan.
In 2008, the regional department of general medicine in Quebec’s Montérégie region (Département régional de médecine général, or DRMG) in collaboration with the Montérégie health and social services agency (Agence de la santé et des services sociaux de la Montérégie, or ASSSM) and the Quebec federation of general practitioners (Fédération des médecins omnipraticiens du Québec, or FMOQ), launched COMPAS, the collective for best practices and improvement in healthcare and services in family practice in Montérégie (Collectif pour des meilleures pratiques et l’amélioration des soins et services en médicine de famille). The objective of this ongoing project is to engage front-line healthcare professionals in a process of continuously improving the services they offer to persons suffering from chronic diseases in their territory. Interprofessional learning workshops are offered to physicians, nurses, pharmacists, and other professionals from the same region. In these workshops, information taken from clinical-administrative databases in the healthcare system are presented to the participants to provide them with feedback on the community of patients they are treating and on their practices, and to engage them in the process of working together to develop a collaborative quality-improvement project. Diabetes was identified by the project steering committee as the first priority target.
In 2010, researchers joined the COMPAS project team to support the development, implementation, and evaluation of this quality improvement strategy. Since continuing education workshops are a complex intervention composed of several interacting components [15, 16], the research team proposed that the project leaders begin by developing the theory underlying their interprofessional educational intervention. One of the main challenges involved in the innovative COMPAS approach is that of clearly identifying the intervention’s most important and measurable outcomes and also of explaining explicitly how it is intended to achieve change and the expected outcomes. As recommended by the UK Medical Research Council  with regard to the development and evaluation of complex interventions, a vitally important early task is to develop a theoretical understanding of the likely process of change by drawing on existing evidence and theory, supplemented if necessary by new primary research, such as interviews with those targeted by the intervention or involved in its development or delivery.
Aim of the study
The aim of our study was to describe the theory underlying the interprofessional educational intervention developed by the COMPAS project. The objectives were 1) to explain explicitly the set of assumptions held about the manner in which the program relates to its expected outcomes; 2) to describe the components of the complex intervention in detail; 3) to assess the intervention’s feasibility and acceptability, as well as possible improvements to it, and 4) to describe the intervention’s preliminary impacts. This paper will focus on the results obtained with respect to objectives one to three.
A program impact theory-driven evaluation approach was used [17, 18]. This approach allows for the evaluation of complex interventions implemented in a community setting where researchers have little control over characteristics of the participants, program, and organizational contexts. Program impact theory-driven evaluation is participatory; it emphasizes the importance of working collaboratively with relevant stakeholders from the outset to develop both a common understanding of the program and realistic expectations by tailoring the evaluation to meet the agreed-on values and goals. A program impact theory is a conceptual framework describing how a program intends to work to affect outcomes and the conditions under which these processes are believed to operate. It explicitly details the cause-and-effect sequences that link the intervention components to outcomes . The study protocol and consent form of this study were previously approved by the Ethics Committee of the Ottawa Hospital Research Institute.
Multiple sources of information were used to develop the program impact theory  underlying the COMPAS project: 1) a literature review and a review of documents describing the program’s development (minutes of the coordination, steering, and pedagogical committees’ meetings; previous presentations given on the project’s goals and development); 2) regular attendance at the project’s committee meetings; 3) direct observation of the workshops; 4) interviews of workshop participants; and 5) focus groups with workshop facilitators.
When the research team joined the project team (BV, BD, JG), its first task was to familiarize itself with the project. The members reviewed all documentation produced since the beginning of the initiative. At that time, it had already been decided that the intervention would take the form of an interprofessional workshop, but the content and specific learning strategies to be used were not yet defined. One of the principal investigators (BV) joined the project’s various committees to gain a more in-depth understanding of the intervention and also contribute to its development. Preliminary versions of the program impact theory were developed and validated with the project leaders. Six workshops were observed directly to assess the plausibility of the program impact theory. A member of the research team (BV) attended these six sessions and took notes on the level of participation, acceptability of the intervention, characteristics of the educational process, group dynamics, level of interprofessional exchange, facilitation process, time constraints, and the workshop’s immediate impact. The level of satisfaction with the workshop was also documented using the FMOQ’S standard CME evaluation form.
Interview guide used with workshop participants
According to you, what were the objectives of this workshop?
What did you learn during this workshop?
Do you plan to make or have you already made any changes to your practices?
Did the workshop allow you to identify these changes?
What do you think of the pedagogical strategies used in this workshop?
Several strategies were used to ensure rigor throughout the qualitative research process. Credibility was ascertained by recruiting participants from different disciplines and participating in five different workshop sessions. Observation notes were also used in order to confirm understanding of the content of the interviews. Coding tables were shared with other members of the project team. Dependability and confirmability were ascertained by the analysis process: a second investigator checked the reliability of coding; final themes were identified through consensus and were compared to original data in order to verify if they reflected an accurate representation of the participants’ experiences of the intervention.
Finally, a focus group was held with five of the seven workshop facilitators to discuss the strengths and weaknesses of the pedagogical process and identify how the workshop content and delivery could be improved or changed. This focus group lasted two hours. Notes were taken during this meeting (BD and BV) and a list of recommendations was drawn up and discussed with the project steering and pedagogical committees.
Development of the intervention
Historical background to the project
In 2006, the Montérégie health and social services agency (ASSSM) adopted a strategic orientation to improve the quality of health services delivered in its region. One of the main strategies identified was that of engaging physicians in the continuous quality improvement process. It was considered essential to mobilize physicians because they play a central role in patient care management and share this responsibility with local healthcare managers. The DRMG was identified as an optimally positioned body for promoting critical reflection among physicians, facilitating the adoption and utilization of evidence-based guidelines, and developing quality improvement initiatives grounded in clinical practice needs. The other main strategy identified was that of increasing use of measurement tools that could provide direct feedback to the system. The Agency had recently developed expertise in extracting information from clinical-administrative databases using the ÉGIPSS model developed by Champagne et al. in 2005 . However, the performance reports produced were mostly tailored to healthcare managers’ needs. The COMPAS project was launched to develop more relevant and practical performance reports adapted to clinicians’ specific needs and that would induce them to become involved in the continuous quality improvement process. The Agency’s wish was to innovate by linking top-down and bottom-up performance approaches. As pointed out by Ham , bottom-up changes introduced incrementally over time can result in more effective and enduring service improvements. This means building on evaluations of past and present improvements, fully engaging professionals in the process of change, and developing effective clinical leadership in the quest for performance improvements that benefit patients.
The project leaders ranked five chronic diseases in order of priority: diabetes, chronic obstructive pulmonary disease (COPD), heart diseases, depression, and cancer. Because of the prevalence of diabetes and the demonstrated effectiveness of interprofessional collaboration in improving diabetes management, this condition was chosen for the purpose of developing and piloting a first series of workshops.
The COMPAS project is carried out with the input of four separate committees: a steering committee, coordination committee, scientific committee, and pedagogical committee. The steering committee’s role is to oversee the project and provide guidance for all decisions made regarding its orientation. It is composed of representatives of management and professional groups directly involved in the project: the head of the COMPAS project (MC), the head of the DRMG (LQ), the director of medical affairs at the ASSSM (JR), the project coordinator (BD), one representative of the Montérégie public health division (Direction de la santé publique at the Montérégie level), two representatives of the information and knowledge management division (Direction de la gestion de l’information et des connaissances), and three front-line clinicians (a physician, nurse, and pharmacist). The committee meets approximately three times a year to plan future activities and assess the project’s relevance and regional impact. The coordination committee is a sub-committee of the steering committee responsible for day-to-day decisions. It meets on a more regular basis to keep fuelling the project, organize workshop delivery, and coordinates the different committees’ work.
The scientific committee is an ad hoc committee convened to advise the steering committee on the choice of key indicators related to diabetes care and management that could be extracted from the clinical-administrative database, on the validation of the extraction process used, and on the interpretation of the results. It is composed of a research expert in chronic disease management, a research expert in pharmaco-epidemiology, an endocrinologist, a computer analyst with expertise in clinical-administrative data management, an expert in the field of health indicators and measures, and a general practitioner. The scientific committee met twice, reviewed the diabetes indicators selected by the steering committee, and made clear recommendations as to which indicators should be kept or added and how they should be interpreted.
Another ad hoc committee is also formed to develop the interprofessional educational intervention: the pedagogical committee. It is responsible for creating the workshop outline and content and for choosing the pedagogical strategies. This committee is chaired by two representatives of the continuing professional development (CPD) division of the FMOQ (CG and ML) because of their expertise in continuing education; it also includes key members of the steering committee.
One of the study investigators (BV) joined the pedagogical committee from the outset and was able to share her expertise on reflective learning to guide the intervention’s development. The pedagogical committee met four times. Internal validation (testing the intervention with the committee) and external validation (testing the intervention with a first group of clinicians) processes were performed to pre-test and improve the intervention. The pedagogical committee was also responsible for training the workshop facilitators.
Description of the intervention
Theoretical basis of the intervention
The theoretical basis of the COMPAS project intervention reflected work motivation theory [22, 23] and reflective learning . One of the basic assumptions underlying the COMPAS intervention is that healthcare professionals are individuals who are absorbed in their everyday practice and who lack the time and opportunities to self-evaluate and self-monitor their practices . However, in order to change and improve their practices, such as improving interprofessional collaboration and ensuring evidence-based diabetes management, these professionals need to recognize possible practice improvements and become involved in identifying strategies to achieve their shared ultimate goals, such as delivering high-quality health services and improving their patients’ health. Work motivation theory describes how to coach a person to instil a desire for continuous improvement . In order to improve their practices, people are required to receive feedback that will allow them to assess whether or not they are achieving their pursued goals . Feedback allows them to compare their own perceptions of their performance to external evaluation information, on which they can place more or less importance depending on the source’s perceived credibility and the informational value of the content. The aim of this comparison is to either confirm actual behaviour and goal attainment or identify gaps or dissonance between actual behaviour, pursued goals, and produced outcomes . Dissonance is generated when, for example, clinicians believe they are giving appropriate and effective treatment but feedback indicates otherwise. Feedback is interpreted individually and in groups .
Reflection is the process whereby the individual and the group discuss and make sense of this information. In the reflective learning process, people focus first on the emotional response generated by the feedback and then make sense of the evaluative information received by drawing on their own experience and knowledge [24, 30]. A second important step in the reflective learning process is that of being open to other perspectives and external knowledge (such as the content of clinical practice guidelines or the experience of another professional from another discipline) in order to reframe, when necessary, pursued goals and expected outcomes. Reflection serves the process of causal attribution . The team may ascribe causes internally or externally and may perceive them as easily controllable or not. If the comparison between perceived actual practices and feedback validates the actual behaviour, the results of the reflective process will lead the team to make more effort and pay greater attention to achieving their shared goal [22, 23]. However, if the comparison reveals dissonance, the results of the reflective process will lead to the identification of new cooperative goals requiring new strategies, greater efforts, and closer attention . This will happen if the team perceives that it has a degree of control and if its members feel confident that they have the abilities to act on the situation.
The main outcome of the COMPAS project intervention is to achieve cooperative goal setting. Cooperative goal setting occurs when team members view the attainment of their respective goals as positively correlated and they work together for their mutual benefit [22, 29]. Because the key factor differentiating a goal from a mere wish is whether or not people develop a plan to achieve it, action planning is also an important component of the intervention. By planning, individuals form an active mental representation of the target situation. Action planning  can help initiate action by specifying when, where, and how to act. People who develop action plans are more likely to act in the intended way , and they initiate the goal behaviour faster  than those who do not form action plans.
Definition of the program theoretical concepts
Shared view of actual team performance
Using performance data information to achieve a mutual understanding of the strengths and weaknesses of chronic disease management in their region
Shared understanding of performance gaps
Achieving a mutual understanding of the disparities between the care delivered and the care they collaboratively wish to deliver
Cooperative goal setting
Translating the gap into a clear practice improvement goal and working together for the mutual benefit of improved chronic disease management
Cooperative practice change
Developing a team improvement strategy to achieve their mutual practice improvement goal
Previous perceived performance
If participants, before the workshop, have a positive or negative view of chronic disease management in their region
Perceived credibility and importance of feedback
If participants give value and credit to the information retrieved in the administrative database
If participants recognize a gap between actual and best practices
Perceived control and self-efficacy
If participants feel capable and confident they can improve chronic disease management and achieve their quality improvement goal
Support from management
If participants feel their organization and management will support the achievement of their quality improvement goal
Components of the intervention
The COMPAS intervention consists of a three-hour workshop led by two facilitators. It was designed to be offered to 20 to 25 professionals working in the same geographic area, thus serving the same population. The Montérégie region is divided into 11 sub-regions, some urban but most rural. It was decided that at least one workshop would be offered in each sub-region. Six workshop facilitators were trained to deliver the workshops in pairs: a physician and a pharmacist, or a physician and a nurse. Three physicians, two pharmacists, and one nurse received half a day of training. The main professional groups targeted by the diabetes workshops were physicians, nurses, and pharmacists, but other healthcare professionals were also invited to participate.
List of indicators included in the feedback intervention
Diabetic patients’ profile
Health service use profile
Number of diagnosed patients
Number of patients who are prescribed
Number of patients with an appointed family physician
– anti-diabetic medication
Number of times patients consulted
Chronic disease score
– hypolipemic medication
– another GP
Frequency of diabetes complications
– heart and vascular diseases
– internal medicine
– kidney failure
– anti-diabetic medication
– eye specialist
Adherence to medication regimen (valid prescription after 12 months and interruption of less than 14 days)
– community nurse
– community nutritionist
Frequency of GP visits
Frequency of visits to a specialist
Frequency of emergency visits
Frequency of hospitalizations
The second component of the intervention is reflection. Reflection is an active process in which one witnesses one’s own experience in order to take a closer look at it and explore it in greater depth [25, 30]. To support this reflective process, participants are asked at the start of the workshop to say what they perceive as the most important challenges they face in their practice in terms of improving diabetes management. These challenges are discussed in a large group. Following the feedback intervention, participants are asked to form small interprofessional groups of six to eight clinicians to make sense out of the information that was presented to them. The pedagogical committee developed a tool to guide their reflection process. Participants are asked to identify what surprises them with regard to patients’ characteristics, prescription profiles, and health services use profiles. They are then asked to identify what they perceive as the most important gaps between their actual team performance and what they consider a good team performance. In a large group, participants are invited to appraise their level of collaboration, discuss their respective and shared roles in diabetes management, and identify possible avenues for interprofessional practice improvement.
The third component of the intervention is action planning . In small interprofessional groups, the participants are asked to select one priority practice improvement need that will become their shared goal. Small groups are invited to develop a plan that will allow them to achieve their goal. Using a template provided, they are asked to identify what they would do to achieve their goal, who would be in charge of the project, who would be doing what, and what the timeline would be, as well as to identify indicators that would help them measure whether they had achieved their goal. Action plans are presented on a poster board and discussed in a large group.
Validation of the program impact theory
Five themes describing the workshop objectives emerged from the qualitative analysis of the interviews conducted with the workshop participants (Table 4). These five themes were the importance of: 1) adopting a regional perspective, 2) reflecting, 3) recognizing gaps between practice and guidelines, 4) collaborating, and 5) identifying possible practice improvements. During the interviews, most of the participants mentioned that one of the intervention’s aims was to allow them to form a regional vision of diabetes patients and diabetes service delivery.
Results of the thematic analysis in terms of categories and themes generated
According to you, what were the objectives of this workshop?
Adopting a regional perspective
Examining practices at a regional level
Having a regional perspective of patient management
Having a regional vision
Reflecting on our own practice
Reflecting on ways by which we can improve our practice
Understanding how we manage our case load
Allowing us to reflect on quality of care improvement
Reflecting on follow-up of patients
Analyzing the global situation
Recognizing our strengths and weaknesses
Recognizing gaps between practice and guidelines
Comparing practice with clinical guidelines
Comparing with good practices
Recognizing gaps between practices and
Recognizing the relevance of performance feedback
Working in interdisciplinary
Working in collaboration
Having a better vision of each other roles
Being more aware of what other professionals are doing
Changing our view of collaboration
Recognizing complementarities between professionals
Knowing what is done elsewhere in order to improve our practice
Identifying possible practice improvements
Identifying one aspect of practice we wish to improve
Identifying possible ways to improve practice
Offering better care
Providing more homogenous and standardized chronic disease care in the region
Improving treatment adherence
Developing clinical tools
They saw the objective of presenting data from the clinical-administrative database as that of giving them a broader perspective and allowing them to compare their practices to those in other regions. This comparison was seen as useful, for example, for understanding how the availability of specialized services such as ophthalmology impacted on retinopathy screening.
“The reflective approach is not the usual approach we are accustomed to in workshops. It means doing our own reflection. We weren’t given data just for the sake of it, but so that we could interpret our profile ourselves” (Participant #5).
“It makes us think about the follow-up we do. We are more careful afterwards about following the guidelines” (Participant #5).
“The objective was not to question the guidelines, but rather to help us see whether we applied them” (Participant #8).
“Pharmacists are invaluable collaborators who should be better integrated into the different steps involved in care” (Participant #9).
“It changed my view of pharmacists. I didn’t think they could have such an influence” (Participant #6).
“We pharmacists know that the other professionals have a hard time recognizing that we see patients 12 times a year and know a lot about clients’ adherence [to treatment regimens]. We are poorly understood” (Participant #8).
“We targeted an action that would improve screening for retinopathy, and it has already been implemented in my clinic” (Participant #2).
Feasibility and acceptability of the intervention
The task of delivering the workshops was more challenging than expected. In the regions, medical education is rarely offered to mixed professional groups, and busy physicians are responsible for organizing the CE activity calendar for peers. Even though an advertisement for the intervention was published in various local and provincial newspapers, word-of-mouth proved to be the most effective way of convincing one CME representative to organize a workshop. Inviting community pharmacists and nurses to the workshops was perceived as time-consuming and as an unusual modus operandi. Thus, at some workshop sessions, there was a good balance between the number of physicians, nurses, and pharmacists, while at others, there were insufficient nurses and pharmacists for them to participate in all the small group discussions. We also observed that when there were prior habits of collaborating or when nurses and physicians were already sharing responsibilities for the management of diabetic patients, it facilitated the reflective and action-planning processes. When a pattern of collaboration was not already established, the workshop’s aim was limited to having the participants get to know one another and explore their respective roles and possible collaborations. Three hours was sufficient to deliver the three workshop components. However, some participants mentioned that less time should be devoted to the feedback intervention and more time allowed for reflection on interprofessional collaboration and action plan development. The pedagogical material that had been developed to support small group work was found to be cumbersome. Participants were asked to use large sheets of paper to write down the outcomes of their reflection and their action plan and then to stick these sheets of paper onto a large board. However, limited room space and unclear or small handwriting limited the usefulness of these materials for purposes of the large group discussion.
Mean satisfaction scores* reported by participants (n = 86)
The goals of the workshop matched my needs.
There was sufficient interaction between the facilitator and participants.
This workshop will have an impact on my practices.
Following the delivery of a first series of workshops on diabetes, four facilitators out of six were still able to and very interested in continuing to participate in the COMPAS project. One physician and one nurse had to withdraw because of work- and family-schedule conflicts. The focus group with the workshop facilitators and the project coordinator generated a list of challenges encountered during workshop delivery and of perceived possible improvements. The difficulties cited pertained to workshop planning and the need to use more formal strategies to reach more physicians and nurses working in primary care settings, as well as community pharmacists. The need to improve the ways in which the facilitators support small group reflection and action planning was also seen as important. The use of pencils and paper was considered an impractical and outdated means of sharing information with the large group. Also, the facilitators mentioned that they would appreciate having the opportunity to present previous action plans developed by other teams in other regions to stimulate small team work in instances where teams experience difficulty in finding a cooperative goal and drawing up an action plan. The facilitators perceived workshop follow-up as a very important means of encouraging action plan implementation and team practice change. It was decided that the project coordinator would do a one-, three-, and six-month follow-up with the workshop participants by e-mail.
Discussion and conclusion
The aim of this paper was to describe the theory underlying the COMPAS intervention delivered to primary care professionals for the purpose of improving interprofessional collaboration and their involvement in improvement of the quality of chronic disease care. As described in a literature review performed by Xyrichis , several barriers exist that hinder interprofessional collaboration in primary care. Some of these barriers are lack of communication between team members, lack of a clear understanding of each other’s professional roles and responsibilities, and lack of practice evaluation. Recommendations have been made to increase the number of team meetings, identify team goals, and conduct team audits. The intervention developed in the Montérégie region addressed these barriers by bringing together professionals from numerous disciplines who are involved in chronic disease management, providing them with feedback on their practices and performance, and having them develop their own action plans to improve the quality of their services. As pointed out by Ham , clinicians need time and space to review established practices and to introduce new and more effective ways of delivering services. It is also important that the interventions carried out to improve clinicians’ involvement be based on what motivates them in their daily work.
The theoretical basis of the COMPAS project intervention reflected work motivation theory [22, 23] and reflective learning . Providing feedback and opportunities for reflective learning are two recommended strategies for continuing professional development, and both have demonstrated their effectiveness in supporting the implementation of practice changes [14, 25, 37]. However, the research evidence is still unclear as to how we should deliver these interventions. Combining both into a three-hour workshop session was a challenge. Right from the beginning of our study, it appeared important to the research team that the developers of the COMPAS intervention should gain a clear understanding of the intervention’s expected outcomes and its action mechanisms before proceeding to its evaluation . In research, most evaluation involves a “black box” approach: the inner mechanisms of the intervention are not explicit or are unknown . The value of conducting theory-driven evaluations is that they have the potential to contribute to an evolving understanding of the nature of the change processes that programs bring about and of the ways in which these processes can be optimized [17, 18]. This approach to evaluation is enriching since it provides evaluators with a thorough understanding of the most effective program components, the mediating processes through which they work, and the moderating factors related to participants and the context influencing the achievement of expected outcomes. The development of the program impact theory underlying the COMPAS project intervention will improve our ability to measure the intervention’s real impacts on practice change and further elucidate the factors influencing the intervention.
Our observation of the workshop sessions and the interviews conducted with the participants confirmed that the objectives of the COMPAS team’s intervention indeed targeted the improvement of interprofessional collaboration and quality of care. Participants described the participating physicians’ and nurses’ lack of awareness of how pharmacists could contribute to chronic disease management in primary care. Pharmacists’ practices are often perceived as being based on physicians’ prescriptive decisions and on technical aspects of dispensing medication . However, the small group discussions increased the participants’ awareness of the active role that pharmacists can play in diabetes management and in providing continuity of care since they see patients regularly and are well-placed to know whether patients are adhering to their medication and treatment plans. They can educate clients on a regular basis and offer self-management support by answering questions and referring patients to appropriate professionals. Another important objective of the intervention was to help participants recognize practice gaps and to create opportunities for them to become personally involved in the improvement of service delivery. The way in which the feedback intervention was delivered promoted the development of a community-oriented primary care (COPC) vision [39, 40]. Community-oriented primary care is about providing accessible, comprehensive, coordinated, continuous, and accountable healthcare services to a defined community. Community refers to a geographic group for which a health organization is responsible. The form of feedback delivered in the COMPAS project intervention facilitates the process of community-oriented primary care delivery because it allows professionals to improve their knowledge of the characteristics of the community they serve and of the prevalence of specific health problems in that community, but also to improve healthcare services, address community needs, and monitor the effectiveness of their interventions . COPC has been described as a promising approach for health promotion and disease prevention and would appear highly conducive to improving integrated care for chronic disease management [40, 41].
One limitation of this study is the small number of professionals recruited for the interviews. Busy clinicians lack time to participate in research projects, especially projects that do not directly involve patients. The professionals volunteered to participate to the interviews and were maybe more satisfied or motivated than other workshop participants. Nevertheless, participants’ answers were converging and most of the themes were identified after a few interviews. The project coordinator (BD) conducted the interviews and the qualitative analysis. An interview guide was used to minimize the influence of his personal interpretation. His knowledge of the intervention was however helpful to help participants talk about their learning experience. In order to increase credibility, a second investigator (BV) was involved at every step of the analysis process. Triangulation was also used: results from the interviews were compared to the workshop observation notes and the participants’ satisfaction evaluation.
However, this study was limited to surfacing and describing the program impact theory underlying an innovative, interprofessional continuing education program. It does not confirm its effectiveness and its evaluation will require the use of an appropriate experimental research design. Program theory development increases our understanding of the expected mechanisms of action of the intervention but do not confirm its real outcomes and if it did lead to practice changes. However, these preliminary results have shown that the intervention does indeed target its expected outcomes. Our hypothesis is that a three-hour workshop alone cannot lead to major changes in practice. Long-term interventions are needed to support this complex change process. That said, using feedback and reflective learning increases participants’ awareness of practice gaps and the need to improve how they collaborate. To maximize the intervention’s impact, a follow-up intervention will be carried out within one year of the initial workshop to support implementation of the developed action plans. The project team is also confident that the COMPAS intervention will have an impact on practice if it is repeated and if these types of reflective learning experiences and team meetings are integrated into practice on at least an annual basis. Recently we launched a new series of workshops for chronic obstructive pulmonary diseases (COPD), and it is our hope that professionals will become more and more familiar with the COMPAS approach in order to increase their involvement in the quality improvement of health services in the communities they serve.
The authors would like to acknowledge the funding of GlaxoSmithKline Inc. (Canada), the Agence de la santé et des services sociaux de la Montérégie and the Canadian Institutes of Health Research (postdoctoral fellowship). We also acknowledge the partners of all the committees of the COMPAS project: Dr Jacques Ricard, Dr Jacques Le Lorier, Dr Louise Passerini, Dr Richard Desmarais, Dr Julie Lajeunesse, Stéphane Bourque, Marc-André Fournier, Manon Noiseux, Marie-Claude Fournier, Lyne Daoust, Mireille Gaudreau and Simon Daneault. We also thank all the workshop facilitators.
- Statistics Canada: Census of Population. 2006, [http://www12.statcan.ca/census-recensement/2006/dp-pd/hlt/97-551/pages/page.cfm?Lang=F&Geo=PR&Code=01&Table=1&Data=Count&Sex=1&StartRec=1&Sort=2&Display=Page]
- Aucoin L, Allaire V, Gratton A-E: Priisme Info, Special Edition, March 2005. Les maladies chroniques et la modernisation du système de santé québécois.
- Schaefer C: Prévenir les maladies chroniques en Montérégie par de saines habitudes de vie: Programme 0-5-30 Combinaison/Prévention. 2005, Longueuil: Direction de la santé de la Montérégie
- Public Health Agency of Canada: Trends & Impact: The Basis for Investment Decisions. 2007, [http://www.phac-aspc.gc.ca/alw-vat/trends-tendances/index-eng.php/health_care]
- Statistics Canada: Gross domestic product by industry. 2011, [http://www.statcan.gc.ca/daily-quotidien/110930/dq110930a-eng.htm]
- Wagner EH: Improving Chronic Illness Care: Translating Evidence Into Action. Health Aff. 2001, 20 (6): 64-78. 10.1377/hlthaff.20.6.64.View Article
- Wagner EH: Managed care and chronic illness: health services research needs. Health Serv Res. 1997, 32: 702-714.PubMedPubMed Central
- Ham C: The ten characteristics of the high-performing chronic care system. Health Econ Policy Law. 2010, 5 (Pt 1): 71-90.PubMedView Article
- Lévesque J-F, Feldman D, Dufresne C, Bergeron P, Pinard B: L’implantation d'un modèle intégré de prévention et de gestion des maladies chroniques au Québec: barrières et éléments facilitant. 2007, Montreal: Institut national de santé publique du Québec
- D’amour D: The conceptual basis for interprofessional collaboration: Core concepts and theoretical frameworks. J Interprof Care. 2005, 19 (Supplement 1): 116-131.PubMedView Article
- Zwarenstein M, Goldman J, Reeves S: Interprofessional collaboration: effects of practice-based interventions on professional practice and healthcare outcomes. Cochrane Database Syst Rev. 2009, 3: CD000072
- The College of Family Physicians of Canada: Primary Care Toolkit for Family Physicians 2006. 2010, [http://toolkit.cfpc.ca]
- Guldberg TL: The effect of feedback to general practitioners on quality of care for people with type 2 diabetes. A systematic review of the literature. BMC Fam Pract. 2009, 10: 30-10.1186/1471-2296-10-30.PubMedPubMed CentralView Article
- Ivers N: Audit and feedback: effects on professionnal practice and healthcare outcomes. Cochrane Database Syst Rev. 2012, 13 (6): CD000259
- Medical Research Council: A Framework for Development and Evaluation of RCTs for Complex Interventions to Improve Health. 2008, London: Medical Research Council, 39.
- Michie S: Specifying and reporting complex behaviour change interventions: the need for a scientific method. Implement Sci. 2009, 4: 40-10.1186/1748-5908-4-40.PubMedPubMed CentralView Article
- Rossi PH, Freeman HE, Lipsey MW: Evaluation: A systematic Approach. 1999, Tousand Oaks: Sage Publications, 6
- Donaldson SI: Program Theory-Driven Evaluation Science: Strategies and Applications. 2007, New York: Lawrence Erlbaum Associates
- Paillé P: Qualitative par théorisation. Dictionnaire des méthodes qualitatives en sciences humaines et sociales. Edited by: Mucchielli A. 2009, Paris: Armand Colin, 214-220.
- Champagne F: Un cadre d’évaluation globale de la performance des systèmes de services de santé: Le modèle EGIPSS, Groupe de recherche interdisciplinaire en santé. 2005, Montréal: Université de Montréal
- Ham C: Improving the performance of health services: the role of clinical leadership. Lancet. 2003, 361: 1978-10.1016/S0140-6736(03)13593-3.PubMedView Article
- Lathatm GP: Work motivation: History, Theory, Research, and Practice. 2007, Thousand Oaks, CA: Sage Publications
- Riemer M, Bickman L: Using program theory to link social psychology and program evaluation, in Social Psychology and Evaluation. In Using program theory to link social psychology and program evaluation, in Social Psychology and Evaluation. Edited by: Mark MM, Donaldson SI, Campbell B. 2011, New York, NY: The Guilford Press
- Mezirow J: Transformative dimensions of adult learning. 1991, San Francisco: Jossey-Bass
- Epstein RM, Siegel DJ, Silberman J: Self-monitoring in clinical practice: a challenge for medical educators. J Contin Educ Health Prof. 2008, 29 (1): 5-13.View Article
- Latham GP, Pinder CC: Work motivation theory and research at the dawn of the twenty-first century. Annu Rev Psychol. 2005, 56: 485-516. 10.1146/annurev.psych.55.090902.142105.PubMedView Article
- Locke EA, Latham GP: A theory of goal setting and task performance. 1990, Englewood Cliffs, NJ: Prentice-Hall
- Festinger L: A theory of cognitive dissonance. 1957, Evanston, IL: Row Peterson
- London M, Sessa VI: Group feedback for continuous learning. Hum Resource Dev Rev. 2006, 5 (3): 303-329. 10.1177/1534484306290226.View Article
- Boud D, Keogh R, Walker D: Reflection: Turning experience into learning. 1985, London: Kogan Page
- Weiner B: An attributional theory of achievement motivation and emotion. Psychol Rev. 1985, 92 (4): 548-573.PubMedView Article
- Leventhal H, Singer R, Jones S: Effects of fear and specificity of recommendation upon attitudes and behavior. J Pers Soc Psychol. 1965, 2 (1): 20-29.PubMedView Article
- Gollwitzer PM, Brandstätter V: Implementation intentions and effective goal pursuit. J Pers Soc Psychol. 1997, 73: 186-199.View Article
- Orbell S, Sheeran P: Motivational and volitional processes in action initiation: A field study of the role of implementation intentions. J Pers Soc Psychol. 2000, 30: 780-797.
- Sniehotta FF: Action planning and coping planning for long-term lifestyle change: theory and assessment. Eur J Pers Soc Psychol. 2005, 35: 565-576. 10.1002/ejsp.258.View Article
- Xyrichis A, Ream E: Teamwork: a concept analysis. J Adv Nurs. 2008, 61 (2): 232-241. 10.1111/j.1365-2648.2007.04496.x.PubMedView Article
- Mann K, Gordon J, Macleod A: Reflection and reflective practice in health professions education: a systematic review. Adv Health Sci Educ. 2009, 14: 595-621. 10.1007/s10459-007-9090-2.View Article
- Grindrod KA: Pharmacists’ perspectives on providing chronic disease management services in the Community - Part 1: Current practice environment. CPJ/RPC. 2009, 142 (5): 234.
- Nevin JE: Community-Oriented Primary Care. Health Policy Newsletter. 1995, 8 (2): Article 7.
- Longlett SK, Kruse JE, Wesley RM: Community-oriented primary care: historical perspective. J Am Board Fam Pract. 2001, 14 (1): 54-63.PubMed
- Hayashi AS: Transforming community health and primary care education using clinical and administrative data and geographic information systems. J Map Geography Librairies. 2011, 7 (1): 61-70. 10.1080/15420353.2011.534690.View Article
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1472-6963/13/106/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.