- Research article
- Open Access
Improving dementia care: insights from audit and feedback in interdisciplinary primary care sites
BMC Health Services Research volume 22, Article number: 353 (2022)
Many primary care sites have implemented models to improve detection, diagnosis, and management of dementia, as per Canadian guidelines. The aim of this study is to describe the responses of clinicians, managers, and staff of sites that have implemented these models when presented with audit results, their insights on the factors that explain their results, their proposed solutions for improvement and how these align to one another.
One audit and feedback cycle was carried out in eight purposefully sampled sites in Ontario, Canada, that had previously implemented dementia care models. Audit consisted of a) chart review to assess quality of dementia care indicators, b) questionnaire to assess the physicians’ knowledge, attitudes and practice toward dementia care, and c) semi-structured interviews to understand barriers and facilitators to implementing these models. Feedback was given to clinicians, managers, and staff in the form of graphic and oral presentations, followed by eight focus groups (one per site). Discussions revolved around: what audit results elicited more discussion from the participants, 2) their insights on the factors that explain their audit results, and 3) solutions they propose to improve dementia care. Deductive content and inductive thematic analyses, grounded in causal pathways models’ theory was performed.
The audit and feedback process allowed the 63 participants to discuss many audit results and share their insights on a) organizational factors (lack of human resources, the importance of organized links with community services, clear roles and support from external memory clinics) and b) clinician factors (perceived competency practice and attitudes on dementia care), that could explain their audit results. Participants also provided solutions to improve dementia care in primary care (financial incentives, having clear pathways, adding tools to improve chart documentation, establish training on dementia care, and the possibility of benchmarking with other institutions). Proposed solutions were well aligned with their insights and further nuanced according to contextual details.
This study provides valuable information on solutions proposed by primary care clinicians, managers, and staff to improve dementia care in primary care. The solutions are grounded in clinical experience and will inform ongoing and future dementia strategies.
Provincial and national dementia guidelines have been published in Canada for improving the care of persons with dementia and their caregivers [1,2,3,4]. These guidelines identify interdisciplinary primary care sites, with the support from specialized services when needed, as the cornerstone in dementia care . Furthermore, many primary care clinicians are willing and ready to assume a key role in dementia care [6, 7]. However, some clinicians face difficulties in providing dementia care in primary care settings . Various studies have explored barriers in the management of dementia in primary care that included failure to recognize symptoms, lacking information and understanding of the disease, lacking support to the primary care clinicians, diagnosis uncertainty, dementia complexity, and lack of time [8,9,10].
Practice guidelines can be difficult to translate into clinical practice . Clinicians, including Canadian clinicians, may perceive these guidelines as both enablers and barriers to the identification, assessment, and management of dementia . There is a need to better support the implementation of dementia guidelines in primary care sites in Canada .
Many different implementation strategies exist to support dissemination and scale up of innovative models of care . One of these strategies, the audit and feedback (A&F) approach, can be useful to improve clinical practice [12, 13], especially when repeated over several cycles . Furthermore, clinicians commonly see A&F as a positive experience . Canadian family physicians consider it an essential part of medical professionalism, important for maintaining their accountability . Because A&F aims at improving clinicians’ adherence to guidelines [16, 17], through action plans  and recommendations for dissemination to future primary care sites and provincial policies, this strategy represents a good option.
The overarching aim of our study was to describe the responses of clinicians, managers and staff of primary care sites that have implemented various models of dementia care when presented with audit results, their insights on the factors that explain the audit results, their proposed solutions to improve dementia care and how these insights and solutions align to one another. More specifically, we had the following three sub-objectives: 1) describe what audit results elicited more discussion from the participants, 2) describe their insights on the factors that explain their results, and 3) describe solutions proposed they would like to implement to improve dementia care in primary care.
We conducted a one-cycle A&F study [18, 19] in eight interdisciplinary primary care sites in Ontario, Canada, that had previously implemented models of dementia care. We used the SQUIRE 2.0 reporting guidelines for quality improvement studies  to guide the writing of this manuscript.
Setting and participating primary care sites
This study is part of a multi-provincial Canadian study taking place in Quebec, Ontario and New Brunswick funded through the Canadian Consortium on Neurodegeneration in Aging (CCNA) . This larger study aims to examine innovative primary care models for persons with dementia. For the current study, we focused on eight purposefully sampled primary care sites (hereafter referred to as ‘sites’) in Ontario.
As per the larger study protocol, the sites were selected because they were interdisciplinary primary care sites, they had previously implemented an innovative primary dementia care model, they were knowledgeable about existing dementia guidelines, and they were motivated to improve dementia primary care for their population. Four of the eight sites had previously implemented an embedded-assessor model, two sites had implemented a collaborative memory clinic model, and two sites had implemented a combination of both in a hybrid model (see Additional file 1 for details on implemented models as well as a timeline of the implementation of the models, the audit, the feedback, and focus group discussions).
The audit was performed after the models of dementia care had been implemented in the eight primary care sites. To conduct a comprehensive audit at the eight clinics, we used three sources of data.
First, we carried out a retrospective chart review of 35 patients per site with a diagnosis of dementia who had a visit during a nine-month period (October 1, 2015 to July 1, 2016) to obtain information on adherence to Canadian recommendations of dementia care [2, 4]. These recommendations translated into 10 indicators, composing a validated quality of follow-up score  (specifically, documented assessment of cognition, functional status, behavioural and psychological symptoms of dementia, weight, driving status, caregiver’s needs, home care needs, community service needs, absence of anticholinergic medication and management of dementia medications). In addition, indicators of continuity of primary care and medication management (specifically, proportion of patient with a new diagnosis during the 9-month period; proportion of patients with a new diagnosis from a physician from the site, from a specialist or during a hospitalization; average number of visits during the period per patient; average number of notes recorded in each chart; proportion of patients with a referral to an external memory clinic during the period and justification of referrals; proportion of patients with dementia treated with dementia medications; proportion of new dementia medications initiated by family physician at the site; proportion of new dementia medications initiated by specialists; and proportion of patients treated with antipsychotics during the study period) were measured along with patients’ characteristics (specifically, mean age, proportion of women, and proportion of patients living alone).
Second, using a validated questionnaire , distributed in 2017, we measured the knowledge, attitudes, and practice (KAP) of 100 family physicians and nurse practitioners with regards to dementia care and initiatives. The details of the questionnaire construction, validation and distribution are presented elsewhere . The questionnaires measured five domains as they relate to their KAP: perceived competency and knowledge related to dementia, attitudes toward dementia, practices in terms of cognitive evaluation; attitude toward their collaboration with other healthcare professionals in the site and attitudes toward the dementia care models.
Finally, in 2017, we conducted interviews with 30 clinicians and managers to identify facilitators and barriers associated with the implementation of the dementia care models described above. The details for this method are reported elsewhere .
Feedback and focus groups
For the feedback, we compiled descriptive results from the audit (number, percentage, mean, standard deviation, and range), with a focus on chart review results, into site-specific PowerPoint presentations. The site-specific results for the chart review were compared to the average for the eight participating sites and presented in bar graphs and tables. Results from the KAP questionnaire (in bar graphs) and the interviews (in point form) were provided globally, not site specifically, to avoid putting the participants’ confidentiality at risk (see Additional file 2 for a template of feedback presentations).
In June 2019, the healthcare clinicians, managers, and administrative staff of each site were invited to a feedback presentation (one presentation per site). To increase the effectiveness of the feedback provided, discussions were facilitated by respected experts [13, 14]: a public health physician and researcher (IV) and a geriatrician (JI), or a researcher in dementia care (CM), using an oral presentation format with visual support (see Additional file 2) and detailing the formal targets included in the audit.
Immediately following each feedback presentation, we conducted a focus group. The discussion guide, specifically developed for this study (Additional file 3), included the following questions: which results did you find useful / interesting / expected / surprising?; what are the key elements that explain these results?; what changes in terms of results would you like to see when this evaluation is performed in the future?; and what would help your site to achieve these changes/goals? Focus group discussions were recorded and transcribed verbatim.
For the first sub-objective (to describe what audit results elicited more discussion from the participants), we performed a content analysis  of the focus group discussions. One author (MLB) first read the transcriptions and created result-specific codes based on a pre-established list of codes from the three sources of data collected during the audit (indicators from the chart review, scores from the questionnaire, and findings of the interviews). These codes were then discussed and confirmed with two other authors (GAL, LRR). A final list of codes was established and a count by codes (at least one mention) was reported for each site and overall. A count of codes was performed by one author (MLB) and verified by another (GAL).
For the second and third objectives (to describe the participants’ insights on the factors that explain the audit results and the solutions proposed by the participants to improve dementia care), we performed an inductive thematic analysis  with Qualitative Data Analysis®, lite version. One author (MLB) coded line-by-line all transcripts. Each code was then discussed and revised by three other authors (IV, GAL, LRR). Codes were organized in thematic networks  and discussed among all authors.
We used and adapted the causal pathway models theory  to guide our analyses of the overarching aim (to describe the responses of clinicians, managers and staff of primary care sites that have implemented various models of dementia care when presented with audit results and how their insights align with the solutions). The reasoning for using this theory was to increase the likelihood that the solutions proposed by the participants achieve the intended change, by exploring how audit results discussed, factors that explain them, and solutions proposed are linked to one another . By doing this, we aim to inform the improvement of implemented models of dementia care . More specifically, we followed loosely the method proposed by Lewis  for grounding implementation research in causal pathway models: a) identify outcomes (proximal: audit results; distal: improvement of dementia care in primary care), b) identify factors that explain these results, c) generate solutions, and d) articulate modifiers (or influences on the factors/specifications on the solutions). The audit results and overall outcome of dementia care improvement are based in Canadian clinical guidelines (as described in ). The other steps were entirely based on the discussions during the focus groups with the participants. Each audit result was first linked with a factor, then each factor was linked with a solution and influences on the factors and specifications on the solutions were highlighted.
To ensure trustworthiness (credibility, transferability, dependability, and confirmability) of our study , we followed several strategies, including analyzing the data by three research team members and discussing this analysis with all research members, providing a clear description of our population, methods, and findings, as well as keeping records of our data analysis process and decisions made.
Description of the participants taking part in the focus groups
The participants’ characteristics varied between sites, relative to the site’s size and team composition. There were 63 participants in the focus groups: 34 family physicians, five nurse practitioners and nine administrative or managerial staff. On average, eight participants per site took part in the focus groups (see Table 1).
First sub-objective: Describe what audit results elicited more discussion from the participants
Because the participants did not discuss each audit result specifically, but rather took a global approach to discussing their audit results, we were not able to count the number of times a specific result was discussed but rather we counted the number of times the codes as they relate to audit results were discussed. For example, participants discussed caregiver’s needs as the documentation of their assessment, the importance of the assessment itself or even the barriers and facilitators to performing a caregiver’s needs evaluation, therefore, we created the code “Caregiver’s needs”. Similarly, the participants discussed the rates of referrals to memory clinics, their appropriateness, or the barriers and facilitators associated with referrals to external memory clinics, therefore, we created the code “Referrals to external memory clinics”, and so on. As such, we created 16 codes as they relate to the audit results (listed in Table 2).
Sites discussed an average of 9.5 audits results. Some sites discussed up to 13 different audit results, whereas one site discussed as few as five audit results.
All sites discussed referrals to external memory clinic and cognitive testing. All but one sites discussed audit results as they relate to caregivers’ needs. Six sites discussed diagnosis, number of contacts or visits, and dementia medications and more than half the sites discussed quality of follow-up, in general or its specific indicators: Alzheimer societies, functional status, driving and weight assessments, making these audit results most discussed by the sites.
Only two to three sites discussed KAP scores, prescription of antipsychotics, and anticholinergic medications. Finally, only one site discussed home care services and no site discussed behavioral and psychological symptoms of dementia (BPSD) evaluation.
Second sub-objective: Describe the participants’ insights on the factors that explain audit results
Participants shared many insights to explain their audit results. These insights were grouped into organizational factors and clinicians’ factors.
Organizational factors that explain the primary care sites’ audit results
Three organizational factors were described by the participants to explain their audit results, namely a) human resources and expansion of nurses and other health professionals’ role, b) clear and organized links with health and community services, c) clear roles and support from external memory clinics. As depicted by the dash lines in Fig. 1, each organizational factor was linked (explicitly by the participants during the discussions) to two audit results, and alternatively, each audit result was linked to a maximum of two organizational factors. Furthermore, participants identified four modifiers that influence these organizational factors (rural settings, multisite clinics, poor communication, and proximity/reputation of external memory clinics were all hindering the organizational factors).
Human resources and expansion of nurses and other health professionals’ role
When discussing their audit results in general but mostly in terms of quality of follow-up (e.g., cognitive testing, caregiver’s needs, and functional status), number of visits, and making diagnosis, participants explained their results by the availability of human resources and the ability to use these resources to support the management of dementia. These resources, such as service coordinators and social workers, allowed clinicians to provide better care and support to persons with dementia by taking the brunt of the work. As such, the participants reported that having these resources enabled them to offer comprehensive assessment, treatment, and follow-up of persons with dementia, including the involvement of caregivers:
[The clinicians from the collaborative memory clinic] do all the heavy lifting and give me advice and it certainly changes the way. Whereas, before I referred them to [external resources]. […] The quality of information I'm getting is much better than what we've had previously, more timely, and more cognitively-based. - Site 107
In embedded-assessor sites, where a nurse or other healthcare professional performed cognitive assessments, the participants explained their audit results in general by the contribution these assessors made throughout the care process: from diagnosis to follow up. When discussing the diagnosis process, participants reported that the presence of the embedded assessors improved the timeliness of services and was perceived as an essential support for the adequate management of dementia:
Generally, most people come through. So, they'll have the cognitive testing with [the nurse], while the caregiver sits with the social worker to do that caregiver interview […] So, they're timed. And then, we come together as a group to discuss the results. – Site 107
Not all participants benefitted from human resources equally, especially in rural settings.
Because of our [rural] location, I will say it to you: as a nurse practitioner in the office, I'm there three days a week, that's all the funding we have, our nurse is also there three days a week, so she's half-time, right? So, if we had her four days a week, you know, there would be more opportunity for her to take on some more projects. – Site 103
Alternatively, participants, especially in multisite clinics (e.g., 105 and 106), explained that the presence of these human resources, especially dementia-specific resources such as the embedded-assessor or the collaborative memory clinic, also generated a high demand of referrals from family physicians, hindering the quality follow-up or their audit results in general. In consequence, they reported, the wait times for diagnosis or follow-up evaluation suffered. The participants added that this led some clinicians to make multiple competing referrals, to collaborative memory clinic, embedded-assessors, and to external memory clinics, to obtain timely access to services: “Some people [refer] to both [collaborative memory clinic or external memory clinic], and they’re hoping whichever is first. It becomes an issue.” – Site 106.
Clear and organized links with health and community services
Participants highlighted that having a good relationship with community services (such as the Alzheimer Society and home care services) helped them ensure that persons with dementia are indeed referred to these services. This close relationship, participants reported, also contributed to the timely and relevant sharing of information:
The [Alzheimer Society] will fax [patient data] over to me and I will have to scan them into the EMR [electronic medical records]. They are using clinical judgement as to whether or not they feel that it is something that the physician should be made aware of. So, they won't always send it, but they do send it if they feel anything is pertinent and relevant. […] The social worker on our team is with the Alzheimer society.” – Site 105
However, participants from rural communities reported a lack of access to these community services resources and long waiting lists due to higher proportion of persons living alone: “[We have more people living alone in our region] because we’re so rural. There may be a lot of people who don’t have family around to help support […] Although we do have trouble with continuity and accountability.” - Site 107.
Clear roles and support from external memory clinics
When discussing the audit results with regards to Alzheimer’s societies and home care services, participants also reported the importance of clearly defined roles for family physicians and memory clinic specialists. More specifically, they reported feeling that memory clinic specialists were better equipped than family physicians to support families and caregivers and deferred to specialists to establish a contact between patients and community services:
I think in that kind of situation, there is some assumptions that [the external memory clinic] is also connecting them with the Alzheimer's society. Patients are going from the country to the city to go to [the external memory clinic], the Alzheimer's society is in the city, you know. – Site 103
When discussing audit results as they relate specifically to referrals to external memory clinics, participants reported a lack of information and suboptimal communications:
I really didn't get as good information as I'd hoped from the [external memory clinic]. […] So, when we started up our [collaborative memory clinic], the quality of the information is just that much superior to the information I'd been getting previously. – Site 107
Alternatively, participants reported that the presence and proximity of well-established external memory clinics were driving higher referrals, prompted by the persons with dementia directly:
Often the patient or provider ask about it. They know that memory clinics are available in this area. They love the quality of them. I think it's fairly well-known in the community. And they ask [for it], as soon as they hear we are going toward the dementia diagnosis, [they say]: ‘I need to go there and get the best treatment’, you know. – Site 104
Clinicians’ factors that explain the primary care sites’ audit results
Participants offered three clinician-level factors that explain many of their audit results, namely a) perceived competency and practices, and b) attitudes. As depicted by the dash lines in Fig. 1, some audit results (namely diagnosis) were linked (explicitly by the participants during the discussions) to both factors, displaying good overlap between audit results and clinician factors. Furthermore, eight modifiers that influence these clinician factors (see Fig. 1) were mentioned by the participants: a) competency with diagnosis and medication management that evolves with years of practice or a move to another clinic and practices for diagnosis (and reliance on external memory clinics for guidance) was influenced by the complexity of cases, and b) attitudes toward diagnosis, medication managements and quality of follow-up relate to the clinicians’ motivation, lack of time, support and resources, and perceived consequences of a diagnosis as well as perceived added value of the model when it relates to referrals to external memory clinics.
Perceived competency and practices with regards to the care of persons with dementia in primary care
When discussing their audit results with regards to making a diagnosis, participants reported that this was supported by cumulated years of experience with older populations. This gradually built-on expertise made them feel confident with dementia care in general, including their perceived competency in making a diagnosis:
Especially because we have a big senior's population and many of our physicians also work in long term care, or complex continuous care, or the rehab unit, the hospital. That is a really big part of their practice and they have probably developed competencies around those areas. And so they feel comfortable managing that piece, like making the diagnosis. – Site 105
However, when discussing their audit results as it relates to managing dementia medications, participants expressed doubts and felt inadequately supported and uncomfortable doing it themselves and preferred referring patients to external memory clinics:
Each drug, you think, they might have all kinds of side effects and so it was very difficult to make a decision. And to be honest, I very rarely know because of quality of back-up that we have locally. I just find it much easier to sit back long enough […] Sitting back, letting the experts carry on is a good idea. – Site 104
When discussing making the diagnosis and managing dementia medications, the participants also reported that this could be influenced by an aging population in their clinical practice or changed due to patients moving from their practice to another one. Participants also reported how this could lower their confidence in making diagnosis and managing dementia medications:
I was practicing outside of [the region], I didn't have the numbers of geriatric patients that I have out here. So, my practice now is very geriatric-heavy and so I am starting […] doing like the testing and stuff for us. So, I'm starting to start prescribing but I must say that, even me, I have been referring a fair amount to the [external memory clinic] because I just haven't prescribed any of those meds for years […]. – Site 104
When participants discussed their audits results as they relate to referrals to external memory clinics, they reported referring to obtain additional clinical guidance, where doubts persisted after their assessment or for more complex cases, reflecting good practice: “That must have been like: ‘I think this person has dementia, do you agree?’. It wasn’t like: ‘what’s going on with this person?’ […] It was confirming the diagnosis.” – Site 107.
Attitudes toward dementia care in primary care
Participants attributed their capacity to diagnose dementia and manage medications to the positive attitudes of their motivated family physicians: “I think we have way more physicians that want to be involved in that process with their patients.” – Site 105.
But not all participants agreed on the positive attitudes of the family physicians working in their site. Some family physicians, the participants reported, were still reluctant to treating the dementia population due to lack of time, support, and resources: “I think that family doctors generally want to take care of their patients, but with dementia it becomes very time consuming very quickly.” – Site 101.
Despite these positive attitudes, participants reported many persisting negative attitudes, especially toward the management of dementia medications (whether patients had received a first prescription in primary care or from a specialist):
I have hesitation with the medicine because the effect of this is not so great: side effects are great, and the evidence that it's going to stop the process is very small. So, if a person in my practice is put on medication, it's because the [external memory clinic] says “Yes, they qualify”. So, I kind of let them manage the meds although I always ask question because face it, we need better drugs for it. – Site 103
In addition, participants reported negative attitudes toward making a diagnosis as in they perceived a diagnosis had more dramatic consequences due to their rural situation:
And to be quite honest, because Alzheimer's and dementia is such a devastating diagnosis in the rural area: you have to move, you have to sell your car, you have to sell your house, your family has to come picking at your fortune, right? It's such a devastating diagnosis. I tend to not make that diagnosis myself. […] I have a big problem telling people they have Alzheimer's. […] Because it's a big game changer out where we live. There is no coming back. […]. – Site 103
Finally, when discussing their audit results on referrals to community services and external memory clinics, participants reported that some family physicians in their site kept referring to external memory services because they did not see the added value of the collaborative memory clinic and kept referring to well established and trusted external memory clinics: “I feel like some of our physicians […] don’t feel the [collaborative memory clinic] people are specialists per se. They don’t feel that, perhaps, they are any more trained than they are.” – Site 105.
Third sub-objective: Describe the solutions proposed by the participants to improve dementia care in primary care
When discussing their insights that can explain the audit results, participants offered five solutions to improve dementia care. As depicted by the dash lines in Fig. 1, each organizational factor was linked explicitly during the discussions to one or two organizational solutions. The solutions paralleled the organizational and clinician factors (both organizational and clinician solutions were offered) and two solutions (i.e., training and tools to support documentation) led to specifications on their delivery.
Financial incentives to support dementia care in primary care in general (organizational solution)
In response to the perceived lack of resources, some participants suggested additional funds for dementia care, in the form of financial incentives. This would in turn improve their audit results as they relate to quality of follow-up, diagnosis, and number of visits: “I mean money’s always good. (laughs) Like in terms of, like, physician compensations, [it’s] not great for the [collaborative memory clinic], right?” – Site 108.
These financial incentives, some participants reflected, would allow hiring more nurses or other health professionals to address dementia care specifically, or expand the role of existing resources, such as nurses dedicated to other chronic diseases.
So, if a nurse does a cognitive test because her salary comes from the family health team, but she does cognitive tests and does care on one of my patients, I can’t bill any funding to that because the government already paid her salary to do that. – Site 102
Clear pathway across dementia care services, including within their primary care site as well as with external memory clinics and community services (organizational solution)
With the variety of available services internal or external to their site, such as collaborative memory clinics, embedded-assessors, and/or external memory clinics, some sites witnessed confusion in the process of referring and following-up on the care of persons with dementia. To ensure integration of all services, participants suggested creating clear pathways:
So, why couldn't each of the clinics, so the [collaborative memory clinic], the [external memory clinics], give a criterion to the physicians and nurse practitioners to say like an algorithm. So, if your patient presents with A, B and C, they go to the  memory clinic. If they present [with E, D, and F], they go to [external memory clinic]. – Site 106
This idea has been already implemented successfully in some sites where many services are already available and referred to it as a “triage system” (Site 105) in a referral form. These pathways, the participants suggested, would support links with community services and external memory clinics to improve quality of follow-up and referrals to memory clinics.
Improve chart documentation and use of prompts in patients’ charts (organizational solution)
To improve their link with both community services and external memory clinics, participants suggested that tools to support chart documentation, such as prompts, be used. This would in turn improve the quality of the follow-up and referrals to external memory clinics. Participants acknowledged the necessity of further financial resources: “If it happens without me thinking about it. […] Right, if it was like an automatic tick box: ‘yes, we need to bring the Alzheimer’s society in somehow’. […] Someone makes sure Alzheimer’s society is called.” – Site 103.
Training for dementia in primary care, especially for management of dementia medications (clinician solution)
Training, especially on medications, was one of the most expressed needs/solutions across sites. According to participants, not all family physicians feel competent to manage medications. The participants mentioned that training could take the form of an expert who visit the site and discuss their concerns:
For me, it would probably be more around the medications, and you know, what to follow-up on and how often we have to. […] The medication monitoring - to get me more comfortable dealing with that. Like I don't think it's the diagnosis part. – Site 104
In addition, the participants suggested that training could happen through the exchange of expertise among family physicians within their site, akin to the idea of a community of practice.
However, some participants expressed that training a champion might be time consuming and rather suggested that the responsibility and expertise be shared among all family physicians and nurse practitioners in their site:
The other issue is if you have a physician champion, you know, how do you find someone who’s going to be engage in each group, who has the time to do that, because they also have their own practice usually and I would think that that would be, that could be a challenge in a lot of groups, there may be some groups where they’re fortunate and have a particular physician who has a keen interest in doing that but I think there’s going to be a lot of groups where you’re going to have trouble finding someone who’s going to take on that role. – Site 102
Or another way to do that is to raise the knowledge and the capacity, the competency of all physicians and nurses, and NPs. – Site 101
Benchmarking with other primary care sites (clinician solution)
Participants expressed that the A&F process was insightful and that they would appreciate sharing with other sites their experiences with dementia care or their innovations to improve dementia care. They expressed wanting to learn about the successes and challenges of other clinics: “Because we don’t know what other people are doing, so it’s interesting to know [what] other people are thinking.” – Site 107.
The primary care clinicians, managers, and staff participating in the focus group discussed many audit results, shared their insights on multiple organizational and clinician factors that could explain their results and proposed solutions aligned to their insights. The insights and solutions were nuanced with contextual details to make the models of dementia care sustainable or to scale-up and disseminate these models to other interdisciplinary primary care sites.
Although many of the audit results discussed by the participants referred to physicians’ activities (i.e., diagnosis, referrals to external memory clinics, medications), possibly due to the fact that there were more physicians than other healthcare professionals taking part in the discussions, activities shared with other health care professionals (especially the quality of follow-up: with cognitive testing, functional status, caregiver’s needs, Alzheimer’s societies, and home care services) also solicited their fair share of discussion. This may reflect the general willingness of the participants to collaborate within an interdisciplinary practice .
During the discussion, the participants shared their insights on the factors that could explain their audit results, which in turn, facilitated the identification of possible solutions and areas of improvement in dementia care and their dementia care model. Such a reflective practice allowed the participants to take a logical approach to finding solutions .
The solutions generated by the participants echoed the same two levels as the factors they perceived as explaining their results. Both organizational- and clinician-level solutions were offered for the organizational and clinician factors, suggesting that their insights and solutions are well aligned to one another. Yet, many of the solutions proposed have already been explored in the literature.
For instance, clear pathways across dementia services to provide integrated care with a clear knowledge of who does what, when and where is indeed essential for quality of care . Integration of care with external services is in line with the Canadian dementia guidelines, which posits primary care at the heart of dementia care, with specialists and tertiary care services as essential support when needed. Agreements and clear pathways facilitate specialists’ and community services’ support to primary care clinicians . Similarly, financial incentives for dementia care have been associated with improved dementia care . Training, especially in the form of interactive, repeated discussions between academic groups, professional associations and healthcare institutions, has been shown to improve care . Furthermore, training could promote a positive shift in the attitudes of clinicians [35, 36]. A&F and benchmarking have been shown to have a positive impact on clinical practice . Through increased awareness and motivation , benchmarking could lead to better detection, diagnosis, and management of dementia in primary care and improved overall dementia care. And finally, chart documentation tools, such as prompts, are essential to interdisciplinarity by increasing awareness , decision-making and communication , which in turn improves quality of care [31, 39]. Electronic chart reminders, indeed, may require higher resources for their implementation (e.g., funds, time, training), but may also lead to high return on investment . Furthermore, they have been shown to improve adherence to guidelines, and thus improve quality of care, especially if an action-response is solicited from the clinicians [41,42,43]. Chart documentation also supports the integration of appropriate care pathways through complete, detailed, accurate and comprehensive referrals, to ultimately improve the quality of care .
However, despite this knowledge, family physicians are still perceiving low levels of competency for managing medications and despite past financial support, human resources are still lacking, and nurses and other health professionals’ roles is till limited to support the diagnosis and ensure the quality of follow-up. This could mean that new solutions or specifications to these solutions need to be explored. One of these specifications on a known solution was offered by the participants of our study, namely training a group of family physicians and nurse practitioners instead of limiting the training to a champion.
Some solutions were linked with multiple factors, which were in turn linked to multiple audit results. Therefore, targeting these solutions that affect multiple factors and multiple results may have more significant impact.
Finally, attitude, a factor explicitly linked to several audit results by the participants, was only loosely linked with one solution: benchmarking. No clear link appears to be established between benchmarking and attitudes improvement in the literature. Yet, it could be a vector of change through self-reflection benchmarking elicits , similarly to what has been previously demonstrated with reflective practice [46, 47]. Benchmarking often yield known solutions, as per our participants offered, but has been shown to renew healthcare professionals’ interest, foster a competitive spirit and promote active engagement . Nonetheless, the loose link between attitudes and benchmarking by the participants of our study may explain persistent negative attitudes among some primary care clinicians.
Strengths and limitations
We used a causal pathway models’ theory to describe the participants’ responses when presented with results and how these relate to the solutions they propose. Linking solutions to insights and results increases the likelihood that the solutions proposed by the participants achieve actual change and is most informative of how to improve the models of care implemented [26, 49]. Our study is a first attempt at linking results, insights, and solutions. As more studies are published, aligning solutions to insights may increase the success of these solutions to improve practices in dementia care . Furthermore, our study supported a variety of models of dementia care in primary care, and fostered solutions potentially adaptable to more than one model . Finally, we followed several strategies to ensure trustworthiness (credibility, transferability, dependability, and confirmability) of our study .
On the other end, our study has limitations that require attention. The choice of the sites and the focus group method had influence over what the participants reported. We purposely chose interdisciplinary primary care sites that had previously implemented an innovative primary dementia care model, were knowledgeable about existing dementia guidelines, and were motivated to improve dementia primary care. As such, our study may not be transferable to primary care sites that have not yet implemented a dementia care model for their practice.
The choice of focus group methods also influenced what the participants discussed. By grouping managers, physicians, other health professionals, along with administrative staff, may have prevented some to share their concerns openly. However, focus groups support a broad perspective exchange that is validating for the participants , and foster a common ground to facilitate organizational change , thus enriching our study. Other methods of data collection (e.g., ethnographic studies) may bring forth different and complementary information.
Similarly, the fact that there were more family physicians who took part in the discussions, may have skewed the discussions toward one group’s interests over the others. However, many of the discussed audit results concerned the activities of other health professionals, such as nurses, occupational therapists, and social workers, not just family physicians.
As we wanted to avoid power imbalance, we did not invite decision makers to the feedback and focus group discussions. This may explain why participants did not explain their audit results or offer solutions at the system level. Excluding external decision makers, however, allowed for more open discussions among the primary care members. Solutions for the improvement of dementia care models implemented occurring at multiple levels – at the clinician, the organization, and the system level – may have a wider and deeper reach . Future studies could consider including external peers in the discussion groups. Future research may also consider using different data collection methods, such as ethnographic observational studies or including decision makers or external peers in the discussion, to offer more diverse perspectives, not limited to the participants’ reporting.
Another limitation is that we only used audio recordings, which limited our capacity to differentiate the participants within each focus group. However, given that our unit of analysis was the focus group and not the individuals participating, this limitation did not have an impact on our analysis.
Overall, participants from the eight Ontario primary care sites that had implemented a dementia care model offered a rich array of solutions to improve dementia care in their practice. These solutions were explicitly linked to the participants’ insights into the factors that explain their audit results. The deep and nuanced solutions offered in our study could guide decision makers to better support sustainable primary care sites in improving dementia care. This is especially important for government-level decision makers when considering the implementation of an Alzheimer Plan, such as the Ontario Alzheimer Plan or the Canadian Dementia Strategy.
Availability of data and materials
The datasets used and/or analysed during the current study are available from the corresponding author or the last authors on reasonable request.
Audit and feedback
Canadian Institutes of Healthcare Research
Canadian Consortium on Neurodegeneration in Aging
Knowledge, attitudes, and practices
Behavioral and Psychological Symptoms in Dementia
Electronic medical records
Public Health Agency of Canada. A Dementia Strategy for Canada: Together We Aspire. 2019. Available from: https://www.canada.ca/content/dam/phac-aspc/images/services/publications/diseases-conditions/dementia-strategy/National%20Dementia%20Strategy_ENG.pdf. Accessed 4 Dec 2019.
Bergman H. Report of the Committee of Experts for the Development of an Action Plan on Alzheimer’s Disease and Related Disorders. 2009. [Available from: https://www.mcgill.ca/geriatrics/files/geriatrics/qap_english.pdf. Accessed 4 Mar 2022.
Ismail Z, Black SE, Camicioli R, Chertkow H, Herrmann N, Laforce R Jr, et al. Recommendations of the 5th Canadian Consensus Conference on the diagnosis and treatment of dementia. Alzheimers Dement. 2020;16(8):1182–95.
Gauthier S, Patterson C, Chertkow H, Gordon M, Herrmann N, Rockwood K, et al. Recommendations of the 4th Canadian Consensus Conference on the Diagnosis and Treatment of Dementia (CCCDTD4). Can Geriatrics J. 2012;15(4):120.
Moore A, Frank C, Chambers LW. Role of the family physician in dementia care. Can Fam Physician. 2018;64(10):717.
Arsenault-Lapierre G, Henein M, Rojas-Rozo L, Sourial N, Bergman H, Couturier Y, et al. Primary care clinicians' knowledge, attitudes, and practices concerning dementia: They are willing and need support. Canadian family physician Medecin de famille canadien. 2021;67(10):731-5. https://doi.org/10.46747/cfp.6710731.
Lee L, Weston WW, Hillier LM. Developing memory clinics in primary care: an evidence-based interprofessional program of continuing professional development. J Contin Educ Heal Prof. 2013;33(1):24–32.
Pimlott NJG, Persaud M, Drummond N, Cohen CA, Silvius JL, Seigel K, et al. Family physicians and dementia in Canada: Part 2. Understanding the challenges of dementia care. Can Fam Phys Med. 2009;55(5):508–9.e97.
Boise L, Camicioli R, Morgan DL, Rose JH, Congleton L. Diagnosing dementia: perspectives of primary care physicians. Gerontologist. 1999;39(4):457–64.
Connell CM, Boise L, Stuckey JC, Holmes SB, Hudson ML. Attitudes toward the diagnosis and disclosure of dementia among family caregivers and primary care physicians. Gerontologist. 2004;44(4):500–7.
Pimlott NJG, Persaud M, Drummond N, Cohen CA, Silvius JL, Seigel K, et al. Family physicians and dementia in Canada: Part 1. Clinical practice guidelines: awareness, attitudes, and opinions. Can Fam Phys Med. 2009;55(5):506–7.e75.
Powell BJ, Waltz TJ, Chinman MJ, Damschroder LJ, Smith JL, Matthieu MM, et al. A refined compilation of implementation strategies: results from the Expert Recommendations for Implementing Change (ERIC) project. Implement Sci. 2015;10(1):21.
Ivers N, Jamtvedt G, Flottorp S, Young JM, Odgaard‐Jensen J, French SD, O'Brien MA, Johansen M, Grimshaw J, Oxman AD. Audit and feedback: effects on professional practice and healthcare outcomes. Cochrane Database Syst Rev. 2012;(6):CD000259. https://doi.org/10.1002/14651858.CD000259.pub3.
Foy R, Skrypak M, Alderson S, Ivers NM, McInerney B, Stoddart J, et al. Revitalising audit and feedback to improve patient care. Bmj. 2020;368:m213.
Rowan MS, Hogg W, Martin C, Vilis E. Family physicians' reactions to performance assessment feedback. Can Fam Physician. 2006;52(12):1570–1.
Lopez-Campos JL, Asensio-Cruz MI, Castro-Acosta A, Calero C, Pozo-Rodriguez F, Audipoc, et al. Results from an audit feedback strategy for chronic obstructive pulmonary disease in-hospital care: a joint analysis from the AUDIPOC and European COPD audit studies. PLoS One. 2014;9(10):e110394.
Millard FB, Thistlethwaite J, Baune BT, Kennedy RL, Spagnolo C. Dementia diagnosis: a pilot randomised controlled trial of education and IT audit to assess change in GP dementia documentation. Austr J Primary Health. 2008;14(3):141–9.
Colquhoun H, Michie S, Sales A, Ivers N, Grimshaw JM, Carroll K, et al. Reporting and design elements of audit and feedback interventions: a secondary review. BMJ Qual Saf. 2017;26(1):54–60.
Pedersen MS, Landheim A, Møller M, Lien L. Audit and feedback in mental healthcare: staff experiences. Int J Health Care Qual Assur. 2018;31(7):822–33.
Stausmire JM, Ulrich C. Using SQUIRE 2.0 as a guide for planning your quality improvement project. Crit Care Nurse. 2017;37(6):72–80.
Vedel I, McAiney C, Couturier Y, Pakzad S, Arsenault-Lapierre G, Godard-Sebillotte C, et al. Assessing care models implemented in primary healthcare for persons with dementia: a mixed-methods study protocol. BMJ Open. 2020;10(5):e035916.
Arsenault-Lapierre G, Sourial N, Pakzad S, Hardouin M, Couturier Y, Bergman H, Vedel I. Validation of a Questionnaire for Family Physicians: Knowledge, Attitude, Practice on Dementia Care. Can J Aging / La Revue Canadienne Du Vieillissement. 2021;40(2):238-47. https://doi.org/10.1017/S0714980820000069.
Hsieh H-F, Shannon SE. Three approaches to qualitative content analysis. Qual Health Res. 2005;15(9):1277–88.
Boyatzis RE. Transforming qualitative information: Thematic analysis and code development: SAGE; 1998.
Attride-Stirling J. Thematic networks: an analytic tool for qualitative research. Qual Res. 2001;1(3):385–405.
Lewis CC, Klasnja P, Powell BJ, Lyon AR, Tuzzio L, Jones S, et al. From Classification to Causality: Advancing Understanding of Mechanisms of Change in Implementation Science. Front Public Health. 2018;6. https://doi.org/10.3389/fpubh.2018.00136
Nowell LS, Norris JM, White DE, Moules NJ. Thematic Analysis:Striving to Meet the Trustworthiness Criteria. Int J Qual Methods. 2017;16(1):1609406917733847.
Canadian Interprofessional Health Collaborative. A national Interprofessional competency framework. 2010. Available from: https://www.cihccpis.com/publications1.html. Accessed 4 Mar 2022.
Roston TM, Dewar L, Franciosi S, Hathaway J, Bartels K, Cunningham T, et al. The accessibility and utilization of genetic testing for inherited heart rhythm disorders: a Canadian cross-sectional survey study. J Commun Genet. 2018;9(3):257–62.
Cole M. Reflection in healthcare practice: Why is it useful and how might it be done? Work Based Learn Primary Care. 2005;3:13–22.
Keenan GMYE, Tschannen D, Mandeville M. Chapter 49: Documentation and the Nurse Care Planning Process. In: RGH, editor. Patient Safety and Quality: An Evidence-Based Handbook for Nurses. Rockville (MD): Agency for Healthcare Research and Quality (US); 2008.
Threapleton DE, Chung RY, Wong SYS, Wong E, Chau P, Woo J, et al. Integrated care for older populations and its implementation facilitators and barriers: A rapid scoping review. Int J Qual Health Care. 2017;29(3):327–34.
Fox C, Maidment I, Moniz-Cook E, White J, Thyrian JR, Young J, et al. Optimising primary care for people with dementia. Ment Health Fam Med. 2013;10(3):143–51.
Rampatige R, Dunt D, Doyle C, Day S, van Dort P. The effect of continuing professional education on health care outcomes: lessons for dementia care. Int Psychogeriatr. 2009;21(S1):S34–43.
Scerri A, Scerri C. Outcomes in knowledge, attitudes and confidence of nursing staff working in nursing and residential care homes following a dementia training programme. Aging Ment Health. 2019;23(8):919–28.
Surr CA, Smith SJ, Crossland J, Robins J. Impact of a person-centred dementia care training programme on hospital staff attitudes, role efficacy and perceptions of caring for people with dementia: A repeated measures study. Int J Nurs Stud. 2016;53:144–51.
Lanham HJ, Leykum LK, McDaniel RR Jr. Same organization, same electronic health records (EHRs) system, different use: exploring the linkage between practice member communication patterns and EHR use patterns in an ambulatory care setting. J Am Med Inform Assoc. 2011;19(3):382–91.
Davidson N, Egbert K, Merchant M, Padgette D, Rankine K. An Interdisciplinary Documentation Performance Improvement Project. J Nurses Prof Dev. 2004;20(5):236–41.
Børmark SR. Interdisciplinary Documentation of Health Care in the Electronic Health Record (EHR): Exploring Information Flow and Overlap. Oslo, Norway: University of Oslo Norway; 2014.
Wang TB, Sue E. Running the Numbers on an EHR: Applying Cost-Benefit Analysis in EHR Adoption. J AHIMA. 2010;81(8):32–6.
Shojania KG, Jennings A, Mayhew A, Ramsay C, Eccles M, Grimshaw J. Effect of point-of-care computer reminders on physician behaviour: a systematic review. Can Med Assoc J. 2010;182(5):E216–E25.
Pereira JA, Quach S, Heidebrecht CL, Quan SD, Kolbe F, Finkelstein M, et al. Barriers to the use of reminder/recall interventions for immunizations: a systematic review. BMC Med Inform Decision Making. 2012;12(1):145.
Holt TA, Thorogood M, Griffiths F. Changing Clinical Practice Through Patient Specific Reminders Available at the Time of the Clinical Encounter: Systematic Review and Meta-Analysis. J Gen Intern Med. 2012;27(8):974–84.
Häyrinen K, Saranto K, Nykänen P. Definition, structure, content, use and impacts of electronic health records: A review of the research literature. Int J Med Inform. 2008;77(5):291–304.
Yang L-Y, Yang Y-Y, Huang C-C, Liang J-F, Lee F-Y, Cheng H-M, et al. Simulation-based inter-professional education to improve attitudes towards collaborative practice: a prospective comparative pilot study in a Chinese medical centre. BMJ Open. 2017;7(11):e015105.
Asselin ME, Fain JA. Effect of Reflective Practice Education on Self-Reflection, Insight, and Reflective Thinking Among Experienced Nurses: A Pilot Study. J Nurses Prof Dev. 2013;29(3):111–9.
Buckley S, Coleman J, Davison I, Khan KS, Zamora J, Malick S, et al. The educational effects of portfolios on undergraduate student learning: A Best Evidence Medical Education (BEME) systematic review. BEME Guide No. 11. Med Teach. 2009;31(4):282–98.
Ettorchi-Tardy A, Levif M, Michel P. Benchmarking: a method for continuous quality improvement in health. Healthcare Policy. 2012;7(4):e101–e19.
Gaugler JE, Gitlin LN, Zimmerman S. Aligning Dementia Care Science With the Urgent Need for Dissemination and Implementation. J Am Med Dir Assoc. 2021;22(10):2036–8.
Rideout K, Oickle D, Clement C. Can focus groups be a tool for change? Introducing health equity to environmental public health practice. Environ Health Rev. 2016;59(4):113–6.
Morgan DL. Focus groups as qualitative research. Thousand Oaks: Sage Publications; 1997.
Paskett E, Thompson B, Ammerman AS, Ortega AN, Marsteller J, Richardson D. Multilevel Interventions To Address Health Disparities Show Promise In Improving Population Health. Health Aff (Millwood). 2016;35(8):1429–34.
This work would not have been possible without a team of hard-working research assistants, students, and administrative coordinators. Thus, we would like to acknowledge Deana Huntsbarger, Carolee Awde, Lucie Vaillancourt, Mary Henein, and Erin Ferrier for helping with data collection and Juliette Champoux-Pellegrin for help with general editing. We would like to extend our acknowledgments to an onsite research nurse and an information technology support who contributed just equally but cannot be named to protect the identity of the people involved in the research. Finally, we want to thank all the primary care teams, their managers, clinicians, and support staff, for participating in our study. Thank you for sharing with us all these important messages.
This work was funded by the Canadian Consortium on Neurodegeneration in Aging (2014–2019) (CCNA- 137794). The Canadian Consortium on Neurodegeneration in Aging is supported by a grant from the CIHR with funding from several partners.
Ethics approval and consent to participate
This project was reviewed and approved by the Hamilton Integrated Research Ethics Board (project #2017-2224) and the University of Waterloo’s Office of Research Ethics (project #40866). Written consent was obtained from each participant to the focus groups, after receiving an explanation of the study and its objective. No administrative permissions were required to access and use the datasets/charts/medical records in the current study.
Consent for publication
None of the authors have competing interests to declare.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Arsenault-Lapierre, G., Le Berre, M., Rojas-Rozo, L. et al. Improving dementia care: insights from audit and feedback in interdisciplinary primary care sites. BMC Health Serv Res 22, 353 (2022). https://doi.org/10.1186/s12913-022-07672-5
- Primary Care
- Practice Guideline
- Medical Audit
- Quality Improvement
- Interdisciplinary Health Team