Monitoring Community Pharmacist's Quality of Care: A feasibility study of using pharmacy claims data to assess performance
© Winslade et al; licensee BioMed Central Ltd. 2011
Received: 15 September 2010
Accepted: 18 January 2011
Published: 18 January 2011
Public pressure has increasingly emphasized the need to ensure the continuing quality of care provided by health professionals over their careers. Health profession's regulatory authorities, mandated to be publicly accountable for safe and effective care, are revising their quality assurance programs to focus on regular evaluations of practitioner performance. New methods for routine screening of performance are required and the use of administrative data for measuring performance on quality of care indicators has been suggested as one attractive option. Preliminary studies have shown that community pharmacy claims databases contain the information required to operationalize quality of care indicators. The purpose of this project was to determine the feasibility of routine use of information from these databases by regulatory authorities to screen the quality of care provided at community pharmacies.
Information from the Canadian province of Quebec's medication insurance program provided data on prescriptions dispensed in 2002 by more than 5000 pharmacists in 1799 community pharmacies. Pharmacy-specific performance rates were calculated on four quality of care indicators: two safety indicators (dispensing of contra-indicated benzodiazepines to seniors and dispensing of nonselective beta-blockers to patients with respiratory disease) and two effectiveness indicators (dispensing asthma or hypertension medications to non-compliant patients). Descriptive statistics were used to summarize performance.
Reliable estimates of performance could be obtained for more than 90% of pharmacies. The average rate of dispensing was 4.3% (range 0 - 42.5%) for contra-indicated benzodiazepines, 15.2% (range 0 - 100%) for nonselective beta-blockers to respiratory patients, 10.7% (range 0 - 70%) for hypertension medications to noncompliant patients, and 43.3% (0 - 91.6%) for short-acting beta-agonists in over-use situations. There were modest correlations in performance across the four indicators. Nine pharmacies (0.5%) performed in the lowest quartile in all four of the indicators, and 5.3% (n = 95) performed in the lowest quartile on three of four indicators.
Routinely collected pharmacy claims data can be used to monitor indicators of the quality of care provided in community pharmacies, and may be useful in future to identify underperforming pharmacists, measure the impact of policy changes and determine predictors of best practices.
Although medications are a mainstay of modern medical treatment, their use is associated with both benefit and harm [1–3]. Preventable drug-related morbidity and mortality (DRM) now accounts for 8% to 23% of hospital admissions in seniors [4–6]. In North America in the early 1990's, professional pharmacy organizations recognized the extent of this problem and recommended that pharmacists expand their role to include a focus on minimizing preventable DRM [7–9]. This recommendation was based on the assertion that pharmacists are both educated to manage patients' drug-therapy problems and readily accessible within the majority of communities in North America. Indeed, the average Canadian adult visits a community pharmacy once or twice per month . This situation provides an ideal opportunity for community pharmacists to minimize patient's preventable DRM.
As pharmacists have incorporated this role of minimizing DRM into their practice, university-based educational programs have been modified to emphasize these responsibilities and standards of practice have been revised [11, 12]. Increasing public emphasis on the need for assurance that health practitioners remain competent to provide quality care through out their careers has lead pharmacy regulatory authorities to update their programs for monitoring pharmacist's performance to ensure compliance with these revised standards of practice [personal communications Quebec Order of Pharmacists and Nova Scotia College of Pharmacists]. These quality assurance programs are being updated based on modern frameworks for regulatory review that include proactive routine surveillance of practice performance, followed by more in-depth assessment of potentially under-performing practices [13–16]. Such frameworks acknowledge the collaborative nature of current health care provision and that the quality of care provided by the health care team is dependent on the quality of care provided by each team member [14, 17]. These frameworks are appropriate for use in community pharmacies, where multiple pharmacists and pharmacy technicians contribute to the care and services provided to an individual patient [18, 19]. Therefore, the proactive surveillance phase of regulatory programs recommended for community pharmacists measures performance on a pharmacy-specific basis rather than on a pharmacist-specific basis .
Indicators are being developed to conduct routine surveillance of the quality of care provided in community pharmacies . To maximize efficiency, it has been recommended that performance on these indicators be assessed using pharmacy claims data that are routinely collected as part of daily provision of medications and services [14, 20]. Preliminary studies have shown that the data required to measure performance on these indicators is available in pharmacy claims databases and that pharmacists find comparative performance information useful . What remains to be evaluated is whether routine use of information from these databases to measure performance at community pharmacies is feasible. Feasibility can be determined by evaluating whether the database-derived performance measures meet the key requirements for use by regulatory authorities for quality assurance. Specifically, the target services need to be routinely provided at the majority of community pharmacies, care must be appropriately attributed, and there must be sufficient variability in performance across community pharmacies to warrant surveillance .
The purpose of this project was to determine the feasibility of routine use of information from these databases by regulatory authorities to screen the quality of care provided at community pharmacies.
This study was conducted in the Canadian province of Quebec where the Order of Pharmacists, the governmental regulatory authority responsible for licensing pharmacists, monitors the performance of more than 5000 community pharmacists in 1800 community pharmacies. These pharmacists serve a population of 7.4 million patients, of whom approximately 50% receive government support for payment of their medications via the publicly-funded insurance program (Régie de l'assurance maladie du Québec - RAMQ). Similar to public and private insurance programs in the rest of the Canadian provinces and American states, medication-related data maintained by RAMQ for insured patients includes payments made for each dispensing of a reimbursable medication, the date, the name, strength, dosage form and quantity of the dispensed medication, and prescriber, pharmacist and pharmacy identification. Reimbursable medications include over 85% of medications available in Canada. In Quebec, medication supply policies support dispensing of chronic medications on a 30 day interval rather than encouraging a 90 day dispensing interval. Although this policy provides more opportunities for pharmacists to detect and intervene on medication use problems, dispensing on either a 30 day or 90 day interval provides regulatory authorities with the data required to measure performance on quality of care indicators.
To assess the quality of care provided at community pharmacies, we used a random sample of 1.4 million patients who received medications from community pharmacies between January and December 2002. In addition to the routine medication-related information, for each dispensing a unique anonymized identifier was provided by RAMQ for each patient, prescriber and dispensing pharmacy. These unique identifiers were used to develop a longitudinal prescription history for each patient and a practice population for each pharmacy that could be used to measure quality of performance on each indicator on a pharmacy-specific basis. Ethics approval was obtained from the McGill Faculty of Medicine Institutional Review Board.
The feasibility of using pharmacy claims data to evaluate performance was assessed by calculating pharmacy-specific performance on four quality of care indicators and determining whether results met requirements for use for high-stakes decisions by regulatory authorities . Specifically we evaluated the proportion of community pharmacies where provision of services was frequent enough to allow reliable assessment on the performance indicators, the variability of performance across pharmacies and the proportion of pharmacies where performance was systematically poor on multiple indicators, indicating a need for further evaluation.
Selection and Measurement of Indicators
Quality of Care Indicators for Community Pharmacists
Beta Blockers in Respiratory Patients
Recommended Care: Patients receiving a SABA should not receive nonselective beta-blockers (NSBB)
Measure: proportion of dispensings of beta-blockers to patients dispensed SABA that are for NSBB*
Denominator: # of dispensings of oral beta-blockers (selective or nonselective) to patients who received a SABA from any pharmacy within the previous 6 months (including dispensing on the same day)
Numerator: # of dispensings of oral NSBB to patients who were dispensed a SABA from any pharmacy within the previous 6 months (including dispensing on the same day)
Benzodiazepines in the Elderly
Recommended Care: seniors requiring a benzodiazepine should not receive long acting agents (flurazepam)
Measure: proportion of dispensings of benzodiazepines to patients >65 years old that are for flurazepam*
Denominator: # of dispensings of benzodiazepines to patients >65 years old
Numerator: # of dispensings of flurazepam to patients >65 years old
Over-use of Asthma Medications
Recommended Care: patients should not use more than 250 doses of SABA in a 90 day period
Measure: proportion of dispensings of SABA that are provided to patients who had used more than 250 doses of these rescue medications over the previous 90 days*
Denominator: # of dispensings of inhaled SABA
Numerator: # of dispensings of an inhaled SABA that were provided to a patient who had been dispensed more than 250 doses of this same SABA from any pharmacy within the previous 90 days
Under-use of Anti-hypertensives
Recommended Care: patients should take at least 80% of their medication prescribed for hypertension
Measure: proportion of dispensings of anti-hypertensive medications that are provided to patients who had received <80% of their required supply of antihypertensive medications over the previous 90 days*
Denominator: # of dispensings of any blood pressure medications
Numerator: # of dispensings of any blood pressure medications that were to patients who had received <80% of the prescribed amount of any blood pressure medications over the previous 90 days from any pharmacy
Number of dispensings was counted in the numerator and denominator because the number of dispensings provided the best measure of the opportunity for community pharmacists to detect and intervene on medication-use problems. For example, for the indicator evaluating non-compliance with anti-hypertensive medications, pharmacists had the opportunity to detect non-compliance each time a patient returned to the pharmacy for a refill of his/her medication. Therefore, each dispensing to a non-compliant patient represented an opportunity for intervention by the pharmacist.
Pharmacy-specific performance on each quality indicator was calculated using dispensings of medications from all community pharmacies. All dispensings were included because pharmacists are expected to inquire about all prescription therapies including dispensings from other pharmacies. Operationally this meant that for the dispensing of concomitant non-selective beta-blockers and inhaled short acting beta agonists (SABA), the medications could be dispensed from two different pharmacies and the performance was attributed to the pharmacy dispensing the non-selective beta-blocker to the patient. For the over-use of SABA and non-compliance with anti-hypertensive medications, all SABA's and anti-hypertensives dispensed to the patient from all pharmacies were counted. As medication discontinuation and switching are not well documented in databases and are common in management of hypertension, the inclusion of all anti-hypertensives allowed us to eliminate the problems of over-estimation of non-compliance due to switching or changing dose of anti-hypertensive medications.
To ensure stable estimates of performance we required pharmacists at each pharmacy to dispense the relevant medication to the at-risk population (i.e. denominator group) five or more times over the one year period . Such cut offs are recommended for use in measures of physician performance to improve the reliability of estimated performance while ensuring that potential poor-performers who provide a low volume of service are not excluded from evaluations [22, 24].
To evaluate whether the performance on the quality indicator met the requirements established by regulatory authorities, we first determined the number of pharmacies where pharmacists provided the service frequently enough for reliable performance estimates to be calculated. We then used univariate statistics and the coefficient of variation to examine the distribution of the quality of performance across pharmacies. To determine if performance on one indicator influenced performance on another indicator, we estimated the Spearman Rank Order Correlation among indicators using the pharmacy as the unit of analysis. To estimate the proportion of pharmacies that would be in the worst-performing quartile in all indicators, and would likely be targeted for regulatory review, we cross tabulated performance by quartile on the four performance indicators.
Characteristics of Pharmacy Practice Population (N = 1,427,325 patients)
Medications per year ‡
Dispensings per year §
Health Services Use
Prescribing physicians per year
Dispensing pharmacies per year
Patients receiving all medications & services from a single pharmacy per year
Population Prevalence of Quality of Care Problems
N (N at-risk)
Medication Safety Indicators
Seniors receiving flurazepam
Patients receiving non-selective beta blockers and SABA
Medication Effectiveness Indicators
Patients over-using SABA
Patients under-using anti-hypertensives
Breadth and Frequency of Service Provision
Pharmacy-Specific Performance on Quality of Care Indicators
Breadth/Frequency of Performance
Pharmacy-Specific Performance on Quality of CareIndicators
Pharmacies dispensing 5 or more times per year
Dispensings per year (N = 54,045,097)
Mean Annual Pharmacy-specific Rate of Inappropriate Dispensings
Dispensings of benzodiazepines to seniors
Seniors receiving flurazepam
Dispensings of beta-blockers to patients taking SABA
Patients receiving non-selective beta blockers and SABA
Dispensings of SABA
Patients over-using SABA
Dispensing of anti-hypertensive medications
Patients under-using hypertension medications
Overall quality and variability in service provision
Overall the quality of performance was better for the medication-safety indicators than for the medication-effectiveness indicators (Table 3). The worst performance on the four quality of care indicators was exhibited for the SABA over-use indicator. On average, across all pharmacies, 43.3% dispensings of SABA were to patients who had over-used these medications within the previous 90 days. Performance on the medication-safety indicator measuring pharmacist dispensing of flurazepam to seniors was the best with, on average, 4.3 percent of benzodiazepine dispensings to seniors being for flurazepam.
Performance across indicators
Among the 1799 pharmacies, 86% provided a sufficient number of services to assess performance on all four indicators. The rank order correlation among indicators was modest, varying from -0.01 (nonselective beta-blockers concomitant with SABA and over-use of SABA) to a high of -0.13 (over-use of SABA and under-use of anti-hypertensive medications).
Nine pharmacies performed in the lowest quartile on all four indicators, with an additional 95 pharmacies performing in the lowest quartile on three of four indicators. These pharmacies represent those that, in all likelihood, would be targeted for further evaluation by regulatory authorities. By contrast, three pharmacies were in the top quartile for all four indicators with another 79 pharmacies in the top quartile for three of four indicators. These pharmacies would be useful to determine predictors of best practice.
This study evaluated all 1800 community pharmacists providing medications to 1.4 million people within the jurisdiction of one regulatory authority in Canada. We found that performance at community pharmacies could be measured on four quality of care indicators using pharmacy claims data. Over 85% of pharmacies provided services frequently enough to be reliably assessed on all four indicators. Proactive surveillance documented substantial variability in performance, with the best performance demonstrated on the indicator measuring rates of dispensing of contra-indicated benzodiazepines to the elderly, and the worst performance demonstrated on the dispensing of SABA to patients who were over-using this medication. Pharmacists at 5.3% (95/1799) of pharmacies underperformed on three of the four indicators.
This study is the first to be done in Canada that uses routinely available claims data to evaluate performance at community pharmacies. The PQA in the United States has completed a series of demonstration projects using administrative data from limited numbers of pharmacies (25 to 85 community pharmacies) to evaluate and report on pharmacy-based performance on quality indicators measuring similar medication use-problems . Similar to our results, these projects indicate that pharmacy claims data contain the information necessary to measure a number of quality of care indicators and that performance varies across pharmacies. Direct comparison of our results with those from the demonstration projects is difficult, since limited performance results have been published. However, differences in results are anticipated as our project used different definitions for some indicators. For example, for SABA over-use we used the Canadian guidelines that define over-use as more than 250 doses in 90 days as prior research had shown that overuse of this magnitude is associated with an increased risk of asthma mortality [25–27]. In contrast, the PQA defined over-use as more than 600 doses in 90 days. As a result of these differences in quality definitions, performance results would be worse in our study as compared to in the demonstration projects. To assess differences in jurisdictions and pharmacy policies, it will be essential to use common metrics for quality measurement.
Comparison of our results with those from the demonstration projects is also difficult as the PQA indicators use patients as the unit of analysis where we elected to use dispensings as the unit of analysis. Although number of patients could have been used in our study, by doing so we would have been unable to detect differences in pharmacies where, for example, a patient was compliant for 11 of 12 dispensings as compared to a pharmacy where the patient was compliant for none of the 12 dispensings. If patients had been used as the unit of analysis, both patients would have been classified as non-compliant for the year and the performance of the two pharmacies considered to be equal. To create a more sensitive measure of performance we, therefore, elected to use the number of dispensings as the unit of analysis. Use of dispensings versus patients would also be anticipated to result in a greater variability in performance across pharmacies, whereas use of patients as the unit of analysis would provide an estimate of the impact of pharmacy services in the population. Both approaches will be useful to evaluate in the future.
The results of our work have significant implications for regulatory authorities as the approach of using claims data to measure performance on quality of care indicators appears to be feasible and reveals substantial variability in the quality of care provided at community pharmacies. With greater demand for public accountability for the quality of health professional practice, regulatory authorities are moving from a passive complaints-based process for monitoring to proactive quality assurance. Currently, pharmacy regulatory authorities have adopted very resource-intensive processes such as on-site inspections or competence testing for assessing the quality of practice [28–30]. Given limitations in availability of human resources, such processes are not able to ensure timely detection of potential performance problems that require further investigation. The ubiquitous availability of pharmacy claims data, and ultimately electronic health records, and the reliability of this data provides a new avenue for relatively inexpensive, proactive performance assessment by regulatory authorities . The methodologies for performance monitoring using billing and electronic health record data are being developed in a number of sectors such as pay-for-performance . Pharmacy regulatory authorities will be able to capitalize upon such advances while developing their performance assessment programs. These approaches may also be more acceptable to practitioners since they are based on actual performance data rather than artificial testing or inspection processes .
The main strengths of this study are the large and representative population of pharmacies studied and the measurement of quality indicators in comparable populations. Limitations that should be considered in interpreting the results are that only four indicators were evaluated that may not be representative of a pharmacy's quality of care, and the relationship between performance on the indicator and patient outcome was not ascertained. We were also missing data such as treatment indication, and patient age, sex and socioeconomic status, all of which could influence the types of drugs prescribed and their utilization. In future it would be preferable to retrieve information on these patient-related characteristics to statistically adjust for differences in clientele served by different pharmacies. In addition to these patient characteristics that may affect pharmacy-specific performance, pharmacy-level characteristics have also been shown to relate to the quality of care provided in community pharmacies . Future work should evaluate the influence of these pharmacy-level characteristics, such as pharmacy location, dispensing volume and staffing, on the quality of care provided at community pharmacies.
Our results confirm that patients present to community pharmacies with evidence of well known medication use problems that are related to safe and effective use of medications. Patients at some pharmacies receive superior care and our methodologies could be used to evaluate the patient, pharmacy and prescriber-based characteristics that are associated with better care. There are many changes being made to the way services are being provided in community pharmacies such as regulation of pharmacy technicians, remote dispensing and deregulation of prescription medications. The utilization of pharmacy claims data provides unique opportunities to evaluate the influences of such policy changes.
Routinely collected pharmacy claims data can be used to monitor indicators of quality of pharmacy services, and may be useful in future to identify potentially underperforming pharmacists, measure the impact of policy changes and to determine predictors of best practices.
- Thomsen LAAG, Winterstein B, Søndergaard LS, Haugbølle A, Melander : Systematic review of the incidence and characteristics of preventable adverse drug events in ambulatory care. Annals of Pharmacotherapy. 2007, 41 (9): 1411-26. 10.1345/aph.1H658.View ArticlePubMedGoogle Scholar
- Howard RL, Avery AJ, Howard PD, Partridge M: Investigation into the reasons for preventable drug related admissions to a medical admissions unit: observational study. Qual Safety Health Care. 2003, 12 (4): 280-5. 10.1136/qhc.12.4.280.View ArticleGoogle Scholar
- Manasse HR: Medication use in an imperfect world: drug misadventuring as an issue of public policy, Part 1. Am J Hosp Pharm. 1989, 46 (5): 929-44.PubMedGoogle Scholar
- Zed PJ, Abu-Laban RB, Balen RM, Loewen PS, Hohl CM, Brubacher JR, Wilbur K, Wiens MO, Samoy LJ, Lacaria K, Purssell RA: Incidence, severity and preventability of medication-related visits to the emergency department: a prospective study. CMAJ. 2008, 178 (12): 1563-9.View ArticlePubMedPubMed CentralGoogle Scholar
- Kongkaew C, Noyce PR, Ashcroft DM: Hospital admissions associated with adverse drug reactions: a systematic review of prospective observational studies. Ann Pharmacotherapy. 2008, 42 (7): 1017-25. 10.1345/aph.1L037.View ArticleGoogle Scholar
- Runciman WB, Roughead EE, Semple SJ, Adams RJ: Adverse drug events and medication errors in Australia. Inter J Qual Health Care. 2003, 15 (Supp1): i49-59. 10.1093/intqhc/mzg085.View ArticleGoogle Scholar
- Hepler CD, Strand LM: Opportunities and Responsibilities in Pharmaceutical Care. Am J Pharm Ed. 1989, 53: 7S-5S.Google Scholar
- American Pharmaceutical Association: An APhA White Paper on the Role of the Pharmacist in Comprehensive Medication Use Management: The Delivery of Pharmaceutical Care. 1992, Washington, DC: American Pharmaceutical AssociationGoogle Scholar
- American Society of Hospital Pharmacists: ASHP statement on pharmaceutical care. Am J Hosp Pharm. 1993, 50: 1720-3.Google Scholar
- Tenth Pharmacy Trends Report: Canada's report for pharmacists on professional and business trends. 2003, Accessed August 12, 2010, [http://220.127.116.11/chronic_lobby_category.asp?siteID=273&catId=1637&sub1=2]Google Scholar
- Association of Faculties of Pharmacy of Canada: Educational Outcomes for First Professional Degree Programs in Pharmacy. 2010, accessed on August 11, 2010, [http://afpc.info/downloads/1/AFPC_Education_Outcomes_AGM_June_2010.pdf]Google Scholar
- National Association of Pharmacy Regulatory Authorities: Model Standards of Practice for Canadian Pharmacists. 2009, accessed March 24, 2010, [http://18.104.22.168/Content_Files/Files/Model_Standards_of_Prac_for_Cdn_Pharm_March09.pdf]Google Scholar
- Dauphinee WD: Revalidation of doctors in Canada. BMJ. 1999, 319: 1188-90.View ArticlePubMedPubMed CentralGoogle Scholar
- Winslade N, Tamblyn R, Taylor L, Schuwirth L, Van der Vleuten C: Integrating Performance Assessment, Maintenance of Competence, and Continuing Professional Development of Community Pharmacists. Am J Pharm Ed. 2007, 71 (1): Article 15Google Scholar
- Holmboe ES: Assessment of the Practicing Physician: challenges and opportunities. J Cont Ed Health Prof. 2009, 28 (Suppl 1): S4-10.Google Scholar
- Shaw K, Cassel CK, Black C, Levinson W: Shared Medical Regulation in a Time of Increasing Calls for Accountability and Transparency. JAMA. 2009, 302 (18): 2008-14. 10.1001/jama.2009.1620.View ArticlePubMedGoogle Scholar
- Farmer ED, Beard JD, Dauphinee WD, LaDuca T, Mann KV: Assessing the performance of doctors in teams and systems. Medical Education. 2002, 36: 942-948. 10.1046/j.1365-2923.2002.01311.x.View ArticlePubMedGoogle Scholar
- Neslon AR, Zelnio RN, Beno CE: Clinical pharmaceutical services in retail practice II. Factors influencing the provision of services. Drug Intell Clin Pharm. 1984, 18 (12): 992-6.Google Scholar
- Ruston A: Achieving re-professionalization: factors that influence the adoption of an 'extended role' by community pharmacists. A national survey. J Soc Admin Pharm. 2001, 18: 103-10.Google Scholar
- Pharmacy Quality Alliance: PQA-Endorsed Starter Set of Measures. 2006, accessed August 13, 2010, [http://www.pqaalliance.org/files/PQAMeasureDescriptionsForDemonstrations.pdf]Google Scholar
- Pharmacy Quality Alliance: Highlights from the Five Phase I Demonstration Projects. 2009, Accessed August 12, 2010, [http://www.pqaalliance.org/files/PQACombined5DemoProjectsTemplate.pdf]Google Scholar
- Landon BE, Normand SLT, Blumenthal D, Daley J: Physician Clinical Performance Assessment: Prospects and Barriers. JAMA. 2003, 290: 1183-9. 10.1001/jama.290.9.1183.View ArticlePubMedGoogle Scholar
- Katz A, Soodeen RA, Bogdanovic B, De Coster C, Château D: Can the Quality of Care in Family Practice Be Measured Using Administrative Data?. Health Services Research. 2006, 41 (6): 2238-54. 10.1111/j.1475-6773.2006.00589.x.View ArticlePubMedPubMed CentralGoogle Scholar
- Norcini JJ: ABC of learning and teaching in medicine. Work based assessment. BMJ. 2003, 326: 753-5. 10.1136/bmj.326.7392.753.View ArticlePubMedPubMed CentralGoogle Scholar
- Boulet LP, Becker A, Berube D, Beveridge R, Ernst P: Canadian asthma consensus report, 1999. CMAJ. 1999, 161 (11 Suppl): S1-S62.PubMedGoogle Scholar
- Spitzer WO, Suissa S, Ernst P, Horwitz RI, Habbick B, Cockcroft D, Boivin JF, McNutt M, Buist S, Rebuck AS: The use of β-agonists and the risk of death and near-death from asthma. N Engl J Med. 1992, 326: 501-506. 10.1056/NEJM199202203260801.View ArticlePubMedGoogle Scholar
- Suissa S, Ernst P, Boivin JF, Horwitz RI, Habbick B, Cockcroft D, Blais L, McNutt M, Buist AS, Spitzer WO: A cohort analysis of excess mortality in asthma and the use of inhaled beta agonists. Am J Respir Crit Care Med. 1994, 149: 604-10.View ArticlePubMedGoogle Scholar
- Austin Z, Croteau D, Marini A, Violato C: Continuous professional development: The Ontario experience in professional self-regulation through quality assurance and peer review. Am J Pharm Ed. 2003, 67 (2): Article 56Google Scholar
- Alberta College of Pharmacists: RxCEL Competence Program. [Accessed August 12, 2010]., [https://pharmacists.ab.ca/nContinuingCompetence/default.aspx]
- Quebec Order of Pharmacists: Professional Inspection Program. [Accessed August 12, 2010], [http://www.opq.org/fr/renseignements/directions/services]
- Tamblyn R, Lavoie G, Petrella L, Monette J: The use of prescription claims databases in pharmacoepidemiological research: the accuracy and comprehensiveness of the prescription claims database in Quebec. J Clin Epidemiol. 1995, 48 (8): 999-1009. 10.1016/0895-4356(94)00234-H.View ArticlePubMedGoogle Scholar
- Doran T, Fullwood C, Gravelle H, Reeves D, Kontopantelis E, Hiroeh U, Roland M: Pay-for-Performance Programs n Family Practices in the United Kingdom. NEJM. 2006, 355: 375-84. 10.1056/NEJMsa055505.View ArticlePubMedGoogle Scholar
- Roberts AS, Benrimoj S, Chen TF, Williams KA, Aslani P: Implementing cognitive services in community pharmacy: a review of facilitators used in practice change. Inter J Pharm Pract. 2006, 14 (3): 163-170. 10.1211/ijpp.14.3.0002.View ArticleGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1472-6963/11/12/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.