Controlled trial of a collaborative primary care team model for patients with diabetes and depression: Rationale and design for a comprehensive evaluation
© Johnson et al.; licensee BioMed Central Ltd. 2012
Received: 6 March 2012
Accepted: 3 August 2012
Published: 16 August 2012
When depression accompanies diabetes, it complicates treatment, portends worse outcomes and increases health care costs. A collaborative care case-management model, previously tested in an urban managed care organization in the US, achieved significant reduction of depressive symptoms, improved diabetes disease control and patient-reported outcomes, and saved money. While impressive, these findings need to be replicated and extended to other healthcare settings. Our objective is to comprehensively evaluate a collaborative care model for comorbid depression and type 2 diabetes within a Canadian primary care setting.
We initiated the TeamCare model in four Primary Care Networks in Northern Alberta. The intervention involves a nurse care manager guiding patient-centered care with family physicians and consultant physician specialists to monitor progress and develop tailored care plans. Patients eligible for the intervention will be identified using the Patient Health Questionnaire-9 as a screen for depressive symptoms. Care managers will then guide patients through three phases: 1) improving depressive symptoms, 2) improving blood glucose, blood pressure and cholesterol, and 3) improving lifestyle behaviors. We will employ the RE-AIM framework for a comprehensive and mixed-methods approach to our evaluation. Effectiveness will be assessed using a controlled “on-off” trial design, whereby eligible patients would be alternately enrolled in the TeamCare intervention or usual care on a monthly basis. All patients will be assessed at baseline, 6 and 12 months. Our primary analyses will be based on changes in two outcomes: depressive symptoms, and a multivariable, scaled marginal model for the combined outcome of global disease control (i.e., A1c, systolic blood pressure, LDL cholesterol). Our planned enrolment of 168 patients will provide greater than 80% power to observe clinically important improvements in all measured outcomes. Direct costing of all intervention components and measurement of all health care utilization using linked administrative databases will be used to determine the cost-effectiveness of the intervention relative to usual care.
Our comprehensive evaluation will generate evidence to reliability, effectiveness and sustainability of this collaborative care model for patients with chronic diseases and depression.
Clintrials.gov Identifier: NCT01328639
KeywordsPrimary care Collaborative Diabetes Depression Controlled trial Health services research
Depression is one of the most common co morbidities in people with diabetes, present in 15-30% of patients with type 2 diabetes , at rates that are 30-40% higher than the general population [1, 2]. Despite this, less than 50% of patients are recognized as having depression within the health care system [1, 2]. Depression itself is a risk factor for the development of type 2 diabetes [3–5], and it is associated with adverse diabetes-related outcomes [6–9]. For example, comorbid depressive disorders in people with diabetes are associated with poorer self-care behaviors [10, 11] worse glycemic control, higher risk of microvascular and microvascular diabetes-related complications [8–11], decreased quality of life and psychological well-being [2, 12, 13], and substantially higher health care costs [6, 14, 15]. The implications of untreated depression on long-term morbidity and mortality are even more significant when one considers that depression tends to be a recurrent condition, with 79% of diabetic patients with depression relapsing over a 5-year period with an average of 4 or more episodes [13, 16]. In turn, diabetes may worsen the course of depression [4, 16]. In fact, having one or more chronic medical condition, such as diabetes, increases the likelihood of developing a major depressive episode .
Although the majority of individuals with diabetes and depression are treated in primary care settings , only a minority of these individuals receive adequate treatment for depression [6, 10, 18]. Indeed, despite its high prevalence, less than one-half of all patients with depression are diagnosed or adequately treated [19, 20]. Even primary care patients with established and treated depression receive only 48% of recommended management with both medication and psychotherapy . It is also true that these rates of adequate treatment are much lower for those with diabetes, given that up to one-half of these patients have undiagnosed depression [1, 19, 20]. Depression has also been reported to be an important barrier to enhancing self-management, quality of care and outcomes in individuals with diabetes in primary care settings [18, 21, 22].
Traditional approaches to improving primary care of patients with complex comorbid chronic illnesses typically involves “carve-out” disease management programs, that is, delivering care for each condition, one disease at a time. Such single-disease management programs have been shown to be effective in improving control of conditions such as heart failure , diabetes [24, 25], and depression . However, a recent systematic review and meta-analysis of interventions for depressive disorders in patients with diabetes concluded that pharmacologic and collaborative care interventions were primarily aimed at and succeeded in the reduction of depressive symptoms, but, in general, had no effect on glycemic control . It was suggested that individuals with comorbid physical and psychological problems require a far more integrated approach of care that targets such conditions collectively, and that management of these comorbid conditions should not be done separately .
This concept was recently proven in a pair of randomized trials investigating the efficacy of a case-management collaborative care model for patients with diabetes and depression in the primary care setting of Group Health Cooperative in Washington State [28, 29]. In the first trial, a case-management approach proved effective in reducing depressive symptoms, but did not result in improved glycemic control . In the second study, the case-managed collaborative care model was expanded in scope, aimed at achieving improvements of depressive symptoms and cardio-metabolic markers in individuals with depression and poorly controlled diabetes or heart disease . In both cases, a nurse care manager guided patient-centered care with family physicians and consultant physician specialists. In the second study the intervention initially focused on the treatment of depression, but also aimed at management of diabetes and cardiovascular risk factors (e.g. high blood pressure, elevated lipids, elevated A1c), as well as lifestyle health-related behaviors. The trial involved 214 patients from 151 physicians in 14 primary care clinics. Patients in the intervention group had greater overall 12-month improvement across A1c (difference, 0.58%), LDL cholesterol (difference, 0.2 mmol/L), systolic blood pressure (difference, 5.1 mm Hg), and SCL-20 depression scores (difference, 0.40 points) (P < 0.001). Patients in the intervention group also were more likely to have one or more adjustments of antihypertensive medications (P < 0.001), insulin (P = 0.006), and antidepressant medications (P < 0.001), and they had better quality of life (P < 0.001) and greater satisfaction with care (P < 0.001). Patients in the intervention group had a mean of 10.0 in-person and 10.8 telephone visits with the nurse care manager over the 12-month period. The estimated mean cost per patient for this intervention, including all nurse contacts, specialist physician consultations, and information system support, was $1,224 (USD) in 2009 . However, these intervention costs were offset by savings in total medical costs; over a 24-month period the intervention was associated with approximately $600 cost savings per patient compared to usual primary care .
While impressive, these findings need to be replicated and extended to other healthcare settings before the intervention model can be widely adopted or recommended. We took the previous randomized controlled trials as evidence of the efficacy of this case-managed collaborative model of care [28, 29]. We therefore proposed a pragmatic approach in the implementation and evaluation of the collaborative care intervention in Primary Care Networks (TeamCare-PCN), and will employ a mixed-methods approach, based on the RE-AIM framework . The RE-AIM framework examines five dimensions: Reach into target populations; Effectiveness; Adoption by target settings, institutions, and staff; Implementation, including consistency and cost of delivery; and Maintenance of effects in both individuals and settings over time. Thus, while a major focus of our protocol is on effectiveness, based on changes in clinical outcomes, applying the complete RE-AIM framework will allow us to determine the broader impact and transferability of the TEAM care model in the Alberta context.
Overall study design
Our decision to employ a pragmatic approach was based on a number of factors. First, the efficacy of the intervention has been established [28, 29], so it is important that external validity now be accorded similar attention to the usual concerns related to internal validity [33–35]. Second, various forms of case-management have generally shown to be effective in improving quality of care for patients with diabetes . Third, the effectiveness, applicability, and feasibility of the intervention have only been established in the urban managed care setting in the US . Testing this intervention in a Canadian primary care setting is crucial to claim its effectiveness and applicability to the Canadian context. Finally, limitations in the available scientific information often impede the efforts of health policy makers and care providers in making evidence-informed policies for new and existing health technologies and interventions . This results in allocating scarce healthcare dollars to interventions where the effectiveness and cost-effectiveness in routine clinical settings have not been evaluated [34, 35, 37]. While an economic evaluation of the original TEAM Care intervention was undertaken from the perspective of a US managed care organization provider , it is important to adopt a pragmatic approach to evaluate the effectiveness and cost-effectiveness of the TeamCare-PCN intervention in the Canadian context, and make this information available to support local health policy making and resource allocation.
We hypothesize the TeamCare-PCN intervention will reduce depressive symptoms, increase achievements of targets for cardio-metabolic measures, improve lifestyle behaviors, and be cost-effective. Furthermore, we anticipate this intervention will be acceptable and feasibly implemented in the PCN environment.
Setting and population
TeamCare-PCN will be conducted in collaboration with four PCN in non-metro Alberta. A PCN is akin to the “medical home” concept , established as a network of primary care physicians in a given geographical area. Through the provincial Primary Care Initiative framework, funding is provided based on an approved business plan for the provision of primary care services to the local population. Each network has the flexibility to develop programs and to provide services in a way that works locally to meet the specific needs of patients. Funding may be used to establish central PCN office/clinic space, and hire allied health professionals, such as nurses, dieticians, pharmacists, or therapists. At the time of the launch of this study, there were 40 PCNs operating throughout Alberta, with about 80% of eligible family physicians working within a PCN. We elected to partner with PCNs outside of the larger metro centers because these cities already have greater access to specialist care as well as more established regional diabetes care and management programs than the non-metro PCNs. Collectively, the four participating study PCNs represent 140 general physicians and approximately 180,000 patients, with an estimated 10,000 patients with type 2 diabetes.
Severe and/or terminal physical illness (e.g. heart disease, renal failure, cancer, major organ failure) or
Serious and/or severe mental or psychiatric illness (e.g. bi-polar disorder or schizophrenia, use of anti-psychotic or mood stabilizer medication, or cared for by a psychiatrist); patients taking anti-depressants or receiving supportive psychotherapy from non-psychiatrists would be eligible or
Pregnant or breastfeeding or
Live in long-term care facility or
Already participating in other clinical trials
Recruitment and allocation
Recruiting participants into TeamCare-PCN involves three steps. First , a screening survey accompanied with an endorsement letter from the PCNs will be mailed out to all patients with type 2 diabetes on the PCNs’ diabetes registries. This survey asks about age, the ability to read and speak English, having type 2 diabetes, length of time since diagnosis, and screens for depressive symptoms. Second , after potential participants have completed and returned the screening survey, PCN staff will contact eligible participants to confirm all eligibility criteria and if the participant is willing to participate, and schedule a baseline assessment visit. Third , during the baseline visit, the Care Manager (CM) will confirm eligibility, explain the intervention, provide an intervention-specific information letter and obtain a signed written informed consent from the patient to participate in the study.
Participants will be allocated to study groups using a previously successful “on-off” group assignment method (Figure 1) [39, 41, 42]. Eligible and consenting respondents who book for a baseline assessment with the CM during month 1 will be allocated to the intervention arm (ON-group). Those who book the baseline assessment in month 2 will be allocated to the usual care arm (OFF-group). This allocation process will continue until the target sample size is recruited. This method has been used in many quality improvement studies, reliably leads to balance in measured [and unmeasured] patient characteristics [39, 41, 42], and meets study design criteria for internal validity sufficient to permit inclusion in the Cochrane Collaborations’ Effective Practice and Organization of Care (EPOC) systematic reviews . Because all four sites are involved in both “on” and “off” phases, this particular study design also balances case mix and controls for Hawthorne or volunteer effects, as well as issues related to “institutional learning” over time [39, 40, 42].
The TeamCare-PCN intervention involves a registered nurse Care Manager (CM), who coordinates collaborative team management for patients with diabetes and depression. Individuals with diabetes will be screened for depressive symptoms using the PHQ-9; patients with a score of > = 10 on the PHQ-9 are eligible for the intervention [43, 44]. The PHQ-9 has been used in a number of interventions for screening of depressive symptoms in primary care , including among diabetic patients , and specifically in the efficacy study of the TEAM Care intervention .
The goal of the intervention is to reduce depressive symptoms, achieve targets for cardio-metabolic measures and improve lifestyle behaviors. The intervention includes three phases: (1) managing depression and improving depressive symptoms, (2) managing diabetes and controlling blood glucose, blood pressure and cholesterol, and (3) improving lifestyle behaviors such as healthy eating, physical activity and smoking cessation. The CM will coordinate the TeamCare-PCN intervention, while the family physician will remain responsible for final treatment decisions and all prescriptions. The CM will consult with specialists (psychiatrist and internist/endocrinologist) to consider management options depending on patients’ needs and desires. The CM will use locally endorsed evidence-based algorithms to provide recommendations for changes in the treatment plan, and in collaboration with specialists and the patients’ family physician, also support the implementation of the patients’ individualized care plan. Using a patient-centered focus, the CM will partner with the patient to develop a shared definition of problems, provide education and support, agree on specific targets/goals and individualized action plan, offer support and problem solving to optimize self-management, and closely monitor treatment adherence and outcomes.
Patients entering the intervention will have a two-hour baseline appointment with the CM. This first visit will include a bio-psychosocial semi-structured assessment (reviewing medical history, previous treatments for depression and diabetes), patient education, potential treatment options (anti-depressant medications and/or psychotherapy) and developing an overall individualized care plan.
As mentioned, the intervention will consist of 3 phases; the first focusing on depression management, the second on cardio-metabolic diabetes management, and the third on general lifestyle modifications. A treat-to-target/stepped care approach will be used at each phase of the intervention. Recommended treatments have been based on algorithms that were developed in collaboration with the PCNs by compiling various guidelines and sources, such as extant clinical practice guidelines and consulting experts in the field. The CM will actively follow-up by telephone or in person one to two times per month to re-assess symptoms, and assist and support patients in achieving treatment goals. The CM will also have weekly meetings with the consulting specialists to review new cases and patient progress, and then communicate team treatment recommendations to the primary care physician.
The depression management phase (Phase 1) will involve the use of anti-depressant medications and/or referral for psychotherapy, as determined by the CM and the family physician (with study psychiatrist consultation as needed by the CM), tailored to each patient. A two-day training session for CM and consultant specialists was planned at the beginning of the project, with an annual one-day booster session The CM will be given basic training in three psychotherapeutic techniques during this phase: problem-solving therapy [46–49], behavioral activation [50–54], and motivational interviewing [55–57]. Direct referral to the care of a psychiatrist will occur only on failure of two separate trials of anti-depressants, or one trial of anti-depressant in combination with psychotherapy. Once patients have reached remission, the CM and patient work together towards a relapse prevention plan to help the patient identify when and where to seek help with future depressive symptoms or renewed problems for disease control. The CM will continue to work with patient through Phases 2 and 3 of the intervention.
Stepped care/treat-to-target algorithms for Phase 2 (cardio-metabolic care) were developed in collaboration with health care professionals at the PCNs and study specialists using local and national guidelines. Phase 2 includes working with the CM in analogous fashion to Phase 1, but with a focus on reaching individualized targets for hemoglobin A1c, lipids and blood pressure measures. Phase 3 involves patient education to address lifestyle behaviors such as diet and exercise. Locally developed educational materials and existing PCN support programs will be available for patient referrals.
All participants in TeamCare-PCN will be actively screened for depression and those allocated to usual care (or intervention) will be identified as such to their family physician. For disease management, patients will receive care from their family physician, without additional active support from the CM. Therefore, this group will receive the usual standard care for diabetes and depression from their family physicians based on available clinical practice guidelines. Participants in this group will be assessed for all of the same outcome measurements as intervention patients. A recently published trial concluded that screening for depression with written feedback to patients and physicians resulted in no improvements in depressive symptoms, nor changes in utilization of mental health care services . Thus, in our design, the usual care group is very likely to represent usual care for patients with diabetes and depression.
To assess the effectiveness (“E” in RE-AIM) of TeamCare-PCN, we will use two primary outcome measures. First, given that we selected patients on the basis of depressive symptoms, our primary depression-related outcome will be the PHQ-9 scores at 12 months. Second, a global measure of patient-centered improvement (the scaled marginal model, see Analysis below) based on the combination of chronic disease-related clinical outcomes. All outcomes will be measured in all participants (i.e., both groups) at baseline, 6, and 12 months. We will secondarily evaluate process indicators for care received, as well as a host of patient-reported outcome measures to determine the overall effectiveness of the TeamCare-PCN intervention.
The outcome measure for depression will be improvement in PHQ-9 score [43, 44]. The minimal important difference on the PHQ-9 score is widely considered to be 5 points . A remission of depression symptoms is indicated with a score <10 for a period of three consecutive months . Operationally, this can be conceptualized as a continuous score or as a binary outcome: improved vs not, since all participants will have scores greater than 10 as part of their eligibility.
Chronic disease-related clinical outcomes
Clinical outcome measures include systolic blood pressure (SBP), LDL cholesterol and A1c, demonstrated by achievement of targets or significant improvements as indicated with a 10% improvement over baseline [59, 60]. These outcomes will be measured using point-of-care devices that we have standardized and placed in each PCN. Capillary blood samples will be collected from participants to assess A1c and lipid profile. Cardiovascular (blood pressure and resting heart rate) and anthropometric (weight, height, and waist circumference) measurements will also be assessed at clinic visits. Regular, monthly quality assurance checks will be conducted on the point-of-care devices, validated against central laboratory measurements.
Process of care indicators
Process indicators will include the number of visits with PCN care providers, including CM, family physicians, specialists consults, referrals for mental health care, and use of medications and psychotherapeutic sessions. The time spent with patients will be tracked for all CM contacts. Adjustments to medications and adherence to treatments will also be assessed.
Health behaviors and self-management: includes assessment of smoking behaviors, alcohol consumption , substance use , and physical activity , and the Summary of Diabetes Self Care Activities (SDSCA) .
The depression and medical outcome measures will be entered into a clinical management tracking system as part of the TeamCare-PCN intervention. The data collected in the survey and through clinical measurement will be entered into centralized, web-accessible databases. These study databases will be housed on secure servers in the research offices at the University of Alberta. Double data entry will be conducted and research staff will remain masked to allocation status at all times. Once the study is completed, all data will be exported and merged, based on individually assigned study ID numbers, to form an analyzable dataset. Investigators, research assistants, and analysts will be masked to allocation status at all times.
As the initial focus of the intervention is on the management of depressive symptoms, we have considered the PHQ-9 as a main primary outcome, and will assess changes in PHQ-9 scores over 12-months between groups, adjusting for baseline PHQ-9 score, using a mixed effects multivariate model. For our second primary outcome of improvements in global disease control, we will employ a multivariate model that jointly tests the changes in multiple clinical outcomes, namely A1c, LDL cholesterol and systolic blood pressure . Using the same analytic approach as in the recently published RCT of this intervention, we will apply a scaled marginal model [29, 75] to simultaneously compare the change in these continuous outcomes at 12 months, adjusting for the baseline status for each variable. This approach scales the changes in each outcome by its standard errors, and thus the coefficients can be directly interpreted as effect sizes . In either primary outcome analyses, the models will be estimated iteratively and the potential correlations among and between outcomes within individuals will be handled using generalized-estimating equation (GEE) models for each outcome .
We will also compare the study arms based on the proportion of subjects who achieved a remission of depression (i.e., PHQ-9 < 10 for 3 consecutive months) and the proportion of patients who achieve a clinically important change in the outcomes (that is, achieving a reduction of 5 points on the PHQ-9  or a 10% or greater improvement over baseline values for A1C, LDL cholesterol and SBP at 12 months) [59, 60], using generalized estimating equations and multivariable logistic regression models. This approach will allow us to present and interpret all outcomes in terms of absolute differences and a number-needed-to-treat .
For all analyses we will employ an intention-to-treat framework for our primary analysis, using a last-observation-carried-forward method of imputation for subjects who do not have complete follow-up data for primary or secondary outcomes. This approach is conservative as it assumes subjects with missing follow-up data have not changed. In either case, the regression models will accommodate additional covariates, as required, to adjust for PCN site, as well as any post-allocation baseline differences between groups in clinically important (e.g., age, sex) or statistically significant (e.g., p < 0.1) characteristics. This ability to statistically control for potential imbalance may be necessary given the non-random treatment allocation used in our “on-off” design.
Sample size and power considerations
We estimate that a minimum total sample size of 120, with 60 in each arm, would provide power of 0.80 to detect a mean difference of 5 points in the PHQ-9 , assuming a repeated measures correlation of 0.6, and 2-tailed alpha of 0.05. This sample size also provides more than 80% power (two sided alpha = 0.05) to detect any between-group absolute difference in proportions of 15% or more (e.g., 45% of usual care patients achieve depression remission vs 60% of intervention patients) . Anticipating a 40% attrition rate, we planned to recruit 168 patients in total across our 4 PCN sites. Although the model is implemented in 4 PCN sites, the individual general physicians affiliated with the PCN will carry out the changes in care. While we will include PCN site as a covariate in our analysis, because there are approximately 140 general physicians across these 4 PCN sites, we choose not to further inflate our sample to account for clustering of patients and their outcomes.
Broader RE-AIM evaluation
Using demographic information and eligibility criteria, a comparison of patient characteristics between the intervention and usual care groups will be conducted to address reach. Aggregate demographic information between participants and non-participants will be compared using population-level data available through the Alberta Diabetes Surveillance System . Information on reach will also be documented through a patient recruitment tracking system, the PCNs’ diabetes patient registries, and monthly reports on recruitment submitted by PCN staff.
Implementation, including cost-effectiveness
Implementation evaluation is used to examine the extent to which an intervention is delivered as planned, particularly in real world practice settings. This type of evaluation explores why an intervention is successful or not, and can contribute to the successful realization of programs in the future. Implementation evaluation of TeamCare-PCN will enhance our contextual understanding and interpretation of why the intervention had an impact or not, in which settings (i.e. PCNs), and for whom. It also provides a mechanism for continuous quality improvement by generating ongoing information. Implementation evaluation is also crucial to determine the sustainability of a program, as it is used to inform future decision-making and strategic planning by identifying critical successful factors for implementation (such as resources, staff qualities, and leadership) and recommendations to mitigate barriers.
We will examine the intended versus actual implementation of TeamCare-PCN through several means: document review; pre/post training survey of CMs to assess knowledge and confidence with the model; usual care checklist documenting organizational priorities and systems to implement the model; baseline, mid- and post-intervention interviews with PCN staff regarding facilitators and barriers to implementation and recommendations for improvement; and participant-observation.
A number of economic evaluations of team-based interventions in patients with diabetes and depression have been conducted [30, 78–80]. Incremental cost-utility ratios have been estimated at less than $400 per quality-adjusted life year gained . While the consistent economic benefit of these interventions has been demonstrated, these evaluations are highly dependent on many factors including the implementation strategies of these interventions in the primary care settings of the single urban managed care environment in the US. We will therefore conduct an economic evaluation of the TeamCare-PCN implementation, using a similar methodological approach. To do this, we will use primary data collected during the study period, health care utilization data obtained through linkages with administrative databases, as well as an Alberta-based economic model to estimate future diabetes related costs . For our economic evaluation models, we will take the perspective of the individual PCN Board as the main decision maker, with a second perspective of the third-party payer, that is, the provincial health care system, along with our analyses focusing on direct medical costs, as this is the most relevant perspective for our decision-making partners.
Intervention costs versus usual care costs
Costs for the intervention will be estimated using the actual salary and benefits for the Care Manager and Administrative Assistant provided for the intervention plus a 30% overhead rate for PCN space and management costs . The CM time will be estimated based on the actual visits with intervention patients, for both in-person and telephone contacts, as well as outreach efforts and record-keeping. Intervention costs will also include a fixed amount for each participant assigned to the intervention program to defray the costs of specialist supervision and the clinical management support.
Health care utilization data
Patients enrolled in the study will be asked for permission to access their medical records by providing their personal health number, thus allowing linkage to provincial health care administrative data from Alberta Health and Wellness (AHW) for physician, hospital, and emergency department billing, and pharmaceutical data (for patients 65 years and older). This linkage will allow health care utilization and health care costs to be included in the evaluation. These data sources are regularly monitored as part of the Alberta Diabetes Surveillance System (ADSS) .
Long-term economic projection model
We have developed a projection model for the future burden of diabetes in Alberta using data collected for the ADSS . Our projection model is based on two elements: epidemiologic trends and costs. To estimate the future incidence of diabetes complications, we will use trends in incidence rates by diabetes status, sex and age group. We will model the longer-term (e.g., at 10-, 20- and 30-years) costs and outcomes of the TeamCare-PCN intervention. We will employ a discount factor of 5% to all future costs and benefits, and perform sensitivity analyses on this discount factor, using rates of 0%, 3% and 10%. Last, we plan to conduct exhaustive one-way, multi-way, and probabilistic sensitivity analyses to ensure our findings are robust [82, 83].
We will examine the adoption of TeamCare-PCN by documenting and comparing the characteristics of the participating PCNs. This will be done through document review (e.g., PCN websites, business plans), the usual care checklist (description of participating PCNs - including number of family physicians, number of patients, governance structure, organizational processes and structures), and interviews with PCN staff. Determining the representativeness of the participating PCNs compared to non-participating PCNs represents a challenge and will be dependent on the availability of secondary data to describe the characteristics of all PCNs in Alberta.
We will also examine the extent to which the effects of the interventions are sustained over time in patients (that is, sustained awareness, knowledge, and management of T2D, depression, and lifestyle behaviors) and at the organizational level of the PCN. This type of information will be gathered through patient reported outcomes (e.g., health behaviors and self-care items) through regular surveys at baseline, 6 and 12 months. These survey items will be collected through the ABCD Cohort Study survey, which will be administered annually for five years after completion of TeamCare-PCN. Also, interviews with PCN staff will be conducted regarding decisions around incorporating the intervention models into future business planning or continuing the use of aspects of the model, such as using the diabetes registry to inform PCN programming, or using screening tools to identify and assess depressive symptoms among people with chronic illness.
RE-AIM data and analysis
Project documents review including patient tracking databases, email communications, and review of secondary data, as available;
Participant observation includes assessment of notes generated from meetings with the PCNs and other partners; and,
Interviews with the Executive Directors, Chronic Disease Clinical Managers, and the CMs from the 4 participating PCNs. Specialists and family physicians will also be invited to participate.
Interviews will be digitally recorded, transcribed verbatim by an independent transcriptionist and verified for accuracy. All qualitative data sources will be compiled and managed using NVivo 9.0 software. We will take a general inductive approach to analysis of the qualitative data , which places fewer restrictions on the content analysis than more constraining approaches such as grounded theory or phenomenology . Within this approach, the evaluation questions related to the RE-AIM framework will direct analysis of the data. However, the findings will be derived directly through a content analysis .
Ethics and funding considerations
All patient participants will receive information about the study and the opportunity to ask any questions. Written informed consent will be obtained from participants prior to obtaining any study measurements. Ethics approval for the study and its evaluation has already been granted from the Health Research Ethics Board (HREB #PRO00012663) at the University of Alberta. The broader evaluation component of this study was also submitted to the HREB for review. However, the Board deemed this component of the study as evaluation and not research; it was deemed to not require ethics review and approval. Regardless, the requirements outlined in the Tri-Council Policy Statement: Ethical Conduct of Research Involving Humans  will be followed in this study. Verbal informed consent from participants will be sought prior to any evaluation activities.
The funding for this study is from a contract from the provincial government (Alberta Health and Wellness) to the Alliance for Canadian Health Outcomes Research for Diabetes (ACHORD) Group. The funding source had no role in the design of the study and will have no role in the conduct, analysis or reporting of the study, nor access to the data.
We report the protocol for the design and comprehensive evaluation of a collaborative team model of primary care for patients with comorbid depression and diabetes. Diabetes is a common and increasingly prevalent chronic medical condition. Comorbid depression is common in people living with diabetes, although it often goes unrecognized and therefore untreated. Together, diabetes and depression increase the risk of adverse health outcomes in these patients, including increased mortality and increased heath care utilization, and treatment should be administered using an integrated approach that targets both diabetes and depression collectively. The efficacy of this collaborative care model has been demonstrated, but only within one managed care environment in the US. Our proposal is to evaluate this model of care in the evolving primary care environment in Canada.
We have proposed a pragmatic approach in the study design of the TeamCare-PCN intervention, and will employ a mixed methods approach for our comprehensive evaluation. Therefore, while we will undertake a controlled outcome evaluation based on changes in clinical parameters to determine effectiveness, we have also planned an economic evaluation and qualitative assessments of reach, adoption, implementation and maintenance. This broad evaluation is intended to provide the relevant decision-makers (i.e., provincial funding agencies and primary care networks) with stronger information on which to build business plans for future service delivery. Ultimately, we believe our work will serve as a platform upon which an emerging model of primary care can incorporate an effective and cost-effective depression intervention into the management of individuals with type 2 diabetes, and as a framework for implementing and evaluating similar interventions for other chronic conditions.
JAJ is a Senior Scholar with Alberta Innovates-Health Solutions and a Centennial Professor at the University of Alberta. SRM is a Health Scholar funded by Alberta Innovates-Health Solutions and holds the Endowed Chair in Patient Health Management funded by the Faculties of Medicine and Dentistry and Pharmacy and Pharmaceutical Sciences of the University of Alberta. This work was supported in part by contract from Alberta Health and Wellness, and a CIHR Team Grant to the Alliance for Canadian Health Outcomes Research in Diabetes (reference #: OTG- 88588), sponsored by the CIHR Institute of Nutrition, Metabolism and Diabetes (INMD).
- Ali S, Stone MA, Peters JL, Davies MJKK: The prevalence of co-morbid depression in adults with type 2 diabetes: a systematic review and meta-analysis. Diabet Med. 2006, 23 (11): 1165-1173. 10.1111/j.1464-5491.2006.01943.x.View ArticlePubMedGoogle Scholar
- Goldney R, Fisher P, Phillips LDW: Diabetes, depression, and quality of life: a population study. Diabetes Care. 2004, 27 (5): 1066-1070. 10.2337/diacare.27.5.1066.View ArticlePubMedGoogle Scholar
- Carnethon M, Kinder L, Fair J, Stafford R, Fortmann S: Symptoms of depression as a risk factor for incident diabetes: findings from the National Health and Nutritional Examination Epidemiologic Follow-Up Study, 1971-1992. Am J Epidemiol. 2003, 158 (5): 416-423. 10.1093/aje/kwg172.View ArticlePubMedGoogle Scholar
- Brown LC, Majumdar SR, Newman SC, Johnson JA: History of depression increases risk of type 2 diabetes in younger adults. Diabetes Care. 2005, 28 (5): 1063-1067. 10.2337/diacare.28.5.1063.View ArticlePubMedGoogle Scholar
- Knol MJ, Twisk JW, Beekman AT, Heine RJ, Snoek FJ, Pouwer F: Depression as a risk factor for the onset of type 2 diabetes mellitus. A meta-analysis. Diabetologia. 2006, 49 (5): 837-845. 10.1007/s00125-006-0159-x.View ArticlePubMedGoogle Scholar
- Ciechanowski P, Katon WJ, Russo J: Depression and diabetes: impact of depressive symptoms on adherence, function, and costs. Arch Intern Med. 2000, 160 (21): 3278-3285. 10.1001/archinte.160.21.3278.View ArticlePubMedGoogle Scholar
- Lustman P, Anderson R, Freedland K, DeGroot M, Carney R, Clouse R: Depression and glycemic control: A meta-analysis review of the literature. Diabetes Care. 2000, 23 (7): 934-942. 10.2337/diacare.23.7.934.View ArticlePubMedGoogle Scholar
- DeGroot M, Anderson R, Freedland K, Clouse R, Lustman PJ: Association of depression and diabetes complications: a meta-analysis. Psychosomatic Medicine. 2001, 63 (4): 619-630.View ArticleGoogle Scholar
- Black S, Markides K, Ray L: Depression predicts increased incidence of adverse health outcomes in older persons with type 2 diabetes. Diabetes Care. 2003, 26 (10): 2822-2828. 10.2337/diacare.26.10.2822.View ArticlePubMedGoogle Scholar
- Ciechanowski P, Katon W, Russo JIH: The relationship of depressive symptoms to symptom reporting, self-care and glucose control in diabetes. General Hospital Psychiatry. 2003, 25 (4): 246-252. 10.1016/S0163-8343(03)00055-0.View ArticlePubMedGoogle Scholar
- McKellar J, Humphreys K, Piette J: Depression increases diabetes symptoms by complicating patients’ self-care adherence. The Diabetes Educator. 2004, 30 (3): 485-492. 10.1177/014572170403000320.View ArticlePubMedGoogle Scholar
- Grey M, Whittemore R, Tamborlane W: Depression in type 1 diabetes in children: natural history and correlates. J Psychosom Res. 2002, 53 (4): 907-911. 10.1016/S0022-3999(02)00312-4.View ArticlePubMedGoogle Scholar
- Ali S, Stone M, Skinner TC, Robertson N, Davies MKK: The association between depression and health-related quality of life in people with type 2 diabetes: a systematic literature review. Diabetes Metab Res Rev. 2010, 26 (2): 75-89. 10.1002/dmrr.1065.View ArticlePubMedGoogle Scholar
- Egede L, Zheng D, Simpson K: Comorbid depression is associated with increased health care use and expenditures in individuals with diabetes. Diabetes Care. 2002, 25 (3): 464-470. 10.2337/diacare.25.3.464.View ArticlePubMedGoogle Scholar
- Simon G, Katon W, Lin E, et al: Diabetes complications and depression as predictors of health care costs. General Hospital Psychiatry. 2005, 27 (5): 344-351. 10.1016/j.genhosppsych.2005.04.008.View ArticlePubMedGoogle Scholar
- Lustman P, Griffith L, Clouse R: Depression in adults with diabetes: results of a 5-year follow-up study. Diabetes Care. 1988, 11 (8): 605-612. 10.2337/diacare.11.8.605.View ArticlePubMedGoogle Scholar
- Wang J, Schmitz N, Dewa C: Socioeconomic status and the risk of major depression: the Canadian National Population Health Survey. Journal of Epidemiology and Community Health. 2009, 64 (5): 447-452.View ArticlePubMedGoogle Scholar
- Katon W, Simon G, Russo J, et al: Quality of depression care in a population-based sample of patients with diabetes and major depression. Medical Care. 2004, 42 (12): 1222-1229. 10.1097/00005650-200412000-00009.View ArticlePubMedGoogle Scholar
- Remick RA: Diagnosis and management of depression in primary care: a clinical update and review. CMAJ. 2002, 167 (11): 1253-1260.PubMedPubMed CentralGoogle Scholar
- Robinson WD, Geske JA, Prest LA, Barnacle R: Depression treatment in primary care. Journal of American Board Family Practice. 2005, 18 (2): 79-86. 10.3122/jabfm.18.2.79.View ArticleGoogle Scholar
- Katon W, Von Korff M, Ciechanowski P, Russo J, Lin E, Simon G: Behavioral and clinical factors associated with depression among individuals with diabetes. Diabetes Care. 2004, 27 (4): 914-920. 10.2337/diacare.27.4.914.View ArticlePubMedGoogle Scholar
- Grant R, Hamrick H, Sullivan C, Dubey A, Chueh H, et al: Impact of population management with direct physician feedback on care of patients with type 2 diabetes. Diabetes Care. 2003, 26 (8): 2275-2280. 10.2337/diacare.26.8.2275.View ArticlePubMedGoogle Scholar
- Phillips C, Wright S, Kern D, Singa R, Shepperd S, Rubin H: Comprehensive discharge planning with post discharge support for older patients with congestive heart failure: a meta-analysis. JAMA. 2004, 291 (11): 1358-1367. 10.1001/jama.291.11.1358.View ArticlePubMedGoogle Scholar
- Renders C, Valk G, Griffin S, Wagner E, Eijk Van J, Assendelft W: Interventions to improve the management of diabetes in primary care, outpatient, and community settings: a systematic review. Diabetes Care. 1995, 24 (10): 1821-1833.View ArticleGoogle Scholar
- Shojania KG, Ranji SR, McDonald KM, Grimshaw JM, Sundaram V, Rushakoff RJ, Owens DK: Effects of quality improvement strategies for type 2 diabetes on glycemic control: a meta-regression analysis. JAMA. 2006, 296 (4): 427-440. 10.1001/jama.296.4.427.View ArticlePubMedGoogle Scholar
- Gilbody S, Bower P, Fletcher J, Richards D, Sutton A: Collaborative care for depression: a cumulative meta-analysis and review of longer-term outcomes. Arch Intern Med. 2006, 166 (21): 2314-2321. 10.1001/archinte.166.21.2314.View ArticlePubMedGoogle Scholar
- van der Feltz-Cornelis CM, Nuyen J, Stoop C, Chan J, Jacobson AM, Katon W, Snoek F, Sartorius N: Effect of interventions for major depressive disorder and significant depressive symptoms in patients with diabetes mellitus: a systematic review and meta-analysis. General Hospital Psychiatry. 2010, 32 (4): 380-395. 10.1016/j.genhosppsych.2010.03.011.View ArticlePubMedGoogle Scholar
- Katon WJ, Von Korff M, Lin EH, Simon G, Ludman E, Russo J, Ciechanowski P, Walker E, Bush T: The Pathways Study: a randomized trial of collaborative care in patients with diabetes and depression. Arch Gen Psychiatry. 2004, 61 (10): 1042-1049. 10.1001/archpsyc.61.10.1042.View ArticlePubMedGoogle Scholar
- Katon WJ, Lin EH, Von Korff M, Ciechanowski P, Ludman EJ, Young B, Peterson D, Rutter CM, McGregor M, McCulloch D: Collaborative care for patients with depression and chronic illnesses New England Journal of Medicine. 2010, 363: 2611-2620.PubMedGoogle Scholar
- Katon W, Russo J, Lin EHB: Cost effectiveness of a multicondition collaborative care intervention: A randomized controlled trial. Arch Gen Psychiatry. 2012, 69 (5): 506-514. 10.1001/archgenpsychiatry.2011.1548.View ArticlePubMedGoogle Scholar
- Glasgow R, Vogt T, Boles S: Evaluating the public health impact of health promotion interventions: the RE-AIM framework. Am J Public Health. 1999, 89 (9): 1322-1327. 10.2105/AJPH.89.9.1322.View ArticlePubMedPubMed CentralGoogle Scholar
- Relton C, Torgerson D, O'Cathain A, Nicholl J: Rethinking pragmatic randomised controlled trials: introducing the "cohort multiple randomised controlled trial" design. BMJ. 2010, 340: c1066-10.1136/bmj.c1066.View ArticlePubMedGoogle Scholar
- Tunis S, Stryer D, Clancy C: Practical clinical trials: increasing the value of clinical research for decision making in clinical and health policy. JAMA. 2003, 290 (12): 1624-1632. 10.1001/jama.290.12.1624.View ArticlePubMedGoogle Scholar
- MacPherson H: Pragmatic clinical trials. Complementary Therapies in Medicine. 2004, 12 ((2-3)): 136-140.View ArticlePubMedGoogle Scholar
- Zwarenstein M, Treweek S, Gagnier J, Altman D, Tunis S, Haynes B, Oxman AD, Moher D: Improving the reporting of pragmatic trials: an extension of the CONSORT statement. BMJ. 2008, 337 (a2390).
- Shojania KG, Ranji SR, McDonald KM, Grimshaw JM, Sundaram V, Rushakoff RJ, Owens DK: Effects of quality improvement strategies for type 2 diabetes on glycemic control: a meta-regression analysis. JAMA. 2006, 26 (296): 427-440.View ArticleGoogle Scholar
- Treweek S, Zwarenstein M: Making trials matter: pragmatic and explanatory trials and the problem of applicability. Trials. 2009, 10 (37).
- Rittenhouse DSS: The patient-centered medical home. JAMA. 2009, 301 (19): 2038-2040. 10.1001/jama.2009.691.View ArticlePubMedGoogle Scholar
- Weingarten SR, Riedinger MS, Conner L, Lee TH, Hoffman I, Johnson B, Ellrodt AG: Practice guidelines and reminders to reduce duration of hospital stay for patients with chest pain – an interventional trial. Ann Intern Med. 1994, 120 (4): 257-263.View ArticlePubMedGoogle Scholar
- ,: Cochrane Effective Practice and Organization of Care Group (EPOC) resources for review authors. Accessed 15. 2011, , , http://epoc.cochrane.org/epoc-resources-review-authors, February.
- Majumdar SR, Rowe BH, Folk D, Johnson JA, Holroyd BH, Morrish DW, Maksymowych WP, Steiner I, Harley CH, Wirzba B, et al: A controlled trial to increase detection and treatment of osteoporosis in older patients with a wrist fracture. Ann Intern Med. 2004, 141 (5): 366-373.View ArticlePubMedGoogle Scholar
- Rucker D, Rowe BH, Johnson JA, Steiner IP, Russell AS, Hanley DA, Maksymowych WP, Holroyd BR, Harley CH, Morrish DW, et al: Educational intervention to reduce falls and fear of falling in elderly patients after fragility fracture: results of a controlled pilot study. Preventive Medicine. 2006, 42 (4): 316-319. 10.1016/j.ypmed.2006.01.008.View ArticlePubMedGoogle Scholar
- Manea L, Gilbody S, McMillan D: Optimal cut-off score for diagnosing depression with the Patient Health Questionnaire (PHQ-9): a meta-analysis. CMAJ. 2011, 184 (3): E191-196.View ArticlePubMedGoogle Scholar
- Kroenke K: Enhancing the clinical utility of depression screening. CMAJ. 2012, 184 (3): 281-282. 10.1503/cmaj.112004.View ArticlePubMedPubMed CentralGoogle Scholar
- van Steenbergen-Weijenburg KM, de Vroege L, Ploeger RR, Brals JW, Vloedbeld MG, Veneman TF, Hakkaart-van Roijen L, Rutten F, Beekman AT, van der Feltz-Cornelis CM: Validation of the PHQ-9 as a screening instrument for depression in diabetes patients in specialized outpatient clinics. BMC Heal Serv Res. 2010, 10: 235-10.1186/1472-6963-10-235.View ArticleGoogle Scholar
- Bell A, D’Zurilla T: Problem solving therapy for depression: A meta-analysis. Clin Psychol Rev. 2009, 29 (4): 348-353. 10.1016/j.cpr.2009.02.003.View ArticlePubMedGoogle Scholar
- Arean P, Hegel M, Vannoy S, Fan M, Unuzter J: Effectiveness of problem solving therapy for older, primary care patients with depression: Results from the IMPACT project. Gerontologist. 2008, 48 (3): 311-323. 10.1093/geront/48.3.311.View ArticlePubMedGoogle Scholar
- Mynors-Wallis L, Gath D, Llyoyd Thomas A, Tomlinson D: Randomized controlled trial comparing problem solving treatment with amitriptyline and placebo for major depression in primary care. British Medical Journal. 1995, 310 (6977): 441-445. 10.1136/bmj.310.6977.441.View ArticlePubMedPubMed CentralGoogle Scholar
- Cuijpers P, van Straten A, Warmerdam L: Problem solving therapies for depression: A meta-analysis. European Psychiatry. 2007, 22 (1): 9-15. 10.1016/j.eurpsy.2006.11.001.View ArticlePubMedGoogle Scholar
- Jacobson N, Martell C, Dimidjian S: Behavioral activation treatment for depression: Returning to contextual roots. Clin Psychol Sci Pract. 2001, 8 (3): 255-270. 10.1093/clipsy.8.3.255.View ArticleGoogle Scholar
- Gortner E, Gollan J, Dobson K, Jacobson N: Cognitive behavioral treatment for depression: Relapse prevention. J Consult Clin Psychol. 1998, 66 (2): 377-384.View ArticlePubMedGoogle Scholar
- Jacobson N, Dobson K, Truax P, Addis M, Koerner K, Gollan J, et al: A component analysis of cognitive-behavioral treatment for depression. J Consult Clin Psychol. 1996, 64 (2): 295-304.View ArticlePubMedGoogle Scholar
- Jacobson N, Gortner E: Can depression be demedicalized in the 21st century? Scientific revolutions, counter revolutions and the magnetic field of normal science. Behav Res Ther. 2000, 38 (2): 103-117. 10.1016/S0005-7967(99)00029-7.View ArticlePubMedGoogle Scholar
- Simons A, Garfield S, Murphy G: The process of change in cognitive therapy and pharmacotherapy: Changes in mood and cognition. Arch Gen Psychiatry. 1984, 41 (1): 45-51. 10.1001/archpsyc.1984.01790120049007.View ArticlePubMedGoogle Scholar
- Rollnick S, Miller W: What is motivational interviewing?. Behavioral and Cognitive Psychotherapy. 1995, 23 (4): 325-334. 10.1017/S135246580001643X.View ArticleGoogle Scholar
- Burke B, Arkowitz H, Menchola M: The efficacy of motivational interviewing: A meta-analysis of controlled clinical trials. J Consult Clin Psychol. 2003, 71 (5): 843-861.View ArticlePubMedGoogle Scholar
- Rubak S, Sandbæk A, Lauritzen T, Christensen B: Motivational interviewing: a systematic review and meta-analysis. Br J Gen Pract. 2005, 55 (513): 305-312.PubMedPubMed CentralGoogle Scholar
- Pouwer F, Tack CJ, Geelhoed-Duijvestin PHLM, Bazelmans E, Beekman AT, Heine RJ, Snoek FJ: Limited effect of screening for depression with written feedback in outpatients with diabetes mellitus: a raondomized controlled trial. Diabetologia. 2011, 54 (4): 741-748. 10.1007/s00125-010-2033-0.View ArticlePubMedPubMed CentralGoogle Scholar
- Majumdar SR, Guirguis LM, Toth EL, Lewanczuk RZ, Lee TK, Johnson JA: Controlled trial of a multifaceted intervention for improving quality of care for rural patients with type 2 diabetes. Diabetes Care. 2003, 26 (11): 3061-3066. 10.2337/diacare.26.11.3061.View ArticlePubMedGoogle Scholar
- Majumdar SR, Johnson JA, Bowker SL, Booth GL, Dolovich L, Ghali W, Harris SB, Hux JE, Holbrook A, Lee H, et al: A Canadian consensus for the standardized evaluation of quality improvement interventions in type 2 diabetes: Development of a Quality Indicator Set. Canadian Journal of Diabetes. 2005, 29 (3): 220-229.Google Scholar
- Johnson JA, Pickard AS: Comparison of the EQ-5D and SF-12 in a general population survey in Alberta, Canada. Med Care. 2000, 38 (1): 115-121. 10.1097/00005650-200001000-00013.View ArticlePubMedGoogle Scholar
- Johnson JA, Maddigan SL: Performance of the RAND-12 and SF-12 summary scores in type 2 diabetes. Quality of Life Research. 2004, 13 (2): 449-456.View ArticlePubMedGoogle Scholar
- Johnson JA, Luo N, Shaw JW, Kind P, Coons SJ: Valuations of EQ-5D health states: are the United States and United Kingdom different?. Med Care. 2005, 43 (3): 221-228. 10.1097/00005650-200503000-00004.View ArticlePubMedGoogle Scholar
- Shaw JW, Johnson JA, Coons SJ: US valuation of the EQ-5D health states: development and testing of the D1 valuation model. Medical Care. 2005, 43 (3): 203-220. 10.1097/00005650-200503000-00003.View ArticlePubMedGoogle Scholar
- McGuire BE, Morrison TG, Hermanns N, et al: Short-form measures of diabetes-related emotional distress: the Problem Areas in Diabetes Scale (PAID)-5 and PAID-1. Diabetologia. 2010, 53 (1): 66-69. 10.1007/s00125-009-1559-5.View ArticlePubMedGoogle Scholar
- Gordon A, Maisto S, McNeil M, et al: Three questions can detect hazardous drinkers. J Fam Pract. 2001, 50 (4): 313-320.PubMedGoogle Scholar
- Smith P, Schmidt S, Allensworth-Davies D, Saitz R: A single-question screening test for drug use in primary care. Arch Intern Med. 2010, 170 (13): 1155-1160. 10.1001/archinternmed.2010.140.View ArticlePubMedPubMed CentralGoogle Scholar
- Godin G, Shephard R: A simple method to assess exercise behavior in the community. Canadian Journal of Applied Sport Sciences. 1985, 10 (3): 141-146.Google Scholar
- Toobert DJ, Hampton SE, Glasgow RE: The Summary of Diabetes Self-Care Activities Measure: results from 7 studies and a revised scale. Diabetes Care. 2000, 23 (7): 943-950. 10.2337/diacare.23.7.943.View ArticlePubMedGoogle Scholar
- Overview of the Questionnaires, Document No. 350. , , CAHPS® Updated 8/19/2008: https://www.cahps.ahrq.gov/cahpskit/cahpskit_main.asp
- Glasgow RE, Whitesides H, Nelson CC, King DK: Use of the Patient Assessment of Chronic Illness Care (PACIC) with diabetic patients: relationship to patient characteristics, receipt of care, and self-management. Diabetes Care. 2005, 28 (11): 2655-2661. 10.2337/diacare.28.11.2655.View ArticlePubMedGoogle Scholar
- Gugiu PC, Coryn C, Clark R, Kuehn A: Development and evaluation of the short version of the Patient Assessment of Chronic Illness Care instrument. Chronic Illness. 2009, 5 (4): 268-276. 10.1177/1742395309348072.View ArticlePubMedGoogle Scholar
- Chew L, Griffin J, Partin M, Noorbaloochi S, Grill J, Snyder A: Validation of screening questions for limited health literacy in a large VA outpatient population. Journal of General Internal Medicine. 2008, 23 (5): 561-566. 10.1007/s11606-008-0520-5.View ArticlePubMedPubMed CentralGoogle Scholar
- Lorig KR, Sobel D, Ritter PL, Laurent D, Hobbs M: Effect of a self-management program for patients with chronic disease. Effective Clinical Practice. 2001, 4 (6): 256-262.PubMedGoogle Scholar
- Roy J, Lin X, Ryan LM: Scaled marginal models for multiple continuous outcomes. Biostatistics. 2003, 4 (3): 371-383. 10.1093/biostatistics/4.3.371.View ArticlePubMedGoogle Scholar
- Guyatt GH, Juniper EF, Walter SD, Griffith LE, Goldstein RS: Interpreting treatment effects in randomised trials. BMJ. 1998, 316 (7132): 690-693. 10.1136/bmj.316.7132.690.View ArticlePubMedPubMed CentralGoogle Scholar
- Johnson JA, Balko SU: Chapter 4, Diabetes and Health Care Utilization in Alberta. Alberta Diabetes Atlas 2011. Edited by: Johnson JA. 2011, Edmonton, AB; Institute of Health Economics, , 35-58.Google Scholar
- Katon W, Unutzer J, Fan M, Williams J, Schoenbaum M, Lin E: Cost-effectiveness and net benefit of enhanced treatment of depression for older adults with diabetes and depression. Diabetes Care. 2006, 29 (2): 265-270. 10.2337/diacare.29.02.06.dc05-1572.View ArticlePubMedGoogle Scholar
- Simon G, Katon J, Lin E, et al: Cost-effectiveness of systematic depression treatment among people with diabetes mellitus. Arch Gen Psychiatry. 2007, 64 (1): 65-72. 10.1001/archpsyc.64.1.65.View ArticlePubMedGoogle Scholar
- Katon W, Russo J, Von Korff M, Lin E, Ludman E, Ciechanowski P: Long-term effects on medical costs of improving depression outcomes in patients with depression and diabetes. Diabetes Care. 2008, 31 (6): 1155-1159. 10.2337/dc08-0032.View ArticlePubMedGoogle Scholar
- Lau R, Ohinmaa A, Johnson JA: Predicting the Future Burden of Diabetes in Alberta from 2008 to 2035. Canadian Journal of Diabetes. 2011, 35 (3): 274-281.View ArticleGoogle Scholar
- Majumdar SR, Lier SA, Rowe BH, Russell AS, McAlister FA, Maksymowych WP, Hanley DA, Morrish DW, Johnson JA: Cost-effectiveness of a multi-faceted intervention to improve quality of osteoporosis care after wrist fracture. Osteoporos International. 2011, 22 (6): 1799-1808. 10.1007/s00198-010-1412-1.View ArticleGoogle Scholar
- Simpson SH, Johnson JA, Tsuyuki RT: Economic impact of community pharmacist intervention in cholesterol risk management: An evaluation of the study of cardiovascular risk intervention by pharmacists (SCRIP). Pharmacotherapy. 2001, 21 (5): 627-635. 10.1592/phco.21.6.627.34538.View ArticlePubMedGoogle Scholar
- Thomas DR: A general inductive approach for analyzing qualitative evaluation data. Am J Eval. 2006, 27 (2): 237-246. 10.1177/1098214005283748.View ArticleGoogle Scholar
- Starks H, Trinidad SB: Choose your method: a comparison of phenomenology, discourse analysis and grounded theory. Qual Heal Res. 2007, 17 (10): 1372-1380. 10.1177/1049732307307031.View ArticleGoogle Scholar
- Mayan MJ: Essentials of Qualitative Inquiry. 2009, Left Coast Press Inc., Walnut Creek, CAGoogle Scholar
- Tri-Council Policy Statement: Ethical Conduct for Research Involving Humans., http://www.pre.ethics.gc.ca/eng/policy-politique/initiatives/tcps2-eptc2/Default/.
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1472-6963/12/258/prepub