- Study protocol
- Open Access
- Open Peer Review
Testing an audit and feedback-based intervention to improve glycemic control after transfer to adult diabetes care: protocol for a quasi-experimental pre-post design with a control group
BMC Health Services Research volume 19, Article number: 885 (2019)
When young adults transfer from pediatric to adult diabetes care they are at risk for deterioration of glycemic control, putting them at an increased risk of developing both acute and chronic complications. Despite increased awareness of these risks, there are gaps in care delivery during this vulnerable time and variability in the implementation of recommended transition practice. Audit and feedback (AF) interventions have a positive but variable effect on implementation of best practices. An expert group identified specific suggestions for optimizing the effectiveness of AF interventions. We aim to test an AF-based intervention incorporating these specific suggestions to improve transition practices and glycemic control in the first year after transfer from pediatric to adult diabetes care.
This is a pragmatic quasi-experimental study; a series of three cohort studies (pre-implementation, early-implementation, and post-implementation) to compare the baseline adjusted hemoglobin A1c (HbA1c) in the 12 months after the final pediatric visit in five pediatric diabetes centres within the Ontario Pediatric Diabetes Network in Ontario, Canada. The intervention includes three components: 1) centre-level feedback reports compiling data from chart abstraction, linked provincial administrative datasets, and patient-reported experience measures; 2) webinars for facilitated conversations/coaching about the feedback; and 3) online repository of curated transition resources for providers. The primary outcome will be analyzed using a multivariable linear regression model. We will conduct a qualitative process evaluation to understand intervention fidelity and to provide insight into the mechanisms of action of our results.
There is a need to develop an innovative system-level approach to improve outcomes and the quality of care for young adults with type 1 diabetes during the vulnerable time when they transfer to adult care. Our research team, a collaboration of health services, implementation science, and quality improvement researchers, are designing, implementing, and evaluating an AF-based intervention using recommendations about how to optimize effectiveness. This knowledge will be generalizable to other care networks that aim to deliver uniformly high-quality care in diverse care settings.
ClinicalTrials.gov NCT03781973. Registered 13 December 2018. Date of enrolment of the first participant to the trial: June 1, 2019.
For individuals with type 1 diabetes, optimizing glycemic control is critical for preventing chronic diabetes complications [1, 2]. Glycemic control deteriorates in adolescence and remains suboptimal throughout the early to mid-20s . This is particularly concerning because glycemic control early in life has a lasting effect on the future risk of developing long-term diabetes complications [1, 2]. Further, during the transfer to adult care, emerging adults are at high risk of dropping out of medical care [4,5,6,7,8]. This may be due to a number of recognized barriers for emerging adults, including feeling unprepared for transition, difficulties scheduling appointments with and making a connection with the new adult team, and lack of perceived value in the clinic visit [9,10,11]. We have shown that there is variability in practice regarding transition to adult diabetes care and gaps in transition care across Ontario pediatric diabetes centres . Improved transition preparation, care coordination, and communication between pediatric and adult providers are needed. However, there is limited evidence to support any particular model of transition care for adolescents with chronic conditions in general and diabetes in particular [13,14,15,16,17,18,19,20,21].
There is an evidence-based, standardized approach with sample tools for providers called ‘Got Transition’ that recommends six core elements of high-quality transition care [22, 23]. The Got Transition/Center for Health Care Transition Improvement is a United States-based cooperative agreement between the Maternal and Child Health Bureau and The National Alliance to Advance Adolescent Health. Implementation of this framework in a pediatric and adult subspecialty diabetes practice improved transition process measures and was associated with stable glycemic control . Audit and feedback (AF) is a quality improvement (QI) approach that involves measuring the quality of care, comparing these results to standards or peer performance, and providing feedback to providers . AF interventions have a positive but variable effect on performance [26, 27]. AF approaches using data from national diabetes registries together with benchmarking against quality indicators to improve pediatric diabetes outcomes have been effective [28,29,30]. An expert group identified specific suggestions for optimizing the effectiveness of practice feedback interventions through expert interviews; systematic reviews; and experience with providing, evaluating, and receiving practice feedback . However, there is little evidence regarding the effectiveness of AF that include key ‘active ingredients’ and of the underlying mechanisms to support the optimal methods for implementation of such interventions .
Ivers et al. have suggested that, in order to advance the field of AF, approaches to optimize and test interventions should be done in collaboration with implementation scientists and health systems or organizations in the context of ‘implementation science laboratories’ [26, 32]. In this article, we describe a study designed by a collaboration of researchers in implementation science, quality improvement, health services, and pediatric diabetes care to test an AF-based intervention that incorporates features identified as key ‘active ingredients’ .
In this study we aim to test the effectiveness of an AF-based intervention to improve diabetes control in the first year after youth transfer from pediatric to adult diabetes care. We will also conduct a process evaluation to assess the intervention fidelity and to understand underlying mechanisms to explain our results . We hypothesize that young adults exposed to the AF-based intervention will have better glycemic control 12 months after their final pediatric visit compared to those not exposed.
We will conduct a pragmatic quasi-experimental study to assess the impact of our AF-based intervention. We adhered to the SPIRIT (Standard Protocol Items: Recommendations for Interventional Trials) guideline for a clinical trial protocol . This will comprise a series of three cohort studies (pre-implementation, early-implementation, and post-implementation) to compare the baseline adjusted hemoglobin A1c (HbA1c) 12 months after the final pediatric visit . Ethics approval for this protocol was granted by the Clinical Trials Ontario Streamlined Research Ethics Review System and the Trillium Health Partners Research Ethics Board. We will conduct a qualitative process evaluation to explore potential underlying mechanisms of our results [36, 37]. The trial is registered on ClinicalTrials.gov (NLM trial registration number: NCT03781973).
In Ontario approximately 7000 children and adolescents live with type 1 diabetes and are cared for by one of the 35 centers in the Ontario Pediatric Diabetes Network (PDN) . In Ontario, youth typically transfer to adult care between age 17 and 19 years . This study will be conducted at five pediatric diabetes centres (three tertiary centres and 2 large community centres) within the Ontario PDN; The Hospital for Sick Children; Trillium Health Partners; Markham Stouffville Hospital; Children’s Hospital, London Health Sciences Centre; and McMaster University Medical Centre. Usual transition care, which is not standardized across sites, will continue during the study period.
The AF-based intervention targets healthcare providers who are pediatric diabetes team members at the participating study sites and was designed using the following four categories of key recommendations for designers of practice feedback and implementation strategies: 1) the nature of the desired action; 2) nature of the data available for feedback; 3) feedback display; 4) and delivering the feedback intervention .
1) The nature of the desired feedback:
Feedback that supports actions that are consistent with established goals and priorities is more likely to be effective . Therefore, we will recommend actions that are consistent with established goals and priorities by introducing ‘Got Transition’, Six Core Elements of Health Care Transition 2.0, a US- funded initiative, that developed a set of six core elements of quality transition care; 1) Transition policy; 2) Transition tracking and monitoring; 3) Transition readiness; 4) Transition planning; 5) Transfer of care; and 6) Transfer completion [40, 41]. These resources will inform providers about best transition practices and provide useful tools to facilitate local quality improvement initiatives [42, 43]. The first report will contain baseline data about transition performance of each site.
2) & 3) The nature of the data available for feedback and feedback display:
Brehaut et al. suggest providing multiple instances of feedback and to closely link the visual display and summary message . As such, we will provide multiple instances of site-specific aggregate feedback; reports every six months during the intervention as described below.
The reports will be populated with data collected from three sources described in detail in the data sources section below: 1) medical record data abstracted from patient charts; 2) provincial population-based administrative databases held at ICES (formerly the Institute of Clinical and Evaluative Sciences); and 3) patient-reported transition experience and outcome measures. The data in the reports will be organized according to the ‘Got Transition’ six core elements . We will display the feedback in the reports with summary messages at the top of each section of data. A template of the centre performance feedback report is available in Additional file 1.
4) Delivering the feedback intervention
To complement the feedback reports, the study team will host a series of webinars for provider participants every three months to give providers an opportunity to reflect on the feedback report and to have facilitated conversations/coaching about the feedback. There will be a total of eight webinars, each scheduled to last 45 min. During the first webinar, the study team will guide participants about how to interpret the report and address the limitations of the feedback data. Sites will also be able to compare their own performance to that of all other centres (anonymously). Each subsequent webinar will be co-hosted by the study team and one study site. Each site will share an example of a QI initiative that they are executing and describe their success and challenges. The study team will post a one-page summary of the main messages discussed at each webinar. Participation in webinars and frequency of accessing the summaries will be monitored and used as part of the process evaluation.
As a supplement to the “Got Transition” Six Core Elements, we will post additional transition resources that currently exist in the public domain in a dedicated space for study materials within a provincial QI online forum, call Quorum . The resources were selected from those recommended in the Ontario PDN Transition to Adult Care Working Group Recommendations Report . These resources will be available to health care provider participants to use as part of their QI initiative if they choose. We will track the frequency that the resources on the study website are accessed as part of our process evaluation.
Health care providers: All health care professionals (i.e., physicians (including endocrinology residents), nurses, dieticians, social workers, and psychologists), who are members of the diabetes healthcare team at participating sites, will be invited to participate in the intervention. Health care providers will be invited to use the feedback reports, participate in the webinars, and access the online resources to facilitate transition care related QI activities within their diabetes healthcare teams. Each team will identify a local “transition champion” to lead local team discussions aimed at identifying areas in need of improvement based on the feedback report and to develop and execute quality improvement projects designed to address the gap(s).
Patients: Three separate patient cohorts will be constructed: (i) those whose last pediatric visit was in the year before the intervention (pre-implementation); (ii) those whose last pediatric visit was in the year immediately after the start of the intervention (early-implementation); (iii) those whose last pediatric visit was in the second year after the intervention (post-implementation). We estimate that our sample size will be approximately 225 individuals per cohort, with individual sites contributing between 25 and 70 individuals to each cohort.
We will invite all participants in the early and post-intervention study cohorts to complete the patient experience surveys. Each site will pre-identify eligible participants who are due to come to clinic for their final pediatric visit. We will mail or email (depending on site-specific clinic practice) an information letter, signed by their own diabetes team, describing our study to all eligible participants. The letter will contain an opt-out contact email and phone number if they do not want to be contacted about participating. The letter will explain our research project, what data we plan to collect and how we will use it. At their final pediatric visit, a research coordinator will meet the participant and invite them to complete the baseline survey and confirm a mailing and email addresses for the 12 month follow-up survey. We will offer an incentive gift card to participants for each survey they complete as a strategy for achieving adequate participant enrolment.
All youth living with type 1 diabetes followed at participating sites will enter the study at the time of their final pediatric clinic visit and will be followed for a minimum of 12 months up to the end of the study period. The final pediatric visit will be the visit at which a referral to an adult diabetes physician is made and is planned to be the final pediatric visit. We will exclude individuals with non-type 1 diabetes, those who plan to move out of Ontario within 12 months after their final pediatric visit, and those who do not have the capacity to consent for themselves.
Data for use in the feedback reports will be derived from medical charts, routinely collected provincial administrative data linked using unique encoded identifiers at ICES, and patient-reported transition experience measures (for those cohorts ii and iii). The provincial health insurance number and participants’ study IDs will be securely transferred to ICES and linked to ICES databases. The study investigators will be permitted to access de-sensitized information only for analysis (i.e., any information that can directly identify a person such as the provincial health insurance number or name will be removed or replaced with a code that is not known to the study investigators).
Data abstracted from the chart will include, Ontario Health Insurance Plan (OHIP) number (to link to administrative datasets at ICES), date of diabetes diagnosis, last HbA1c available while in pediatric care (within 12 months before the final pediatric visit), method of HbA1c collection (lab vs. point of care testing (POCT)), HbA1c laboratory assay or POCT testing platform, the date of the final pediatric visit, and the name of the adult diabetes clinic to which the patient is referred.
We will extract data from the following ICES databases: 1) Ontario Lab Information System (OLIS)(to measure HbA1c while in adult care); 2) the Hospital Discharge Abstract Database (information on discharges from acute care facilities); 3) the Ontario Health Insurance Plan Database (physician billing claims); 4) the National Ambulatory Care Reporting System (information on emergency department visits); 5) the Registered Persons Database (demographics and vital statistics including outmigration of all legal residents in Ontario); 6) the Ontario Registrar General-Death for cause of death; 7) the Assistive Devices Program (ADP) to identify claims for insulin pumps and supplies; 8) the 2016 Canadian Census to assign neighbourhood material deprivation quintiles to Ontario residents; 9) The Ontario Mental Health Reporting System (data on patients in inpatient mental health beds); and 10) ICES physician database (identifies physician speciality).
Patient experience measures
We will conduct a patient transition experience survey at the final pediatric visit (baseline) and 12 months later for the early and post-implementation cohorts only. We modified the survey used in the T1D Exchange Transition Experiences Study which includes the following domains: 1) Current Diabetes Care; 2) Pediatric Diabetes Care; 3) Transition from Pediatric to Adult Care; 4) Current Diabetes Self-Care and Support; 5) Social Networking; and 6) Demographics (Additional file 2) . The results of the survey will be included in the performance feedback reports to centres. These will not be used as an outcome measure since these will not be measured in the pre-implementation cohort.
The outcomes and covariates, period of ascertainment, and data sources are summarized in Table 1. The primary outcome is HbA1c (the last HbA1c value available during the 12 months after the final pediatric visit), ascertained from OLIS. We will adjust for the baseline HbA1c at the time of the final pediatric visit in the regression model, which will be ascertained from the medical record, because not all pediatric hospital laboratory data are available in OLIS. Secondary outcomes will include the occurrence of at least one diabetes-related admission or emergency department visit, or all-cause death in the 12 months after the final pediatric visit. We will use ICD-10-CA codes for diabetes-related preventable hospitalizations to identify diabetes-related admissions [46, 47]. We will measure all-cause death, as not all sources of mortality data include cause of death. We will also measure the time from the final pediatric visit (extracted from the medical record) to the first adult diabetes visit, identified using physician service claims and defined as the first diabetes office visit by an adult endocrinologist or internist after the final pediatric visit.
The main exposure is the cohort variable: (i) those youth whose last pediatric visit was in the year before the intervention (pre-implementation); (ii) those whose last pediatric visit was in the year immediately after the start of the intervention (early-implementation); and (iii) those whose last pediatric visit was in the second year after the intervention (post-implementation).
We will estimate socioeconomic status using household income, assigned ecologically at the neighbourhood level using postal codes, divided into quintiles . Other covariates are sex and duration of diabetes on the date of the final pediatric visit. We will use the Rurality Index for Ontario, based on community characteristics including access to health services, to categorize rurality . We will measure the presence of any prior acute diabetes complications (diabetes-related admissions and emergency department visits) and any prior mental health visit (either hospital admission or physician visit for a mental health problem) within 24 months prior to the final pediatric visit as baseline covariates. A list of mental health diagnostic codes used to identify outpatient physician visits for a mental health problem are available in Additional file 3.
We will describe the baseline characteristics and the occurrence of any missing data for each cohort using descriptive statistics. We will test the effectiveness of the intervention using a multivariable linear regression model that regresses HbA1c (the last HbA1c value available during the 12 months after the final pediatric visit) on the main exposure variable (the main exposure variable is the cohort variable) using data from all three cohorts pooled together. The model will also adjust for the following variables: last recorded value of HbA1c at the final pediatric visit, pediatric diabetes centre, and the covariates listed above. Our sample size of 675 individuals in 3 cohorts provides us with 92% power to detect a difference in means between the three cohorts, based on analysis of covariance, in which we adjust for baseline HbA1c and the other variables described above. This assumes that the mean HbA1c in the control and early-intervention cohorts is 8.82% and that it is 8.32% in the late-intervention cohort, with a common standard deviation of 1.75. This is based on the observation that the mean HbA1c and standard deviation for all individuals aged 18–24 years with diabetes diagnosed before age 15 years in Ontario from 2011 to 2014 was 8.82% ±1.75 (unpublished). We will also include an interaction term between the cohort variable and diabetes centre to determine if the effect of the intervention is different depending on the pediatric centre. We will also report sex-stratified outcomes.
We will assess the effect of the intervention on the occurrence of any acute diabetes complication or death using a logistic regression model. We will assess the effect of the intervention on the time to first adult diabetes visit using a Cox proportional hazards model. For both models, the main exposure variable will be the cohort (pre-implementation vs. early-implementation vs. post-implementation). We will also adjust for pediatric diabetes centre (5 levels) and the covariates listed above.
The quantitative data collected to assess the outcomes of the trial are important to determining if the intervention works. However qualitative approaches are particularly useful for understanding how and why a given intervention works or not . We will conduct a qualitative process evaluation to understand whether the intervention was received as intended (i.e., intervention fidelity), the mechanisms of action, and the contextual features associated with engagement with the intervention (i.e., conditions and factors that might affect trial results at each of the study sites, as well as macro level health system factors) . Data sources will include focus groups with diabetes team members, conducted following the receipt of first feedback and at end of the trial . There will be a set of two initial focus groups conducted virtually by videoconference with the site champions from each of the participating sites . The rationale for the initial set of focus groups is to understand the trial as it is unfolding (and to explore how the feedback is being received). This will allow us to address any challenges to implementation, with a view to optimizing recruitment/participation in the final round of focus groups, as well as informing data collection procedures at end of trial (e.g., refinement of final focus group guide for the process evaluation). At the end of the trial we will conduct one focus group with all available diabetes team members at each of the participating sites. For all focus groups, we will use a semi-structured interview guide informed by the consolidated framework for advancing implementation science to capture diabetes team members’ experiences of participating in the QI intervention . For the final round of focus groups, we will aim to include between 6 and 8 participants per group . We will audio record and transcribe the focus groups. Focus groups will all be conducted by experienced qualitative researchers. During focus groups two researchers will be present – one to facilitate the group and one to take detailed field notes of the discussion (e.g., group dynamics, non-verbal communication, etc.). We will use a qualitative descriptive approach to analyze the focus group transcripts . Constant comparison will be conducted to look for differences and similarities within and across groups and between data sources .
There is a need to develop an innovative system-level approach to improve outcomes and the quality of care for youth during the vulnerable time while they transition from pediatric to adult diabetes care. We are taking advantage of an existing network of pediatric diabetes programs that is committed to improving the quality of care, an accepted general transition care practice guideline, and population-level provincial administrative datasets to design, implement, and evaluate an AF-based intervention using recommendations about how to optimize effectiveness . Our findings will serve as a foundation on which to build future trials embedded within existing QI programs to optimize the effectiveness of AF and transition practice.
Improving outcomes of and the quality of diabetes transition care is a key priority for the Ontario PDN and other national and international diabetes organizations [45, 52, 53]. Unlike existing models of transition care that are limited by their cost, scalability, and generalizability, our approach can be expanded in scale and modified to function in local contexts and used in conjunction with existing diabetes registries and administrative datasets. Our intervention can be translated immediately into clinical practice and will have a direct impact on how services are delivered to youth with diabetes.
Further, our embedded process evaluation aims to advance knowledge about the mechanisms underlying the effectiveness of specific components of AF and to assess the variable impact of different components . Results of the process evaluation will inform future work to refine the optimal design, delivery, and additional features of our AF-based intervention. We anticipate using this knowledge to address some of the limitations of our study. One such limitation is the risk of poor provider engagement. To mitigate this risk, study teams have agreed to participate in our webinars during their regularly scheduled team meeting times in order to minimize the burden on providers. Further, we hope that the discussion about the feedback reports, coaching, and availability of online transition resources will incentivize provider participation in the webinars and ignite enthusiasm for local QI initiatives. In order to maximize patient enrollment, we are offering monetary incentives for completing the baseline and 12 month follow-up patient surveys.
Further, we are unable to identify diabetes visits to non-physician providers from our administrative data. Therefore, we may over-estimate the time from the last pediatric visit to the first adult diabetes visit if the first visit was to a diabetes nurse or dietician educator. Finally, we recognize that delivery of adult diabetes care is an important contributing factor to transition outcomes. It is not feasible to include adult diabetes centres in this study because only small numbers of patients are transferred to each of the many adult diabetes program each year; however, we have three adult diabetes providers on our research team to provide an adult provider perspective and we will provide a study summary report to local adult diabetes programs.
We are using this study as a foray to develop an “implementation laboratory” within the Ontario PDN [32, 54]. We envision an ongoing collaboration between the PDN and our research team to embed implementation research within the fabric of its quality improvement initiatives. The PDN is committed to QI and is currently undertaking evaluative processes to inform its QI strategies. The PDN is an ideal setting for an implementation laboratory because there are health system characteristics common to all PDN sites, yet each of the 35 sites resides in a unique context in which there is an opportunity to explore how local factors modify the effect of an intervention . Given that members of our research team are also members of the PDN Quality and Clinical Standards Committee, we can work to ensure that the goals and objectives of both our research team and the PDN are aligned and met.
Looking ahead, Health Quality Ontario is currently developing quality standards for care for people living with type 1 diabetes expected to be available in spring/summer 2020. These quality statements accompanied by their structure, process and/or outcome indicators, could be incorporated into implementation strategies and tested in this proposed implementation laboratory. Our goal is to generate evidence that is generalizable to other care networks that aim to deliver uniformly high quality care in diverse care settings.
Availability of data and materials
Audit and feedback
Ontario Lab Information System
Pediatric Diabetes Network
Sustained effect of intensive treatment of type 1 diabetes mellitus on development and progression of diabetic nephropathy: the Epidemiology of Diabetes Interventions and Complications (EDIC) study. JAMA. 2003;290(16):2159–67.
Nathan DM, Cleary PA, Backlund JY, Genuth SM, Lachin JM, Orchard TJ, et al. Intensive diabetes treatment and cardiovascular disease in patients with type 1 diabetes. N Engl J Med. 2005;353(25):2643–53.
Miller KM, Foster NC, Beck RW, Bergenstal RM, DuBose SN, DiMeglio LA, et al. Current state of type 1 diabetes treatment in the U.S.: updated data from the T1D exchange clinic registry. Diabetes Care. 2015;38(6):971–8.
Lotstein DS, Seid M, Klingensmith G, Case D, Lawrence JM, Pihoker C, et al. Transition from pediatric to adult Care for Youth Diagnosed with Type 1 diabetes in adolescence. Pediatrics. 2013;131(4):e1062–e70.
Frank M. Factors associated with non-compliance with a medical follow-up regimen after discharge from a pediatric diabetes clinic. Canadian Journal of Diabetes Care. 1996;20:13–20.
Pacaud D, Yale J, Stephure D, Trussell R, Davies HD. Problems in transition from pediatric care to adult care for individuals with diabetes. Can J Diabetes. 2005;29(1):13–8.
Garvey KC, Wolpert HA, Rhodes ET, Laffel LM, Kleinman K, Beste MG, et al. Health care transition in patients with type 1 diabetes: young adult experiences and relationship to glycemic control. Diabetes Care. 2012;35(8):1716–22.
Shulman R, Shah BR, Fu L, Chafe R, Guttmann A. Diabetes transition care and adverse events: a population-based cohort study in Ontario. Canada Diabet Med. 2018;35(11):1515–22.
Hynes L, Byrne M, Dinneen SF, McGuire BE, O'Donnell M, Mc SJ. Barriers and facilitators associated with attendance at hospital diabetes clinics among young adults (15-30 years) with type 1 diabetes mellitus: a systematic review. Pediatr Diabetes. 2016;17(7):509–18.
Garvey KC, Foster NC, Agarwal S, DiMeglio LA, Anderson BJ, Corathers SD, et al. Health care transition preparation and experiences in a U.S. National Sample of Young adults with type 1 diabetes. Diabetes Care. 2017;40(3):317–24.
Nakhla M, Bell LE, Wafa S, Dasgupta K. Improving the transition from pediatric to adult diabetes care: the pediatric care provider’s perspective in Quebec, Canada. BMJ Open Diabetes Res Care. 2017;5(1):e000390.
Shulman R, Chafe R, Guttmann A. Transition to adult diabetes care: A description of practice in the Ontario Pediatric Diabetes Network. Canadian journal of diabetes. 2018;accepted.
Frank M. Evaluation of a transition from pediatrics to adult diabetes care program. Can J Diabetes. 2002;26(Suppl. 1):253.
Vidal M, Jansa M, Anguita C, Torres M, Giménez M, Esmatjes E, et al. Impact of a special therapeutic education programme in patients transferred from a paediatric to an adult diabetes unit. Eur Diabetes Nurs. 2004;1(1):23–7.
Lane JT, Ferguson A, Hall J, McElligott M, Miller M, Lane PH, et al. Glycemic control over 3 years in a young adult clinic for patients with type 1 diabetes. Diabetes Res Clin Pract. 2007;78(3):385–91.
Kipps S, Bahu T, Ong K, Ackland FM, Brown RS, Fox CT, et al. Current methods of transfer of young people with type 1 diabetes to adult services. Diabet Med. 2002;19(8):649–54.
Van Walleghem N, Macdonald CA, Dean HJ. Evaluation of a systems navigator model for transition from pediatric to adult care for young adults with type 1 diabetes. Diabetes Care. 2008;31(8):1529–30.
Cadario F, Prodam F, Bellone S, Trada M, Binotti M, Allochis G, et al. Transition process of patients with type 1 diabetes (T1DM) from paediatric to the adult health care service: a hospital-based approach. Clin Endocrinol. 2009;71(3):346–50.
Hardy KJ, O'Brien SV, Furlong NJ. Information given to patients before appointments and its effect on non-attendance rate. BMJ. 2001;323(7324):1298–300.
Holmes-Walker DJ, Llewellyn AC, Farrell K. A transition care programme which improves diabetes control and reduces hospital admission rates in young adults with type 1 diabetes aged 15-25 years. Diabet Med. 2007;24(7):764–9.
Markowitz B, Parsons JA, Advani A. Diabetes in emerging adulthood: transitions lost in translation. Can J Diabetes. 2017;41(1):1–5.
Cooley WC, Sagerman PJ. Supporting the health care transition from adolescence to adulthood in the medical home. Pediatrics. 2011;128(1):182–200.
Got transition? Center for Health Care Transition Improvement National Alliance to Advance Adolescent Health [accessed June 19, 2019:[Available from: https://www.gottransition.org/.
Jones MR, Robbins BW, Augustine M, Doyle J, Mack-Fogg J, Jones H, et al. Transfer from pediatric to adult endocrinology. Endocr Pract. 2017;23(7):822–30.
Ivers N, Jamtvedt G, Flottorp S, Young JM, Odgaard-Jensen J, French SD, et al. Audit and feedback: effects on professional practice and healthcare outcomes. The Cochrane database of systematic reviews. 2012;6:CD000259.
Ivers NM, Grimshaw JM, Jamtvedt G, Flottorp S, O'Brien MA, French SD, et al. Growing literature, stagnant science? Systematic review, meta-regression and cumulative analysis of audit and feedback interventions in health care. J Gen Intern Med. 2014;29(11):1534–41.
Hysong SJ, Best RG, Pugh JA. Audit and feedback and clinical practice guideline adherence: making feedback actionable. Implementation science : IS. 2006;1:9.
Margeirsdottir HD, Larsen JR, Kummernes SJ, Brunborg C, Dahl-Jorgensen K. The establishment of a new national network leads to quality improvement in childhood diabetes: implementation of the ISPAD guidelines. Pediatr Diabetes. 2010;11(2):88–95.
Peterson A, Hanberger L, Akesson K, Bojestig M, Andersson Gare B, Samuelsson U. Improved results in paediatric diabetes care using a quality registry in an improvement collaborative: a case study in Sweden. PLoS One. 2014;9(5):e97875.
Samuelsson U, Akesson K, Peterson A, Hanas R, Hanberger L. Continued improvement of metabolic control in Swedish pediatric diabetes care. Pediatr Diabetes. 2018;19(1):150–7.
Brehaut JC, Colquhoun HL, Eva KW, Carroll K, Sales A, Michie S, et al. Practice feedback interventions: 15 suggestions for optimizing effectiveness. Ann Intern Med. 2016;164(6):435–41.
Ivers NM, Grimshaw JM. Reducing research waste with implementation laboratories. Lancet. 2016;388(10044):547–8.
Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M. Developing and evaluating complex interventions: the new Medical Research Council guidance. BMJ. 2008;337:a1655.
Chan AW, Tetzlaff JM, Altman DG, Laupacis A, Gotzsche PC, Krleza-Jeric K, et al. SPIRIT 2013 statement: defining standard protocol items for clinical trials. Ann Intern Med. 2013;158(3):200–7.
Penfold RB, Zhang F. Use of interrupted time series analysis in evaluating health care quality improvements. Acad Pediatr. 2013;13(6 Suppl):S38–44.
Parsons JA, Yu CH, Baker NA, Mamdani MM, Bhattacharyya O, Zwarenstein M, et al. Practice Doesn't always make perfect: a qualitative study explaining why a trial of an educational toolkit did not improve quality of care. PLoS One. 2016;11(12):e0167878.
Patton MQ. Qualitative Research & Evaluation Methods. 3rd ed. Thousand Oaks: Sage; 2002.
Shulman R, Miller FA, Stukel TA, Daneman D, Guttmann A. Resources and population served: a description of the Ontario Paediatric diabetes network. CMAJ open. 2016;4(2):E141–6.
A Guideline for Transition From Paediatric to Adult Health Care for Youth with Special Health Care Needs: A National Approach. Canadian Association of Paediatric Health Centres (CAPHC), 2016. http://ken.caphc.org/xwiki/bin/download/Transitioning+from+Paediatric+to+Adult+Care/A+Guideline+for+Transition+from+Paediatric+to+Adult+Care/2017%2005%2010%20CAPHC%20Transition%20to%20Adult%20HC%20Guideline.pdf
Kite J, Phongsavan P. Insights for conducting real-time focus groups online using a web conferencing service. F1000Research. 2017;6:122.
Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implementation science : IS. 2009;4:50.
Lehoux P, Poland B, Daudelin G. Focus group research and "the patient's view". Soc Sci Med. 2006;63(8):2091–104.
Sandelowski M. Whatever happened to qualitative description? Res Nurs Health. 2000;23(4):334–40.
Quorum [accessed June 19, 2019]. Available from: https://quorum.hqontario.ca/en
Ontario Pediatric Diabetes Network. Transition to Adult Care Working Group Recommendations Report. 2016 February. Report No. http://www.pcmch.on.ca/wp-content/uploads/2016/03/PDN_TACWGRecommendationsReport_Feb152016_FINAL.pdf
Shulman R, Stukel TA, Miller FA, Newman A, Daneman D, Wasserman JD, et al. Low Socioeconomic Status is Associated with Adverse Events in Children and Teens on Insulin Pumps under a Universal access program: A population-based cohort study. BMJ Open Diabetes Research and Care. 2016;in press.
Diabetes Short-Term Complications Admission Rate Technical Specifications: Agency for Healthcare Research and Quality; 2013 [Available from: http://www.qualityindicators.ahrq.gov/Downloads/Modules/PQI/V44/TechSpecs/PQI%2001%20Diabetes%20Short-term%20Complications%20Admissions%20Rate.pdf
Mustard CA, Derksen S, Berthelot JM, Wolfson M. Assessing ecologic proxies for household income: a comparison of household and neighbourhood level income measures in the study of population health status. Health Place. 1999;5(2):157–71.
Kralj B. Measuring "rurality" for purposes of health-care planning: an empirical measure for Ontario. Ont Med Rev. 2000:33–52.
Moore GF, Audrey S, Barker M, Bond L, Bonell C, Hardeman W, et al. Process evaluation of complex interventions: Medical Research Council guidance. BMJ. 2015;350:h1258.
Kvale S. InterViews: an introduction to qualitative research interviewing. Thousand Oaks: Sage Publications; 1996.
Wherrett DK, Ho J, Huot C, Legault L, Nakhla M, Rosolowsky E. Type 1 diabetes in children and adolescents. Can J Diabetes. 2018;42(Suppl 1):S234–s46.
Cameron FJ, Garvey K, Hood KK, Acerini CL, Codner E. ISPAD clinical practice consensus guidelines 2018: diabetes in adolescence. Pediatr Diabetes. 2018;19(Suppl 27):250–61.
Grimshaw JM, Ivers N, Linklater S, Foy R, Francis JJ, Gude WT, et al. Reinvigorating stagnant science: implementation laboratories and a meta-laboratory to efficiently advance the science of audit and feedback. BMJ quality & safety. 2019;28(5):416–23.
This study is funded by a Canadian Institutes of Health Research New Investigator Grants in Maternal, Reproductive, Child and Youth Health. Matching funds for this grant are provided by the Sickkids Research Institute and the Hospital for Sick Children, Department of Pediatrics. Dr. Austin was supported by a Mid-Career Investigator Award from the Heart and Stroke Foundation. The funding bodies had no role in the design of the study, collection, analysis, interpretation of data, or in writing the manuscript.
Ethics approval and consent to participate
Ethics approval for this protocol was granted by the Clinical Trials Ontario (CTO) Streamlined Research Ethics Review System for four out of five study sites. CTO research sites participating in a multi-site research study undergo a single ethics review. Ethics approval was also granted by the Trillium Health Partners Research Ethics Board.
Informed written consent is being obtained from all participants in the early and late-intervention cohorts.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Shulman, R., Zenlea, I., Shah, B.R. et al. Testing an audit and feedback-based intervention to improve glycemic control after transfer to adult diabetes care: protocol for a quasi-experimental pre-post design with a control group. BMC Health Serv Res 19, 885 (2019) doi:10.1186/s12913-019-4690-0
- Health services research
- Audit and feedback
- Type 1 diabetes
- Transition to adult care