- Research article
- Open Access
Implementation of a group-based diabetes prevention program within a healthcare delivery system
BMC Health Services Research volume 19, Article number: 694 (2019)
Group-based Diabetes Prevention Programs (DPP), aligned with recommendations from the Centers for Disease Control and Prevention, promote clinically significant weight loss and reduce cardio-metabolic risks. Studies have examined implementation of the DPP in community settings, but less is known about its integration in healthcare systems. In 2010, a group-based DPP known as the Group Lifestyle Balance (GLB) was implemented within a large healthcare delivery system in Northern California, across three geographically distinct regional administration divisions of the organization within 12 state counties, with varying underlying socio-demographics. The regional divisions implemented the program independently, allowing for natural variation in its real-world integration. We leveraged this natural experiment to qualitatively assess the implementation of a DPP in this healthcare system and, especially, its fidelity to the original GLB curriculum and potential heterogeneity in implementation across clinics and regional divisions.
Using purposive sampling, we conducted semi-structured interviews with DPP lifestyle coaches. Data were analyzed using mixed-method techniques, guided by an implementation outcomes framework consisting of eight constructs: acceptability, adoption, appropriateness, cost, feasibility, fidelity, penetration, and sustainability.
We conducted 33 interviews at 20 clinics across the three regional administrative divisions. Consistencies in implementation of the program were found across regions in terms of satisfaction with the evidence base (acceptability), referral methods (adoption), eligibility criteria (fidelity), and strategies to increase retention and effectiveness (sustainability). Heterogeneity in implementation across regions were found in all categories, including: the number and frequency of sessions (fidelity); program branding (adoption); lifestyle coach training (adoption), and patient-facing cost (cost). Lifestyle coaches expressed differing attitudes about curriculum content (acceptability) and suitability of educational level (appropriateness). While difficulties with recruitment were common across regions (feasibility), strategies used to address these challenges differed (sustainability).
Variation exists in the implementation of the DPP within a large multi-site healthcare system, revealing a dynamic and important tension between retaining fidelity to the original program and tailoring the program to meet the local needs. Moreover, certain challenges across sites may represent opportunities for considering alternative implementation to anticipate these barriers. Further research is needed to explore how differences in implementation domains impact program effectiveness.
Contributions to the literature
Little is known about the integration of the Group-based Diabetes Prevention Programs (DPP), aligned with recommendations from the Centers for Disease Control and Prevention, in healthcare systems. We assessed the implementation and local adaptations in structure and design of a DPP within a large healthcare delivery system in Northern California, across three geographically distinct regional administration divisions of the organization within 12 state counties, with varying underlying socio-demographics.
We found instances of both consistency and variation in implementation of the program across three geographic regions, with very different underlying sociodemographic characteristics.
The findings of our study expose a dynamic and important tension between the attempt to retain fidelity to the original evidence-based program and the need to tailor the program to meet the local needs of the organization, distinct patient populations, and the clinical context.
According to the Centers for Disease Control and Prevention (CDC), around 70% of Americans are overweight or obese, of which 9.5% have diagnosed type 2 diabetes (T2D) . Further, an estimated 84 million people in the United States (U.S.) have prediabetes, a condition that increases the risk of T2D and cardiovascular diseases (CVD) and in some instances may be reversible . Given the increased direct and indirect costs of T2D , and its adverse outcomes on the individual’s quality of life , opportunities for prevention are of paramount importance for the long-term health of the American population and the efficiency of the healthcare system .
Research has shown that lifestyle interventions promoting moderate physical activity and healthy eating habits positively impact long-term weight management and prevention of T2D [2, 5]. The Diabetes Prevention Program (DPP) was a landmark randomized controlled trial (RCT) that established the gold standard for T2D prevention in the U.S . The trial demonstrated that a predominantly one-on-one lifestyle behavioral intervention, promoting weight loss through healthy eating habits and increased physical activity, reduced CVD risk factors [7,8,9] and lowered the risk of developing T2D by 58% relative to placebo, [6, 10,11,12] irrespective of age, gender, race, and ethnicity [7, 13, 14]. Given the efficacy of the DPP intervention [8, 15,16,17] in 2010 Congress authorized the CDC to establish the National DPP to facilitate large-scale dissemination and implementation of effective lifestyle interventions modeled after the original DPP intervention . As a result, organizations across the nation began to offer group-based versions of the DPP, in community and clinical settings [15, 17, 19]. Numerous subsequent studies [20,21,22] of group-based DPP translations in primarily community-based settings, have demonstrated the effectiveness of these adapted programs in reducing the T2D risk among participants.
The CDC established the National Diabetes Prevention Recognition Program (DPRP) to ensure quality and effectiveness of evidence-based DPP translations. CDC guidelines leave much room for variation in the format of program delivery. While the National DPRP provides standards and basic criteria that must be met by all CDC-recognized programs, there is still room for variation allowing for organizations to adapt aspects of the program to a particular setting. There is little information on the implementation of this program and the ways in which it is adapted to meet local needs. Research is needed to understand the extent of this variation in the context of real-world implementation and to explore the balance between the importance of fidelity to the program and the need to tailor the program to specific populations and delivery environments in order to optimize outcomes.
In 2010, a group-based DPP known as the Group Lifestyle Balance™ (GLB) program was implemented within a large healthcare delivery system in Northern California, across three geographically distinct regional administration divisions of the organization within 12 state counties, with varying underlying sociodemographics. The regional divisions implemented the program independently, allowing for natural variation in its real-world integration. The aim of this study was to assess the implementation of a DPP in this healthcare system and, especially, its fidelity to the original GLB curriculum and potential heterogeneity in implementation across clinics and regional divisions. This natural experiment provides a unique opportunity to explore variation in the integration and adaptations of a group-based DPP (hereafter group-DPP). Findings may inform national diabetes prevention guidelines for ensuring both program fidelity while allowing for appropriate local adaptations.
This was a qualitative, descriptive study. We conducted semi-structured interviews with DPP lifestyle coaches (LCs). LCs are existing clinical staff who facilitated the face to face program sessions to program participants. They are typically dieticians or nurses who receive additional training in order to facilitate the DPP program. Data were analyzed using mixed-method techniques, guided by an implementation outcomes framework consisting of eight constructs as described below.
This study was conducted at Sutter Health, a large multi-specialty healthcare delivery system in northern California. Sutter Health serves approximately 3 million patients per year in more than 100 communities across 5 regional administrative divisions. Sutter Health is a mixed-payer, fee-for-service (FFS) provider organization, which contracts with various commercial payers, as well as the Centers for Medicare and Medicaid Services. Sutter Health’s group-DPP, the GLB program (15, 16), was implemented at a total of 20 clinic sites between 2010 and 2016. The GLB was developed by the University of Pittsburgh [7, 8, 10, 15, 23]. The curriculum is composed of 16 core sessions (12 weekly intensive core sessions and 4 biweekly transition sessions), followed by 6 monthly maintenance sessions (i.e. post-core) [10, 15, 24]. The program emphasizes on goal setting and planning, problem solving and social support, enhancing motivation to engage in healthy lifestyle practices, as well as self-monitoring of physical and calorie intake using a weekly food and physical activity tracker [10, 15]. During the maintenance sessions, skills learned during the core sessions are reinforced, and cognitive and behavioral strategies are introduced for long term-weight management .
We examined the implementation of the program across three geographical distinct regional administrative divisions within a single healthcare system (Fig. 1). We examined the consistency and variability in implementation across clinic sites using the implementation outcomes framework developed by Proctor et al. 2011 . This framework puts forth the concept of “implementation outcomes” as distinct from service system and clinical treatment outcomes and proposes a heuristic consisting of eight conceptually distinct but interrelated implementation outcomes: adoption, penetration, acceptability, appropriateness, feasibility, fidelity, implementation cost and sustainability  (Table 1).
Interview protocol and procedures
We used purposive sampling to identify program LCs within each region and clinic site. Study team members (CN and NKS) first contacted program managers at each region by phone to explain the aim of the study and gather data on the features of the program, number of clinics offering the program, and names and contact information of LCs at each clinic. Then, current and previous program LCs were contacted by email to explain the aim of the study and to schedule semi-structured in-person interviews with them. Interviews were conducted at 20 clinic sites across the three regions between November 2017 and March 2018 by two research associates trained in qualitative research (CN and NKS).
Interviews lasted between 30 and 90 min. Interviewers used a semi-structured interview guide including both close-ended and open-ended questions covering the following: 1) LCs’ demographic characteristics; 2) characteristics of program clinic site; 3) eligibility and recruitment of program participants; 4) implementation and characteristics of the program; 5) maintenance and changes made over time; and 6) outcomes of the program. The interview guide was pilot tested and edited accordingly with a LC who previously provided the program at one of the clinic sites. Interviews were audio recorded using encrypted voice recorders and were then transcribed verbatim. In addition, study team members took thorough notes of all the information provided by participants and collected program flyers from each clinic sites. All study activities were reviewed and approved by the healthcare organization’s Institutional Review Board.
We utilized multiple methods to ensure the validity and reliability of the results reported below. First, after completing the interviews with LCs, the study team conducted a document review of all the notes taken during the interview as well as information included in the program flyers collected from clinic sites and information provided by site managers to confirm some of the accuracy of the information provided by LCs. Next, responses to close-ended questions included in the interview guide were analyzed quantitatively on STATA 16 using descriptive statistics (see Table 2). Responses to open-ended questions were analyzed thematically using a combination of deductive and inductive approaches in Dedoose, a multifunctional mixed-methods platform . To identify inductive themes, three members of the study team (JJP, CN, NKS) reviewed 1233 transcribed pages of interviews and independently created a preliminary set of emergent codes characterizing the key themes discussed in the interviews. These codes were then reviewed together by the study team and revised, and organized into a structured codebook including a total of 68 codes. Three coders (CN, NKS & JJP) independently applied a total of 15,698 codes in Dedoose.
When coding was complete, the team reviewed the data by code to identify the relevant implementation outcomes based on our conceptual framework. Inductive codes were assigned to relevant outcomes based on their definitions (see Table 1) using a team-based consensus approach. We aligned our inductively-derived thematic codes with the relevant constructs from the conceptual framework to structure our findings. For example, excerpts coded as “content/characteristics” and “background evidence of program” are reported as elements of acceptability, “program visibility” and “experience/training” elements of adoption, and “strategies for change” of sustainability. We then identified exemplary quotes to illustrate the key ideas grouped by the eight implementation outcomes.
The group-DPP is offered within three of five regional administrative division of the healthcare system (Fig. 1). Regions differed in underlying sociodemographic characteristics (Fig. 1) and the sociodemographic characteristics of program participants (Additional file 1). Region 1, the largest geographically of the three, spans seven counties, with an underlying racial/ethnic minority population of 23% Hispanic, 13% Asian, and 8% Black/African American , and a median household income of $73,439 . Region 2 covers five counties, has a higher average household income of $106,489  and different demographic with a larger Asian population (29%) . Region 3’s catchment area includes three counties, which includes a larger Hispanic population (42% Hispanic)  compared to the other two regions and the lowest average household income of $60,170 .
All LCs agreed to participate in the study. A total of 33 LCs were interviewed, representing 20 clinics across the 3 regions (Table 2). Most LCs were female (97%) with a mean age ± SD of 48 ± 9.6 years. A majority of LCs were dieticians (94%) and health or diabetes educators (84.8%), with an average experience ± SD of 3.1 ± 2.02 years facilitating the program.
According to Proctor et al., adoption refers to experiences in the initial uptake and intention to try to implement the program. The group-DPP was first implemented in 2010 at 8 clinic sites: Region 1 (4 sites) and Region 2 (4 sites), and in 2011 at two additional sites (1 site in Region 2 and 1 site in Region 3). Through 2016, 10 more sites implemented GLB. However, between 2011 and 2019, five sites stopped offering the program (Additional file 2). Overall, 20 clinic sites across the regions implemented group-DPP (8 sites in Region 1, 10 sites in Region 2, and 2 sites in Region 3). Across all regions, the program has been, exclusively offered in English. The branded name of the program was chosen by region Directors, physician leads, and managers in each region. One region used the original “Group Lifestyle Balance™” trademarked name, whereas the other regions rebranded the program (names not disclosed to protect anonymity). In all regions, LCs indicated that the program was intended to serve as a weight management program and implementation was driven by a need to address increased prevalence of prediabetes and obesity in their populations (Table 3: Quotes 1.1 & 1.2).
Penetration can be defined as the level of institutionalization and access to services. LCs were asked to describe program referral methods as well as visibility of the program to both patients and referring physicians. LCs from Regions 1 and 2 had similar perspectives on the visibility of the program to both patients and referring physicians. They made similar attempts at marketing to potential participants and to referring physicians (Table 3: Quotes 2.1 & 2.2). Region 2 relied on physicians who were outwardly supportive of the program, designated as “physician champions,” as a referral source for program participants (Table 3: Quote 2.3). However, LCs in Regions 1 and 2 stated that physicians’ referrals were inconsistent and generally insufficient. They described physicians’ awareness of the program as lacking due to physician turnover and competing care priorities (Table 3: Quotes 2.4–2.6). Physicians were the main source of referrals to the program in Region 3.
Acceptability can be defined as LC’s satisfaction with various aspects of the program. LCs expressed their acceptance of the program overall, but there were notable differences in their perceptions across the three regions. All LCs believed that the program is effective in changing participants’ knowledge, attitudes, and behaviors towards healthy eating and physical activity and achieving positive health outcomes (Table 3: Quotes 3.1 & 3.2). They stated that the robust evidence base was a major strength of the program (Table 3: Quotes 3.3 & 3.4). In addition, LCs in Regions 1 and 2 highlighted as strengths the program’s focus on behavior change through the provision of problem-solving strategies and approaches to overcome emotional triggers (Table 3: Quotes 3.5 & 3.6).
Some LCs considered the group-based nature of the program a strength, providing accountability, motivation, peer support, and empowerment in helping participants to commit to the sessions and achieve positive outcomes (Table 3: Quotes 3.7 & 3.8). However, other LCs highlighted several challenges with the group-based structure of the program, including recruitment, enrollment, and implementation. They further stated that participants who are not comfortable with group classes would not enroll in the program (Table 3: Quote 3.9). In addition, they reported the lack of group cohesion, perceived to be driven by diversity in age and personalities among participants within the same group, as a barrier to program success (Table 3: Quotes 3.10 & 3.11).
LCs expressed mixed opinions regarding the curriculum design and content. In all regions they agreed that being simple, easy to follow, and well organized are strengths of the program (Table 3: Quote 3.12 & 3.13). However, there was general agreement that program materials were not visually appealing (Table 3: Quote 3.14).
Notable differences in LCs’ perspectives towards the program also were noted between regions in terms of goal setting and relevance of information included the curriculum. Some considered goal setting a strength of the program (Table 3: Quote 3.15), whereas others felt it could demotivate program participants and increase withdrawal, especially among those who either could not achieve their weekly goals or those who set ambitious weight loss goals (e.g. more than 10% of their initial body weight) (Table 3: Quote 3.16).
Appropriateness can be defined as the perceived fit, relevance and suitability of the program for the target population and participants. Differences in perceived fit were evident across regions. LCs at all sites in Region 2 perceived the curriculum’s content to be too basic for their patients, given higher underlying education levels of the population (Table 3: Quote 4.1 & 4.2). In Regions 1 and 3, with comparatively lower educational levels, the LCs considered the content to be appropriate, but information needed some tailoring to be relevant to their participants (Table 3: Quote 4.3- & 4.4). Further, several LCs within Regions 1 and 2 expressed that the curriculum lacked some important information (Table 3: Quote 4.5 &4.6), such as physical activity topics (Table 3: Quote 4.7), while overabundant in other topics such as nutrition information and calories. (Table 3: Quotes 4.8 & 4.9). The focus on calories and fat counting was perceived by virtually all LCs as inconsistent with newer nutritional science paradigms (Table 3: Quote 4.10 &4.11).
Feasibility refers to the actual practicability or suitability for implementation of the program. The program was discontinued at a total of seven sites (4 sites in Region 2, 2 sites in Region 1, and 1 site in Region 3). Main reported reasons for discontinuing the program was increased patient attrition (2 sites in Region 1, 1 in Region 2 and 1 in Region 3). LCs across all three regions reported consistent difficulties with recruiting and retaining patients, which affected the sustainability of the program (Table 3: Quote 2.1 &5.2). s. Other reported reasons at two sites in Region 2 were related to lack of trained LCs to facilitate the program at the sites (Table 3: Quote 5.3) and change of location of the health education department where the program had been provided to another clinic site (1 site in Region 2) (Table 3: Quote 5.4).
Fidelity can be defined as the extent to which the program or intervention is delivered as intended. Implementation of the program varied within and across regions in terms of LC training, eligibility criteria for participants, and program structure and delivery (Table 4). All LCs were trained before facilitating the program; however, types of training varied between regions. In Region 3, LCs received formal training from the University of Pittsburgh, whereas LCs in Region 1 were trained by their supervisor (i.e. peer-to-peer training), who received University of Pittsburgh certification for training new LCs. A variety of training modalities were used in Region 2: formal, in-person training from the University of Pittsburgh (61.9%), online or virtual training (19.1%), and peer-to-peer training (14.3%).
Eligibility criteria varied within and across regions and differed from the initial target population of the DPP, that is, patients with clinical pre-diabetes or high risk of developing T2D. All regions targeted individuals who are overweight or obese, regardless of other risk factors and did not exclude individuals who already had a diabetes diagnosis. The majority of sites within Region 1 allowed all individuals to participate, regardless of diabetes risk. Eligibility criteria of patients referred to the program changed only in Region 2, whereby, over time, more diabetic patients had been included in the program after completing diabetes education classes. As a result of this difference in eligibility criteria, only approximately half of program participants meet DPP eligibility criteria (data not shown). Nearly 25% of participants have T2D, and 27% of participants are overweight or obese with no other risk factors for diabetes.
All regions offered group-based, in-person programs, consist with GLB™; however, variation in program structure were found across regions, including duration of the program, total number and frequency of sessions, and type of curriculum used. In Region 1, the duration of the program was 12 months. It included 12 core sessions provided on a weekly basis for approximately one hour, which is consistent with the GLB™ curriculum. In this region, however, post-core sessions were referred to as a “support group” and were not offered consistently at all sites due to attrition of patients enrolled in the program. The post-core sessions consisted of 9 optional sessions, provided once a month, for one hour each. In Region 3, the program consisted 12 core sessions delivered once per week for 3 months, corresponding to the intensive core phase of the GLB curriculum. In Region 2, the program initially consisted of 12 weekly core sessions; however, it changed in 2014 to a full-year program including 16 core sessions and 9 post core sessions. The 16 core sessions included 13 weekly sessions followed by 3 transitional biweekly sessions. The post-core sessions included 3 transitional sessions offered every other week followed by 6 monthly sessions.
All regions utilized the standardized GLB curriculum and content, with some pre-approved modifications included to allow for use among those with diabetes. These minor modifications (e.g. addressing hypoglycemia risk in the physical activity session) were made at the adoption stage and were approved by the University of Pittsburgh. Other micro-variations were observed across sites within Region 2 in terms of additions to the content (e.g. information about vitamins and supplements). LC’s used different types of visual aids to make the information more appealing (Table 3: Quotes 6.1 & 6.2). Since they first started providing the program at their sites, LC in both Regions 1 and 2 used the original GLB curriculum developed by the University of Pittsburgh. In 2014, three additional CDC-approved transitional sessions were incorporated to the curriculum used in Region 2, intended to help patients transition from weekly to monthly session schedule. The curriculum was also modified, with approval from the University of Pittsburgh, to include information for patients with a diabetes diagnosis (e.g. modified physical activity and diet recommendations). While LCs in Region 3 stated that they adhere to the curriculum materials, those in Regions 1 and 2 regularly provided additional and updated information to their patients. They elaborated on several topics included in the curriculum while modifying examples and providing additional strategies specific to diabetic patients in terms of calories, protein, and carbohydrates (Table 3: Quotes 6.3 & 6.4). However, LCs in Region 2 reported that they modified the level of information discussed and provided deeper explanations and examples to their patients who were perceived to be highly educated and knowledgeable about majority of the topics discussed in the curriculum (Table 3: Quote 6.5).
Implementation costs in Proctor’s framework refer to the marginal costs or perceived cost-effectiveness of the program as implemented. In this context, we refer to costs of the program to patient participants since we do not quantify the full cost of implementation from the institutional perspective. Cost of the 12-month program varied between regions. The costs of the program to patients was approximately 100% more expensive in Region 2 than Region 1, whereas the program was offered free of charge in Region 3, reflecting differences in socioeconomic status and ability to pay. However, in Region 1 the post-core sessions were considered optional and the patient was billed for each portion of the program separately. Insurance coverage of the program was not common and depended on an individual’s insurance plan and eligibility criteria (Table 3: Quotes 7.1 & 7.2). According to LCs in Region 1, the cost of the program was considered by some patients as fairly expensive and it was a major barrier to enrollment, especially those living in rural areas (Table 3: Quotes 7.3 & 7.4).
Sustainability can be defined as the durability and institutionalization of the program to be maintained and implemented over time. To improve efficiency, LCs made several changes to the program in terms of recruitment and retention methods, as well as implementation of sessions and use of program materials. In Regions 1 and 2, LCs mentioned that informing and reminding physicians about the program increased patients’ referral to the program (Table 3: Quotes 8.1 & 8.2).
LCs used different strategies to increase patient recruitment, including rescheduling sessions to fill classes and referring patients to other nearby sites in case of lack of available spaces. To encourage patients to enroll in the program and prevent waiting lists, a rolling enrollment system was implemented in Region 1, whereby every week, participants could join the program at any core session (Table 3: Quote 8.3). In addition, prompt pay discounts or allowing for monthly or per-session payment were other strategies used in Region 2 to increase participants’ enrollment in the program (Table 3: Quote 8.4).
Participants’ attrition was reported as a challenge in all regions. In addition to following up and reaching out to their participants between classes, upfront payment was a retention strategy used in Region 1 and 2 (Table 3: Quote 8.5). However in Region 2, some LCs made changes to the frequency of post-core sessions from monthly to biweekly in an attempt to retain participants (Table 3: Quote 8.6). In addition, they applied strict pre-assessment requirements to recruit eligible and motivated patients who are ready to join the program (Table 3: Quote 8.7).
The integration of a group-DPP within a large healthcare delivery system, as a natural experiment, provides a unique opportunity to evaluate variation in implementation and to inform best practices for long-term success of this program in routine clinical settings across the nation. In this study, we observed instances of both consistency and variation in implementation of the program across three geographic regions, with very different underlying sociodemographic characteristics (Table 5). The findings of our study expose a dynamic and important tension between the benefits of fidelity to the original evidence-based program and tailoring the program to meet the local needs of the organization, distinct patient populations, and the clinical context.
There is a dearth of studies that examine the real-world implementation of an evidence-based DPP. Moreover, this evaluation of implementation, under the conceptual framework described above, sets the stage for future work to examine the effect of implementation variation on outcomes. Several comments from LCs within different regions reflected differences in perceived appropriateness and acceptability and may have been influenced by underlying sociodemographic factors. The addition of content, visual aids, and other changes to the curriculum may have been an attempt on the part of LCs to increase appropriateness when it was perceived to be low. There is continued debate about the value of fidelity in implementation of existing evidence-based public health and clinical programs as originally developed versus adaptation of these program to make them more acceptable and applicable to a certain setting, population, or culture [29,30,31,32]. Fidelity can be defined as the degree to which an intervention is implemented as intended by its developers in order to ensure that the intervention remains effective . It is described as the extent to which a program is implemented according to core elements included in the program manual such as: theoretical methods, strategies, determinants, target population, and activities delivered [29, 30]. Many of the core aspects and features of the group-based GLB program remained consistent and intact across all three regions over time. This included the use of the core curriculum and content for the intensive phase consisting of 12 weekly sessions. All clinics covered the core material of the program, with some LCs providing additional information and examples based on the perceived needs and demands of participants. Moreover, given that only clinics in Region 2 required the implementation of the post-core maintenance phase as compared to some clinics that did not offer it, or made it optional, the content of those sessions remained unchanged and consistent across regions. This was also the case with self-monitoring of food choices and weight, whereby LCs at all sites required and motivated program participants to track their calories intake and physical activities to achieve their lifestyle and weight loss goals. Other consistencies in implementation of the program were found across regions in terms of satisfaction with the evidence base (acceptability), referral methods (adoption), eligibility criteria (fidelity), and strategies to increase retention and effectiveness (sustainability).
Some aspects of the program were modified and changed, creating micro-adaptations to meet the needs of the distinct patient populations served by the region. For example, while difficulties with recruitment were common across regions (feasibility), strategies used to address these challenges differed (sustainability). Adaptation involves modifications made to the original design of an intervention during the implementation process and can include the adding, removing, or tailoring of information and/or activities from the original program [29, 34, 35]. While some studies have demonstrated that program adaptations can decrease effectiveness of the program [36,37,38], others argue that adaptation is necessary to increase stakeholder buy-in and improve the program’s delivery and relevance for the local target populations, while using available and accessible resources [39, 40]. Depending on the nature of modifications, adaptation could be beneficial or could threaten the theoretical basis of the intervention, resulting in a negative effect on expected outcomes. For example, some sites offered rolling admission to address recruitment challenges, allowing participants to begin that program midway through the session. While this may have improved recruitment numbers, the program and its content were originally designed to be sequential, building on foundational concepts as the program progresses. It remains unknown what impact this lack of fidelity, due to adaptation, may have on the ultimate effectiveness.
Studies exploring types of adaptations made to existing evidence-based programs showed that program providers modify programs based on various factors including target population needs , available physical and financial resources , and their own knowledge and expertise . This was consistent with the results of our study showing that LCs supplemented the curriculum by providing updated information, based on their own knowledge, skills, and experiences, as well as their patients’ needs. In addition, facilitators “tweaked” and tailored examples within the curriculum to meet the population education level. The need for adaptation may be driven by the acceptability and/or perceived appropriateness of the intervention. The underlying patient populations in each region are very different in terms of sociodemographic and race/ethnicity. Additions, omissions, and other changes to the curriculum were likely influences by the LC perception appropriateness for a given patient population. It is unknown how adaptations and variation in implementation ultimately influence effectiveness or clinical outcomes. While we did not examine this in the present study, future studies are underway to examine how each of these implementation factors may influence patient outcomes. This information will be crucial to resolving the tension between optimizing the benefits of both fidelity and adaptation as needed and appropriate for a given patient population.
While many of the issues described are not unique to the health system in question, this was a qualitative study of 33 LCs from a single healthcare system in the western U.S. However, this healthcare delivery system, as a mixed-payer, FFS provider organization, is similar to most other healthcare settings in the nation. Thus, these findings have the potential for broad applicability. Given that the views and perspectives are based on individual responses, other health systems should consider examining program implementation of group-DPP to validate these findings. Further, while it is important to examine the ways in which program implementation was consistent or varies across sites, future research is needed to explore how this these factors may serve as barriers or facilitators to successful implementation of the program. Finally, the program was first implemented nearly a decade ago, which may introduce recall bias. Natural experiments provide an opportunity to study interventions in real-world clinical settings, yet such experiments have several challenges, including non-standardized metrics, inconsistent data collection over time, and incomplete data capture, which has limited our ability to determine the true impact of implementation factors, such as loss of fidelity or low perceived appropriateness, on goal attainment among participants.
Healthcare leadership and program implementers must consider building evaluation into the intervention prior to implementation, in order to be able to assess effectiveness and impact of the program. The CDC’s National DPRP provides some incentive for standardized data collection and evaluation, as recognition status is linked to the achievement of several requirements and performance metrics for a given program. More work is needed to support efficient yet robust data collection for program evaluation within healthcare systems.
Here we provide an in-depth examination of differences in program implementation and local adaptations in structure and design of group-DPP in a real-world healthcare setting. There were instances of both consistency and variation in implementation of the program across three geographic regions, revealing a dynamic and important tension between the desire to retain fidelity to the original evidence-based program and the need to tailor the program to meet the local needs of the organization, distinct patient populations, and the clinical context. In addition, certain challenges present consistently across sites, in particular, challenges resulting from a reliance on physician referrals as a method of recruitment, and challenges of patient attrition over the course of the year-long program. Identifying the common challenges faced across sites also offers opportunities for considering alternative approaches to implementation to anticipate these potential barriers. Findings may inform national diabetes prevention guidelines, such as the DPRP initiative, for facilitating successful adoption and long-term sustainability of programs. Further research is needed to explore how differences in implementation domains impact program effectiveness.
Availability of data and materials
The dataset, which includes participants’ transcripts, is not publicly available due to confidentiality policies.
Centers for Disease Control and Prevention
Diabetes Prevention Programs
Diabetes Prevention Recognition Program
Group Lifestyle Balance™
Group-based versions of the DPP
National Institute of Diabetes and Digestive and Kidney Diseases
Type 2 diabetes
National Diabetes Statistics Report, 2017. Centers for Disease Control and Prevention. Atlanta: Centers for Disease Control and Prevention (CDC); 2017.
Pan XR, et al. Effects of diet and exercise in preventing NIDDM in people with impaired glucose tolerance. The Da Qing IGT and diabetes study. Diabetes Care. 1997;20(4):537–44.
Economic Costs of Diabetes in the U.S. in 2017. Diabetes Care, 2018: p. dci180007.
Trikkalinou A, Papazafiropoulou AK, Melidonis A. Type 2 diabetes and quality of life. World J Diabetes. 2017;8(4):120–9.
Weiss EP, et al. Improvements in glucose tolerance and insulin action induced by increasing energy expenditure or decreasing energy intake: a randomized controlled trial. Am J Clin Nutr. 2006;84(5):1033–42.
Brink S. The diabetes prevention program: how the participants did it. Health Aff (Millwood). 2009;28(1):57–62.
Knowler WC, et al. Reduction in the incidence of type 2 diabetes with lifestyle intervention or metformin. N Engl J Med. 2002;346(6):393–403.
Greenwood DA, et al. Adapting the group lifestyle balance program for weight management within a large health care system diabetes education program. Diabetes Educ. 2014;40(3):299–307.
Diabetes Prevention Program Research, G. The Diabetes Prevention Program (DPP): description of lifestyle intervention. Diabetes Care. 2002;25(12):2165–71.
Betts AC, Froehlich-Grobe K. Accessible weight loss: adapting a lifestyle intervention for adults with impaired mobility. Disabil Health J. 2017;10(1):139–44.
Kriska A. Can a physically active lifestyle prevent type 2 diabetes? Exerc Sport Sci Rev. 2003;31(3):132–7.
Kriska AM, et al. Physical activity in individuals at risk for diabetes: diabetes prevention program. Med Sci Sports Exerc. 2006;38(5):826–32.
Jiang L, et al. Translating the diabetes prevention program into American Indian and Alaska native communities: results from the special diabetes program for Indians diabetes prevention demonstration project. Diabetes Care. 2013;36(7):2027–34.
Davis-Smith YM, et al. Implementing a diabetes prevention program in a rural African-American church. J Natl Med Assoc. 2007;99(4):440–6.
Driver S, Reynolds M, Kramer K. Modifying an evidence-based lifestyle programme for individuals with traumatic brain injury. Brain Inj. 2017;31(12):1612–6.
Ackermann RT, et al. Translating the diabetes prevention program into the community. The DEPLOY pilot study. Am J Prev Med. 2008;35(4):357–63.
Kramer MK, et al. Translating the diabetes prevention program: a comprehensive model for prevention training and program delivery. Am J Prev Med. 2009;37(6):505–11.
Aziz Z, et al. A systematic review of real-world diabetes prevention programs: learnings from the last 15 years. Implement Sci. 2015;10:172.
Venditti EM, Kramer MK. Diabetes prevention program community outreach: perspectives on lifestyle training and translation. Am J Prev Med. 2013;44(4 Suppl 4):S339–45.
Baker MK, et al. Behavioral strategies in diabetes prevention programs: a systematic review of randomized controlled trials. Diabetes Res Clin Pract. 2011;91(1):1–12.
Kramer MK, et al. Evaluation of a diabetes prevention program lifestyle intervention in older adults: a randomized controlled study in three senior/community centers of varying socioeconomic status. Diabetes Educ. 2018;44(2):118–29.
Kanaya AM, et al. The live well, be well study: a community-based, translational lifestyle program to lower diabetes risk factors in ethnic minority and lower-socioeconomic status adults. Am J Public Health. 2012;102(8):1551–8.
Albright AL, Gregg EW. Preventing type 2 diabetes in communities across the U.S.: the National Diabetes Prevention Program. Am J Prev Med. 2013;44(4 Suppl 4):S346–51.
Kramer MK, et al. A community-based diabetes prevention program: evaluation of the group lifestyle balance program delivered by diabetes educators. Diabetes Educ. 2011;37(5):659–68.
Proctor E, et al. Outcomes for implementation research: conceptual distinctions, measurement challenges, and research agenda. Admin Pol Ment Health. 2011;38(2):65–76.
Dedoose 2018; Version 8.0.35 [Web application for managing, analyzing, and presenting qualitative and mixed method research data]. Available from: www.dedoose.com.
Race/Ethnicity of Individual, 2016 American Community Survey 1-year estimates. 2016, US Census Bureau.
Income/Earnings (Households), 2016 American Community Survey 1-year estimates. 2016, US Census Bureau.
Owczarzak J, Broaddus M, Pinkerton S. A qualitative analysis of the concepts of fidelity and adaptation in the implementation of an evidence-based HIV prevention intervention. Health Educ Res. 2016;31(2):283–94.
Berman P, McLaughlin MP. Implementation of educational outcomes. Educ Forum. 1976;40(2):347–70.
Boruch RR, Gomez H. Sensitivity, bias, and theory in impact evaluation. Prof Psychol. 1977;8:411–33.
Bopp M, Saunders RP, Lattimore D. The tug-of-war: fidelity versus adaptation throughout the health promotion program life cycle. J Prim Prev. 2013;34(3):193–207.
Pérez D, Van der Stuyft P, Zabala MC, Castro M, Lefèvre P. A modified theoretical framework to assess implementation fidelity of adaptive public health interventions. Implement Sci. 2016;11(1):91.
Cunningham SD, Card JJ. Realities of replication: implementation of evidence-based interventions for HIV prevention in real-world settings. Implement Sci. 2014;9:5.
Moore JE, Bumbarger BK, Cooper BR. Examining adaptations of evidence-based programs in natural contexts. J Prim Prev. 2013;34(3):147–61.
Durlak JA, DuPre EP. Implementation matters: a review of research on the influence of implementation on program outcomes and the factors affecting implementation. Am J Community Psychol. 2008;41(3–4):327–50.
Dane AV, Schneider BH. Program integrity in primary and early secondary prevention: are implementation effects out of control? Clin Psychol Rev. 1998;18(1):23–45.
McKleroy VS, et al. Adapting evidence-based behavioral interventions for new settings and target populations. AIDS Educ Prev. 2006;18(4 Suppl A):59–73.
Harshbarger C, et al. An empirical assessment of implementation, adaptation, and tailoring: the evaluation of CDC's National Diffusion of VOICES/VOCES. AIDS Educ Prev. 2006;18(4 Suppl A):184–97.
Rohrbach LA, et al. Type II translation: transporting prevention interventions from research to real-world settings. Eval Health Prof. 2006;29(3):302–33.
Galbraith JS, Stanton B, Boekeloo BEA. Exploring implementation and fidelity of evidence-based behavioral interventions for HIV preventions: lessons learned from the focus on kids diffusion case study. Health Educ Behav. 2008;36:532–49.
Payne AA, Eckert R. The relative importance of provider, program, school, and community predictors of the implementation quality of school-based prevention programs. Prev Sci. 2010;11(2):126–41.
Palinkas LA, et al. An ethnographic study of implementation of evidence-based treatments in child mental health: first steps. Psychiatr Serv. 2008;59(7):738–46.
This was an investigator-initiated study by Sutter Health Research. No sponsor or funding source had a role in the design or conduct of the study; collection, management, analysis or interpretation of the data; or preparation, review or approval of the manuscript. The findings reported have not been previously published and that the manuscript is not being simultaneously submitted elsewhere. The authors would like to thank several groups at Sutter Health for providing valuable information on the identification lifestyle change program participants in the EHR and on the format and structure of the program at individual Sutter Health clinics: diabetes management regional leads (Karen Astrachan, RD; Amy Fox, RD; Catherine Hazlewood, Beth Schatzman, RD, and Jan Hadley, RD), lifestyle coaches, and members of the Sutter Health Diabetes Care Improvement Committee (DCIC).
Research reported in this publication was supported by the National Institute of Diabetes and Digestive and Kidney Diseases (NIDDK) of the National Institutes of Health under Award Number R18DK110739. The funding institute provided financial support for the conduct of the research and was not involved the design of the study, collection, analysis and interpretation of data as well as writing the manuscript. The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health.
Ethics approval and consent to participate
Approval to conduct the study was gained from the Sutter Health Institutional Review Board (SHIRB).
All participants provided written consent before participating in the study, which included consent to publish anonymous quotes from individual participants.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Participant Socio-demographics and Baseline Characteristics. Bivariate analysis of program participants sociodemographic and baseline characteristics across the three geographic regions.
Active Group-Based Diabetes Prevention Program Sites. Number of clinic sites providing the program, per year (from 2010 until 2019), at each of the three geographic regions.
About this article
Cite this article
Azar, K.M.J., Nasrallah, C., Szwerinski, N.K. et al. Implementation of a group-based diabetes prevention program within a healthcare delivery system. BMC Health Serv Res 19, 694 (2019). https://doi.org/10.1186/s12913-019-4569-0
- Diabetes prevention program
- Diabetes mellitus; program evaluation
- Healthcare system
- Health promotion
- Qualitative evaluation