We’re sorry, something doesn't seem to be working properly.
Please try refreshing the page. If that doesn't work, please contact support so we can address the problem.
Barriers and facilitators to implementing a pragmatic trial to improve advance care planning in the nursing home setting
BMC Health Services Researchvolume 19, Article number: 527 (2019)
The PRagmatic trial Of Video Education in Nursing homes (PROVEN) aims to test the effectiveness of an advance care planning (ACP) video intervention. Relatively little is known about the challenges associated with implementing ACP interventions in the nursing home (NH) setting, especially within a pragmatic trial. To address this research gap, this report sought to identify facilitators of and barriers to implementing PROVEN from the perspective of the Champions charged with introducing the ACP video program delivery to patients and families.
In semi-structured telephone interviews at 4 and 15 months of the 18-month implementation period, ACP Champions at all PROVEN intervention facilities (N = 119) were asked about their perceptions of program implementation. Forty interviews were purposively sampled, transcribed, and analyzed using a hybrid deductive/inductive approach to thematic analysis incorporating the Consolidated Framework for Implementation Research’s domains: Intervention Characteristics (IC), Inner Setting (IS), Characteristics of Individuals (CI), Outer Setting (OS), and Process (P).
Implementation facilitators identified by Champions included: the intervention’s adaptable mode of presentation and minimal time burden (IC) as well as the program’s customizable delivery to patients and families and opportunity for group reflection on implementation among ACP Champions (P). Barriers included mandated protocol-driven aspects of the program (OS), limited time to deliver the intervention (IS), and lack of perceived relevance and emotional readiness for ACP amongst stakeholders (CI).
Despite the promise of PROVEN’s intervention for improving ACP in nursing homes, unchangeable setting and characteristics of Champions, patients, and family members presented implementation barriers. Researchers need to engage all program participants (i.e., facility staff, patients, and families), in addition to corporate-level stakeholders, in early pragmatic trial design to minimize such obstacles. Further, despite the facilitating nature of PROVEN’s implementation processes, the study encountered tension between scientific rigor and real-world demands. Researchers need to optimize the real-world authenticity of pragmatic trial design while avoiding excessive implementation protocol deviations.
ClinicalTrials.gov Identifier: NCT02612688. Registered 19 November 2015.
Nursing home (NH) patients often receive aggressive and costly treatments that may be of limited clinical benefit and inconsistent with their preferences [1,2,3,4]. Advance care planning (ACP) within this setting has the potential to promote more preference-based, higher quality, and cost-effective care .
While important to rigorously test the impact of ACP programs, NHs are challenging environments in which to conduct traditional randomized clinical trials (RCTs) which require homogeneous and carefully controlled study conditions to establish efficacy. Indeed, there are few well-powered traditional RCTs testing ACP interventions in this setting [6,7,8,9]. Traditional RCTs are also limited in their generalizability to real-world settings . Pragmatic clinical trials (PCTs) conducted in partnership with health care systems are designed to test interventions as they would be done under real-world circumstances. A number of relatively small PCTs have been completed in the NH setting, but none of these have specifically focused on ACP interventions [11,12,13,14,15,16,17,18,19,20,21].
Intervention implementation can be a particular challenge in a PCT, as protocol compliance relies on usual care providers rather than a research team. Limited intervention uptake by these providers - constrained by intensive, competing demands of routine care - can translate into “implementation error”. Such error (i.e., an invalidating degree of deviation from an implementation protocol) may erroneously appear to reflect ineffectiveness .
Little is known, however, about the factors influencing intervention implementation (i.e., facilitators and barriers) in NH-based RCTs related to ACP interventions or in similar types of PCTs. Notable exceptions are two qualitative studies examining facilitators of and barriers to two multicomponent interventions: 1) the INTERACT program (already tested through an RCT)  and 2) the “COSMOS” (i.e., COmmunication, Systematic assessment and treatment of pain) trial (currently being tested within a PCT) . These qualitative studies point to several similar implementation barriers including significant demands for organizational change required by the interventions [25, 26].
The Consolidated Framework for Implementation Research (CFIR) offers a useful framework for developing this literature further. CFIR is a conceptual framework composed of a well-established set of implementation constructs . It is strongly grounded in the implementation science literature  and is useful in comparing implementation findings across varying interventions. Accordingly, this report uses CFIR in its analysis of the implementation experience of the PRagmatic trial Of Video Education in Nursing homes (PROVEN). PROVEN is the first PCT to be conducted in partnership with NH health care systems (HCS) (N = 360 NHs) to test the effectiveness of an ACP intervention (specifically, a video education program). Guided by CFIR constructs, we leveraged qualitative interview data with PROVEN Champions charged with delivering the ACP intervention to answer the following research question: “What are the barrier and facilitators Champions face in implementing a pragmatic trial to improve advance care planning in the nursing home setting?”
PROVEN trial overview
Brown University’s Institutional Review Board approved the conduct of the PROVEN trial and determined that the nursing home providers were not engaged in human subjects research.
As mentioned, PCTs strive to assess intervention effectiveness as implemented in real-world conditions. To emulate a pragmatic design, PROVEN’s implementation was managed primarily by the HCS leaders, similar to any new clinical program roll-out in their system. As such, ACP champions, staff, patients, and families were unaware the ACP video program was part of a research trial. Additional pragmatic features included: 1) permitting all patients in intervention facilities to be eligible for the program, 2) allowing intervention facilities to customize implementation as local needs dictated, and 3) capitalizing on already collected and electronically integrated clinical data to assess facility-level implementation .
PROVEN was conducted in partnership with two for-profit U.S. HCS which, at the start of the study, together operated a total of 456 facilities in 32 states. Eligible facilities needed to have a bed size larger than 50, to provide care to both short and long stay patients, and to be free of organizational or regulatory compliance difficulties (as determined by corporate leaders). Facility randomization consisted of a two-phase stratification process: 1) stratification by HCS given differing corporate-level characteristics and 2) stratification into terciles related to the trial’s primary outcome (hospitalizations/person-day alive for patients with advanced dementia or pulmonary disease). The resulting distribution of intervention versus control facilities in total and across HCS was: N = 119 intervention/N = 241 control; HCS1: N = 98 intervention/N = 199 control; HCS2: N = 21 intervention/N = 42 control. PROVEN commenced in March 2016 and was rolled out in three implementation waves through May 2018.
Briefly, the intervention consisted of a suite of five videos (~ 6–10 min) that presented a similar framework for choosing preferences and decisions for health care, i.e., preferences and decisions amongst intensive medical care, basic medical care, or comfort care. Each video customized this framework to the particular situation of patients/families: 1) General Goals of Care (providing descriptions of each type of care with narration and visual images), 2) Goals of Care for Advanced Dementia (providing similar information with family members as the target audience), 3) Hospice (providing detail on hospice care options at the end of life), 4) Hospitalization (providing detail on hospital care options), and 5) Advance Care Planning for Healthy Patients (providing basic education on advance care planning for patients with time-limited treatment needs).
At each intervention facility, one or two “ACP Champions” (most often social workers) were assigned and trained to offer a video to all patients or their family members within 7 days of admission (short-stay patients), every 6 months (long-stay patients (length of stay > 100 days)), and upon readmission (short-stay and long-stay patients) over an 18-month period. Videos could be viewed by patients or families on a tablet device or on-line. Champions were instructed to document the introduction of the intervention in a special report form embedded in the electronic medical record (EMR) each time they offered a video, and if offered, whether or not the video was shown.
Training of the ACP Champions was designed and conducted cooperatively by the research team and NH HCS leadership and occurred at a centralized in-person half-day event for the smaller HCS (HCS2) and by webinar for the larger HCS (HCS1). In addition to training Champions strictly in the ACP Video program protocol, trainers also instructed Champions on how to use the ACP videos as a supplement to rather than a replacement of usual advance care planning discussions.
Throughout the implementation, HCS leadership provided Champions with monthly feedback reports generated by the research team that included quantitative measures of adherence (i.e., proportion of patients/families offered a video) based on the EMR report data. These leaders, along with research team members, also conducted regular group conference calls attended by Champions from multiple facilities to share their experiences and problem-solve mutual implementation barriers.
Control facilities conducted their usual ACP practices, and were unaware they were part of a research study. The primary trial outcome was hospital transfer rates per person-day over 12 months, as ascertained from Medicare Claims data obtained directly from Centers for Medicare and Medicaid Services.
Setting & participants
Semi-structured telephone interviews at 4 and 15 months into the 18-month intervention implementation period with all facility Champions (N = 119 facilities) served to better understand perceived facilitators and barriers to program implementation. Whenever possible, the same Champion was interviewed at both time periods. These qualitative interviews and subsequent analyses were auxiliary to PROVEN’s main research aims assessing the intervention’s effectiveness. Among the 119 intervention facilities, interviews were purposively sampled from facilities that were in the top and bottom terciles (N ≈ 40 per tercile) for new admission rates in 2015 based on data available to the research team. This approach was intended to optimize balance of short-stay patients versus long-stay patients among sampled facilities.
Data collection / measures
Both 4-month and 15-month open-ended interview guides were developed inductively for this study (Additional file 1 and Additional file 2) and included questions addressing the following implementation domains: 1) Champions’ perspective of the training experience and preparedness to implement the program, 2) ACP practices at the facility prior to the program, and 3) Champions’ perspectives of the implementation experience (e.g., successes, challenges, and reactions from patients, families, and non-champion staff). The 15-month interview included additional questions (e.g., about suggested program improvements and whether Champions would recommend the program to other facilities).
The Consolidated Framework for Implementation Research (CFIR) guided the deductive analysis of the Champion interviews . CFIR’s conceptual domains are: 1) Intervention Characteristics (i.e., characteristics of the ACP video program), 2) Inner Setting (i.e., NH), 3) Characteristics of Individuals (i.e., Champions, patients, and families characteristics), 4) Outer Setting (i.e., mandated program requirements), and 5) Process (i.e., implementation efforts). Table 1 presents CFIR’s domains and their nested constructs found relevant to PROVEN. For each construct, published CFIR definitions are presented  as well as how we operationalized them for PROVEN.
Domain 1: Intervention Characteristics
There are four relevant constructs within the CFIR Intervention Characteristics domain: evidence strength and quality, relative advantage, adaptability, and cost. Evidence strength & quality refers to the perceived level of evidence supporting the intervention’s effectiveness as derived from a number of sources (e.g., literature, guidelines, or stakeholders’ experiences) . We operationalized this construct as the Champions’ perception of the quality, effectiveness, and validity of PROVEN’s videos in facilitating ACP conversations. CFIR defines relative advantage as the perceived benefit of an intervention over an alternate approach to the same problem. We operationalized this construct as the Champion’s perception about whether the PROVEN video program was more effective at improving ACP compared to other approaches. The construct of adaptability pertains to how much an intervention can be refashioned to address local needs. Within PROVEN, we conceptualized adaptability as how much Champions felt the ACP video program could be customized to their needs and those of patients/families. Finally, the cost construct considers resource investment and opportunity costs associated with an intervention. Within the PROVEN context, it referred to the perceived degree to which the intervention consumed facility resources, including the time and effort of the Champions.
Domain 2: Inner Setting
Within the Inner Setting domain, the constructs of available resources, networks and communications, and compatibility were considered. One construct nested within Inner Setting is readiness for implementation, in which available resources (i.e., organizational dedication of resources to intervention operations) is a sub-construct. We operationalized this sub-construct as the Champions’ perceptions of the availability of organizational resources (e.g., staff time and effort) for ACP video program implementation. The networks & communications construct relates to the nature and quality of the organization’s communication systems. In PROVEN, it related to the communication amongst Champions and other staff. CFIR’s construct of implementation climate has a sub-construct labeled compatibility that refers to alignment between an intervention and organizational climate and systems. We operationalized compatibility as how well Champions felt the ACP video program could be integrated into the facility’s established workflow.
Domain 3: Characteristics of Individuals
CFIR interprets “individuals” as those involved in implementing the program (i.e., the facility Champions). However, our inductive analysis revealed that the concept of “individuals” should be extended to the end-users (i.e., patients/family members). The knowledge and beliefs about the intervention construct in this domain pertains to cognition, that is, individuals’ attitudes towards and familiarity with an intervention. In PROVEN, this construct pertained to Champions’ attitudes towards and familiarity with ACP and those they perceived in patients and family members. Individual stage of change is a CFIR construct that captures emotional features, that is, the readiness of an individual (e.g., in a skilled or enthusiastic manner) to use an intervention. In PROVEN, this was interpreted as the patients’ and family members’ emotional readiness (as perceived by the Champion) to participate in the ACP video program.
Domain 4: Outer Setting
Within the Outer Setting domain, CFIR defines the construct of external policies and incentives as relating to strategies used by centralized bodies to disseminate the intervention (e.g. external mandates). In PROVEN, this was operationalized as the Champions’ perception of how the mandate passed down to them by HCS leaders in how to offer the ACP program influenced its implementation.
Domain 5: Process
CFIR’s constructs in the Process domain included: engaging, executing, and reflecting and evaluating. CFIR’s engaging construct refers to stakeholder involvement in implementation, such as through training and educational activities. We operationalized this construct as the Champions’ perception of their training to use the ACP video program and engagement of other facility staff in the program. Executing in CFIR represents how much implementation is conducted as originally planned, which we applied as ways in which Champions adhered to or customized the implementation process as originally planned. CFIR uses the construct of reflecting and evaluating to signify the quantitative and qualitative feedback implementers may receive (e.g., through debriefings) about the implementation process. For PROVEN, we operationalized this construct as the Champions’ perceptions of program feedback, such as that provided in the regular conference calls.
Three trained qualitative researchers (J.P., P.C., L.B.) conducted thematic analysis of the interview data with a hybrid deductive/inductive approach with the CFIR framework guiding the deductive analysis. Data from the two HCS and from 4-month and 15-month interviews were grouped together for analysis. Interviews were digitally-recorded and professionally transcribed. NVivo 11 software (QSR International; Melbourne, Australia) was used to manage data.
Analysis proceeded through three phases. In the first phase, J.P., P.C., and L.B. deductively developed a preliminary, structured codebook based upon CFIR domains. In a second phase, the codebook was refined inductively to ensure inclusion of constructs not within each CFIR domain. J.P. and P.C. pursued this by: 1) independently coding data by blocks of text, and 2) holding consensus meetings after coding six transcripts at a time. These coders noted both positive and negative cases of each code within the data and engaged in analytic memo writing to crystallize their thinking. The third analytic phase consisted of J.P. and L.B. iteratively reformulating inductive codes into larger domains (i.e., those formulated a priori by CFIR), paying attention to inductively derived constructs that might need to be added.
Data from 40 interviews were analyzed (4 months: HCS1: N = 17, HCS2: N = 4; 15 months: HCS1: N = 15, HCS2: N = 4). Champions were female (100%) and mostly social workers (87%). Table 2 presents the analytic themes that emerged in each CFIR domain as applied to PROVEN with illustrative quotes. No inductively derived constructs were necessary to supplement the CFIR domains, though not all CFIR constructs proved relevant to analysis.
Domain 1: Intervention Characteristics
Intervention Characteristics were generally perceived as facilitators to implementation. Related to evidence strength & quality, Champions mentioned video quality, effectiveness, and validity. Many Champions emphasized the high quality of the video content. They felt the videos presented ACP information with expansive detail, helpful descriptors, and a useful framework for decision-making. The Champions stated that the video helped patients/family members, as well as themselves, better conceptualize and comprehend goals of care options. Champions described the video as an effective “tool” and “opener” to begin ACP discussions, as well as a motivating factor for patients or proxies to complete or change their advance directives. Champions also felt the videos functioned effectively as a vehicle for education and self-reflection, enabling patients’/family members’ future ACP decision-making. As for the validity of the video’s content, a contrasting case surfaced with one Champion expressing concern that the videos presented information in a biased fashion that favored less aggressive care.
Within relative advantage, several Champions mentioned that the visual nature of the videos was superior to verbal descriptions alone in facilitating a deeper understanding of goals of care options and informing ACP. Champions also described a number of features related to the intervention’s adaptability to local needs that promoted successful implementation, such as the availability of the videos in several languages. Having choice for mode of video viewing (i.e., on the tablet at the NH or on-line at a later time) was also viewed positively. Champions also liked that the ACP program offered a choice of a suite of videos, enabling them to tailor its delivery to each patient’s medical situation.
Relevant to the cost construct, mixed perceptions surfaced regarding how much the video(s) consumed stakeholder resources. Some Champions viewed videos’ short duration as a facilitator of implementation while a couple of others believed the videos were too long, for example, to sustain the viewer’s attention.
Domain 2: Inner Setting
Champions depicted Inner Setting constructs (i.e., facility characteristics) as mostly barriers to implementation. A notable barrier cited by Champions was insufficiency in facilities’ available resources, particularly the lack of adequate time and staffing to implement the ACP video program. The finding of insufficient time for implementation remained constant even amongst those Champions who felt the videos were brief. Related to networks & communications, Champions had mixed perceptions. Some Champions capitalized on opportunities to communicate with other staff about the ACP video program, such as at staff meetings. On the other hand, a few Champions noted that newly hired staff remained unaware of the program due to persistent communication gaps amongst staff within the organization. In terms of compatibility, Champions were conflicted as to how easily the ACP video program could be integrated into established workflow. A number of Champions felt it could be easily tagged on to current facility ACP processes, while others felt that integration into existing work systems was difficult.
Domain 3: Characteristics of Individuals
Within Characteristics of Individuals, knowledge and beliefs about the intervention had both facilitating and inhibiting effects upon implementation, while the individual stage of change was viewed primarily as a barrier. As for the first construct, Champions commonly perceived the patient’s and/or family member’s refusal to view a video as stemming from his/her belief that ACP lacked personal relevance, both among relatively younger or short-stay patients with less advanced disease, as well as long-stay patients who already had well-established advance directives. Also related to knowledge and beliefs, Champions who believed they were already skilled in the ACP process thought the video program created extra, unnecessary work. Alternatively, a few Champions stated that the videos could serve as a valuable learning tool for inexperienced providers. Within the individual stage of change construct, Champions portrayed patients/family members as not always emotionally ready to engage in an ACP discussion, impeding Champions’ ability to maximize patient/family participation.
Domain 4: Outer Setting
External policy and incentives, interpreted as features of the prescribed elements (i.e., mandates) of program implementation, emerged as barriers in three main ways. First, the program required Champions to offer videos to all new admissions and long-stay patients/family members. Several Champions felt implementation would have had a more meaningful impact if Champions had the option of only offering the video to those perceived as needing it. Second, Champions found that the implementation protocol had unproductive redundancies in that they were expected to offer a video to all long-stay patients every six months even if the patients’ clinical status was unchanged which they felt sometimes fostered resistance. Finally, the mandated EMR report that Champions were required to complete about whether or not they offered a video to a patient was in some instances deemed an unnecessary burden that lacked meaningful clinical purpose.
Domain 5: Process
Champions had mixed perceptions about how the engaging construct influenced implementation. For the most part, engagement through formal training was viewed as straightforward, well-designed, and effective in preparing Champions. Not all Champions (e.g., newly appointed ones after a prior Champion left the facility) received formal training despite the HCS leadership’s ongoing efforts to address this gap. In such situations, informal training by the Champions themselves or their supervisors was sometimes initiated to ensure preparedness. Engaging non-Champion staff directly in the implementation process though present was infrequent. On occasion, however, non-Champion staff perceived a need for ACP for a patient/family member and then referred the individual to Champions for video administration.
Within the construct of executing, Champions mostly considered latitude to customize (vs. strictly adhering to) the delivery of the intervention as a facilitator. Examples of facility-initiated customization included sending families individual letters or newsletters with on-line video links, planning a “family night” of video viewing, or offering snacks to patients as they viewed the video as a group. As for reflecting & evaluating, a couple of Champions reported that ongoing cross-facility conference calls were “the best part” of implementation training given the opportunity to learn from other Champions’ experiences.
This study explored implementation of an ACP video education program in the NH setting under the rubric of a PCT from the perspective of the NH Champions charged with implementing it. Qualitative analysis, as guided by the five CFIR domains, revealed a number of facilitators and barriers. While Intervention Characteristics (e.g., adaptability of presentation mode and minimal time burden) were perceived as largely facilitative, Inner Setting (e.g., limited time available for implementation), Characteristics of Individuals (e.g., perceived patient/family readiness to engage in ACP), and Outer Setting (e.g., mandated program requirements) made implementation more challenging. The Process (e.g., the fact that the intervention could be customized) mostly strengthened implementation. Based upon this study, some of the implementation barriers identified can be resolved while others are inherent to both ACP efforts as well as pragmatic trials within the NH setting, raising questions about the feasibility of the program as currently designed.
Our findings extend the literature on ACP interventions in NHs, particularly within the context of a PCT. PROVEN’s adaptable and minimally time-intensive intervention facilitated its implementation. Indeed, research posits that simpler ACP tools (e.g., those not needing highly specialized intermediaries) will optimize implementation and stakeholder uptake and thus intervention effectiveness . In contrast, implementation of multi-component interventions in NHs, of which ACP is a part, such as the INTERACT and the COSMOS programs, can be hindered by technical problems, time demands, and magnitude of needed organizational change [25, 26]. While some researchers have argued for the superior effectiveness of more complex interventions in realizing preference-aligned treatment , PROVEN’s future trial outcomes may further elucidate how well an individualized yet streamlined intervention achieves desired outcomes (e.g., reduced hospitalizations), especially in face of NHs’ innate contextual barriers.
A salient Inner Setting constraint in PROVEN and comparable studies relates to such contextual barriers, i.e., limited resources (inadequate staffing, significant turnover, competing work demands, and intensive time pressure) [7, 25, 26, 31,32,33,34]. In PROVEN, perceived lack of sufficient implementation time coincided even with perceptions of the intervention as brief. Indeed, while some Champions described PROVEN’s videos as compatible with usual clinical workflows, a critical element for ACP intervention effectiveness in fast-paced health care settings , others described easy workflow integration as hindered by time constraints. The intransigent nature of resource barriers in NHs will remain a challenge for future PCTs in this setting. This challenge may be best addressed by designing interventions that are as parsimonious as feasible  and engaging NH administrators and direct care staff in developing implementation strategy in its earliest stages [26, 35]. Designating multiple collaborating Champions who could represent different disciplines may be another solution.
Like PROVEN, implementation of other NH ACP interventions has been affected by stakeholder characteristics. As in PROVEN, other studies [7, 33] describe patients’ and families’ resistance to ACP discussions as due to beliefs of their personal irrelevance or insufficient emotional readiness to broach such discussions. Unlike PROVEN which relied on Champion report, these other studies found resistance related to patient/family-reported implicit values such as discomfort with a decision-making role, preference for less formalized ACP conversations, and family feelings of guilt . Champions reinforced nuance, however, about reasons they perceived that patients and families might view ACP as personally irrelevant (i.e., short-stay patients finding it premature for their health status and long-stay patients/families feeling it had been previously addressed). Engaging NH patients and families as stakeholders early in future PCT designs for ACP interventions would help address these issues . For example, such stakeholders could provide an insider perspective on the optimal timing, frequency, and context for intervention delivery which could enhance end-user buy-in.
In terms of the impact of Champions’ knowledge about ACP on implementation, prior work suggests that when NH staff lack knowledge and skill, their ability to conduct ACP is hindered [7, 33]. However, in PROVEN, some Champions who perceived that they were experienced in conducting ACP did not view the intervention as helpful and believed it may be more valuable to inexperienced staff. Better preparation of Champions about the rationale and intended role of PROVEN’s video program may have averted this issue, i.e., reinforcing the intention of the video was to standardize information about goals of care options and to enhance but not replace ACP conversations between providers and patients/families.
External mandates imposed by PROVEN’s implementation protocol, while perhaps originally devised to maximize uptake of the intervention, encumbered implementation. Champions perceived universal rather than “as-needed” administration a barrier, a finding echoed in studies noting the need to appropriately time ACP delivery given NH patients’ unpredictable illness trajectories [31, 36]. Protocol redundancies also generated concern among Champions in PROVEN as well as other studies , most notably that repeatedly approaching patients and family regarding ACP could impair ongoing end-user engagement. Future research will need to establish whether NH-based ACP intervention delivery is more effective when determined by standardized administration or by clinical discretion. In terms of adherence documentation, researchers have argued this element is key to implementing NH ACP interventions ; this theory has yet to be established in practice, however. In fact, both PROVEN Champions and authors of a community-based ACP RCT suggest that resource use for fidelity monitoring may compromise real-world application . Indeed, PROVEN critically highlights how external mandates of the research context may constrain a PCT.
These potential constraints of the research context raise a larger question: whether protocols in real-world clinical settings would act similarly. A research protocol in a pragmatic trial (where implementation is rolled out by the HCS itself) is equivalent to policies and procedures used in real-world clinical program roll-out. These policies and procedures may also dictate standardized implementation so that an effective intervention is administered in the fashion that made it initially effective. Adherence documentation may also be required to establish accountability. As with a pragmatic trial, the implementation challenge would be to balance standardization and accountability with feasibility.
PROVEN Champions found the customizability of the implementation process (e.g., protocol adjustments at the local level to maximize patient and family outreach), enabled by the PCT design, to be a facilitator. In contrast, the process evaluation of the COSMOS PCT describes routine and systematic processes (e.g., a delineated process for family contact) as facilitators of a multicomponent, NH-based ACP intervention . Further research will need to investigate these seemingly opposing findings. For now, the PROVEN experience suggests that customizing implementation processes as broadly as possible may be the most mutable target for optimizing implementation in NHs. Doing so may maximize PCT generalizability; however, future PCTs will also need to avert implementation error by ensuring that customization does not compromise essential elements of protocol fidelity.
This study has a number of limitations. We gathered minimal information on Champion demographic information, work experience, and personal beliefs and values which may have influenced their viewpoints. Our interview participants included program Champions but not patients and families themselves; thus, Champion report of patient and family perceptions of the program were indirect and perhaps not authentic. As for their own self-report, Champions may have responded to PROVEN interviewers with socially desirable responses. Facilitators and barriers associated with important macro-level concerns of policy and regulation did not emerge from our qualitative data, perhaps due to a lack of associated interview guide questions. Generalizability of this study is limited; we cannot claim to know whether our findings are transferable to PCTs within non-profit NHs nor to other long-term care settings.
A promising ACP intervention may be hindered by immutable issues such as NHs’ limited resources (e.g. staff time) as well as end-user (i.e., Champion, patient, family member) characteristics. A key implication is that end-users, not just corporate-level stakeholders, should be invited to weigh in on the early phases of PCT design to guide optimal parameters (timing, frequency, context) for intervention delivery. Additionally, while this trial’s pragmatic design allowed mutable study processes which facilitated implementation, tension surfaced between the demands of empirical rigor and real-world exigencies. Accordingly, one must remain cognizant of how research demands may constrict the real-world nature of a PCT and, inversely, how implementation error may lead to false conclusions about intervention effectiveness.
Availability of data and materials
The data that support the findings of this study are available from the corresponding author [J.A.P.] upon reasonable request.
Advance care planning
Consolidated Framework of Implementation Research
Electronic medical record
Health care system
Pragmatic clinical trial
PRagmatic trial Of Video Education in Nursing Homes
Randomized clinical trial
Gaugler JE, Mittelman MS, Hepburn K, Newcomer R. Predictors of change in caregiver burden and depressive symptoms following nursing home admission. Psychol Aging. 2009;24(2):385–96.
Morrison RS, Ahronheim JC, Morrison GR, et al. Pain and discomfort associated with common hospital procedures and experiences. J Pain Symptom Manag. 1998;15(2):91–101.
Morrison RS, Siu AL. Survival in end-stage dementia following acute illness. JAMA. 2000;284(1):47–52.
Teno JM, Mitchell SL, Skinner J, et al. Churning: the association between health care transitions and feeding tube insertion for nursing home residents with advanced cognitive impairment. J Palliat Med. 2009;12(4):359–62.
U.S. Department of Health and Human Services; Office of the Assistant Secretary for Planning and Evaluation; Office of Disability, Aging and Long-Term Care Policy. Advance directives and advance care planning: Report to Congress. 2008.
Brinkman-Stoppelenburg A, Rietjens JA, van der Heide A. The effects of advance care planning on end-of-life care: a systematic review. Palliat Med. 2014;28(8):1000–25.
Flo E, Husebo BS, Bruusgaard P, et al. A review of the implementation and research strategies of advance care planning in nursing homes. BMC Geriatr. 2016;16:24.
Houben CHM, Spruit MA, Groenen MTJ, Wouters EFM, Janssen DJA. Efficacy of advance care planning: a systematic review and meta-analysis. J Am Med Dir Assoc. 2014;15(7):477–89.
Martin RS, Hayes B, Gregorevic K, Lim WK. The effects of advance care planning interventions on nursing home residents: a systematic review. J Am Med Dir Assoc. 2016;17(4):284–93.
Ford I, Norrie J. Pragmatic trials. N Engl J Med. 2016;375(5):454–63.
Cox H, Puffer S, Morton V, et al. Educating nursing home staff on fracture prevention: a cluster randomised trial. Age Ageing. 2008;37(2):167–72.
Desveaux L, Gomes T, Tadrous M, et al. Appropriate prescribing in nursing homes demonstration project (APDP) study protocol: pragmatic, cluster-randomized trial and mixed methods process evaluation of an Ontario policy-maker initiative to improve appropriate prescribing of antipsychotics. Implement Sci. 2016;11:45.
Gravenstein S, Davidson HE, Han LF, et al. Feasibility of a cluster-randomized influenza vaccination trial in U.S. nursing homes: lessons learned. Hum Vaccin Immunother. 2018;14(3):736–43.
Hahnel E, Blume-Peytavi U, Trojahn C, et al. The effectiveness of standardized skin care regimens on skin dryness in nursing home residents: a randomized controlled parallel-group pragmatic trial. Int J Nurs Stud. 2017;70:1–10.
Lyons RA, Johansen A, Brophy S, et al. Preventing fractures among older people living in institutional care: a pragmatic randomised double blind placebo controlled trial of vitamin D supplementation. Osteoporos Int. 2007;18(6):811–8.
Rasmussen CD, Holtermann A, Bay H, Sogaard K, Birk Jorgensen M. A multifaceted workplace intervention for low back pain in nurses' aides: a pragmatic stepped wedge cluster randomised controlled trial. Pain. 2015;156(9):1786–94.
Romoren M, Gjelstad S, Lindbaek M. A structured training program for health workers in intravenous treatment with fluids and antibiotics in nursing homes: a modified stepped-wedge cluster-randomised trial to reduce hospital admissions. PLoS One. 2017;12(9):e0182619.
Sackley CM, Walker MF, Burton CR, et al. An occupational therapy intervention for residents with stroke related disabilities in UK care homes (OTCH): cluster randomised controlled trial. BMJ. 2015;350:h468.
van de Ven G, Draskovic I, Adang EM, et al. Effects of dementia-care mapping on residents and staff of care homes: a pragmatic cluster-randomised controlled trial. PLoS One. 2013;8(7):e67325.
Werner J, Wosch T, Gold C. Effectiveness of group music therapy versus recreational group singing for depressive symptoms of elderly nursing home residents: pragmatic trial. Aging Ment Health. 2017;21(2):147–55.
Wouters H, Scheper J, Koning H, et al. Discontinuing inappropriate medication use in nursing home residents: a cluster randomized controlled trial. Ann Intern Med. 2017;167(9):609–17.
Vernooij-Dassen M, Moniz-Cook E. Raising the standard of applied dementia care research: addressing the implementation error. Aging Ment Health. 2014;18(7):809–14.
Kane RL, Huckfeldt P, Tappen R, et al. Effects of an intervention to reduce hospitalizations from nursing homes: a randomized implementation trial of the INTERACT program. JAMA Intern Med. 2017;177(9):1257–64.
Husebo BS, Flo E, Aarsland D, et al. COSMOS--improving the quality of life in nursing home patients: protocol for an effectiveness-implementation cluster randomized clinical hybrid trial. Implement Sci. 2015;10:131.
Aasmul I, Husebo BS, Flo E. Description of an advance care planning intervention in nursing homes: outcomes of the process evaluation. BMC Geriatr. 2018;18(1):26.
Tappen RM, Wolf DG, Rahemi Z, et al. Barriers and facilitators to implementing a change initiative in long-term care using the INTERACT(R) quality improvement program. Health Care Manag (Frederick). 2017;36(3):219–30.
Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci. 2009;4:50.
Kirk MA, Kelley C, Yankey N, Birken SA, Abadie B, Damschroder L. A systematic review of the use of the consolidated framework for implementation research. Implement Sci. 2016;11:72.
Mor V, Volandes AE, Gutman R, Gatsonis C, Mitchell SL. Pragmatic trial of video education in nursing homes: the design and rationale for a pragmatic cluster randomized trial in the nursing home setting. Clin Trials. 2017;14(2):140–51.
Consolidated Framework for Implementation Research. https://cfirguide.org/ (2018). Accessed 6 Dec 2018.
Lund S, Richardson A, May C. Barriers to advance care planning at the end of life: an explanatory systematic review of implementation studies. PLoS One. 2015;10(2):e0116629.
Ampe S, Sevenants A, Smets T, Declercq A, Van Audenhove C. Advance care planning for nursing home residents with dementia: influence of 'we DECide' on policy and practice. Patient Educ Couns. 2017;100(1):139–46.
Gilissen J, Pivodic L, Smets T, et al. Preconditions for successful advance care planning in nursing homes: a systematic review. Int J Nurs Stud. 2017;66:47–59.
Hickman SE, Unroe KT, Ersek MT, Buente B, Nazir A, Sachs GA. An interim analysis of an advance care planning intervention in the nursing home setting. J Am Geriatr Soc. 2016;64(11):2385–92.
Gilissen J, Pivodic L, Gastmans C, et al. How to achieve the desired outcomes of advance care planning in nursing homes: a theory of change. BMC Geriatr. 2018;18(1):47.
Cornally N, McGlade C, Weathers E, et al. Evaluating the systematic implementation of the 'Let me Decide' advance care planning programme in long term care through focus groups: staff perspectives. BMC Palliat Care. 2015;14:55.
Song MK, Ward SE. Making visible a theory-guided advance care planning intervention. J Nurs Scholarsh. 2015;47(5):389–96.
This work is supported by the National Institutes of Health (NIH) Common Fund, through a cooperative agreement (NIH-NIA UH3AG49619) from the Office of Strategic Coordination within the Office of the NIH Director. The NIH played no role in the study design, nor in the collection and analysis and interpretation of data, nor in the writing of the manuscript. The views presented here are solely the responsibility of the authors and do not necessarily represent the official views of the NIH. Dr. Palmer is supported by NIH-NIA T32AG023480; Dr. McCreedy is supported by AHRQ National Research Service Award 4T32HS000011; Ms. Loomer is supported by NIH-NIA National Research Service Award 2T32AG023482–13; and Dr. Mitchell is supported by NIH-NIA K24AG033640.
Ethics approval and consent to participate
The trial described within was approved by the Brown University’s Institutional Review Board, Protocol #1408001112. The Brown University Institutional Review Board deemed the study minimal risk, and individual consent was waived.
Consent for publication
J.A.P., V.A.P., L.R.B., E.B., P.C., L.L., E.M., and S.L.M. declare that they have no competing interests.
V.M. holds stock in PointRight, Inc. an information services company whose clients are the nursing home industry; chairs the Independent Quality Committee for HRC Manor Care, Inc.; chairs a Scientific Advisory Committee for NaviHealth, a post-acute care service organization; serves as a Technical Expert panel member on several Center for Medicare/Medicaid quality measurement panels; and is a member of the board of directors of Tufts Health Plan Foundation, Hospice Care of Rhode Island, and The Jewish Alliance of Rhode Island.
A.E.V. is President of Nous Foundation, Inc., (www.ACPDecisions.org) a not-for profit (501[c]3) foundation that disseminates educational videos. Dr. Volandes has a financial interest in the not-for-profit, which was reviewed and is managed by Massachusetts General Hospital and Partners HealthCare in accordance with their conflict of interest policies.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.