Barriers to symptom management care pathway implementation in pediatric Cancer
BMC Health Services Research volume 21, Article number: 1068 (2021)
Objectives were to describe barriers to pediatric cancer symptom management care pathway implementation and the impact of the COVID-19 pandemic on clinical research evaluating their implementation.
We included 25 pediatric oncology hospitals in the United States that supported a grant submission to perform a cluster randomized trial in which the intervention encompassed care pathways for symptom management. A survey was distributed to site principal investigators prior to randomization to measure contextual elements related to care pathway implementation. Questions included the inner setting measures of the Consolidated Framework for Implementation Research (CFIR), study-specific potential barriers and the impact of the COVID-19 pandemic on clinical research. The Wilcoxon rank sum test was used to compare characteristics of institutions that agreed that their department supported the implementation of symptom management care pathways vs. institutions that did not agree.
Of the 25 sites, one withdrew because of resource constraints and one did not respond, leaving 23 institutions. Among the seven CFIR constructs, the least supported was implementation climate; 57% agreed there was support, 39% agreed there was recognition and 39% agreed there was prioritization for symptom management care pathway implementation at their institution. Most common barriers were lack of person-time to create care pathways and champion their use (35%), lack of interest from physicians (30%) and lack of information technology resources (26%). Most sites reported no negative impact of the COVID-19 pandemic across research activities. Sites with fewer pediatric cancer patients were more likely to agree that staff are supported to implement symptom management care pathways (P = 0.003).
The most commonly reported barriers to implementation were lack of support, recognition and prioritization. The COVID-19 pandemic may not be a major barrier to clinical research activities in pediatric oncology.
Most pediatric patients receiving cancer treatments experience bothersome symptoms that are poorly documented and often not treated [1, 2]. Symptom control is important as there is a strong correlation between increasing symptom burden and inferior quality of life . Improving symptom control is likely to require multiple approaches including systematic symptom screening, symptom feedback to healthcare professionals and adherence to symptom management clinical practice guidelines (CPGs) [3, 4]. To address symptom screening, we developed the Symptom Screening in Pediatrics Tool (SSPedi), which measures the degree of bother for 15 symptoms considered most important by patients [5,6,7]. We then developed Supportive care Prioritization, Assessment and Recommendations for Kids (SPARK), which is a web-based application that consists of a symptom screening component centered on SSPedi and a supportive care CPG component [8,9,10].
To test whether SPARK can improve symptom control and quality of life for pediatric patients with cancer, we were awarded operating grants from the National Institutes of Health (1R01CA251112) and the Canadian Institutes of Health Research (PJT 169165) to perform a cluster randomized trial of 20 institutions in the United States. This trial will randomize 10 sites to intervention and 10 sites to control (usual care) groups. The intervention will include prompts to complete self-reported symptom screening three times weekly for 8 weeks for newly diagnosed pediatric patients with cancer (both inpatients and outpatients), symptom feedback to the primary healthcare team and adaptation of care pathways for symptom management. The care pathways will be adapted by each intervention site from generic pathways we developed using a standardized process to identify relevant CPGs . Thus, intervention sites will need to adapt and implement evidenced-based care pathways. Planning of the trial started concurrent with the coronavirus disease pandemic (COVID-19) [12, 13] thus adding potential barriers.
There were limited reports on barriers to implementation of evidence-based care in pediatric oncology. For the care pathways to be successfully incorporated into routine practice, understanding implementation barriers was essential. We hypothesized that there would be barriers relevant to the planned trial including care pathway implementation, and that understanding those barriers would facilitate development of strategies to improve implementation. Thus, we circulated a survey to sites that had committed to the trial at the grant submission stage from which the 20 participating sites would be chosen. Objectives were to describe barriers to pediatric cancer symptom management care pathway implementation and the impact of the COVID-19 pandemic on clinical research evaluating their implementation.
The study was approved by the Research Ethics Board of The Hospital for Sick Children and the clinical trial registration number was NCT04614662. The sites were 25 hospitals providing care for pediatric oncology patients in the United States that supported a grant submission to conduct a cluster randomized trial focused on improving symptom control in pediatric cancer patients. The institutions were chosen to reflect variation in pediatric vs. mixed adult and pediatric sites and based upon previous research collaborations.
Purpose of survey, survey creation and survey distribution
One component of the intervention is the institution-specific adaptation of symptom management care pathways that are based upon CPGs. The purposes of the baseline survey were to facilitate site selection (20 of the 25 potential sites would be chosen), to measure baseline characteristics of participating sites and to anticipate barriers and facilitators to trial conduct and care pathway implementation that could influence implementation processes. The trial will enroll 444 patients at 20 sites to demonstrate a difference of 3 points in total SSPedi scores between intervention and control patients, assuming alpha 0.05, power at least 80%, intraclass correlation coefficient 0.021 and SSPedi score standard deviation 8.8.
CPGs are statements developed to facilitate healthcare-related decisions; they are the foundations for translating evidence to clinical practice . Rigorously developed CPGs must include a systematic review of the literature and convene a panel that weighs the benefits and harms of different treatment options to arrive at recommendations [14,15,16]. Care pathways are tools that can improve CPG implementation. They can be defined as “structured multidisciplinary care plans which detail essential steps in the care of patients with a specific clinical problem.” .
The survey (Additional file 1) measured baseline characteristics including institution, patient and healthcare professional characteristics. In order to understand potential barriers to symptom management care pathway implementation, we used three approaches. First, we used the Consolidated Framework for Implementation Research (CFIR) [18, 19]. The CFIR is a conceptual framework that includes factors that may influence intervention implementation. We focused on the inner setting measures that include the following constructs: culture, culture stress, culture effort, implementation climate, learning climate, leadership engagement and available resources. Culture may be described as a stable attribute of an organization that reflects its norms and values . Of these constructs, implementation climate was central to our aims and thought to be especially important to successful implementation given its specificity to the task. It has been identified as being important to influencing implementation in practice [18, 21, 22]. Each of the questions was rated on a 5-point Likert scale consisting of 1 = “strongly disagree”; 2 = “disagree”; 3 = “neutral”; 4 = “agree”; and 5 = “strongly agree”. We dichotomized those who agreed (score of 4 or 5) vs. those who were neutral or disagreed (score of 1, 2 or 3).
We also used a second set of questions that were specific to the proposed study and asked if the lack of the following were potential barriers to symptom management care pathway adaptation and implementation: person-time to create care pathways and champion their use; education and mentorship around care pathway use; hospital leadership support; interest from physicians; interest from allied health; information technology resources; and collaboration between different disciplines. These were rated on a 5-point Likert scale representing the degree to which they were a barrier: 1 = “not at all”; 2 = “a little”; 3 = “somewhat”; 4 = “a lot”; and 5 = “extreme”. We focused on any barrier defined as those that were somewhat, a lot or extreme barriers, and severe barriers defined as those that were a lot or extreme barriers. Third, given the timing of the COVID-19 pandemic related to full grant funding (R01 notice of award July 2020), we also asked about the impact of the pandemic across the spectrum of clinical research activities.
The primary outcomes were related to support, recognition and prioritization of symptom management care pathway implementation from the CFIR implementation climate construct. The survey was piloted internally prior to distribution. It was disseminated to the participating sites by email and completed in REDCap. The respondents were the site principal investigators; they could consult with other institutional personnel to facilitate survey completion. Reminders were sent weekly up to three times in the event of non-response.
Descriptive statistics were used to summarize baseline characteristics and potential barriers to symptom management care pathway implementation. We compared institutional characteristics of those that agreed that their department supports, recognizes and prioritizes the implementation of symptom management care pathways vs. those that did not agree using the Wilcoxon rank sum test. Analyses were performed using R studio version 3.6.1, The R Foundation for Statistical Computing.
Of the 25 sites who supported grant submission, one withdrew because of institutional resource constraints and one did not complete the survey, leaving 23 institutions included in the analysis. The survey was completed between August 5, 2020 and September 9, 2020. Table 1 describes institutional, patient and healthcare professional characteristics. Within all institutions, health care professionals create orders in the electronic health record for symptom prevention and management. The median number of new pediatric cancer patients diagnosed annually was 90 (interquartile range (IQR) 63 to 200). All institutions were described as not-for-profit. The median number of physician full time equivalents was 9 (IQR 5 to 13).
Table 2 shows the results of the inner setting measures from the CFIR. Across most constructs, at least 70% of institutions agreed that the culture, climate, leadership and resources facilitated symptom management care pathway implementation. With respect to the implementation climate construct, less than 70% of respondents agreed or strongly agreed with the following positively framed statements: “department staff gets the support they need to implement care pathways for symptom management” (57%), “department staff gets recognition for implementing care pathways for symptom management” (39%) and “implementing care pathways for symptom management is a top priority of the department” (61%). Respondents from 35% of institutions indicated that “staff members often showed signs of stress and strain”.
Table 3 shows additional barriers to implementing symptom management care pathways among respondents. The most common barriers (somewhat, a lot or extreme barrier) were as follows: lack of person-time to create care pathways and champion their use (35%), lack of interest from physicians (30%) and lack of information technology resources (26%). Severe barriers (a lot or extreme barrier) were rare and the most common was the lack of person-time to create care pathways and champion their use (9%).
Table 4 illustrates the impact of the COVID-19 pandemic on research activities at the institutions. Most sites reported no negative impact of the pandemic across research activities. The most common activities that were a lot more difficult or almost impossible were executing contracts (9%), study activation (9%) and accessing patients in person (9%).
Table 5 compares the attributes of sites who agreed that symptom management care pathway implementation was supported, recognized and prioritized vs. those who did not agree with these statements. Sites with fewer newly diagnosed cancer patients and those with fewer physician, nurse practitioner and physician assistant full time equivalents were significantly more likely to agree that their staff are supported. Sites with a larger percentage of black patients were significantly more likely to agree that their staff receives recognition for implementing symptom management care pathways and that implementation is a priority.
In this study, we found that few survey respondents anticipated challenges with care pathway implementation. However, potential barriers that were reported lay within the implementation climate construct of CFIR and were lack of support, recognition and prioritization at the participating institutions. Lack of person-time to create care pathways and champion their use, lack of physician interest, and lack of information technology were other important potential barriers reported with respect to developing and implementing symptom management care pathways. However, the COVID-19 pandemic did not appear to be perceived as a major barrier to research conduct.
We found that unfavorable implementation climate may be a potential barrier to care pathway implementation. Other studies have also identified this construct as a potential problem in program implementation [23, 24]. It is interesting that smaller sites reported receiving more support for care pathway implementation. It is possible that smaller sites are more likely to provide verbal and non-verbal support of initiatives in general and if this is true, identifying ways to provide this type of support across institutions could be important. Such support could include wide availability of research staff to address questions and provide educational materials. It may also be important to identify site champions who can provide this type of support locally. More specifically, our proposed strategy will focus on enhancing support and recognition for care pathway implementation although these elements will primarily arise extrinsic to the institution and be provided by the study team.
The finding of greater support at institutions with a greater percentage of black patients may be spurious. It also may reflect additional supports given to institutions that are minority based, such as those participating in the National Cancer Institute Community Oncology Research Program (a program aimed at sites with greater representation of racial/ethnic minorities or rural residents). We also found that lack of physician interest was a potential barrier to developing and implementing symptom management care pathways. Future qualitative research could explore reasons behind lack of interest and identify potential interventions to mitigate or address the issue.
We found that the COVID-19 pandemic was not perceived as a major barrier to research conduct. This finding is in contrast to a recent meta-analysis suggesting that trial delays and cessation were common and were a direct consequence of the pandemic . Our findings may differ because the survey was distributed later in the pandemic, when many institutions had adapted to it. Further, some institutions have made distinctions based upon whether research activities are in person vs. not in person and whether they are essential vs. not essential. Given that our trial could be conducted entirely remotely, and since some could consider this type of trial essential, respondents may have anticipated fewer barriers compared with other research studies. Lastly, respondents to our survey may not have had personal experience surmounting the logistical and bureaucratic barriers to the conduct of research created by the COVID-19 pandemic and, thus, may have not fully appreciated its impact. While our findings are unique to this particular project, they offer useful insight into institutional support of research during the pandemic.
The strengths of this study include the utilization of an established framework (CFIR) in addition to study-specific items in order to identify potential barriers to care pathway implementation. This will allow important contextual elements to be evaluated for their future relationship to implementation strategies and outcomes. Another strength is the evaluation of the impact of the COVID-19 pandemic on clinical research, a timely and important question. However, the study is limited as two institutions either dropped out or did not complete the survey; they are likely to be different than the 23 institutions that did complete the survey. In addition, these questions were mainly answered by a single individual, namely the site principal investigator. While input from other colleagues could have been accessed, perspectives of other healthcare professionals at the site were not fully represented. Also, sites agreed to provide support at the grant submission stage, suggesting they believe that symptom management is important. Thus, participating sites are likely a positively biased cohort and the “typical” site may report more barriers to care pathway implementation. Finally, evaluation of characteristics of sites who agreed that their department supports, recognizes and prioritizes the implementation of symptom management care pathways vs. those who did not agree should be considered hypothesis generating.
In conclusion, respondents at pediatric oncology institutions expected few barriers to symptom management care pathway implementation at their institutions. The most commonly reported barriers to implementation were lack of support, recognition and prioritization. The COVID-19 pandemic may not be a major barrier to clinical research activities in pediatric oncology. These results were limited by being conducted at sites that have prioritized supportive care. Future work should use this information to improve care pathway implementation.
Availability of data and materials
The datasets used or analyzed during the current study are available from the corresponding author on reasonable request.
Consolidated Framework for Implementation Research
Clinical Practice Guideline
Symptom Screening in Pediatrics Tool
Supportive care Prioritization, Assessment and Recommendations for Kids
Coronavirus disease pandemic
Dupuis LL, Johnston DL, Baggott C, Hyslop S, Tomlinson D, Gibson P, et al. Validation of the symptom screening in pediatrics tool in children receiving Cancer treatments. J Natl Cancer Inst. 2018;110(6):661–8. https://doi.org/10.1093/jnci/djx250.
Hyslop S, Davis H, Duong N, Loves R, Schechter T, Tomlinson D, et al. Symptom documentation and intervention provision for symptom control in children receiving cancer treatments. Eur J Cancer. 2019;109:120–8. https://doi.org/10.1016/j.ejca.2019.01.002.
Sung L. Priorities for quality care in pediatric oncology supportive care. J Oncol Pract. 2015;11(3):187–9. https://doi.org/10.1200/JOP.2014.002840.
Dupuis LL, Cook S, Robinson PD, Tomlinson D, Vettese E, Sung L. Optimizing symptom control in children and adolescents with cancer. Pediatr Res. 2019;86(5):573–8. https://doi.org/10.1038/s41390-019-0516-3.
Tomlinson D, Dupuis LL, Gibson P, Johnston DL, Portwine C, Baggott C, et al. Initial development of the symptom screening in pediatrics tool (SSPedi). Support Care Cancer. 2014;22(1):71–5. https://doi.org/10.1007/s00520-013-1945-x.
O'Sullivan C, Dupuis LL, Gibson P, Johnston DL, Baggott C, Portwine C, et al. Refinement of the symptom screening in pediatrics tool (SSPedi). Br J Cancer. 2014;111(7):1262–8. https://doi.org/10.1038/bjc.2014.445.
O'Sullivan C, Lee Dupuis L, Gibson P, Johnston DL, Baggott C, Portwine C, et al. Evaluation of the electronic self-report symptom screening in pediatrics tool (SSPedi). BMJ Support Palliat Care. 2018;8(1):110–6. https://doi.org/10.1136/bmjspcare-2015-001084.
Cook S, Vettese E, Tomlinson GA, Soman D, Schechter T, Kuczynski S, et al. Feasibility of a randomized controlled trial of symptom screening and feedback to healthcare providers compared with standard of care using the SPARK platform. Support Care Cancer. 2020;28(6):2729–34. https://doi.org/10.1007/s00520-019-05115-2.
Vettese E, Cook S, Soman D, Kuczynski S, Spiegler B, Davis H, et al. Longitudinal evaluation of supportive care prioritization, assessment and recommendations for kids (SPARK), a symptom screening and management application. BMC Cancer. 2019;19(1):458. https://doi.org/10.1186/s12885-019-5662-9.
Cook S, Vettese E, Soman D, Hyslop S, Kuczynski S, Spiegler B, et al. Initial development of supportive care assessment, prioritization and recommendations for kids (SPARK), a symptom screening and management application. BMC Med Inform Decis Mak. 2019;19(1):9. https://doi.org/10.1186/s12911-018-0715-6.
Robinson PD, Tomlinson D, Beauchemin M, Gibson P, Grimes A, Dadzie G, et al. Identifying clinical practice guidelines for symptom control in pediatric oncology. Support Care Cancer. 2021. https://doi.org/10.1007/s00520-021-06303-9.
Lu X, Zhang L, Du H, Zhang J, Li YY, Qu J, et al. SARS-CoV-2 infection in children. N Engl J Med. 2020;382(17):1663–5. https://doi.org/10.1056/NEJMc2005073.
Guan WJ, Ni ZY, Hu Y, Liang WH, Ou CQ, He JX, et al. Clinical characteristics of coronavirus disease 2019 in China. N Engl J Med. 2020;382(18):1708–20. https://doi.org/10.1056/NEJMoa2002032.
Lohr KN, Field MJ. Clinical practice guidelines: Directions for a new program, Institute of Medicine. Washington, DC: National Academy Press; 1990.
Steinberg E, Greenfield S, Wolman DM, Mancher M, Graham R. Clinical practice guidelines we can trust. Washington, D.C: Institute of Medicine, National Academies Press; 2011.
Guyatt GH, Oxman AD, Vist GE, Kunz R, Falck-Ytter Y, Alonso-Coello P, et al. GRADE: an emerging consensus on rating quality of evidence and strength of recommendations. BMJ. 2008;336(7650):924–6. https://doi.org/10.1136/bmj.39489.470347.AD.
Campbell H, Hotchkiss R, Bradshaw N, Porteous M. Integrated care pathways. BMJ. 1998;316(7125):133–7. https://doi.org/10.1136/bmj.316.7125.133.
Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci. 2009;4:50. https://doi.org/10.1186/1748-5908-4-50.
Fernandez ME, Walker TJ, Weiner BJ, Calo WA, Liang S, Risendal B, et al. Developing measures to assess constructs from the inner setting domain of the consolidated framework for implementation research. Implement Sci. 2018;13:52. https://doi.org/10.1186/s13012-018-0736-7.
Culture - The Consolidated Framework for Implementation Research. https://cfirguide.org/constructs/culture/. Accessed 2 June 2021.
Helfrich CD, Li YF, Mohr DC, Meterko M, Sales AE. Assessing an organizational culture instrument based on the competing values framework: exploratory and confirmatory factor analyses. Implement Sci. 2007;2:13. https://doi.org/10.1186/1748-5908-2-13.
Shortell SM, Zazzali JL, Burns LR, Alexander JA, Gillies RR, Budetti PP, et al. Implementing evidence-based medicine: the role of market pressures, compensation incentives, and culture in physician organizations. Med Care. 2001;39(7 Suppl 1):I62–78.
Stokes T, Tumilty E, Doolan-Noble F, Gauld R. HealthPathways implementation in a New Zealand health region: a qualitative study using the consolidated framework for implementation research. BMJ Open. 2018;8(12):e025094. https://doi.org/10.1136/bmjopen-2018-025094.
Robey N, Margolies S, Sutherland L, Rupp C, Black C, Hill T, et al. Understanding staff- and system-level contextual factors relevant to trauma-informed care implementation. Psychol Trauma. 2020; Available from: https://www.ncbi.nlm.nih.gov/pubmed/32915041.
Sathian B, Asim M, Banerjee I, Pizarro AB, Roy B, van Teijlingen ER, et al. Impact of COVID-19 on clinical trials and clinical research: a systematic review. Nepal J Epidemiol. 2020;10(3):878–87. https://doi.org/10.3126/nje.v10i3.31622.
We are grateful to the people who agreed to champion our study at their institutions and thank those who responded to our surveys. LS is supported by the Canada Research Chair in Pediatric Oncology Supportive Care. The study was supported by operating grants from the Canadian Institutes of Health Research (PJT 169165) and the National Institutes of Health (1R01CA251112).
The study was supported by operating grants from the Canadian Institutes of Health Research (PJT 169165) and the National Institutes of Health (1R01CA251112). The funding body had no role in the design of the study; collection, analysis and interpretation of data; and in writing the manuscript.
Ethics approval and consent to participate
This study has research ethics board approval from The Hospital for Sick Children Research Ethics Board (#1000068699) and was performed in accordance with the Declaration of Helsinki. The need for written consent was not felt to be necessary given the short time for survey completion, nature of the data, and completion of the survey was considered consent to participate. The research ethics board approved the survey and the approach to obtaining consent.
Consent for publication
The authors declare that they have no competing financial interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Dupuis, L.L., Grimes, A., Vettese, E. et al. Barriers to symptom management care pathway implementation in pediatric Cancer. BMC Health Serv Res 21, 1068 (2021). https://doi.org/10.1186/s12913-021-07047-2