Skip to main content
Download PDF

Multi-method study of the implementation of Cognitive Symptom Management and Rehabilitation Training (CogSMART) in real-world settings

BMC Health Services Research volume 22, Article number: 1542 (2022) Cite this article

Abstract

Cognitive Symptom Management and Rehabilitation Training (CogSMART) and Compensatory Cognitive Training (CCT) are evidence-based compensatory cognitive training interventions that improve cognition in persons with a history of traumatic brain injury or other neuropsychiatric disorders. Despite demonstrated efficacy, use and effectiveness of CogSMART/CCT in real-world settings is not known.

We used a multi-method design to collect and analyze quantitative and qualitative survey data from several domains of the Reach, Effectiveness, Adoption, Implementation, and Maintenance (RE-AIM) framework to gather information about use of CogSMART/CCT in real-world settings from provider and patient perspectives. Surveys were sent to email addresses from persons who registered on the CogSMART website seeking access to training manuals and other resources. Descriptive statistics were generated, and we used Natural Language Processing methods to study the self-report free responses. Using n-gram analysis, we identified the most frequently reported responses.

We found CogSMART/CCT was broadly used in real-world settings and delivered by a variety of providers for several patient groups with high attendance and overall high satisfaction. CogSMART/CCT seemed to be offered in VA- or university-related clinics more than in private practice or rehabilitation centers. The diversity of providers and variety of formats by which to deliver CogSMART/CCT (i.e., individual, group, telehealth) seemed to play a role in its widespread implementation, as did its adaptability. Most providers made adaptations to the intervention that reduced the length or number of sessions. These changes were most likely to be based on client characteristics. The low rates of formal training, however, may have contributed to lower levels of perceived helpfulness among patients.

Reach and Adoption of a cognitive rehabilitation intervention improved by increasing access to the manuals. Attention to characteristics of dissemination and implementation in the design of an intervention may enhance its use in real-world settings. The relevant outcomes, easy access to training manuals, and adaptability of CogSMART/CCT seem to have been important factors in its use in a variety of settings and for several disorders with cognitive impairment. The adoption of CogSMART/CCT by a variety of providers other than neuropsychologists suggests its use may be broadened to other healthcare providers, if adequately trained, to increase access to an intervention with demonstrated efficacy for cognitive rehabilitation for several neuropsychiatric disorders.

Peer Review reports

Background

Cognitive rehabilitation has been shown to be effective in increasing cognitive performance and daily functioning for persons with TBI and other neurocognitive disorders [1]. The compensatory cognitive training (CCT) rehabilitation approach employs cognitive techniques and coping strategies, such as problem-solving and use of external aids, to improve cognitive performance and functional capacity [1]. In one such CCT-based intervention, Cognitive Symptom Management and Rehabilitation Training (CogSMART), individuals are taught strategies and habits that specifically target memory, attention, prospective memory, and executive functioning. They learn to make use of internal strategies (e.g., visual imagery, information chunking, acronyms, problem solving, planning) and external aids (e.g., day planners and timers), to augment their own current cognitive resources. In clinical trials, CogSMART training has been shown to improve cognition, functional capacity, post-concussive symptom severity, and quality of life in civilians and Veterans with TBI [2,3,4,5,6,7], as well as in several other populations of patients with neurocognitive disorders including serious mental illness and psychosis [8,9,10,11], co-occurring PTSD and TBI [12], hoarding disorder [13,14,15,16,17], autism [18], and HIV [19].

Despite its demonstrated efficacy, CogSMART/CCT, however, like many other evidence-based practices (EBPs), is not widely implemented in clinical practice. To our knowledge, there is one study reported in the literature that investigated a multi-component cognitive intervention for older adults in a real-world setting. Mao and colleagues (2021) found that this intervention improved cognition compared to preintervention levels when it was delivered in day care and neighborhood centers in Taiwan (Mao, et al. 2021) [20]. The lag in time to translate EBPs into wide use in practice settings is often due to a lack of fit between the intervention, implementation strategies, and the intended contexts, as well as many external environmental factors [21, 22]. The investigation of the use of and adaptations to EPBs in controlled settings is one approach to understanding their dissemination, adoption, implementation, and sustainment. Another approach to understand the uptake of EBPs is to examine their active dissemination in the real-world environment. CogSMART/CCT was designed with several features to enhance uptake, such as targeting the improvement of outcomes that are meaningful to the patients, no-cost access to the training manuals and implementation support materials, and marketing to providers and patients (website, YouTube videos).

To better understand naturalistic dissemination and implementation of CogSMART/CCT in real-world settings, we surveyed providers and patients who downloaded the CogSMART/CCT manuals through the research-related website. We employed the RE-AIM (Reach, Effectiveness, Adoption, Implementation, and Maintenance) framework [23] to evaluate the implementation outcomes of CogSMART in real-world settings.

Applying the pragmatic RE-AIM approach [24], we sought to answer the following questions: Who is intended to benefit from CogSMART/CCT and who participated in the intervention (Reach)? What were the benefits of CogSMART/CCT from the patient and provider perspectives (Effectiveness)? Who delivered CogSMART/CCT and where was it delivered (Adoption)? How consistently was CogSMART/CCT administered and how was it adapted (Implementation)? We did not address maintenance (e.g., how long will a provider use CogSMART/CCT and how long the benefits of it last) in this study.

The purpose of this study was to explore the use of an EBP for cognitive rehabilitation, CogSMART/CCT, in real-world settings to inform its future implementation.

Method

This study used a multi-method design to collect and analyze quantitative and qualitative survey data to gather information about the use of CogSMART/CCT in real-world settings from provider and patient perspectives.

Survey development

Using the pragmatic RE-AIM framework, we developed the survey and piloted it with research assistants familiar with the intervention to refine the questions. Most responses were categorical or ordinal, and some Likert scales and free text fields were included. The provider survey was 58 total questions, and the patient version contained 73. The survey was designed to minimize response burden; therefore, questions were presented in a sequential rather than randomized manner, and no completeness or review checks were included. We did not offer incentives for participation; therefore, we attempted to reduce response burden. The survey was re-issued to the same email list with an additional question regarding the perceived overall helpfulness for the providers to compare to patient data yielding a sample of 19 and 16, respectively. Email addresses we examined for duplicates, and, if a second response was detected, we used the data from the used the response that was more complete. Skip logic was employed, and participants could choose not to answer any question.

Participants and survey administration

This open survey was administered to a convenience sample of nearly 6000 individuals who provided email addresses to access treatment manuals and other intervention-related tools available through the researcher-designed website from January 2014 to June 2020. Links to the survey were included in an email update notifying the recipient of the availability of an updated manual. Participation was anonymous and voluntary. Respondents self-identified their role as provider or patient by selecting the corresponding survey link. The survey was active for from March 2020 to June 2020, and two reminders were sent two and four weeks after the initial invitation. In January 2021 we reissued the survey for three months to increase participation, as well as to collect expanded and standardized information across stakeholders on perceived helpfulness of and satisfaction with CogSMART/CCT, which resulted in different patient sample sizes for some variables. There were no significant differences between current and past users on the intervention characteristics, so the data were combined for analysis. The study was conducted via Qualtrics, and data was stored behind a VA-secured firewall.

Additional data on patients’ perceived helpfulness was obtained from a quality improvement project in the Cognitive Rehabilitation Clinic at VA San Diego Healthcare System (VASDHS) (n = 86) with data collected from 2011 to 2016. It included the CogSMART Feedback Form, which consists of a 10-item list of cognitive domains, post-concussive symptoms, psychoeducation, and information about additional services. The perceived treatment helpfulness for each item was rated on a five-point Likert scale (1 = not helpful; 2 = mildly helpful; 3 = moderately helpful; 4 = very helpful; and 5 = extremely helpful). All participants in the clinic were Veterans with TBI participating in CogSMART/CCT. No information on demographic or clinical characteristics was available. Therapists were master’s level staff who received intensive training that consisted of manual review with neuropsychologist, observation of a neuropsychologist delivering the intervention, delivery of the intervention with observation, and then serving as co-therapist with a CogSMART/CCT expert. Despite the lack of patient characteristics, these data provided the opportunity to contrast the use of CogSMART/CCT conditions with lower external and higher internal validity (structured clinical conditions) to those with higher external and lower internal validity (real world settings).

Data analysis

Quantitative survey data was characterized using descriptive statistics including frequencies, percentages, and graphs. Chi-square tests were also used to assess for statistical differences in perceived helpfulness ratings. All quantitative analyses were conducted using SPSS 27. Qualitative data (i.e., free text survey questions inquiring about barriers and facilitators of CogSMART/CCT as well as “Any other suggestions”) were analyzed with Python using Natural Language Processing methods - n-gram analysis [25] - to identify response categories and frequencies, such as the most frequently reported responses.

Ethical concerns

The survey was reviewed and approved by the VASDHS IRB (HRD200006). Respondents were told of the voluntary nature of their participation, informed that they could refuse to answer questions, and acknowledgement of consent was required prior to beginning the survey.

Results

Dissemination of CogSMART/CCT

Of the 5853 unique email addresses, the most frequent domains were from the VA, educational institutions, or international organizations, other US government agencies, and healthcare-related organizations (n = 2652) with the remainder consisting of commercial domain addresses (n = 3142) and undetermined (n = 50). Respondents included healthcare providers and patients (n = 207 and 87 respectively) who were past or current users of CogSMART/CCT.

Providers in real-world settings reported that the most frequent source of information about CogSMART/CCT was from colleagues (46%) with journal articles (20%), other sources (19%) and workshops (15%) less likely. Patients were most likely to hear about CogSMART/CCT from their healthcare providers (54.4%) compared to workshops (18.2%), other sources (18.2%), or journals (4.5%).

Reach

Because this was a naturalistic study of the dissemination and implementation of CogSMART/CCT, in real-world settings, we did not determine a priori the intended recipients of this intervention. We did ascertain, however, the characteristics of 75 patients who voluntarily responded to the internet survey and provided the data on the website; twelve individuals declined to answer the survey questions. See Table 1 for patient demographics.

Table 1 Patient Characteristics
Full size table

Patients were referred to CogSMART/CCT most frequently based on provider assessment and clinical judgment and patient goals. Other reasons for referral included diagnosis or participation in an assessment or treatment clinic. Most of the providers reported using TBI-related CogSMART/CCT manuals (67%), with 26% using manuals for psychiatric illnesses and 7% using manuals for mild cognitive impairment.

Effectiveness

Overall satisfaction and perceived helpfulness

Based on the providers who answered this question (N = 102), 99% (N = 101) would recommend CogSMART/CCT to others, and for the patients who responded (N = 19), 95% (N = 18) would recommend CogSMART/CCT. There were no significant differences between the patients and providers. Ratings for perceived helpfulness are presented in Table 2.

Table 2 Perceived Overall Helpfulness for Providers and Patients
Full size table

Perceived helpfulness of cognitive domains

Perceived helpfulness of strategies taught in the four CogSMART/CCT cognitive domains (prospective memory, attention, learning and memory, and executive functioning) and, in the case of TBI manuals, information provided on post-concussive symptoms, were compared for providers across disciplines, settings, and neurocognitive conditions. The perceived helpfulness of CogSMART/CCT content domains generally had high helpfulness ratings across settings, manuals/conditions (traumatic brain injury, serious mental illness, mild cognitive impairment), and disciplines with no statistically significant differences observed.

Patients seen in the VASDHS Cognitive Rehabilitation Clinic were significantly more likely to rate perceived helpfulness higher for the cognitive domains of prospective memory, learning and memory, and problem solving than both patients and providers who responded to the survey (See Fig. 1). Providers were more likely to rate helpfulness for the attention/concentration domain higher than patients in real world or clinical settings.

Fig. 1
figure 1

Perceived Helpfulness of CogSMART/CCT Domains by Provider and Patient Groups

Full size image

Adoption

Provider characteristics can be seen in Table 3.

Table 3 Provider Characteristics
Full size table

About 67% of providers currently providing CogSMART/CCT reported no formal training in CogSMART/CCT prior to delivering the intervention independent of whether they were neuropsychologists. Of those receiving training, neuropsychologists and psychologists had the highest rates of formal training (50% and 36%) compared to other disciplines (ST (18%) and OT 18%) and other (31%). Those with formal training were more likely to be treating TBI, rather than other neurocognitive disorders, and work in a VA- or university-affiliated hospital. The training of the providers in the Cognitive Rehabilitation Clinic versus the real-world setting differed considerably. All the providers in the clinic setting received intensive training, whereas the majority (67%) of those in the real-world setting received no formal training.

Implementation

Providers reported that patients attended an average of eight sessions of the 10–12 session intervention (75–80% attendance rate) when CogSMART/CCT was delivered in individual or group format. Patients participating in the intervention using telehealth format attended more than half of the sessions. High attendance rates were further supported by patient responses: 63% reported attending all or most sessions, 26% at least half of the sessions, and only 11% less than half.

Most providers (74%) reported making modifications to CogSMART/CCT. The most frequent adaptations were combining (14%), modifying (17%) or omitting (17%) exercises and shortening the length (15%) or number of the sessions (14%). Most providers based these adaptions on client characteristics (42.5%), such as language or cultural adaptations or reading level, or logistics (31%) followed by provider preference (13.7%) and other reasons (9%). Very few providers made adaptations based on evidence (3%).

Qualitative data was collected from questions inquiring about barriers and facilitators of CogSMART/CCT, as well as from answers to the question “Any other suggestions?” (See Table 4).

Table 4 Frequency of Barriers and Facilitators
Full size table

Despite overall reports of high attendance and the modifiability of CogSMART/CCT, some providers described barriers related to both patient and intervention characteristics. For example, patient adherence and motivation and the length of the session or intervention were the most frequent patient and intervention characteristics noted as barriers, respectively. Fit of the patient and intervention were also noted as somewhat problematic, and providers suggested that there is a need to further adapt the intervention to patient’s complaints and lower level of functioning. Additional suggestions focused on addressing attention and memory in earlier sessions, and implementing metacognitive strategies, more executive functioning exercises, and more practical applications of cognitive flexibility.

In contrast, the accessibility of the intervention and its pragmatic focus were perceived as facilitators. For example, providers noted the benefit of CogSMART/CCT on patient outcomes, its flexibility to combine with other approaches, and its usefulness for training purposes (“[CogSMART/CCT is] Super useful in building patient confidence, practical and easy to combine with other approaches” and “Helpful as both a stand-alone intervention or blend in with other approaches….”). The quality of the examples and exercises was also noted. Others mentioned CogSMART/CCT’s appropriateness for other populations, such as multiple sclerosis and mild cognitive impairment.

Discussion

Our study describes the naturalistic dissemination and implementation of CogSMART/CCT in real-world settings using a convenience sample of providers and patients who requested access to CogSMART/CCT training manuals from the website. Data showed that the intervention was broadly disseminated and widely used in real-world settings. CogSMART/CCT was delivered by a variety of providers for several patient groups with overall high attendance and limited, but high satisfaction scores. The low rates of formal training, however, may have contributed to patients’ lower levels of perceived helpfulness among cognitive domains. Data from this sample indicated that CogSMART/CCT is more frequently offered in VA- or university-affiliated clinics than in private practice or rehabilitation centers. Adaptations to CogSMART/CCT included the reduction of the number of exercises or shortening the length or number of sessions, and these changes were most likely to be based on client characteristics. Some providers, however, noted that further improvements of the intervention for patients with lower levels of functioning would be beneficial.

Our results are consistent with the literature showing that attention paid to design characteristics in developing interventions increases their reach [26]. CogSMART/CCT was designed to be accessible, easy to use, and practical. The creation of an intervention-specific website with open access clearly resulted in dissemination of this EBP. CogSMART/CCT’s ease of use and focus on outcomes relevant to patients may have also contributed to the use of CogSMART/CCT by providers and patients. Diffusion, the social influence that facilitate knowledge of, attitudes toward, and use of an intervention, also seemed to broaden the reach of CogSMART/CCT, because the most common method that providers and patients learned of it was from colleagues or healthcare providers respectively [26]. The reach of other EBPs may be enhanced by attending to factors related to dissemination and diffusion early in the design of the intervention.

CogSMART/CCT was designed for several patient groups demonstrating neurocognitive impairment, and our findings of real-world use are consistent with this. Pragmatic trials and implementation studies to capture data RE-AIM outcomes in more representative samples are needed.

Despite its broad dissemination and limited but overall high satisfaction, patients’ perceived helpfulness of CogSMART/CCT may be associated with the training of the provider. Patients treated in the VA Cognitive Rehabilitation Clinic, where all the providers received intensive training, rated perceived helpfulness of several cognitive domains higher than did patients in the real-world settings. In contrast, we observed that training differed among provider types, although these differences were not significant. A critical role in translating EBPs into broad practice involves effective provider training [27]. The fidelity with which EBPs are delivered affects patient outcomes, emphasizing the need for well-trained providers [28]. Future research on the relationship of types and intensity of training in the delivery of CogSMART/CCT is warranted to achieve the best possible patient outcomes with the most cost-effective training modality. Moreover, the delivery of CogSMART/CCT in real world settings by providers other than neuropsychologists, suggests that the use of non-specialty providers may further extend access to evidence-based cognitive training for persons with TBI and other cognitive impairments. The use of task-sharing has been used to increase the provision of mental health care services in rural and low-resource settings [29, 30]. Task-shifting entails reallocating duties, typically from more to less highly trained individuals to make efficient use of these resources, allowing all providers to work at the top of their scope of practice [31]. Effective training with adequate fidelity to EBPs will likely require tailoring the educational materials to the unique characteristics and contexts of the potential group of providers.

Data from the implementation of CogSMART/CCT in real world settings indicated that the intervention was frequently adapted to accommodate the characteristics of the patients, and that this adaptability was a facilitator in its adoption by providers. Current literature on the adaptation of EBPs differentiates between core functions, the underlying mechanisms of change that make an intervention effective, and forms, which are the specific intervention activities [32]. The high satisfaction and perceived helpfulness ratings of CogSMART/CCT by both the providers and patients suggest that the potential mechanisms of change (i.e., psychoeducation, skill development, practice, problem solving, and generalization) were easily identifiable and preserved, while the details of the intervention (i.e., delivery format, exercises, and length and number of sessions) were modified to meet the needs of the patients. Future studies are needed to confirm core functions and forms for CogSMART/CCT, but others have identified four techniques (facilitation by a therapist, cognitive exercise, procedures to develop problem-solving strategies, and procedures to facilitate transfer to real world functioning) in cognitive remediation for persons with schizophrenia [33].

There are several limitations of this study. Most notable is the potential of response bias, given the very low response rate, particularly related to overall satisfaction and perceived helpfulness. The purpose of this study, however, was not hypothesis testing, but rather the exploration of the natural diffusion of CogSMART/CCT and the characterization of its use in real world settings using mixed methods. Several findings from these data suggest future important and actionable research, such as the relationship between training and outcomes, task shifting as an implementation strategy, and understanding of core forms and functions to enable systematic adaptation. More research in these areas, as well as in the match between the intervention, implementation strategies, and environment, is needed.

Conclusion

Manualized cognitive rehabilitation interventions with known efficacy can have a broad reach and be delivered in a variety of settings when they are available and accessible to healthcare professionals and patients. Attention to characteristics of dissemination and implementation in the design of an intervention may enhance its use in real-world settings. The relevant outcomes, easy access to training manuals, and adaptability of CogSMART/CCT seem to have been important factors to its use in a variety of settings and for several disorders with cognitive impairment. A key finding of our study was to emphasize importance of local adaptation of the intervention to increase the fit to the patient population and context. Adaptations can include changes to the number, length, and content of sessions.” The adoption of CogSMART/CCT by a variety of providers other than neuropsychologists, suggest that its use may be broadened to other healthcare providers, if adequately trained, to increase the access to an intervention that has demonstrated efficacy for several neuropsychiatric disorders.

Availability of data and materials

The datasets supporting the conclusions of this article are available from the corresponding author on reasonable request.

Abbreviations

TBI:

Traumatic Brain Injury

CogSMART:

Cognitive Symptom Management and Rehabilitation Training

CCT:

Compensatory Cognitive Training

RE-AIM:

Reach, Effectiveness, Adoption, Implementation, and Maintenance framework

PTSD:

Post-traumatic Stress Disorder

EBP:

Evidence-based Practices

VASDHS:

VA San Diego Healthcare System

IRB:

Institutional Review Board

MCI:

Mild Cognitive Impairment

ST:

Speech Therapist

OT:

Occupational Therapist

References

  1. Vanderploeg RD, Belanger HG, Curtiss G, Bowles AO, Cooper DB. Reconceptualizing rehabilitation of individuals with chronic symptoms following mild traumatic brain injury. Rehab Psychol. 2019;64:1–12.Available from: https://pubmed.ncbi.nlm.nih.gov/30570331/. American Psychological Association Inc.; Cited 2021 May 21.

    Article  Google Scholar 

  2. Howe EI, Fure SCR, Løvstad M, Enehaug H, Sagstad K, Hellstrøm T, et al. Effectiveness of combining compensatory cognitive training and vocational intervention vs. treatment as usual on return to work following mild-to-moderate traumatic brain injury: interim analysis at 3 and 6 Month follow-up. Front Neurol. 2020;11:561400.

  3. Fure SCR, Howe EI, Andelic N, Brunborg C, Sveen U, Røe C, et al. Cognitive and vocational rehabilitation after mild-to-moderate traumatic brain injury: a randomised controlled trial. Ann Phys Rehabil Med. 2021;64(5). Available from: https://pubmed.ncbi.nlm.nih.gov/33957293/. Cited 2021 Nov 8.

  4. Storzbach D, Twamley EW, Roost MS, Golshan S, Williams RM, O Neil M, et al. Compensatory cognitive training for operation enduring freedom/operation iraqi freedom/operation new dawn veterans with mild traumatic brain injury. J Head Trauma Rehabil. 2017;32(1):16–24.

    Article  Google Scholar 

  5. Twamley EW, Jak AJ, Delis DC, Bondi MW, Lohr JB. Cognitive symptom management and rehabilitation therapy (CogSMART) for veterans with traumatic brain injury: pilot randomized controlled trial. J Rehabil Res Dev. 2014;51(1):59–70.

    Article  Google Scholar 

  6. Howe EI, Langlo KPS, Terjesen HCA, Røe C, Schanke AK, Søberg HL, et al. Combined cognitive and vocational interventions after mild to moderate traumatic brain injury: study protocol for a randomized controlled trial. Trials. 2017;18(1):483.

    Article  Google Scholar 

  7. Twamley EW, Thomas KR, Gregory AM, Jak AJ, Bondi MW, Delis DC, et al. CogSMART compensatory cognitive training for traumatic brain injury: effects over 1 year. J Head Trauma Rehabil. 2015;30(6):391–401. Available from: http://journals.lww.com/headtraumarehab.

    Article  Google Scholar 

  8. Mendella PD, Burton CZ, Tasca GA, Roy P, St. Louis L, Twamley EW. Compensatory cognitive training for people with first-episode schizophrenia: Results from a pilot randomized controlled trial. Schizophr Res. 2015;162(1–3):108–11. Available from: https://pubmed.ncbi.nlm.nih.gov/25631454/. Cited 2021 May 21.

    Article  Google Scholar 

  9. Twamley EW, Vella L, Burton CZ, Heaton RK, Jeste DV. Compensatory cognitive training for psychosis: Effects in a randomized controlled trial. J Clin Psychiatry. 2012;73(9):1212–9.

    Article  Google Scholar 

  10. Vidarsdottir OG, Twamley EW, Roberts DL, Sigurdsson E, Gudmundsdottir B, Magnusdottir BB. Integrative cognitive remediation for early psychosis: a 12-month follow-up. Psychiatry Res. 2020;288. Available from: https://pubmed.ncbi.nlm.nih.gov/32361338/. Cited 2021 Nov 8.

  11. Vidarsdottir OG, Roberts DL, Twamley EW, Gudmundsdottir B, Sigurdsson E, Magnusdottir BB. Integrative cognitive remediation for early psychosis: results from a randomized controlled trial. Psychiatry Res. 2019;273:690–8. Available from: https://pubmed.ncbi.nlm.nih.gov/31207854/. Cited 2021 Nov 8.

    Article  Google Scholar 

  12. Jak AJ, Jurick S, Crocker LD, Sanderson-Cimino M, Aupperle R, Rodgers CS, et al. SMART-CPT for veterans with comorbid post-traumatic stress disorder and history of traumatic brain injury: a randomised controlled trial. J Neurol Neurosurg Psychiatry. 2019;90(3):333–41.

    Article  Google Scholar 

  13. Ayers CR, Dozier ME, Twamley EW, Saxena S, Granholm E, Mayes TL, et al. Cognitive rehabilitation and exposure/sorting therapy (CREST) for hoarding disorder in older adults: a randomized clinical trial. J Clin Psychiatry. 2018;79(2):85–93.

    Article  Google Scholar 

  14. Pittman JOE, Davidson EJ, Dozier ME, Blanco BH, Baer KA, Twamley EW, et al. Implementation and evaluation of a community-based treatment for late-life hoarding. Int Psychogeriatr. 2021;33(9):977-86.

  15. Ayers CR, Davidson EJ, Dozier ME, Twamley EW. Cognitive rehabilitation and exposure/sorting therapy for late-life hoarding: Effects on neuropsychological performance. Journals Gerontol - Ser B Psychol Sci Soc Sci. 2020;75(6):1193–8.

    Google Scholar 

  16. Ayers CR, Saxena S, Espejo E, Twamley EW, Granholm E, Wetherell JL. Novel treatment for geriatric hoarding disorder: an open trial of cognitive rehabilitation paired with behavior therapy. Am J Geriatr Psychiatry. 2014;22(3):248–52.

    Article  Google Scholar 

  17. Ayers CR, Dozier ME, Taylor CT, Mayes TL, Pittman JOE, Twamley EW. Group cognitive rehabilitation and exposure/sorting therapy: a pilot program. Cognit Ther Res. 2017;42(3):315–27. Available from: https://pubmed.ncbi.nlm.nih.gov/32669748/. Cited 2021 Nov 8.

    Article  Google Scholar 

  18. Baker-Ericzén MJ, Fitch MA, Kinnear M, Jenkins MM, Twamley EW, Smith L, et al. Development of the supported employment, comprehensive cognitive enhancement, and social skills program for adults on the autism spectrum: results of initial study. Autism. 2018;22(1):6–19.Available from: https://pubmed.ncbi.nlm.nih.gov/29034696/. Cited 2021 Nov 8.

    Article  Google Scholar 

  19. Woods SP, Weber E, Weisz BM, Twamley EW, Grant I. Prospective memory deficits are associated with unemployment in persons living with HIV infection. Rehabil Psychol. 2011;56(1):77–84. Available from: https://pubmed.ncbi.nlm.nih.gov/21401289/. Cited 2021 May 21.

    Article  Google Scholar 

  20. Mao HF, Tsai AY, Chang LH, Tsai IL. Multi-component cognitive intervention for older adults with mixed cogntiviel levels: impplemenations an preliminary effectiveness in real-world settings. BMC Geriatri. 2022;21(1):543.

  21. Haines E, Dopp A, Lyon A, Witteman H, Bender M, Vaisson G, et al. Harmonizing evidence-based practice, implementation context, and implementation strategies with user-centered design: a case example in young adult cancer care. Implementation Sci Commun. 2021;2(1):45.

  22. Lyon AR, Koerner K. User-centered design for psychosocial intervention development and implementation. Clinical Psychology: Science and Practice; 2016.

    Book  Google Scholar 

  23. Glasgow RE, Harden SM, Gaglio B, Rabin B, Smith ML, Porter GC, et al. RE-AIM planning and evaluation framework: adapting to new science and practice with a 20-year review. Front Public Heal. 2019;7:64.

  24. Glasgow RE, Estabrooks PE. Pragmatic applications of RE-AIM for health care initiatives in community and clinical settings. Prev Chronic Dis. 2018;15:170271.

  25. Brown PF, Della Pietra VJ, deSouza PV, Lai JC, Mercer RL. Class-based n-gram Models of Natural Language. Comput Linguistics. 1992;18(4):467–80.

    Google Scholar 

  26. Dearing JW, Kreuter MW. Designing for diffusion: how can we increase uptake of cancer communication innovations? Patient Educ Couns. 2010;81(SUPPL. 1). Available from: https://pubmed.ncbi.nlm.nih.gov/21067884/. Cited 2021 Jul. 16.

  27. Khanna MS, Kendall PC. Bringing technology to training: web-based therapist training to promote the development of competent cognitive-behavioral therapists. Cogn Behav Pract. 2015;22(3):291–301.

    Article  Google Scholar 

  28. Webb CA, DeRubeis RJ, Barber JP. Therapist adherence/competence and treatment outcome: a meta-analytic review. J Consult Clin Psychol. 2010;78(2):200–11.

  29. Darnell DA, Parker LE, Wagner AW, Dunn CW, Atkins DC, Dorsey S, et al. Task-shifting to improve the reach of mental health interventions for trauma patients: findings from a pilot study of trauma nurse training in patient-centered activity scheduling for PTSD and depression. Cogn Behav Ther. 2019 Nov;48(6)(2):482–96.

    Article  Google Scholar 

  30. Hoeft TJ, Fortney JC, Patel V, Unützer J. Task-sharing approaches to improve mental health care in rural and other low-resource settings: a systematic review. J Rural Heal. 2018;34(1):48–62.

    Article  Google Scholar 

  31. WHO. Task Shifting. Global recomendations and guidelines. Geneva: World Heal Organ. 2008; p. 1–88.

  32. Kirk MA, Haines ER, Rokoske FS, Powell BJ, Weinberger M, Hanson LC, et al. A case study of a theory-based method for identifying and reporting core functions and forms of evidence-based interventions. Transl Behav Med. 2021;11(1):21. Available from: /pmc/articles/PMC7877297/. Cited 2021 Nov 8.

    Article  Google Scholar 

  33. Bowie CR, Bell MD, Fiszdon JM, Johannesen JK, Lindenmayer JP, McGurk SR, et al. Cognitive remediation for schizophrenia: an expert working group white paper on core techniques. Schizophrenia Res. 2020;215:49–53. Available from: https://reader.elsevier.com/reader/sd/pii/S0920996419304827?token=115678DF75E2E75FECDFC774FB408B55CDC1CE7DD8583B862DDACB77FC33DA736E8498AF3806D00E45116DA4F6B349B8&originRegion=us-east-1&originCreation=20210716205458.

    Article  Google Scholar 

Download references

Acknowledgements

This research is supported by the VA Center of Excellence for Stress and Mental Health (CESAMH) and Department of Veterans Affairs Office of Academic Affiliations Advanced Fellowship Program in Mental Illness Research and Treatment. We would like to acknowledge Matt Morgan and John Gault for their assistance with the survey.

Funding

The project and authors were also supported by the VA Center of Excellence for Stress and Mental Health (CESAMH) who were involved in the design; collection, analysis, and interpretation of data; and writing the manuscript as stated below. This material also is the result of work supported with resources of the VA San Diego Healthcare System. The views expressed in this paper are those of the authors and do not reflect the official policy or position of the Department of Veteran Affairs or any of the institutions with which the authors are affiliated.

Author information

Authors and Affiliations

  1. VA Center of Excellence for Stress and Mental Health, 3350 La Jolla Village Dr., San Diego, CA, 92161, USA

    Laurie Lindamer, Erin Almklov, James O. E. Pittman, Jacqueline Maye, Amy Jak, Elizabeth Twamley & Borsika Rabin

  2. Department of Psychiatry, University of California San Diego, 9500 Gilman Dr., La Jolla, CA, 92093, USA

    Laurie Lindamer, James O. E. Pittman, Jacqueline Maye, Amy Jak & Elizabeth Twamley

  3. Department of Psychology, University of British Columbia, 2136 West Mall, Vancouver, BC, V6T 1Z4, Canada

    Shuyuan Shi

  4. Department of Family Medicine and Public Health, University of California San Diego, 9500 Gilman Dr., La Jolla, CA, 92093, USA

    Borsika Rabin

Authors
  1. Laurie Lindamer
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Erin Almklov
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. James O. E. Pittman
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Shuyuan Shi
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Jacqueline Maye
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Amy Jak
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Elizabeth Twamley
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Borsika Rabin
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

LL contributed to the project design, development of the measures, data interpretation, drafting and revising the manuscript. EA contributed to the development of the measures, data analysis and interpretation, drafting and revising the manuscript. JP participated in measure development, interpreted the results, and contributed to drafting/revising the manuscript. SS assisted with data collection and analysis. JM contributed to development of the measures and revising the manuscript. AJ contributed to data collection and manuscript preparation. ET contributed to development of the measures, data collection, and manuscript revisions. BR participated in the design and coordination, and helped with data interpretation and drafting/revising the manuscript. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Laurie Lindamer.

Ethics declarations

Ethics approval and consent to participate

This project was approved by the Institutional Review Board (IRB) at the VA San Diego Healthcare System (VASDHS) (protocol reference H200006). All participants provided informed consent to participate. All study methods and procedures were conducted in accordance with VASDHS IRB guidelines regulations.

Consent for publication

Not Applicable.

Competing interests

None of the authors have any conflicts of interest to declare.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Lindamer, L., Almklov, E., Pittman, J.O.E. et al. Multi-method study of the implementation of Cognitive Symptom Management and Rehabilitation Training (CogSMART) in real-world settings. BMC Health Serv Res 22, 1542 (2022). https://doi.org/10.1186/s12913-022-08941-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12913-022-08941-z

Keywords

BMC Health Services Research

ISSN: 1472-6963

Contact us