- Study protocol
- Open Access
- Open Peer Review
Study protocol: a hybrid effectiveness-implementation trial of Moral Reconation Therapy in the US Veterans Health Administration
BMC Health Services Research volume 18, Article number: 164 (2018)
Moral Reconation Therapy (MRT) is a cognitive-behavioral intervention aimed at reducing risk for criminal recidivism by restructuring antisocial attitudes and cognitions (i.e., “criminogenic thinking”). MRT has empirical support for reducing risk for criminal recidivism among civilian offenders. Recently, a version of MRT was developed for military veterans; however, no randomized controlled trials (RCT) have been conducted with the veteran-specific protocol, and the effectiveness and implementation potential of MRT outside of correctional settings has not been established.
Using a Hybrid Type 1 RCT design, this study will test the effectiveness of MRT to reduce risk for criminal recidivism and improve health-related outcomes among justice-involved veterans entering mental health residential treatment at three US Veterans Health Administration (VHA) Medical Centers. Upon admission to the treatment program, justice-involved veterans will complete a baseline assessment, be randomized to usual care (UC) or UC + MRT, and be followed 6 and 12 months post-baseline. A process evaluation will also be conducted to identify barriers and facilitators to implementation of MRT in residential treatment.
The primary aim of this study is to evaluate the effectiveness of MRT with justice-involved veterans. If MRT proves effective in this trial, the findings can provide large healthcare systems that serve veterans with an evidence-based intervention for addressing criminogenic thinking among justice-involved adults, as well as guidance on how to facilitate future implementation of MRT in non-correctional settings.
This trial is funded by the VA Health Services Research & Development Program (IIR 14–081) and is registered with ClinicalTrials.gov (ID: NCT02524171).
Among criminal offenders, two-thirds will recidivate (i.e., be rearrested, reconvicted, or reincarcerated for a new crime or violation of their parole or probation) within 3 years from their release . Criminal recidivism is also common among veterans of the US military (“justice-involved veterans”), who comprise 8% of the incarcerated population in the US (approximately 181,500 individuals). For example, the majority of incarcerated veterans in US jails and prisons have at least one prior episode of incarceration, and 43% have four or more prior lifetime arrests . Therefore, there is a critical need to develop and test interventions that may reduce criminal recidivism in this population.
According to the Risk-Need-Responsivity model of offender rehabilitation, antisocial cognitions and attitudes – referred to as criminogenic thinking – are the risk factors most strongly associated with criminal recidivism [3, 4]. Criminogenic thinking has also been linked to offending among US military veterans [5,6,7,8,9]. Cognitive-behavioral interventions that are designed to restructure antisocial cognitions and behaviors represent best practices for reducing criminal recidivism [10,11,12,13]. However, the availability of these interventions for justice-involved veterans following release from correctional settings is less than the availability of services to address other risk factors for recidivism identified in the Risk-Need-Responsivity model – e.g., substance abuse .
Moral Reconation Therapy (MRT) is a cognitive-behavioral intervention that aims to reduce criminogenic thinking  and has the strongest empirical support for reducing criminal recidivism among civilian offenders . MRT is a manualized intervention that uses an open-enrollment, group format and includes a patient workbook. The MRT curriculum consists of structured exercises and homework assignments that aim to modify the antisocial cognitions and behaviors of participants in order to move them through 12 steps of moral development. The term “conation” has been employed to describe the conscious process of decision-making and purposeful behavior. The term “moral reconation” was chosen for this treatment approach because the underlying goal is to change conscious decision-making to higher levels of moral reasoning .
Multiple meta-analyses in civilian populations support the efficacy of MRT to reduce criminal recidivism [10, 11, 17,18,19,20]. For example, in a review of 65 studies, MRT was found to reduce the 12-month recidivism rate by 50% . More recently, a meta-analysis of 33 published studies of MRT found that the rate of recidivism among MRT participants is reduced by one-third compared to the rate of those who do not receive MRT and that the treatment effect size is greater in randomized (vs. non-randomized) trials. Further, a structured evidence review from the US Department of Veterans Affairs examined the evidence base for MRT in civilian samples . Six studies were identified as being rigorous enough to provide interpretable evidence about the impact of MRT and all demonstrated a significant reduction in reoffending in the MRT group [21,22,23,24,25,26].
Aside from reductions in criminal recidivism, MRT has theoretical and empirical associations with improvement in several health-related outcomes such as substance use [21, 27], mental health [28,29,30], housing , and employment . The theoretical and empirical links between MRT and these health-related outcomes are important, given that these health-related outcomes are risk factors for future recidivism, and improvements in these outcomes have been shown to reduce recidivism. For example, according to the Risk-Need-Responsivity model , substance use and employment problems are robust predictors of criminal recidivism and are key domains measured by valid indices of recidivism risk .
Despite its evidence base in civilian samples, no randomized controlled trials (RCT) of MRT have been conducted with justice-involved veterans. This is an important research gap as justice-involved veterans differ from justice-involved civilians on sociodemographics (justice-involved veterans tend to be older, more educated, and more likely to be married) [34, 35], offense characteristics (justice-involved veterans are more likely to have committed violent offenses, particularly intimate partner violence) [34,35,36], mental and physical health problems (justice-involved veterans have more service-related traumas and traumatic brain injuries) [37, 38], and interpersonal problems (a strong connection to military culture in veterans can increase feelings of estrangement from social networks upon return to civilian life) . Given these differences, prior research on MRT with civilian populations may not be generalizable. In response to this gap in the literature, a version of MRT specific to justice-involved veterans was developed in 2013 ; however, its efficacy with this group of offenders has yet to be examined.
Another issue is that MRT was originally developed for use within correctional settings in which treatment can be mandated and rewards and sanctions for treatment engagement or non-engagement, respectively, can be applied. Consequently, knowledge regarding the effectiveness and implementation potential of MRT in non-correctional settings is limited. Understanding the implementation of MRT in non-correctional settings is important given the rise of diversion programs and specialty courts in the US over the past decade . Moreover, mental health services are increasingly called upon to treat criminal offenders and reduce their risk for criminal recidivism. However, there is a lack of data on the effectiveness and implementation potential of MRT within mental health treatment programs. To fill this gap in the literature, the study described in this protocol paper aims to evaluate the effectiveness and implementation potential of MRT for veterans in mental health residential treatment programs within the US Veterans Health Administration (VHA) – a large, integrated healthcare system which provides mental health and psychosocial services to a substantial number of justice-involved veterans [41,42,43].
This study will use a Hybrid Type 1 design , which is a mixed-methods design that will allow us to test the effectiveness of MRT in an RCT across three VHA medical centers, as well as gather qualitative data on MRT’s implementation potential in a process evaluation. The overarching objective of the current study is to evaluate MRT as an intervention to reduce risk for criminal recidivism and improve health-related outcomes among justice-involved veterans in VHA mental health residential treatment programs. At each study site, veterans who (a) are entering a mental health residential treatment program, and (b) had been arrested and charged and/or released from incarceration in the past 5 years will be recruited for participation and randomly assigned to one of two conditions: usual care (UC) or UC + two MRT group meetings per week for 12 weeks.
The specific aims of this study are to determine whether adding MRT to usual care in mental health residential treatment reduces overall risk for criminal recidivism (Aim 1, Hypothesis 1a); improves health-related outcomes that are risk factors for recidivism (i.e., substance use, mental health, housing, and employment problems) (Aim 1, Hypothesis 1b); and whether the effects of MRT on reduced recidivism risk and better health-related outcomes is mediated in part by greater likelihood of completing the residential treatment program and utilizing substance use disorder/mental health continuing care services (Aim 1; Hypothesis 1c). Patients will be followed 6 and 12 months post-baseline. The process evaluation will entail qualitative interviews with mental health treatment program providers and patients (Aim 2). The goal of this aim is to inform the future implementation of MRT in VHA by identifying barriers and facilitators to implementation in residential treatment programs.
In addition to these aims, the study design will also allow us to explore other mediators and moderators of MRT’s effects. For example, improvements in interpersonal functioning and reductions in affiliations with antisocial/substance-using peers are key mechanisms of MRT. Therefore, we will examine if these variables mediate links between receipt of MRT and better outcomes during the follow-up period. Finally, given that (a) psychopathic personality traits have been found to moderate recidivism among justice-involved adults , and (b) patients in this trial will have varied histories of criminal justice involvement, we will explore whether level of psychopathy and criminal history at baseline moderate MRT’s direct effects on outcomes.
To increase the generalizability of findings, participants will be drawn from mental health residential treatment programs at three large VHA Medical Centers on the West Coast, Midwest, and East Coast of the US. These residential programs are analogous to the settings in which MRT was originally developed (i.e., drug therapeutic communities in prison) and serve a high proportion of justice-involved veterans who have extensive histories of criminal justice involvement .
Veteran patients who (a) are entering a mental health residential treatment program at one of the participating sites, (b) had been arrested and charged and/or released from incarceration in the 5 years prior to their current admission to residential treatment, and (c) are conversant in English will be eligible for participation and recruited into the RCT portion of the study. Exclusion criteria are being too cognitively impaired to understand the informed consent process and other study procedures, and pregnancy. Power analyses were calculated to determine the sample size needed to obtain a small-to-medium effect size (i.e., f2 = .07) with 80% power. To account for having patients at three sites, the analyses were based on six cells (two conditions per site). Based on an alpha of .05 (two-tailed), the inclusion of three moderator variables and three interaction terms, and an expected attrition rate of 20% at the follow-up assessments, a total of 365 patients will need to be recruited into the study. The sample will be stratified by site such that 122 patients (with rounding) will be recruited from each of the three VHA medical centers, with 61 patients entering each condition at each site.
For the process evaluation (Aim 2), we will interview six staff members from the mental health residential treatment programs at each site who were involved in the delivery and/or implementation of MRT. We will also conduct interviews with 12 veteran participants from each site who were randomized to the MRT condition: one-half will be drawn from those who remained engaged in MRT during their stay in the residential program, and the other half from those who dropped out of MRT prior to being discharged from the residential program. Staff interviews will take place after all patient participants have completed the intervention phase of the RCT. Patient interviews will take place after participants have either completed or dropped out of the intervention.
Recruitment for RCT
Veteran patients entering mental health residential treatment programs at participating sites will be screened by treatment program staff in consecutive order during the admissions process to determine their eligibility for the RCT. Treatment program staff members will also verify that the veteran is not pregnant and is conversant in English. Treatment program staff will then ask eligible patients for permission to be contacted about the study and will provide study personnel with the names and contact information of eligible patients.
Eligible patients will be contacted by study personnel, who will explain the purpose of the study, what study participation would involve, and the risks and benefits of participation. Patients will be informed that they will be assigned either to “usual care” or two additional one-hour long group sessions per week in the residential treatment program. Regardless of their group assignment, patients will also be informed that they will be asked to complete an in-person baseline assessment and two follow-up assessments (in-person or via phone) 6 and 12 months later. Patients who express interest in participating will be scheduled for the baseline assessment. At the beginning of that assessment, patients will be screened for cognitive impairment using the Montreal Cognitive Assessment’s section on Orientation . Patients who are not able to correctly answer the Orientation (date, location) items will be deemed too cognitively impaired to understand the study’s procedures, participate meaningfully in MRT, and respond to interviews, and therefore will be ineligible. For those who are eligible, written informed consent will be obtained, and the baseline assessment will be administered.
At the beginning of the study before participants are recruited, a randomization schedule will be established for each site using www.randomizer.org. Randomization will occur in fixed block sizes of six to assure a roughly equal balance of participants in the two conditions in case the study does not fully accrue. The schedule concealment will be maintained by the principal investigator at each study site. At each site, after creation of the randomization spreadsheets, sealed envelopes will be labeled with a unique study ID number and include the condition assignment based on the randomization spreadsheet. Following completion of the baseline assessment, the research assistant will open the envelope for that unique study participant, notify the participant of his/her group assignment, and schedule the first MRT session for those randomized to that condition. Patients randomized to the UC condition will be asked to not seek out MRT during the 12-month study period. To reduce contamination, patients in the UC condition will not be allowed to attend MRT sessions, and the MRT group facilitators will remind the members at the end of each session not to discuss the group content outside of the session. In the event the study team learns that MRT-related information was shared with UC participants, the records of those UC participants will be flagged, and contamination-adjusted intention-to-treat analyses will be calculated (see Data analysis section) .
All patients, regardless of condition, will receive usual care in the mental health residential treatment program at one of the three sites. Mental health residential treatment programs serve veterans dealing with homelessness, substance abuse, and/or mental health issues. These programs aim to improve veterans’ health and facilitate community reintegration by providing care in a structured residential environment. The residential programs are comparable across sites in terms of program structure and services delivered (patients are involved in therapeutic activities 7 h per day, 5 days per week), clinical approaches (individual and group-based, cognitive-behavioral programming for substance use and mental health problems) and staffing (psychiatrists, psychologists, social workers, nurses, addiction therapists, vocational therapists, homelessness coordinators). The participants’ health care providers in the residential treatment programs (not the study team) will be providing usual care. No standard treatment will be withheld.
Patients assigned to the MRT condition will receive usual care in the residential treatment program plus 2 h of MRT weekly. Over the course of 12 weeks, they will attend 24 group sessions (one-hour sessions, twice per week). The overall length of the intervention (12 weeks) corresponds to the national average of bed days of care for veterans in mental health residential treatment (3 months) and the minimum intended length of stay for the target residential programs in this study. Regardless of patients’ length of stay, continuing care services are available at the residential programs at each site, and those who have not yet completed the full MRT protocol when they discharge from the residential programs will be encouraged to continue with the intervention as outpatients.
The MRT curriculum consists of short assignments, grounded in cognitive-behavioral techniques, which move participants through 12 steps that aim to restructure antisocial cognitions and behaviors. To progress through the steps, patients complete homework between group meetings and then present their homework to group members in the following week’s meeting for feedback. Participants move through steps at a rate of approximately 1–2 sessions and group sessions can incorporate new members at any time. With open enrollment, patients are presenting on different steps, which is advantageous because those who have progressed farther are able to share their insights to newer patients who are at lower steps. To facilitate patients’ engagement in MRT, small reinforcements (coins and certificates) will be offered for completion of key steps in the MRT curriculum (i.e., Steps 3, 7, and 12).
To assess ongoing fidelity to the MRT condition, at each site, one group session per month will be observed in-person by study research staff and evaluated against a fidelity checklist that has been used in prior research with MRT. The completed fidelity checklists for each site will then be reviewed each month by the site PIs and discussed on a monthly treatment fidelity call with the developers of MRT who will provide corrective feedback and consultation to the MRT group facilitators. A subset of group sessions will also be audio- or video-recorded (with participant consent) to permit evaluation of inter-rater reliability of the checklist coding.
RCT. For the RCT, research assistants will collect data from patients at three time-points: baseline, and 6 and 12 months post-baseline. The baseline assessment will be conducted in-person approximately 1 week after the patient is admitted to the residential treatment program. The 6- and 12-month follow-up assessments will be conducted either in-person or via telephone. We will use an intent-to-treat design and follow all patients who are randomized to either the UC or MRT condition. An overview of the variables that will be measured across the study time-points and the specific measures or data sources used to index these variables are shown in Table 1. Collectively, the measures represent validated tools that have been commonly used in prior studies of criminal justice and/or substance-using populations. With exception of the Triarchic Psychopathy Measure, all measures will be administered at all time-points.
Outcome selection was guided by Risk-Need-Responsivity framework [3, 4], which describes the most robust risk factors for criminal recidivism, as well as Fontaine’s work on homelessness and recidivism [49, 50]. The primary outcome of recidivism risk will be measured with the Psychological Inventory of Criminal Thinking Styles , a self-report measure used to assess antisocial cognitions and behaviors (i.e., “criminogenic thinking”). Items on this measure are summed to create a General Criminal Thinking score, which has been validated as an overall index of recidivism risk [52, 53]. Although reductions in criminal recidivism is the ultimate goal of MRT, given the non-correctional setting, as well as the fact that patients in this trial will have varied histories of criminal justice involvement, it is anticipated that the base rate of criminal recidivism will be low during the 12-month follow-up period. Therefore, we elected to focus on recidivism risk as the primary outcome and to index this outcome via a measure of criminogenic thinking, given it is the strongest dynamic risk factor for recidivism [3, 4].
Secondary outcomes include health-related outcomes of substance use (via the Alcohol and Drug modules of the Addiction Severity Index [ASI] , and Timeline Follow-back interviews for alcohol and drug use) , mental health (via the Psychiatric Status section of the ASI to index global mental health, the Patient Health Questionnaire-9 to index symptoms of major depression , and the PTSD Checklist, DSM-5 version to index symptoms of PTSD ), housing (via items from the VHA’s Homeless Operations Management and Evaluation System) , and employment (via the Employment/Support section of the ASI).
In order to test whether the effects of MRT on reduced recidivism risk and better health-related outcomes are mediated in part by greater likelihood of completing the mental health residential treatment program and utilizing substance use disorder/mental health continuing care services, we will also collect data on service utilization (via patients VHA administrative records) and mutual-help group attendance (via the Alcoholics Anonymous Interview ). In order to conduct exploratory mediation analyses, we will measure interpersonal functioning (via the Family/Social functioning module of the ASI and the Inventory of Interpersonal Problems ) and antisocial/substance-using peer affiliations (via select items from the Measures of Criminal Attitudes and Associates  and the Life Stressors and Social Resources Inventory ) to test whether changes in these measures mediate links between receipt of MRT and better outcomes during the follow-up period. To conduct exploratory moderation analyses, we will collect information on psychopathic personality traits (via the Triarchic Psychopathy Measure  and criminal history (via the Legal Status module of the ASI) to test whether scores on these indices at baseline moderate MRT’s direct effects on outcomes. The ASI Legal Status module will also be used to measure criminal recidivism during the follow-up period.
The RE-AIM (Reach, Effectiveness, Adoption, Implementation, and Maintenance) Planning Tool  will be used to guide the content of the semi-structured phone interviews with mental health residential treatment program providers and patients at each site. The RE-AIM framework  highlights five domains to evaluate an intervention’s potential for implementation and widespread impact: Reach (how to reach the target population with the intervention); Effectiveness (how to know the intervention is effective); Adoption (organizational support to implement an intervention); Implementation (fidelity and consistency of an intervention’s delivery); and Maintenance (sustainability of an intervention in the long-term). The RE-AIM Planning Tool will be modified to ask questions of providers and patients within these domains regarding key issues that should be considered when planning to implement MRT in mental health residential treatment across VHA.
Intent-to-treat analyses will be conducted. The primary and secondary outcomes will be measured at all three time-points. Therefore, we will use generalized linear mixed model (GLMM) regressions to compare the UC and MRT conditions on these outcomes. These models take into account that the repeated measures across time points are clustered within each individual by treating time as a single repeated factor. GLMMs also have the advantages of being able to use all available data (under the assumption that data are missing at random) and being able to accommodate different conditional distributions for outcome variables (e.g., dichotomous; continuous; Poisson-distributed). We will also examine these outcomes as a function of MRT dose (i.e., number of group sessions attended; number of steps completed). To test mediation, we will conduct GLMM regressions following the approach of Mackinnon and Fairchild , which will correspond to a causal sequence among condition, the hypothesized mediator, and the outcomes, and control for covariates (e.g., baseline scores on the outcome). To test moderation, we will explore whether at baseline various indices of criminal history (i.e., incarcerated or not in the past 12 months; number of months since charged with an offense or released from incarceration; and extent of criminal history) and psychopathic personality traits moderate the direct effects of condition on the primary and secondary outcomes. Finally, to address the possibility of contamination, if we learn that MRT-related information was shared with UC participants, the records of those UC participants will be flagged, and contamination-adjusted intention-to-treat analyses will be calculated  (i.e., the effect of treatment assignment on outcomes is adjusted by the percentage of participants assigned to the UC condition who may have received the treatment).
The de-identified audio-files of the staff and patient interviews will be transcribed. The interview transcripts will then be will be analyzed using template analysis to identify common themes in textual data . This approach allows for identification of codes a priori, as well as modification of codes and addition of new codes based on a reading and interpretation of the data. This process will be used to identify themes related to barriers and facilitators to MRT implementation at the system, provider, and patient levels. These barrier and facilitator themes will be summarized and categorized into tables, which will include potential solutions and potential-to-leverage columns that contain evidence-based implementation tools to be considered for more widespread usage of MRT.
This study was reviewed and approved by the VA’s Central IRB (Study #15–04) and registered with ClinicalTrials.gov (ID: NCT02524171). Prospective participants will be told that they may withdraw from the study at any time and refrain from answering specific questions, and that all information will be confidential and used only for the purposes of the research study. Prospective participants will also be told that any withdrawal from the study on their part or on the part of the investigators will not affect the standard care that the participant is receiving in the residential treatment program or any other healthcare from the VHA to which the participant is entitled.
The primary aim of this hybrid trial is to evaluate the efficacy of MRT with justice-involved veterans using the new veteran-specific protocol of this intervention . Another key contribution of this trial is the opportunity to learn about factors that may either hinder or facilitate implementation of MRT in a non-correctional setting. As noted above, MRT was originally developed for use within correctional settings. Thus, knowledge of the implementation potential of MRT in large, integrated healthcare systems such as the VHA is limited, and unique challenges to (or opportunities for) implementation of MRT in this setting may emerge in this trial. This issue is timely, given that recent policy efforts in the US that are focused on diversion rather than incarceration (e.g., specialty courts) have shifted the burden of treating justice-involved adults and reducing their risk for recidivism from correctional services to behavioral health services in the community .
Recent work by Blonigen and colleagues  highlights a number of potential challenges to implementation of MRT in the VHA. One such challenge that is relevant to the current trial is patient engagement, given the time commitment involved in MRT. Specifically, the MRT curricula and homework assignments that patients are required to complete between group sessions can be time intensive, and completion of all 12 MRT steps requires at least 24 sessions, on average. Consequently, engagement may be challenging for non-incarcerated populations. This may be due to the fact that for those who are not incarcerated or are not mandated to attend MRT by the criminal justice system, there are no consequences for not engaging in the intervention. In addition, those who are not incarcerated may have other demands on their time such as employment and/or other treatment requirements placed on them by the criminal justice system or the residential program in which MRT has been implemented. We will address this issue by offering reinforcements (coins and certificates) for completion of key steps in the MRT curriculum (e.g., Steps 3, 7, and 12). For patients who are still under supervision of the criminal justice system, such incentives are often highly valued as it allows them to demonstrate to court-related decision makers that they are complying with treatment [69, 70]. In addition, there is evidence to suggest that completion of the first seven of the 12 steps in MRT is associated with long-term reductions in criminal recidivism [71, 72]. This suggests that a lower dose than the 24 sessions that are planned for patients randomized to MRT in this trial may still yield benefits on the primary and secondary outcomes. We estimate 12 sessions as the minimal dose of MRT for this study. To maximize the clinical usefulness of the data, our analytic plan includes an examination of the effect of condition on outcomes as a function of (a) number of MRT group sessions attended, and (b) number of MRT steps completed. Finally, the potential challenges of patient engagement in MRT in non-correctional settings and how to properly incentivize participation (or sanction non-participation) will be a key focus of the process evaluation, which will entail interviews with patients who did or did not remain engaged in MRT during their residential stay.
This hybrid trial represents the first attempt to systematically evaluate the effectiveness of MRT with justice-involved veterans and the implementation potential of this intervention in a large, integrated healthcare setting. The potential impact of this work is underscored by the extensive criminal histories of veterans treated in mental health residential treatment programs in VHA  and the dearth of empirically-supported treatments in this healthcare system that directly address criminogenic thinking  – the strongest dynamic risk factor for criminal recidivism [3, 4]. By testing and implementing MRT in residential treatment programs, where many patients have extensive criminal histories, integrated healthcare systems such as the VHA can better understand how to reduce risk for criminal recidivism among patients with criminal justice system involvement and in turn improve the long-term health and well-being of this vulnerable population.
Addiction Severity Index
Generalized Linear Mixed Models
Moral Reconation Therapy
Randomized Controlled Trial
Reach, Effectiveness, Adoption, Implementation, and Maintenance
Veterans Health Administration
Langan PA, Levin DJ. Recidivism of prisoners released in 1994. U.S. Department of Justice, Office of Justice Programs. 2002. https://www.bjs.gov/content/pub/pdf/rpr94.pdf. Accessed 3 Mar 2017.
Bronson J, Carson A, Noonan M, Berzofsky M. Veterans in prison and jail, 2011–12. U.S. Department of Justice, Office of Justice Programs. 2015. https://www.bjs.gov/content/pub/pdf/vpj1112.pdf. Accessed 06 Mar 2017.
Andrews DA, Bonta JL. The psychology of criminal conduct. 5th ed. New Providence: Anderson; 2010.
Andrews DA, Bonta JL. Rehabilitating criminal justice policy and practice. Psychol Public Policy Law. 2010;16:39–55.
Black DW, Carney CP, Peloso PM, Wollson RF, Letuchy E, Doebbeling BN. Incarceration and veterans of the first gulf war. Mil Med. 2005;170:612–8.
Bovasso GB, Alterman AI, Cacciola JS, Rutherford MJ. The prediction of violent and nonviolent criminal behavior in a methadone maintenance population. J Pers Dis. 2002;16:360–73.
Kasarabada ND, Anglin MD, Stark E, Paredes A. Cocaine, crime, family history of deviance: are psychosocial correlates related to these phenomena in male cocaine abusers? Subst Abuse. 2000;21:67–78.
Blodgett JC, Fuh IL, Maisel NC, Midboe AM. A structured evidence review to identify treatment needs of justice-involved veterans and associated psychological interventions. Veterans Health Administration. 2013. https://www.ci2i.research.va.gov/CI2IRESEARCH/docs/structured_evidence_review.pdf. Accessed 6 Mar 2017.
Blonigen DM, Bui L, Elbogen E, Blodgett JC, Maisel NC, Midboe AM, et al. Risk of recidivism among justice-involved veterans: a systematic review of the literature. Criminal Justice Policy Rev. 2016;27:812–37.
Aos S, Miller M, Drake E. Evidence-based adult corrections programs. Washington state Institute for Public Policy. 2006. http://www.wsipp.wa.gov/rptfiles/06-01-1201.pdf. Accessed 07 Mar 2017.
Wilson DB, Bouffard LA, Mackenzie DL. A quantitative review of structured, group-oriented, cognitive behavioral programs for offenders. Crim Justice Behav. 2005;32:172–204.
Landenberger NA, Lipsey MW. The positive effects of cognitive-behavioral programs for offenders: a meta-analysis of factors associated with effective treatment. J Exp Criminol. 2005;1:451–76.
Milkman H, Wanberg K. Cognitive behavioral treatment: a review and discussion for corrections professionals. In: U.S. Department of Justice, National Institute of corrections; 2007. http://static.nicic.gov/Library/021657.pdf. Accessed 08 Mar 2017.
Blonigen DM, Rodriguez AL, Manfredi L, Britt J, Nevedal A, Finlay AK, et al. The availability and utility of services to address risk factors for recidivism among justice-involved veterans. Criminal Justice Policy Rev. 2016; https://doi.org/10.1177/088740341662860.1.
Little GL, Robinson KD. Moral reconation therapy: a systematic step-by-step treatment system for treatment resistant clients. Psychol Rep. 1988;62:135–51.
Little GL, Robinson KD. Winning the invisible war. Memphis: Eagle Wing Books; 2013.
Little GL. Meta-analysis of moral reconation therapy recidivism results from probation and parole implementations. Cogn Behav Treat Rev. 2005;14:14–6.
Ferguson LM, Wormith JS. A meta-analysis of moral reconation therapy. Int J Offender Ther Comp Criminol. 2013;57:1076–106.
Little GL. Meta-analysis of MRT recidivism research on post-incarceration adult felony offenders. Cogn Behav Treat Rev. 2001;10:4–6.
Little GL, Robinson KD, Burnette KD, Swan ES. Successful ten-year outcome data with MRT: treated offenders show significantly lower reincarceration each year. Cogn Behav Treat Rev. 1999;8:1–3.
Anderson JL. Overview of the Illinois DOC high-risk parolee re-entry program and 3-year recidivism outcomes of program participants. Cogn Behav Treat Rev. 2002;11:4–6.
Boston C. Changing offenders’ behavior: evaluating moral reconation therapy in the better people program. In: Better People: In; 2001. http://franklincountypa.gov/ckeditorfiles/files/Jail/Jail_Better_People.pdf. Accessed 9 Mar 2017.
Brame R, Mackenzie DL, Waggoner AR. D K. Moral Reconation therapy and problem behavior in the Oklahoma department of corrections. J Oklahoma Crim Just Res Consort. 1996;3:63–84.
Burnett WL. Treating post-incarcerated offenders with moral reconation therapy: a one-year recidivism study. Cogn Behav Treat Rev. 1997;6:2.
Little GL, Robinson KD. Treating drunk drivers with moral recognition therapy: a one-year recidivism report. Psychol Rep. 1989;64:960–2.
Little GL, Robinson KD, Burnette KD. Treating drug offenders with moral reconation therapy: a three-year recidivism report. Psychol Rep. 1991;69:1151–4.
Fuller D. 16th judicial district of Tennessee drug court program 2003 process evaluation. In drug courts program office, Office of Justice Programs, U.S. Department of Justice. 2003. rutherfordcountytn.gov/drug_court/docs/2003outcomereport.pdf. Accessed 09 Mar 2017.
Lindholm C. Preliminary outcomes with moral reconation therapy: Northeast Texas restitution center, Maud. TX Cogn Behav Treat Rev. 1998;7:16.
Burnette KD, Prachniak KJ, Swan ES, Robinson KD, Lester D, Little GL. Recidivism of MRT-treated male offenders in a prison-based therapeutic community. Cogn Behav Treat Rev. 2005;14:10.
Gilreath L. First wings of freedom program: results and observations. Cog Behav Treat Rev. 1995;4:14–5.
Caton CLM, Dominguez B, Schanzer B, Hasin D, Shrout PE, Felix A, et al. Risk factors for long-term homelessness: findings from a longitudinal study of first-time homeless single adults. Am J Public Health. 2005;95:1753–9.
Andrews DA, Bonta J. The empirical base of PCC and the RNR model of assessment and crime prevention through human service. In: Boyne S, editor. The psychology of criminal conduct. 5th ed. New Providence: Anderson; 2010. p. 45–78.
Olver ME, Stockdale KC, Wormith JS. Thirty years of research on the level of service scales: a meta-analytic examination of predictive accuracy and sources of variability. Psychol Assess. 2013;26:156–76.
Mumola CJ. Veterans in prison or jail. U.S. Department of Justice, Office of Justice Programs. 2000. http://bjs.gov/content/pub/pdf/vpj.pdf. Accessed 09 Mar 2017.
Noonan ME, Mumola CJ. Veterans in state and federal prison, 2004. U.S. Department of Justice, Office of Justice Programs. 2007. http://bjs.gov/content/pub/pdf/vsfp04.pdf. Accessed 09 Mar 2017.
Marshall AD, Panuzio J, Taft CT. Intimate partner violence among military veterans and active duty servicemen. Clin Psychol Rev. 2005;25:862–76.
Elbogen EB, Fuller SF, Johnson SC, Brooks S, Kinneer P, Calhoun PS, et al. Improving risk assessment of violence among military veterans. Clin Psychol Rev. 2010;30:595–607.
Rosenthal L, McGuire J. Incarcerated veterans. In: Gideon L, editor. Special needs offenders in correctional institutions. Thousand Oaks: SAGE Publications; 2013. p. 345–76.
Halvorson A. Understanding the military: the institution, the culture, and the people. Substance Abuse and Mental Health Services Administration Center for Substance Abuse Treatment Partners for Recovery Initiative. 2010; https://www.samhsa.gov/sites/default/files/military_white_paper_final.pdf. Accessed 10 Mar 2017
Samuels J, La Vigne N, Taxy S. Stemming the tide: strategies to reduce the growth and cut the cost of the federal prison system. Urban Institute. 2013; http://www.urban.org/sites/default/files/publication/24086/412932-Stemming-the-Tide-Strategies-to-Reduce-the-Growth-and-Cut-the-Cost-of-the-Federal-Prison-System.PDF. Accessed 10 Mar 2017
Blue-Howells JH, Clark SC, van den Berk-Clark C, JF MG. The U.S. Department of Veterans Affairs Veterans Justice Programs and the sequential intercept model: case examples in national dissemination of intervention for justice-involved veterans. Psychol Serv. 2013;10:48–53.
Finlay AK, Binswanger IA, Smelson D, Sawh L, McGuire J, Rosenthal J, et al. Sex differences in mental health and substance use disorders and treatment entry among justice-involved veterans in the veterans health administration. Med Care. 2015a;53:S105–11.
Finlay AK, Stimmel M, Blue-Howells J, Rosenthal J, McGuire J, Binswanger I, et al. Use of veterans health administration mental health and substance use disorder treatment after exiting prison: the health Care for Reentry Veterans Program. Admin Pol Ment Health. 2017;44:177.
Curran GM, Bauer M, Mittman B, Pyne JM, Stetler C. Effectiveness-implementation hybrid designs: combining elements of effectiveness and implementation research to enhance public health impact. Med Care. 2012;50:217–26.
Ogloff JRP, Wong S, Greenwood A. Treating criminal psychopaths in a therapeutic community program. Behav Sci Law. 1990;8(2):181–90.
Weaver CM, Trafton JA, Kimerling R, Timko C, Moos R. Prevalence and nature of criminal offending in a national sample of veterans in VA substance use treatment prior to the operation enduring freedom/operation Iraqi freedom conflicts. Psychol Serv. 2013;10:54–65.
Nasreddine ZS, Phillips NA, Bedirian V, Charbonneau S, Whitehead V, Collin I, et al. The Montreal cognitive assessment, MoCA: a brief screening tool for mild cognitive impairment. J Am Geriatr Soc. 2005;53(4):695–9.
Sussman JB. An IV for the RCT: using instrumental variables to adjust for treatment contamination in randomised controlled trials. BMJ. 2010;340
Fontaine J. Examining housing as a pathway to successful reentry. The Urban Institute. 2013; http://www.urban.org/sites/default/files/publication/24206/412957-Examining-Housing-as-a-Pathway-to-Successful-Reentry-A-Demonstration-Design-Process.PDF. Accessed 09 Mar 2017
Fontaine J, Biess J. Housing as a platform for formerly incarcerated persons. The Urban Institute. 2012; http://www.urban.org/sites/default/files/publication/25321/412552-Housing-as-a-Platform-for-Formerly-Incarcerated-Persons.PDF. Accessed 11 Mar 2017
Walters GD. The psychological inventory of criminal thinking styles (PICTS): a review and meta-analysis. Assessment. 2002;9(3):278–91.
Walters GD, Lowenkamp CT. Predicting recidivism with the psychological inventory of criminal thinking styles (PICTS) in community-supervised male and female federal offenders. Psychol Assess. 2016;28(6):652–9.
Walters GD, Cohen TH. Criminal thought process as a dynamic risk factor: variable- and person-oriented approaches to recidivism prediction. Law Hum Behav. 2016;40(4):411–9.
McLellan AT, Cacciola JS, Alterman AI, Rikoon SH, Carise D. The addiction severity index at 25: origins, contributions and transitions. Am J Addict. 2006;15:113–24.
Sobell LC, Brown J, Leo GI. The reliability of the alcohol timeline followback when administered by telephone and by computer. Drug Alcohol Depend. 1996;42:49–54.
Kroenke K, Spitzer RL, Williams JB. The PHQ-9: validity of a brief depression severity measure. J Gen Intern Med. 2001;16(9):606–13.
Bovin MJ, Marx BP, Weathers FW, Gallagher MW, Rodriguez P, Schnurr PP, et al. Psychometric properties of the PTSD checklist for diagnostic and statistical manual of mental health disorders-fifth edition (PCL-5) in veterans. Psychol Assess. 2016;28:1379–91.
LaSalle JL. Homeless operations management and evaluation system (HOMES) user manual – phase 1. Dep of Veterans Affairs. 2011. https://www.va.gov/HOMELESS/docs/Center/HOMES_Manual.pdf. Accessed 6 Mar 2017.
Tonigan JS, Connors GJ, Miller WR. Alcoholics anonymous involvement (AAI) scale: reliability and norms. Psychol Addict Behav. 1996;10:75–80.
Barkham M, Hardy GE, Startup M. The IIP-32: a short version of the inventory of interpersonal problems. Br J Clin Psychol. 1996;35:21–35.
Mills JF, Kroner DG, Forth AE. Measures of criminal attitudes and associates (MCAA): development, factor structure, reliability, and validity. Assessment. 2002;9(3):240–53.
Moos RH, Moos BS. Life stressors and social resources inventory-adult form. Odessa: PAR; 1994.
Patrick CJ, Fowles DC, Krueger RF. Triarchic conceptualization of psychopathy: developmental origins of disinhibition, boldness, and meanness. Dev Psychopathol. 2009;21(3):913–38.
Forman J, Damschroder LJ, Robinson CH, Kerr EA. RE-AIM plus: expanding the RE-AIM framework for real-time program evaluation. Ann Arbor VA HSR&D Center for clinical management research. 2010. http://re-aim.org/wp-content/uploads/2010/03/Forman_2010_RE-AIMPlus.pdf. Accessed 10 Mar 2017.
Glasgow RE, Vogt TM, Boles SM. Evaluating the public health impact of health promotion interventions: the RE-AIM framework. A J Public Health. 1999;89:1322–7.
Mackinnon DP, Fairchild AJ. Current directions in mediation analysis. Curr Dir Psychol Sci. 2009;18(1):16.
King N. Template analysis. In: Symon G, Cassell C, editors. Qualitative methods and analysis in organizational research. Thousand Oaks: Sage Publications; 1998. p. 119–34.
Blonigen DM, Rodriguez AL, Manfredi L, Nevedal A, Rosenthal J, McGuire JF, et al. Cognitive-behavioral treatments for criminogenic thinking: barriers and facilitators to implementation within the veterans health administration. Psychol Services. 2018;15:87-97.
Lash S, Burden JL, Monteleone BR, Lehmann LP. Social reinforcement of substance abuse treatment aftercare participation: impact on outcome. Addict Behav. 2004;29:337–42.
McKay J. Continuing care research. J Subst Abus Treat. 2009;36:131–45.
Burnette KD, Swan ES, Robinson KD, Woods-Robinson M, Little GL. Male juvenile offenders participating in MRT within a therapeutic community program continue to show positive results. Cogn Behav Treat Rev. 2004;13:3–5.
Krueger S. Three-year recidivism of MRT-treated offenders in a county jail. Cogn Behav Treat Rev. 1995;4:13.
The authors would like to acknowledge the contributions of the MRT Study Facilitator Group: Fatimaah Carmichael, Ean Dervin, Nichole Fraser, Bruce Meltzer, Victor Modesto, Rickey Phillips, John Sirley, Lisa Southerland, and Robert Whelan. We would also like to acknowledge the contribution and support of the President (Dr. Kenneth Robinson) and Vice Presidents (Ms. Katherine Burnette, and Mr. Stephen Swann) of Correctional Counseling Inc. who trained the intervention coordinators in the delivery of MRT, and participated in the treatment fidelity calls to provide corrective feedback and consultation to the MRT group facilitators during the trial. Finally, we would like to thank the administrators of the mental health residential treatment programs at each site (Dr. Courtney Crutchfield, Dr. Rachael Guerra, Dr. Bruce Meltzer, Dr. Timothy Ramsey, Mr. Michael Ritchie, Mr. David Grillo, and Ms. Kate Severin) for their assistance with the implementation of MRT groups in their residential programs, and Dr. Jennifer Burden (Deputy Director, Mental Health Residential Rehabilitation Treatment Programs, VHA Mental Health Services) for her operational support and endorsement of this project.
This trial was funded by the Department of Veterans Affairs’ Health Services Research & Development Program (IIR 14–081 to Drs. Blonigen and Smelson; RCS 00–001 to Dr. Timko).
Availability of data and materials
The datasets used and/or analyzed during the current study are available from the corresponding author on reasonable request.
Ethics approval and consent to participate
Ethical approval was granted by the VA Central IRB Review Committee (Study #15–04) on August 7, 2016. All patients recruited for the study will be required to sign a consent form.
Consent for publication
The authors declare that they have no competing interests. MRT is copyrighted and trademarked by CCI, whose members served as paid consultants on this project. CCI also receives compensation for MRT trainings and sales of MRT workbooks.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Blonigen, D.M., Cucciare, M.A., Timko, C. et al. Study protocol: a hybrid effectiveness-implementation trial of Moral Reconation Therapy in the US Veterans Health Administration. BMC Health Serv Res 18, 164 (2018) doi:10.1186/s12913-018-2967-3
- Moral Reconation therapy
- Justice-involved veterans
- Randomized controlled trial
- Veterans health administration
- Hybrid trial