Skip to main content
  • Research article
  • Open access
  • Published:

Optimizing naloxone distribution to prevent opioid overdose fatalities: results from piloting the Systems Analysis and Improvement Approach within syringe service programs

Abstract

Background

Opioid overdose fatalities are preventable with timely administration of naloxone, an opioid antagonist, during an opioid overdose event. Syringe service programs have pioneered naloxone distribution for potential bystanders of opioid overdose. The objective of this study was to pilot test a multi-component implementation strategy—the systems analysis and improvement approach for naloxone (SAIA-Naloxone)—with the goal of improving naloxone distribution by syringe service programs.

Methods

Two syringe service programs participated in a 6-month pilot of SAIA-Naloxone, which included (1) analyzing program data to identify gaps in the naloxone delivery cascade, (2) flow mapping to identify causes of attrition and brainstorm programmatic changes for improvement, and (3) conducting continuous quality improvement to test and assess whether modifications improve the cascade. We conducted an interrupted time series analysis using 52 weeks of data before and 26 weeks of data after initiating SAIA-Naloxone. Poisson regression was used to evaluate the association between SAIA-Naloxone and the weekly number of participants receiving naloxone and number of naloxone doses distributed.

Results

Over the course of the study, 11,107 doses of naloxone were distributed to 6,071 participants. Through SAIA-Naloxone, syringe service programs prioritized testing programmatic modifications to improve data collection procedures, proactively screen and identify naloxone-naïve participants, streamline naloxone refill systems, and allow for secondary naloxone distribution. SAIA-Naloxone was associated with statistically significant increases in the average number of people receiving naloxone per week (37% more SPP participants; 95% CI, 12% to 67%) and average number of naloxone doses distributed per week (105% more naloxone doses; 95% CI, 79% to 136%) beyond the underlying pre-SAIA-Naloxone levels. These initial increases were extended by ongoing positive changes over time (1.6% more SSP participants received naloxone and 0.3% more naloxone doses were distributed in each subsequent week compared to the weekly trend in the pre-SAIA Naloxone period).

Conclusions

SAIA-Naloxone has strong potential for improving naloxone distribution from syringe service programs. These findings are encouraging in the face of the worsening opioid overdose crisis in the United States and support testing SAIA-Naloxone in a large-scale randomized trial within syringe service programs.

Peer Review reports

Background

An estimated 2.2 million people in the United States (US) have an opioid use disorder, and less than 20% of them are currently receiving treatment [1, 2]. In addition, opioid-related overdose mortality has increased over six-fold since 1999 with particularly steep increases in recent years [3,4,5,6,7]. Between 2013 and 2019, the age adjusted rate of deaths involving synthetic opioids other than methadone increased by 1,040% [6]. Alarming increases across demographics indicate that the opioid overdose epidemic continues to surge in the US [8].

Opioid-related overdose deaths are preventable with naloxone, a medication that displaces opioids from the brain receptors to which they attach, reversing the opioid-induced respiratory depression that leads to a fatal overdose [9]. A prescription medication, but not a controlled substance, naloxone is safe, produces no analgesic or euphoric effect, has no potential for abuse, and has been used for more than four decades to reverse opioid overdose [10]. Because the likelihood of permanent injury or death increases with the amount of time a person remains in respiratory depression, it is imperative that naloxone be administered as soon as an overdose is suspected [11]. Increasing access to naloxone in at-risk communities by educating and training potential bystanders—such as people who use drugs, their family members, and their peers—about the symptoms of overdose, how to use naloxone, and the importance of keeping it on their person can ensure naloxone is available and deployed to save lives [12, 13].

Syringe services programs (SSPs), which provide access to and disposal of sterile syringes and injection equipment for people who use drugs, are ideal venues for naloxone distribution as they reach people who are at high risk of observing or experiencing opioid overdose and have staff who are culturally competent in providing services for people who use opioids [14]. While SSPs pioneered naloxone distribution, their distribution of naloxone has not reached sufficient levels to reduce population-level opioid overdose mortality [15,16,17]. A recent study of people who inject drugs (PWID) found that half (49.4%) had witnessed an overdose and 15.9% had experienced an overdose in the past six months—but only 35.1% currently possessed naloxone [18]. For naloxone to effectively reduce the number of opioid overdose fatalities, a higher proportion of potential bystanders need to be knowledgeable about and consistently possess and use naloxone [12]. Leveraging implementation strategies to strengthen the ability of SSPs to distribute naloxone to their participants is paramount to addressing the nation’s opioid overdose crisis.

As a multi-component implementation strategy, the systems analysis and improvement approach (SAIA) has the potential to improve SSP-based naloxone distribution by centering analysis of service gaps, mapping service flow, and continuous quality improvement. The original SAIA trial focused on the prevention of mother-to-child HIV transmission cascade, where antiretroviral therapy coverage increased threefold and screening for HIV-exposed infants increased 17-fold [19]. Additionally, health workers in the trial described the intervention as easy to use and practical [20]. In the present study, we piloted and assessed an adapted version of SAIA to improve SSPs’ naloxone delivery cascade and increase access to naloxone in communities at high risk of opioid overdose.

Methods

Clinical intervention

At the individual-level, naloxone is an effective opioid antagonist that can prevent opioid overdose mortality when administered quickly and appropriately during an opioid overdose event [9, 21]. Efforts to educate and equip potential bystanders of opioid overdose to administer naloxone are highly effective at preventing opioid overdose mortality and have demonstrated cost-effectiveness [12, 22].

The naloxone delivery cascade refers to a series of linked, sequential steps considered necessary for naloxone programs to fully realize the life-saving benefits of the intervention at the population-level. These steps include screening individuals who present for syringe services for naloxone engagement, training potential bystanders who have not been previously engaged on how to reverse an overdose with naloxone, equipping trained bystanders with naloxone to use during observed overdoses, and refilling their supply of naloxone as needed. If followed, these steps could maximize the effectiveness of naloxone by ensuring bystanders have immediate access to naloxone and can administer it when needed.

Setting

Our study included two SSPs with ongoing naloxone distribution in California. SSPs provide access to and disposal of syringes and injection equipment for PWID and offer a range of other prevention services [14]. They are ideal settings for naloxone distribution as they have staff who are culturally competent in providing services for PWID, and PWID already engage with and trust these organizations to care for their health. In California, SSPs are authorized by the California Department of Public Health. State authorization also allows SSP staff and volunteers to lawfully distribute and possess syringes and naloxone for distribution. California SSPs acquire naloxone from the California Department of Health Care Services. In total, the California Department of Public Health has authorized 61 SSPs in California as of November 2021; all of them distribute naloxone.

Two SSPs with naloxone programs located in large urban centers in California were enrolled. The first SSP (Site 1) was a standalone non-profit organization that began distributing syringes in 1993 and naloxone in 2000. In 2020, site 1 had 8 full time staff, 3 part time staff and 4 volunteers. The organization had an annual budget of $876,869, with funding from their county health department, private foundations, and other community-based organizations. In 2019 and 2020, they served approximately 3,000 participants annually. In addition to providing syringes and naloxone, this SSP provides on-site HIV and HCV counseling and testing; fentanyl test strips; nutritional support; abscess and wound care; individual risk reduction counseling and linkage to substance use treatment.

The second SSP (Site 2) was part of a county health department that began distributing syringes in 1994 and naloxone in 2017. In 2020, site 2 had 3 full time staff and 2 part time staff. The organization had an annual budget of $319,518 with funding from the county and state health departments. SSP services are provided across the county five days a week at five pop-up sites by county employees. Across 2019 and 2020, they served approximately 700 participants annually. In addition to providing syringes and naloxone, this SSP provides on-site STD, HIV, and HCV testing; fentanyl test strips; and referrals to mental health, and substance use treatment.

Implementation strategy

For this study, we adapted the original SAIA implementation strategy for naloxone delivery within SSPs (SAIA-Naloxone) by directly engaging staff at the two SSPs that were participating in the 6-month pilot study [19, 20, 23, 24]. We held three meetings with staff involved in naloxone distribution and information collection from each of the SSPs (n = 6 at Site 1; n = 5 at Site 2) to orient them to SAIA and, using principles of focus group discussions, elicit ways in which it should be adapted. Key adaptations for SAIA-Naloxone that resulted from these meetings involved modifying data collection instruments, primarily to reduce data collection burden and align data elements with the Naloxone Cascade Analysis Tool (NCAT) [24]. Briefly, NCAT is an Excel-based simulation model that uses routine data collection to identify gaps in an SSP’s naloxone delivery cascade [24, 25]. NCAT includes the number of SSP participants who presented for syringe services; screened for prior naloxone engagement; of those who were not engaged previously, received training for and a supply of naloxone; and among those who were engaged previously, whether participants still possessed naloxone, had immediate access to naloxone, and/or received a naloxone refill. NCAT guides improvement efforts by promptly identifying which step in this process offers the greatest potential cascade gain to improve completion of the cascade (i.e., improve fidelity to the naloxone delivery cascade) and achieve effective naloxone coverage among SSP participants (i.e., increase service penetration of naloxone) [26].

Like the original SAIA, SAIA-Naloxone included [1] analyzing program data to identify gaps in the naloxone delivery cascade, [2] flow mapping to identify causes of attrition and brainstorm programmatic changes for improvement, and [3] conducting continuous quality improvement to test and assess whether modifications improve the cascade. For example, we first presented baseline data to the SSP staff using NCAT to identify steps in the cascade that could benefit most from intervention (e.g., few participants who were not previously engaged for naloxone receive training). We then led the staff in visually mapping out their service structure, including documenting how different service elements (e.g., registration, supply pick up, naloxone training and refills, and other services) fit together, where staff or volunteers are positioned, and how participants flow through and engage with the different elements. This helps the SSP staff identify where bottlenecks start to develop and where participants start to leave before receiving all appropriate service elements, serving as the basis for understanding drop-offs identified via NCAT (e.g., participants end up leaving after getting screened for naloxone engagement instead of waiting for staff to become available to provide training) and identifying potential solutions to address those drop-offs (e.g., increase staffing for naloxone training). We worked with staff to prioritize solutions that were perceived to be both important in addressing key drop-offs and feasible to adopt, develop a plan for operationalizing prioritized solutions, and evaluate the impact of the adopted solutions using NCAT (e.g., whether fewer participants drop-off between getting screened for naloxone engagement and receiving training after increasing staffing). SAIA-Naloxone is described in detail according to the Proctor guidelines for specifying and reporting implementation strategies in Table 1 [27].

Table 1 SAIA-Naloxone implementation strategy

Data collection

Primary outcomes

Our primary outcomes included the weekly number of people receiving naloxone and the weekly number of naloxone doses distributed. Improvements in these outcomes signal improvements along the naloxone delivery cascade and reflect improvements in effective naloxone coverage among SSP participants. Further, we focus on these two outcomes as prior research has demonstrated that these metrics significantly predict opioid overdose mortality rates at the community-level [28, 29]. SSPs provided retrospective data for the 52 weeks prior to initiating SAIA-Naloxone. Prospectively, these data were securely transferred to the study team monthly for the 26 weeks after SAIA-Naloxone was initiated.

SAIA-Naloxone implementation and process data

We marked each SSP’s SAIA-Naloxone start date as the week following our first meeting with the organization’s implementation team to complete actions 1 through 3 of Table 1. From this point, the SSP was considered actively participating in SAIA-Naloxone. Throughout delivery of the SAIA-Naloxone implementation strategy, the external facilitator prospectively documented which steps of the cascade the SSP implementation team prioritized, the content of programmatic modifications employed by the team, and the change in percent completion of the prioritized cascade steps after implementing the modifications.

Analysis

To assess the association between SAIA-Naloxone and access to naloxone among communities served by the SSPs, we conducted an interrupted time-series analysis [30]. We utilized population averaged Poisson models where site and week were specified as the panel and time variable, respectively. We constructed a segmented model to assess if SAIA-Naloxone resulted in a change in both level and trend (i.e., slope) in the weekly number of SSP participants receiving naloxone and the weekly number of naloxone doses distributed. Interrupted time-series enables detection of whether SAIA-Naloxone was associated with a significant one-time change and/or shift in weekly trend in the outcomes beyond what is expected given pre-SAIA-Naloxone trends. The model also accounted for potential serial correlation of measures within each of the SSPs over time. The basic equation used for estimating the association between SAIA-Naloxone (I) and each outcome (Y) was:

$$\mathrm{Yst}\:=\:\beta0\:+\:\beta1(\mathrm t)\:+\:\beta2(\mathrm{Is})\:+\:\beta3(\mathrm{Is}\ast\mathrm t)\:+\:\beta4(\mathrm{Xs})\:+\:\varepsilon\!\mathrm{st}.$$

The coefficient on the time indicator (β1) provides the pre-SAIA-Naloxone trend for the outcome. For this analysis, this covers the 52-week period prior to the first SAIA-Naloxone meeting the SSP provider. A significant coefficient on the intervention indicator (β2) would indicate a one-time change in the outcome beyond the pre-period trend due to SAIA-Naloxone. A significant coefficient on the interaction between the intervention and time (β3) would indicate a shift in the outcome trend in the post-period from the pre-period due to initiating SAIA-Naloxone. The models were adjusted for SSP participant volume as a continuous variable and season as a 4-level categorical variable (X). We report 2-sided p-values and considered p < 0.05 the cut-off for statistical significance. Statistical analyses were performed using Stata 16.0 (StataCorp, 2021).

Results

Across the 78-week study period and two SSPs, a total of 20,530 SSP visits occurred with 6,071 participants receiving naloxone and a total of 11,107 naloxone doses distributed. This shifted from a weekly average of 129 SSP participant visits, 17 people receiving naloxone, and 38 naloxone doses distributed prior to SAIA-Naloxone to a weekly average of 127 SSP participant visits, 64 people receiving naloxone and 109 naloxone doses distributed after SAIA-Naloxone.

Twelve staff from across the two SSPs were engaged in the SAIA-Naloxone implementation strategy as part of their SSP implementation team. Six cycles of SAIA-Naloxone were completed as intended across the two SSPs, half of which focused on improving naloxone possession (Table 2). Each modification resulted in at least a 50% improvement in the targeted cascade step. One of the modifications targeting naloxone possession resulted in a 110% improvement for Black, indigenous, and people of color.

Table 2 Programmatic modifications and change achieved through SAIA-Naloxone cycles

In the adjusted statistical model, SAIA-Naloxone was associated with a significant and substantial change in the weekly number of participants receiving naloxone and number of naloxone doses distributed (Table 3). Prior to introducing SAIA-Naloxone, 1.1% fewer SSP participants received Naloxone each week. Immediately after SAIA-Naloxone was introduced, 37% more SSP participants received naloxone (β = 1.369; 95% CI, 1.122 to 1.669). In each subsequent week, 1.6% more SSP participants received naloxone (β = 1.016; 95% CI, 1.012 to 1.020), compared to the weekly trend in the pre-SAIA Naloxone period. In addition, prior to introducing SAIA-Naloxone, the number of naloxone doses distributed each week remained steady. Immediately after SAIA-Naloxone was introduced, 105% more naloxone doses were distributed (β = 2.055; 95% CI, 1.792 to 2.358). In each subsequent week, 0.3% more naloxone doses were distributed (β = 1.003; 95% CI, 1.001 to 1.005), compared to the weekly trend in the pre-SAIA Naloxone period. Figure 1 depicts the initial changes and changes in trend associated with SAIA-Naloxone.

Table 3 Estimates from an interrupted time series segmented regression model
Fig. 1
figure 1

Interrupted time series of the number of (a) people receiving naloxone and (b) naloxone doses distributed before and after initiating SAIA-Naloxone. Dots represent the pooled (a) number of participants receiving naloxone or (b) naloxone doses distributed each week. Black lines represent a linear model fit to the data points in the pre- and post-SAIA-Naloxone periods. The introduction of SAIA-Naloxone is represented by the red vertical line

Discussion

The results of this pilot demonstrate that the SAIA-Naloxone implementation strategy can improve access to naloxone among SSP participants. The SSPs engaged in 6 cycles of SAIA-Naloxone (3 per SSP) during the implementation period, suggesting that SAIA-Naloxone was acceptable and feasible as an implementation strategy. In addition, the introduction of SAIA-Naloxone at SSPs was associated with statistically significant increases in the number of participants receiving naloxone each week and the number of naloxone doses distributed each week. Further, SAIA-Naloxone was associated with significant increases in the trend of these outcomes, with more participants receiving naloxone and more doses distributed each week. Based on these findings, SAIA-Naloxone has strong potential to optimize the naloxone delivery cascade for SSP participants and prevent opioid-involved overdose deaths.

Prior studies have demonstrated that Black and Latinx PWID were 25% and 47% less likely, respectively, to receive naloxone compared to white PWID [18]. As part of this pilot, a programmatic modification employed by one of the SSPs showed an improvement in naloxone possession among Black, indigenous, and people of color. In addition to assessing for general improvements in naloxone distribution, future trials of SAIA-Naloxone should assess whether it can improve equitable access to naloxone.

Beyond these outcomes, it is possible that SAIA-Naloxone improved aspects of the internal environment of the SSPs. For example, external facilitators engaged the full implementation team which could have shifted power dynamics and allowed front-line staff the opportunity to express their ideas about what is contributing to drop-offs in the naloxone delivery cascade and potential ways to improve them. This could provide an opportunity for innovative, prioritized approaches to emerge from any of the staff members, not just SSP leadership, potentially contributing to a strengthened culture within the organization. Further, leveraging data to engage in continuous quality improvement through multiple cycles of SAIA-Naloxone could foster a learning mindset among SSP staff and might improve the implementation climate for naloxone. Future research should evaluate the impact of SAIA-Naloxone on key implementation determinants like organizational culture and implementation climate and the extent to which they operate as mechanisms through which SAIA-Naloxone improves access to naloxone.

It is important to consider the findings of this study in light of the emerging body of research regarding factors internal and external to SSPs that are related to larger scale naloxone distribution. Results from two national surveys of SSPs have identified that higher levels of community support, more sustained implementations, larger annual budgets, more days of service, and being a non-governmental entity are associated with higher levels of naloxone distribution [17, 31]. While SAIA-Naloxone may strengthen the organizational culture and implementation climate within an SSP, it does not address several of the structural-related characteristics that are related to larger scale distribution. Longer term studies of SAIA should explore whether effects plateau based on structural factors of the SSP, and if encountered, which supplemental approaches can improve these structural factors [32]. Even with these constraints, SAIA-Naloxone was able to improve naloxone distribution within these SSPs.

While the findings from this pilot study are promising, there are some limitations to consider. In piloting SAIA-Naloxone, we did not randomly select SSPs, randomly assign SSPs to receive SAIA-Naloxone, nor were we able to use a design with a robust control. Still, the use of an interrupted time series approach allowed us to assess changes within SSPs and provided an estimate of the outcomes above and beyond what would have been expected in the absence of SAIA-Naloxone [32]. This design limits concern for confounding due to between site differences, but the possibility of confounding due to co-occurring interventions or events remains a possibility. Further, through this pilot, SAIA-Naloxone was deemed feasible by external facilitators and SSP implementation teams, and the effect estimates are strong enough to warrant a randomized trial. Lastly, pre-period outcome data were reported retrospectively by the participating SSPs; however, SSPs involved in the study maintained electronic records of these data for routine reporting and could easily transfer them to the study team. The limitations of this pilot study are being addressed through a randomized controlled trial currently underway, which requires SSPs to report baseline data for a lead-in period before randomizing them to receive SAIA-Naloxone or implementation as usual and collects data beyond the intervention period to assess the extent to which impacts of SAIA-Naloxone are sustained.

Conclusions

SAIA-Naloxone is a feasible implementation strategy that leverages programmatic data and principles of continuous quality improvement to increase access to naloxone among SSP participants who are likely bystanders of opioid-related overdoses. Ensuring this population is prepared and equipped to reverse overdoses and prevent fatalities is essential to combatting the worsening opioid overdose crisis in the US.

Availability of data and materials

The dataset created and analyzed during the current study are available from the corresponding author on reasonable request.

Abbreviations

HCV:

Hepatitis C virus

HIV:

Human immunodeficiency virus

NCAT:

Naloxone Cascade Analysis Tool

PWID:

People who inject drugs

SAIA:

Systems Analysis and Improvement Approach

SSP:

Syringe services program

STD:

Sexually transmitted disease

US:

United States

References

  1. SAMHSA. Key Substance Use and Mental Health Indicators in the United States: Results from the 2018 National Survey on Drug Use and Health. Rockville, MD: Center for Behavioral Health Statistics and Quality, Substance Abuse and Mental Health Services Administration, 2019 Contract No.: HHS Publication No. PEP19–5068, NSDUH Series H-54.

  2. Alderks CE. Trends in the Use of Methadone, Buprenorphine, and Extended-release Naltrexone at Substance Abuse Treatment Facilities: 2003–2015 (Update). Rockville, MD: Center for Behavioral Health Statistics and Quality, Substance Abuse and Mental Health Services Administration, 2017. https://www.ncbi.nlm.nih.gov/books/NBK469748/.

  3. Rudd RA, Seth P, David F, Scholl L. Increases in Drug and Opioid-Involved Overdose Deaths - United States, 2010–2015. MMWR Morb Mortal Wkly Rep. 2016;65(50–51):1445–52.

    Article  PubMed  Google Scholar 

  4. Wilson N, Kariisa M, Seth P, Smith H, Davis NL. Drug and Opioid-Involved Overdose Deaths - United States, 2017-2018. MMWR Morbidity and mortality weekly report. 2020;69(11):290–7.

    Article  PubMed  PubMed Central  Google Scholar 

  5. Hedegaard H, Miniño AM, Warner M. Drug Overdose Deaths in the United States, 1999–2018. NCHS Data Brief. 2020;356:1–8.

    Google Scholar 

  6. Mattson CL, Tanz LJ, Quinn K, Kariisa M, Patel P, Davis NL. Trends and Geographic Patterns in Drug and Synthetic Opioid Overdose Deaths - United States, 2013–2019. MMWR Morb Mortal Wkly Rep. 2021;70(6):202–7.

    Article  PubMed  PubMed Central  Google Scholar 

  7. CDC. Wide-ranging online data for epidemiologic research (WONDER). Atlanta: GA: National Center for Health Statistics, Centers for Disease Control and Prevention; 2020.

    Google Scholar 

  8. NIDA. Overdose Death Rates Bethesda, MD: National Institute on Drug Abuse; 2017 [cited 2017 September 24]. Available from: https://www.drugabuse.gov/drug-topics/trends-statistics/overdose-death-rates.

  9. Chamberlain JM, Klein BL. A comprehensive review of naloxone for the emergency physician. Am J Emerg Med. 1994;12(6):650–60.

    Article  CAS  PubMed  Google Scholar 

  10. Davis CS, Southwell JK, Niehaus VR, Walley AY, Dailey MW. Emergency medical services naloxone access: a national systematic legal review. Acad Emerg Med Off J Soc Acad Emerg Med. 2014;21(10):1173–7.

    Article  Google Scholar 

  11. Michiels C. Physiological and pathological responses to hypoxia. Am J Pathol. 2004;164(6):1875–82.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  12. Giglio RE, Li G, DiMaggio CJ. Effectiveness of bystander naloxone administration and overdose education programs: a meta-analysis. Inj Epidemiol. 2015;2(1):10.

    Article  PubMed  PubMed Central  Google Scholar 

  13. Davis CS, Ruiz S, Glynn P, Picariello G, Walley AY. Expanded access to naloxone among firefighters, police officers, and emergency medical technicians in Massachusetts. Am J Public Health. 2014;104(8):e7-9.

    Article  PubMed  PubMed Central  Google Scholar 

  14. CDC. Syringe Service Programs (SSPs) Atlanta, GA: Centers for Disease Control and Prevention; 2019 [cited 2020 May 5]. Available from: https://www.cdc.gov/ssp/index.html.

  15. McClellan C, Lambdin BH, Ali MM, Mutter R, Davis CS, Wheeler E, et al. Influence of state overdose laws and naloxone programs on opioid overdose mortality. Atlanta: American Public Health Association; November; 2017.

    Google Scholar 

  16. Lambdin BH, Zibbell J, Wheeler E, Kral AH. Identifying gaps in the implementation of naloxone programs for laypersons in the United States. Int J Drug Policy. 2018;52:52–5.

    Article  PubMed  Google Scholar 

  17. Lambdin BH, Wenger LD, Bluthenthal RN, Garner B, LaKosky P, O'Neill S, et al. Understanding the influence of external and internal characteristics on the penetration of naloxone delivery from syringe service programs in the United States. 13th Annual Conference on the Science of Dissemination and Implementation in Health; December; Virtual 2020.

  18. Kinnard EN, Bluthenthal RN, Kral AH, Wenger LD, Lambdin BH. The naloxone delivery cascade: Identifying disparities in access to naloxone among people who inject drugs in Los Angeles and San Francisco. CA Drug and alcohol dependence. 2021;225:108759.

    Article  PubMed  Google Scholar 

  19. Rustagi AS, Gimbel S, Nduati R, Cuembelo Mde F, Wasserheit JN, Farquhar C, et al. Implementation and Operational Research: Impact of a Systems Engineering Intervention on PMTCT Service Delivery in Côte d’Ivoire, Kenya, Mozambique: A Cluster Randomized Trial. J Acquir Immune Defic Syndr (1999). 2016;72(3):e68-76.

    Article  Google Scholar 

  20. Gimbel S, Rustagi AS, Robinson J, Kouyate S, Coutinho J, Nduati R, et al. Evaluation of a Systems Analysis and Improvement Approach to Optimize Prevention of Mother-To-Child Transmission of HIV Using the Consolidated Framework for Implementation Research. JAIDS J Acquired Immune Defic Syndr. 2016;72:S108–16.

    Article  Google Scholar 

  21. Sporer KA, Kral AH. Prescription naloxone: a novel approach to heroin overdose prevention. Ann Emerg Med. 2007;49(2):172–7.

    Article  PubMed  Google Scholar 

  22. Coffin PO, Sullivan SD. Cost-effectiveness of distributing naloxone to heroin users for lay overdose reversal in Russian cities. J Med Econ. 2013;16(8):1051–60.

    Article  PubMed  Google Scholar 

  23. Sherr K, Gimbel S, Rustagi A, Nduati R, Cuembelo F, Farquhar C, et al. Systems analysis and improvement to optimize pMTCT (SAIA): a cluster randomized trial. Implement Sci. 2014;9(1):55.

    Article  PubMed  PubMed Central  Google Scholar 

  24. Wagner AD, Gimbel S, Ásbjörnsdóttir KH, Cherutich P, Coutinho J, Crocker J, et al. Cascade Analysis: An Adaptable Implementation Strategy Across HIV and Non-HIV Delivery Platforms. J Acquir Immune Defic Syndr (1999). 2019;82(Suppl 3):S322-s31.

    Article  Google Scholar 

  25. Lambdin BH, Wenger L, Kral AH, Wagner AD, Sherr K. Optimizing naloxone distribution to prevent opioid overdose fatalities: Results from piloting the systems analysis and improvement approach within syringe service programs. 13th Annual Conference on the Science of Dissemination and Implementation in Health; December; Virtual 2020.

  26. Stiles PG, Boothroyd RA, Snyder K, Zong X. Service penetration by persons with severe mental illness: how should it be measured? J Behav Health Serv Res. 2002;29(2):198–207.

    Article  PubMed  Google Scholar 

  27. Proctor EK, Powell BJ, McMillen JC. Implementation strategies: recommendations for specifying and reporting. Implementation science : IS. 2013;8:139.

    Article  PubMed  PubMed Central  Google Scholar 

  28. Walley AY, Xuan Z, Hackman HH, Quinn E, Doe-Simkins M, Sorensen-Alawad A, et al. Opioid overdose rates and implementation of overdose education and nasal naloxone distribution in Massachusetts: interrupted time series analysis. BMJ. 2013;346:f174.

    Article  PubMed  PubMed Central  Google Scholar 

  29. Bird SM, McAuley A. Scotland’s National Naloxone Programme. Lancet. 2019;393(10169):316–8.

    Article  PubMed  Google Scholar 

  30. Bernal JL, Cummins S, Gasparrini A. Interrupted time series regression for the evaluation of public health interventions: a tutorial. Int J Epidemiol. 2017;46(1):348–55.

    PubMed  Google Scholar 

  31. Lambdin BH, Wenger L, Bluthenthal RN, Tookes H, P. L, T. M, et al. Understanding the impact of COVID-19 on the penetration of naloxone distribution from syringe service programs in the United States. 14th Annual Conference on the Science of Dissemination and Implementation in Health; December; Virtual 2021.

  32. Lopez Bernal J, Cummins S, Gasparrini A. The use of controls in interrupted time series studies of public health interventions. Int J Epidemiol. 2018;47(6):2082–93.

    Article  PubMed  Google Scholar 

Download references

Acknowledgements

We sincerely thank our SSP partners and their implementation teams for engaging in this pilot study and providing us with the opportunity to learn from them.

Funding

This study was funded by R21DA046703 from the National Institute of Drug Abuse. The funding body had no role in the design of the study; collection, analysis, and interpretation of data; or writing of the manuscript. AW was supported by K01MH121124.

Author information

Authors and Affiliations

Authors

Contributions

BL conceptualized the study and developed the analytic approach. LW and BL managed the data. BL conducted analyses. SP, LW, AK, KS, AW, PD, and BL contributed to the interpretation of the data. SP and BL drafted the manuscript. LW, AK, KS, AW, PD reviewed and provided substantial feedback on the manuscript. SP, LW, AK, KS, AW, PD, and BL read and approved the final manuscript.

Corresponding author

Correspondence to Sheila V. Patel.

Ethics declarations

Ethics approval and consent to participate.

Study procedures were reviewed and approved by the RTI International Office of Research Protection Institutional Review Board (STUDY00020144). Leaders and staff at the pilot organizations consented to participate.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Patel, S.V., Wenger, L.D., Kral, A.H. et al. Optimizing naloxone distribution to prevent opioid overdose fatalities: results from piloting the Systems Analysis and Improvement Approach within syringe service programs. BMC Health Serv Res 23, 278 (2023). https://doi.org/10.1186/s12913-023-09289-8

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12913-023-09289-8

Keywords