Skip to main content
  • Research article
  • Open access
  • Published:

Rapid Cycle Implementation and Retrospective Evaluation of a SARS-CoV-2 Checklist in Labor and Delivery

A Correction to this article was published on 18 August 2021

This article has been updated

Abstract

Background

Preparedness efforts for a COVID-19 outbreak required redesign and implementation of a perioperative workflow for the management of obstetric patients. In this report we describe factors which influenced rapid cycle implementation of a novel comprehensive checklist for the perioperative care of the COVID-19 parturient.

Methods

Within our labour and delivery unit, implementation of a novel checklist for the COVID-19 parturient requiring perioperative care was accomplished through rapid cycling, debriefing and on-site walkthroughs. Post-implementation, consistent use of the checklist was reported for all obstetric COVID-19 perioperative cases (100% workflow checklist utilization). Retrospective analysis of the factors influencing implementation was performed using a group deliberation approach, mapped against the Consolidated Framework for Implementation Research (CFIR).

Results

Analysis of factors influencing implementation using CFIR revealed domains of process implementation and innovation characteristics as overwhelming facilitators for success. Constructs within the outer setting, inner setting, and characteristic of individuals (external pressures, baseline culture, and personal attributes) were perceived to act as early barriers. Constructs such as communication culture and learning climate, shifted in influence over time.

Conclusion

We describe the influential factors of implementing a novel comprehensive obstetric workflow for care of the COVID-19 perioperative parturient during the first surge of the pandemic using the CFIR framework. Early workflow adoption was facilitated primarily by two domains, namely thoughtful innovation design and careful implementation planning in the setting of a long-standing culture of improvement. Factors initially assessed as barriers such as communication, culture and learning climate, transitioned into facilitators once a perceived benefit was experienced by healthcare teams. These results provide important information for the implementation of rapid change during a time of crisis.

Peer Review reports

Background

Obstetrics & COVID-19

The Severe Acute Respiratory Syndrome Coronavirus-2 (SARS-CoV-2), which causes the disease COVID-19, was first detected in Massachusetts, USA on 1 February 2020. Statewide spread of the virus was observed in early March and coincided with the declaration of SARS-CoV-2 pandemic by the World Health Organization on 11 March, 2020 [1]. As reports of exponential community transmission became apparent, health care organizations, including hospitals and labor and delivery (L&D) units were prompted to evaluate existing workflow patterns and develop innovations to mitigate risk of viral exposure to patients and staff [2]. The layout and dynamics in L&D units are designed to create a shared experience for family members, while maintaining high levels of readiness for acute deterioration requiring operative delivery. Thus, labor rooms are typically in close proximity to both operating rooms and communal spaces such as the nursing stations and are subject to significant overlapping foot traffic [2]. A single COVID-19 parturient presenting for care at L&D units would pose a considerable risk of viral exposure and spread to other healthcare workers and possibly even other patients, in particular if they required an emergency cesarean delivery.

While clinical guidelines and checklists are core components of patient safety efforts within L&D units [3], the implementation of new guidelines or workflow processes within healthcare is challenging and often hampered by several expected and unexpected barriers [4,5,6]. The identification of barriers and facilitators is vital in establishing an efficient strategy for change [7], as described in established frameworks such as the Consolidated Framework for Implementation Research (CFIR) [8,9,10] and Expert Recommendations for Implementing Change (ERIC) [11, 12]. Typically, these analyses are performed prior to the implementation of an innovation. However, formal pre-implementation assessments may not be feasible in crisis situations given the need for urgent implementation of change. Retrospective evaluations of implementation have previously been used to help explain success or failures [13]. The retrospective post-implementation use of CFIR to assess factors influencing implementation outcome has been reported previously [14], but not in the setting of rapid change implementation to manage pandemic spread within hospital units. There is a paucity of literature on factors influencing rapid change implementation during pandemics such as COVID-19, therefore such knowledge may benefit organizations in future planning and preparedness measures.

The aim of our study was to therefore identify the factors that influenced implementation of the perioperative workflow checklist for care of the COVID-19 parturient, by performing a retrospective analysis using CFIR.

Methods

i. Design

A qualitative design using CFIR, as the validated assessment tool, was chosen in order to better understand the factors that influenced implementation of a novel workflow. The study was approved by our Institutional Review Board (IRB) at the Beth Israel Deaconess Medical Center. As this was a qualitative study identifying the factors that influenced implementation, and did not constitute human subject research, the requirement for written informed consent was waived. This manuscript conforms to the Standards for Quality Improvement Reporting Excellence (SQUIRE) guidelines and the Template for Intervention Description and Replication (TIDieR) checklist [15, 16].

ii. Description of Workflow Checklist Implementation (obstetric workflow redesign)

Context:

Initial reviews of COVID-19 pandemic preparedness in our hospital identified the need for the redesign of a L&D site-specific perioperative workflow for managing a COVID-19 parturient. Our L&D unit serves as a regional referral center serving an urban, metropolitan area of approximately 4.6 million people, and is the academic teaching hospital for Beth Israel Lahey Health, a state-wide hospital network representing more than 15,000 births annually. As a center for high-risk patients, we anticipated a higher traffic of both diagnosed and suspected COVID-19 patients, in common with earlier experiences at similar units in New York State.

Innovation design:

We reviewed the available literature on both SARS-CoV-2 and other related viruses [17], including recommendations on the standards of care from government and professional bodies such as the American College of Obstetrics and Gynecology (ACOG), the Society for Obstetric Anesthesia and Perinatology (SOAP) and the Anesthesia Patient Safety Foundation (APSF) [18,19,20]. We combined these recommendations with our own organization’s newly designed perioperative workflows for COVID-19 patients to create the L&D workflow for the COVID-19 parturient requiring perioperative care. It was produced as a single page document, formatted as a sequential checklist with the intention to be used in real time as a cognitive aid . The checklist was an intentional design decision, documented as an effective means of detailing sequential steps in care [21]; it also fit in with existing local practice of checklist use for pre-operative briefings for all patients going to the operating room on L&D. The intended users of the checklist were staff from nursing, maternal-fetal-medicine, obstetrics, anesthesia and neonatology.

Implementation of workflow change:

Implementation of this innovation took place through a process of rapid cycling over a period of 2 weeks [22,23,24], described in detail by Li et al, 2020 [2]. The initial workflow draft was disseminated among clinical leaders and stakeholders and underwent one cycle of cognitive redesign. Prior to further refinement, planned testing or wide-scale dissemination amongst providers, its use was urgently requested by clinical leaders to assist in the management of our first live COVID-19 obstetric case. At this time, staff members involved in the case had no formal input into the design of the checklist or training in its use but were coached in real-time to work through the checklist elements. By following the sequence of the checklist, staff were able to safely perform the standard operating procedures, as indicated. Following our first live case, a formal debriefing with all members of the obstetric, anesthesia and perinatal team was conducted using video-conferencing, and specific steps were identified for checklist optimization. Subsequent inter-professional input from the departments of obstetrics, nursing and anesthesia, virtual event debriefings and on-site walkthroughs, several iterations of workflow re-design resulted in our final refined product (Figure 1). Post-case debriefings were performed routinely after-hours and led by the division chiefs of obstetrics, and included staff from nursing, maternal-fetal-medicine, obstetrics, anesthesia, neonatology, and quality and safety. Details on the individual cycles for change are listed (Supplemental Table 1). Our finalized workflow materials are freely available to access online [25].

Figure 1
figure 1

Rapid cycles of change. Schematic representation of rapid-cycle implementation, demonstrating how the individual processes of inter-professional input, testing in real-time, focused debriefing, on-site walkthroughs and iterative re-design contributed to our final refined product. CFIR: Consolidated framework for implementation research, L&D: labor and delivery

Outcome of implementation:

Adoption of this new workflow was quantitatively defined by documentation of its use during the care of successive COVID-19 parturients over the subsequent weeks, in the medical record. We modified the anesthesia information management system to capture three elements of workflow utilization in a binary (yes/no) fashion: a) patient transport per COVID checklist protocol, b) the intraoperative use of COVID checklist protocol, and c) early postoperative recovery per COVID checklist protocol. Following implementation, we report consistent use of this new workflow for all obstetric COVID-19 perioperative cases; 100% workflow utilization was observed and documented for a total of 23 cases (10 patients who required perioperative care, 13 who required labor analgesia), between March and August 2020. Repeated verbal feedback from frontline clinicians was that the checklist helped with ensuring proper use of PPE, created an environment of safety, and improved coordination and communication among the teams.

iii. Identification of Factors Influencing Implementation

Material:

To identify factors influencing implementation of the redesigned perioperative workflow checklist on L&D, we conducted a detailed retrospective analysis using the CFIR [8, 26, 27]. CFIR classifies operationally defined domains that have been shown to influence implementation success [8], namely, intervention characteristics (e.g.; adaptability, design quality and cost), the outer setting (e.g., external policy, peer pressure), the inner setting (e.g., culture, climate and readiness for implementation), the characteristics of individuals (e.g., knowledge and beliefs about the intervention) and the process of implementation (e.g., planning, engaging, executing and reflecting).

Participants:

Our assessment of the implementation experience was mapped against the CFIR constructs and ranked by a panel of 6 experts within our organization. The panel included members of the multidisciplinary team; obstetricians, anesthesiologists and our quality and safety faculty, who are included authors in this study. The first and last authors of this study (LZ and SKR) are not members of the L&D unit.

Procedure:

We opted to use a group deliberation approach because of the extensive history of collaborative work that existed in the L&D unit. Given this previous shared knowledge of local context, each construct was evaluated by the group with respect to its likely influence on implementation, and ranked as a facilitator or barrier, having no effect or not applicable to implementation. Virtual group deliberations took place over several days, initially each member of the panel of experts independently reviewed each construct, then as a collaborative discussion facilitated by the senior author and chair of quality and safety division. Disagreements were discussed in two settings, initially through email and then again in person, facilitated by the lead author.

Analysis:

In order to compare the relative contribution of each equally weighted construct within each domain at baseline, we transformed these results into a quantitative assessment by allocating a numerical score of 1 to a construct if it acted as a facilitator and 0 if it was considered a barrier or not influencing implementation success. The denominator included all constructs within each domain, apart from those deemed not applicable to the study.

Results

Evaluation of the implementation experience using CFIR demonstrated the significance of the following domains, when ranked in order of influence as facilitators of implementation success (expressed as a percentage of constructs within each domain): process (89%), innovation characteristics (88%,) inner setting (64%,) characteristic of individuals (40%) and the outer setting (0%). Constructs not applicable to this study included cosmopolitanism, organizational incentives and rewards, and external change agents.

Facilitators of implementation:

Constructs which positively influenced the implementation of this workflow redesign spanned all domains, except the outer setting. The domains of implementation process (Table 1) and innovation characteristics (Table 2) demonstrated the greatest proportion of facilitating constructs. Constructs within the process domain which had a positive influence on implementation included planning and execution, engagement from opinion leaders and key stakeholders, the presence of formally appointed internal implementation leaders and unit champions and repeated reflection and evaluation. Constructs within the domain of innovation characteristics which revealed a positive influence on implementation included the internal trusted source of the innovation, its adaptability, immediate trialability, easy to use checklist design and low cost. Constructs within the inner setting which had a strong influence in facilitating implementation included the structural characteristics of the unit, the implementation climate (tension for change, compatibility, relative priority, goals and feedback) and the readiness for implementation (leadership engagement, available resources) (Table 3).

Table 1 CFIR Domain - Process
Table 2 CFIR Domain - Innovation Characteristics
Table 3 CFIR Domain - Inner Setting

Barriers to implementation:

Several constructs were felt to negatively influence implementation in this study, particularly those from within the outer setting (Table 4). Additional barriers to implementation included the complexity of the change (innovation characteristics, Table 2), baseline culture, climate and communication (inner setting, Table 3) and personal attributes (characteristics of individuals, Table 5).

Table 4 CFIR Domain - Outer Setting
Table 5 CFIR Domain - Characteristics of Individuals

External pressures created by peer pressure, both locally and internationally, were evident as an early barrier to implementation. Local peer pressure was created by a departmental policy within anesthesia on the appropriate personal protective equipment (PPE). The timing of this change preceded policy change in the L&D unit by a couple of weeks, resulting in general anxiety, disagreement and inconsistencies in inter-departmental guidance that impacted staff behaviors and overall readiness for alignment. Furthermore, external influences from international peer groups, in particular communications from colleagues in China, Italy and other centers across the USA including the Center for Disease Control (CDC), demonstrated a considerable disconnect between the recommendations for care and clinical practice. This affected expectations and resulted in a delay in establishing a shared mental model.

Constructs which demonstrated a change over time:

Evaluation of our implementation revealed some constructs which demonstrated a temporal change over time, the majority of which were within the inner setting (Table 3). At baseline, constructs such as communication, culture and learning climate initially acted as a barrier to implementation, but then progressed to become facilitators within the space of a few weeks.

With respect to this innovation, clear lines of communication and knowledge of where to access the most up to date information were not evident initially within the organization, which resulted in frustration. This was rectified over the course of implementation and communicated through the hospital’s COVID intranet. Further communication improvements at the local departmental levels, via intranet, email and teleconferencing permitted inter-professional collaborative work.

The group deliberation process revealed that while the culture within the L&D unit was accustomed to the use of checklists, standard operating procedures, and iterative cycle improvement, additional internal forces such as recent staffing changes along with external pressures, fears and anxiety were present that may have influenced the cohesion of the unit. Individual constructs such as "knowledge and beliefs about the intervention" as well as "individual stage of changes" were a source of further deliberation. Stakeholders may initially have shared a belief that an intervention was necessary. However, pre-existing egotism and individualism may have impacted the early learning climate and further impacted implementation negatively. Since both these views provided opposing unweighted impact on the implementation, the arbiters (LZ and SKR) chose to score them as no impact. Yet, we also believe that individual knowledge and beliefs positively influenced sustainability of the workflow implementation, as staff became comfortable with the workflow elements and may indeed have provided a central focus for team behaviors. Additionally, in view of the urgency of COVID-19, assistance outside of the L&D unit was sought and welcomed over the course of the implementation. This openness to external inputs likely influenced individual attitudes as well. Leaders within L&D valued the input of all inter-professional team members during the implementation period. Additionally, through the debrief mechanism, involved staff members felt like a valued partner in the change process. Finally, within the outer setting, the patient’s needs and resources also shifted in influence over time (Table 4).

Discussion

This paper describes the identification of factors that impacted implementation of a new obstetric workflow checklist, specific for COVID-19 patients in the perioperative setting, through retrospective evaluation using the CFIR established framework.

In our study, constructs within the domains of process implementation and innovation characteristics were overwhelming facilitators of implementation. We believe that transparency in the development and implementation plan along with the design and content of the tool itself were significant influencers. Innovation characteristics found within the tool included the sequential steps of the checklist which ensured that front-line clinicians were able to perform standard operating procedures. Despite the initial impression that our tool was complex, the ability of staff to successfully use the checklist without prior, and extensive, training demonstrates construct validity of the innovation [29]. The immediate and regular testing of our workflow checklist during real COVID-19 obstetric cases by front line staff, enabled us to adapt the tool to meet local requirements [29,30,31]. In general, cognitive aids should be as concise and clear as possible, and their implementation in other units or environments must include local testing and adaptation for success.

Constructs within the inner setting, such as implementation climate and readiness for implementation, likely acted to support the time pressure. Our institution’s L&D unit is a world-leading center for teamwork and excellence in obstetrics and anesthesia and is a well-established division within the medical center. The unit has a history of clear processes in place to facilitate multidisciplinary quality improvement. A lack of safety culture, policy guideline and senior leadership support have been reported as barriers to implementation during the COVID-19 pandemic [32]. Therefore, we believe that clarity in the prioritization of implementing this innovation along with a readiness demonstrated by senior leaders and stakeholders within our L&D unit and organization facilitated rapid change implementation. A culture of inclusion and teamwork promotes alignment during rapid change, as leaders actively reach out to each other for input [33]. Crisis is a challenging time to develop trust, inclusion and teamwork; a pre-existing culture that includes these characteristics makes it easier to incorporate change, even though staff members within these units may be at different individual stages of change. The effectiveness of implementation in our unit demonstrates that developing a culture of quality improvement, multidisciplinary alignment, and trust has true long-term value. Based on our findings, preparedness measures for rapid change implementation amid a crisis should include an evaluation by organizations of their own inner setting to optimize the learning climate and safety culture.

Implementation in the setting of L&D has generally been previously hampered by individual reluctance to change, pre-existing hierarchical structures and a lack of organizational policy or regulation [34]. Given the context of the pandemic, the influence of some of these usual barriers to implementation may have been lessened. Early publications from international centers and anecdotal reports surrounding COVID-19 left significant room for confusion and interpretation. This may have led to a greater sense of anxiety amongst providers and delays in strategic alignment. This would have typically had a negative impact on implementation, however, in our study a significant observation was that the use of the checklist shortened the preparatory time needed for clinical care, as it provided clarity and unified thinking amongst staff with regards to implementation of clinical recommendations. Thus, the workflow checklist tool was adopted because of the absence of clear global policy. Through this process, it enabled rapid local adoption of the shared mental model and facilitated implementation, despite ongoing conflicting guidance from various national and international sources.

Reflecting on how the pandemic affected implementation outcome, it is worth noting that even in the context of an originally perceived barrier, the urgency and time pressure applied by the threat of an outbreak enabled a rapid transition of impact to facilitate change. The finding of implementation success, despite the presence of perceived barriers within the outer setting, inner setting and amongst the characteristics of individuals, was unexpected. This may be a reflection of the urgency brought about by the COVID-19 pandemic, or perhaps an indication that in the time of crisis, the influence imparted by constructs within these domains are minimal. Furthermore, we noted that drivers for change during the COVID-19 pandemic within our organization are different than during times of routine care. For instance, anxiety around healthcare worker infection rates, the associated stress of rapidly changing local policies and the unknown value of the innovation may negatively impact adherence to guidelines [5]. In contrast, our agile team-centered implementation approach resulted in greater engagement and acceptance of the checklist as a central cohesive factor in enhancing care of these patients.

Strength and Limitations

In this study we did not perform a comparative pre-post analysis, our evaluation is therefore limited to the post-implementation period. Retrospective evaluations of implementation are often performed to help explain success or failures; they are done at the end of the project and rely on key stakeholder experiences [13, 35, 36]. Rankings of individual constructs was performed through a group deliberation approach, and agreement between raters about the influence of each construct on implementation was consistent, likely reflecting a high level of shared mental model and leadership engagement in the implementation process. We report mainly on the results of qualitative findings, however, in the context of the study objective, qualitative analyses may provide a deeper understanding of the barriers and facilitators for implementation [7]. Quantitative results of implementation are limited to documented or observed use of the innovation but does not reflect a deeper investigation into the precision of its use.

Conclusions

We describe the factors influencing implementation of a novel comprehensive obstetric workflow for care of the COVID-19 perioperative parturient during the first surge of the pandemic using the CFIR framework. Early workflow adoption was facilitated primarily by two domains, namely thoughtful innovation design and careful implementation planning in the setting of a long-standing culture of improvement. Factors initially assessed as barriers such as communication, culture and learning climate, transitioned into facilitators once a perceived benefit was experienced by healthcare teams. These key factors provide important information for the implementation of rapid change during a time of crisis.

Availability of data and materials

Not applicable

Change history

Abbreviations

SARS-CoV-2:

Severe Acute Respiratory Syndrome Coronavirus-2

COVID-19:

Coronavirus disease 2019

L&D:

Labor and delivery

PPE:

Personal protective equipment

CFIR:

Consolidated Framework for Implementation Research

ERIC:

Expert Recommendations for Implementing Change

IRB:

Institutional review board

ACOG:

American College of Obstetrics and Gynecology

SOAP:

Society for Obstetric Anesthesia and Perinatology

APSF:

Anesthesia Patient Safety Foundation

CDC:

Centers for Disease Control

SQUIRE:

Standards for QUality Improvement Reporting Excellence

TIDieR:

Template for Intervention Description and Replication

References

  1. World Health Organization (WHO). WHO Director-General’s opening remarks at the media briefing on COVID-19 - 11 March 2020. 2020. https://www.who.int/director-general/speeches/detail/who-director-general-s-opening-remarks-at-the-media-briefing-on-covid-19---11-march-2020.

  2. Li Y, Ciampa EJ, Zucco L, Levy N, Colella M, Golen T, et al. Adaptation of an Obstetric Anesthesia Service for the Severe Acute Respiratory Syndrome Coronavirus-2 Pandemic: Description of Checklists, Workflows, and Development Tools. Anesth Analg. 2020;132(1):31–7.

    Article  Google Scholar 

  3. Sabol B, Caughey AB. Quality Improvement and Patient Safety on Labor and Delivery. Obstet Gynecol Clin N Am. 2017;44(4):667–78.

    Article  Google Scholar 

  4. Fischer F, Lange K, Klose K, Greiner W, Kraemer A. Barriers and Strategies in Guideline Implementation—A Scoping Review. Healthcare. 2016;4(3):36.

    Article  Google Scholar 

  5. Houghton C, Meskell P, Delaney H, Smalle M, Glenton C, Booth A, Chan XHS, Devane D, Biesty LM. Barriers and facilitators to healthcare workers' adherence with infection prevention and control (IPC) guidelines for respiratory infectious diseases: a rapid qualitative evidence synthesis. Cochrane Database Syst Rev. 2020;4(4):CD013582.

  6. Chaillet N, Dubé E, Dugas M, Audibert F, Tourigny C, Fraser WD, et al. Evidence-based strategies for implementing guidelines in obstetrics: A systematic review. Obstet Gynecol. 2006;108(5):1234–45.

    Article  Google Scholar 

  7. Forsner T, Hansson J, Brommels M, Wistedt AA, Forsell Y. Implementing clinical guidelines in psychiatry: a qualitative study of perceived facilitators and barriers. BMC Psychiatry. 2010;10:8. https://doi.org/10.1186/1471-244X-10-8.

  8. Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. Fostering implementation of health services research findings into practice: A consolidated framework for advancing implementation science. Implement Sci. 2009;4(1):1–15.

    Article  Google Scholar 

  9. King DK, Shoup JA, Raebel MA, Anderson CB, Wagner NM, Ritzwoller DP, et al. Planning for Implementation Success Using RE-AIM and CFIR Frameworks: A Qualitative Study. Front Public Health. 2020;8(March):1–14.

    Google Scholar 

  10. Kirk MA, Kelley C, Yankey N, Birken SA, Abadie B, Damschroder L. A systematic review of the use of the Consolidated Framework for Implementation Research. Implement Sci [Internet]. 2016;11(1) Available from: https://doi.org/10.1186/s13012-016-0437-z.

  11. Waltz TJ, Powell BJ, Chinman MJ, Smith JL, Matthieu MM, Proctor EK, et al. Expert recommendations for implementing change (ERIC): Protocol for a mixed methods study. Implement Sci [Internet]. 2014;9(1):1–12 Available from: Implementation Science.

    Article  Google Scholar 

  12. Powell BJ, Waltz TJ, Chinman MJ, Damschroder LJ, Smith JL, Matthieu MM, et al. A refined compilation of implementation strategies: Results from the Expert Recommendations for Implementing Change (ERIC) project. Implement Sci. 2015;10(1):1–14.

    Article  Google Scholar 

  13. Zulman DM, Damschroder LJ, Smith RG, Resnick PJ, Sen A, Krupka EL, et al. Implementation and evaluation of an incentivized Internet-mediated walking program for obese adults. Transl Behav Med. 2013;3(4):357–69.

    Article  Google Scholar 

  14. van Oers HA, Teela L, Schepers SA, Grootenhuis MA, Haverman L; ISOQOL PROMs and PREMs in Clinical Practice Implementation Science Group. A retrospective assessment of the KLIK PROM portal implementation using the Consolidated Framework for Implementation Research (CFIR). Qual Life Res. 2020. https://doi.org/10.1007/s11136-020-02586-3.

  15. Ogrinc G, Davies L, Goodman D, Batalden P, Davidoff F, Stevens D. SQUIRE 2.0 (Standards for QUality Improvement Reporting Excellence): Revised publication guidelines from a detailed consensus process. BMJ Qual Saf. 2016;25(12):986–92.

    Article  Google Scholar 

  16. Hoffmann TC, Glasziou PP, Boutron I, Milne R, Perera R, Moher D, et al. Better reporting of interventions: Template for intervention description and replication (TIDieR) checklist and guide. BMJ [Internet]. 2014;348(March):1–12 Available from: http://dx.doi.org/doi:10.1136/bmj.g1687.

    Google Scholar 

  17. Chen X, Liu Y, Gong Y, Guo X, Zuo M, Li J, Shi W, Li H, Xu X, Mi W, Huang Y. Chinese Society of Anesthesiology, Chinese Association of Anesthesiologists. Perioperative Management of Patients Infected with the Novel Coronavirus: Recommendation from the Joint Task Force of the Chinese Society of Anesthesiology and the Chinese Association of Anesthesiologists. Anesthesiology. 2020;132(6):1307–16. https://doi.org/10.1097/ALN.0000000000003301.

  18. Podovei M, Bernstein K, George R, Habib A, Kacmar R, Bateman B, et al. Interim Considerations for Obstetric Anesthesia Care related to COVID19. Soc Obstet Anesth Perinatol. 2020. https://cdn2.hubspot.net/hubfs/49769/SOAP_COVID-19%20Interim%20Considerations.pdf.

  19. Boelig RC, Manuck T, Oliver EA, Di Mascio D, Saccone G, Bellussi F, Berghella V. Labor and delivery guidance for COVID-19. Am J Obstet Gynecol MFM. 2020;2(2):100110. https://doi.org/10.1016/j.ajogmf.2020.100110.

  20. Zucco L, Levy N, Ketchandji D, Aziz M, Ramachandran SK. Perioperative Considerations for the 2019 Novel Coronavirus (COVID-19). Anesth Patient Saf Foundation. 2020. https://www.apsf.org/article/an-update-on-the-perioperative-considerations-for-covid-19-severe-acute-respiratory-syndrome-coronavirus-2-sars-cov-2/.

  21. Bernstein PS, Combs CA, Shields LE, Clark SL, Eppes CS. The development and implementation of checklists in obstetrics. Am J Obstet Gynecol. 2017;217(2):B2–6.

    Article  Google Scholar 

  22. Etchells E, Ho M, Shojania KG. Value of small sample sizes in rapid-cycle quality improvement projects. BMJ Qual Saf. 2016;25(3):202–6.

    Article  CAS  Google Scholar 

  23. Etchells E, Woodcock T. Value of small sample sizes in rapid-cycle quality improvement projects 2: Assessing fidelity of implementation for improvement interventions. BMJ Qual Saf. 2018;27(1):61–5.

    Article  Google Scholar 

  24. Taras J, Everett T. Rapid Cycle Deliberate Practice in Medical Education - a Systematic Review. Cureus. 2017;9(4):e1180. https://doi.org/10.7759/cureus.1180.

  25. Obstetric Workflows & Checklists. COVID-19 Resources; Department of Anesthesia, Critical Care and Pain Medicine at Beth Israel Deaconess Medical Center. 2020.

    Google Scholar 

  26. Stetler CB, Legro MW, Wallace CM, Bowman C, Guihan M, Hagedorn H, et al. The role of formative evaluation in implementation research and the QUERI experience. J Gen Intern Med. 2006;21(SUPPL. 2):1–8.

    Article  Google Scholar 

  27. Damschroder LJ, Lowery JC. Evaluation of a large-scale weight management program using the consolidated framework for implementation research (CFIR). Implement Sci. 2013;8(152):1–17.

    Google Scholar 

  28. CFIR Research Team - Center for Clinical Management Research. Consolidated Framework for Implementation Research: Data Collection Tools [Internet]. 2021. Available from: https://cfirguide.org/tools/tools-and-templates/

    Google Scholar 

  29. Francke AL, Smit MC, De Veer AJE, Mistiaen P. Factors influencing the implementation of clinical guidelines for health care professionals: A systematic meta-review. BMC Med Inform Decis Mak. 2008;8:1–11.

    Article  Google Scholar 

  30. Kilsdonk E, Peute LW, Jaspers MWM. Factors influencing implementation success of guideline-based clinical decision support systems: A systematic review and gaps analysis. Int J Med Inform. 2017;98:56–64.

    Article  CAS  Google Scholar 

  31. Grimshaw J, Freemantle N, Wallace S, Russell I, Hurwitz B, Watt I, et al. Effectiveness Bulletin Developing and implementing clinical practice guidelines. Qual Heal Care. 1995;4:55–64.

    Article  CAS  Google Scholar 

  32. Maqbool A, Khan NZ. Analyzing barriers for implementation of public health and social measures to prevent the transmission of COVID-19 disease using DEMATEL method. Diabetes Metab Syndr [Internet]. 2020;14(5):887–92 Available from: https://pubmed.ncbi.nlm.nih.gov/32563940.

    Article  Google Scholar 

  33. Wensing M, Wensing M, Sales A, Sales A, Armstrong R, Wilson P, et al. Implementation science in times of Covid-19. Implement Sci. 2020;15(1):1–4.

    Article  Google Scholar 

  34. Bermúdez-Tamayo C, Fernández Ruiz E, Pastor Moreno G, Maroto-Navarro G, Garcia-Mochon L, Perez-Ramos FJ, et al. Barriers and enablers in the implementation of a program to reduce cesarean deliveries. Reprod Health. 2017;14(1):1–13.

    Article  Google Scholar 

  35. English M, Nzinga J, Mbindyo P, Ayieko P, Irimu G, Mbaabu L. Explaining the effects of a multifaceted intervention to improve inpatient care in rural Kenyan hospitals - interpretation based on retrospective examination of data from participant observation, quantitative and qualitative studies. Implement Sci. 2011;6(1):124.

    Article  Google Scholar 

  36. Green CA, McCarty D, Mertens J, Lynch FL, Hilde A, Firemark A, et al. A qualitative study of the adoption of buprenorphine for opioid addiction treatment. J Subst Abus Treat. 2014;46(3):390–401.

    Article  Google Scholar 

Download references

Acknowledgements

Not applicable

Funding

Not applicable

Author information

Authors and Affiliations

Authors

Contributions

All authors read and approved the final manuscript. LZ helped with study design, data analysis and interpretation, manuscript drafting. NL helped with data interpretation and manuscript drafting. YL helped with data interpretation and manuscript drafting. TG helped with data interpretation and manuscript drafting. SAS helped with data interpretation and manuscript drafting. PEH helped with study design, data analysis and interpretation, manuscript drafting. SKR helped with study conception, study design, data analysis and interpretation, manuscript drafting

Corresponding author

Correspondence to Satya Krishna Ramachandran.

Ethics declarations

Ethics approval and consent to participate

As stated in the methods, this study was approved by our IRB at the Beth Israel Deaconess Medical Center and did not constitute human subject research, therefore the requirement for written informed consent was waived (Protocol number: 2020D000469).

Consent for publication

Not applicable

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

The original version of this article was revised: Figure1’s caption was revised.

Supplementary Information

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zucco, L., Levy, N., Li, Y. et al. Rapid Cycle Implementation and Retrospective Evaluation of a SARS-CoV-2 Checklist in Labor and Delivery. BMC Health Serv Res 21, 775 (2021). https://doi.org/10.1186/s12913-021-06787-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12913-021-06787-5

Keywords