Skip to main content
  • Research article
  • Open access
  • Published:

Implementing a toolkit for the prevention, management and control of carbapenemase-producing Enterobacteriaceae in English acute hospitals trusts: a qualitative evaluation



Antimicrobial resistance is an increasing problem in hospitals world-wide. Following other countries, English hospitals experienced outbreaks of carbapenemase-producing Enterobacteriaceae (CPE), a bacterial infection commonly resistant to last resort antibiotics. One way to improve CPE prevention, management and control is the production of guidelines, such as the CPE toolkit published by Public Health England in December 2013. The aim of this research was to investigate the implementation of the CPE toolkit and to identify barriers and facilitators to inform future policies.


Acute hospital trusts (N = 12) were purposively sampled based on their self-assessed CPE colonisation rates and time point of introducing local CPE action plans. Following maximum variation sampling, 44 interviews with hospital staff were conducted between April and August 2017 using a semi-structured topic guide based on the Capability, Opportunity, Motivation and Behaviour Model and the Theoretical Domains Framework, covering areas of influences on behaviour. Interviews were audio-recorded, transcribed verbatim and analysed using thematic analysis.


The national CPE toolkit was widely disseminated within infection prevention and control teams (IPCT), but awareness was rare among other hospital staff. Local plans, developed by IPCTs referring to the CPE toolkit while considering local circumstances, were in place in all hospitals. Implementation barriers included: shortage of isolation facilities for CPE patients, time pressures, and competing demands. Facilitators were within hospital and across-hospital collaborations and knowledge sharing, availability of dedicated IPCTs, leadership support and prioritisation of CPE as an important concern. Participants using the CPE toolkit had mixed views, appreciating its readability and clarity about patient management, but voicing concerns about the lack of transparency on the level of evidence and the practicality of implementation. They recommended regular updates, additional clarifications, tailored information and implementation guidance.


There were problems with the awareness and implementation of the CPE toolkit and frontline staff saw room for improvement, identifying implementation barriers and facilitators. An updated CPE toolkit version should provide comprehensive and instructive guidance on evidence-based CPE prevention, management and control procedures and their implementation in a modular format with sections tailored to hospitals’ CPE status and to different staff groups.

Peer Review reports


Carbapenemase-producing Enterobacteriaceae (CPE), Gram-negative bacteria with resistance to carbapenem antibiotics, are an increasing problem world-wide [1,2,3]. Carbapenems are powerful broad spectrum antibiotics and one of the last effective treatments for multi-resistant bacteria [4]. In some European countries, CPE are endemic, particularly in southern countries such as Greece and Italy [5, 6]. Evidence suggests that hospitalisation, especially when occurring in countries with high numbers of patients colonised or infected with CPE, is a key risk factor for CPE spread and associated deaths [7,8,9]. The United Kingdom has seen a continual increase in incidence of detected colonisations and infections since 2008 with fewer than five confirmed cases between 2004 to 2007 followed by 23 in 2008, 73 in 2009, 333 in 2010, and 561 in 2011 [5].

In December 2013, as part of the response to a number of CPE outbreaks in acute hospitals in England, Public Health England (PHE) published a guidance document, the “Acute trust toolkit for the early detection, management and control of carbapenemase-producing Enterobacteriaceae” and hereafter referred to as the CPE toolkit [10]. Acute trusts are organisational structures of the English National Health Service (NHS), which manage one or more acute care hospitals (secondary and tertiary) with a single management board. The CPE toolkit was produced to offer guidance on CPE, transmission risk factors, early recognition and prevention of transmission to inform the development of trust-specific plans. A literature search was conducted to identify and review relevant publications, documents and guidelines focusing on lessons learned from countries that had experienced CPE outbreaks previously. A question and answer section of the toolkit was based on real questions asked by health care professionals as well as further anticipated questions. The CPE toolkit was formally launched in March 2014 with an NHS England Patient Safety Alert requiring acute trusts to have a local CPE plan in place by June 2014 [11].

The aim of this implementation evaluation was to investigate the awareness of the CPE toolkit amongst frontline staff with specific infection prevention and control responsibilities (IPC), such as IPC nurses or microbiologists, as well as non-IPC specialist frontline staff, including nurses and doctors. Further, the implementation of procedures recommended by the CPE toolkit and the processes by which the CPE toolkit may have influenced clinical practice were examined [12, 13]. Implementation evaluations are particularly important for interventions like the CPE toolkit, which facilitate adaptation to the local context [14, 15]. By encouraging the development of local plans implemented process may vary between trusts, for instance use of risk-based screening of all patients versus limited screening for specific wards. Examining contextual influences, differences between the recommended and implemented processes and identifying key implementation facilitators and barriers from the perspective of frontline staff should help improve and strengthen future versions of the CPE toolkit and inform other policies.


Implementation evaluation frameworks

The Behaviour Change Wheel (BCW), a comprehensive framework for developing and evaluating behaviour change interventions, was used to theoretically inform the evaluation [16]. It describes seven broad policy level options through which behaviour can be influenced: fiscal measures, regulations, service provision, legislation, communication and marketing, environmental and social planning, and guidelines. To target capabilities, opportunities and motivation to perform behaviours (COM-B model), policy interventions support specific intervention functions, for example education, persuasion, incentivisation, coercion, training, restriction and environmental restructuring. Mapping onto the COM-B model, the Theoretical Domains Framework (TDF) breaks down the capability, opportunity and motivation domains further, outlining 14 areas of influence on professional behaviour, for example improving skills, changing beliefs about consequences or social influences [17, 18]. We examined which influences were relevant to the CPE toolkit implementation and what behaviour change pathways applied according to frontline staff. The evaluation built on empirical findings from a 2016 online survey of executive acute trust staff on organisational level perceptions of the CPE toolkit implementation, which suggested awareness of the CPE toolkit, but a lack of confidence in its practical value [19]. Additional file 1 illustrates how the evaluation frameworks informed the following research process.


A qualitative design was used to gain a contextual understanding of CPE awareness amongst frontline staff and their experiences of the CPE toolkit implementation [14, 20, 21]. The evaluation protocol was reviewed by the University of Bristol Research Ethics Committee, classifying this health service evaluation as an audit of existing NHS procedures [22].


The evaluation was conducted in acute hospital trusts in England, the setting for which the CPE toolkit was developed. At the time of this research, there were 154 English acute trusts. Trusts that had given their consent to be approached for further evaluation activities (59 of 99 respondents) in the prior online survey [19] were purposively sampled to ensure a diverse sample [23,24,25]. The sampling frame focused on capturing all potential combinations of two main sampling criteria, CPE colonisation rates and time point of introducing local CPE plans, and on including large, medium and small trusts from each commissioning region. All trusts had local CPE plans in place, but the time point of initial introduction varied from prior to the CPE toolkit publication, as early as 2014, to late adoptions (2015/16). CPE colonisation, a precursor for infection [26], correlated with CPE infection rates (χ2 = 116.49; p < 0.001) and ranged from no cases, to some (1–10), and many CPE colonisation rates (> = 11) [19].

A personal access strategy [27, 28] was employed, gaining access through gatekeepers such as the local infection prevention and control teams (IPCT) and antimicrobial resistance (AMR) leads or through executive members of staff that participated in the survey. Following a maximum variation sampling approach to explore different views and experiences and to maximise the chance of discovering differences between staff with a range of roles and responsibilities [29,30,31], gatekeepers identified interview participants from two staff groups targeted by the CPE toolkit: 1) staff with specialist IPC responsibilities (e.g. IPC directors, lead IPC nurses or consultant microbiologists) as key informants [32], hereafter called IPC frontline staff, and 2) non-IPC frontline staff (e.g. staff nurses, ward managers and doctors) caring for patients, hereafter called general frontline staff. Settings included low CPE risk but high patient throughput wards, such as admission and acute medicine, as well as specialised, high CPE risk wards, like intensive care and surgical wards. Depending on trust size and speciality, the number of staff available for interviews varied, ranging from two to five participants per trust (Additional file 2) with at least one person from each group (Table 1). Out of the 14 trusts approached, 12 agreed to participate and 44 interviews were conducted (Table 2). Inability to spare staff time was given as reason for non-participation.

Table 1 Interviewed staff characteristics
Table 2 Participating trusts’ characteristics

Interview procedures

An interview topic guide (Additional file 3) was developed by the multidisciplinary research team, piloted with participants at two acute trusts and iteratively adapted over the course of the interviews as new insights emerged [21, 33, 34]. Semi-structured interviews ensured detailed information relevant to the evaluation questions were captured while allowing participants to raise additional topics of importance [24, 25]. Participants were asked to reflect on any ‘significant changes’ [35, 36] concerning CPE prevention, management and control since 2014 when the CPE toolkit was launched nationally. Questioning not referring explicitly to the CPE toolkit initially was aimed at identifying changes in the wider context and how much importance participants ascribed to the toolkit, if they were aware of it. Aspects related to potential behaviour change pathways and context factors were explored with questions based on the TDF [18]. As visual stimulus to prompt further insight into participants’ experiences and views on recommended procedures [14, 37], participants were asked to comment on the patient management steps specified in a flowchart included in the CPE toolkit. Interviews were conducted in accordance with data protection and confidentiality regulations, by briefing participants and obtaining informed consent. As this evaluation was commissioned by the same group at PHE who commissioned the CPE toolkit, interviewers emphasised their independence of the evaluation group to counter response biases. Depending on participants’ preferences and availability, interviews were conducted between April and August 2017 either face-to-face during one-day site visits or by telephone over a maximum period of one month (Table 1). Both interviewers (AS, CC) were women with a PhD in health science (health psychology, epidemiology) with prior qualitative research experience. Interview times ranged from nine to 108 min with an average length of 26 min. The average interview length was similar for face-to-face (27 min) and telephone interviews (24 min).


The interviews were digitally recorded on an encrypted recording device and transcribed verbatim. The transcripts were imported into NVivo Version 12 [38] and analysed following thematic analysis steps [39] using the constant comparison technique, coding the material line-by-line [40]. To ensure reliability and validity of the analysis [21, 30, 41], the first five transcripts were independently double-coded (AS, CC). Potential discrepancies were discussed to reach consensus and a coding framework was developed using a hybrid approach [42], combining data-driven inductive codes and deductively developing categories based on the Medical Research Council process evaluation guidelines [12] and procedures outlined by the CPE toolkit [10]. The first author applied the agreed coding framework to the remaining transcripts. Themes were converted into thematic networks [43], mapping implementation barriers and facilitators according to COM-B model categories for behavioural influences [16]. Further procedures employed to ensure quality of the data analysis included discussions of findings within the multidisciplinary team, memo writing and keeping reflective and decision logs throughout the data collection and analysis phase, grounding findings in the data through anonymised participant quotes and transparent reporting in line with recognised standards [25, 44].


Table 3 summaries results concerning awareness and reach of the CPE toolkit, the implementation and impact pathway and views, responses and improvement suggestions, followed by corresponding participant quotes.

Table 3 CPE toolkit implementation overview

Awareness and reach of the CPE toolkit

The extent to which frontline staff came into direct contact with the published CPE toolkit varied by staff group. All interviewed IPC frontline staff were aware of the CPE toolkit. This was rarely the case amongst general frontline staff (10%) and the few who recalled seeing it, acknowledged that they had not read it. General frontline staff, which referred directly to the CPE toolkit, usually did so in the context of CPE outbreaks. IPC frontline staff often could not remember how they initially heard about the CPE toolkit. If they did, this was typically through their professional networks and PHE mailing lists.

CPE toolkit implementation and impact pathway

All trusts had local CPE plans in place and participants described CPE prevention, management and control procedures that aligned with the CPE toolkit guidance as much as possible considering local circumstances. Figure 1 provides an illustration of the role of the CPE toolkit in the typical development and implementation process of local CPE plans.

Fig. 1
figure 1

Typical CPE toolkit impact pathway

The process started with encountering CPE, either within their trust or becoming aware that it was a problem at other, particularly neighbouring trusts. CPE proximity seemed crucial in influencing the implementation process by raising awareness of CPE as a problem (82%). In response, IPC frontline staff would use the CPE toolkit to inform trust practice and translate it into local procedures and policies, making amendments to accommodate their circumstances and demands. Examples of local adaptations were enhancement of CPE precautions for high CPE colonisation rates or CPE outbreaks and large-scale patient cohorting at CPE isolation wards in response to insufficient isolation facilities. The three trusts that had local plans in place before the CPE toolkit was published reported their own hospital CPE outbreaks as triggers for developing CPE policies in the absence of national guidance. When the CPE toolkit was published, they referred to it to check if their policies aligned with recommended procedures, but did not necessarily find them useful.

The process of developing local CPE plans was often described as an interdisciplinary effort. Considering multiple perspectives helped to engage different staff groups and aimed to generate policies that were relevant, workable and acceptable for users. Communication channels for local CPE plans varied, including word of mouth, meetings and training sessions, intranet communications and written information leaflets and checklists. There was awareness that the implementation of procedures recommended in the CPE toolkit or locally-relevant adaptations promoted a general confidence in CPE prevention, management and control capabilities. This, however, did not necessarily co-exist with an in-depth knowledge of CPE, even in hospitals that experienced outbreaks.

The described process (Fig. 1) was iterative in nature without an ultimate endpoint, as responding to implementation experiences and situational factors (e.g. CPE outbreaks, availability of new evidence) local plans and procedures continued to change. Overall, developing local CPE plans was seen as less of a challenge than their implementation.

Implementation facilitators and barriers

Table 4 provides an overview of factors mentioned by participants that acted as facilitators and/or barriers to implementing recommended CPE prevention, management and control procedures. They are grouped under the most relevant COM-B model component and illustrated by verbatim quotations. Factors influencing implementation often interacted as staff capabilities (e.g. knowledge and skills) and opportunities (e.g. social influences and available resources) had an impact on their motivation (e.g. beliefs and intentions) to engage in target behaviours.

Table 4 Factors influencing the implementation of recommended procedures

Due to the novelty of the topic, a lack of awareness and knowledge especially amongst general frontline staff prevailed. Expert CPE knowledge went hand-in-hand with concerns about resulting risks and increased efforts to deal with CPE. Uncertainties about CPE risk factors and its management as well as receiving too much and too detailed information were problematic. Implementation was made easier, if new processes such as screening procedures were added to already existing standard operational procedures and routines. One way of doing this was making CPE part of a wider IPC plan. This however posed the risk of not paying enough attention to CPE but prioritising other more pressing issues.

Contextual factors, including resources and social influences, were overall key to implementation. Participants recognised multidisciplinary, trust-wide and across-trusts efforts and knowledge sharing as facilitators, even if these slowed down the process since involving various stakeholders took time. This approach promoted communication of relevant patient information and helped to creatively deal with important barriers, such as insufficient numbers of isolation facilities. A problem mentioned was communication and collaboration with community care providers, where anxieties and a lack of CPE knowledge hampered the discharge of colonised patients.

Further facilitative social opportunity factors included the presence of dedicated IPC staff and support from supervisors, modelling good practice, and trust management support. The CPE toolkit was seen as a credible source of information, which could help to secure management support for financial investments to address resource challenges such as a shortage of isolation facilities or funding for additional training. Comparing their own situation to other trusts seemed to encourage CPE prevention and control efforts as CPE outbreaks at other trusts highlighted the seriousness of the problem; some participants mentioned a desire to outperform other trusts. Patients’ lack of awareness and refusal to participate in recommended procedures, particularly refusing rectal swabs, was a barrier reported by some trusts but could be addressed with communication and reassurance.

Encountering CPE increased staff motivation to develop local plans and follow recommended procedures and led to raised awareness and CPE knowledge. On the other hand, if CPE was already a problem, procedures outlined in the CPE toolkit were often not seen as adequate or practicable, forcing staff to find new ways of managing the problem, including cohorting whole patient groups. Older hospital buildings were a barrier to ensuring appropriate cleaning of facilities and isolation. Staff shortages, time pressures and competing IPC demands complicated matters further. Training members of staff for example, the most frequently named dissemination strategy for local CPE plans, was difficult due to high staff turnover and work pressures. There was increased anxiety in the context of resource shortages as this increased the challenge of managing potential CPE cases. Being extremely concerned and anxious about CPE seemed to evoke helplessness and inaction.

Optimism and confidence in the capability to carry out recommended procedures was both a barrier and facilitator. A certain level was required for successful implementation, for example when carrying out rectal swabs. An over-confidence, assuming current practice based on clinical expertise and experience sufficed, however, prevented staff from acquiring further knowledge and skills. Some staff mentioned that the CPE toolkit helped reduce concerns and improved beliefs in their capacity to manage outbreaks as it provided clear guidance. Continuous improvement efforts, e.g. using monitoring, audit or feedback, helped adapting patient management procedures. IPC nurses typically took charge as they felt responsible for and took ownership of the issue and for passing on relevant knowledge. Overall, it was facilitative to change if staff perceived following recommended procedures and dealing with CPE as an important part of their role and identity.

Views and responses to the CPE toolkit

Participants, who were familiar with the CPE toolkit, often could not remember their initial thoughts or recall its specific content, but reported views were mixed (Table 3). Some thought it was comprehensive and useful and much needed at the time, especially the flowchart, while others perceived the recommended procedures as impractical to implement locally. Participants criticised the CPE toolkit for not being specific enough, sometimes acknowledging this could be due to lack of a clear evidence base. The lack of scientific evidence led others to question the credibility of the information provided and to voice distrust in or confusion around the recommended procedures. While the toolkit did not include enough information for some, other participants criticised it for being too long, making it inaccessible. There was also some uncertainty about the CPE toolkit target group.

CPE toolkit improvement suggestions

The most commonly voiced improvement suggestion was that the current version of the CPE toolkit should be updated regularly (23%). Participants were keen that an updated version would include new evidence and further clarifications on the difference between CPE and Carbapenemase-producing Organism (CPO), risk factors and screening procedures, including different implementation options to fit clinical practice. One way to address concerns around the evidence base of the CPE toolkit and strengthen its credibility could be linking it to related guidance and research publications or providing contact details of experts for further queries. A better fit for clinical practice might be achieved building on previous involvement of experts “on the ground”.

Participants felt it needed to be more explicitly highlighted that the CPE toolkit encouraged local adaptations and to provide tailored information to meet the needs of different staff groups and types of trusts, for example trusts with low and high colonisation rates. To improve accessibility and reduce information overload for general frontline staff, an abbreviated version was suggested. Participants also expressed a desire for further visualisations, particularly in the form of graphs and figures concerning epidemiological information. Those figures would not necessarily need to be provided in writing, but could be accessible online and should again be updated regularly. Table 5 summarises recommendations for improving the CPE toolkit based on participants’ suggestions and outlined implementation facilitators and barriers.

Table 5 Recommendation summary for future CPE toolkit versions


In this qualitative implementation evaluation, frontline staff representing a variety of roles and different hospital settings, in terms of CPE colonisation rates, time point of introducing local CPE plans, trust size and geographical region, were interviewed to examine in-depth their experiences concerning awareness and uptake of the CPE toolkit and recommended procedures. A minority of frontline staff had seen the published CPE toolkit and of those who had almost all were staff with specific IPC responsibilities. The majority of frontline staff was exposed to the information in the CPE toolkit indirectly via local CPE policies, which were in place at all participating trusts.

Interviewed IPC frontline staff typically used the toolkit as a resource or were aware that it had been used to inform the development of their local CPE plan. In cases where outbreaks preceded the CPE toolkit, it was used to check whether existing plans aligned to recommended procedures. The previously conducted survey with executive-level staff found that out of 99 represented trusts 64% said they had used the CPE toolkit to inform their local CPE plan whilst 32% reported having used it as provided [19].

Proximity to CPE in terms of local experiences or outbreaks at trusts nearby seemed to be a crucial facilitator of change via increased awareness and motivation. Specifically trusts with high colonisation rates and outbreak experiences were quick to have management and control procedures in place, even before the publication of the CPE toolkit that was not necessarily seen as useful anymore. This is in line with findings from the executive staff survey and research on regional CPE prevalence at English hospitals [19, 45]. The development of local plans and the introduction of CPE prevention, management and control procedures based on the CPE toolkit in response to such trigger events represent a multilevel implementation process typical for healthcare interventions in complex settings [46, 47]. It was not a strictly linear, rational and clock-workstyle pathway to change standard operational procedures. As found in research on introducing new procedures and systems in primary care [48], pathways to implementation were complex and both organisational and interpersonal factors, such as senior management support, a culture of knowledge sharing and multidisciplinary collaborations, mediated the process.

The evaluation captured the multidisciplinary nature of both, local plan development and their implementation. Continual efforts were required to adapt procedures in the light of changing conditions, such as increased experiences of CPE. The conceptualisation of the CPE guidelines as a toolkit allowed for differences between trusts and shifted the implementation focus from fidelity to local adaptations, which could be tailored to the specific contexts and built on local expertise. Such multicomponent approaches that build on and increase existing infection control measures have been found to be particularly effective in controlling CPE outbreaks, whilst feedback loops involving various stakeholders within the organisation are important to translate guidelines into implementable procedures [3, 46, 47].

Overall, writing local plans was not a problem, but difficulties arose implementing them. This is not unusual as even evidence-based guidelines are frequently not implemented in practice [49, 50] and therefore implementation research is crucial to understanding the reasons for this to improve uptake [46]. This implementation evaluation highlighted implementation barriers and facilitators that should be considered in future revision of the CPE toolkit. Furthermore, as epidemiological studies assessed CPE as a representative example for new emerging AMR threats [45], current findings could be helpful when developing and implementing other AMR focused policies.

Social and resource factors were the most important implementation facilitators and barriers. Organisational cultures were found to be particularly important for the implementation of new policies in complex organisations such as hospitals where many different groups of people interact [51]. Interview participants commented, for example, on the facilitative influence of senior management support, which is in line with the prior executive staff survey [19]. Acute trusts that placed a low priority on CPE prevention, management and control also had poorer compliance at the frontline.

Organisational factors are even thought to outweigh the impact of the quality of the evidence supporting new policies or procedures in respect to implementation [52, 53]. This may be partly because frontline staff did not necessarily have contact with the actual guidance, but rather with the local interpretation of them. Staff commented on the benefit of knowledge sharing and multidisciplinary efforts, similar to evidence on successful CPE outbreak control measures, which included dedicated IPC frontline staff and hospital-wide contact tracing as part of a multifaceted intervention [54]. Delegating overseeing the implementation of local CPE prevention, management and control procedures to specific IPC frontline staff seemed easier in large trusts with extensive IPC teams, while multi-disciplinary collaborations were facilitated in small trust by staff being familiar with each other and existing work relationships. Cross-trust coordination of IPC activities within regions, e.g. by sharing information about patients’ colonisation status between health-care institutions, seems particularly important in England and other countries where hospitals are connected by patient movements and inter-hospital spread is likely, and where there is the possibility of community associated CPE [26, 45, 55, 56]. A big resource-related challenge was staff having to negotiate competing demands with little scope to be released from day-to-day duties for example for relevant training. Keeping up with training was an even bigger issue if there was high staff turnover and employment of agency staff.

In the absence of cases, CPE concerns amongst participants were often low and so was the perceived risk to patients’ safety, hindering compliance with recommended procedures. This is supported by research that has found a poor compliance with guidance at the frontline if staff deemed their patients not at risk [57] and if there was a lack of fit between clinicians’ experiences and recommended practices [58]. Some participants at trusts with currently no or low numbers of CPE cases felt confident in their abilities to manage small numbers of cases but were less optimistic if they expected an increase in the future. This mirrors the perception of executive trust staff, who also voiced a lack of confidence in the value of the CPE toolkit when dealing with outbreaks [19]. Interview participants had general concerns about the effectiveness of the CPE toolkit guidance and questioned its evidence-base.

Although the CPE toolkit suggests a multifaceted approach in line with best practice evidence [3] and its overlap with other guidance based on expert consultations and systematic reviews [59, 60], evidence gaps remain. There is uncertainty for example with respect to CPE risk factors, cost effective surveillance strategies and the general robustness of the available evidence. It is important to address these gaps, although improving the evidence base alone will not be enough to strengthen guidance implementation [52, 53], which also depends on the described motivational and organisational factors.

Regular intervention revisions and updates are required to achieve sustainable change, but excessive guideline revision frequencies should be avoided as they may undermine implementation [46, 47, 58]. In the case of the CPE toolkit and in light of the influence of CPE proximity on implementation, it may be that maps providing epidemiological data on the geographical distribution of CPE positive isolates could be produced and updated frequently online, while the CPE toolkit in its entirety should only be updated when a considerable amount of new evidence is available [45, 58]. The need for comprehensive summary information should be considered when presenting new evidence and references and additionally information sources should be clearly signposted to accommodate further information needs. It would also be helpful to link the CPE toolkit to related guidance such as the CPE toolkit for non-acute and community settings [61], which would be important for issues around transfers to community settings.

The CPE toolkit contained information targeting different groups, including hospital frontline staff, board and executive-level staff and patients [10]. The evaluation found that it was used mainly by IPC specialist staff and disseminated to other frontline staff was via local plans and processes such as on the job training. It may therefore be useful to target the CPE toolkit for use by the IPCT, and provide them with recommendations and resources on how to disseminate its content to the hospital workforce. This approach, providing implementation guidance, would harness the responsibility felt by IPC staff to inform others. Additional staff groups such as microbiologists or pharmacists may also be involved in dissemination. A section for board level executives should remain due to the importance of garnering management support. The CPE toolkit could function as a comprehensive reference document, but with sections and resources clearly signposted to relevant audience (information for general frontline staff, microbiologists, pharmacists, management etc.) and with information specifically prepared for each target group to reduce information load and improve processing. A modular design could also consider different or incremental CPE incident levels as trusts with none or low colonisation rates require different action plans than those with widespread outbreaks. For low-prevalence CPE settings enhanced infection control measures even without active surveillance could suffice whereas hospital-wide contract tracing would be required to control outbreaks [54, 62].

Implementation guidance could be included in the CPE toolkit to facilitate the process of incorporating recommended procedures into clinical practice. A task force or implementation team consisting of different target group representatives and tools for conducting stakeholder analyses or leadership support assessments are promising options [63, 64]. Leadership support could further be encouraged, if necessary, by providing information on cost savings due to outbreak prevention measures [65, 66]. Overall, acute trust representatives should be involved in the revision of the guidelines and multidisciplinary collaborations at trust level should be encouraged to revise local policies. Involving end-users promotes implementable recommendations and a sense of ownership and commitment to adherence [58].

Drawing on behavioural science theories, this implementation evaluation contributed to addressing a lack of rigorous, theory-based implementation evaluations and provided an evidence base for updating the CPE toolkit [17, 50]. The in-depth, qualitative research approach allowed for flexibility to explore emerging issues and new points of views, which was particularly important to understand the implementation in context and to uncover not only the intended, but also unintended intervention consequences [46, 47]. Taking into account participants’ responses and following up on their specific experiences and implementation concerns meant that topics outlined by the interview guide were not assessed in a standardised, quantifiable but holistic manner [39, 67].

A personal access strategy and entering the field during data collection [27, 68] resulted in good participant engagement rates with 12 out of 14 trusts and general as well as IPC frontline staff participating. Purposively recruiting trusts and frontline staff using a maximum variation sampling approach [29,30,31] provided insight into wide range of frontline experiences in different settings. The recruitment was based on the previous survey sample [19] and required consent to interviews, possibly selecting trusts already being more engaged in the CPE toolkit implementation than non-survey participants. Considering late adopters, trusts that introduced local CPE plans only with a delay of up to 3 years, might counteract this potential selection bias to some degree. With telephone interviews being conducted over multiple days, answers concerning awareness of the CPE toolkit could have been affected due to trust internal information exchange, but remained overall low amongst general frontline staff.

The CPE toolkit was nationally disseminated and there were therefore no examples of acute trusts not provided with it to be considered for comparative purposes. Due to the multicomponent nature of the CPE toolkit, the evaluation focused on general, top-level implementation facilitators and barriers to provide generic improvement suggestions. Analysing the implementation of all target behaviours suggested by the CPE toolkit would have been beyond the scope of this research and would not have been reasonable considering the guidelines allowed for local adaptations. This should, however, be kept in mind when interpreting the findings and it would be useful to triangulate them with experimental research investigating the impact of the guidelines on specific target behaviours [69]. It would have been beneficial to conduct this implementation evaluation sooner after the national launch of the CPE toolkit, accompanying the implementation phase, to avoid potential memory biases. This approach would fit with a continual cycle of evaluation, feedback and implementation as subsequent adaptation is important for future guidance.


The CPE toolkit was found to be helpful as a reference document for IPC frontline staff using it to inform and check their own CPE prevention, management and control plans in particular in the event of an outbreak. Frontline staff felt there was a need for an updated version of the CPE toolkit, including new evidence and guidance on how to tailor it to different contexts. Greater consideration should be given to implementation when developing national guidance and policy.

Availability of data and materials

The datasets generated and analysed during the current study are not publicly available for data protection reasons but anonymised excerpts are available from the corresponding author on request.



Antimicrobial resistance


Behaviour Change Wheel

COM-B model:

Capability, Opportunity, Motivation and Behaviour model


Carbapenemase-producing enterobacteriaceae


Carbapenemase-producing Organism


European Centre for Disease Prevention and Control


Infection prevention and control


Infection prevention and control teams


Medical Research Council


National Health Service


Public Health England


Theoretical Domains Framework


World Health Organization


  1. Munoz-Price LS, Poirel L, Bonomo RA, Schwaber MJ, Daikos GL, Cormican M, et al. Clinical epidemiology of the global expansion of Klebsiella pneumoniae carbapenemases. Lancet Infect Dis. 2013;13:785–96.

    Article  PubMed  PubMed Central  Google Scholar 

  2. Nordmann P, Dortet L, Poirel L. Carbapenem resistance in Enterobacteriaceae: here is the storm! Trends Mol Med. 2012;18:263–72.

    Article  CAS  PubMed  Google Scholar 

  3. French CE, Coope C, Conway L, Higgins JPT, McCulloch J, Okoli G, et al. Control of carbapenemase-producing Enterobacteriaceae outbreaks in acute settings: an evidence review. J Hosp Infect. 2017;95:3–45.

    Article  CAS  PubMed  Google Scholar 

  4. Hawkey PM, Livermore DM. Carbapenem antibiotics for serious infections. BMJ. 2012;344:1–7.

    Article  CAS  Google Scholar 

  5. Cantón R, Akóva M, Carmeli Y, Giske C, Glupczynski Y, Gniadkowski M, et al. Rapid evolution and spread of carbapenemases among Enterobacteriaceae in Europe. Clin Microbiol Infect. 2012;18:413–31.

    Article  PubMed  Google Scholar 

  6. Nordmann P. Carbapenemase-producing Enterobacteriaceae: overview of a major public health challenge. Med Mal Infect. 2014;44:51–6.

    Article  CAS  PubMed  Google Scholar 

  7. ECDC. Risk assessment on the spread of carbapenemase-producing Enterobacteriaceae (CPE) through patient transfer between healthcare facilities, with special emphasis on cross-border transfer. Stockholm: ECDC; 2011.

    Google Scholar 

  8. Falagas ME, Tansarli GS, Karageorgopoulos DE. Deaths attributable to Enterobacteriaceae infections. Emerg Infect Dis. 2014;20:6.

    Article  Google Scholar 

  9. Van der Bij AK, Pitout JDD. The role of international travel in the worldwide spread of multiresistant enterobacteriaceae. J Antimicrob Chemother. 2012;67:2090–100.

    Article  PubMed  CAS  Google Scholar 

  10. PHE. Acute trust toolkit for the early detection, management and control of carbapenemase-producing Enterobacteriaceae. London: PHE; 2013.

    Google Scholar 

  11. NHS Improvement. Addressing rising trends and outbreaks in carbapenemase-producing Enterobacteriaceae. NHS Improvement. 2014. Accessed 6 Mar 2014.

  12. Moore GF, Audrey S, Barker M, Bond L, Bonell C, Hardeman W, et al. Process evaluation of complex interventions: Medical Research Council guidance. Br Med J. 2015;350:h1258.

    Article  Google Scholar 

  13. Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M, et al. Developing and evaluating complex interventions: new guidance. Br Med J. 2008;337:a1655.

    Article  Google Scholar 

  14. Chandler CIR, Reynolds J, Palmer JJ, Hutchinson E. ACT consortium guidance: qualitative methods for international health intervention research. London: LSHTM; 2013.

    Google Scholar 

  15. Oakley A, Strange V, Bonell C, Allen E, Stephenson J, Team RS. Process evaluation in randomised controlled trials of complex interventions. Br Med J. 2006;332:413–6.

    Article  Google Scholar 

  16. Michie S, van Stralen MM, West R, Grimshaw J, Shirran L, Thomas R, et al. The behaviour change wheel: a new method for characterising and designing behaviour change interventions. Implement Sci. 2011;6:42.

    Article  PubMed  PubMed Central  Google Scholar 

  17. Atkins L, Francis J, Islam R, O’Connor D, Patey A, Ivers N, et al. A guide to using the theoretical domains framework of behaviour change to investigate implementation problems. Implement Sci. 2017;12:77.

    Article  PubMed  PubMed Central  Google Scholar 

  18. Cane J, O’Connor D, Michie S. Validation of the theoretical domains framework for use in behaviour change and implementation research. Implement Sci. 2012;7:37.

    Article  PubMed  PubMed Central  Google Scholar 

  19. Coope CM, Verlander NQ, Schneider A, Hopkins S, Welfare W, Johnson AP, et al. An evaluation of a toolkit for the early detection, management, and control of carbapenemase-producing Enterobacteriaceae: a survey of acute hospital trusts in England. J Hosp Infect. 2018;99:381–9.

    Article  CAS  PubMed  Google Scholar 

  20. NICE Guidelines. Behaviour change: general approaches. London: NICE; 2007.

    Google Scholar 

  21. Silverman D. Interpreting qualitative data: a guide to the principles of qualitative research. 4th ed. Los Angeles: Sage; 2011.

    Google Scholar 

  22. Healthcare Quality Improvement. Criteria and indicators of best practice in clinical audit. London: Healthcare Quality Improvement; 2009.

    Google Scholar 

  23. Bryman A. Social research methods. 4th ed. Oxford: Oxford University Press; 2012.

    Google Scholar 

  24. Forrester MA. Doing qualitative research in psychology : a practical guide. Los Angeles: SAGE; 2010.

    Google Scholar 

  25. Lyons E, Coyle A. Analysing qualitative data in psychology. Los Angeles: SAGE Publications; 2007.

    Book  Google Scholar 

  26. Akova M, Daikos GL, Tzouvelekis L, Carmeli Y. Interventional strategies and current clinical experience with carbapenemase-producing gram-negative bacteria. Clin Microbiol Infect. 2012;18:439–48.

    Article  CAS  PubMed  Google Scholar 

  27. Johl SK, Renganathan S. Strategies for gaining access in doing fieldwork: reflection of two researchers. Electron J Bus Res Methods. 2010;8:42–50.

    Google Scholar 

  28. Lee P. The process of gatekeeping in health care research. Nurs Times. 2005;101:36–8

    PubMed  Google Scholar 

  29. Suri H. Purposeful sampling in qualitative research synthesis. Qual Res J. 2011;11:63–75.

    Article  Google Scholar 

  30. Boyatzis RE. Transforming qualitative information: thematic analysis and code development. Thousand Oaks: Sage; 1998.

    Google Scholar 

  31. Harper D, Thompson AR. Qualitative research methods in mental health and psychotherapy: a guide for students and practitioners. Chichester, West Sussex: John Wiley & Sons; 2012.

    Google Scholar 

  32. USAID. Conducting key informant interviews. Washington, D.C.: USAID; 1996.

    Google Scholar 

  33. Creswell JW. Qualitative inquiry and research design: choosing among five approaches. 3rd ed. London: SAGE; 2013.

    Google Scholar 

  34. Richards L. Handling qualitative data: a practical guide. 2nd ed. London: SAGE; 2009.

    Google Scholar 

  35. Davies R, Dart J. The ‘Most significant change’ (MSC) technique. London: MSC Guide; 2005.

    Google Scholar 

  36. Chandler CI, DiLiberto D, Nayiga S, Taaka L, Nabirye C, Kayendeke M, et al. The PROCESS study: a protocol to evaluate the implementation, mechanisms of effect and context of an intervention to enhance public health centres in Tororo, Uganda. Implement Sci. 2013;8:113.

    Article  PubMed  PubMed Central  Google Scholar 

  37. Crilly N, Blackwell AF, Clarkson PJ. Graphic elicitation: using research diagrams as interview stimuli. Qual Res. 2006;6:1–27.

    Article  Google Scholar 

  38. NVivo 12 qualitative data analysis software: QSR International Pty Ltd; 2018.

  39. Braun V, Clarke V. Using thematic analysis in psychology. Qual Res Psychol. 2006;3:77–101.

    Article  Google Scholar 

  40. Glaser BG, Strauss AL. The discovery of grounded theory: strategies for qualitative research. London: Weidenfeld & Nicolson; 1968.

    Google Scholar 

  41. Gale NK, Heath G, Cameron E, Rashid S, Redwood S. Using the framework method for the analysis of qualitative data in multi-disciplinary health research. BMC Med Res Methodol. 2013;13:117.

    Article  PubMed  PubMed Central  Google Scholar 

  42. Fereday J, Muir-Cochrane E. Demonstrating rigor using thematic analysis: a hybrid approach of inductive and deductive coding and theme development. Int J Qual Methods. 2006;5:80–92.

    Article  Google Scholar 

  43. Attride-Stirling J. Thematic networks: an analytic tool for qualitative research. Qual Res. 2001;1:385–405.

    Article  Google Scholar 

  44. Tong A, Sainsbury P, Craig J. Consolidated criteria for reporting qualitative research (COREQ): a 32- item checklist for interviews and focus group. Int J Qual Heal Care. 2007;19:349–57.

    Article  Google Scholar 

  45. Donker T, Henderson KL, Hopkins KL, Dodgson AR, Thomas S, Crook DW, et al. The relative importance of large problems far away versus small problems closer to home: insights into limiting the spread of antimicrobial resistance in England. BMC Med. 2017;15:1–11.

    Article  Google Scholar 

  46. Braithwaite J, Churruca K, Long JC, Ellis LA, Herkes J. When complexity science meets implementation science: a theoretical and empirical analysis of systems change. BMC Med. 2018;16:1–14.

    Article  Google Scholar 

  47. Greenhalgh T, Papoutsi C. Studying complexity in health services research: desperately seeking an overdue paradigm shift. BMC Med. 2018;16:95.

    Article  PubMed  PubMed Central  Google Scholar 

  48. Sanders T, Foster NE, Ong BN. Perceptions of general practitioners towards the use of a new system for treating back pain: a qualitative interview study. BMC Med. 2011;9:49.

    Article  PubMed  PubMed Central  Google Scholar 

  49. Grimshaw JM, Thomas RE, MacLennan G, Fraser C, Ramsay CR, Vale L, et al. Effectiveness and efficiency of guideline dissemination and implementation strategies. Int J Technol Assess Heal Care. 2005;21:149.

    Article  Google Scholar 

  50. Grol R, Grimshaw J. Research into practice I From best evidence to best practice : effective implementation of change in patients care. Lancet. 2003;362:1225–30.

    Article  PubMed  Google Scholar 

  51. West MA, Dawson JF. Employee engagement and NHS performance. London: The King’s Fund; 2012.

    Google Scholar 

  52. Fulop N, Walters R, Perri, Spurgeon P. Implementing changes to hospital services: Factors influencing the process and “results” of reconfiguration. Health Policy. 2012;104:128–35.

    Article  PubMed  Google Scholar 

  53. Williams B, Perillo S, Brown T. What are the factors of organisational culture in health care settings that act as barriers to the implementation of evidence-based practice? A scoping review. Nurse Educ Today. 2015;35:e34–41.

    Article  PubMed  Google Scholar 

  54. Hussein K, Rabino G, Eluk O, Warman S, Reisner S, Geffen Y, et al. The association between infection control interventions and carbapenem-resistant Enterobacteriaceae incidence in an endemic hospital. J Hosp Infect. 2017;97:218–25.

    Article  CAS  PubMed  Google Scholar 

  55. Kelly AM, Mathema B, Larson EL. Carbapenem-resistant Enterobacteriaceae in the community: a scoping review. Int J Antimicrob Agents. 2017;50:127–34.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  56. CDC. Facility guidance for control of Carbapenem-resistant Enterobacteriaceae (CRE). Atlanta: CDC; 2015.

    Google Scholar 

  57. Ferguson KJ, Waitzkin H, Beekmann SE, Doebbeling BN. Critical incidents of nonadherence with standard precautions guidelines among community hospital-based health care workers. J Gen Intern Med. 2004;19:726–31.

    Article  PubMed  PubMed Central  Google Scholar 

  58. Kastner M, Bhattacharyya O, Hayden L, Makarski J, Estey E, Durocher L, et al. Guideline uptake is influenced by six implementability domains for creating and communicating guidelines: a realist review. J Clin Epidemiol. 2015;68:498–509.

    Article  PubMed  Google Scholar 

  59. Magiorakos AP, Burns K, Rodríguez Baño J, Borg M, Daikos G, Dumpis U, et al. Infection prevention and control measures and tools for the prevention of entry of carbapenem-resistant Enterobacteriaceae into healthcare settings: guidance from the European Centre for Disease Prevention and Control. Antimicrob Resist Infect Control. 2017;6:1–17.

    Article  Google Scholar 

  60. WHO. Guidelines for the prevention and control of carbapenem-resistant Enterobacteriaceae, Acinetobacter baumannii and Pseudomonas aeruginosa in health care facilities. Geneva: WHO; 2017.

    Google Scholar 

  61. PHE. Toolkit for managing carbapenemase- producing Enterobacteriaceae in non- acute and community settings. London: PHE; 2015.

    Google Scholar 

  62. Kim NH, Han WD, Song KH, Seo HK, Shin MJ, Kim TS, et al. Successful containment of carbapenem-resistant Enterobacteriaceae by strict contact precautions without active surveillance. Am J Infect Control. 2014;42:1270–3.

    Article  PubMed  Google Scholar 

  63. Parker V, Logan C, Currie B. Carbapenem-resistant Enterobacteriaceae (CRE) control and prevention toolkit. Rockville: Agency for Healthcare Research and Quality; 2014.

    Google Scholar 

  64. Bosse G, Breuer JP, Spies C. The resistance to changing guidelines - what are the challenges and how to meet them. Best Pract Res Clin Anaesthesiol. 2006;20:379–95.

    Article  PubMed  Google Scholar 

  65. Otter JA, Burgess P, Davies F, Mookerjee S, Singleton J, Gilchrist M, et al. Counting the cost of an outbreak of carbapenemase-producing Enterobacteriaceae: an economic evaluation from a hospital perspective. Clin Microbiol Infect. 2017;23:188–96.

    Article  CAS  PubMed  Google Scholar 

  66. Bartsch SM, Huang SS, McKinnell JA, Wong KF, Mueller LE, Miller LG, et al. The economic value of the Centers for Disease Control and Prevention Carbapenem-resistant Enterobacteriaceae toolkit. Infect Control Hosp Epidemiol. 2018;39:516–24.

    Article  PubMed  PubMed Central  Google Scholar 

  67. Legitimising the Subjectivity of Human Reality Through Qualitative Research Method. Qual Rep. 2003;8:70–80.

    Google Scholar 

  68. Adams A, Cox AL. Questionnaires, in-depth interviews and focus groups. In: Cairns P, Cox AL, editors. Research methods for human computer interaction. Cambridge: Cambridge University Press; 2008. p. 17–34.

    Chapter  Google Scholar 

  69. Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M. Developing and evaluating complex interventions: the new Medical Research Council guidance. BMJ. 2008;337:979–83.

    Article  Google Scholar 

Download references


Not applicable.


This research is supported by the National Institute for Health Research Health Protection Research Unit (NIHR HPRU) in Evaluation of Interventions at the University of Bristol, in partnership with Public Health England (PHE). The views expressed are those of the authors and not necessarily those of the National Health Service, the NIHR, the Department of Health and Social Care or Public Health England. The funders had no role in the study design, data collection, analysis or interpretation of the data, decision to publish, or preparation of the manuscript.

Author information

Authors and Affiliations



AS: designed the study, collected, analysed and interpreted the data and drafted and revised the manuscript. CC: involved in the study design, data collection and analysis and drafting and revising of the manuscript. SM: involved in the study design and drafting of the manuscript. RP: involved in the data collection and drafting and revising of the manuscript. SH: involved drafting and revising of the manuscript. IO: involved in the study design and drafting and revising of the manuscript. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Annegret Schneider.

Ethics declarations

Ethics approval and consent to participate

The evaluation protocol was reviewed by the University of Bristol Research Ethics Committee, classifying this health service evaluation as an audit of existing NHS procedures not requiring further ethical approval. All interviews were conducted in accordance with data protection and confidentiality regulations, by briefing participants and obtaining written informed consent.

Consent for publication

Written consent was obtained from participants to include anonymised direct quotations from interviews in subsequent publications.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Additional files

Additional file 1:

Flowchart of the evaluation frameworks and research process linkage. (PDF 316 kb)

Additional file 2:

Interview participation per trust. (PDF 67 kb)

Additional file 3:

Interview Topic Guide. (PDF 268 kb)

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (, which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver ( applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Schneider, A., Coope, C., Michie, S. et al. Implementing a toolkit for the prevention, management and control of carbapenemase-producing Enterobacteriaceae in English acute hospitals trusts: a qualitative evaluation. BMC Health Serv Res 19, 689 (2019).

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: