Exploring everyday work as a dynamic non-event and adaptations to manage safety in intraoperative anaesthesia care: an interview study
BMC Health Services Research volume 23, Article number: 651 (2023)
Safety has been described as a dynamic non-event and as constantly present in professionals’ work processes. Investigating management of complex everyday situations may create an opportunity to elucidate safety management. Anaesthesia has been at the frontline of enhancing patient safety – testing and implementing knowledge from other high-reliability industries, such as aviation, in the complex, adaptive system of an operating room. The aim of this study was to explore factors supporting anaesthesia nurses and anaesthesiologists in managing complex everyday situations during intraoperative anaesthesia care processes.
Individual interviews with anaesthesia nurses (n = 9) and anaesthesiologists (n = 6) using cognitive task analysis (CTA) on case scenarios from previous prospective, structured observations. The interviews were analysed using the framework method.
During intraoperative anaesthesia care, management of everyday complex situations is sustained through preparedness, support for mindful practices, and monitoring and noticing complex situations and managing them. The prerequisites are created at the organization level. Managers should ensure adequate resources in the form of trained personnel, equipment and time, team and personnel sustainability and early planning of work. Management of complex situations benefits from high-quality teamwork and non-technical skills (NTS), such as communication, leadership and shared situational awareness.
Adequate resources, stability in team compositions and safe boundaries for practice with shared baselines for reoccurring tasks where all viewed as important prerequisites for managing complex everyday work. When and how NTS are used in a specific clinical context depends on having the right organizational prerequisites and a deep expertise of the relevant clinical processes. Methods like CTA can reveal the tacit competence of experienced staff, guide contextualized training in specific contexts and inform the design of safe perioperative work practices, ensuring adequate capacity for adaptation.
In the last decade, the field of safety research has shifted focus from analysing adverse events and errors to understanding how teams and organizations can perform critical tasks and keep processes operational in the face of variations, disruptions and unplanned events . Resilience engineering focuses on understanding and increasing adaptive capacity, providing insight into how care quality and safety arise from multiple interacting factors . Safety has been described as a dynamic non-event  and as something that is constantly present in professionals’ work processes. Though resilience is not directly observable, it may be possible to identify its emergence in everyday work, where organizations, teams and professionals manage complex situations through anticipating, monitoring, responding and learning [4, 5]. Resilience engineering started as a theoretical model, highlighted with clinical examples, but there are now a number of studies calling for more rigorous qualitative research, linking the concepts of resilience engineering to concrete strategies for everyday practice among teams and managers [6,7,8].
It has been suggested that one important way of doing this is through the study of successful performance in everyday situations where professionals interact with each other, technology and the organization to perform complex tasks – i.e., complex everyday situations . The characteristics of a complex task, in contrast to a simple task, derive from a system where its components have multiple and dynamic interdependencies [10, 11], making it difficult to predict how the system components will interact in response to a given situation . This implies that each system actor’s view is quite limited – and the faster decisions must be made, the more unpredictable consequences of actions are . Official processes and protocols often reflect the work methods intended to meet the demands at the frontline (WAI – work as imagined). Because of the complex nature of the health care system, with continuous variations and interdependence, the work performed – or work as done (WAD) – is never completely aligned with WAI. As a consequence, resilient performance is dependent on the adaptive capacity of frontline staff managing both the gap between WAI and reality and the challenges that emerge when everyday work is done in a complex adaptive system. This capacity relies on adaptations that professionals perform as a part of everyday work [2, 5, 6].
Anaesthesia teams work in the complex and adaptive system of an operating room (OR) , where the intraoperative care process is managed within the anaesthesia team and impacted by the actions of the surgical team . Work during intraoperative anaesthesia has been defined as a combination of clinically and cognitively demanding tasks, paired with high requirements on vigilance and the ability to adjust work based on unexpected developments . Intraoperative anaesthesia work consists of phases with different aims, tasks and intensity, requiring the anaesthesia team’s constant, active presence . Induction was found to be the most intensive phase (73 steps) in the anaesthesiologists’ work process, with errors occurring for example in collecting and preparing medication. Maintenance involved fewer tasks (16 steps), but was prone to errors of a different nature, for example missing relevant information and therefore not acting in time on developments in the patient or procedure status. Solutions for safety management differed between phases. Crosschecks were suggested during induction, whereas systematic checks were recommended during maintenance . In registered nurse anaesthetists’ (RNAs’) intraoperative work, the task frequency, multitasking and interruptions often increased during certain phases, such as anaesthesia induction, preparation for anaesthesia maintenance and extubation. By interpreting multitasking and interruptions as a sign of adaptive capacity, instead of as a threat, they can be explored in regard to how and when resilience emerges .
At the individual and team levels, intraoperative patient safety in anaesthesia is also supported by non-technical skills (NTS), defined as ‘the cognitive, social and personal resource skills that complement technical skills, and contribute to safe and efficient care’ . NTS include elements of situational awareness, decision-making, task management and teamwork , which have been investigated among anaesthesiologists , nurse anaesthetists  and anaesthesia assistants . NTS have been linked to certain aspects of resilience, such as adaptive coordination. It has been identified as a feature of high-performing anaesthesia teams and it has been suggested that adaptive capacity may support management of complex and critical tasks in anaesthesia, such as extubating . When facing nonroutine events or when moving from one phase to the next in the anaesthesia work process, the anaesthesia teams showed an increase in task management and adaptation to changing situational demands [24, 25]. Adaptive coordination requires continually appraising the dynamic environment, identifying and defining points of coordination between team members, and making coordination explicit. Exploration of coordination patterns in relation to tasks has revealed that certain patterns may be more effective than others. In addition, task analysis has made it possible to link drivers for action and adaptive behaviours to specific tasks .
Thus, insight into prerequisites for successful task management, NTS and the importance of adaptive coordination is growing. However, little is known about the underlying organizational and situational circumstances that trigger and support adaptive coordination and we have only begun to explore the effects that variability in adaptation of NTS have on safety [5, 27]. Such knowledge may contribute to a deeper understanding of how to design care systems for safe clinical practice [1, 14, 26].
In our earlier work, the nature of and challenges to task management during anaesthesia were explored. The aim of this study was to explore factors supporting the anaesthesia team in managing complex everyday situations during intraoperative anaesthesia. The research questions were:
How do anaesthesia teams detect and manage complexity during the intraoperative care process?
What cognitive strategies do members of anaesthesia teams use to sustain safety in complex everyday situations?
From the perspective of clinical experts – what circumstances support or disrupt adaptive capacity in anaesthesia teams?
An exploratory research design was applied based on data from individual interviews with anaesthesia nurses and anaesthesiologists. In Finland, anaesthesia care is provided by teams consisting of anaesthesia nurses and anaesthesiologists. Anaesthesia nurses assist anaesthesiologists and have the competence to prepare and maintain anaesthesia and monitor anaesthetized patients . An anaesthesiologist may deliver anaesthesia throughout a procedure or delegate this task to an anaesthesia nurse. However, the anaesthesiologist retains personal and professional responsibility for the anaesthetic procedure at all times, even if an anaesthesia nurse is performing most of the work individually . The participants were purposively recruited to capture the perspectives and experiences of all anaesthesia professionals working in the OR context .
The framework method  was used in the analysis of the qualitative data. The method was chosen as it enables addressing contextual, evaluative and strategic research questions . It is used to identify commonalities and differences in qualitative data and enables drawing descriptive and explanatory inferences clustered around themes. It also enables an approach where a researcher’s interpretations are made transparent through series of interconnected stages . Access to original transcripts and textual data allows others to assess and judge the findings, supporting transparency . A defining feature is the matrix output, which provides a structure into which the researchers can systematically reduce the data. The framework is not aligned with any particular epistemological, philosophical or theoretical approach, nor does it have any allegiance to either deductive or inductive thematic analysis – instead, it incorporates both . During the study, the COVID-19 pandemic prevented close contact between the researchers in this study. The framework method has the additional advantage of supporting collaboration between multi-disciplinary researchers working with large, cross-sectional and descriptive datasets on different sites.
Setting and study participants
Data collection was conducted in January–February 2020 in Finland, at the anaesthesia departments of three hospitals. In order to prevent single-site bias, the participants were recruited from one university hospital and two county hospitals. The anaesthesia departments in question treated patients in multiple specialities, and provided care to both adult and paediatric patients.
Eligible participants were experienced anaesthesiologists and anaesthesia nurses, who were working clinically in the OR context during the study period. Potential participants were identified with the support of department managers, who had knowledge on the availability of the professionals with the longest clinical experience in the department. Two to three weeks before the interviews, participants were sent a letter with information on the study, on participation being voluntary and on practical arrangements, as well as the researcher’s contact information and a consent form . The sample size of 15 interviews – nine with anaesthesia nurses and six with anaesthesiologists – was chosen based on an information power calculation . The adequacy of the sample size was also assessed during the interviews through preliminary analysis of the data, looking for signs of saturation .
Designing interviews with cognitive task analysis
In order to capture the cognitive skills and strategies underlying the management of both everyday and emergent complex situations, interviews were constructed based on cognitive task analysis (CTA). CTA is an extension of traditional task analysis, often resulting in a description of the performance objectives, equipment, conceptual and procedural knowledge and performance standards used by experts when they perform a task. In addition, CTA provides system design information on how to promote safe patient care [37,38,39,40]. Instead of asking experts to recall a critical incident, as in the critical decision method , experts are prompted to reflect on everyday work by observing another expert or to reflect on the scenario of a normal situation.
In this study, the experts were asked to reflect on complex everyday situations visualized through case scenarios. These case scenarios described complex situations in intraoperative work processes and were created specifically for this study, based on data from previous observation studies conducted by members of the research group [14, 16]. Situations with high task frequency, multitasking and interruptions, such as intubation, were included. Gantt charts were created with task categories on the vertical axis and time intervals on the horizontal axis. The resulting charts served as visual representations of two possible scenarios: one expected complex situation (induction, Fig. 1) and one unexpected complex situation during anaesthesia maintenance.
The interview guide, consisting of open-ended questions, was based on previous studies applying CTA [42, 43] (Additional file 1). Pilot interviews were conducted with individuals from both professions, with the aim to adjust the interview guide based on their feedback. The study protocol for the CTA is provided as an Additional file (Additional file 2).
Data were collected by one researcher (KO) through individual scheduled interviews, held in an undisturbed and quiet location at each hospital. At the beginning of each session, the researcher gave a brief presentation of the study, its aim and a declaration of participant confidentiality . The interviews started with a walkthrough of two case scenarios, one illustrating a planned induction and the other an unexpected complex situation during anaesthesia maintenance.
The participants were asked to reflect upon and share experiences from similar situations in their own work. They were then asked to reflect on the cases guided by the questions in the interview guide (Additional file 1, Table 1). Broad descriptions were allowed, in order to capture areas not covered by the original questionnaire. Saturation was reached during the final interviews.
The interviews were audio-recorded and transcribed verbatim. The transcribed data were analysed using the framework method . In this study, the analysis began with an inductive approach, where the researchers familiarized themselves with the transcribed data by reading through them multiple times. During the process of unrestricted coding, conceptual or descriptive labels were assigned to excerpts of raw data. All codes were organized in an Excel sheet, creating a framework method matrix. During abstraction, general descriptions of the research topic were produced through generating subcategories based on the contents of the codes. Each subcategory was named using words characteristic of their contents. Subcategories with similar events and incidents were grouped into categories and categories were grouped into themes (Table 2). The abstraction process was continued as far as it was considered reasonable and/or possible. Any text that could not be indexed within the initial coding scheme was given a new code, meaning that the analysis process included both inductive and deductive elements. The findings are presented as descriptive evidence, reflecting the perceptions of both the professions included .
Once the first interview was conducted, two researchers independently analysed the interview transcript using the framework method . The codes and categories created were compared side by side in the framework method Excel sheet, indicating high similarities between the researchers even though only one of them (KO) had profound context knowledge and the other (CK) had no previous experience from the anaesthesia context or an OR. However, the latter had profound experience of qualitative analysis. The resulting two analytical frameworks were found to be highly similar, reflecting credibility . The final codes were organized into subcategories, which were grouped into categories based on similarities in the included concepts. This was discussed by all researchers involved in the study (KO, CK, KPH). The same applied to the next step, in which themes containing several categories were developed.
In total, 15 professionals participated in the interviews The median length of the interviews was 31 min and 2 s, with an interquartile range (IQR) of 6 min 36 s (Table 3).
Both anaesthesia nurses and anaesthesiologists described team members’ strategies and organizational prerequisites for sustaining safety during complex everyday situations (Table 4, Additional file 3).
Anaesthesia team members’ strategies
Strategies supporting the management of complex everyday situations – both expected and unexpected – varied between different stages of the anaesthesia process. They included preparing, supporting mindful practices, and monitoring and noticing complex situations and managing them.
Planning anaesthesia and providing team members with lists of procedures well in advance, preferably the day before, gave the team the ability to prepare for and anticipate future events. This was considered to be of increasing importance, because patients are older and have more morbidities than in the past.
We often discuss the day before with the anaesthesiologists, how to prepare for the anaesthesia, what is needed. (Anaesthesia nurse 6)
The participants emphasized that preparation of anaesthesia takes time, and that this is crucial, for instance when anticipating and preparing a difficult airway with adequate equipment and medication. Also, if a team member was new, the preparation phase was a good opportunity to get to know his/her mental models in relation to anaesthesia care.
You know how to prepare, maybe with equipment and medications, you know what to take with you … so you don’t have to leave to fetch it, when you should already have started using it. (Anaesthesia nurse 3)
The participants described how the anaesthesiologist, if he/she arrived during anaesthesia maintenance, could be working through mental models in his/her mind before ‘going in’, anticipating what could be waiting. Cues on the status would be available from the anaesthesia nurses’ tone of voice during reports or phone calls, so relevant information from multiple sources needed to be filtered by the anaesthesiologist. One participant described it as follows:
Every time I go into the OR, I’m thinking about the phase of the surgical procedure: What should the patient’s status look like and are we starting or in the middle of maintenance … And what has happened in the surgical procedure … or does it have an effect on the patient’s … the situation at hand. (Anaesthesiologist 5)
Deep understanding of both anaesthesia and surgical processes allowed team members to comprehend the normal rhythm and identify any deviations, so they could anticipate challenges and prioritize tasks if needed. Thus, having performed processes many times made adaptations and preventive risk management easier.
The anaesthesia nurse anticipates so much, it is almost like telepathic with an experienced team member. So when I have looked there (into a patient’s airway during intubation) for a second and a half, he/she already suggests: ‘Should I put pressure on it (the trachea)?’, it’s so seamless … And the tube is exactly where you need it, so that your hand doesn’t have to do this … (waving an arm to the side). (Anaesthesiologist 3)
Supporting mindful practices
The participants highlighted that meetings with the patient should be conducted without either party feeling rushed. Informing the patient about possible sensations during anaesthesia (e.g., local anaesthesia) could help the patient participate in keeping up situational awareness. This was described by one participant in the following way:
Maybe with the patients on local anaesthesia, that they are informed from the start, that we discuss with them, I think that’s the most important thing. We don’t mention the surgical risks, but anaesthesia-related ones, definitely, so that the patient doesn’t have to be surprised about their feelings, so there won’t be a panic reaction … You can see quite quickly what kind of a person the patient is. (Anaesthesia nurse 3)
Keeping noise and music levels low from the beginning of the anaesthesia was mentioned as contributing to keeping focus. Calming things down ahead of intubation or in case of an emergent complex situation was emphasized as an aid in situation management. Phone use was given as an example of an event that could be planned beforehand, especially ahead of critical phases. The importance of allowing anaesthesia nurses to focus when a critical task was at hand was underscored by the participants. In addition, knowing when to interrupt a colleague – whether an anaesthesia nurse, an anaesthesiologist or a member of a surgical team – was mentioned as important, as well as asking students to wait with any questions until a complex situation was over. One participant described the challenge of finding the right time for questions as follows:
It is always a somewhat challenging situation, knowing when to present a question to the operating surgeon, like if they are in a tight spot, I don’t want to disturb them until it’s under control. (Anaesthesiologist 2)
Anaesthesia nurses mentioned the use of memory aids as a facilitating factor to actively retain their focus on any important primary task. In a complex situation, anaesthesia nurses found it essential to be constantly vigilant, so that nothing would be forgotten, for instance by checking and double-checking lookalike/soundalike medication.
You keep your hand on the sevoflurane lid so that you don’t start with something else, until you reach the three percent, and then you close it. (Anaesthesia nurse 6)
Monitoring and noticing complex situations
Anaesthesia nurses described how anaesthesiologists created safe boundaries, inside which they could adaptively ensure stable and effective anaesthesia for the patient.
We have certain limits for vital parameters and my aim is to keep them within those boundaries. Of course, if a patient is bleeding heavily, I may let the blood pressure drop intentionally, but will raise it back to what it was once the bleeding is under control. (Anaesthesia nurse 5)
The participants were of the opinion that an anaesthesia team must be aware that something unexpected may happen at any time. Anaesthesia nurses described how they worked through a mental model, monitoring the patient at all times and considering every observed vital parameter. A patient needs to be monitored continuously, both as regards vitals and as a whole. The participants emphasized that changes in a patient’s vitals, identified through continuous monitoring, might indicate problems.
You have this thought pattern in your mind and you go through it, you check the pulse, blood pressure, saturation, what they look like, end tidal, what is coming out from the patient, and just like that – you go through the pattern, like blood pressure related to the medications the patient has been given, and you check that there has been no bleeding, you question the validity of every finding all the time … That’s partly risk management, keeping yourself under continuous scrutiny. (Anaesthesia nurse 6)
The participants stated that actively observing the behaviour and communication of the surgical team and sensing changes in their mood could aid identification of possible challenges in anaesthesia care, for example during massive blood loss. Being one step ahead was made possible by observing the surgical process and its rhythm and raising awareness based on anything unusual. This required receiving and filtering relevant information from multiple data sources and through various senses (hearing, sight, smell).
It depends on both visuals and audio input, you can hear it … if there is haste on the side of the operation room nurse, circulating nurse or surgeon, what kind of communication there is. And if their movements are very abrupt and quick. (Anaesthesiologist 1)
Managing complex situations
Both professions described the importance of prioritization in complex situations. When encountering a complex situation, anaesthesiologists described active problem-solving through testing alternative solutions without delay. In addition, anaesthesia nurses discussed the importance of knowing what they needed in order to achieve the next step. The professionals’ mood was also mentioned. It was considered bad to hurry. Being focused, efficient and calm aided management.
You must remember to always proceed to the next step, you have to keep trying again and not getting stuck in a situation. (Anaesthesiologist 3)
Anaesthesia nurses described that they preferred to have one anaesthesiologist leading the work in complex situations. Moreover, clear delegation of responsibilities and clear instructions were underlined as important, especially if a team member was new. Being able to ask for multi-professional help was seen as an asset. However, the participants said that only the relevant people were wanted at the anaesthesia team’s side during a complex situation. In very hectic moments, an anaesthesia nurse would prefer to take responsibility for her own tasks, without helpful hands intruding, as described here by one participant:
If it is a very complex situation, I try to coordinate, ‘you can write’ and ‘take care of the blood order’, so that I can take care of the rest on my own, thank you. Don’t mess with my anaesthesia. (Anaesthesia nurse 2)
Both professions emphasized the importance of open, timely and honest communication between anaesthesia professionals and the surgical team. Surgeons could for example provide information in advance about changes that might require anticipatory actions in anaesthesia. Closed-loop communication was preferred, especially if a situation was emergent. In addition, anaesthesia nurses stated that team members should use the same language in all communication during anaesthesia.
Orders from the firing control must be unambiguous and they can never fall short. So you have to repeat them back, it is like a clear protocol – without that, it’s hard to operate. Like, then the situation is enlightened and opens up to others as well. Like, they’re executing that task now, so I can do this at the same time. (Anaesthesia nurse 6)
Both professions described it as good practice to perform a quick debriefing after an emergent situation and its management, including discussing patient status, intravenous lines, positioning, etc. Giving and receiving honest feedback within the team, also after successful operations, was highlighted as crucial by all participants. A quick debriefing after an emergent situation could cover how and why the situation was a success.
After the complex situation, I can quickly walk through the situation with the new anaesthesiologist, and discuss what happened, and document possible identified risks in the patient journal too. (Anaesthesiologist 5)
Organizational prerequisites included adequate levels of resources and competence, in addition to an optimal work environment.
Enabling adequate levels of resources and competence
Both anaesthesia nurses and anaesthesiologists described how an adequate number of personnel was the foundation for safe anaesthesia care. Committed staff members supported the sustainment of high levels of competence. Stable team composition and having the opportunity to focus on limited specialties contributed to cumulation and construction of expertise. In addition, in-depth competence and professional skills created the capacity for development.
The challenge is that not all anaesthesia nurses have the time to focus on paediatric anaesthesia. They circulate all over the unit, they know bits and pieces of everything, but it leads to a situation where no one is actually all that good anymore. (Anaesthesiologist 2)
Anaesthesiologists mentioned the importance of participating in team training such as simulations, to build the individual capacity to react and adapt. The participants underlined that teams should have frequent possibilities of simulation training with all team members. Both professions identified adequate orientation as a prerequisite for forming routines and stated that adequate training ensured competence. Multi-professional training was also pointed out as necessary when using new equipment.
And the way I see it, it requires training, not sitting through a lecture, because that may not lead to a good outcome. But a suitable amount of team training and development, so that you are left with good practical skills. And it is of paramount importance that you participate with your own team. (Anaesthesiologist 5)
The participants underlined the importance of feeling rested and having an adequate level of alertness, which enabled them to deal with interruptions and react swiftly. They said that having a culture that supported wellbeing and success created a positive atmosphere, which in turn supported management of complex situations.
It has happened to me, as well, a couple of times, I have been too tired at the end of a night shift to think properly … so … a couple of times I have been very, very close to making a serious mistake. (Anaesthesiologist 1)
It was highlighted by the participants that performance pressures should be manageable. Having an overly tightly packed schedule was mentioned as causing unwanted and suboptimal multitasking.
Like, we have these gastric bypass operations three in a row, they all have an insane amount of drugs, all of them, more than in any other and all drawn in syringes. So you have to draw the medication for the next anaesthesia during the one you are managing. I mean, I can observe the monitors at the same time, but it feels far from optimal. (Anaesthesia nurse 5)
Ensuring an optimal work environment
Both professions stated that an organization should have standardized protocols. Processes and protocols should be described and documented, because working adaptively was found to be easier when done inside safe boundaries and when clear instructions were given. In addition, a familiar and standardized work environment and placement of equipment and medications was emphasized as facilitating management of complex situations.
We had no room for mistakes in paediatrics. We thought very carefully about what we did, what kind of routines we had, and we did everything in the same way, like a train on rails. Of course there were patient-specific variations every time, but standardization was the foundation we built on. (Anaesthesia nurse 8)
Anaesthesiologists highlighted the importance of suitable and functional electronic patient records for management of complex situations. In addition, it was stated that quality should be the main criterion in procurement procedures for new equipment and appliances – so equipment was reliable and did not fail in a complex situation.
A lot of time and effort is wasted in situations when we have received unsuitable equipment through procurement procedures. Starting with ophthalmologists’ ‘suction coagulators’, in which either suction or coagulation works, and intravenous cannulas which are really difficult to insert. (Anaesthesiologist 5)
As resilience is not directly observable as a phenomenon, the research questions were explored using a combination of scenarios constructed from structured, prospective observations (WAD) and individual interviews using CTA. The participants provided rich examples of strategies used by anaesthesia teams to detect and manage complex everyday situations that required adaptation as well as elucidating organizational factors reflecting and supporting resilience (Fig. 2).
To ensure being prepared for both unexpected and expected complex situations, the participants described how anticipation and planning began already during the days before surgery, when procedures and team compositions were decided. Mental models were mentioned as a strategy for preparing for patient care both ahead of future anaesthesia and when taking over a patient intraoperatively. In a previous study, RNAs also described the importance of planning for both the expected and the unexpected, using mental models and sharing a plan between RNAs and the anaesthesiologist . Interruptions were often present (4.7/hr) in RNAs’ work during the immediate preparations . During this phase, interruptions related to medication care and external disturbance could be interpreted as adaptations made to ensure safe care while sharing mental models with the rest of the team. Ideally, there should be time set aside for the anaesthesia team to plan ahead the requirements for safe care. Such moments are included in the WHO surgical safety checklist, but research has shown variability in the way the checklist is used . The checklist provides the time necessary for sharing mental models and anticipating, which therefore should be part of the standard procedure in all operating rooms .
Supporting mindful practice was mentioned as an important strategy. At the beginning of the anaesthesia, healthcare staff could include patients in sustaining safety by informing them about the intraoperative anaesthetic care process. The importance of interaction between the patient and anaesthesia personnel was highlighted, as the situation could be very stressful to the patient, but also because the patient was seen as a team member who might detect a need for adaptation. Though communication was directed at the patient, it enabled staff to share the progress of the induction with each other . Creating a peaceful atmosphere for induction was crucial in order to create cognitive space for management of any unexpected changes. However, as the preparations for induction and induction were the most task-intensive phases of anaesthesia, with multitasking and interruptions, balancing task management (e.g., medication care) and patient wellbeing in this very short timeframe was described as especially demanding. Active management of interruptions and avoiding unnecessary multitasking through planning phone use, keeping noise levels low, planning when to interrupt a colleague and asking for calm to concentrate were strategies mentioned in the interviews in regard to such situations. These strategies and tools for management of complex or safety–critical phases have been described in previous studies as well [49,50,51,52]. The so-called sterile cockpit rule prohibits unnecessary activities, including interrupting a colleague during a critical phase, such as induction or extubation . Crocket et al. showed how implementation of three interventions (educating personnel on the effects of interruptions, giving the OR’s circulating nurse the responsibility to pause music prior to the arrival of the patient, and having the anaesthesiologist remind the staff in the OR to be quiet during induction) resulted in a decrease in the number of inductions including a distraction from 61 to 10% . This study reinforces our previous findings that interruptions may sometimes represent adaptive capacity, as unexpected variations are an inherent part of any care process, triggering the need for the team to communicate to support preparedness and mindful practice [14, 16]. Thus, interruptions should not be categorically prohibited – but the intention and timing should be considered beforehand, possibly by agreeing within the team on when and how interrupting is ok.
Situational awareness, understanding what is going on around you by gathering information, recognizing and understanding situations or the behaviours of other team members, and anticipating the future are important for task management and teamwork . As regards strategies for establishing and maintaining situational awareness for monitoring and noticing complex situations, the interviews captured many examples. Situational awareness can be distributed, encompassing three levels . At the first level, one has to perceive elements in the environment and detect possible changes in patient care. Here, the interviewees gave many concrete examples of clues from multiple sources, such as patient monitors and the surgical team. Second, the current situation needs to be understood and, third, a projection of the future status must be made. The interviewees described how the actions, communication and mood of the surgical team provided information on possible changes which could require preparation, in addition to information gathered from observing and caring for the patient. Both professions described how certain sounds, sudden silences and smells informed them of a possible escalation of complexity and a need to react, when combined with knowledge on the specific care process phase. The ability to monitor and notice complex situations is important for adaptive capacity, reflecting the findings described in the study by Rönnberg et al., where RNAs described the management of a critical task as requiring being one step ahead, alert and using situational awareness . Anaesthesia teams have a pivotal role in supporting situational awareness within the whole OR team and with other parties connected to the anaesthesia process, adding to adaptive capacity.
When managing complex situations, the anaesthesia team described the importance of open, timely and honest communication within the anaesthesia team as well as with the surgical team. Explicit reasoning in the form of thinking out loud and talking to the room has been shown to support the adaptation of coordination activities to meet the challenges in an emergent situation and is crucial to effective performance . In our previous study, communication with all OR team members, and outside the OR, was identified as the single largest group of tasks in RNAs’ work during intraoperative anaesthesia care .
Clear leadership was emphasized as an important factor in any complex situation. Managing complex situations was experienced as easier when an anaesthesiologist took the lead, and any unnecessary personnel was removed from the OR. According to Larson and Holmström (2013), a sign of an excellent performance in an anaesthesiologist is being humble regarding the complexity of anaesthesia, but at the same time appearing calm and clear in critical situations and being able to present strong leadership if needed . However, the interviewees also discussed that anaesthesia nurses would take charge of the anaesthesia nursing tasks in certain situations and work independently, making adaptations to protect the patient. In their study of leadership, Künzle et al. reported that leadership in anaesthesia tended to be positively correlated with team performance during non-routine and non-standardized situations. However, in routine and highly standardized situations, leadership was negatively correlated with team performance . Thus, the ability to ascertain situations when care processes occur within safe boundaries, and where an anaesthesia nurse’s independent work can support and sustain high-quality teamwork is important. Moreover, the ability to notice changes and work together when a rising level of complexity threatens the boundaries of safe care may promote patient safety and increase the adaptive capacity of the team.
One key element in managing complex situations mentioned by both professions was having profound knowledge and understanding of both anaesthesia and the surgical process. Such knowledge provided the team with a shared baseline for working adaptively when needed and was described as supporting problem-solving in many ways. The connection between a shared baseline and patient safety has also been established through a survey assessing factors related to high-reliability organizational culture . The survey included items such as safety culture, teamwork culture, overall patient safety grade, preoccupation with failure and adherence to shared baselines. Among these items, adherence to shared baselines and preoccupation with failure were identified as key features, both significantly correlated with overall patient safety grade . Shared mental models of the situation allowed anticipating, prioritizing and understanding what was needed for future steps, but also allowed the team to collaboratively test alternative solutions calmly and without delay. Understanding of other team members’ tasks and work processes could be ensured through the basic education of OR team professionals. It could be argued that one should be acquainted with the other professions’ work processes, in addition to one’s own, in order to anticipate and predict the complexity built into everyday team work.
Team members also described how, after each complex situation, a timeout was used to walk through and learn from the management of that situation, giving and receiving feedback and checking the patient’s medications, status and position. This could be interpreted as a form of in situ learning from both critical incidents and successful management of complex and demanding situations, developing mental models ahead of future challenges and thus adding to the adaptive capacity of the team.
Some of the conditions for resilient performance were created well before actual intraoperative anaesthesia by enabling adequate levels of resources and competence and stable teams. In another study on first-line managers in an intensive care environment, the importance of securing both enough staff and expertise for each shift was emphasized . However, sustaining a unit’s resilience capacity every day requires mindful adaptations from the managers, in addition to balancing demands against capacity – two things which can never be completely aligned, due to the complex nature of the system [7, 59]. Unexpected variance and interactions will require adjustments from the frontline professionals, who in addition to following the planned protocols will also adapt to changing circumstances . In the current study, the participants emphasized that managers must be aware that performance and time pressures should not exceed an anaesthesia team’s ability to adapt and work efficiently and with precision.
The importance of standardization of work processes as a way to ensure an optimal work environment and aid management of complex situations was mentioned by both professions. Standard operating procedures provide a core for shared baselines, establishing an important factor supporting safety in high-reliability organizations . However, in a previous study from our group, managers acknowledged the need for balancing implementation and continuous updating of standard operating procedures with giving staff with deep knowledge about the clinical context room for adaptation when something unexpected happened .
The interviewees in this study also gave many examples of how resilient practice needs to be contextualized and that concrete strategies for maintaining safety differ from one clinical situation to another as well as between different phases of the same type of anaesthesia. They highlighted how the possibility to gain experience and practice in a focused speciality, in a relatively stable team composition, promoted deep understanding of both anaesthesia and the surgical process and possible adaptations that could be used to support safe care. As explored in previous research, NTS was said to be fundamental in managing patient safety in anaesthesia [19, 22]. The participants stated that if anaesthesia teams could gain deep understanding of NTS through training together, their ability to adapt to and manage planned and unexpected complex situations would be enhanced. The importance of simulation training to increase coordination and adaptation is supported by previous studies, especially as regards in situ simulation training . The importance of experience and contextualized technical skills and NTS conflicts with the prevailing trend in healthcare to create versatile staff pools, where professionals may be distributed to a variety of units or work posts, depending on the current needs of the department and organization. This reveals an important dilemma and an example of Hollnagel’s efficiency-thoroughness trade-off principle . Managers have to ensure efficiency with an adequate amount of personnel but risk losing thoroughness in the form of deep expertise, intuition and development capacity.
Strengths and limitations
One major strength of this study was that both anaesthesia nurses and anaesthesiologists were generally quite experienced, providing rich descriptions of the phenomenon. Some of those interviewed had worked in the same department for a long time, which may have affected the variability of the data. However, we saw both saturation and variation in the responses. Furthermore, interviews were conducted in three hospitals in separate districts, to gain experiences from multiple safety cultures and organizational traditions. Individual interviews using CTA with real observation-based case scenarios added to the dependability and allowed triangulation. Individual, semi-structured interviews using CTA provided rich and relevant data. The data collection and analysis procedure was systematic – the framework method acted as a functional structure for analysis . To support trustworthiness and confirmability, examples of the process from codes to themes have been presented. Credibility was supported through discussions among researchers throughout the analysis and through use of the framework method, which is suitable when researchers are situated in different locations. Also, original quotes are presented in the text, to illustrate empirically based examples. Data obtained through real-time observations were used to design case scenarios to guide parts of the CTA interviews. The scenarios were based on the findings of a previous study on safety–critical phases of intraoperative anaesthesia care . Although our interview guide did not include questions regarding administration- or management-related issues, participants underlined the importance of system support. In addition, the participants provided conceptual and procedural knowledge and knowledge on performance standards.
During the planning of the study, the researcher listed factors (values, beliefs, knowledge, biases) that could affect method choice, the interview guide, the initial interviews or the data analysis. These factors were presented to and discussed in the research group, adding to the trustworthiness of the study . In addition, a table of data, codes and themes has been provided to promote confirmability [63, 64].
A potential limitation of this study is that the transferability of qualitative results to other contexts is uncertain, as the results reflect the views of only 15 professionals from three different hospitals in one country and are context-dependent. However, as research conducted in other countries has indicated similar work processes and task management in anaesthesia and work contexts in the OR, our results may to some extent aid development in other countries. It could also be argued that the human experiences of responding to unexpected situations are universal. The interviewer had an RNA background, which could be seen as both a strength and a limitation. This was partially counteracted by also having a researcher without a background in anaesthesia conduct analyses of the first interviews, to compare the results in the next step. Interestingly, despite their substantial experience, participants seemed to find it challenging to verbalize the cognitive processes underlying their behaviours during everyday work process/task completion, which they perceived to be routine. This could also explain the relatively short duration of some interviews and might reflect that the strategies used for creating resilience are still very much tacit and not talked about as part of professional education and practice. We tried to address this challenge by providing the participants with visual representations of tasks, in chronological order, for both an expected and an unexpected, complex situation, based on our previous in situ observations. The length of participants’ work experience did not seem to affect interview duration.
Experienced clinicians provided deep insights on what strategies support anaesthesiologists and anaesthesia nurses in managing safety in the continuously changing OR context when prompted by scenarios of complex everyday work. Adequate resources, stability in team compositions, and safe boundaries for practice based on shared baselines for recurring tasks where all viewed as important prerequisites for safe care. Although previous research has shown that management of complex situations in anaesthesia teams benefits from NTS, such as good communication, leadership and shared situational awareness, we argue that when and how to apply these skills in a specific clinical context and situation is dependent on both the right organizational prerequisites and deep expertise of the clinical context and procedure at hand. Methods such as CTA can elucidate the tacit competence of experienced staff and thus guide contextualized training and application of NTS in specific contexts and inform the design of safe perioperative work practices.
Availability of data and materials
Data are available on reasonable request from the author (KO) due to them containing information that could compromise research participant privacy/consent and due to the conditions of the permission given by the Ethical Board of the University of Turku, 1/2012.
Cognitive task analysis
Registered nurse anaesthetist
Work as done
Work as imagined
Staender S. Safety-II and resilience: the way ahead in patient safety in anaesthesiology. Curr Opin Anaesthesiol. 2015;28(6):735–9.
Anderson JE, Ross AJ, Macrae C, Wiig S. Defining adaptive capacity in healthcare: a new framework for researching resilient performance. Appl Ergon. 2020;87:103111. https://doi.org/10.1016/j.apergo.2020.103111.
Sutcliffe KM, Weick KE. Mindful organizing and resilient health care. In: Hollnagel E, Braithwaite J, Wears R, editors. Resilient health care. London: Ashgate; 2013.
Iflaifel M, Lim RH, Ryan K, Crowley C. Resilient Health Care: a systematic review of conceptualisations, study methods and factors that develop resilience. BMC Health Serv Res. 2020;20(1):1–49.
MacKinnon RJ, Slater D, Pukk-Härenstam K, von Thiele SU, Stenfors T. Adaptations to practice and resilience in a paediatric major trauma centre during a mass casualty incident. Br J Anaesth. 2021;2021(128):120–6.
Berg SH, Akerjordet K, Ekstedt M, Aase K. Methodological strategies in resilient health care studies: an integrative review. Saf Sci. 2018;110:300–12. https://doi.org/10.1016/j.ssci.2018.08.025.
Hybinette K, Pukk Härenstam K, Ekstedt M. A first-line management team’s strategies for sustaining resilience in a specialised intensive care unit-a qualitative observational study. BMJ Open. 2021;11(3):1–12.
Hedsköld M, Sachs MA, Rosander T, von Knorring M, Pukk HK. Acting between guidelines and reality- an interview study exploring the strategies of first line managers in patient safety work. BMC Health Serv Res. 2021;21(1):1–10.
Lyng HB, Macrae C, Guise V, Haraldseid-Driftland C, Fagerdal B, Schibevaag L, et al. Capacities for resilience in healthcare; a qualitative study across different healthcare contexts. BMC Health Serv Res. 2022;22(1):1–14. https://doi.org/10.1186/s12913-022-07887-6.
Kannampallil TG, Schauer GF, Cohen T, Patel VL. Considering complexity in healthcare systems. J Biomed Inform. 2011;44(6):943–7. https://doi.org/10.1016/j.jbi.2011.06.006.
Kuziemsky C. Decision-making in healthcare as a complex adaptive system. Healthc Manag Forum. 2016;29(1):4–7.
Braithwaite J, Clay-Williams R, Nugus P, Plum J. Health care as a complex adaptive system. In: Hollnagel E, Braithwaite J, Wears R, editors. Resilient health care. London: Ashgate Publishing Limited; 2013.
Plsek PE, Greenhalgh T. The challenge of complexity in health care. Br Med J. 2001;323(7313):625–8.
Göras C, Olin K, Unbeck M, Pukk-Härenstam K, Ehrenberg A, Tessma MK, et al. Tasks, multitasking and interruptions among the surgical team in an operating room: a prospective observational study. BMJ Open. 2019;9(5):1–12.
Vakkuri A, Niskanen M, Meretoja OA, Alahuhta S. Allocation of tasks between anesthesiologists and anesthesia nurses in Finland. Acta Anaesthesiol Scand. 2006;50(6):659–63.
Olin K, Göras C, Nilsson U, Unbeck M, Ehrenberg A, Pukk- K, et al. Mapping registered nurse anaesthetists’ intraoperative work: tasks, multitasking, interruptions and their causes, and interactions: a prospective observational study. BMJ Open. 2022;12(1):1–12. https://doi.org/10.1136/bmjopen-2021-052283.
Phipps D, Meakin GH, Beatty PCW, Nsoedo C, Parker D. Human factors in anaesthetic practice: insights from a task analysis. Br J Anaesth. 2008;100(3):333–43.
Flin R, O’Connor P, Crichton M. Safety at the Sharp End: A Guide to NonTechnical Skills. Aldershot: Ashgate Publishing Ltd; 2008.
Flin R, Maran N. Basic concepts for crew resource management and non-technical skills. Best Pract Res Clin Anaesthesiol. 2015;29(1):27–39. https://doi.org/10.1016/j.bpa.2015.02.002.
Boet S, Larrigan S, Martin L, Liu H, Sullivan KJ, Etherington N. Measuring non-technical skills of anaesthesiologists in the operating room: a systematic review of assessment tools and their measurement properties. Br J Anaesth. 2018;121(6):1218–26. https://doi.org/10.1016/j.bja.2018.07.028.
Lyk-Jensen HT, Jepsen RMHG, Spanager L, Dieckmann P, Østergaard D. Assessing nurse anaesthetists’ non-technical skills in the operating room. Acta Anaesthesiol Scand. 2014;58(7):794–801.
Rutherford JS, Flin R, Mitchell L. Non-technical skills of anaesthetic assistants in the perioperative period: a literature review. Br J Anaesth. 2012;109(1):27–31. https://doi.org/10.1093/bja/aes125.
Rönnberg L, Nilsson U, Hellzén O, Melin-Johansson C. The art is to extubate, not to intubate—Swedish registered nurse anesthetists’ experiences of the process of extubation after general anesthesia. J Perianesthesia Nurs. 2019;34(4):789–800.
Burtscher MJ, Wacker J, Grote G, Manser T. Managing nonroutine events in anesthesia: the role of adaptive coordination. Hum Factors. 2010;52(2):282–94.
Bogdanovic J, Perry J, Guggenheim M, Manser T. Adaptive coordination in surgical teams: an interview study quality, performance, safety and outcomes. BMC Health Serv Res. 2015;15(1):1–12.
Henrickson Parker S, Schmutz JB, Manser T. Training needs for adaptive coordination: utilizing task analysis to identify coordination requirements in three different clinical settings. Gr Organ Manag. 2018;43(3):504–27. https://doi.org/10.1177/1059601118768022.
MacKinnon RJ, Pukk-Härenstam K, Kennedy C, Hollnagel E, Slater D. A novel approach to explore Safety-I and Safety-II perspectives in in situ simulations—the structured what if functional resonance analysis methodology. Adv Simul. 2021;6(1):1–13.
Jeon Y, Lahtinen P, Meretoja R, Leino-Kilpi H. Anaesthesia nursing education in the nordic countries: Literature review. Nurse Educ Today. 2015;35(5):680–8. https://doi.org/10.1016/j.nedt.2015.01.015.
Patton M. Qualitative research and evaluation methods. 3d ed. Thousand Oaks: Sage; 2002.
Gale N, Heath G, Cameron E, Rashid S, Redwood S. Using the framework method for the analysis of qualitative data in multi-disciplinary health research. BMC Med Res Methodol. 2013;13:1–8.
Parkinson S, Eatough V, Holmes J, Stapley E, Midgley N. Framework analysis: a worked example of a study exploring young people’s experiences of depression. Qual Res Psychol. 2016;13(2):109–29. https://doi.org/10.1080/14780887.2015.1119228.
Smith J, Firth J. Qualitative data analysis: application of the framework approach. Nurse Res. 2011;18(2):52–62.
Srivastava A, Thomson SB. Framework analysis: research note. J Adm Gov. 2009;4(2):72–9.
World Medical Association. Declaration of Helsinki, ethical principles for scientific requirements and research protocols. Bull World Health Organ. 2013;79(4):373 Available from: https://www.wma.net/policies-post/wma-declaration-of-helsinki-ethical-principles-for-medical-research-involving-human-subjects/.
Malterud K, Siersma VD, Guassora AD. Sample size in qualitative interview studies: guided by information power. Qual Health Res. 2016;26(13):1753–60.
Morse JM. Determining sample size. Qual Health Res. 2000;10(1):3–5.
Chipman SF, Schraagen JM, Shalin V. Intoduction to cognitice task analysis. In: Chipman SF, Schraagen JM, Shalin V, editors. Cognitive Task Analysis. New York: Psychology Press; 2008. p. 3–23.
Crandall B, Kelin G, Hoffman R. Working minds. A practitioners guide to cognitive task analysis. London: The MIT press; 2006.
Russ AL, Militello LG, Glassman PA, Arthur KJ, Zillich AJ, Weiner M. Adapting cognitive task analysis to investigate clinical decision making and medication safety incidents. J Patient Saf. 2019;15(3):191–7.
Craig C, Klein MI, Griswold J, Gaitonde K, McGill T, Halldorsson A. Using cognitive task analysis to identify critical decisions in the laparoscopic environment. Hum Factors. 2012;54(6):1025–39.
Hoffman RR, Crandall B, Shadbolt N. Use of the critical decision method to elicit expert knowledge: a case study in the methodology of cognitive task analysis. Hum Factors. 1998;40(2):254–76.
Gore J, Banks AP, McDowall A. Developing cognitive task analysis and the importance of socio-cognitive competence/insight for professional practice. Cogn Technol Work. 2018;20(4):555–63. https://doi.org/10.1007/s10111-018-0502-2.
Roth EM, Malsch N, Multer J. Understanding how train dispatchers manage and control trains: results of a cognitive task analysis. 2001. Available from: www.fra.dot.gov.
Vetenskapsrådet. Forskningsetiska principer. 2002:1–17. Available from: http://www.codex.vr.se/texts/HSFR.pdf.
Göras C, Nilsson U, Ekstedt M, Unbeck M, Ehrenberg A. Managing complexity in the operating room: a group interview study. BMC Health Serv Res. 2020;20(1):1–12.
Jammer I, Ahmad T, Aldecoa C, Koulenti D, Goranović T, Grigoras I, et al. Point prevalence of surgical checklist use in Europe: relationship with hospital mortality. Br J Anaesth. 2015;114(5):801–7.
Weiser TG, Haynes AB. Ten years of the surgical safety checklist. Br J Surg. 2018;105(8):927–9.
Smith AF, Pope C, Goodwin D, Mort M. Communication between anesthesiologists, patients and the anesthesia team: a descriptive study of induction and emergence. Can J Anesth. 2005;52(9):915–20.
Crockett CJ, Donahue BS, Vandivier DC. Distraction-free induction zone. Anesth Analg. 2018;129(3):1.
Jenkins A, Wilkinson JV, Akeroyd MA, Broom MA. Distractions during critical phases of anaesthesia for caesarean section: an observational study. Anaesthesia. 2015;70(5):543–8.
Broom MA, Capek AL, Carachi P, Akeroyd MA, Hilditch G. Critical phase distractions in anaesthesia and the sterile cockpit concept. Anaesthesia. 2011;66(3):175–9.
Campbell G, Arfanis K, Smith AF. Distraction and interruption in anaesthetic practice. Br J Anaesth. 2012;109(5):707–15.
Rutherford JS, Flin R, Mitchell L. “They seem to be able to read your mind.” An interview study to identify the cognitive non-technical skills of anaesthetic assistants. J Perioper Pract. 2015;25(9):155–9.
Fioratou E, Flin R, Glavin R, Patey R. Beyond monitoring: distributed situation awareness in anaesthesia. Br J Anaesth. 2010;105(1):83–90.
Burtscher MJ, Manser T, Kolbe M, Grote G, Grande B, Spahn DR, et al. Adaptation in anaesthesia team coordination in response to a simulated critical event and its relationship to clinical performance. Br J Anaesth. 2011;106(6):801–6.
Larsson J, Holmström IK. How excellent anaesthetists perform in the operating theatre: a qualitative study on non-technical skills. Br J Anaesth. 2013;110(1):115–21.
Künzle B, Zala-Mezö E, Kolbe M, Wacker J, Grote G. Substitutes for leadership in anaesthesia teams and their impact on leadership effectiveness. Eur J Work Organ Psychol. 2010;19(5):505–31.
Etchegaray JM, Thomas EJ, Profit J. Preoccupation with failure and adherence to shared baselines: measuring high-reliability organizational culture. J Patient Saf Risk Manag. 2019;24(4):147–52.
Anderson JE, Ross AJ, Back J, Duncan M, Snell P, Walsh K, et al. Implementing resilience engineering for healthcare quality improvement using the CARE model: a feasibility study protocol. Pilot Feasibility Stud. 2016;2(1):1–9. https://doi.org/10.1186/s40814-016-0103-x.
Iflaifel M, Lim RH, Ryan K, Crowley C. Resilient Health Care: a systematic review of conceptualisations, study methods and factors that develop resilience. BMC Health Serv Res. 2020;20(1):1–21.
Hollnagel E. The ETTO Principle: Efficiency-Thoroughness Trade-Off. Why things that go right sometimes go wrong. Farnham: Ashgate Publishing Limited; 2009. p. 162.
Lincoln Y, Guba E. Naturalistic Inquiry. Beverly Hills: SAGE Publications; 1985.
Berger R. Now I see it, now I don’t: researcher’s position and reflexivity in qualitative research. Qual Res. 2015;15(2):219–34.
Mays N, Pope C. Qualitative research in health care: assessing quality in qualitative research. Br Med J. 2000;320(7226):50–2.
We want to thank the heads of the participating departments and the anaesthesiologists and anaesthesia nurses for their willingness to participate in this study. We also want to express our gratitude to Magna Andreen Sachs (MD, PhD, Senior Researcher / Medical Management Centre, Karolinska Institutet) for valuable comments during planning of the study design and during writing process of the manuscript.
Open access funding provided by Karolinska Institute. This work was funded through Finnish state funding for university-level health research. The funder has neither been involved in any part of the study, nor in writing the manuscript or making the decision to submit the manuscript for publication.
Ethics approval and consent to participate
The study was conducted in accordance with the Declaration of Helsinki. Ethical approval was obtained by Ethical Board of the University of Turku 1/2012. All participants gave written informed consent.
Consent for publication
The authors report no conflicts of interest. The authors alone are responsible for the content and the writing of this paper.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Olin, K., Klinga, C., Ekstedt, M. et al. Exploring everyday work as a dynamic non-event and adaptations to manage safety in intraoperative anaesthesia care: an interview study. BMC Health Serv Res 23, 651 (2023). https://doi.org/10.1186/s12913-023-09674-3