Skip to main content

External inspection approaches and involvement of stakeholders’ views in inspection following serious incidents - a qualitative mixed methods study from the perspectives of regulatory inspectors

Abstract

Objective

The objective was to gain knowledge about how external inspections following serious incidents are played out in a Norwegian hospital context from the perspective of the inspectors, and whether stakeholders’ views are involved in the inspection.

Methods

Based on a qualitative mixed methods design, 10 government bureaucrats and inspectors situated at the National Board of Health Supervision and three County Governors in Norway, were strategically recruited, and individual semi-structured interviews were conducted. Key official government documents were selected, collected, and thematically analyzed along with the interview data.

Results

Our findings overall demonstrate two overarching themes: Theme (1) Perspectives on different external inspection approaches of responding and involving stakeholders in external inspection following serious incidents, Theme (2) Inspectors’ internal work practices versus external expectations. Documents and all participants reported a development towards new approaches in external inspection, with more policies and regulatory attention to sensible involvement of stakeholders. Involvement and interaction with patients and informal caregivers could potentially inform the case complexity and the inspector’s decision-making process. However, stakeholder involvement was sometimes complex and challenging due to e.g., difficult communication and interaction with patients and/or informal caregivers, due to resource demands and/or the inspector’s lack of experience and/or relevant competence, different perceptions of the principle of sound professional practice, quality, and safety. The inspectors considered balancing the formal objectives and expectations, with the expectations of the public and different stakeholders (i.e. hospitals, patients and/or informal caregivers) a challenging part of their job. This balance was seen as an important part of the continuous development of ensuring public trust and legitimacy in external inspection processes.

Conclusions and implications

Our study suggests that the regulatory system of external inspection and its available approaches of responding to a serious incident in the Norwegian setting is currently not designed to accommodate the complexity of needs from stakeholders at the levels of hospital organizations, patients, and informal caregivers altogether. Further studies should direct attention to how the wider system of accountability structures may support the internal work practices in the regulatory system, to better algin its formal objectives with expectations of the public.

Peer Review reports

Introduction

Norway has a universal public healthcare system entailing different accountability structures as key strategies to ensuring and improving quality and safety [1]. External inspection is one of these accountability structures. Along with accreditation, external inspection is an internationally wide-spread external evaluation method used to assess the quality of care given to patients [2, 3]. The aim is to ensure that healthcare providers adequately implement, maintain, and improve quality and safety [2, 3]. In a broader sense, external inspection contributes to enhancing healthcare providers’ processes of risk management [4]. Previous research has explored how regulatory inspectors approach healthcare organizations and in what ways external inspection potentially could impact quality improvement [5,6,7,8,9,10,11,12,13]. There is however conflicting evidence about how and if regulatory activities, including external inspection, is designed in ways that factor in the complexity, uncertainty, and variation in healthcare, and whether it is performed with the sufficient knowledge, expertise, and skill set in stakeholder involvement [9, 11, 13,14,15,16,17,18]. In an international context, external evaluation of quality and safety, and national policy strategies, have different organizational structures, including differences in regulatory implementation and enactment processes [2, 4]. The Norwegian system of regulatory, external inspection specifically is a mandatory mechanism designed to control quality and safety systems, implemented by healthcare providers [4]. The system is based on principles of internal control of structure and process, where attention to management responsibilities and system-performance is given over attention to individual performance [4] (please see Table 1). In contrast, the US system of external evaluation rests on voluntary, non-statutory accreditation, individual liability in cases of medical error countered by a system of torts; insurance, with management-oriented evaluation of structure and process by a compliance-based focus [4]. Although each country has its own characteristics, the Norwegian regulatory context featuring of a state regulated and mandatory system design for external evaluation, bears resemblance to other European countries such as the Netherlands [2, 4, 5].

In recent years, the WHO and national governments across the globe seem to have become more interested in the idea of gaining contributions from different stakeholders, to improve quality and safety [3, 19,20,21]. Studies have encouraged a more extensive and structured approach to stakeholder involvement in risk and safety regulation and external inspection, for instance by influencing the regulatory design process [22,23,24,25,26,27,28,29,30] and by collecting the perspectives of patients and families following serious incidents [31, 24, 25, 32,33,34]. A recent review offers indications of an ongoing change of course to involving patients and informal caregivers directly in incident-based inspections, and it suggests that this shift is more evident in external inspection culture and methods than in processes of accreditation [4]. Except from a couple of reports and one study targeting next of kin involvement following regulatory inspection of serious incidents, knowledge is scarce in the Norwegian context about how stakeholder involvement unfolds in regulatory inspection, including what the implications might be [24, 25, 35, 36]. The study presented in this paper is therefore innovative: it reports mixed-methods qualitative findings of regulatory inspectors’ perspectives on their approaches of responding to an incident, and how their work concerning serious incidents involves and is informed by stakeholders. Stakeholder involvement was in this study defined as healthcare related processes or decisions concerning external inspection which may become informed by multiple stakeholders from different system levels such as: hospitals and healthcare professionals, patients, and informal caregivers [37].

The Norwegian System of Regulating Quality and Safety in Healthcare.

The Norwegian Board of Health Supervision (NBHS) and 11 regional County Governors perform system audits (systematically planned inspection), or incident-based inspection to follow up serious incidents reported directly to the NBHS [38, 39]. The legal framework of external inspection is comprehensive, including objectives, requirements and processes found in the act relating to external inspection in the healthcare services [40] and in the act relating to the specialized healthcare services [41]. The Ministry of Health and Care Services (MHCS) provides the NBHS and County Governors with additional regulations, policies, and guidelines for the regulatory activities expected to be carried out by these bodies, including policies for stakeholder involvement. The principle of sound professional practice informs the inspector’s assessment of whether adequate quality and safety in health care has been provided or not [42]. Hospitals and health professionals are required to report serious incidents, and the regulatory framework directs the enforcement of this duty to the managerial level, and not towards individual health professionals [40,41,42]. Please see Table 1 for definitions and key facts about the Norwegian system of regulating quality and safety in healthcare.

Table 1 Definitions and key facts about the Norwegian system of regulating quality and safety in healthcare

Objective and research question

The objective was to gain knowledge about how external inspections following serious incidents are played out in a Norwegian hospital context, from the perspective of the inspectors, and whether stakeholders’ views are involved in the inspection.

The main research question was: how do different inspection approaches facilitate inspectors to involve stakeholders’ views in the inspection following serious incidents?

Methods

Study design and setting

This is a qualitative mixed-methods study [49] combining the perspectives of regulatory, external inspectors at the government level with expectations of stakeholder involvement identified in governmental documents. According to Morse and Niehaus [49, pp. 17–18], a study is considered mixed method if it consists of a core component and a supplemental component, published in the same scientific paper. In our study this is illustrated by combining qualitative methods of interview data (the core component), supplied by documents, altogether published in this present paper. This methodological strategy was chosen as it allowed us to explore different aspects of the same phenomenon played out in a Norwegian hospital context: expectations formed in official governmental documents, and perspectives given by the inspectors.

Participant recruitment & characteristics

10 participants were recruited by strategic sampling and approached by e-mail [50, 51]. The NBHS participants were contacted based on identification done by a well-experienced informant, who provided us with relevant participant names and contact information. Participants at the County Governor level were identified based on requests sent by e-mail to the relevant County Medical Officer or unit manager for the relevant specialized healthcare service. The researchers aimed at participants holding in-depth insights into hospital external inspection of serious incidents. The participants were seven women and three men. Five of them were medical doctors and five lawyers (one being a registered nurse). Two participants were situated at the national level of NBHS whilst eight participants were located at three County Governors.

Data collection

Data was collected by individual interviews and relevant official, governmental documents such as acts, regulations, guidelines, and reports concerning external inspection (see Table 2). The interviews were conducted in person at the workplace of the participant, by researcher SFØ and researcher IJB between March 2022 and June 2022. Interviews lasted approximately 1 h and were conducted in Norwegian. The researchers used a semi-structured interview guide (see supplementary file) covering the topics: the role of regulatory inspectors, methods, self-assessment template, onsite inspection, guidelines and support material for internal work practices, involvement such as interaction and dialogue with hospital organizations, health professionals, patients, informal caregivers, media attention, and areas of possible future development in external inspection. This strategy allowed the researchers to ask relevant follow-up questions. All interviews were recorded and subsequently transcribed by an external consultant. The documents were identified and selected based on researcher SFØ’s pre-existing familiarity with the subject of external inspection [13]. Hand searches were thus required for this part of the data collection. The document referred to as “Guidelines for inspection conducted by the County Governor level- Appendix 2” [52] was however forwarded to the researchers, after the interview was done.

Table 2 Documentary evidence identified, included and analyzed

Analysis

Interview data as the primary data source, and supplementary documents were analyzed by thematic analysis [51]. The inductive approach by the application of thematic analytical principles has a data driven, bottom-up way of analysis [51]. Hence, and as described by Braun & Clarke (51 p. 178), the approach does not require a theoretical framework or ontological or epistemological ideas.

This paper presents the findings from the thematic analysis altogether. The analysis was done inductively using codes as building blocks for overarching themes. Interview transcripts were analyzed by researcher SFØ and researcher IJB in four steps: (1) open reading process of interview transcripts (2) identifying meaning units, key words, and questions for reflection (3) forming and discussing codes, and (4) refining overarching themes. Document analysis data was used to contextualize the interview data and provide explanations for governmental expectations of the inspectors’ methods and approaches of responding to an incident, and to understand the expectations to stakeholder involvement practices in inspection [66]. The process involved thorough reading of all documents, and identification of relevant passages of text related to key words such as onsite inspection, self-assessment, objective/aim, involvement, information [66]. The researchers SFØ and IJB had several meetings discussing and refining patterns of meaning, codes, and themes.

Trustworthiness

As part of the process of ensuring relevance and trustworthiness, the research protocol and interview guide were presented to fellow researchers and members of a panel of different stakeholders situated at various levels of the healthcare system (please see Patient and Public Involvement Statement.

below). The interview transcripts displayed information rich participant responses, covering a wide collection of inspection related topics. Our efforts to ensure trustworthiness throughout the process of analysis and presentation of findings were focused on providing as much methodological context as possible, and by tight analytical collaboration between researcher SFØ and researcher IJB [67].

Patient and public involvement statement

The study presented here is part of a larger research project on stakeholder involvement in external inspection and hospital internal assessment of serious incidents. The main project plan was presented to SHARE– Centre for Resilience in Healthcare’ Stakeholder Panel, in an early phase, and feedback was provided by designated members of the panel. We also involved a highly experienced researcher, who provided valuable insights and feedback to the project plan and interview guide (please see Acknowledgement).

Results

The thematic analysis resulted in two overarching themes. Each overarching theme was accompanied by codes, presented in bullet points for each theme.

Theme 1. perspectives on different external inspection approaches of responding and involving stakeholders in external inspection following serious incidents.

  • Five key approaches of responding, used in incident-based inspection with intention to increase stakeholder involvement.

  • Frequent hospital application of self-assessment templates in inspections.

  • Infrequent on-site inspection in hospital settings.

Theme 2. Inspectors’ Internal Work Practices Versus External Expectations.

  • The formal objectives of external inspection encountering patients’ and informal caregivers’ understanding and perception of quality and safety.

  • Sound professional practice principles encountering patients’ and informal caregivers’ understanding and perception of quality and safety.

  • Governmental delegation of responsibility for incident-based inspection; Resource Demands.

In the following we present interview and document findings altogether by summary of each overarching theme and codes, including participant quotations. In Table 3 below, we provide example citations retrieved from some of the documents for each of the two themes and their belonging codes.

Table 3 Theme 1 and 2, codes, and examples of document citations

Theme 1: Perspectives on different External Inspection Approaches of Responding and Involving Stakeholders in External Inspection following Serious Incidents

Five key approaches of responding, used in incident-based inspection with intention to increase stakeholder involvement

Overall, documents demonstrated that incidents reported through the national reporting system, were subject to a multi-element decision-making process [63]. Findings demonstrated application of five different approaches for responding to an incident, by external inspectors. These were described in the document “Guidelines for inspection conducted by the County Governor level” [52] and supported by the participants. The approaches were related to:

  1. 1.

    Guidance: Termination and guidance offered (the incident reported is not processed any further).

  2. 2.

    Internal handling: The incident reported is forwarded to the hospital for internal handling solely.

  3. 3.

    Self-assessment: The hospital is provided with a template and handles the follow-up of the incident internally by doing a written self-assessment as instructed in the template. The template is returned to the NBHS or the County Governor, which gives feedback to the hospital.

  4. 4.

    Meeting: A meeting is held between the NBHS, and the hospital management team, or between the County Governor, hospital, and the patient, and/or informal caregivers.

  5. 5.

    On-site inspection: The NBHS or the County Governor explores the incident by incident-based inspection, and/or on-site inspection, and makes a final decision about the outcome of the case.

These five approaches may be supplied or combined with for instance collection of statistics, random sampling of patient journals, or the inspection body may encourage the hospital to seek external assistance in its quality improvement work or offer guidance on how to follow up healthcare professionals [63]. Some participants gave accounts of a certain flexibility among the range and combinations of different external inspection approaches, for instance that the inspector could make a phone call to the patient or informal caregiver to clarify or supply case matters with additional information. Few of the participants did however reveal their perspectives related to how they supplied or combined elements from all five inspection approaches available. Participants primarily spoke about the inspection approaches of self-assessment and onsite inspection.

“We have received signals from the Norwegian Directorate of Health that they think it would have been nice if we had continued to work on expanding the toolbox a little, because different types of tools are probably suitable in different contexts. Hence, there is no reason, (…) to only have one method or approach available. It might be a good idea to have a small “bouquet” of different methods that we can use”. NBHS, interview 1.

Participants described how incidents were discussed in what they referred to as a “start-up meeting”, where decisions were made on how to proceed. Documents showed that an incident reported to the NBHS may become terminated and not proceeded further based on three arguments: (1) due to the incident being out of regulatory scope, (2) due to the incident being sufficiently informed and with no deviation suspected, (3) or due to the incident needing more investigation before a final assessment can be reached [52]. Severity of the incident, complexity and potential risk for recurrence should be considered and form the decision on how to proceed further [64].

“(…) when we do the sorting of the incidents reported to us, we decide on how to- or which method to choose to get the most out of it. For example, what is appropriate for us to investigate, and how can we best help the services to improve”. County Governor 1, interview 4.

If the NBHS decides to move forward with the serious incident reported, the NBHS either chooses to conduct onsite inspection or do “other external inspection follow-up”, as described in the Guidelines issued [52, 56]. The latter includes all the other types of methods mentioned among the overall five inspection approaches and can either be applied and performed by the NBHS, or by the County Governors. These approaches are however frequently applied by the County Governors, because the NBHS forwards most of these cases to the County Governors [61, 64]. The choice of follow-up from the County Governor’s part is based on the decision letter issued by the NBHS, which concludes with violation of legislation, and confirms the need to proceed with “other external inspection follow up” [61]. The autonomy is however substantial as the County Governors may “consider which strategies that are most applicable to obtain quality improvement” [65].

All participants reported development towards greater variety of external inspection approaches, and a stronger incentive to involve, inform and apply information from patients and/or informal caregivers. These accounts were reflected in new policy documents developed at the national government level. In its Annual Report, the NBHS states that the leading principle is to retrieve information from patients and informal caregivers, in all types of serious incidents reported. The NBHS considers it particularly important if a case is terminated/not further processed [39].

Since 2014, the NBHS have issued several documents, for instance recommendations for sound stakeholder involvement, the “Patient- and informal caregivers’ perspectives following serious incidents” document as well as established a user panel aiming to ensure that experiences from users, patients and informal caregivers are taken into consideration in activities related to external inspection [35, 53]. Adding to this is the statement issued by the NBHS, emphasizing its expectations towards the services: to ensure follow-up routines and processes of involving patients and informal caregivers, a “highly prioritized task” [58].

Our participants reported that communication and interaction with patients and/or informal caregivers could contribute positively to revealing the complexity of the incident as well as informing the decision-making processes of the inspectors. However, and despite policies and guidelines pointing to the importance of stakeholder involvement, participants pointed that communication and interaction with patients and/or informal caregivers could be a challenging part of their job. This was described as due to several elements, such as time management and resources, lack of experience and/or relevant competence among the inspectors, the patient and/or informal caregiver not wanting to be part of the inspection process, disagreement between inspectors and the hospitals and patient/informal caregivers. These aspects could intensify the conflict between the different stakeholders, some participants argued.

Frequent hospital application of self-assessment templates in inspection and infrequent on-site inspections in hospital settings

Participants described hospital self-assessment as the inspection approach they selected and applied most frequently. Benefits were described to be increased sense of ownership and responsibility at the hospital organizations.

“The fact that we have tried to work more along the lines of asking what the hospital internally investigates the incidents, and we have started to test the method of self-assessment where the idea is that the inspectors their process. We get a lot of positive feedback from that, simply because it increases ownership and responsibility within the hospital organization”. NBHS, interview 1.

As demonstrated in the “Guidelines for inspection conducted by the County Governor level” document, the self-assessment report was seen as beneficial to the adversarial principle because the report may be forwarded to the patient or informal caregiver for comments and feedback [52, 56]. According to the NBHS, this process could in turn encourage the hospitals to set up a dialogue with the informal caregivers [65].

“Regarding self-assessment, we think that it’s a document we can return (based on the adversarial principle) to obtain the views of informal caregivers. However, it is even better- we do have examples of it- the hospitals initiate dialogue and get their aspects included into the self-assessment”. County Governor 2 interview 7.

Based on our data, it was however not possible to confirm if the self-assessment template included standardized question(s) about involving the patient and/or informal caregivers. The general impression from the documentary evidence and interviews was nevertheless that the template often asked for information about how informal caregivers and the affected health professionals were taken care of in the aftermath of the serious incident [52, 56, 61, 65].

“We often get the cases we select for the approach of self-assessment in return from the hospital because the patient or the informal caregivers inform us that they already have attended meetings at the hospital, and they do not trust the hospital. Then we will have to request a “full-scale version” of inspection (….) which is a dilemma”. County Governor 2, interview 8.

Despite the overall findings indicating positive and valuable aspects of applying self-assessment as a means of involving hospitals more thoroughly in the external inspection processes and internal improvement process, some of the participants mentioned drawbacks with the approach. They pointed out that self-assessment primarily facilitated written communication between the regulatory inspectors and the hospital. This approach could potentially conceal important issues or internal aspects, participants argued.

Onsite inspections were described by our participants as less frequently used compared to other approaches. Some participants however pointed out that having a close dialogue with the hospital was more important than the sole use of onsite inspection. Some emphasized that they wished they used onsite inspection more frequently despite the approach being demanding resource wise. According to the Act relating to external inspection for instance, the NBHS should conduct an onsite inspection following a report of a serious incident, “as soon as possible” [40]. The requirement is however reserved for serious incidents where onsite inspection is necessary to get the case “sufficiently disclosed” [40]. Documents showed that if an onsite inspection is to be carried out, the NBHS offers the patient or the informal caregiver(s) a conversation, where their experiences, observations and reflections are seen as important sources of information [55]. During an onsite inspection, the patient or informal caregiver has the right to- and gets forwarded copies of relevant case related documents [5]. Suspicion of poor treatment of the patient or the informal caregivers following a serious incident, was considered one of the key arguments in the NBHS’s decision to do an onsite inspection [55]. Documents however also displayed that the County Governor may choose to do onsite inspection as part of its following up process, to reveal whether the hospital has implemented sufficient changes and/or achieved improvement [65].

“If a serious incident is reported, I would argue that onsite inspection is a much swifter method to disclose what happened. And- if it is a very serious incident where the risk is still ongoing, I believe (onsite inspection) is the best method. It requires enough resources– it is a matter of capacity…it requires a lot of (resource) capacities for as long as the onsite inspection lasts (…)”. County Governor 2, interview 6.

Overall, the external inspection approaches demonstrated in our findings, displayed different ways of involving stakeholders, at varying system levels. Onsite inspection was shown in formal documents to have incentives for involvement of patients and informal caregivers, related to their right to be notified prior, during and after the inspection. The option of providing the patient and/or informal caregivers with the draft of the report, and their right to comment on findings, as well as the option of getting access to the proceedings, indicate how perspectives from patients and/or informal caregivers are considered valuable to external inspection of serious incidents [39]. Participants reported that the recent introduction of self-assessment as an inspection approach signaled stronger emphasis on involvement and served as motivation for the hospitals to contribute during the inspection process. It was also described to play an important part of the internal improvement processes in the hospitals undergoing inspection.

Theme 2: Inspectors’ Internal Work Practices versus External Expectations

Formal objectives of external inspection and sound professional practice principles encountering patients’ and informal caregivers’ understanding and perception of quality and safety

Documents showed that the primary objective with external inspection is to enhance patient safety and promote improvements and learning [40]. Participants however expressed some doubt about how their work really contributed to safer and higher quality of care. Corroborated by both participants and documents, findings showed that external inspection is based on a joint medical and legal assessment of sound professional practice [40, 41]. Thus, the inspectors’ work practices were in general lead by the principle of sound professional practice and the considerations about whether adequate care was given patients in the incidents reported. The formal objectives of external inspection were however described to be encountered by the patients’ and informal caregivers’ understanding and perception of the principle of sound professional practice. Some of the inspectors argued that patients and informal caregivers sometimes had different views on what the incident was caused by and interpreted the principle of sound professional practice and considered adequate care differently than the inspectors’ medical-legal assessment did. The process of balancing medical aspects with a legal assessment was described as a team-effort, with a mix of different competencies within a team of inspectors. Thus, most participants considered their internal work practices to be part of a trade-off between different perspectives of quality and adequate care. The objectives of external inspection work were subject to continuous development, they argued.

“The outcome of the case, or the seriousness of the incident, does not necessarily mean that there have been deviations or that it was not in line with sound professional practice. They (patient; informal caregivers) do not understand that- it is difficult to explain it (to them)”. County Governor 1, interview 3.

Documentary findings showed how the government suggested inspectors to triangulate different sources of knowledge from patients, informal caregivers, healthcare professionals and managers because triangulation may provide a more complete picture of what happened [53]. In turn, it may provide the inspectors with solid ground for their subsequent assessment concerning sound professional practice and adequate health care [53]. Participants in this study however described it to be a challenging part of their work, balancing the formal objectives with the emotional experience and trust of the patient and/or informal caregivers. Participants described how external expectations formed in government policies and regulations contrasted with the expectations from the public in general, and from patients and informal caregivers specifically. This gap was described as somewhat contradictory, with the strong set of patient and informal caregivers’ rights on one hand and external inspection resources available on the other. Participants saw this gap as a fundamental conflict in the current external inspection system. Another part of this gap was described as the governmental expectation of applying a system-perspective to external inspection of serious incidents, and the perspectives of individual-oriented proceedings of incidents reported where patients and/or informal caregivers sporadically sought to blame individual healthcare professionals. Expectations of accountability and responsibility from the perspectives of the patient and/or his or her informal caregivers, were thus sometimes perceived differently than what the formal joint medical, legal assessment allowed regulatory inspectors to determine.

“I have had quite a few conversations with people, for instance one prior to the weekend, where I spoke to a patient who had complained several times about the same situation, but he got really annoyed because he thought it was strange that we had not concluded that his case was a regulatory violation. Somehow, he did not understand how we could call it sound professional practice because he had contracted cancer several years ago of which the hospital had given him the wrong diagnosis, they had not called it cancer, but it turned out later that it was cancer. He still does not understand how we can call it sound professional practice”. County Governor 1, interview 4.

The response letter from the NBHS to the Consultative Committee responsible for assessing the incident reporting regime in Norway argued that many patients and informal caregivers were disappointed if their case was terminated and not followed through [57]. Participants expressed frustration about these issues and reported that the different perceptions of what external inspection could contribute to in terms of enhancing quality and safety, challenged their internal work practices. It moreover held to account the public trust issue described. The participants explained how public perception of sound professional practice, shaped for instance by media attention, could exceed both the formal objective of external inspection as system-level quality improvement and learning, as well as sound professional practice principles. Interaction and communication between inspectors, hospitals and health professionals and patients and informal caregivers became extra challenging in those types of cases, participants argued.

Governmental delegation of responsibility for incident-based inspection; resource demands

According to the Annual Reports by the NBHS, the County Governors have in recent years been provided with policies and guidelines of more autonomy and responsibility to decide and prioritize inspection (with regards to risk and relevance) [39, 45]. The annual reports confirm that if an incident is delegated to the County Governor in an early phase of the proceedings, the NBHS leaves all encounters and contact with the patient and/or the informal caregivers to the County Governor [39, 45]. Our participants however, indicated challenging issues with governmental delegation of responsibility for incident-based inspection. The inspectors at the County Governor level believed that the NBHS more often delegated cases of serious incidents to them now, than previously. Due to available internal resources and an overall bigger case-volume being reported, this was portrayed as a challenge. An overall increase in case volume for both the NBHS and the County Governors was raised as an issue that effected the internal capacity in the government bodies [45]. Document data from the NBHS moreover showed that of 763 serious incidents reported from the specialized healthcare services, 576 of the incidents were delegated to the County Governors [39]. 132 incidents reported were terminated and not processed further, six on-site inspections were conducted, 20 incidents were pursued as “other external inspection follow-up” and 29 of the incidents reported were out of scope [39]. These numbers indicate that a substantial part of the serious incidents reported become delegated to the County Governors for further follow up and decision-making. This aligns with the perspectives of our participants. Considering the issue of governmental delegation of responsibility for incident-based inspection, the inspectors stressed the efficient use of resources as an important future interest.

“(…) Due to the fact that the number of incident reports has increased, there is actually a very large part of the resources that go into the initial handling of the reports (….) One outcome may be that the report is forwarded to the County Governor for assessment. It is not like we are instructing them on what to with the case, (…) they consider how to handle it further. However, the delegation process is a bit demanding between us and the County Governors”. NBHS, interview 1.

In their annual report, the NBHS acknowledged that the internal work practices at the County Governor level needed coordination and development, to make the use of existing resources “optimal” [39]. Our participants on the other hand, indicated fundamental issues with how external stakeholders perceived and confused the different government bodies involved in external inspection. Some pointed to a potential need to actively clarify the responsibilities and collaboration between the NBHS and the Country Governors, to the healthcare services. This could contribute to an increased understanding of the roles and objectives, some participants argued. Moreover, they emphasized how external inspection in the future should focus more on specific topics of quality and safety and specific regulatees, and not add to the workload of the healthcare services. This could potentially contribute to more relevant and constructive external inspection and increase the legitimacy of the system.

“I think that we sort the cases more diligently than the NBHS expected us to do, because looking into every case is not possible, and we need to be strict in setting our priorities. (…) Even when we are strict, we have a very long case processing time”. County Governor 1, interview 1.

Discussion

Principal findings

We have explored different approaches of external inspection related to stakeholder involvement in regulatory follow up of serious incidents- as seen from the perspectives of 10 inspectors, supported by document analysis. Principal findings indicated that new approaches of responding have developed and applied to the inspectors’ repertoire of internal work practices. Self-assessment and onsite inspection were found to be most frequently discussed and applied, where the reliance on hospital self-assessment was reported to having benefits but also potential downsides. Reports were given of a development towards more policy and regulatory attention to and sensible involvement of stakeholders such as hospitals, patients and/or informal caregivers. Some of these approaches were perceived to have a stronger incentive for involving hospital organizations, patients and/or informal caregivers than others. Participants agreed that although involvement could entail challenging interaction with stakeholders, it could contribute to positively informing the case complexity and the inspectors’ decision-making processes. The complexity of balancing all perspectives, from patients, informal caregivers, the public in general, health professionals and hospitals, including the high emotional component and the possibility of patient/families being dissatisfied with the inspection approaches and processes, were considered a challenging part of the work led by the inspectors. The increase in incidents reported raises questions about how to resource this work moving forward. Acknowledging the different perceptions of external inspection and clarifying the responsibilities, collaboration, and resources between the NBHS and the Country Governor, were reported key to the development of future external inspection.

Developing the scope of external inspection and clarifying public expectations

Research has shown that perspectives from patients and informal caregivers, have increasingly become a “key principle” in external evaluation of the healthcare services [4, 32, 33, 68]. However, recent research findings indicate that there is a difference in stakeholder involvement depending on the type of external evaluation system. In accreditation systems, patients and informal caregivers may be less involved compared to inspection designed systems [4]. Knowledge about how different system designs promote stakeholder involvement following serious incidents, is still missing. These indications were corroborated by our findings showing reports of extensive government attention to stakeholder views and the approaches applied by the inspectors. Adding to this is the increasing emphasis on management and the internal work processes of managers in healthcare organizations, set to improve quality and safety, which in turn may have implications for external inspection [69,70,71,72]. For instance, in the Norwegian setting, internal incentives to work systematically on all organizational levels to improve quality and safety became stronger as a result from the introduction of the Quality Improvement Regulation. It also paved way for a stronger system perspective to regulatory inspectors’ assessment of the services [40, 46, 73]. This increase in attention to performance overall is partly justified by previous international findings demonstrating scarce impact on quality and safety from external inspection of compliance with standards [5, 6]. The attention also reflects a broader development in regulatory culture in general, where implementing “self-regulatory approaches” is considered part of the solution in ensuring relevance and ownership [73]. Thus, external inspection aiming at ensuring a certain level of performance may be assumed to have greater relevance and realism to the healthcare organizations’ internal improvement processes [4, 74, 75]. Depending on the way external inspections are conducted and if and how they engage and involve staff, have been demonstrated in the literature to be critical to how the findings from external inspection are perceived and followed up internally in the hospitals [9].

Mirrored by regulatory theory, the success of regulation depends on the responsiveness of the regulators to the regulatees [76,77,78,79]. Responsive regulation as a dynamic theoretical construct, considers persuasion of the regulatees and/or internal capacity building the primary option for regulators- before more punitive actions are tried [78, 79]. The public perception of the model as being fair and legitimate is however a key precondition for the model to work as intended [78, 79]. The findings in our study displayed variation in the inspectors’ responsiveness, depending on the case complexity, severity of the case and availability of internal resources. Different inspection approaches were applied, with different level of encouragement to stakeholder involvement. The most frequently applied approach was self-assessment, whilst onsite inspections were infrequent. The two approaches illustrate the two “extremes” of available external inspection approaches. On one hand, self-assessment is conducted and led by the hospital itself and to that extent it represents a way of ensuring direct stakeholder involvement from the regulatee undergoing inspection (i.e., the hospital). Onsite inspection on the other hand is an approach where the external inspection bodies oversee the process, a “full-scale version” of external inspection, where the regulatee undergoing inspection is approached from the “outside”. It seems crucial, based on the findings, that information and communication flows both ways, between internal and external stakeholders, regardless of the approach(es) of response chosen by the regulatory inspection body. The adversarial principle, meaning that a party should be allowed to comment on any submission from its opponent, is part of why responsiveness and tight communication should be considered valuable [80]. Studies in the past [9,10,11, 81, 82] seem to not have directly touched upon this argument, but our study implicates more awareness to this specific liberal democratic right held by the patients and the informal caregivers. An increase in the sensitivity of the inspectors towards the adversarial principle would perhaps also underpin what some of our participants emphasized: that the formal objective of external inspection did not always meet the level of accountability and responsibility claimed from the perspectives of the patient and/or informal caregivers. Past research has shown how using a restorative approach in responses to serious incidents in healthcare may counter the affected patients, informal caregivers, hospital organizations and health professionals’ sense of epistemic injustice [83, 84]. The right to have one’s voice heard could to some degree explain why it is important to include all sorts of implicated stakeholders in the aftermath of a serious incident. Based on our findings, patients and/or informal caregivers were not always seen as constructive in their effort to enlighten the case complexity. Not seeing these stakeholders as valid sources of knowledge, regardless of their approach to the process, should not be a standalone argument for omitting them from the external inspection process. Studies have in fact indicated that information from next of kin resulted in changes in the regulatory inspectors’ conclusions [25].

The framework of “value driven regulation” provides further interesting input to these matters, stressing how the “societal value” of inspection may increase due to the inspectors’ collection and interpretation of the regulatees’ activities [85]. To this study’s understanding, the mere fact that patients and/or informal caregivers become informed and are allowed to provide information to the inspectors themselves is imperative for the legitimacy of external inspection as a governmental, regulatory activity. The key question according to “value driven regulation” however, is to answer who (e.g. who are the actors having informal power) should be doing what (e.g. how are quality standards defined) to achieve which (e.g. what is the objective of regulation) societal value [85]. Indeed, our participants indicated that the scope of external inspection struggled with the balance between externally formulated objectives and the level of public expectation to what external inspection productively could contribute to. This was related to different perceptions of quality and safety, for instance, implying that inspectors and patients interpreted the societal value; regulatory objective differently. From a theoretical point of view, these tensions also relate to how reconciliation by epistemic and restorative justice may facilitate a more unified cross-level understanding of what purpose regulation should serve, and to whom it should serve its purpose [86, 87]. Considering that there often is a gap between work as imagine (regulations and policies) and work as imagine (work practices as these unfold in reality) it seems sensible for any government that seeks to align formalities and legitimacy to be more responsive to different perceptions of societal values [76, 78, 79].

Playing into the challenges of stakeholder interaction in external inspection is also the aspect of power distribution. Our findings provide indications of a gap between the internal work practices of the inspectors against external expectations, similar to other studies [30, 34, 81]. The power distribution between regulatory inspectors on one hand and patients and informal caregivers on the other is by nature uneven. Although a comprehensive set of patient rights exists, only regulatory bodies have the power to make decisions and potentially put sanctions into effect [13, 15, 16]. The hospitals are situated in the middle of this power dynamic, having to deal with both inspectors, patients, informal caregivers as well as having internal obligations to protect its employees [40,41,42,43]. It is not irrelevant to think that this power dynamic has an impact on interaction and communication, which may hamper the ability and willingness to agree on the narrative and accept outcomes from the decision-making processes. Findings from a Dutch study confirmed that perspectives provided by patients or informal caregivers were downplayed by inspectors if these contradicted the perspectives from health professionals involved [34]. The power distribution thus unfortunately reinforces the tensions between inspectors, hospital organizations and patients and informal caregivers.

Another paradox is the recent report of further governmental requirements and expectations to hospital internal follow up of serious incidents and an increase in attention to stakeholder involvement in these internally based processes, in parallel with less attention to the subsequent increase in workload and lack of competence [58, 88]. This was reflected in our participants’ responses.

Implications of the current system design - comprehensive pressures on the regulatory inspectors

Unlike our findings, previous studies have explored how bodies of external inspection could encourage hospitals to prepare for onsite inspection by self-assessing clinical practice and involving clinicians prior to the onsite inspection visit [10]. Others have investigated the impact of an increasingly layered system of governance and regulation of healthcare quality, showing how inspectors aimed at gaining control of quality of care in parallel with dependency on professional self-regulation by the healthcare organization undergoing inspection, introducing challenges of having to deal with a variety of stakeholders and regulatory instruments [89]. Comparing the Norwegian system of regulatory inspection to structures in other countries shows how the Dutch system shares similar multiple layers in its regulatory design and external evaluation processes [4, 18]. However, in contrast to Norway, the Dutch system combines accreditation standards and processes of external inspection, implying that it is possible to design the regulatory system in ways that ensure organizational autonomy of the hospital by the application of inspection, in parallel with structured compliance by the means of accreditation [4]. Based on existing literature, it is not possible to assess which one of the system designs that poses more, or less, pressure on the regulatory inspectors. Our findings however indicate issues with the current Norwegian system design of multiple system levels involved in inspection processes. Balancing internal stakeholders (the NBHS versus the County Governor level) and various external stakeholders were described as conflicted by our participants.

Although external inspection as external assessment of quality and safety has its overall objective of contributing to system-level improvement, and previous research has shown external inspection as moving into more system-oriented approaches [25], our study indicates that the different expectations and trade-offs required in external inspection processes makes it difficult to meet the needs of all stakeholders involved. The trade-offs are similarly reflected in responsive regulation theory: even if regulators choose to approach the regulatees in accordance with restorative justice principles, it may also fail because “noncompliance is neither about a lack of goodwill to comply nor about rational calculation to cheat. It is about management not having the competence to comply” (79 p.119). The complexity of the serious incident leaves the team of inspectors to balance different governmental expectations with the expectations from the patient and informal caregivers, as well as considering the perspectives of the hospital and health professionals. This results in comprehensive pressure on the inspectors, illustrated in Fig. 1 below.

Fig. 1
figure 1

Pressures on the regulatory inspectors in the incident-based inspection process

The findings and discussions demonstrated in this paper, display how the NBHS and County Governors decide between different approaches of responding to an incident, how they assess and process serious incidents with constant trade-offs. Part of the trade-off is who they choose to involve and how they choose to involve hospitals, healthcare professionals, patients, and informal caregivers. Implications from this study could serve as insight into a complex landscape of external inspection. We suggest that government bodies should acknowledge the trade-offs in external inspection, and more openly discuss the implications of the existing system design to ensure meaningful and relevant stakeholder involvement.

Strengths and limitations of the study

This study’s main strength is the novel focus on the links between approaches of responding in external inspection and involvement strategies of stakeholders such as hospitals and healthcare professionals, patients and/or informal caregivers. The application of mixed methods represents a rigorous exploration of the perspectives of regulatory external inspectors (interview data) and macro level expectations (document data). The study sample could have been larger; however, this was supplemented by the inclusion of documentary data. The included documents and interviews were in Norwegian. Thus, translation of the interview transcripts or document quotes into English during the analytical process may not have captured all the linguistic nuances. Although the study’s findings are limited to a specific structural, and cultural context, the qualitative mixed methods approach contributes to a fuller understanding of a highly relevant topic regardless of cultural context: regulatory inspections of hospitals after serious incidents. Further studies are required to extend findings related to how the wider system of accountability structures may support the internal work practices in the regulatory system of external inspection, to better align its formal objectives with the public expectations. As the findings reported in this paper are limited to the experiences and perspectives of inspectors, future research could benefit from including experiences and perspectives of patients and informal caregivers.

Conclusion

The study found that inspectors are formally expected to apply five different approaches in their responses to serious incidents and ensure stakeholder involvement in the following external inspection. The study provides new insight into how strategies for stakeholder involvement in external inspection entails complex and challenging interaction with stakeholders due to different views, resource demands and lacking competence. The inspectors considered balancing the formal objectives with the expectations of the public, hospitals, patients, and informal caregivers, to be a challenging part of their job as inspectors. Cross level interaction is suggested as a possible way forward and may contribute to positively informing the inspectors’ decision-making processes and case complexity, and remedy some of the uneven power distribution between the stakeholders. Based on our findings, and with support from previous literature, our study thus suggests that the regulatory system of external inspection and its available approaches of responding to serious incidents in the Norwegian setting is currently not designed to accommodate the complexity of needs from stakeholders at the levels of hospital organizations, patients, and informal caregivers altogether.

Data availability

Data may be obtained from a third party and are not publicly available. Data retrieved from the interviews are not publicly available due to the risk of identification but may be available from the corresponding author upon reasonable request and with permission from the participant(s).

Abbreviations

MHCS:

Ministry of Health and Care Services

NBHS:

Norwegian Board of Health Supervision

References

  1. Tikkanen R, et al. In: Osborn R, editor. International profiles of health care systems. New York: The Commonwealth Fund; 2020. https://www.commonwealthfund.org/sites/default/files/2020-12/International_Profiles_of_Health_Care_Systems_Dec2020.pdf

    Google Scholar 

  2. Van Wilder A, Brouwers J, Cox B, et al. A decade of commitment to hospital quality of care: overview of and perceptions on multicomponent quality improvement policies involving accreditation, public reporting, inspection and pay-for-performance. BMC Health Serv Res. 2021;21(1):990. https://doi.org/10.1186/s12913-021-07007-w. Published 2021 Sep 20.

    Article  PubMed  PubMed Central  Google Scholar 

  3. World Health Organization (WHO). Health care accreditation and quality of care: exploring the role of accreditation and external evaluation of health care facilities and organizations. Geneva: World Health Organization; 2022. Licence: CC BY-NC-SA 3.0 IGO. (Accessed 11 May 2023).

  4. Øyri SF, Bates DW, et al. Comparison of external evaluation policies and regulations for quality improvement and safety of health services in Norway and the United States. Int J Health Gov ISSN. 2023:2059–4631. https://doi.org/10.1108/IJHG-06-2023-0065

  5. Flodgren G, Pomey MP, Taber SA, et al. Effectiveness of external inspection of compliance with standards in improving healthcare organisation behaviour, healthcare professional behaviour or patient outcomes. Cochrane Database Syst Rev. 2011;CD008992. https://doi.org/10.1002/14651858.CD008992.pub2

  6. Flodgren G, Gonçalves-Bradley DC, Pomey MP. External inspection of compliance with standards for improved healthcare outcomes. Cochrane Database Syst Rev. 2016;12(12):CD008992. https://doi.org/10.1002/14651858.CD008992.pub3. Published 2016 Dec 2.

    Article  PubMed  Google Scholar 

  7. Schaefer C, Wiig S. Strategy and practise of external inspection in healthcare services—a Norwegian comparative case study. Saf Health. 2017;3:3.

    Article  Google Scholar 

  8. Hovlid E, Frich JC, Walshe K, et al. Effects of external inspection on sepsis detection and treatment: a study protocol for a quasiexperimental study with a stepped-wedge design. BMJ Open. 2017;7:e016213.

    Article  PubMed  PubMed Central  Google Scholar 

  9. Hovlid E, Braut GS, Hannisdal E, et al. Mediators of change in healthcare organisations subject to external assessment: a systematic review with narrative synthesis. BMJ Open. 2020;10(8):e038850. https://doi.org/10.1136/bmjopen-2020-038850. Published 2020 Aug 30.

    Article  PubMed  PubMed Central  Google Scholar 

  10. Hovlid E, Teig IL, Halvorsen K, Frich JC. Inspecting teams’ and organisations’ expectations regarding external inspections in health care: a qualitative study. BMC Health Serv Res. 2020;20(1):627. https://doi.org/10.1186/s12913-020-05475-0. Published 2020 Jul 8.

    Article  PubMed  PubMed Central  Google Scholar 

  11. Hovlid E, Husabø G, Teig IL, Halvorsen K, Frich JC. Contextual factors of external inspections and mechanisms for improvement in healthcare organizations: a realist evaluation. Soc Sci Med. 2022;298:114872. https://doi.org/10.1016/j.socscimed.2022.114872

    Article  PubMed  Google Scholar 

  12. Johannesen DTS, Lindøe PH, Wiig S. Certification as support for resilience? Behind the curtains of a certification body - a qualitative study. BMC Health Serv Res. 2020;20(1):730. https://doi.org/10.1186/s12913-020-05608-5. Published 2020 Aug 8.

    Article  PubMed  PubMed Central  Google Scholar 

  13. Øyri S. Healthcare Regulation and Resilience - a Norwegian Multilevel Case Study Thesis; University of Stavanger. Stavanger; 2021. https://uis.brage.unit.no/uis-xmlui/handle/11250/2766250 (Accessed 13 May 2023).

  14. Brennan TA. The role of regulation in quality improvement. Milbank Q. 1998;76(4):709–512. https://doi.org/10.1111/1468-0009.00111

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  15. Sparrow M. The Regulatory Craft. Controlling risks: solving problems, and managing compliance. Brookings Institution; 2000.

  16. Walshe K, Regulating Healthcare. A prescription for improvement? McGraw-Hill Education; 2003.

  17. Chuang S. Adaptation versus standardisation in patient safety. In: Hollnagel E, Braithwaite J, & Wears RL, editors. Resilient health care. Ashgate Publishing Limited; 2013.

  18. Weenink JW, Wallenburg I, Hartman L, et al. Role of the regulator in enabling a just culture: a qualitative study in mental health and hospital care. BMJ Open. 2022;12(7):e061321. https://doi.org/10.1136/bmjopen-2022-061321. Published 2022 Jul 27.

    Article  PubMed  PubMed Central  Google Scholar 

  19. Bergerød IJ, Braut GS, Wiig S. Resilience from a stakeholder perspective: the role of next of kin in cancer care. J Patient Saf. 2020;16(3):e205–10. https://doi.org/10.1097/PTS.0000000000000532

    Article  PubMed  Google Scholar 

  20. Van Vliet EJ, Stewart J, Engel C, editors. Clarifying the concept of external evaluation. White Paper, International Society for Quality in Health Care (ISQua). Dublin, 2021. https://isqua.org/images/blog/ISQuaWhitepaperExtEvaluationJuly2021_RS.pdf. (Accessed 11 May 2023).

  21. Bergerød I. Quality and safety in hospital cancer care: a mixed methods study of next of kin involvement. Thesis. University of Stavanger, Stavanger; 2021. https://uis.brage.unit.no/uis-xmlui/handle/11250/2753635

  22. Rasmussen J. Risk management in a dynamic society: a modelling problem. Saf Sci. 1997;27:183–213.

    Article  Google Scholar 

  23. Batalden PB, Davidoff F. What is quality improvement and how can it transform healthcare? Qual Saf Health Care. 2007;16:2–3.

    Article  PubMed  PubMed Central  Google Scholar 

  24. Wiig S, Haraldseid-Driftland C, Tvete Zachrisen R, Hannisdal E, Schibevaag L. Next of kin involvement in regulatory investigations of adverse events that caused patient death: a process evaluation (part I - the next of kin’s perspective). J Patient Saf. 2021;17(8):e1713–8. https://doi.org/10.1097/PTS.0000000000000630

    Article  PubMed  Google Scholar 

  25. Wiig S, Schibevaag L, Tvete Zachrisen R, Hannisdal E, Anderson JE, Haraldseid-Driftland C. Next-of-kin involvement in regulatory investigations of adverse events that caused patient death: a process evaluation (part II: the inspectors’ perspective). J Patient Saf. 2021;17(8):e1707–12. https://doi.org/10.1097/PTS.0000000000000634

    Article  PubMed  Google Scholar 

  26. Allen T, Walshe K, Proudlove N, Sutton M. Measurement and improvement of emergency department performance through inspection and rating: an observational study of emergency departments in acute hospitals in England. Emerg Med J. 2019;36(6):326–32. https://doi.org/10.1136/emermed-2018-207941

    Article  PubMed  Google Scholar 

  27. Wears RL, Sutcliffe KM. Still not safe: patient safety and the middle managing of American medicine. 1st ed. Oxford University Press; 2020.

  28. yri Ø SF, Braut GS, Macrae C, Wiig S. Exploring links between resilience and the macro-level development of healthcare regulation- a Norwegian case study. BMC Health Serv Res. 2020;20(1):762. https://doi.org/10.1186/s12913-020-05513-x. Published 2020 Aug 18.

    Article  Google Scholar 

  29. Øyri S, Braut G, Macrae C, et al. Investigating hospital supervision: a case study of regulatory inspectors’ roles as potential co-creators of resilience. J Pat Saf. 2021;17(2):122–30. https://doi.org/10.1097/PTS.0000000000000814

    Article  Google Scholar 

  30. Øyri SF, Wiig S. Linking resilience and regulation across system levels in healthcare - a multilevel study. BMC Health Serv Res. 2022;22(1):510. https://doi.org/10.1186/s12913-022-07848-z. Published 2022 Apr 15.

    Article  PubMed  PubMed Central  Google Scholar 

  31. Ocloo JE. Harmed patients gaining voice: challenging dominant perspectives in the construction of medical harm and patient safety reforms [published correction appears in Soc Sci Med. 2010;71(6):1218]. Soc Sci Med. 2010;71(3):510–516. https://doi.org/10.1016/j.socscimed.2010.03.050

  32. Wiig S, Rutz S, Boyd A, Churruca K, et al. What methods are used to promote patient and family involvement in healthcare regulation? A multiple case study across four countries. BMC Health Serv Res. 2020;20(1):616. https://doi.org/10.1186/s12913-020-05471-4. PMID: 32631343; PMCID: PMC7336629.

    Article  PubMed  PubMed Central  Google Scholar 

  33. Wiig S, Hibbert PD, Braithwaite J. The patient died: what about involvement in the investigation process? Int J Qual Health Care. 2020;32(5):342–6. https://doi.org/10.1093/intqhc/mzaa034

    Article  PubMed  PubMed Central  Google Scholar 

  34. Kok J, Leistikow I, Bal R. Patient and family engagement in incident investigations: exploring hospital manager and incident investigators’ experiences and challenges. J Health Serv Res Policy. 2018;23(4):252–61. https://doi.org/10.1177/1355819618788586

    Article  PubMed  PubMed Central  Google Scholar 

  35. Norwegian Board of Health Supervision (NBHS). In Norwegian: Pasient- og pårørendeperspektiv ved alvorlige hendelser. Rapport fra Helsetilsynet 4/2019. In English: Patient- and informal caregivers’ perspectives following serious incidents. Oslo: Norwegian Board of Health Supervision; 2018. Report 4/2019. https://www.helsetilsynet.no/en/publications/report-of-the-Norwegian-board-of-health-supervision/2019/the-perspective-of-patients-and-relatives-when-a-serious-adverse-event-has-occurred.-examples-and-experience-gained-from-assessing-serious-adverse-events-in-2018/

  36. Lippestad JW, Melby L, Kilskar SS, Øren A. Evaluering av meldeordning om uønskede hendelser i spesialisthelsetjenesten. SINTEF. https://www.sintef.no/globalassets/sintef-teknologi-og-samfunn/rapporter-sintef-ts/sintef-a26547_sluttrapport_meldeordning.pdf

  37. Petkovic J, Riddle A, Akl EA et al. Protocol for the development of guidance for stakeholder engagement in health and healthcare guideline development and implementation. Syst Rev. 2020;9(1):21. Published 2020 Feb 1. https://doi.org/10.1186/s13643-020-1272-5

  38. Norwegian Board of Health Supervision (NBHS). In Norwegian: Årsrapport 2018 fra Statens Helsetilsyn. In English: Annual Report 2018 from the Norwegian Board of Health Supervision. Oslo: Norwegian Board of Health Supervision; 2018. https://www.helsetilsynet.no/globalassets/opplastinger/publikasjoner/aarsrapporter/aarsrapport2018.pdf

  39. Norwegian Board of Health Supervision (NBHS). In Norwegian: Årsrapport 2021 fra Statens Helsetilsyn In English: Annual Report 2021 from the Norwegian Board of Health Supervision Oslo: Norwegian Board of Health Supervision; 2021.

  40. Ministry of Health and Care Services (MHCS). In Norwegian: Lov om statlig tilsyn med helse- og omsorgstjenesten mv. (helsetilsynsloven). In English: The Act of 15 December 2017 No. 107 relating to governmental supervision with the healthcare services (The Health Supervision Act) LOV-2017-12-15-107. Oslo: Ministry of Health and Care Services; 2017. (Accessed 11 May 2023). https://lovdata.no/dokument/NL/lov/2017-12-15-107.

  41. Ministry of Health and Care Services (MHCS). In Norwegian: Lov om spesialisthelsetjenesten. (LOV-1999-07-02-61). In English: The Act of 2 July 1999 No. 61 relating to the specialized healthcare services (the Specialized Healthcare Services Act). Oslo: Ministry of Health and Care Services; 1999. (Accessed 11 May 2023).

  42. Ministry of Health and Care Services (MHCS). In Norwegian: Lov Om Helsepersonell m.v.(helsepersonelloven). LOV-1999-07-02-64. English: Act of 2 July 1999 No. 64 relating to Health personnel etc. Oslo: Ministry of Health and Care Services; 1999. https://www.regjeringen.no/no/dokumenter/act-of-2-july-1999-no-64-relating-to-hea/id107079/

    Google Scholar 

  43. Ministry of Health and Care Services (MHCS). In Norwegian: Pasient- Og brukerrettighetsloven. English: the patient and user rights Act (patient and user rights Act). Ministry of Health and Care Services; 1999. https://lovdata.no/dokument/NL/lov/1999. (accessed 11 May 2023). -07-02-63/KAPITTEL_2#x2-5a Oslo.

  44. Norwegian Directorate of Health (NDH). In Norwegian: Rapport. Pasientskader i Norge 2022– Målt med Global Trigger Tool. In English: Report. Patient injuries in Norway 2022– measured by the Global Trigger Tool. Oslo: Norwegian Directorate of Health; 2022. https://www.helsedirektoratet.no/rapporter/pasientskader-i-norge-2022--malt-med-global-trigger-tool

  45. Norwegian Board of Health Supervision (NBHS). In Norwegian: Statens helsetilsyn. Årsrapport 2022. In English: Annual Report 2022 from the Norwegian Board of Health Supervision Oslo: Norwegian Board of Health Supervision; 2022. https://www.helsetilsynet.no/globalassets/opplastinger/publikasjoner/aarsrapporter/aarsrapport_2022.pdf

  46. Ministry of Health and Care Services. Regulation on management and quality improvement in the healthcare services. Norwegian: Forskrift Om ledelse og kvalitetsforbedring i helse- og omsorgstjenesten. FOR-2016-10-28–1250. Oslo: Ministry of Health and Care Services; 2016. https://lovdata.no/dokument/SF/forskrift/2016-10-28-1250

    Google Scholar 

  47. Norwegian Directorate of Health (NDH). In Norwegian: Veileder for utvikling av kunnskapsbaserte retningslinjer. In English: Guidelines for the development of evidence-based guidelines. Oslo: Norwegian Directorate of Health; 10/2012. https://www.helsedirektoratet.no/veiledere/utvikling-av-kunnskapsbaserte-retningslinjer/Veileder for utvikling av kunnskapsbaserte retningslinjer (fullversjon).pdf/_/attachment/inline/efa406d5-9fe5-4ff5-9a8c-3f0e143c55c8:2cc6aceb8963dcfec76bc036a10402f12729b8ad/Veileder for utvikling av kunnskapsbaserte retningslinjer (fullversjon).pdf

  48. Norwegian Directorate of Health (NDH). In Norwegian: Kvalitet Og Kvalitetsindikatorer. English: quality and quality indicators. Oslo: Norwegian Directorate of Health; 2021. https://www.helsedirektoratet.no/statistikk/kvalitetsindikatorer/kvalitet-og-kvalitetsindikatorer

    Google Scholar 

  49. Morse JM, Niehaus L. Mixed Method Design. Principles and procedures. Walnut Creek: Left Coast; 2009.

    Google Scholar 

  50. Patton M. Qualitative evaluation and research methods. Beverly Hills, CA: Sage; 1990.

    Google Scholar 

  51. Braun V, Clarke V. Successful qualitative research - a practical guide for beginners. Thousand Oaks, CA: Sage; 2013.

    Google Scholar 

  52. Norwegian Board of Health Supervision (NBHS). In Norwegian: Varsler som oversendes fra Statens Helsetilsyn. English: guidelines for inspection conducted by the County Governor level- appendix 2. Oslo, 14.02.2022. Oslo: Norwegian Board of Health Supervision; 2022.

    Google Scholar 

  53. Norwegian Board of Health Supervision (NBHS). In Norwegian: Saman Om Betre tilsyn. Tilrådingar Om brukarinvolvering i tilsyn. Rapport Fra Helsetilsynet 2/2019. English: recommendations related to stakeholder involvement in external inspection. Report 2/2019. Oslo: Norwegian Board of Health Supervision; 2019. https://www.helsetilsynet.no/globalassets/opplastinger/publikasjoner/rapporter2019/helsetilsynetrapport2_2019.pdf

    Google Scholar 

  54. Norwegian Board of Health Supervision (NBHS). In. Norwegian: Informasjon til Ledere Og Helsepersonell Om stedlig tilsyn fra Statens Helsetilsyn. English: information to managers and health professionals regarding onsite inspection. 21.06.2021. Oslo: Norwegian Board of Health Supervision; 2021. https://www.helsetilsynet.no/tilsyn/varsel-om-alvorlige-hendelser/informasjon-til-ledere-og-helsepersonell--om-stedlig-tilsyn-fra-statens-helsetilsyn/

    Google Scholar 

  55. Norwegian Board of Health Supervision (NBHS). In. Norwegian: Stedlig Tilsyn etter varsel om alvorlig hendelse som tilsynsmetode. English: Onsite inspection as method following reports of serious incidents. 01.08.2022. Oslo: Norwegian Board of Health Supervision; 2022. https://www.helsetilsynet.no/tilsyn/varsel-om-alvorlige-hendelser/mer-om-stedlig-tilsyn-etter-varsel-om-alvorlig-hendelse-som-tilsynsmetode/

    Google Scholar 

  56. Norwegian Board of Health Supervision (NBHS). In Norwegian: veiledning for statsforvalterens behandling av tilsynssaker (helse- og omsorgstjenesten). English: Guidelines - reports delegated to the County governors from the NBHS. 03.07.2022. Oslo: Norwegian Board of Health Supervision; 2022. https://www.helsetilsynet.no/tilsyn/veiledning-for-statsforvalterens-behandling-av-tilsynssaker-helse-og-omsorgstjenesten/

    Google Scholar 

  57. Norwegian Board of Health Supervision (NBHS). In. Norwegian: Tilbakemelding til Utvalget Som Skal evaluere varselordningen for helse- og omsorgstjenesten. English: response letter from the NBHS to the Consultative Committee responsible for assessing the incident reporting regime in Norway. 13.06.2022. Oslo: Norwegian Board of Health Supervision; 2022.

    Google Scholar 

  58. Norwegian Board of Health Supervision (NBHS). In Norwegian: Påminnelse til helse- og omsorgstjenesten om oppfølging av alvorlige hendelser, etterlevelse av varslingsplikten og betydningen av dialog med involverte parter ved alvorlige hendelser. In English: Reminder: letter from the NBHS to the health care trusts and municipalities. 26.01.2022. Oslo: Norwegian Board of Health Supervision; 2022. https://www.helsetilsynet.no/publikasjoner/brev-og-horingsuttalelser-fra-statens-helsetilsyn/2022/paaminnelse-til-helse-og-omsorgstjenesten-om-oppfoelging-av-alvorlige-hendelser-etterlevelse-av-varslingsplikten-og-betydningen-av-dialog-med-involverte-parter-ved-alvorlige-hendelser/

  59. Norwegian Board of Health Supervision (NBHS). In. Norwegian: Annen tilsynsmessig oppfølging etter varsel om alvorlig hendelse - innhenting av redegjørelse, egenvurdering, egenrapport. English: additional external inspection follow-up following reports of serious incidents. 23.05. 2023. Oslo: Norwegian Board of Health Supervision; 2023. https://www.helsetilsynet.no/tilsyn/varsel-om-alvorlige-hendelser/mer-om-annen-tilsynsmessig-oppfolging-etter-varsel-om-alvorlig-hendelse---innhenting-av-redegjorelse-egenvurdering-egenrapport/

    Google Scholar 

  60. Norwegian Board of Health Supervision (NBHS). In. Norwegian: Tilsynsmessig oppfølging av lovbrudd. English: external inspection follow-up of violations. 12.06.2023. Oslo: Norwegian Board of Health Supervision; 2023. https://www.helsetilsynet.no/globalassets/opplastinger/tilsyn/veileder_tilsynssaker_statsforvalteren/tilsynsmessig_oppfoelging.pdf

    Google Scholar 

  61. Norwegian Board of Health Supervision (NBHS). Virksomheten følger opp og gir tilbakemelding til statsforvalteren. English: follow up by the organization and feedback to the County Governor. 12.06.2023. Oslo: Norwegian Board of Health Supervision; 2023. https://www.helsetilsynet.no/globalassets/opplastinger/tilsyn/veileder_tilsynssaker_statsforvalteren/virksomheten_foelger_opp_og_rapporterer_til_statsforvalteren.pdf

    Google Scholar 

  62. Norwegian Board of Health Supervision (NBHS). In. Norwegian: Tilsynsfaglige prioriteringer og vurdering. English: priorities and assessment regarding external inspection 12.12.2022. Oslo: Norwegian Board of Health Supervision; 2022. https://www.helsetilsynet.no/globalassets/opplastinger/tilsyn/veileder_tilsynssaker_statsforvalteren/tilsynsfaglige_prioriteringer_vurderinger.pdf

    Google Scholar 

  63. Norwegian Board of Health Supervision (NBHS). In Norwegian: Mottak og avklaringer. Veiledning for statsforvalterens behandling av tilsynssaker (helse- og omsorgstjenesten). In English: Reception and clarification - Guidelines for the County Governor proceedings of incidents 29.06.2022. Oslo: Norwegian Board of Health Supervision; 2022. https://www.helsetilsynet.no/globalassets/opplastinger/tilsyn/veileder_tilsynssaker_statsforvalteren/mottak_og_avklaringer.pdf

  64. Norwegian Board of Health Supervision (NBHS). In. Norwegian: Oversendelse til statsforvalteren som tilsynsmessig oppfølging etter varsel om alvorlig hendelse. English: delegation to the County Governor of notifications related to serious incidents. 23.05.2023. Oslo: Norwegian Board of Health Supervision; 2023. https://www.helsetilsynet.no/tilsyn/varsel-om-alvorlige-hendelser/mer-om-oversendelse-til-statsforvalteren-som-tilsynsmessig-oppfolging-etter-varsel-om-alvorlig-hendelse/

    Google Scholar 

  65. Norwegian Board of Health Supervision (NBHS). In. Norwegian: Oversendelse til virksomheten/ helsepersonellet. English: transfer to organizations/health professionals. 23.06.2023. Oslo: Norwegian Board of Health Supervision; 2023. https://www.helsetilsynet.no/globalassets/opplastinger/tilsyn/veileder_tilsynssaker_statsforvalteren/oversendelse_til_virksomheten_helsepersonellet.pdf

    Google Scholar 

  66. Bowen GA. Document analysis as a qualitative research method. Qualitative Res J. 2009;9(2):27–40. https://doi.org/10.3316/QRJ0902027

    Article  Google Scholar 

  67. Malterud K, Siersma VD, Guassora AD. Sample size in qualitative interview studies: guided by information power. Qual Health Res. 2016;26(13):1753–60. https://doi.org/10.1177/1049732315617444. Epub 2016 Jul 10. PMID: 26613970.

    Article  PubMed  Google Scholar 

  68. Shaw C, Groene O, Berger E. External institutional strategies: accreditation, certification, supervision. In Busse R, Klazinga, N., Panteli, D. & Quentin, W. Improving healthcare quality in Europe: Characteristics, effectiveness, and implementation of different strategies Health Policy Series, No. 53. Copenhagen (Denmark): European Observatory on Health Systems and Policies; 2019. https://apps.who.int/iris/bitstream/handle/10665/327356/9789289051750-eng.pdf?sequence=1&isAllowed=y

  69. Fulop L, Day GE. From leader to leadership: clinician managers and where to next? Aust Health Rev. 2010;34(3):344–51. https://doi.org/10.1071/AH09763

    Article  PubMed  Google Scholar 

  70. Fulop L. Leadership, clinician managers and a thing called hybridity. J Health Organ Manag. 2012;26(4–5):578–604. https://doi.org/10.1108/14777261211256927

    Article  PubMed  Google Scholar 

  71. Øyri SF, Braut GS, Macrae C, et al. Hospital managers’ perspectives with implementing quality improvement measures and a new regulatory framework: a qualitative case study. BMJ Open. 2020;10:e042847.

    Article  PubMed  PubMed Central  Google Scholar 

  72. Husabø G, Teig IL, Frich JC, Bondevik GT, Hovlid E. Promoting leadership and quality improvement through external inspections of management of sepsis in Norwegian hospitals: a focus group study. BMJ Open. 2020;10(11):e041997. https://doi.org/10.1136/bmjopen-2020-041997. Published 2020 Nov 12.

    Article  PubMed  PubMed Central  Google Scholar 

  73. Øyri S, Wiig S. Regulation and resilience at the macro-level healthcare system– a literature review. In: Beer and Enrico Zio Michael, editor. Proceedings of the 29th European Safety and Reliability Conference. 2019. https://doi.org/10.3850/978-981-11-2724-3_0075-cd

  74. de Kam D. Through the Regulator’s Eyes. Thesis. Erasmus University Rotterdam, Rotterdam; 2019. file:///C:/Users/2919684/Transkribering%20Dropbox/Sina%20%C3%98yri/PC/Downloads/david-de-kam-through-the-regulators-eyes.pdf.

  75. Kok J, Wallenburg I, Leistikow I, Bal R. The doctor was rude, the toilets are dirty. Utilizing ‘soft signals’ in the regulation of patient safety. Saf Sci. 2020;131:104914. https://doi.org/10.1016/j.ssci.2020.104914

    Article  Google Scholar 

  76. Ayres I, Braithwaite J. Responsive regulation: transcending the deregulation debate. New York: Oxford University Press; 1992.

    Book  Google Scholar 

  77. Hood C, Rothstein H, Baldwin R. The government of risk: understanding risk regulation regimes. Oxford University Press; 2001.

  78. Braithwaite J. The essence of responsive regulation. UBC Law Rev. 2011;44(3):475–520.

    Google Scholar 

  79. Braithwaite J. Types of responsiveness. In: Drahos P, editor. Regulatory Theory, foundations and applications. ANU; 2017.

  80. Backer IL. The Norwegian reform of civil procedure. Scandinavian Studies In Law, 1999–2012. https://www.scandinavianlaw.se/pdf/51-2.pdf

  81. Husabø G, Hovlid E. What might be required for inspections to be considered fair? Comment on What lies behind successful regulation? A qualitative evaluation of pilot implementation of Kenya’s health facility inspection reforms. Int J Health Policy Manag. 2022;x(x):x–x. https://doi.org/10.34172/ijhpm.2022.7296

  82. Kok J, de Kam D, Leistikow I, Grit K, Bal R. Epistemic injustice in incident investigations: a qualitative study. Health Care Anal. 2022;30(3–4):254–74. https://doi.org/10.1007/s10728-022-00447-3

    Article  PubMed  PubMed Central  Google Scholar 

  83. Ramsey L, McHugh S, Simms-Ellis R, Perfetto K, O’Hara J. Patient and family involvement in serious incident investigations from the perspectives of key stakeholders: a review of the qualitative evidence. J Patient Saf. 2022;18(8):e1203–10. https://doi.org/10.1097/PTS.0000000000001054

    Article  PubMed  PubMed Central  Google Scholar 

  84. Wailling J, Kooijman A, Hughes J, O’Hara JK. Humanizing harm: using a restorative approach to heal and learn from adverse events. Health Expect. 2022;25(4):1192–9. https://doi.org/10.1111/hex.13478

    Article  PubMed  PubMed Central  Google Scholar 

  85. Leistikow IP, Pot AM, Bal R. Value driven regulation and the role of inspections. Commentary to: Hovlid E, Husabø G, Teig IL, Halvorsen K, Frich JC. Contextual factors of external inspections and mechanisms for improvement in healthcare organizations: A realist evaluation. Soc Sci Med. 2022;298:114872. Soc Sci Med. 2022;308:115170. https://doi.org/10.1016/j.socscimed.2022.115170

  86. Hollnagel E. Safety-II in practice. developing the resilience potentials. Routledge; 2018.

  87. Anderson JE, Ross AJ, Back J, et al. Implementing resilience engineering for healthcare quality improvement using the CARE model: a feasibility study protocol. Pilot Feasibility Stud. 2016;2:61. https://doi.org/10.1186/s40814-016-0103-x. Published 2016 Oct 12.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  88. Ytterdahl SA et al. In Norwegian: Fra varsel til læring og forbedring. Rapport fra utvalg oppnevnt for å vurdere varselordningene til Statens helsetilsyn og Statens undersøkelseskommisjon for helse- og omsorgstjenesten. In English: Report regarding an external evaluation of incident reporting regimes in Norway. Oslo; 12.04.2023. Accessed 23 Aug 2023.

  89. van de Bovenkamp HM, Stoopendaal A, Bal R. Working with layers: the governance and regulation of healthcare quality in an institutionally layered system. Public Policy Adm. 2017;32(1):45–65. https://doi.org/10.1177/0952076716652934

    Article  PubMed  Google Scholar 

Download references

Acknowledgements

The authors would like to thank the participants who shared their valuable knowledge and reflections. We appreciate the constructive feedback given by Professor emeritus Kirsten Jæger Fjetland and by SHARE– Centre for Resilience in Healthcare’ Stakeholder Panel during the development of our project plan and interview guide.

Funding

Open access funding provided by University of Stavanger & Stavanger University Hospital. This work was funded by the University of Stavanger, SHARE- Centre for Resilience in Healthcare, and supported by Stavanger University Hospital. This research received no specific grant from any funding agency in the public, commercial or not-for-profit sectors. Author SW is supported by the Resilience in Healthcare Program, project number 275367. The RiH research program has received funding from the Research FIGURE Council of Norway from the FRIPRO TOPPFORSK program, grant agreement no. 275367, The University of Stavanger, Norway, and NTNU Gjøvik, Norway; The Norwegian Air Ambulance support the study with in-kind funding.

Author information

Authors and Affiliations

Authors

Contributions

SFØ and IJB co-designed the study, co-recruited participants, and conducted interviews in collaboration. The analytical process was performed individually by researchers SFØ and IJB, as well as by collective discussions refining codes and themes among them. SFØ drafted the manuscript, with SW, JEA, and IJB providing revisions of the manuscript.

Corresponding author

Correspondence to Sina Furnes Øyri.

Ethics declarations

Ethics approval

The study was conducted in accordance with the Declaration of Helsinki (DOH), and all methods were carried out in accordance with relevant guidelines and regulations. The study did not collect specific patient information. The study protocol was approved by the Norwegian Center for Research Data (NSD) in 2021, ref. nr: 443658. NSD was renamed “Sikt” (Norwegian Agency for Shared Services in Education and Research) in 2022 and ensures that the research project adheres to ethical guidelines and regulations and provides the approval for ethics, information security and privacy services, as part of the HK-dir (Norwegian Directorate for Higher Education and Skills). All participants included in the study signed informed consent ahead of the interview, with information about the study’s aim, method and data protection, and the researchers’ interest in the research topic.

Consent for publication

Not required.

Competing interests

The authors declare no competing interests.

Provenance and peer review

Not commissioned; external peer review.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Electronic supplementary material

Below is the link to the electronic supplementary material.

Supplementary Material 1

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Øyri, S.F., Wiig, S., Anderson, J.E. et al. External inspection approaches and involvement of stakeholders’ views in inspection following serious incidents - a qualitative mixed methods study from the perspectives of regulatory inspectors. BMC Health Serv Res 24, 300 (2024). https://doi.org/10.1186/s12913-024-10714-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12913-024-10714-9

Keywords