Skip to main content
  • Research article
  • Open access
  • Published:

Sustainability of healthcare improvement: what can we learn from learning theory?

Abstract

Background

Changes that improve the quality of health care should be sustained. Falling back to old, unsatisfactory ways of working is a waste of resources and can in the worst case increase resistance to later initiatives to improve care. Quality improvement relies on changing the clinical system yet factors that influence the sustainability of quality improvements are poorly understood. Theoretical frameworks can guide further research on the sustainability of quality improvements. Theories of organizational learning have contributed to a better understanding of organizational change in other contexts. To identify factors contributing to sustainability of improvements, we use learning theory to explore a case that had displayed sustained improvement.

Methods

Førde Hospital redesigned the pathway for elective surgery and achieved sustained reduction of cancellation rates. We used a qualitative case study design informed by theory to explore factors that contributed to sustain the improvements at Førde Hospital. The model Evidence in the Learning Organization describes how organizational learning contributes to change in healthcare institutions. This model constituted the framework for data collection and analysis. We interviewed a strategic sample of 20 employees. The in-depth interviews covered themes identified through our theoretical framework. Through a process of coding and condensing, we identified common themes that were interpreted in relation to our theoretical framework.

Results

Clinicians and leaders shared information about their everyday work and related this knowledge to how the entire clinical pathway could be improved. In this way they developed a revised and deeper understanding of their clinical system and its interdependencies. They became increasingly aware of how different elements needed to interact to enhance the performance and how their own efforts could contribute.

Conclusions

The improved understanding of the clinical system represented a change in mental models of employees that influenced how the organization changed its performance. By applying the framework of organizational learning, we learned that changes originating from a new mental model represent double-loop learning. In double-loop learning, deeper system properties are changed, and consequently changes are more likely to be sustained.

Peer Review reports

Background

Quality improvements in health care that are not sustained are a waste of resources. Falling back to old, unsatisfactory ways of working can be frustrating and increase the resistance to later initiatives to improve care. Few publications have reported sustainability of healthcare improvements. In a systematic review, the median follow-up time for interventions that sought to improve the quality of care was less than 1 year [1]. Consequently, little is known about the factors that contribute to the sustainability of improvements [2, 3]. This makes such research sorely needed [4].

Over the past few decades, an understanding of healthcare quality as a system property has emerged [57]. Accordingly, the quality of health care primarily depends on the function of the system and to a lesser degree on the skills of individuals [5]. Changing the system is therefore the most effective route to improvement; i.e., an organization needs to change its way of operating to produce improved outcomes, and these changes must be maintained to sustain the improvements [5, 8].

The sustainability of systemic change is poorly understood. Use of theoretical frameworks allows for an understanding of factors that contribute to sustainability [9, 10]. In particular, theories of organizational learning explain crucial aspects of change in organizational behavior. Argyris and Schön [11] defined learning as the translation of new knowledge to altered behavior that is replicable. Quality improvement implies that an organization needs to alter its behavior, and that the behavioral changes must be replicable to sustain improvements. Sustained improvement after systemic change can thus represent a case of organizational learning. A framework of organizational learning can be used to explore the factors that influence the sustainability of improvements.

In this article, we use an organizational learning framework to explore a case that demonstrated sustained improvement. The case is Førde Hospital’s project redesigning their pathway for elective surgery to reduce cancellations. Reasons for cancellations are complex and related to patients, organizational issues, and clinical staff [12, 13]. Cancellations are caused by a clinical system performing sub-optimally, e.g., poor scheduling, inadequate medical pre-assessment, and facility shortcomings [1419]. Reducing cancellations requires changes in the clinical system. Changing the clinical system requires organizational change through organizational learning [5]. Organizational learning becomes manifest through new organizational routines, and the effects of these new routines can be measured [20, 21]. Organizational learning in our case should therefore be reflected in reduced cancellation rates. We have previously demonstrated how the redesign of the surgical pathway at Førde Hospital caused a significant reduction in cancellation rates from 8.5 % to 4.7 % that was sustained over 2 years [22]. The case is thus an example of sustained improvement through organizational learning, and it should be suitable for exploring factors contributing to sustain the improvements.

Methods

Context

Førde Hospital is a district general hospital in a small town in Norway, population 10,000. The hospital has 7 operating suites and 34 surgical beds. Like most hospitals in Norway, Førde Hospital is publicly owned and financed. The local health authority also includes two smaller local hospitals. Altogether, the three hospitals serve a population of approximately 107,000. All patients have full healthcare coverage through the national state insurance.

The cancellation of planned surgeries is a known problem in health care that affects patients, diminishes quality of care, wastes resources, and increases healthcare costs. Complaints from patients and high cancellation rates indicated that the pathway for elective surgery was not optimal at Førde Hospital, and the hospital therefore set out to redesign the entire pathway. The project involved the surgical departments at the hospital (ophthalmology, general surgery, gynecology, orthopedics, and ear, nose, and throat). Altogether 280 full-time equivalents work in these departments.

Four different project groups with a total of 40 employees were formed. Each group was given a mandate to redesign parts of the pathway. The changes that were implemented included one common entry point for all referrals, earlier clinical patient assessment, improved information flow among staff members, patient participation in selecting the date for surgery, and improved coordination and scheduling of operations.

Theoretical framework

The Evidence in the Learning Organization (ELO) model describes how healthcare organizations learn, create, and share knowledge about evidence-based practices and the system issues that facilitate or inhibit these learning processes[23] Therefore, we found that this model is appropriate as a framework for our analysis. The model is based on four main themes: inquiring deciding relating, and interpreting. Together, these themes represent the process required for organizations to learn and share new knowledge more effectively[23]:

  1. 1.

    Inquiring: Are members ready to inquire on behalf of teams/organizations to facilitate the loop learning processes?

    1. a.

      Acquiring: Do they possess technical skills related to locating resources and communicating feedback about this inquiry (e.g., Information Technology training)?

    2. b.

      Informing: Do they possess the cognitive skills (i.e., EBM skills) that support evidence-based decisions?

    3. c.

      Transforming: Do they possess cognitive traits that facilitate behaviors for inquiry (e.g., internal learning motivation)?

  2. 2.

    Deciding: Are members and teams utilizing effective decision processes to integrate evidence into healthcare decisions?

    1. a.

      Deliberating: Are they comparing and analyzing new working goals/strategies and structures/processes that will lead to better decisions (e.g., weighing alternative work procedures)?

    2. b.

      Decision-taking: Are they using appropriate decision methods/tools to support better decision-making (e.g., computer-assisted decision tools)?

    3. c.

      Evaluating: Are they using adequate analytical methods (qualitative or quantitative) to measure outcomes of evidence-based decisions (e.g., adequate audit and feedback)?

  3. 3.

    Relating: Are members, teams, and organizations facilitating evidence-based practices through effective organizational communication and relationships?

    1. a.

      Sharing: Do the organizational communication structures and processes facilitate sharing knowledge (e.g., adequate information networks)?

    2. b.

      Cooperating: Are teams available and functioning to facilitate efficient knowledge generation and evaluation (e.g., team composition and roles)?

    3. c.

      Advocating: Is there adequate and sufficient leadership with effective motivational strategies to induce organizational cultural change toward learning (e.g., incentives, championing, leadership style, etc.)?

  4. 4.

    Interpreting: Are members and teams sensing the need for evidence-based practice innovations and explicitly describing their tacit knowledge?

    1. a.

      Judging: Are they properly evaluating judgments about the outcomes of decisions and needed practice changes (i.e., testing for epistemic gaps)?

    2. b.

      Knowing: Are they building new models of shared understanding based on the results of evidence-based decision-making (i.e., interpreting/integrating with communities of practice)?

    3. c.

      Formulating: Are they codifying this new knowledge (e.g., team-tested practice recommendations) for organizational consumption?

The ELO model itself does not specifically elaborate on how new knowledge is created, how individual learning is transformed to organizational learning, or what organizational mechanisms are involved in the change process. These questions are important for organizational learning. To better understand these processes, we included four of the theoretical frameworks that underlie the ELO model: Argyris’ [24] loop learning, Kim’s [25] concept of organizational learning, Nonaka’s [26]Socialization, Externalization, Combination, and Internalization (SECI) model, and the framework of complex adaptive systems (CAS) [27].

Together these frameworks help explore factors that sustain organizational changes. The concept of single- and double-loop learning explains the actual learning process in the organization [24]. Kim’s [25] model explains the transformation from individual to organizational learning through mental models. The SECI model sheds light on how these mental models are incorporated and shared at the organizational level. The framework of CAS elucidates consequences interdependencies in a clinical system can have for organizational behavior and performance [28].

Loop learning

The concept of single- and double-loop learning explains the actual learning process in the ELO model [24]. In single-loop learning, a defect or mismatch between expected and observed outcomes is corrected, leaving the underlying theory for the action unchanged [24]. The feedback loop from the actual experience does not change the basic assumptions or decision-making rules that govern the action that corrected the defect. In double-loop learning, the detected defect is corrected, and the feedback loop from what is experienced during this process also changes the underlying theory or decision-making rules of the action that corrected the defect.

Double-loop learning can occur in organizations when individuals inquire on behalf of the organization in such a way as to lead to change in the values of the organizational theory in use[24]. In contrast to single-loop learning, double-loop learning changes the individuals’ understanding of the fundamental theories and values that guide organizational behavior [24]. Double-loop learning is thus a deeper change than single loop-learning because it changes the underlying system that produces the current organizational behavior.

Organizational learning through changed mental models

Earlier models of organizational learning did not describe how individual members of an organization learn or how the organization learns. According to Kim [25], shared mental models can be viewed as the link between individual and organizational learning. The cycles of individual learning affect learning at the organizational level through their influence on the organization’s shared mental models. When referring to mental models, Kim used Senge’s [29] definition: deeply held internal images of how the world works, which have a powerful influence on what we do because they also affect what we see.

Kim’s 1993 model also incorporates Argyris and Schön’s concept of double-loop learning. Organizational double-loop learning occurs when individual mental models become incorporated into the organization through shared mental models, which can then affect organizational action[25]. Argyris and Schön define organizational learning as the way people jointly construct maps [11]. These maps can be viewed as the mental models that are shared by the organization and compatible with the concept of the organizational theory in use [24].

The SECI model

Individual mental models can be viewed as tacit knowledge. According to Kim, making this tacit knowledge explicit is crucial to the development of new shared mental models in an organization [25]. The SECI model [26] explains how organizations dynamically share, create, and maintain knowledge. Knowledge is created through interactions between tacit and explicit knowledge through four modes of knowledge conversation: socialization, externalization, combination, and internalization[30]. Thus, the SECI model can help understand how individual mental models can be turned into shared mental models in the organization because it explains how tacit knowledge can be made explicit and shared in an organization. The model has been extended by introducing the concept of ba[30]. Ba can be defined as a shared context in which knowledge is shared, created, and utilized[30]. This shared context is important because it affects what kind of knowledge is shared and how the knowledge that is created is utilized.

Complex adaptive systems

In line with the increasing complexity of healthcare services, traditional organizational models have exhibited shortcomings, especially in explaining how change occurs. New ways of looking at healthcare organizations have evolved. The literature has advocated use of the CAS framework to explore change processes in health care [3133]. As opposed to traditional organizational models, CAS explores organizational change by directing attention to the interdependency of the different organizational elements and not towards the elements themselves [28]. CAS can thus help us understand the importance of the relationships and patterns of actions between individuals in a clinical system [34]. These relationships are dynamic, non-linear, and evolve with time. Small changes in one part of the system can lead to huge consequences in a different part [34]. Changes in mental models at an organizational level may influence the relationships and patterns of actions between individuals in the clinical system. We used CAS to better understand the connection between clinicians’ change in mental models and their revised understanding of interdependencies in the clinical system, and how this new understanding affected organizational behavior.

Design

Given the scarce knowledge on sustainability of healthcare improvements, the character of our study is explorative. Thus we used a qualitative case study design grounded in the theoretical framework of learning theory [35]. Our case is the redesign of the clinical pathway for elective surgery at Førde Hospital.

Data collection

We used purposive sampling to explore the organizational changes at the hospital [36]. Our focus was on organizational rather than the individual perspectives. Thus we included informants with different roles in the hospital. With assistance from the hospital administration, we recruited informants with different professional backgrounds and work experience as well as varying degrees of involvement in the improvement project.

Case study evidence initially consisted of administrative documents. These documents described the overall aim of the improvement project and the mandate of the improvement groups at Førde Hospital. We did not conduct a formal document analysis, but the documents provided us with background information for the interviews.

One of the authors (EH) conducted all interviews during June and July 2010. Seventeen of the interviews were conducted face to face, and three on the telephone. The length of the interviews varied between 20 to 70 minutes. Each respondent was interviewed once. EH wrote case notes for each interview. Our purpose was to maximize information [37, 38]. Based on the case notes, the last few interviews did not add any new substantial information. Thus, we reached redundancy, and our sample size was sufficient for the purposes of the study [37, 38].

EH conducted in-depth interviews. Based on our theoretical framework, he asked questions having to do with the following themes: identification of a need to change, planning the change, actions taken to induce change, outcomes of change, and adaptations of interventions. He used open-ended questions, e.g., How did the interviewees realize that they needed to change? What did they do to induce changes? How did this change affect their work? At the beginning of the interviews he collected demographic data (gender, profession, degree of involvement in improvement work, leader responsibilities, and years of work experience at the hospital). We grouped the degree of involvement in improvement work in employees who participated in the project groups, i.e., those directly involved in planning and execution, and employees who did not participate in the project groups but whose daily work was affected by the changes.

Analysis

We analyzed the interviews in the three steps described by Creswell [39]: preparing and organizing, reducing into themes through a process of coding and condensing, and representing in a figure and a discussion. We taped the interviews, transcribed them verbatim, and transferred them to HyperRESEARCH 2.8.3 computer software (Research Ware, 2009) for coding. We developed an initial coding scheme based on the main themes in the ELO model. EH coded the entire data set. During the analysis new codes were added based on the data [39]. Through an iterative process of coding, reflecting on the codes, and condensing, we identified common themes [37]. We interpreted the themes with regard to our theoretical frameworks and represented the relationship between the themes in Figure 1[39, 40].

Figure 1
figure 1

Factors that contribute to sustained improvements.

As recommended by Barbour, [41] the other authors validated excerpts of the data set to validate the coding and the quotations that we present to illustrate our findings. To enhance the rigor of our analysis, three key respondents validated a narrative of how interventions were planned and implemented in the hospital [38, 42]. We adapted the quotations, without changing the meaning, to enhance readability and maintain confidentiality [40]. A professional translator translated the quotations presented in this article into written English.

Ethical considerations

The Western Department of the Regional Committee for Medical and Health Research Ethics in Norway deemed a full ethical review unnecessary because the study did not use sensitive patient data. The study protocol was accepted by the Norwegian Social Science Data Services, which reviewed ethical aspects related to collecting and handling data (voluntary participation based on informed consent, anonymity of informants, and presence of appropriate data storage protocols).

Results

We interviewed 20 employees with different professional backgrounds and varying degrees of involvement in the improvement work. Characteristics of the interviewees are provided in Table 1.

Table 1 Characteristics of the interviewees

We structure the presentation of our findings around the four main themes of the ELO model. Where relevant, we present representative quotations from the interviews to illustrate our findings.

Inquiring

Complaints from patients and high cancellation rates indicated that the pathway for elective surgery was not optimal. At the beginning of the project, there was a unified understanding that the pathway needed to be improved. Four multidisciplinary project groups were formed to suggest a redesign of different parts of the pathway. The inquiry was initiated in these groups, and clinicians outside the groups were involved through regular meetings and dialogue.

Within the organization, there was a desire to try to improve the flow of patients.

Middle manager in project group.

There were lots of information meetings along the way. People were supposed to make suggestions; they could write suggestions on pieces of paper, which were posted on the wall. They could say what they thought about the various stages in the process.

Physician not in project group.

The health authority had developed a common platform and strategy for conducting improvement projects. The focus was on detecting systemic problems through equally addressing the four perspectives: professional, patient, and management quality (resource utilization), and staff satisfaction. The balanced approach among these four quality dimensions contributed to making the project understandable and increased acceptance among frontline clinicians.

The project groups mapped the current state of the clinical system and then began inquiring about how the system ought to work in the future and what changes needed to be made. Necessary process data were extracted from the patient administrative system. The project groups received guidance about improvement techniques. They used simple tools, such as Post-It Notes, to visualize the clinical pathway.

You may have really good project support, but if you don’t have really good ideas, good staff, creative staff, then all you’ll get are minor adjustments or copies of what others do.

Staff member offering support in project group.

Cases of patients were used in the inquiry process to emphasize the patient experience in the pathway. Moreover, the team used ideas from a site visit to a hospital that was considered to have a better practice. Interventions suggested in the literature were also used. The inquiry was a stepwise process influenced by activities in the relating and interpreting phases of the model. New knowledge created in these phases revealed new areas of inquiry.

Deciding

The project combined top-down and bottom-up approaches. The improvement strategy secured a sound foundation with the top management, whereas the frontline professionals were left with sufficient room to find new ways to redesign their own work processes. The project groups suggested interventions and tried to build a consensus for their suggestions through the involvement of and dialogue with clinicians outside the groups. Staff from the support unit provided the groups with structure and process data from the patient administrative system that served as the groundwork for their decisions.

Middle managers in the project groups mostly decided themselves which interventions to implement. Interventions in the project were in accordance with published evidence (e.g., earlier patient assessment, involvement of patient in decisions for scheduling operations, and calling the patient 2 days prior to surgery).

Those with expertise in project and improvement measures took part throughout the preliminary investigation stage and knew exactly what had been done before, what had been decided, and what the plans for the future were.

Middle manager in project group.

Additionally, the deciding phase was a stepwise process influenced by the new knowledge created in the relating and interpreting phases of the model. This new knowledge provided a new perspective and new areas of inquiry, which again could lead to new decisions. The middle managers participated in the actual clinical processes that were affected by the interventions, thereby instantly learning about the effects of their decisions. This feedback was considered more valuable than measurements such as cancellation rates because it was direct and without delay. Sometimes this feedback revealed a need to revise previous decisions.

Implementation was time-consuming and difficult because of resistance in the organization. Consistent follow-up by middle managers over an extended time was necessary to actually implement the decisions that were made. Through their participation in daily work, middle managers exemplified the new ways of working and demonstrated the importance of following new routines.

I’ve learned that involving the relevant staff is not enough. Unfortunately, we need those enthusiasts, too. This has not been a success only because of involvement, Post-It Notes, and conclusions. If that were the case, we would not have progressed a single step. And that is something I think that improvement theorists need to take more seriously: that is, that the project itself is only one per cent, or ten per cent. Ninety per cent is the consistent follow-up. And that is generally extremely unpleasant.

Middle manager in project group.

Relating

The meetings in the project groups were the most important arena for sharing and reflecting on information. The strategy of the top management was to include all of the professional groups that participated in the work process; thus, they convened interdisciplinary project groups. In these groups, frontline clinicians shared information, reflected on it, and related it to their own work and the clinical pathway as one whole to detect areas for improvement. Through this process, tacit knowledge was made explicit and shared.

Reflection and communication was not confined to the project groups. Through the active involvement of clinicians outside the project groups, new knowledge was spread and shared throughout the organization.

You got to sit in a group with the doctor, the nurse, the director, and the porter and look at all the problems. It’s not only about my challenges in dealing with a patient scheduled for an operation in an hour. There is actually an entire surrounding complex that has to work.

Middle manager in project group.

Interpreting

In accordance with the improvement strategy, the reflections by the project groups were set in the context of how the entire pathway could be improved. Considering this context enabled a new understanding of the clinical system to emerge. Clinicians realized that their former work processes had been fragmented and that they had lacked an understanding of how the hospital worked as a whole. Gradually, the focus shifted from their small, familiar part of the patient flow to how all of the various elements needed to interact to improve overall system performance.

Furthermore, individual clinicians reflected on how their own work contributed to the pathway and began to realize how dependent they were on each other and how crucial everybody’s contribution was for an optimal pathway. Through this reflection, the organization improved its understanding of the clinical system and its interdependencies.

You see more than your own little task, and you see how you can become a bottleneck for others’ tasks without even knowing it. I think that getting to see the whole process and to see that you actually are one link in a long chain helps people to see things more holistically.

Staff member offering support in project group.

The way it used to be, in many areas the big picture fell apart; work was so fragmented.

Physician in project group.

Each separate section had its own books with patients needing surgery, and everybody tried to plan their operation schedules on the basis of these. But there was no coordination; nothing brought things together in terms of the resources available on the ward as a whole.

Nurse in project group.

The new understanding of the clinical system changed the mental model. Moreover, it was codified into altered individual and organizational behavior. New organizational routines were created and implemented, in which the new system perspective was taken into account. For example, before the intervention the different surgery departments managed their own scheduling of operations, with no coordination among the departments. As part of the intervention, a new computer application was introduced for scheduling surgery across all surgical departments. This made waiting lists and schedules transparent across departments. Furthermore, a capacity coordinator position was created that was empowered to coordinate planning across the departments. Scheduling surgery also became more dynamic because waiting lists were considered when slots for surgery were assigned among departments.

The most important thing, I think we’ve learned is that it was very easy to sit and just look at your own sphere when working out procedures and general standards for patient scheduling. When we all sat down together and tried to create something, it required a mental readjustment so that we had to think, “This isn’t just about my area; it also affects others.”

Physician in project group.

We [anesthesiology and surgery] have probably become closer; yes, we have. It isn’t uncommon that we now are in touch at the early stages to discuss a patient’s medical problem. Then, together, we work out a plan for preparing for the operation.

Physician not in project group.

The improved system awareness influenced the inquiry and decision processes. As staff members became aware of the complexity of their clinical processes and their understanding of the interdependencies of the various elements grew, they discovered new problems and possible solutions.

When the head got a look at the clinic waiting lists, it became clear that there was a whole ocean of things that needed to be tackled. And these are things that we didn’t know about before, because the system hadn’t been transparent.

Middle manager in project group.

Now we see the big picture with regard to the operation schedule, and this means that we now discover ahead of time if two patients are scheduled for procedures that require the same instruments and thus re-sterilization. This used to cause unnecessary waits.

Nurse in project group.

Clinicians were involved in modifying and adapting the interventions to the context. Their new understanding of the clinical system influenced how this was done. With the new understanding, effects of the interventions were evaluated and adapted according to how the entire clinical pathway was thought should work.

Then we had to have a discussion about what we meant by “urgent,” what kind of things really are urgent, and what kinds of things it makes no sense to mark as “urgent.” So it took some time to get that as good as it could be.

Secretary not in project group.

Discussion

We begin by discussing our findings with regard to the theoretical framework and proceed to relate our findings to previous studies. We conclude with implications for quality improvement in health care.

A new understanding of the clinical system and double-loop learning

By structuring and analyzing our data according to the four themes of the ELO model, we were able to construct a representation of how the learning process unfolded. Furthermore, our theoretical frameworks helped us identify factors that contributed to sustain the improvements.

Our findings demonstrate that employees at the hospital developed a revised and deeper understanding of their clinical system and its interdependencies during the course of the improvement project. This new understanding had implications for organizational behavior. We consider this a key finding because it indicates a change in clinicians’ mental model of their clinical system that influenced organizational action.

This new understanding emerged from a dynamic process in which clinicians shared information, reflected on it, and related it to their everyday work situation. Consistent with the extended SECI model, including ba[26, 30], individual tacit knowledge was made explicit and interpreted in a new shared context. This shared context was provided by the hospital leadership. Specifically this context involved how the various elements of the clinical pathway needed to interact to enhance the performance of the clinical system as a whole. Through this process of sharing and reflection among individuals across professional groups and departments, the employees’ new model of the clinical system was transformed into a mental model that was shared by the organization [25]. As pointed out by Kim [25], a changed mental model that is shared at the organizational level can serve as a foundation for double-loop organizational learning if it affects organizational action [24].

Individuals in a system tend to focus on their immediate surroundings and pay less attention to the functioning of the clinical system as a whole [43, 44]. We observed the same kind of behavior at Førde Hospital before the project started. During the project clinicians shared and reflected on information with regard to how the performance of the clinical system as a whole could be improved. In line with the CAS framework we observed that clinicians revised their understanding of the clinical system as they acquired a better understanding of its interdependencies [43]. Clinicians’ improved understanding of the interdependencies in the clinical system affected three important stages of the change process: inquiry about what to change, change of organizational routines, and adaptations of interventions to the context.

As clinicians gradually improved their understanding of the clinical system and its interdependencies, they became able to detect system problems they previously had been unaware of. Failures prone to transitions between clinical entities were revealed as these transitions were evaluated from a new perspective, i.e., the clinical system as a whole. Furthermore, the new understanding led to a deeper and more precise understanding of the underlying causes of the quality problems.

Organizational learning becomes manifest through new or modified organizational routines [20]. In our case, clinical practice was altered as a consequence of a new understanding of the clinical system and its interdependencies. At the individual and group levels, physicians began cooperating in a new way that benefited the patients. At an organizational level, to offer one example, the hospital improved the scheduling and coordination of surgery by doing this across departments as opposed to department-wise as was done before the project. The new routine contributed to reducing cancellations and increasing the number of operations performed. Furthermore, remarks by the physicians demonstrated that their better understanding of the system of care facilitated the development of new organizational procedures in general.

Frontline employees were engaged in suggesting adaptations and modifications of the interventions. The improved understanding of the system increased the employees’ awareness of the interaction between context and interventions and improved their ability to adapt interventions to specific situations. Moreover, the hospital increased the effectiveness of changes by fitting them to a constantly changing context in a way pointed out by Fixsen et al. [45].

Consistent with Berwick [5], improvements in our case were made by changing the clinical system. During this process, clinicians developed a deeper understanding of their clinical system and its interdependencies. This was transformed into a shared mental model at the organizational level. The shared mental model affected organizational action, indicating that double-loop organizational learning occurred [24]. According to our theoretical framework, organizational change that involves double-loop learning is more likely to be sustained because it alters the deeper, structural, and cultural properties of systems. The fact that the hospital was able to facilitate and induce systemic change through double-loop learning appeared to be important for understanding how improvements were sustained. In our case, important stages in the process of changing the system were based on double-loop learning: inquiry about the need to change, change of clinical practice, and adaptations of interventions.

Our findings in relation to earlier studies

An understanding of an organization as a system is a prerequisite for organizational learning [29]. The performance of a system is far more dependent on how the elements work together than on how each element performs separately [46]. According to Batalden and Davidoff [47], knowledge about processes and patterns is a prerequisite for improving the performance of a clinical system (i.e., knowledge about how clinicians interact to deliver the actual care that patients need). However, many health professionals are process illiterate, partially owing to the challenges of recognizing and understanding causal implications of their actions in a system [44, 48]. In our case, clinicians improved quality by focusing on interdependencies, i.e., the way clinicians cooperated in their clinical processes to deliver care. By doing so, clinicians’ understanding of the implications of their actions grew, deepening their understanding of the clinical system.

Previous studies indicated that organizational learning in health care is fragmented (i.e., consisting of many learning cycles that are not interconnected) [21, 49, 50]. Contrary to our findings, Tucker and Edmondson [51] found that single-loop learning was dominant when nurses learned from mistakes. They suggested that this type of learning may mask the underlying structural problems of the system that could have been detected and corrected by double-loop learning. In our case, the hospital leaders were able to address underlying systemic problems through the dynamic process of inquiry, information sharing, and reflection, thereby facilitating double-loop learning.

Consistent with earlier studies [6, 52], we found that multidisciplinary teams of professionals, combined with knowledge about improvement, was an important success factor in our case study. The staff that supported the project groups helped to structure an arena for reflection and sharing information. Furthermore, their guidance and assistance in mapping and visualizing the clinical system, along with their role in keeping track of decisions, were important for maintaining a system perspective during the inquiry process.

Perseverance from middle managers, who led the implementation process through their clinical work, was a key driver in overcoming resistance and implementing change. Consistent with previous findings, middle managers built and demonstrated knowledge about the clinical system through their work and leadership, thereby facilitating the spread of the new mental model [53, 54]. By doing so, they maintained double-loop learning at the organizational level.

Implications for quality improvement in health care

We report here that clinicians revised their understanding of their clinical system and developed a new mental model. The mental model was then shared by the organization and influenced the inquiry process, clinical practice, and the way interventions were adapted. These steps are illustrated in Figure 1. The improvement strategy triggered clinicians to inquire about their system and opened an arena for information sharing and for relating these activities to the context of the whole clinical system. These combined activities improved clinicians’ understanding of their clinical system. The process was circular as the new understanding influenced the actions that had induced it.

Our case demonstrates that clinicians’ understanding of their clinical system can be improved, partially depending on how a project is planned and conducted. The hospital’s general strategy for improvement influenced how this new understanding emerged. A fundamental part of the strategy was to provide an arena and structured approach for sharing information and involving frontline professionals in the inquiry about systemic problems by equally addressing patient, professional, and administrative quality [55]. By providing clinicians with an arena for sharing information and a context for reflecting on the shared information, the leadership facilitated the process that led to a revised understanding of the clinical system. We therefore suggest that it may be possible to influence clinicians’ understanding of their clinical system by paying close attention to how improvement work is planned and conducted. Table 2 summarizes and suggests implications of our findings for quality improvement work in health care.

Table 2 Implications for quality improvement in health care

Limitations, relevance, and further research

The retrospective study design has inherent limitations such as information bias and confounding; thus, we cannot prove causality between interventions and outcomes. However, combining a retrospective design with a theory-driven analysis allowed us to learn from a successful case by exploring how and why the improvement efforts worked and were sustained [9, 10, 56]. Retrospective interview data may be influenced by what respondents remember and how they emphasize various parts of their experiences. In our case, the respondents independently described how the improvement process changed their understanding of the clinical system and their own roles in this system. This finding was consistent across professional groups, regardless of the degree of involvement in the improvement work, thus increasing the credibility and trustworthiness of our analyses [37]. The rigor of our analyses was also enhanced by our use of complementary theoretical perspectives [57].

Our study is based on a single case that cannot be directly generalized. However, lack of sustainability of healthcare interventions is a substantial and ubiquitous problem [58, 59]. The literature suggests that an incomplete understanding of the clinical system in not unique to our case; our findings are consistent with the literature and previous empirical findings [47, 50]. In line with recommendations in the literature, we used theoretical perspectives to generate a middle-range theory, or context-dependent theory, which describes how clinicians’ increased understanding of their clinical system contributes to sustainability [9, 10, 60]. Despite the inherent limitations of a retrospective case study, we suggest that our theory may help hospitals to increase the sustainability of improvements.

Our study may also open a new line of research into sustainability of improvements. Future studies should address factors that improve individuals’ understanding of clinical systems, changes of mental models, sharing of mental models, and how these models affect organizational behavior [61]. A better understanding of these factors might eventually increase the sustainability of healthcare improvements.

Conclusion

Our case study demonstrated that the clinicians developed a new understanding of their clinical system and its interdependencies. We suggest that the management can facilitate this kind of change by focusing on how frontline clinicians are involved in sharing and reflecting on information with regard to how the clinical system as a whole can be improved. The new understanding of the clinical system represented a change in mental models of employees that influenced how the organization changed its performance. Changes originating from a new mental model represent double-loop learning. In double-loop learning, deeper system properties are changed, and consequently improvements are more likely to be sustained.

References

  1. Alexander JA, Hearld LR: What Can We Learn From Quality Improvement Research? A Critical Review of Research Methods. Med Care Res Rev. 2009, 66 (3): 235-271. 10.1177/1077558708330424.

    Article  PubMed  Google Scholar 

  2. Bowman CC, Sobo EJ, Asch SM, Gifford AL: Measuring persistence of implementation: QUERI Series. Implement Sci. 2008, 3: 21-10.1186/1748-5908-3-21.

    Article  PubMed  PubMed Central  Google Scholar 

  3. Duckers MLA, Spreeuwenberg P, Wagner C, Groenewegen PP: Exploring the black box of quality improvement collaboratives: modelling relations between conditions, applied changes and outcomes. Implement Sci. 2009, 4: 74-10.1186/1748-5908-4-74.

    Article  PubMed  PubMed Central  Google Scholar 

  4. Grol R, Berwick DM, Wensing M: On the trail of quality and safety in health care. Br Med J. 2008, 336 (7635): 74-76. 10.1136/bmj.39413.486944.AD.

    Article  Google Scholar 

  5. Berwick DM: Improvement, trust, and the healthcare workforce. Qual Saf Health Care. 2003, 12 (6): 448-452. 10.1136/qhc.12.6.448.

    Article  CAS  PubMed  Google Scholar 

  6. Batalden PB, Stoltz PK: A framework for the continual improvement of health care: building and applying professional and improvement knowledge to test changes in daily work. Jt Comm J Qual Improv. 1993, 19 (10): 424-447.

    CAS  PubMed  Google Scholar 

  7. Committee on Quality of Health Care in America: Crossing the Quality Chasm: A New Health System for the 21st Century. 2001, Institute of Medicine, Washington DC

    Google Scholar 

  8. Shojania KG, Grimshaw JM: Evidence-based quality improvement: the state of the science. Health Aff (Millwood). 2005, 24 (1): 138-150. 10.1377/hlthaff.24.1.138.

    Article  Google Scholar 

  9. Grol R, Bosch MC, Hulscher M, Eccles MP, Wensing M: Planning and studying improvement in patient care: The use of theoretical perspectives. Milbank Q. 2007, 85 (1): 93-138. 10.1111/j.1468-0009.2007.00478.x.

    Article  PubMed  PubMed Central  Google Scholar 

  10. Walshe K: Understanding what works - and why - in quality improvement: the need for theory-driven evaluation. Int J Qual Health Care. 2007, 19 (2): 57-59. 10.1093/intqhc/mzm004.

    Article  PubMed  Google Scholar 

  11. Argyris C, Schön DA: Organizational learning: a theory of action perspective. 1978, Addison-Wesley, Reading, Mass

    Google Scholar 

  12. Gillen SM, Catchings K, Edney L, Prescott R, Andrews SM: What's all the fuss about? Day-of-surgery cancellations and the role of perianesthesia nurses in prevention. J Perianesth Nurs. 2009, 24 (6): 396-398. 10.1016/j.jopan.2009.10.008.

    Article  PubMed  Google Scholar 

  13. Argo JL, Vick CC, Graham LA, Itani KMF, Bishop MJ, Hawn MT: Elective surgical case cancellation in the Veterans Health Administration system: identifying areas for improvement. Am J Surg. 2009, 198 (5): 600-606. 10.1016/j.amjsurg.2009.07.005.

    Article  PubMed  Google Scholar 

  14. Pandit JJ, Westbury S, Pandit M: The concept of surgical operating list ‘efficiency’: a formula to describe the term. Anaesthesia. 2007, 62 (9): 895-903. 10.1111/j.1365-2044.2007.05174.x.

    Article  CAS  PubMed  Google Scholar 

  15. Pandit JJ, Carey A: Estimating the duration of common elective operations: implications for operating list management. Anaesthesia. 2006, 61 (8): 768-776. 10.1111/j.1365-2044.2006.04719.x.

    Article  CAS  PubMed  Google Scholar 

  16. Ferschl MB, Tung A, Sweitzer B, Huo D, Glick DB: Preoperative clinic visits reduce operating room cancellations and delays. Anesthesiology. 2005, 103 (4): 855-859. 10.1097/00000542-200510000-00025.

    Article  PubMed  Google Scholar 

  17. van Klei WA, Moons KG, Rutten CL, Schuurhuis A, Knape JT, Kalkman CJ, Grobbee DE: The effect of outpatient preoperative evaluation of hospital inpatients on cancellation of surgery and length of hospital stay. Anesth Analg. 2002, 94 (3): 644-649. 10.1097/00000539-200203000-00030.

    Article  PubMed  Google Scholar 

  18. Rai MR, Pandit JJ: Day of surgery cancellations after nurse-led pre-assessment in an elective surgical centre: the first 2 years. Anaesthesia. 2003, 58 (7): 692-699. 10.1046/j.1365-2044.2003.03189_3.x.

    Article  CAS  PubMed  Google Scholar 

  19. O'Regan D, Shah S, Mirsadraee S, Al-Ruzzeh S, Karthik S, Jarvis M: Implementation of a process-orientated multidisciplinary approach (POMA), a system of cost-effective healthcare delivery within a cardiac surgical unit. Qual Saf Health Care. 2008, 17 (6): 459-463. 10.1136/qshc.2006.021279.

    Article  PubMed  Google Scholar 

  20. Levitt B, March JG: Organizational learning. Annu Rev Sociol. 1988, 14: 319-340. 10.1146/annurev.so.14.080188.001535.

    Article  Google Scholar 

  21. Rivard PE, Rosen AK, Carroll JS: Enhancing patient safety through organizational learning: Are patient safety indicators a step in the right direction?. Health Serv Res. 2006, 41 (4): 1633-1653. 10.1111/j.1475-6773.2006.00569.x.

    Article  PubMed  PubMed Central  Google Scholar 

  22. Hovlid E, Bukve O, Haug K, Aslaksen A, von Plessen C: A new pathway for elective surgery to reduce cancellation rates. BMC Health Serv Res. 2012, 12 (1): 154-10.1186/1472-6963-12-154.

    Article  PubMed  PubMed Central  Google Scholar 

  23. Crites GE, McNamara MC, Akl EA, Richardson WS, Umscheid CA, Nishikawa J: Evidence in the learning organization. Health Research Policy and Systems. 2009, 7: 4-10.1186/1478-4505-7-4.

    Article  PubMed  PubMed Central  Google Scholar 

  24. Argyris C, Schön DA: Organizational learning II: theory, method, and practice. 1996, Addison-Wesley, Reading, Mass

    Google Scholar 

  25. Kim DH: The link between individual and organizational learning. Sloan Manage Rev. 1993, 35 (1): 37-50.

    Google Scholar 

  26. Nonaka I: A dynamic theory of organizational knowledge creation. Organ Sci. 1994, 5 (1): 14-37. 10.1287/orsc.5.1.14.

    Article  Google Scholar 

  27. Plsek PE, Asq ASQ: Complexity and quality: New models for the new century. 2000

    Google Scholar 

  28. Plsek PE, Wilson T: Complexity science - Complexity, leadership, and management in healthcare organisations. Br Med J. 2001, 323 (7315): 746-749.

    Article  CAS  Google Scholar 

  29. Senge PM: The fifth discipline: the art and practice of the learning organization. 1990, Doubleday, New York

    Google Scholar 

  30. Nonaka I, Toyama R, Konno N: SECI, ba and leadership: a unified model of dynamic knowledge creation. Long Range Plann. 2000, 33 (1): 5-34. 10.1016/S0024-6301(99)00115-6.

    Article  Google Scholar 

  31. Edgren L: The meaning of integrated care: a systems approach. Int J Integr Care. 2008, 8: e68.

    Article  PubMed  Google Scholar 

  32. Plsek PE, Greenhalgh T: Complexity science - The challenge of complexity in health care. Br Med J. 2001, 323 (7313): 625-628. 10.1136/bmj.323.7313.625.

    Article  CAS  Google Scholar 

  33. Matlow AG, Wright JG, Zimmerman B, Thomson K, Valente M: How can the principles of complexity science be applied to improve the coordination of care for complex pediatric patients?. Qual Saf Health Care. 2006, 15 (2): 85-88. 10.1136/qshc.2005.014605.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  34. McDaniel RR, Driebe DJ: Complexity science and health care management. Advances in health care management. Edited by: Fottler MD, Savage GT, Blair JD, Payne GT. 2001, JAI, Amsterdam, 367 s-XVI

    Google Scholar 

  35. Yin RK: Case study research: design and methods. 2009, Sage, Los Angeles

    Google Scholar 

  36. Mays N, Pope C: Qualitative Research: Rigour and qualitative research. Br Med J. 1995, 311 (6997): 109-112. 10.1136/bmj.311.6997.109.

    Article  CAS  Google Scholar 

  37. Patton MQ: Qualitative research & evaluation methods. 2002, Sage Publications, London

    Google Scholar 

  38. Lincoln YS, Guba EG: Naturalistic inquiry. 1985, Sage, Beverly Hills

    Google Scholar 

  39. Creswell JW: Qualitative Inquiry & Research Design: Choosing Among Five Approaches. 2007, Sage Publications, Thousand Oaks, California

    Google Scholar 

  40. Kvale S, Brinkmann S: Interviews: learning the craft of qualitative research interviewing. 2009, Sage, Los Angeles

    Google Scholar 

  41. Barbour RS: Checklists for improving rigour in qualitative research: a case of the tail wagging the dog?. Brithish Medical Journal. 2001, 322 (7294): 1115-1117. 10.1136/bmj.322.7294.1115.

    Article  CAS  Google Scholar 

  42. Mays N, Pope C: Assessing quality in qualitative research. BMJ. 2000, 320 (7226): 50-52. 10.1136/bmj.320.7226.50.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  43. Cilliers P: Complexity and postmodernism: understanding complex systems. 1998, Routledge, London

    Google Scholar 

  44. Miller JH, Page SE: Complex adaptive systems: an introduction to computational models of social life. 2007, Princeton University Press, Princeton, N.J.

    Google Scholar 

  45. Fixsen DL, Naoom SF, Blase KA, Friedman RM, Wallace F: Implementation Research: A Synthesis of the Literature. 2005, University of South Florida, Louis de la Parte Florida Mental Health Institute, Tampa, FL

    Google Scholar 

  46. Berwick DM: Crossing the boundary: changing mental models in the service of improvement. International Journal For Quality In Health Care. 1998, 10 (5): 435-441. 10.1093/intqhc/10.5.435.

    Article  CAS  PubMed  Google Scholar 

  47. Batalden PB, Davidoff F: What is "quality improvement" and how can it transform healthcare?. Qual Saf Health Care. 2007, 16 (1): 2-3. 10.1136/qshc.2006.022046.

    Article  PubMed  PubMed Central  Google Scholar 

  48. Batalden PB, Godfrey MM, Nelson EC: Quality by design: A clinical microsystems approach. 2007, Jossey-Bass, San Francisco

    Google Scholar 

  49. Carroll JS, Edmondson AC: Leading organisational learning in health care. Qual Saf Health Care. 2002, 11 (1): 51-56. 10.1136/qhc.11.1.51.

    Article  CAS  PubMed  Google Scholar 

  50. Edmondson AC: Learning from failure in health care: frequent opportunities, pervasive barriers. Qual Saf Health Care. 2004, 13: 3-9. 10.1136/qshc.2003.008631.

    Article  Google Scholar 

  51. Tucker AL, Edmondson AC: Why hospitals don't learn from failures: Organizational and psychological dynamics that inhibit system change. Calif Manage Rev. 2003, 45 (2): 55-72. 10.2307/41166165.

    Article  Google Scholar 

  52. Brandrud AS, Schreiner A, Hjortdahl P, Helljesen GS, Nyen B, Nelson EC: Three success factors for continual improvement in healthcare: an analysis of the reports of improvement team members. BMJ Qual Saf. 2011, 20 (3): 251-259. 10.1136/bmjqs.2009.038604.

    Article  PubMed  Google Scholar 

  53. Batalden PB, Nelson EC, Mohr JJ, Godfrey MM, Huber TP, Kosnik L, Ashling K: Microsystems in health care: Part 5. How leaders are leading. Jt Comm J Qual Improv. 2003, 29 (6): 297-308.

    Google Scholar 

  54. Øvretveit J: The leaders role in Quality and safety improvement. 2005, http://194.103.189.144/upload/Webbplatser/Utvecklingscentrum/dokument/ledarens_roll_engelsk.pdf%20(Accessed February 16th 2012):%20Sveriges%20Kommuner%20och%20Landsting.

    Google Scholar 

  55. Ovretveit J: Integrated quality development in public healthcare. Continuing Education and Quality Improvement. 1999, Norwegian Medical Association, Oslo, 128.

    Google Scholar 

  56. Dixon-Woods M, Bosk CL, Aveling EL, Goeschel CA, Pronovost PJ: Explaining Michigan: developing an ex post theory of a quality improvement program. Milbank Q. 2011, 89 (2): 167-205. 10.1111/j.1468-0009.2011.00625.x.

    Article  PubMed  PubMed Central  Google Scholar 

  57. Patton MQ: Enhancing the quality and credibility of qualitative analysis. Health Serv Res. 1999, 34 (5 Pt 2): 1189-1208.

    CAS  PubMed  PubMed Central  Google Scholar 

  58. Chien AT, Walters AE, Chin MH: Community health center quality improvement: a systematic review and future directions for research. Progress in community health partnerships: research, education, and action. 2007, 1 (1): 105-116. 10.1353/cpr.0.0002.

    Article  Google Scholar 

  59. Gruen RL, Elliott JH, Nolan ML, Lawton PD, Parkhill A, McLaren CJ, Lavis JN: Sustainability science: an integrated approach for health-programme planning. Lancet. 2008, 372 (9649): 1579-1589. 10.1016/S0140-6736(08)61659-1.

    Article  PubMed  Google Scholar 

  60. Wensing M, Bosch M, Foy R, van der Weijden T, Eccles M, Grol R: Factors in Theories on Behaviour Change to Guide Implementation and Quality Improvement in Health Care. 2005, Centre for Quality of Care Research (WOK), Nijmegen, 2005

    Google Scholar 

  61. Doyle JK: The cognitive psychology of systems thinking. Syst Dyn Rev. 1997, 13 (3): 253-265. 10.1002/(SICI)1099-1727(199723)13:3<253::AID-SDR129>3.0.CO;2-H.

    Article  Google Scholar 

Pre-publication history

Download references

Acknowledgments

We thank the employees and management at Førde Hospital for allowing us to assess their improvement project, for providing access to data, and for participating in interviews.

We also thank Professor Paul Batalden for reading an early version of the manuscript and providing valuable comments.

This work was supported in part by the Research Council of Norway, Sogn and Fjordane University College, and the National Centre of Rural Medicine in Norway. The sponsors had no role in the design and conduct of the study; collection, management, analysis, and interpretation of the data; or preparation, review, or approval of the manuscript.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Einar Hovlid.

Additional information

Competing interests

The authors have no competing interests.

Authors’ contributions

EH designed the study, collected the data, analyzed the data and drafted the manuscript. OB participated in the design of the study, the analysis of data and helped to draft the manuscript. KH participated in the design of the study and helped to draft the manuscript. ABA participated in the design of the study and helped to draft the manuscript. CVP participated in the design of the study, the analysis of the data and helped to draft the manuscript. All authors read and approved the final manuscript.

Authors’ original submitted files for images

Below are the links to the authors’ original submitted files for images.

Authors’ original file for figure 1

Rights and permissions

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and permissions

About this article

Cite this article

Hovlid, E., Bukve, O., Haug, K. et al. Sustainability of healthcare improvement: what can we learn from learning theory?. BMC Health Serv Res 12, 235 (2012). https://doi.org/10.1186/1472-6963-12-235

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/1472-6963-12-235

Keywords