SARS and hospital priority setting: a qualitative case study and evaluation
BMC Health Services Research volume 4, Article number: 36 (2004)
Priority setting is one of the most difficult issues facing hospitals because of funding restrictions and changing patient need. A deadly communicable disease outbreak, such as the Severe Acute Respiratory Syndrome (SARS) in Toronto in 2003, amplifies the difficulties of hospital priority setting. The purpose of this study is to describe and evaluate priority setting in a hospital in response to SARS using the ethical framework 'accountability for reasonableness'.
This study was conducted at a large tertiary hospital in Toronto, Canada. There were two data sources: 1) over 200 key documents (e.g. emails, bulletins), and 2) 35 interviews with key informants. Analysis used a modified thematic technique in three phases: open coding, axial coding, and evaluation.
Participants described the types of priority setting decisions, the decision making process and the reasoning used. Although the hospital leadership made an effort to meet the conditions of 'accountability for reasonableness', they acknowledged that the decision making was not ideal. We described good practices and opportunities for improvement.
'Accountability for reasonableness' is a framework that can be used to guide fair priority setting in health care organizations, such as hospitals. In the midst of a crisis such as SARS where guidance is incomplete, consequences uncertain, and information constantly changing, where hour-by-hour decisions involve life and death, fairness is more important rather than less.
As of August 12, 2003 there were 438 probable and suspected cases of Severe Acute Respiratory Syndrome (SARS) in Canada – the majority located in Toronto. In Toronto there were forty-four SARS related deaths and over 100 health care workers contracted SARS, placing intense pressure on Toronto's public health and hospital system .
Due to both the importance of hospitals in any health system and the difficulties they face, improving priority setting (also known as rationing or resource allocation) within hospitals is crucial. Priority setting is one of the most difficult issues facing hospitals because of funding restrictions and changing patient need. A deadly communicable disease outbreak, such as SARS in Toronto in 2003, amplifies the difficulties of hospital priority setting.
Key goals of priority setting in any context are legitimacy and fairness. 'Accountability for reasonableness' is an explicit ethical framework for legitimate and fair priority setting in health care . It is internationally recognized as a framework that can guide priority setting in health systems and their institutions [3–5]. According to 'accountability for reasonableness', an institution's priority setting may be considered fair if four conditions are met: relevance, publicity, appeals, and enforcement (see Table 1).
In 2003, the outbreak of SARS further challenged priority setting decision makers in Toronto hospitals, creating decision making difficulties in relation to both SARS and non-SARS patients. To what extent should the need for containment over-ride other important needs? To what extent should the need for quick decisions over-ride the need for legitimate and fair decision making?
Only a few studies have directly examined priority setting in hospitals – two focused on technology acquisition [6, 7], one on strategic planning , one on a hospital drug formulary , and two on hospital ICUs [10, 11]. The latter four studies used 'accountability for reasonableness' as the study framework. To our knowledge there have been no studies of hospital priority setting during an emergency response to a communicable disease outbreak.
The purpose of this study was to describe priority setting in a hospital in response to SARS and evaluate it using 'accountability for reasonableness'.
To describe priority setting we used qualitative case study methods. A case study is "an empirical inquiry that investigates a contemporary phenomenon within its real-life context" . This is an appropriate method because priority setting in hospitals is complex, context-dependent, and involves social processes. To evaluate the description we used the four conditions of 'accountability for reasonableness' (described in Table 1).
This case study was conducted at a large tertiary hospital in Toronto, Canada.
We sampled key documents and people. We used theoretical sampling to determine which people and documents were 'key'. Included among the individuals sampled were senior administrators, managers, physicians, nurses, patients and family members.
There were two sources of data: (1) over two hundred key documents (e.g. emails, minutes of meetings), and (2) 35 interviews with key informants (senior administrators (6), physicians (10), managers (5), nurses (5), a patient (1), family members (2), and other staff (6)). Interviews were audiotaped and transcribed. Interview participants were asked to describe priority setting decisions in relation to SARS and their thoughts about it. We developed an interview guide based on previous research and improved it through pilot interviews with personnel from other hospitals. As is traditional with qualitative studies, the interview guide was modified during the study to explore emerging themes.
The data were analyzed concurrent with collection using a modified thematic approach in three phases: open coding, axial coding, and evaluation. In open coding, the data were fractured by identifying chunks of data that relate to a concept or idea. In axial coding, the concepts were organized under overarching themes (i.e. the four conditions of 'accountability for reasonableness'). In evaluation, the descriptive data were compared with the conditions of 'accountability for reasonableness' – correspondence with the framework was considered 'good practice'; instances where the conditions are not met were considered 'opportunities for improvement'. Concepts were formalized and made explicit through the writing of the findings .
The validity of the interpretations was enhanced in four ways . First, the coding was conducted in collaboration between two researchers, thus limiting the influence of any one person's biases. Second, the coding was reviewed and modified by an interdisciplinary team who provided challenges that were resolved through consensus. Third, the findings were presented to participants who verified the findings – traditionally called a 'member check'. Finally, all research activities were rigorously documented to permit a critical appraisal of the methods .
Approval for this project was obtained from the participating hospital's Research Ethics Board. Written informed consent was obtained from each individual before being interviewed. All data were kept confidential and viewed only by the research team. No individuals have been identified without their explicit agreement.
In this section we describe one hospital's priority setting in response to SARS by focusing on the types of decisions, the decision making process, and the supportive reasoning. We then evaluate our findings using the four conditions of 'accountability for reasonableness'. We have also included verbatim quotes from participants to illustrate key points.
I. Description of priority setting
Types of priority setting decisions
There were two distinct phases of priority setting at the hospital during the SARS outbreak. First, during the initial days of the outbreak, decisions were made in order to contain the spread of the virus. The Ontario Ministry of Health and Long-Term Care (MOHLTC) directed Toronto acute care hospitals to establish or maintain as necessary a SARS isolation area, restrict patient visits, limit visitors and suspend selected patient transfers. Second, after the initial weeks of the outbreak, was a 'ramp up' phase during which the hospital gradually increased its level of activity. Throughout both phases, priority setting decisions can be organized according to four specific types: decisions relating to staff and patients, beds/rooms, clinical activity, and visitors.
1) Staff and patients
Staff were allocated for SARS patients in the SARS unit and ICU, screening at the doors, manning the site command centre, or helping out in occupational health; pregnant and immunosuppressed staff were either redeployed to low-risk activities or sent home; staff deemed non-essential were sent home with pay; students were sent home and educational rounds were cancelled. General medicine patients were transferred to other medical units to maintain the SARS isolation unit; out-patients who had been waiting for non-emergency surgery or clinic appointments were told to wait indefinitely.
The SARS isolation unit required negative pressure beds. The hospital created these spaces in a specific isolation unit on a general medicine floor, and in the ICU and Emergency. Admissions to negative pressure beds were decided case-by-case and were based on the assessment of the referring physician, the hospital's infectious disease representative, and the hospital intensivist.
3) Clinical activity
All non-emergency surgery and ambulatory care were cancelled during the initial 7–10 days of SARS. During the ramp up phase, clinical activity volumes increased in percentages allowing for urgent cases to be seen as determined by physicians. Operating room time was allotted by division – each individual surgeon reported to their division head the cases they considered urgent. This activity was coordinated by the hospital's command center.
A 'no visitors' policy was enforced during the initial stages of SARS except for compassionate grounds as determined by the nurse manager or nurse in charge of the particular unit, in consultation with the attending physician and the hospital command centre. During the ramp up phase, the hospital relaxed the no visitor policy according to changing directives from the MOHLTC and the human resources available for screening at the doors.
Decision making process
Priority setting decisions were made across all levels of the institution. We identified four groups of key decision makers: Corporate Command, Hospital Command, Department Management/Chiefs, and Individual Clinicians. MOHLTC directives were interpreted by a team of senior administrators (corporate command) and then communicated to the hospital's command centre. The hospital's command centre implemented the recommendations from the corporate command in accordance with patient population requirements and physical logistics. Department managers and clinical staff also participated in allocating human resources and determining patient care priorities. The corporate command was in constant communication with the hospital's command centre who maintained communication with the managers and other leaders through teleconferencing and email.
Priority setting reasoning
Throughout each stage of the SARS outbreak, safety was the primary rationale underpinning priority setting. During the early stages of SARS, decisions were made for infection control focused on protecting staff. During the ramp up phase, decisions were based more on a duty to care for patients, emphasizing the hospital's role in the community. However, in addition, there were several other reasons used in support of each decision (See Figure 1).
During the ramp up phase the reasoning shifted to address patient need. Leaders recognized that the hospital could not operate under the shut down conditions for very long; urgent cases were quickly becoming emergent. Thus, though staff and patient safety remained a primary concern, very few of the decisions can be linked solely to safety; rather, decisions involved clusters of reasons. Table 2 describes decisions made, the reasons used, and the level at which they were made.
II. Evaluation of priority setting using 'accountability for reasonableness'
Many participants confirmed that staff and patient safety was, appropriately, the primary criterion used in the decision making process.
"I think due to the fact that this was so communicable, and I think, certainly felt, most people felt this was all being done in our best interest."
Some expressed concern about the relevance of the reasoning used in the allocation of OR time and the visitor policy. For example, one surgeon commented that the OR schedule was allocated by division as opposed to being allocated by patient need. Similarly, the visitor policy was appreciated by family members of patients on an abstract level but some still could not understand why exceptions to the policy could not be made in certain instances.
Many participants found it difficult to evaluate the relevance of the reasons underlying many of the MOHLTC directives because the directives did not explicitly describe the reasoning involved.
Priority setting decisions and the reasons behind them were readily accessible to those directly involved in making the decisions. However, even though decisions and reasons were regularly distributed via email, or posted on the hospital intranet and world-wide web, many felt that communication beyond the core group of decision makers was incomplete. At the height of the crisis, MOHLTC directives were changing almost hourly, and this made real-time communications to the front lines difficult. It was generally felt that communication was excellent, with room for improvement.
"Even though we have a very good communications team you know some people are still left out of the loop – they don't read the paper they don't listen to the radio they don't read their emails or they don't have email. So, there are still small pockets of lack of or miscommunication, so communication is always something that we need to improve."
There was no formal revisions/appeals mechanism. Instead the hospital CEO felt it was important to address all disagreements personally. Many participants thought there were ample opportunities for informal discussion and debate in meetings and email communication. However, one participant commented that without formal appeals mechanisms, some stakeholders participated unfairly by using a 'squeaky wheel' approach.
" [B]y appealing the process, the sickly squeaky wheel method of appeal, we just begged, pleaded, ranted, raved, called back, called back."
Overwhelmingly, participants thought the process was as fair as it could have been given the time constraints and the knowledge base at the particular time. The hospital leadership made an effort to meeting the conditions of 'accountability for reasonableness'. However, some felt that the decision making was not ideal.
"At a moment of crisis which I think that SARS was, there's not always opportunity for full and open and even decision making."
Some stated that more support and accountability implementing decisions could have occurred – that there was a gap between the decisions that were made in high level administration and the implementation of those decisions at the front lines.
"Most of us felt, you know the decisions were made, up there, and we could understand them, we could agree with them, but we were the ones who had to live with them. And there was nobody who really came and asked us what that was like. There was some, it wasn't that there was nothing – but there wasn't a sense of being listened to the way that we needed to be listened to, the way that we needed to be supported."
Some participants expressed concern that many staff started relying on senior management to make many of the decisions for them.
"When you go into another mode that commands and controls, doesn't take too long until you understand how comfortable and actually how easy that is. It is way easier to do what you're told."
This study examined priority setting at one Toronto hospital as it responded to the 2003 SARS crisis. Even though the crisis created safety concerns and time constraints that impinged upon decision making, this hospital endeavoured to meet the four conditions of 'accountability for reasonableness'.
By describing and evaluating priority setting using the four conditions of 'accountability for reasonableness', we are able to identify examples of 'good practices' that other hospital should emulate, and 'opportunities for improvement' that this and other hospitals should consider.
We identified the following good practices: 1) staff and patient safety was the primary criterion in decision making, but each decision was based on a cluster of relevant reasons – decision makers' use of clusters of relevant reasons has been identified and discussed in a previous study , 2) decisions were regularly accessible on hospital email, intranet and the world-wide web; 3) challenges were addressed directly by the CEO; 4) hospital leadership made a concerted effort to meet the conditions of 'accountability for reasonableness'. We also identified the following opportunities for improvement: 1) patients and families did not have access to the reasons for many decisions, including the visitation policy and ramp-up of clinical activities; 2) a formal revision/appeals mechanism could help improve the quality of decision making and alleviate the unfair reliance on the 'squeaky wheel' phenomenon; 3) OR time was allocated by division, rather than by patient need, and these decisions should be discussed more fully; 4) institutional leaders should maintain two-way contact with front-line staff who are implementing priority setting decisions – this will provide support and enhance accountability for decision making by staff.
'Accountability for reasonableness' is a framework that can be used to guide legitimate and fair priority setting in health care organizations, such as hospitals. It assumes that the time and effort required for meeting the conditions of fairness is justified for two reasons: First, it is important to act ethically and be perceived to be acting ethically – in this case, fairly. Second, acting ethically can help an organization achieve 'goodwill' benefits including, but not limited to, increased trust and satisfaction and decreased complaints. However, it is clear from this scope of decisions examined in this study that time constraints imposed on a health care organization by a highly communicable and potentially fatal infectious disease creates significant priority setting difficulties. It may appear that the conditions of 'accountability for reasonableness' are too demanding to implement in the time constraints – that perhaps containment should take precedence over procedural requirements. We disagree. During the SARS outbreak the hospital's leadership developed and implemented several sophisticated processes to help with their crisis management. Tailoring those processes to meet the four conditions of 'accountability for reasonableness' is not any more difficult or demanding. Moreover, we argue, and some of the participants also argued, that in the midst of a crisis where guidance is incomplete, consequences uncertain, and information constantly changing, where hour-by-hour decisions involve life and death, fairness is more important rather than less.
Our findings are limited in that they may not be generalizable to other hospitals. However, generalizability is not the goal of qualitative studies like this. We expect that other hospitals may benefit from the insights provided in this study. For example, this was the first time that 'accountability for reasonableness' has been used to evaluate priority setting in response to an infectious disease outbreak. Other hospitals in similar crises can use 'accountability for reasonableness' to help evaluate and enhance the fairness of their priority setting .
The best assurance of fair priority setting in a crisis is fair priority setting everyday. A health care organization that incorporates legitimate and fair decision making everyday, where the decision making culture of the organization is permeated with the conditions of 'accountability for reasonableness', will be primed to meet the challenges of fair priority setting in a crisis. This may be the most important lesson to take from this study.
Health Canada: Learning From SARS: Renewal of Public Health in Canada. 2003, [http://www.hc-sc.gc.ca/english/protection/warnings/sars/learning.html]
Daniels N, Sabin J: Setting Limits Fairly: can we learn to share medical resources. 2002, Oxford, UK: Oxford University Press
Martin DK, Giacomini M, Singer PA: Fairness, accountability for reasonableness, and the views of priority setting decision-makers. Health Policy. 2002, 61 (3): 279-90. 10.1016/S0168-8510(01)00237-8.
Ham C, McIver S: Contested Decisions: Priority setting in the NHS. 2000, London, UK: King's Fund Publishing
Ham C, Roberts G, eds: Reasonable Rationing: International Experience of Priority Setting in Health Care. 2003, Maidenhead, UK, Open University Press
Deber R, Wiktorowicz M, Leatt P, Champagne F: Technology Acquisition in Canadian Hospitals: How is it done, and where is the information coming from?. Healthcare Management Forum. 1994, 7 (4): 18-27.
Deber R, Wiktorowicz M, Leatt P, Champagne F: Technology Acquisition in Canadian Hospitals: How are We Doing?. Healthcare Management Forum. 1995, 8 (2): 23-8.
Martin D, Shulman K, Santiago-Sorrell P, Singer P: Priority setting and hospital strategic planning: a qualitative case study. Journal of Health Services Research and Policy. 2003, 8 (4): 197-201. 10.1258/135581903322403254.
Martin DK, Hollenberg D, MacRae S, Madden S, Singer PA: "Priority Setting in a Hospital Formulary: A Qualitative Case Study". Health Policy. 2003, 66: 295-303. 10.1016/S0168-8510(03)00063-0.
Martin DK, Singer PA, Bernstein M: Access to intensive care unit beds for neurosurgery patients: a qualitative case study. Journal of Neurology, Neurosurgery and Psychiatry. 2003, 74: 1299-1303. 10.1136/jnnp.74.9.1299.
Mielke J, Martin DK, Singer PA: Priority setting in a hospital critical care unit: qualitative case study. Critical Care Medicine. 2003, 31 (12): 2764-8. 10.1097/01.CCM.0000098440.74735.DE.
Yin RK: Case Study Research: Design and Methods. 1994, Thousand Oaks, CA: Sage Publications, Inc
Altheide DL, Johnson JM: "Criteria for assessing interpretive validity in qualitative research.". In: Handbook of qualitative research. Edited by: Denzin NK, Lincoln YS. 1994, Thousand Oaks, CA: Sage Publications, Inc, 485-99.
Richardson L: "Writing: a method of inquiry.". In: Handbook of qualitative research. Edited by: Denzin NK, Lincoln YS. 1994, Thousand Oaks, CA: Sage Publications, Inc
Mays N, Pope C: Rigour and qualitative research. British Medical Journal. 1995, 311: 109-12.
Martin DK, Pater JL, Singer PA: Priority Setting Decisions for New Cancer Drugs: A Qualitative Study. Lancet. 2001, 358: 1676-81. 10.1016/S0140-6736(01)06714-9.
Martin DK, Singer PA: A Strategy to Improve Priority Setting in Health Care Institutions. Heath Care Analysis. 2003, 11: 59-68. 10.1023/A:1025338013629.
The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1472-6963/4/36/prepub
The authors wish to thank all the administrators, physicians, nurses, staff, patients, and family members who participated in this study.
This research project was funded by an Interdisciplinary Capacity Enhancement grant to the Canadian Priority Setting Research Network from the Canadian Institute for Health Research. Martin is supported by an Ontario Ministry of Health and Long-Term Care Career Scientist Award. Upshur is supported by a Canadian Institutes of Health Research New Investigator Award.
SH and MB are employees of the organization studied here.
JB was primarily responsible for acquisition and analysis of data. All authors made substantial contributions to conception and design of the study, data analysis and interpretation, and have been involved in drafting the article or revising it critically for important intellectual content. All authors have given final approval of the version to be published.
Authors’ original submitted files for images
Below are the links to the authors’ original submitted files for images.
About this article
Cite this article
Bell, J.A., Hyland, S., DePellegrin, T. et al. SARS and hospital priority setting: a qualitative case study and evaluation. BMC Health Serv Res 4, 36 (2004). https://doi.org/10.1186/1472-6963-4-36