Patient severity matters for night-shift workload for internal medicine residents in Taiwan
BMC Health Services Research volume 14, Article number: 587 (2014)
Although work hour is an important factors for resident workload, other contributing factors, such as patient severity, with regards to resident workload have been scarcely studied.
A prospective observational cohort study was conducted in a general medicine unit in an academic medical center in Taiwan. Every event for which the nurses needed to call the on-call residents was recorded. To quantify the workload, the responses of on-duty residents to calls were analyzed. To allow comparisons of patient factors to be made, we classified all patients by assigning them stable, unstable, or do-not-resuscitate (DNR) codes. The reasons for the calls were categorized to facilitate the comparisons across these three groups.
From October 2009 to September 2011, a total of 2,518 patients were admitted to the general medicine unit. The nurses recorded a total of 847 calls from 730 call nights, ranging from 0 to 7 per night. Two peaks of calls, at 0-2 am and 6-7 am, were noted. Calls from stable, unstable, and DNR patients were 442 (52.2%), 95 (11.2%), and 298 (35.2%), respectively. For both unstable and DNR patients, the leading reason was abnormal vital signs (62.1% and 67.1%, respectively), while only 36.2% for stable patients. Both unstable and DNR patients required more bedside evaluation and management compared to stable patients.
Beyond work hours and patient census, patients with different clinical severity and palliative goal produce different workload for on-call residents.
Shift work, which improves inpatient care during after-hours and on weekends, is an essential component of current inpatient care models . The main workload during on-call shifts includes caring for previously admitted patients and managing new admissions, if any . However, criticism of shift work has been ongoing for decades, mostly as a result of the sleep deprivation and the impaired neuropsychological performance of the workers, which raised concerns about patient safety .
The Accreditation Council for Graduate Medical Education (ACGME) in the United States mandated limits on resident work hours in 2003, including a 30-hour limit on continuous shifts . Most controversy focused only on the positive and negative effects of work hour restrictions ,, until the conceptual framework of work intensity was emphasized again recently by Horner and coworkers . In Horner’s framework, patient factors, provider factors and practice-based factors were three essential confounders for clinical work demand, which in turn contributed to physician work intensity and influenced physician health and patient outcomes. Work hours, which could be classified as practice factors in the Horner’s model, is one of the contributing factors of workload which has been investigated quite often. However, provider factors and patient factors were relatively neglected in the current literature.
To improve residents’ health, it is reasonable to reduce the night workload as much as possible, unless this could compromise patient safety or quality of care . Libby and coworkers investigated the importance rating of beeper calls to interns, and revealed that nearly 60% of the calls were not relevant to patient care and 37% interrupted teaching or patient-physician interactions . Some researchers also revealed that nurses and doctors exhibited different patterns of paging . Some authors therefore advocated that unnecessary calls at night should be reduced. In addition, paging frequently interrupted work and rest at night . However, few studies have attempted to predict night workload and to devise ways to achieve reasonable on-call workloads. The reasons of calling on-duty residents have been extensively studied in several different settings, but the sources of calls which could be helpful in predicting workload were rarely mentioned. Calls from stable, critically ill patients, or patients in other special conditions, may led to different pattern of care.
In order to contribute to the groundwork of establishing reasonable on-call workload, our research aims to study the night-shift workload for residents and focuses on not only the reasons of placing calls at night, but also the patient sources of calls and workload produced after the calls. Although workload is usually measured by census of patient encounter, we hypothesized that resident workload is associated with patient severity. By comparing the reasons of calls and workload produced after calls, our hypothesis that different patient produced different resident workload could be tested.
The study was conducted at the National Taiwan University Hospital (NTUH), a 2,000-bed, acute care, university-affiliated tertiary referral medical center in northern Taiwan. A hospitalist acute general medicine ward was set up in October 2009, with three attending physicians and eight nurse practitioners, to admit general medicine patients from the emergency department . Hospitalists, who had general internal medicine background, served as the in-charge attending physicians for hospitalized patients. The study was based on a longitudinal hospitalist research which was approved by the Research Ethical Committee of NTUH (registration number: 201112161RIC).
Three shifts were designed for our hospitalist system in 2009 and remained unchanged during the study period. The day shift, which started at 8 am and ended at 5 pm, handled 36 beds before the bridge hospitalist came. After that, the day shift person continued handling 18 beds, and handed the other 18 beds over to the bridge person. The bridge shift started at 1 pm and ended at 11 pm, handling initially 18 beds and subsequently, after the day person signed off, 36 beds. New admissions from the emergency department (ED), which typically presented between 11 am and 5 pm, were assigned to both the day shift and the bridge hospitalists. Because numerous ED patients were awaiting admission, all available beds would be fully occupied in the evening, and night shift admissions were rare. The night shift was from 11 pm to 8 am the next morning, taking handoffs from the bridge shift, and covered 36 beds overnight. Nurse practitioners were assigned the day and bridge shift hospitalists, while residents were assigned the night shift hospitalist. Residents were the first to receive calls from the night shift nurses, and they were supervised by a night shift hospitalist. In our hospitalist program, the resident’s workload was restricted to 24 hours per shift, with at least an 18-hour rest period after an on-call shift. Each hospitalist, resident, and nurse practitioner had a low-power mobile phone for communicating with each other.
From the beginning of the hospitalist ward, a standard night shift event record form was designed. The night shift nurses, who worked from 11 pm to 8 am, were responsible for recording every event that required calling the on-duty residents. The record sheets were handed to the day shift hospitalists the following day. To avoid observation effect, the on-call residents were blinded to the whole study.
The prospective data collection was analyzed in our study. The night shift record form included the time of the call, the categorized clinical state of the patient, the categorized call reason, vital signs at the time when the call was placed, subsequent evaluation and management by the resident, and the nurses’ satisfaction with the whole management process.
Because the patient severity or acuity changed throughout the hospitalized course, it should be measured at the time when the call was placed. To test our hypothesis that workload is associated with patient severity, patients were classified as do-not-resuscitate (DNR) and non-DNR. Non-DNR patients were further labeled as stable and unstable. Non-DNR patients who met the criteria of clinical alert signs were classified as “unstable”, and nurses knew that they should immediately inform residents or attending physicians. The clinical alert sign system of NTUH included 10 items, which have been published in the literature . The red color would be shown on the electronic health information system (HIS) until the warning signs disappeared. Patients with DNR consents were classified as “DNR”, with a green color on the HIS. The remaining patients had no colors presented in association with their status, and were classified as “stable” in our study. The three-colored patient classification system remained unchanged during the study period.
In order to analyze the workload, the response of the residents was classified as a telephone order, or an immediate or delayed bedside evaluation and management. According to regulations in our hospital, a telephone order had to be repeated, confirmed, and written down by nurses, and residents had to follow the patient and complete standard orders from residents within their shift. Residents could fill prescriptions through the electronic system, and they did not have to go to the nurses’ station for prescribing simple medications, such as sleeping pills and antipyretics. When evaluation or management was necessary, the on-call resident decided whether an immediate (within 15 minutes) bedside visit was required. A bedside visit that occurred over 15 minutes after a call had been placed was defined as a delayed bedside visit . Nurses recorded the actual time lag between the call and the visit. In our study, direct patient care workload was defined as bedside visits by the on-call residents.
The reasons for placing a call were classified into six categories by night shift nurses: (1) abnormal vital signs, (2) original symptom/problem, (3) new-onset symptom/problem, (4) need for physician’s evaluation, prescription, or procedure, (5) need for explanation/communication, and (6) others. The former categories had priority over the later ones. For instance, if a new symptom was associated with abnormal vital signs, such as fever or tachycardia, the call was classified as being placed for an abnormal vital sign. Mild, asymptomatic hypoglycemia required a physician’s evaluation, but symptomatic hypoglycemia was coded as a new-onset symptom/problem. Requests for sleeping pills or painkillers were coded as a need for physician’s evaluation, prescription, or procedure. To address the problems opened by the possibility of multiple choices, the daytime attending physician confirmed the nurses’ record sheets the next day.
The night shift nurses who participated in our study were requested to complete an informed consent process by the institutional review board of NTUH, and their satisfaction with on-duty resident’s management was measured using a Likert scale that included five level of satisfaction: very satisfied, satisfied, unsure, dissatisfied, and very dissatisfied.
The categorization and definition of the study parameters are shown in Table 1.
The data were analyzed using the SPSS software (version 16, SPSS Inc., Chicago, IL, USA). We compared the basic demographic data, the reasons for night calls, residents’ responses, the time until bedside visits, and nurses’ satisfaction scores in the stable, unstable, and DNR patient groups. Inter-group differences were compared using the Pearson Chi-square test for dichotomous and categorical variables, and the one-way ANOVA test for continuous variables.
Night shift calls
From October 2009 to September 2011, a total of 2518 patients were admitted to the hospitalist ward. Table 2 depicts the demographic data of all patients. Within 2 years, a total of 847 night shift calls were recorded by 16 nurses in 730 call nights. The number of call ranged from 0 to 7 per night. Table 3 comparatively presents the characteristics of the calls.
Stable, unstable, and DNR patients accounted for 442 (52.2%), 95 (11.2%), and 298 (35.2%), respectively, of all the calls. For both unstable and DNR patients, the leading reason for placing the calls was abnormal vital signs (62.1% and 67.1%, respectively). For stable patients, the reasons for the calls were relatively balanced among abnormal vital signs (36.2%), new-onset symptoms or problems (24.7%), and the need for an evaluation, prescription, or procedure (24.7%). The call reasons were statistically different by Pearson Chi-square test (p < 0.001).
Figure 1 depicts the distribution of 841 calls (the time records were missing for 6 of the calls) on an hourly basis throughout the night shift. Two peaks, at 0-2 am and 6-7 am, were noted. The variation was more prominent for stable and DNR codes than for the unstable code, for which the rate of the calls remained almost constant throughout the night shift.
On-call resident’s responses
Forty-five residents were observed, and their responses were recorded on 670 (79.7%) forms. The percentage of bedside visits was 33.8%, 50.6%, and 56.1%, and that of immediate (within 15 minutes) visits was 23.7%, 35.3%, and 32.5% after calls received from stable, unstable, and DNR patients, respectively (p < 0.001 by Pearson Chi-square test for immediate visit, delayed visit, and no visit). Regarding the direct patient care workload of on-duty residents, from 289 bedside visits, 40.5%, 14.9%, and 44.3% were from stable, unstable, and DNR patients, respectively.
A total of 819 satisfaction reports from nurses were available for analysis (data were missing for 22 calls). The nurses were “very satisfied” and “satisfied” in 46.6% and 36.8%, of these, respectively, and their level of satisfaction was slightly higher for unstable patients (91.3%) than for stable (83.4%) and DNR ones (80.9%), but did not reach statistical significance (p = 0.147).
Residents’ responses to calls depended on the situation of calls and were therefore complex. Although patients had been labeled as “unstable” in the beginning of the night shift, the nurses might call the resident just to clarify an order or request a sleep pill. It was shown that only 62.1% of calls from unstable patients were due to abnormal vital signs, which may explain why only 50.6% calls required bedside visit by on-call residents. Compared to “stable” patients who only required 33.8% bedside visits by residents, patients labeled as “unstable” produced higher workload.
We believe that our study is the first report about the relationship between patient factors and resident workload. In the conceptual model proposed by Horner, patient factors, provider factors and practice factors contributed to the clinical work demands and work intensity, which in turn influences patient outcomes . Most previous studies addressed the practice factors, such as duty hour design and protected sleep time for residents . However, clinical severity of patient, which is an important patient factor in Horner’s framework, has been scarcely taken into consideration on workload studies.
In the pager era, several ground work studies have already been conducted. Previous studies have revealed the fact that half of pager calls were not relevant to patient care, and most of them did not affect immediate patient management ,. Beebe also conducted important work that investigated the reasons for beeper calls and rated their urgency. Two important findings were that the most common reason for calls (29%) was a change in the patient’s status, and that ratings of urgency made by nurses were not good predictors of the physicians’ responses to the call . However, both studies included complex patient populations, including ward and ICU patients in the former, and pediatric, medical, surgical, and orthopedic patients in the latter. The work done by Katz et al. revealed that nurses and doctors exhibited different patterns of paging medical interns and highlighted unnecessary pages . The study included only medical patients, however it had the limitations of covering relatively short time periods and performing in 1980s. Besides, none of the previous studies attempted to identify and compare the reasons for the calls among different patient groups.
We investigated the sources and reasons of the after-hours calls, their patterns, and the on-call workload in an acute-care general medicine population, and we used a sufficiently long study period. The most valuable finding in our study is that the reasons of night-shift calls were significantly different in patients from different clinical status categories. The workload produced after calls and the behavior pattern of the on-duty residents were also different. In the future, we may predict on-call workload by analyzing the clinical severity status of responsible patients.
Consistent with previous studies that examined night calls, the assessment of patients with complaints or changes in vital signs was the most common reason for the calls in Harvey’s  and Wong’s reports . The former used numeric pagers while the latter used alphanumeric pagers that could display both numbers and text. In our study, abnormal vital signs were the leading reason of call in stable, unstable and DNR patients, although the proportion of call reasons was different. These results have important implications for the response to clinical events. There is an inevitable time lag between finding an abnormal patient condition and reaching the on-call physician. Calling via mobile phones may shorten the time lag compared to traditional paging systems, but has been criticized by residents as being highly disruptive for the patient care activity . It calls for more study to prove the advantage of using mobile phones in clinical settings. Besides, most previous studies revealed a low percentage of bedside visits, from 10.3% to 28%, by on-call physicians ,. In our study, immediate (within 15 minutes) bedside visits occurred in 27.8%, and delayed visits in 14.5% of the calls. The higher rate of bedside visits was probably due to a higher proportion of abnormal vital signs in the study population, a different communication style using mobile phones, or a changed doctor-patient relationship and culture that exist nowadays. All patients in this study suffered from acute illness and were admitted from ED, and the picture was typical for an acute general medicine unit. Our study had no historical control and, thus, it could not make further deductions.
Table 4 summarizes the key studies from the related literature that examined pages and calls placed to physicians. In previous studies, the observation periods ranged from 1 week to 18 months. Our study involves the longest study period in the literature to date. A two-year long study period allowed us to minimize the observation effect on the study participants (night shift nurses) and depicted the real practice pattern at night. A recent trial with a comparably long study period investigated the workload of on-call medical interns for 2 years, but paging was not taken into consideration . Our study provided supplemental information to the researchers.
Our study may have several meaningful clinical implications. First, the 457 DNR patients, who within the study period in our hospitalist setting were a minority (18.1%) of our patient population, surprisingly, accounted for one third of the night calls and nearly one half of the immediate bedside visits made by on-call residents. DNR patients had different reasons for placing the calls as compared to general patients, but had similar reasons as compared to the unstable patients. This finding should be emphasized, because we tend to ignore the workload of palliative care, or so-called conservative care, which is provided to DNR patients. DNR orders for old, co-morbid patients are not uncommon in Taiwan, especially when these patients face acute illness. Our study showed that the workload involved in palliative care was much heavier than expected.
Second, the workload that is required for unstable patients was distributed evenly throughout the whole night. Similar results were found in Beebe’s work, where the number of emergency calls was comparable regardless of whether they occurred during the day or the night . In contrast to the stable and DNR patients, the conditions affecting unstable patients happened at any time, and often could not be managed on a “batch” basis. To improve the sleep fragmentation of the on-call residents, it was suggested that non-emergent calls be delivered by text messages on a batch basis . However, the pattern of unstable patient calls, as shown in this study, may disturb the sleep of the on-call residents all night long. Therefore, the protected sleep time is probably the best strategy to deal with this situation .
Early in the 1990s, Harvey pointed out that studying the night calls allowed specific strategies to reduce the number of calls to be identified . However, no known interventions have been proposed to effectively reduce night calls in the following decades. The lack of front-line information may explain the knowledge gap in dealing with the night shift workload. That’s why we have attempted to perform the ground work on this issue to help provide some initial findings.
With regards to the methodology of the night call study, earlier studies tended to record data first-hand from nurses or doctors ,,, while recent studies usually adopted the web system records ,,. The web system records can reduce the number of instances when data are missing, but might underestimate the events required to call if the responsible resident was already on the ward . In our study, the night shift nurses were ordered to record every event in which they needed to call the physicians and they were, therefore, the ones to report the data first-hand. In addition, the web system records cannot help identify whether a call was placed by nurses or by doctors if it originated from the nurses’ station . Therefore, the recording, as performed by nurses, provides valuable and correct information. A previous study demonstrated that nurses completed 95% of the records, while interns completed 86% of them . The on-call residents may often be interrupted or they try to sleep at night, which may explain why they recorded the calls to a lesser extent than nurses. From this point of view, the nurses’ first-hand records appeared to be the most reliable ones. Further studies may combine nurses’ records with web registration data to make the design more accurate. In addition, it also worth recording the detailed managements done by residents after the calls. How patient care is organized and what resources are needed are essential for patient safety at night shifts.
Our study had several limitations that are worth noting. First, the reasons why patients called the night shift nurses were not studied. In a previous study, the reasons that made patients call nurses were different from the reasons that made nurses call doctors . Our study, however, focused only on the need to call residents whose response and workload could therefore be studied. On-call residents may consult attending hospitalists, but this was not included on the record forms, either. Second, we only surveyed the needs for resident care at night, an aspect that could not be generalized to the day and evening shift. The care at night aims to provide the best possible sleeping environment for the patients . The night call studies can reveal the patients’ real needs during the night, without being confounded by daytime activities. While most other studies were conducted at daytime, it is mandatory to gather the front-line information at night to improve nighttime problems . Third, in our hospitalist service, we rarely have new admissions during night shifts. Therefore, the reasons for the calls were excluding the ones that were placed for new admissions. In other hospitalist programs, where night shift admissions are common, our data regarding the night workload may be underestimated. However, the calls for new admissions, if pooled into the statistical analysis, will inevitably distort the needs of inpatients during the night hours. Our study focused on inpatients’ calls at night, rather than on calls for managing admission process. Therefore, the previously admitted patients and new admitted patients should be considered separately. Forth, time spent on patient care should be an important endpoint in assessing physician workload, but we could not address it based on our data. Time spent on managing the patient’s call is highly related to the resident’s training and personality, which have been classified into “provider factors” in Horner’s framework and warranted further research. Fifth, the study was conducted in single academic medical center in Taiwan. The generalizability of our results to other settings has not been proved.
The clinical state of the patients determines the workload during the night shift in a general medicine service. Both the cause and effect of the night calls differ among patients in different clinical states. Vital sign changes that needed assessment were the leading reasons for calls that were placed at night, and this was particularly the case for unstable and DNR patients. In the general medicine unit, DNR patients contributed substantially to the workload at night, to an extent comparable to unstable patients. Researcher should be reminded that beyond work hour, patient factors determine on-call workload. In different residency programs, factors other than work hour mandate investigation to allow fair comparisons. Further studies to predict the workload based on patient composition are warranted.
Arendt J: Shift work: coping with the biological clock. Occup Med (Lond). 2010, 60: 10-20. 10.1093/occmed/kqp162.
Arora VM, Georgitis E, Siddique J, Vekhter B, Woodruff JN, Humphrey HJ, Meltzer DO: Association of workload of on-call medical interns with on-call sleep duration, shift duration, and participation in educational activities. JAMA. 2008, 300: 1146-1153. 10.1001/jama.300.10.1146.
Rollinson DC, Rathlev NK, Moss M, Killiany R, Sassower KC, Auerbach S, Fish SS: The effects of consecutive night shifts on neuropsychological performance of interns in the emergency department: a pilot study. Ann Emerg Med. 2003, 41: 400-406. 10.1067/mem.2003.77.
Philibert I, Friedmann P, Williams WT: New requirements for resident duty hours. JAMA. 2002, 288 (9): 1112-1114. 10.1001/jama.288.9.1112.
Volpp KG, Rosen AK, Rosenbaum PR, Romano PS, Even-Shoshan O, Wang Y, Bellini L, Behringer T, Silber JH: Mortality among hospitalized Medicare beneficiaries in the first 2 years following ACGME resident duty hour reform. JAMA. 2007, 298 (9): 975-983. 10.1001/jama.298.9.975.
Fischer JE, Healy GB, Britt LD: Surgery is different: a response to the IOM report. Am J Surg. 2009, 197: 135-136. 10.1016/j.amjsurg.2009.01.001.
Horner RD, Matthews G, Yi MS: A conceptual model of physician work intensity: guidance for evaluating policies and practices to improve health care delivery. Med Care. 2012, 50: 654-661. 10.1097/MLR.0b013e31825516f7.
Meretoja OA: We should work less at night. Acta Anaesthesiol Scand. 2009, 53: 277-279. 10.1111/j.1399-6576.2008.01896.x.
Libby LS, Hill DM, Lowensten SR, Moutain RD, LaForce FM: Beeper use on a medical service. West J Med. 1983, 138: 106-107.
Katz MH, Schroeder SA: The sounds of the hospital: paging patterns in three teaching hospitals. N Engl J Med. 1988, 319: 1585-1589. 10.1056/NEJM198812153192406.
Harvey R, Jarrett PG, Peltekian KM: Patterns of paging medical interns during night calls at two teaching hospitals. CMAJ. 1994, 151: 307-311.
Shu CC, Lin JW, Lin YF, Hsu NC, Ko WJ: Evaluating the performance of a hospitalist system in Taiwan: A pioneer study for nationwide health insurance in Asia. J Hosp Med. 2011, 6: 378-382. 10.1002/jhm.896.
Jerng JS, Ko WJ, Lu FL, Chen YS, Huang SF, Yu CJ, Wang MJ, Lin FY: Incidence and significance of clinically abnormal events in a tertiary referral medical center: implementation of the Clinical Alert System (CAS). J Formos Med Assoc. 2008, 107: 396-403. 10.1016/S0929-6646(08)60105-9.
Beebe SA: Nurses’ perception of beeper calls. Arch Pediatr Adolesc Med. 1995, 149: 187-191. 10.1001/archpedi.1995.02170140069011.
Arora V, Dunphy C, Chang VY, Ahmad F, Humphrey HJ, Meltzer D: The effects of on-duty napping on intern sleep time and fatigue. Ann Intern Med. 2006, 144: 792-798. 10.7326/0003-4819-144-11-200606060-00005.
Wong BM, Quan S, Shadowitz S, Etchells E: Implementation and evaluation of an alphanumeric paging system on a resident inpatient teaching service. J Hosp Med. 2009, 4: E34-E40. 10.1002/jhm.488.
Wu RC, Morra D, Quan S, Lai S, Zanjani S, Abrams H, Rossos PG: The use of smartphones for clinical communication on internal medicine wards. J Hosp Med. 2010, 5: 553-559. 10.1002/jhm.775.
Locke KA, Duffey-Rosenstein B, De Lio G, Morra D, Hariton N: Beyond paging: building a web-based communication tool for nurses and physicians. J Gen Intern Med. 2009, 24: 105-110. 10.1007/s11606-008-0827-2.
Patel SP, Lee JS, Ranney DN, Al-Holou SN, Frost CM, Harris ME, Lewin SA, Liu E, Madenci A, Majkrzak AA, Nelson J, Peterson SF, Serecky KA, Wilkinson DA, Wojcik BM, Englesbe MJ, Lynch RJ: Resident workload, pager communication, and quality of care. World J Surg. 2010, 34: 2524-2529. 10.1007/s00268-010-0740-9.
Tzeng HM: Perspectives of staff nurses of the reasons for and the nature of patient-initiated call lights: an exploratory survey study in four USA hospitals. BMC Health Serv Res. 2010, 10: 52-10.1186/1472-6963-10-52.
Muir JC, Arnold RM: Palliative care and the hospitalist: an opportunity for cross-fertilization. Am J Med. 2011, 111: 10S-14S. 10.1016/S0002-9343(01)00963-9.
Shulkin DJ: Like night and day - shedding light on off-hours care. New Engl J Med. 2008, 358: 2091-2093. 10.1056/NEJMp0707144.
The study appreciates the contributions of researchers in the Hospitalist in National Taiwan University (HINT) study group and the Department of Medical Research of NTUH.
The authors declare that they have no competing interests.
NCH was responsible for conceptualization and manuscript writing. REC, MCY and WJK contributed significantly to the study design and the manuscript revision. All authors read and approved the final manuscript.
Authors’ original submitted files for images
Below are the links to the authors’ original submitted files for images.
About this article
Cite this article
Hsu, NC., Yang, MC., Chang, RE. et al. Patient severity matters for night-shift workload for internal medicine residents in Taiwan. BMC Health Serv Res 14, 587 (2014). https://doi.org/10.1186/s12913-014-0587-0