- Research article
- Open Access
Workload and influencing factors in non-emergency medical transfers: a multiple linear regression analysis of a cross-sectional questionnaire study
BMC Health Services Research volume 19, Article number: 812 (2019)
Human workload is a key factor for system performance, but data on emergency medical services (EMS) are scarce. We investigated paramedics’ workload and the influencing factors for non-emergency medical transfers. These missions make up a major part of EMS activities in Germany and are growing steadily in number.
Paramedics rated missions retrospectively through an online questionnaire. We used the NASA-Task Load Index (TLX) to quantify workload and asked about a variety of medical and procedural aspects for each mission. Teamwork was assessed by the Weller teamwork measurement tool (TMT). With a multiple linear regression model, we identified a set of factors leading to relevant increases or decreases in workload.
A total of 194 non-emergency missions were analysed. Global workload was rated low (Mean = 27/100). In summary, 42.8% of missions were rated with a TLX under 20/100. TLX subscales revealed low task demands but a very positive self-perception of performance (Mean = 15/100). Teamwork gained high ratings (Mean TMT = 5.8/7), and good teamwork led to decreases in workload. Aggression events originating from patients and bystanders occurred frequently (n = 25, 12.9%) and increased workload significantly. Other factors affecting workload were the patient’s body weight and the transfer of patients with transmittable pathogens.
The workload during non-emergency medical transfers was low to very low, but performance perception was very positive, and no indicators of task underload were found. We identified several factors that led to workload increases. Future measures should attempt to better train paramedics for aggression incidents, to explore the usefulness of further technical aids in the transfer of obese patients and to reconsider standard operating procedures for missions with transmittable pathogens.
The number of missions carried out by Emergency Medical Services (EMS) has been growing steadily over the past years and is predicted to continue worldwide for the foreseeable future [1, 2]. Next, to the eponymous emergency missions, EMS in many countries must also carry out non-emergency medical transfers. Depending on healthcare system structures and EMS organizational make-up and location, this supposedly secondary activity may occupy large quantities of available EMS resources. Data published by the state of Bavaria show that 43% of all missions in the year 2017 were non-emergency missions . In contrast to what their title might suggest, emergency paramedics may find themselves performing non-emergency duties on a regular basis [1, 3]. Considering the current demographic increase in immobile elderly patients and obese patients, as well as the ongoing concentration of hospital resources, it is conceivable that the number of non-emergency transfers will also increase substantially [4, 5]. As a result, the EMS work force assigned to conduct these transfers could also grow.
In contrast to the obvious importance and dynamics of non-emergency transfers, there is a lack of scientific data concerning the human factors behind the work in this subset of EMS activities. Such explorations of human factors and ergonomics aim to simultaneously improve system performance and paramedics’ well-being. Understanding the human factors in non-emergency transfers might help to increase efficiency and lower costs and thus be vital to resolve the modern health-care dilemma of simultaneous performance and cost pressure.
One of the core components and major contributors to both human performance and well-being is the workload associated with the tasks required [6, 7]. Workload is the psychological concept of subjective demands and self-perception, and a variety of definitions of workload do exist. For our study, we defined workload as the value on the NASA-Task Load Index scale. Yerkes and Dodson demonstrated that task overload, as well as task underload, will lead to a decrease in performance . A medium workload level results in optimal performance .
Our study assessed the single-mission workload of non-emergency medical transfers conducted by EMS paramedics and aimed to identify relevant factors that influence workload. Our central objective was to detect these influencing factors. Using a network of relevant stakeholder organisations in pre-hospital emergency medicine, we conducted a national prospective survey to gather representative data. Workload was measured by the NASA Task Load Index (NASA-TLX), and we investigated a set of candidate variables that were assumed to possibly have an influence on workload, such as medical or organizational aspects of each transfer, paramedics’ teamwork, and their interactions with patients and third parties.
Background information: German EMS
The German EMS is an emergency-physician-based system. While non-emergency transports and minor emergencies are autonomously managed by paramedics, emergency physicians are called to the scene for life-threatening emergencies.
Different levels of paramedical qualifications do exist in Germany. The “Rettungssanitäter” is trained in 13 weeks and has subordinate duties and responsibilities, while the “Notfallsanitäter” requires 3 years of training, which allows him or her to administer life-saving medication and to carry out life-saving measures while the physician is on his or her way to the scene. The previous qualification “Rettungsassistent” was replaced by the “Notfallsanitäter” in 2014. It required a two-year training that was similar but of lesser extent than the training of the “Notfallsanitäter”.
While BLS-ambulances (Basic Life Support) require at least one “Rettungssanitäter” on board, ALS-ambulances (Advanced Life Support) are staffed with at least one “Rettungsassistent” or “Notfallsanitäter”. Small variations in the crew lineup exist from state to state, as the EMS legislation is regulated on a state-level.
This national prospective observational study was designed as an online questionnaire survey. It took place over a period of 7 weeks in the autumn of 2017 and was approved beforehand by the research ethics committee of the Friedrich-Alexander-University Erlangen-Nuremberg under decision number 172_17B. Participation was anonymous, voluntary and unpaid. The study was promoted with information material sent out to all rescue stations nationwide as well as advertisements printed in all relevant German emergency medicine journals. The campaign was supported by major German EMS providers (Bayerisches Rotes Kreuz - Rettungsdienst, Arbeiter Samariter Bund Bayern - Notfallhilfe) as well as the paramedics’ labour union (Ver.di Bayern) and the paramedics’ professional society (Deutscher Berufsverband Rettungsdienst).
Paramedics scored non-emergency medical transfers retrospectively. A variety of candidate variables were considered as possible influencing factors, while workload was considered as the resulting parameter.
The compiling of candidate variables was achieved through structured discussions within a panel of human factor and emergency medicine experts from the University of Erlangen-Nuremberg. This committee consisted of three physicians (specialists in anaesthesia and emergency medicine) and two paramedics. All five were active medical simulations and team resource management trainers with longstanding experience in pre-hospital emergency medicine. In several meetings, each committee member had the equal right to bring variables to the discussion table.
Medical and logistical mission aspects as possible influencing factors
Candidate variables included the patients’ general characteristics such as weight, their medical condition as classified by the NACA score, logistical consideration such as missions in overtime, procedural aspects such as the precautions against transmittable pathogens and interactions with others such as aggressive behaviour from patients and by-standers. While a set of variables was included in the final statistical model others failed in terms of statistical significance. Table 6 shows the variables included in the model, while Table 7 reports on the remaining.
The quality of teamwork as a possible influencing factor
In addition to the above-mentioned candidate variables, we suspected teamwork to be a significant contributor to workload. To evaluate the quality of teamwork through self-assessment, the Weller teamwork measurement tool (TMT) was used. It is particularly well suited for use by professional medical emergency teams . The original English version is known to have a valid structure for self-assessment . For our purposes, we translated Weller’s TMT into German. Weller et al. defined 20 items to measure teamwork in emergency situations . These 20 items are clustered in three main sectors: leadership and team coordination (LTC), verbalizing situational information (VSI), and mutual performance monitoring (MPM) . For our study, we queried all 20 items to statistically evaluate not only the TMT score in total but also the means of each cluster (LTC, VSI, and MPM). This resulted in a score for teamwork ranging from 1 (low) to 7 (high). The same scale applied to the sub-scales of the TMT score.
NASA task load index as an evaluation tool for subjective workload
The National Aeronautics and Space Administration Task Load Index (NASA-TLX) is a sensitive and validated measurement tool used to quantify subjective workload during a task or directly afterwards . Originally designed to fulfil the needs of the aerospace industry, TLX is now widely used in different sectors, such as high-risk industries and medicine . In the medical field, it has been used to measure workload in paediatric, sepsis and resuscitation scenarios [13, 14], during surgical procedures , in the emergency department, and in prehospital emergency medicine [16,17,18]. The NASA-TLX questionnaire is available in various languages . As it is described that there are no significant differences between the results of paper-based and digital NASA-TLX questionnaires, we integrated the digital version into our study .
As measuring task load is subject to inter-individual variability, the Task Load Index’s goal was to minimize this spread in data . Six sub-dimensions were identified to measure the task load with very low inter-individual variability: physical, mental and temporal demands next to effort, performance, and frustration perception . All six sub-dimensions were included in our questionnaire, and the resulting global TLX was then calculated (Table 1). With its six subscales ranging from 1 to 100, the overall TLX is the arithmetic mean of all subscales again ranging from 1 to 100 . However, understanding workload depends not only on the absolute values of the TLX but also on the relation of sub-dimensions to each other. The six sub-dimensions can be grouped into two separate causal mechanisms behind workload that need to be considered for their complex interdependence: While physical, mental and temporal dimensions represent how individuals perceive what the task demands from them, the (resulting) dimensions of effort, performance and frustration characterise how individuals perceive themselves and their actions in relation to the task.
Data collection and statistics
For questionnaire access, the online platform SoSci Survey  was utilized. The data we gathered are available via a persistent Digital Object Identifier (DOI) linking to the dataset stored in the Zenodo data repository. Statistical analysis was performed using SPSS Statistics 188.8.131.52 (IBM Corp. Armonk, NY, USA), and statistical significance was defined as p < 0.05. Values are presented as the means with standard deviations and medians with interquartile ranges, where appropriate. The literature is inconsistent with regard to describing the statistical measures of NASA-TLX values. Both mean/SD and median/IQR reporting can be found. To allow for better comparison with previous data, we reported the NASA-TLX in both manners.
The global TLX was defined as our primary parameter of interest. To explore the influence of candidate variables on the TLX, we carried out a multiple linear regression analysis with a stepwise selection of predictor variables. Workload, defined as the value on the NASA-TLX scale, was the dependent variable, whereas mission characteristics and others were used as the independent variables.
For methodological clarity, we restricted the candidate variables to factors originating from the individual missions. In a separate investigation, our group recently studied the possible influences of professional biography, long-term characteristics and persuasions of paramedics’ on job-perception including perceived long-term workload .
Paramedics were asked to score both emergency missions and non-emergency medical transfers after each task. This article focuses on non-emergency transfers only. Our findings on workload and contributing factors from emergency missions are reported elsewhere .
A total of 98 participants recorded data on 260 non-emergency medical transfers. Each participant entered between 1 and 15 non-emergency missions (Median = 1; IQR = 1–2). A total of 194 mission documentations had complete NASA Task Load Index values and could thus be included for analysis. Table 2 shows the descriptive statistics of the participants:
The subjectively felt urgency of transfers was measured on a self-designed 5-point scale: 1 indicated no urgency and 5 indicated the highest urgency. Figure 1 shows the statistics of the subjectively felt urgency.
Of the 194 transported patients, 13 were rated as carrying transmittable pathogens (6.7%). Three cases (1.5%) were reported in which bystanders obstructed the patient’s treatment. Physically aggressive patients appeared in four missions (2.1%), whereas seven cases (3.6%) of verbally aggressive bystanders were documented. In total, 25 transfers (12.9%) were affected by aggression incidents (characterized as physically or verbally aggressive patients or bystanders or obstruction of treatment). More detailed descriptive statistics on aggression incidents (multiple answers possible) are shown in Table 3:
Weller teamwork measurement tool (TMT)
On Weller’s TMT scale (ranging from 1 to 7), teamwork averaged 6.28 (SD 0.93). Table 4 provides details of the descriptive statistics for the TMT, and Fig. 2 provides detailed information on the distribution of the TMT Score.
NASA task load index
The mean task load measured using the National Aeronautics and Space Administration Task Load Index (NASA-TLX) was 27 (SD 18). While 83 missions (42.8%) had a global TLX below 20, only 2 missions scored above TLX 80. Table 5 provides details of the descriptive statistics for the six subscales and the overall score of the NASA Task Load Index.
Multiple linear regression model
A multiple linear regression model was computed to investigate predictor variables that had a significant influence on the global NASA-TLX.
The subjectively felt urgency of transports was rated on a scale between 1 (no urgency) and 5 (highest urgency) by paramedics. There was a 6.9-point increase in the NASA-TLX for each positive step on the urgency scale (p < 0.01). Transporting a patient with potentially transmittable pathogens increased the task load by 15.4 points (p < 0.01). An increase of 0.1 points was caused by each additional kilogram of the patient’s body weight (p = 0.012). In cases where treatment was obstructed by bystanders, the task load increased by 35.0 points (p = 0.013). Verbal aggression from bystanders (delta 19.4 points, p < 0.01) or physically aggressive patients (delta 33.6 points, p < 0.01) also led to major increases in workload.
Each positive step on the 7-step teamwork measurement tools (p < 0.01) brought about a decrease in task load of − 4.0 points.
Details of the multiple linear regression model can be found in Table 6.
During the process of stepwise integration of predictor variables, some failed in terms of statistical significance. Table 7 lists variables that had been selected to undergo investigation but had to be removed from the multiple linear regression model because of low significance or low correlation with the TLX.
Workload and performance
Workload is a key component of human performance. In this study, we quantified the workload for 194 non-emergency medical transfers conducted by EMS paramedics. Multiple linear regression analysis identified relevant factors influencing workload levels.
The average overall workload in our data set as described by the global NASA-TLX was low compared to most other professions and tasks from previous studies. In a comprehensive 2015 meta-analysis, Grier calculated the median TLX-score for more than 1100 observations and 20 different task types at a median of 50 points . In comparison, the median TLX of 22 for non-emergency transfers from our study ranged significantly lower than scores from mechanical tasks, piloting, or other medical tasks (Fig. 3). The workload from non-emergency EMS transfers was also significantly lower than the workload from EMS emergency missions (Fig. 4) that we analysed in a recent study . In fact, the only tasks scoring somewhat lower in the Grier meta-analysis were so-called “daily activities” [23, 24]).
Eighty-three transfers (42,8%) were scored with a global workload below 20, reaching the bottom fifth of the NASA-TLX scale. Task Load Index sub-dimension analysis revealed that demands were unequal contributors to overall workload, as Table 4 shows. An interesting finding was that according to their performance self-ratings, paramedics usually felt satisfied and successful in reaching the goals of their tasks.
The frequent findings of low to very low TLX ratings must be weighed carefully. Yes, there is a broad consensus that workload and performance output are linked by an inversely U-shaped correlation . However, several limitations apply. First, science has not been able to define a fixed TLX cut-off value that truly characterizes workload as being “too low” or “too high”, despite decades of research. This lack of a clear red line may be caused by inter-individually varying coping strategies, knowledge, and experience of persons undertaking the tasks on the outskirts of the workload continuum [23, 24]. Second, the association of workload and performance is much less understood for the lower end of workload than for upper extremes. With rising demands, efforts from workers will increase, but once the requirements exceed their capabilities, a degradation of performance output will follow with clear predictability. For example, a study in the context of emergency medicine demonstrated a positive correlation between workload excess in emergency departments and unwanted incidents negatively impacting patient safety .
On the other end of the scale, low demand tasks (meaning low physical, mental and temporal demands) do not automatically lead to poor performance output. Emotional attributes can pivot the individuals’ experience. Even in a low-demand-task, output can be reliably high if individuals have a strong feeling of successfully reaching their goals against a weak feeling of frustration and stress. Moreover, from our context, non-emergency transfers may be low-demand tasks, but they are very satisfying and performance output is perceived as being very high. Unfortunately, linear regression modelling identified several distinct factors in our data set that impact workload significantly and could therefore endanger this balance and lead to output deficits.
Aggression incidents and workload
We recorded aggressive behaviour in words and actions by both patients and bystanders at a troublesome frequency. The variables in our model describing these incidents are the following: “physically aggressive patient”, “verbally aggressive bystanders”, and “obstruction by bystander”. All three events were linked to great increases in global workload. Other variables recording similar behaviour were not integrated into our final model due to missing statistical significance and can therefore be found in Table 7. Confounding with other aggression events may be responsible for this statistical conclusion.
Our findings are consistent with previous studies reporting increases in aggressive behaviour of patients worldwide. Gillespie reported that between 51 and 67% of American emergency department workers faced physical violence and 78–83% encountered verbal aggression during a study period of 18 months . Authorities in the German state of North Rhine-Westphalia investigated violence against paramedics and found that within 12 months, 59% of personnel experienced physical aggression and 98% experienced verbal attacks .
Previous research has identified risk factors and early warning signs that help to predict aggression incidents: hostile behaviour, recent drug or alcohol misuse, non-adherence to psychotherapy or medication, and poor impulse control [29, 30]. Our data support these findings, as verbally or physically aggressive patients were often described as intoxicated in our cohort. As a consequence, the training of paramedics to identify these early indicators of aggressive incidents as well as de-escalation management could be implemented into paramedic education as these measures have proven themselves effective in other healthcare settings .
Obesity and workload
The increasing prevalence of obesity worldwide has resulted in a rising incidence of overweight patients within healthcare systems and in an increasing number of ambulance transfers of overweight patients [5, 32]. Our data show that patients’ body weight leads to a significant increase in paramedics’ workload per kilogram of weight. It has long been known that lifting and transferring obese patients is difficult ergonomically, and a variety of presumably helpful technical devices have been introduced into daily EMS routine to manage the problem .
It is somewhat discouraging that even in our selected group of non-emergencies, when time should allow for proper preparation of lifting and transfer, the patient’s body weight still had such a profound effect on workload despite all aids and preventative measures. Therefore, the development, acquisition, and distribution of helping aids as well as operational procedures for the transfer of obese patients should be reconsidered. For example, a more liberal provision and dispatch of dedicated “heavy lift” ambulances could provide relief to regular ambulance crews and should be investigated for possible benefits on workload .
Transmittable pathogens and workload
The prevalence of pathogens with antimicrobial resistance is rising in healthcare systems around the globe . The transfer of patients with these and other transmittable pathogens have increased accordingly. The variable “infectious patient” specifies these missions. In German EMS, standard operational procedures (SOP) to prevent the transmission of these pathogens are long-established and comprise protective clothing, contact restrictions and subsequent cleaning of ambulances, among measures. The common basis of these SOPs is the “TRBA 250” – German nationwide technical rules for biological materials . Although these SOPs are well-rehearsed and non-emergency transfers should provide ample time for preparation and implementation, such cases still lead to major increases in workload (plus 15 points).
It should be unfortunate that scenarios for which we supposedly already had good practice recommendations in place still have such a significant impact on workload. As with the obesity problem described previously, our data again necessitate re-consideration of SOPs, technical aids, and training for their benefit in these scenarios. Nassauer’s statement that intensified education is needed to avoid needless measures and reduce deficits in the knowledge about handling infectious patients is consistent with this goal .
Teamwork and workload
In non-emergency transfers, different patients, different referring or receiving institutions, and frequently changing team partners can lead to challenging external conditions for teamwork. The connection of teamwork and performance output is considered of high value in ergonomics and over the last decades has led to “a golden age of interest in team research” . In our cohort of non-emergency transfers, the subjective rating of teamwork was very positive across all sectors of the Weller TMT, and leadership and team coordination scored excellent values. We interpret these findings as the well-deserved payoff from the intensive efforts within German EMS to foster crew resource management as a core component of paramedic training. Good teamwork is not the only goal, as our results demonstrate: good teamwork leads to significant decreases in workload!
Non-emergency transfers and medical conditions
In a recent study of paramedics’ workload from emergency missions, we identified medical aspects of missions such as the patient’s NACA score, scenarios such as multiple trauma, and the need for advanced procedures like airway management as factors to increase workload . In comparison, in our cohort of non-emergency transfers, NACA scoring was significantly lower, emergency scenarios were not present, and advanced procedures were extremely rare occurrences. As a logical consequence, none of these candidate variables was selected for the workload model. However, the perceived urgency of a transfer did increase workload significantly and may serve as a surrogate parameter for the overall severity of a patient’s medical condition.
Our study had several limitations. The study was widely advertised and extensively distributed across German EMS, but we still cannot rule out a relevant selection bias in the participants or in the documented transfers. A methodological weakness of studies like ours is that the data may be biased by the healthy worker effect  or by an unwanted special appeal to paramedics with either very high or very low motivation for their job and for non-paid, voluntary scientific studies.
Second, our data consisted of self-reported subjective perceptions only. These may be prone to hindsight errors or other psychological influences and were not coupled with objective, i.e., physiological, measurements of workload.
This limitation also includes the subjective ratings of performance levels. Performance in non-emergency medical transfers was not measured in our study, and the literature does not provide any guidance on how to measure performance in such a multi-dimensional task. To overcome these limitations, future studies should try to provide measurement tools to objectively evaluate all subdimensions of the workload as well as external performance. Such efforts might also help to more clearly define the long desired “red-line” of workload.
Third, the questionnaire uses some “self-designed” items that have not undergone formal validation studies. These items have been highlighted as such in the text.
Finally, our data are missing ICU transfers. These specific missions are an important part of EMS providers’ scope of service and are also growing in number . It seems worthwhile to investigate workload in this subspecialty in the future. The combination of critically ill patients, advanced use of medical equipment and team building between ICU physicians and EMS paramedics presents a unique background for human factor research.
Our prospective study provides novel data on the human factors at work in emergency medical services. In a self-assessment with the NASA Task Load Index, EMS paramedics performing non-emergency medical transfers rated workload as low. Scores were lower than for EMS emergency missions and lower than for typical medical tasks from previous studies. Nevertheless, there was no indication of task under-load, and paramedics shared a common perception of successful performance and accomplishment.
Through regression modelling from candidate variables, we were able to identify factors that significantly increase workload, such as aggression events, patient weight, and transfer of patients carrying transmittable pathogens. In addition to a general rating of the cases’ urgency, no other factors relating to the patients’ medical condition contributed significantly to the workload. Team performance between paramedics was rated as very positive, and such positive ratings led to significant workload decreases.
Compared to emergency missions, non-emergency transfers resulted in lower and more homogenous workload ratings. For EMS organisations covering both types of missions, our study can indicate a way to homogenize the workload for the individual paramedics. Composite rosters - comprising emergency and non-emergency duties alike - could possibly lead to a more balanced workload and thus help to improve system performance and work satisfaction at the same time.
Workload increments from the transfer of obese patients and patients who are carrying transmittable pathogens can still be found regularly despite all previous preventative efforts to optimize such procedures. The re-evaluation of current measures seems indicated. Aggression events are reported with worrisome frequency. They lead to major increases in workload. Prevention and coping strategies should be brought into the focus of paramedics’ training.
Ultimately, our study provides baseline data for repeated workload assessments in the future to test the efficacy of possible improvement measures. The study can be part of a comprehensive strategy to optimize working conditions in EMS in times of growing case numbers, cost pressure and skilled labour shortages.
Availability of data and materials
The datasets generated and analysed during the current study are available in the Zenodo data repository: https://doi.org/10.5281/zenodo.2532618
Digital Object Identifier
Emergency Medical Services
Intensive Care Unit
Leadership and team coordination
Mutual performance monitoring
National Advisory Committee for Aeronautics
National Aeronautics and Space Administration
Task Load Index
Teamwork Measurement Tool
Verbalizing situational information
gbe-bund.de. Einsatzfahrtaufkommen im öffentlichen Rettungsdienst in Deutschland nach Einsatzanlass in den Jahren 1994 bis 2013 2018 [Available from: https://de.statista.com/statistik/daten/studie/482380/umfrage/einsatzfahrtaufkommen-im-oeffentlichen-rettungsdienst-nach-einsatzart/]. Accessed 29 Dec 2018.
Statista. Umsatz der Rettungsdienste und Krankentransporte in den USA von 2008 bis 2015 und Prognose bis zum Jahr 2020 (in Milionen Euro). US Census Bureau2017 [Available from: https://de.statista.com/prognosen/424070/rettungsdienste-und-krankentransporte-in-den-usa%2D%2D-umsatzprognose]. Accessed 29 Dec 2018.
Alt T, Bielmeier S, Birk A, Dudinova D, Elbauer V, Gattinger A, et al. Rettungsdienstbericht Bayern. München: Institut für Notfallmedizin und Medizinmanagement (INM) Klinikum der Universität München; 2018.
Seidell JC, Halberstadt J. The Global Burden of Obesity and the Challenges of Prevention. Ann Nutr Metabol. 2015;66(suppl 2):7–12.
Bartels UE, Brinkmann A, Ziegler M, Schmidt A. Eine schwere Aufgabe – adipöse Patienten in der Notfallmedizin. Notfall + Rettungsmedizin. 2012;15(3):241–4.
Hart SG, Staveland LE. Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research. In: Hancock PA, Meshkati N, editors. editors Advances in Psychology. 52: North-Holland: Elsevier; 1988. p. 139–83.
Tschan F, Semmer NK, Gautschi D, Hunziker P, Spychiger M, Marsch SU. Leading to recovery: group performance and coordinative activities in medical emergency driven groups. Hum Perform. 2006;19(3):277–304.
Yerkes RM, Dodson JD. The relation of strength of stimulus to rapidity of habit-formation. J Comp Neurol Psychol. 1908;18(5):459–82.
Kolus A, Wells R, Neumann P. Production quality and human factors engineering: a systematic review and theoretical framework. Appl Ergon. 2018;73:55–89.
Weller J, Shulruf B, Torrie J, Frengley R, Boyd M, Paul A, et al. Validation of a measurement tool for self-assessment of teamwork in intensive care. Br J Anaesth. 2013;111(3):460–7.
Weller J, Frengley R, Torrie J, Shulruf B, Jolly B, Hopley L, et al. Evaluation of an instrument to measure teamwork in multidisciplinary critical care teams. BMJ Qual Saf. 2011;20(3):216–22.
Hart SG. NASA-task load index (NASA-TLX); 20 years later. Proc Human Factors Ergon Soc Annu Meet. 2006;50(9):904–8.
Tofil NM, Lin Y, Zhong J, Peterson DT, White ML, Grant V, et al. Workload of team leaders and team members during a simulated Sepsis scenario. Pediatr Crit Care Med. 2017;18(9):e423–e7.
Asselin N, Choi B, Pettit CC, Dannecker M, Machan JT, Merck DL, et al. Comparative analysis of emergency medical service provider workload during simulated out-of-hospital cardiac arrest resuscitation using standard versus experimental protocols and equipment. Simul Healthc. 2018;13(6):376–86.
Dias RD, Ngo-Howard MC, Boskovski MT, Zenati MA, Yule SJ. Systematic review of measurement tools to assess surgeons’ intraoperative cognitive workload. Br J Surg. 2018;105(5):491–501.
Levin S, France DJ, Hemphill R, Jones I, Chen KY, Rickard D, et al. Tracking workload in the emergency department. Hum Factors. 2006;48(3):526–39.
Bradley Morrison J, Rudolph JW. Learning from accident and error: avoiding the hazards of workload, stress, and routine interruptions in the emergency department. Acad Emerg Med. 2011;18(12):1246–54.
Schneider F, Martin J, Schneider G, Schulz CM. The impact of the patient’s initial NACA score on subjective and physiological indicators of workload during pre-hospital emergency care. PLoS One. 2018;13(8):e0202215.
Trujillo AC. Evaluation of electronic formats of the NASA task load index. Hampton: NASA; 2011.
Leiner DJ. SoSci Survey (Version 2.6.00) [Computer software] Available at https://www.soscisurvey.de. 2016. Accessed 2 Sept 2017.
Birkholz T, Eiche C, Gall C, Konrad F, Prottengeier J. editorsSelbsteinschätzung von Fähigkeiten und subjektiver Belastung bei 2684 im Rettungsdienst tätigen Personen. Leipzig: DIVI Kongress 2018; 2018.
Prottengeier J, Keunecke G, Gall C, Eiche C, Konrad F, Birkholz T. Belastung im Rettungsdienst. Eine nationale Querschnitsstudie zu Einzelfaktoren der Einsatzbelastung in der präklinischen Notfallrettung. Leipzig: DIVI Kongress 2018; 2018.
Grier RA. How high is high? A meta-analysis of NASA-TLX global workload scores. Proc Human Factors Ergon Soc Annual Meet. 2016;59(1):1727–31.
Casner SM, Gore BF. In: NASA, editor. editor Measuring and evaluating workload: a primer. NASA: San Jose; 2010.
Mazur LM, Mosaly PR, Hoyle LM, Jones EL, Chera BS, Marks LB. Relating physician's workload with errors during radiation therapy planning. Pract Radiat Oncol. 2014;4(2):71–5.
Carlesi KC, Padilha KG, Toffoletto MC, Henriquez-Roldan C, Juan MA. Patient safety incidents and nursing workload. Rev Lat Am Enfermagem. 2017;25:e2841.
Gillespie GL, Gates DM, Kowalenko T, Bresler S, Succop P. Implementation of a comprehensive intervention to reduce physical assaults and threats in the emergency department. J Emerg Nurs. 2014;40(6):586–91.
Schmidt J, Feltes T. Gewalt gegen Rettungskräfte. Bestandsaufnahme zur Gewalt gegen Rettungskräfte in Nordrhein-Westfalen. Abschlussbericht; 2012.
Witt K, van Dorn R, Fazel S. Risk factors for violence in psychosis: systematic review and meta-regression analysis of 110 studies. PLoS One. 2013;8(2):e55942.
Pajonk F-GB, D’Amelio R. Agitation und Aggression – Eine Herausforderung in der Notfallmedizin. Notfall + Rettungsmedizin. 2016;19(3):163–71.
Frick J, Slagman A, Möckel M, Searle J, Stemmler F, Joachim R, et al. Erleben von aggressivem Verhalten in der Notaufnahme nach Etablierung eines Deeskalationstrainings. Notfall + Rettungsmedizin. 2018;21(5):349–56.
Prottengeier J, Meyer M, Munster T. Transfer of obese patients in European air ambulances. Eur J Emerg Med. 2014;21(5):377–9.
Giesel M, Wißuwa H, Puchstein C. Adipositas permaxima in der Notfallrettung. Notfall + Rettungsmedizin. 2009;12(3):211–4.
Baker S. Infectious disease. A return to the pre-antimicrobial era? Science (New York, NY). 2015;347(6226):1064–6.
Arbeitsmedizin BfAu. TRBA 250 - Technische Regeln für biologische Arbeitsstoffe - Biologische Arbeitsstoffe im Gesundheitswesen und in der Wohlfahrtspflege. 2014.
Nassauer A, Mielke M. Infektionsprävention im Krankentransport und Rettungsdienst. Notfall + Rettungsmedizin. 2010;13(6):483–96.
Salas E, Cooke NJ, Rosen MA. On teams, teamwork, and team performance: discoveries and developments. Hum Factors. 2008;50(3):540–7.
McMichael AJ. Standardized mortality ratios and the “healthy worker effect”: scratching beneath the surface. J Occup Med. 1976;18(3):165–8.
We thank Jens Kasberger, Fabian Konrad, Wolfgang Lindner and Daniel Wohlfahrt for their excellent technical assistance in the logistical preparations of our study. Permission to publish their names was received.
This study was funded by a science grant from the Arbeiter-Samariter-Bund Notfallhilfe Bayern. The funding body played no role in the design of the study, analysis and interpretation of data, or in writing the manuscript.
Ethics approval and consent to participate
The study was evaluated and approved by the University of Erlangen-Nuremberg’s ethics council beforehand. Decision number 172_17B. The need for formal consent from participants was waived by the ethics committee and the voluntary participation itself served as surrogate of consent.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Keunecke, J.G., Gall, C., Birkholz, T. et al. Workload and influencing factors in non-emergency medical transfers: a multiple linear regression analysis of a cross-sectional questionnaire study. BMC Health Serv Res 19, 812 (2019). https://doi.org/10.1186/s12913-019-4638-4
- Emergency medical services
- Human factors