Developing process guidelines for trauma care in the Netherlands for severely injured patients: results from a Delphi study
© Hoogervorst et al.; licensee BioMed Central Ltd. 2013
Received: 8 June 2012
Accepted: 14 February 2013
Published: 3 March 2013
In organised trauma systems the process of care is the key to quality. Nevertheless, the optimal process of trauma care remains unclear due to lack of or inconclusive evidence. Because monitoring and improving the performance of a trauma system is complex, this study aimed to develop consensus-based process guidelines for trauma care in the Netherlands for severely injured patients.
A five-round Delphi study was conducted with 141 participants that represent all professions involved in trauma care. Sensitivity analyses were carried out to evaluate whether consensus extended across all professions and to detect possible bias.
Consensus was reached on 21 guidelines within 4 categories: timeliness, actions, competent teams and interdisciplinary process. Timeliness guidelines set specific critical limits and definitions for 10 time intervals in the time period from an emergency call until the patient leaves the trauma room. Action guidelines reflect aspects of appropriate care and strongly rely on the international Advanced Trauma Life Support principles. Competence guidelines include flow charts to assess the competence of prehospital and emergency department teams. Essential to competent teams are education and experience of all team members. The interdisciplinary process guideline focuses on cooperation, communication and feedback within and between all professions involved. Consensus was extended across all professions and no bias was detected.
In this Delphi study, a large expert panel agreed on a set of guidelines describing the optimal process of care for severely injured trauma patients in the Netherlands. In addition to time intervals and appropriate actions, these guidelines emphasise the importance of team competence and interdisciplinary processes in trauma care. The guidelines can be seen as a description of a best practice and a new field standard in the Netherlands. The next step is to implement the guidelines and monitor the performance of the Dutch trauma system based on the guidelines.
Quality of trauma care can be defined as achieving the best possible outcome for a given set of clinical circumstances . Quality can be assessed by evaluating the structure of the trauma system, the process of trauma care and the effect of trauma care on the health status of the patient, or the outcome . Worldwide, outcome is well documented in various trauma registries. The structure needed to provide trauma care with the lowest mortality rates is secured in regional trauma systems that have been implemented in many countries. Positive effects of this organisational structure on survival rates have been clearly demonstrated [3–7]. However, as the most optimal structure can only affect outcome through the processes of care that it enables , the next step in quality improvement is to describe the processes that would lead to the best possible outcome when applied within the defined structure. The optimal processes should not only influence mortality, but should also positively affect functional outcome and health-related quality of life [8, 9].
Although the processes of trauma care are important, only a few process guidelines in this field are available [10, 11] and it is largely unknown whether these are positively related with either survival or functional outcome [12–17]. Monitoring and improving the performance of a trauma system in this situation is an arduous task. In 2009 the Cochrane collaboration attempted to determine the effectiveness of using audit filters for improving processes of care and clinical outcomes in trauma systems; however, they found no studies to include . Therefore, as scientific evidence is either absent or inconclusive, process guidelines have to be developed based on expert opinion.
When guidelines are adopted and supported by all professions they can be interpreted as the description of a best practice and as a new field standard. Eventually, guidelines need to be implemented and employed in order to monitor the performance of a trauma system.
We conducted a Delphi study to develop process guidelines for quality of trauma care in the Netherlands for severely injured trauma patients. The primary aim was to compose process guidelines with an expected positive relation with survival and/or functional outcome which are supported by an expert panel representing all professions that collaborate in regional trauma care. The second aim was to determine whether panel members from different settings and/or occupations would support the same guidelines.
The Delphi procedure uses a series of structured questionnaires to transform opinion into group consensus. Results of every questionnaire are shared with panelists and converted to a subsequent questionnaire or round [19–21]. Our Delphi procedure consisted of 5 structured questionnaires sent to the complete panel in September 2005, December 2005, April 2006, October 2006 and April 2007. The study was combined with a Nominal Group Technique (NGT) meeting in which the participants met to discuss the process and resolve uncertainty or any ambiguities in the questionnaires.
To avoid imposing a specific view and preconceptions of process guidelines for trauma care , every questionnaire was primarily composed by a methodologist with knowledge of current literature, protocols and legislation but without any clinical experience in trauma care (EMH).The draft questionnaires were reviewed on relevance and methodological quality by a steering committee, composed of clinical professors in traumatology and emergency medicine, and university healthcare researchers. The systematic procedure resulted in consistently structured and unambiguous questionnaires covering all items of interest.
Each questionnaire was analysed separately and processed into a feedback report and a subsequent questionnaire, both of which were sent by email to the entire Delphi panel. In addition to the results from previous questionnaires, additional input for questionnaires was gathered from scientific literature.
Experts were explicitly asked to answer questionnaires with the care processes in mind that would elicit the best possible survival chances and functional outcome for the severely injured trauma patient.
As our study focused on reaching consensus in an expert panel, the institutional review board of the VU University Medical Center (METc VUmc) decided that study approval was not necessary.
The study was carried out in the Netherlands, a country with 16.4 million inhabitants and a population density of 486 persons per square kilometer. The Dutch Emergency Medical System (EMS) is organised into 11 trauma regions, according to international principles with regard to the optimal structure.
Each region has at least one level 1 trauma centre, several level 2 and 3 hospitals for trauma care, one or more ambulance dispatch centres, and one or more public or private ambulance services. Each trauma region supports a Mobile Medical Team (MMT) consisting of a physician and a nurse experienced in delivering complex care at the scene of the accident to a severely injured patient. The MMT is primarily dispatched in conjunction with an ambulance when the patient meets criteria with a high possibility of severe injury. In addition, secondary dispatch of a MMT can be requested if an ambulance arrives alone at the scene and severe injuries are observed by the ambulance crew.
All trauma care providers are trained according to Prehospital Trauma Life Support (PHTLS) and Advanced Trauma Life Support (ATLS) principles. During this study there were no interventions or major changes in training, procedures or legislation related to the Dutch EMS system.
Selection of participants
Panel members and average number of working years (experience) in trauma care, by occupation and setting
During the Delphi procedure, 14 panel members indicated that they were no longer able to participate. Reasons for withdrawal were personal circumstances (n=2) or lack of time (n=12).
Methods of measurement
Data collection and processing
All questionnaires were sent by email (in Word format) and most were returned by email. Questionnaires returned by post were manually converted to a Word document, double checked and processed in the same was as the digitally returned questionnaires by the first author (EMH). All answers, clarifications, added indicators and arguments were directly copied in an Excel database (Microsoft Excel version 2003, Redmond, WA, USA). Frequencies of answers and percentages of agreement and disagreement were calculated with Excel. The excel database was imported in SPSS (version 17.0, Chicago, IL, USA) for the sensitivity analysis.
In total, 706 items were measured on the Likert scale. Consensus was reached on an item when 70% or more of the respondents answered the item with ‘strongly agree’ or ‘agree’ (respondents not answering or with no opinion were omitted). Items passing the 70% limit of agreement were included in the feedback report to the Delphi panel and were further examined in the subsequent round. The 65-70% threshold used in our consensus definition was based on literature on the Delphi Method . Qualitative results included all the free texts written by respondents in response to the questionnaire. Text was sorted by subject by one researcher (EMH) and checked by a second researcher (JJLMB); differences in opinions were solved through discussion between the two researchers. Ideas suggested by two or more respondents were included in the subsequent round. Sensitivity analysis was performed to explore consensus across the groups of panel members by analysing average item scores. In addition, possible bias caused by the use of the ‘no opinion’ option, missing values and selective withdrawal was analysed. The 706 items were independently classified by two researchers into 6 distinct domains; one of these researchers was not actively involved in the study at any time. The domains were General (n=43), Dispatch (n=33), Dispatch and Prehospital care (n=105), Prehospital care (n=222), Prehospital care and Emergency Department (n=67) and Emergency Department (n=236). Initial agreement between the researchers was good (kappa 0.75). Differences in domains were discussed and solved resulting in unanimous agreement. For every domain of items, the average Likert score was calculated. We also calculated the percentage of Likert items answered with ‘no opinion’ the percentage of Likert items that were left empty, and the percentage of Likert items with no response (due to not returned questionnaires). There were no missing values. In order to analyse the potential effect of selection bias caused by the reduced response rates in the final round, a t-test was performed to compare average domain scores of the respondents that also filled out questionnaire 5 and the respondents that filled out questionnaires 1 to 4 only. Analysis of variance (ANOVA) was performed for two separate factors (independent variables) describing the Delphi panelists by occupation (levels: executive, physician, nurse) and setting (levels: dispatch, prehospital care, emergency department). These analyses were performed with the average item score in every domain, and the percentage of ‘no opinion, ‘empty’ or ‘no response’ in every domain. Bonferonni was chosen as post-hoc test and the significance level was set at 0.05.
In round one (response rate 87%; 122/141), round two (response rate 75%; 103/137) and round three (response rate 70%; 93/132) the main aim was to develop the specific items of each guideline for which consensus was to be achieved. Round four (response rate 57%; 74/130) provided further details on these guidelines, specifically regarding acceptable limits for each guideline. The NGT meeting (n=12) focused on discussing 21 items that needed clarification. Round five (response rate 48%; 61/127) aimed to acquire the panel’s approval of the NGT results and achieve final consensus.
In round 1, four categories of guidelines were selected: time intervals, actions, competent teams and interdisciplinary process. The results of the subsequent Delphi rounds were organised according to these four categories.
Starting point, endpoint, maximal duration in minutes and definition of 10 time intervals selected as guidelines for severe trauma patients
Time intervals for dispatch setting
112 call at dispatch
Departure of ambulance
112 call at dispatch
Departure of MMT
Request for Mobile Medical Team (MMT)
Departure of MMT
Time intervals for dispatch and prehospital setting
112 call at dispatch
Arrival of ambulance on scene
112 call at dispatch
Arrival of MMT on scene
Request for MMT
Arrival of MMT on scene
112 call at dispatch
Arrival at the emergency department
Time intervals for prehospital setting
Arrival of ambulance on scene
Departure of patient
Arrival of MMT on scene
Departure of patient
Time intervals for emergency department (ED) setting
Arrival at the trauma room
Departure from trauma room
Definitions of time points
Point in time
The moment that the:
112 call at dispatch
dispatch nurse picks up the phone.
Request for MMT
dispatch nurse picks up the phone to receive the request
Departure of ambulance
ambulance departs to the accident location
Departure of MMT
MMT departs to the accident location
Arrival of ambulance on scene
ambulance nurse starts delivering care to the patient
Arrival of MMT on scene
MMT members start delivering care to the patient
Departure of the patient
patient leaves the accident location
Arrival of the patient at the ED
ED team starts delivering care to the patient
Departure from the trauma room
patient definitively leaves the trauma room
It was agreed that the ambulance and MMT should leave for the accident location within 2 min after the dispatch nurse answered the phone. In less than 10 min the ambulance should arrive at the accident location and the crew should start delivering care to the patient. Less than 5 min later the MMT should be at the scene. When a ‘scoop and run policy’ is performed the patient should be transported from the accident location within 10 min after arrival of the ambulance. The total duration from national emergency call until arrival of the patient at the trauma room of the emergency department (ED) should not exceed 30 min. The patient should spend maximally 30 min in the trauma room. The total time spent from national emergency call until departure from the ED should not exceed 60 min. (In trauma systems where a physician is always dispatched to the accident location guidelines 1, 4 and 8 are not relevant).
Description and definition of 8 appropriate actions selected as process guidelines for severe trauma patients
Actions for dispatch setting
One ambulance and a Mobile Medical Team (MMT) are dispatched
Actions for prehospital setting
The patient is ABCDE stabilised before the hospital is reached
A provisional/working diagnosis is formulated before the hospital is reached
The patient is transported to a level 1 trauma centre
Actions for emergency department (ED) setting
A complete trauma team is present in the trauma room when the patient arrives
The patient is ABCDE stabilised in the trauma room
A complete trauma series X-rays is made in the trauma room
A provisional diagnosis is confirmed or reformulated in the trauma room
ABCDE stabilisation in the prehospital setting
Manual clearance of the airway, application of a cervical collar, application of oxygen, staunching the flow of blood, insertion of two intravenous lines, administering intravenous fluids, immobilisation on a backboard, connection of the patient to a monitor and covering of the patient.
ABCDE stabilisation in the trauma room setting
Manual clearance of the airway, intubation, application of oxygen, staunching the flow of blood, insertion of two intravenous lines, administering intravenous fluids, pain medication, connection of the patient to a monitor and covering of the patient
Prehospital working diagnosis
ABCDE (Airway and cervical spine, Breathing, Circulation, Disability, Exposure and Environment), symptoms, anatomical location of injury, trauma mechanism, Glasgow Coma Scale (GCS) score, Revised Trauma Score (RTS)
Trauma room working diagnosis
Prehospital working diagnosis extended with:
1.Findings on the trauma series X-rays
2.Pediatric Trauma Score for juvenile patients
Complete trauma team
2 ED nurses, a trauma surgeon, an anesthesiologist, a radiologist and an X-ray laboratory assistant
Complete trauma series Rontgen
Cervical spine, chest and pelvis
At the trauma room of the ED the complete trauma team should be ready to undertake all necessary actions to keep or get the patient ABCDE stabilised. When necessary actions were not performed in the prehospital setting, they should be performed at the ED. Actions that should only be performed in the trauma room are intubation and application of pain medication. The patient should undergo a complete trauma series of X-rays; these results are evaluated by a physician and used in confirming or reformulating the working diagnosis.
Consensus was reached on two competent team guidelines that indicate that all professionals involved in trauma care should have completed specific trauma courses in addition to their professional education. They should be experienced in delivering care to a severe trauma patient and should have worked in trauma care for at least 1.5 years.
Consensus was reached on one interdisciplinary process guideline. It was agreed that, during or shortly after treating the severe trauma patient, at least 80% of all 7 team members (as named in the competent team flowcharts) should judge cooperation, communication and feedback within and between teams as satisfactory. This implies that the guideline is met when at most 1 of the 7 professionals named in the competent team flowcharts was dissatisfied with cooperation, communication and feedback.
Effects of the work setting on the average percentage of ‘no opinion’ categorized by the domain of the Likert items
Average percentage ‘no opinion’ on items in the domain:
Prehospital and emergency department
In this Delphi study, a representative national expert panel achieved consensus on a set of guidelines describing the optimal process of care in the Netherlands for severely injured trauma patient.
According to the guidelines, the time interval between the call to the dispatch nurse until the moment that the patient leaves the trauma room of a level 1 trauma centre should not exceed 60 min. Critical actions in this time frame include the dispatch of an ambulance in conjunction with an MMT, ABCDE stabilisation, formulation of a provisional diagnosis, transportation to a level 1 trauma centre, complete trauma team presence at the ED when the patient arrives, and a complete trauma series of X-rays to confirm or adapt the provisional diagnosis. The Delphi panel indicated that the patient should be cared for by competent teams, as assessed by novel flow charts. Moreover, the perception of cooperation, communication and feedback within and between all team members should be judged as satisfactory.
An inherent limitation of our design is that studies based on expert opinion are low in the ranking of scientific evidence. The relation between the developed process guidelines and functional outcome or mortality should be established in later validation studies. This approach has been applied in the USA, where a national panel of trauma experts reached consensus on 28 criteria to evaluate prehospital trauma care . Subsequently, two of the proposed audit filters were validated, and only one of these filters was associated with increased mortality .
A second limitation is that consensus was based on a national study, reflecting the unique aspects of the Dutch setting (including densely populated cities and relatively short distances between hospitals). However, the Dutch trauma system operates according to international standards and many core results might be transferred to trauma systems working with similar processes in a similar structure. Furthermore, some of the guidelines may be generically applicable, as the anatomic and physiological damage resulting from injuries are similar worldwide. However, to assess which of the guidelines may be generalisable to all trauma systems, an international expert panel study is recommended.
A third limitation of our study is that the response rates dropped from 87% in the first round to 48% in the final 5th round; however, the sensitivity analysis did not reveal any selective withdrawal by occupation or by setting. Moreover, the 61 respondents that filled out all 5 questionnaires did not answer questions differently from the 66 respondents that filled out questionnaires 1 to 4 only. This implies that response bias is minimal and that the results of this study can be interpreted as a national consensus among all professions involved in Dutch regional trauma care.
Although national consensus was reached, more research is needed to elucidate the possible connection between time intervals and outcome in the trauma patient. Some authors reported that mortality increased with increasing time spent out of hospital [27, 28] whereas others did not find this association [10, 29–31]. Authors that studied timeliness in the ED setting could not establish a relation with outcome [10, 32]. Our Delphi panel stated that critical limits for the time spent on scene are only relevant for patients in whom a ‘scoop and run’ strategy is applied as this is the subgroup of trauma patients where time is expected to be most crucial; these subgroups include patients with traumatic brain injury and penetrating injuries. Studies on prehospital time intervals in these subgroups could not establish a relation with outcome [22–24].
Although our Delphi study identified many ‘action filters’ that are already addressed in the ACSCOT and ATLS, we also found a filter not yet mentioned in the literature, i.e. formulating a provisional diagnosis in the prehospital setting.
Two of the action guidelines as proposed by our panel are related to the organisation of trauma care: dispatch of an ambulance in conjunction with an MMT and transport to a level 1 trauma centre. Dispatch of an MMT in addition to an ambulance brings a physician to the scene. It is reported that mortality decreases when patients are treated on scene by a physician in conjunction with a nurse [33, 34]. Transportation of a severely injured trauma patient to a level 1 trauma centre is in line with the current international standards [9, 32, 35, 36]. In contrast, the establishment of a provisional diagnosis is, as far as we know, never mentioned and/or investigated as a relevant aspect of trauma care. The expert panel agreed on the establishment of a provisional diagnosis as a guideline for quality of trauma care for the prehospital setting and the ED setting. Further research is needed to evaluate the possible value of the provisional diagnosis as a process guideline.
Available evidence on the education and experience of a prehospital or ED team is scarce and inconclusive. Some found a contribution of the surgeon’s experience on outcome of the trauma patient [37, 38], whereas others found no effect [39–41]. Available studies were unable to show any effect of trauma courses on the outcome of severe trauma patients [15, 16]. No studies were found that combined the competencies of several team members. Future studies should establish whether being treated by competent teams, as assessed with our novel flow charts, offers an advantage in terms of survival and/or functional outcome in the severe trauma patient.
Our panel defined one interdisciplinary process guideline which lies on largely unexplored terrain; its validity in trauma care practice has yet to be established. However, the interdisciplinary process guideline is in accordance with current international standards on medical specialty training that place emphasis on cooperation and communication skills .
The results of this study can be seen as a new field standard for quality in trauma care in the Netherlands. The standards are based on a national consensus among all professionals involved in regional trauma care; this should facilitate the acceptance of the guidelines by all stakeholders. Additional steps are required before the set of guidelines can be validated and implemented. First, a thorough analysis of the availability and reliability of the data needed to assess the guidelines is required in order to monitor and improve the performance of a trauma system. Future research needs to determine whether adherence to specific guidelines (or the set as a whole) is associated with improved survival and/or functional outcome of the severe trauma patient.
The Delphi panel developed 21 process guidelines for trauma care which can be considered as new tools to measure the quality of trauma care in the Netherlands. The time and performance-related process guidelines reflect accepted concepts and are partly underpinned by scientific evidence, whereas the competencies and interdisciplinary-related process guidelines are new in this domain.
In addition to time intervals and appropriate actions, these guidelines emphasise the importance of team competence and the interdisciplinary process in trauma care. The guidelines can be seen as the description of a best practice and a new field standard in the Netherlands. The next step is to implement the guidelines and subsequently monitor the performance of the Dutch trauma system based on these guidelines.
Airway Breathing Circulation Disability Exposure and Environment
American College of Surgeons Committee on Trauma
Advanced Trauma Life Support
Mobile Medical Team
Nominal Group Technique.
The authors thank all the experts who participated in the Delphi panel.
This study was funded by the Netherlands Organisation for Health Research and Development (ZonMw).
- Civil ID: What is quality care in trauma?. Injury. 2007, 38 (5): 525-526. 10.1016/j.injury.2007.03.001.View ArticlePubMedGoogle Scholar
- Donabedian A: The quality of care. How can it be assessed?. JAMA. 1988, 260 (12): 1743-1748. 10.1001/jama.1988.03410120089033.View ArticlePubMedGoogle Scholar
- Celso B, Tepas J, Langland-Orban B, Pracht E, Papa L, Lottenberg L, Flint L: A systematic review and meta-analysis comparing outcome of severely injured patients treated in trauma centers following the establishment of trauma systems. J Trauma. 2006, 60 (2): 371-378. 10.1097/01.ta.0000197916.99629.eb.View ArticlePubMedGoogle Scholar
- Haas B, Jurkovich GJ, Wang J, Rivara FP, Mackenzie EJ, Nathens AB: Survival advantage in trauma centers: expeditious intervention or experience?. J Am Coll Surg. 2009, 208 (1): 28-36. 10.1016/j.jamcollsurg.2008.09.004.View ArticlePubMedGoogle Scholar
- MacKenzie EJ, Rivara FP, Jurkovich GJ, Avery B, Nathens AB, Frey KP, Egleston BL, Salkever DS, Scharfstein DO: A national evaluation of the effect of trauma-center care on mortality. N Engl J Med. 2006, 354 (4): 366-378. 10.1056/NEJMsa052049.View ArticlePubMedGoogle Scholar
- Nathens AB, Brunet FP, Maier RV: Development of trauma systems and effect on outcomes after injury. Lancet. 2004, 363 (9423): 1794-1801. 10.1016/S0140-6736(04)16307-1.View ArticlePubMedGoogle Scholar
- Peleg K, Aharonson-Daniel L, Stein M, Kluger Y, Michaelson M, Rivkind A, Boyko V: Increased survival among severe trauma patients: the impact of a national trauma system. Arch Surg. 2004, 139 (11): 1231-1236. 10.1001/archsurg.139.11.1231.View ArticlePubMedGoogle Scholar
- Beeck EF, Larsen CF, Lyons RA, Meerding WJ, Mulder S, Essink-Bot ML: Guidelines for the conduction of follow-up studies measuring injury-related disability. J Trauma. 2007, 62 (2): 534-550. 10.1097/TA.0b013e31802e70c7.View ArticlePubMedGoogle Scholar
- Cameron PA, Gabbe BJ, McNeil JJ: The importance of quality of survival as an outcome measure for an integrated trauma system. Injury. 2006, 37 (12): 1178-1184. 10.1016/j.injury.2006.07.015.View ArticlePubMedGoogle Scholar
- Di Bartolomeo SD, Valent F, Sanson G, Nardi G, Gambale G, Barbone F: Are the ACSCOT filters associated with outcome? Examining morbidity and mortality in a European setting. Injury. 2008, 39 (9): 1001-1006. 10.1016/j.injury.2008.04.009.View ArticlePubMedGoogle Scholar
- Task Force of the Committee on Trauma ACoS: Resources for optimal care of the injured patient: an update. Bull Am Coll Surg. 1990, 75 (9): 20-29.Google Scholar
- Di Bartolomeo SD, Valent F, Rosolen V, Sanson G, Giuseppe N, Cancellieri F, Barbone F: Are pre-hospital time and emergency department disposition time useful process indicators for trauma care in Italy?. Injury. 2007, 38 (3): 305-311. 10.1016/j.injury.2006.10.005.View ArticlePubMedGoogle Scholar
- Jayaraman S, Sethi D: Advanced trauma life support training for ambulance crews. Cochrane Database Syst Rev. 2010, 1: CD003109.PubMedGoogle Scholar
- Jayaraman S, Sethi D: Advanced trauma life support training for hospital staff. Cochrane Database Syst Rev. 2009, 2: CD004173.PubMedGoogle Scholar
- Stelfox HT, Straus SE, Nathens A, Bobranska-Artiuch B: Evidence for quality indicators to evaluate adult trauma care: a systematic review. Crit Care Med. 2011, 39 (4): 846-859. 10.1097/CCM.0b013e31820a859a.View ArticlePubMedGoogle Scholar
- Willis CD, Stoelwinder JU, Cameron PA: Interpreting process indicators in trauma care: construct validity versus confounding by indication. Int J Qual Health Care. 2008, 20 (5): 331-338.View ArticlePubMedGoogle Scholar
- Willis CD, Gabbe BJ, Cameron PA: Measuring quality in trauma care. Injury. 2007, 38 (5): 527-537. 10.1016/j.injury.2006.06.018.View ArticlePubMedGoogle Scholar
- Evans C, Howes D, Pickett W, Dagnone L: Audit filters for improving processes of care and clinical outcomes in trauma systems. Cochrane Database Syst Rev. 2009, 4: CD007590.PubMedGoogle Scholar
- Hasson F, Keeney S, McKenna H: Research guidelines for the Delphi survey technique. J Adv Nurs. 2000, 32 (4): 1008-1015.PubMedGoogle Scholar
- Jones J, Hunter D: Consensus methods for medical and health services research. BMJ. 1995, 311 (7001): 376-380. 10.1136/bmj.311.7001.376.View ArticlePubMedPubMed CentralGoogle Scholar
- Powell C: The Delphi technique: myths and realities. J Adv Nurs. 2003, 41 (4): 376-382. 10.1046/j.1365-2648.2003.02537.x.View ArticlePubMedGoogle Scholar
- Eachempati SR, Robb T, Ivatury RR, Hydo LJ, Barie PS: Factors associated with mortality in patients with penetrating abdominal vascular trauma. J Surg Res. 2002, 108 (2): 222-226. 10.1006/jsre.2002.6543.View ArticlePubMedGoogle Scholar
- Härtl R, Gerber LM, Iacono L, Ni Q, Lyons K, Ghajar J: Direct transport within an organized state trauma system reduces mortality in patients with severe traumatic brain injury. J Trauma. 2006, 60 (6): 1250-1256. 10.1097/01.ta.0000203717.57821.8d.View ArticlePubMedGoogle Scholar
- Pepe PE, Wyatt CH, Bickell WH, Bailey ML, Mattox KL: The relationship between total prehospital time and outcome in hypotensive victims of penetrating injuries. Ann Emerg Med. 1987, 16 (3): 293-297. 10.1016/S0196-0644(87)80174-9.View ArticlePubMedGoogle Scholar
- Rosengart MR, Nathens AB, Schiff MA: The identification of criteria to evaluate prehospital trauma care using the Delphi technique. J Trauma. 2007, 62: 708-713. 10.1097/01.ta.0000197150.07714.c2.View ArticlePubMedGoogle Scholar
- Laudermilch DJ, Schiff MA, Nathens AB, Rosengart MR: Lack of emergency medical services documentation is associated with poor patient outcomes: a validation of audit filters for prehospital trauma care. J Am Coll Surg. 2010, 210: 220-227. 10.1016/j.jamcollsurg.2009.10.008.View ArticlePubMedGoogle Scholar
- Gonzalez RP, Cummings GR, Phelan HA, Mulekar MS, Rodning CB: Does increased emergency medical services prehospital time affect patient mortality in rural motor vehicle crashes? A statewide analysis. Am J Surg. 2009, 197 (1): 30-34. 10.1016/j.amjsurg.2007.11.018.View ArticlePubMedGoogle Scholar
- Sampalis JS, Denis R, Lavoie A, Frechette P, Boukas S, Nikolis A, Benoit D, Fleiszer D, Brown R, Churchill-Smith M, Mulder D: Trauma care regionalization: a process-outcome evaluation. J Trauma. 1999, 46 (4): 565-579. 10.1097/00005373-199904000-00004.View ArticlePubMedGoogle Scholar
- Lerner EB, Billittier AJ, Dorn JM, Wu YW: Is total out-of-hospital time a significant predictor of trauma patient mortality?. Acad Emerg Med. 2003, 10 (9): 949-954. 10.1111/j.1553-2712.2003.tb00650.x.View ArticlePubMedGoogle Scholar
- Pons PT, Markovchick VJ: Eight minutes or less: does the ambulance response time guideline impact trauma patient outcome?. J Emerg Med. 2002, 23 (1): 43-48. 10.1016/S0736-4679(02)00460-2.View ArticlePubMedGoogle Scholar
- Ringburg AN, Spanjersberg WR, Frankema SP, Steyerberg EW, Patka P, Schipper IB: Helicopter emergency medical services (HEMS): impact on on-scene times. J Trauma. 2007, 63 (2): 258-262. 10.1097/01.ta.0000240449.23201.57.View ArticlePubMedGoogle Scholar
- Cornwell EE, Chang DC, Phillips J, Campbell KA: Enhanced trauma program commitment at a level I trauma center: effect on the process and outcome of care. Arch Surg. 2003, 138 (8): 838-843. 10.1001/archsurg.138.8.838.View ArticlePubMedGoogle Scholar
- Osterwalder JJ: Mortality of blunt polytrauma: a comparison between emergency physicians and emergency medical technicians–prospective cohort study at a level I hospital in eastern Switzerland. J Trauma. 2003, 55 (2): 355-361. 10.1097/01.TA.0000034231.94460.1F.View ArticlePubMedGoogle Scholar
- Roudsari BS, Nathens AB, Cameron P, Civil I, Gruen RL, Koepsell TD, Lecky FE, Lefering RL, Liberman M, Mock CN, Oestern HJ, Schildhauer TA, Waydhas C, Rivara FP: International comparison of prehospital trauma care systems. Injury. 2007, 38 (9): 993-1000. 10.1016/j.injury.2007.03.028.View ArticlePubMedGoogle Scholar
- Demetriades D, Martin M, Salim A, Rhee P, Brown C, Doucet J, Chan L: Relationship between American College of Surgeons trauma center designation and mortality in patients with severe trauma (injury severity score > 15). J Am Coll Surg. 2006, 202 (2): 212-215. 10.1016/j.jamcollsurg.2005.09.027.View ArticlePubMedGoogle Scholar
- Durham R, Pracht E, Orban B, Lottenburg L, Tepas J, Flint L: Evaluation of a mature trauma system. Ann Surg. 2006, 243 (6): 775-783. 10.1097/01.sla.0000219644.52926.f1.View ArticlePubMedPubMed CentralGoogle Scholar
- Pasquale MD, Peitzman AB, Bednarski J, Wasser TE: Outcome analysis of Pennsylvania trauma centers: factors predictive of nonsurvival in seriously injured patients. J Trauma. 2001, 50 (3): 465-472. 10.1097/00005373-200103000-00010.View ArticlePubMedGoogle Scholar
- Konvolinka CW, Copes WS, Sacco WJ: Institution and per-surgeon volume versus survival outcome in Pennsylvania's trauma centers. Am J Surg. 1995, 170 (4): 333-340. 10.1016/S0002-9610(99)80299-2.View ArticlePubMedGoogle Scholar
- Cooper A, Hannan EL, Bessey PQ, Farrell LS, Cayten CG, Mottley L: An examination of the volume-mortality relationship for New York State trauma centers. J Trauma. 2000, 48 (1): 16-23. 10.1097/00005373-200001000-00004.View ArticlePubMedGoogle Scholar
- Glance LG, Osler TM, Dick A, Mukamel D: The relation between trauma center outcome and volume in the National Trauma Databank. J Trauma. 2004, 56 (3): 682-690. 10.1097/01.TA.0000053469.92142.40.View ArticlePubMedGoogle Scholar
- Richardson JD, Schmieg R, Boaz P, Spain DA, Wohltmann C, Wilson MA, Carrillo EH, Miller FB, Fulton RL: Impact of trauma attending surgeon case volume on outcome: is more better?. J Trauma. 1998, 44 (2): 266-271. 10.1097/00005373-199802000-00004.View ArticlePubMedGoogle Scholar
- Frank JR, Langer B: Collaboration, communication, management, and advocacy: teaching surgeons new skills through the CanMEDS Project. World J Surg. 2003, 27 (8): 972-978. 10.1007/s00268-003-7102-9.View ArticlePubMedGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1472-6963/13/79/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.