Skip to main content

The role of feedback in emergency ambulance services: a qualitative interview study

Abstract

Background

Several international studies suggest that the feedback that emergency ambulance service (EMS) personnel receive on the care they have delivered lacks structure, relevance, credibility and routine implementation. Feedback in this context can relate to performance or patient outcomes, can come from a variety of sources and can be sought or imposed. Evidence from health services research and implementation science, suggests that feedback can change professional behavior, improve clinical outcomes and positively influence staff mental health. The current study aimed to explore the experience of EMS professionals regarding current feedback provision and their views on how feedback impacts on patient care, patient safety and staff wellbeing.

Methods

This qualitative study was conducted as part of a wider study of work-related wellbeing in EMS professionals. We used purposive sampling to select 24 frontline EMS professionals from one ambulance service in the United Kingdom and conducted semi-structured interviews. The data was analyzed in iterative cycles of inductive and deductive reasoning using Abductive Thematic Network Analysis. The analysis was informed by psychological theory, as well as models from the wider feedback effectiveness and feedback-seeking behavior literature.

Results

Participants viewed current feedback provision as inadequate and consistently expressed a desire for increased feedback. Reported types of prehospital feedback included patient outcome feedback, patient-experience feedback, peer-to-peer feedback, performance feedback, feedforward: on-scene advice, debriefing and investigations and coroners’ reports. Participants raised concerns that inadequate feedback could negatively impact on patient safety by preventing learning from mistakes. Enhancing feedback provision was thought to improve patient care and staff wellbeing by supporting personal and professional development.

Conclusions

In line with previous research in this area, this study highlights EMS professionals’ strong desire for feedback. The study advances the literature by suggesting a typology of prehospital feedback and presenting a unique insight into the motives for feedback-seeking using psychological theory. A logic model for prehospital feedback interventions was developed to inform future research and development into prehospital feedback.

Peer Review reports

Background

The work of emergency medical services (EMS) has traditionally involved rapid transportation of patients to the nearest Emergency Department (ED). However, over the last two decades EMS have undergone significant changes signposted by landmark reports such as ‘Taking Healthcare to the Patient’ in the United Kingdom (UK) and ‘Emergency Medical Services: At the Crossroads’ in the United States [1,2,3]. EMS professionals now routinely assess and treat patients at home, refer them via alternative community pathways or bypass local hospitals in favor of advanced treatment in specialized centers. The resulting detailed assessments, complex decisions and lengthier transports [4, 5] have led to EMS professionals feeling more involved in patient care and wanting to know whether their clinical decisions were correct, known as “clinical curiosity” ( [6], p. 100).

There are, however, limitations in the current provision of feedback for EMS professionals. A study from Canada suggests that current prehospital feedback provision lacks structure, relevance, credibility and routine implementation [7]. A large-scale United States survey revealed that 45.5% of EMS professionals had not received feedback on the medical care they provided in a 30 day period [8]. Indeed, when encountering particularly difficult or unique cases, EMS professionals informally follow-up patients by contacting ED staff due to a lack of formal patient outcome feedback [9]. This is referred to by Croskerry as “specialty follow-up deficiency” ( [10], p. 1233) in relation to ED physicians.

The term “feedback” has many uses both within and beyond clinical practice and the academic literature on the topic. Feedback in the prehospital context may relate to performance or patient outcomes, can come from a variety of sources and can be either sought or imposed. In the medical education literature, evidence synthesis suggests that effective feedback should focus on the task rather than the individual and should be both specific and linked to personal development goals [11]. Within the broader implementation science literature, audit and feedback of individual performance is a well-researched phenomenon. Systematic reviews suggest that providing feedback to healthcare professionals results in small to moderate improvements in patient care and positive influences on staff engagement and mental health [12, 13]. This is especially relevant, in light of mental health disorders being more prevalent amongst EMS professionals than in the general population [14].

Health service researchers further suggest that feedback could improve patient safety [15,16,17]. This is highly pertinent because the uncontrolled prehospital environment represents an area of high risk for errors and harm [18]. A recent scoping review suggests that prehospital patient safety needs to become a more prominent consideration [19]. In areas such as non-conveyance, treatment, diagnosis and handover to hospital, the literature suggests this could be addressed by prehospital feedback interventions [18,19,20,21]. However, whilst research into feedback in certain areas of healthcare, e.g. primary care or outpatient settings, is well established, very little research addresses feedback in a prehospital setting.

Building on existing work in the field of audit and feedback, Brown et al. developed Clinical Performance Feedback Intervention Theory (CP-FIT) [22]. This cyclical model illustrates how feedback works within healthcare and outlines three factors that influence feedback effectiveness: feedback variables, recipient variables and context variables [22]. Brown et al. propose that these variables operate via a set of explanatory mechanisms; thereby, advancing our currently limited understanding of the mechanisms by which feedback influences outcomes in a real-world clinical setting [22, 23].

Alongside the feedback effectiveness literature centered on audit and feedback, a separate body of work has focused on Feedback-Seeking Behavior (FSB), which seeks to explore recipients’ motives for seeking feedback [24,25,26]. To fully understand feedback and its effects, there have been calls to integrate the two separate literature streams of feedback effectiveness and FSB [27].

Recent research into feedback provided to ED physicians identified the need to know whether recipients value feedback, highlighted the effects of feedback on personal and professional development, and suggested that further research is needed to determine the most effective feedback strategies and components in the ED environment [28,29,30]. These research gaps are echoed within the limited research on prehospital feedback, where studies by Morrison et al. and Cash et al. emphasize that further research is needed to explore feedback content and impact on prehospital practice [7, 8]. A recent, small-scale qualitative study suggests the lack of prehospital feedback reported internationally exists in the UK [31].

A deeper understanding of prehospital feedback is timely in light of several major health systems beginning to develop EMS guidance and policy relating to the provision of prehospital feedback. Examples from the United States are the recently published position statement by the National EMS Management Association [32] and the ‘EMS Agenda 2050’ report [33], which envisions EMS clinicians and systems receiving rapid feedback on patient outcomes to improve performance measurement, quality improvement and education.

The aim of the present study was to explore the perceptions of EMS professionals regarding current provision of prehospital feedback and their views on how feedback impacts patient care, patient safety and staff wellbeing. The latter included participants’ ideas concerning what could be achieved through enhancing existing prehospital feedback provision. The interview data was collected as part of a wider exploratory study of work-related wellbeing in EMS professionals in the UK, which included a prehospital feedback focus.

Methods

Study design and setting

This study employed a qualitative approach using semi-structured interviews with frontline EMS professionals from a single UK ambulance service. The research team consisted of qualitative researchers (BK, GJ, JB), a paramedic early career researcher (CW) and two undergraduate psychology students (FT, AH). The interviews took place via telephone or face-to-face in an ambulance service headquarters setting with only the participant and researcher present. They were conducted between April–June 2019 by three female members of the research team, who were from different backgrounds (health services research, psychological science). All interviewers were trained in qualitative methods with the senior researcher (GJ) being an experienced qualitative researcher. The study was carried out in accordance with the UK Policy Framework for Health and Social Care Research [34]. It was approved by the Health Research Authority (IRAS project ID 255406) and the University of Leeds ethics committee (PSC-518 22/11/2018). The Consolidated Criteria for Reporting Qualitative Research was used to guide study reporting [35].

Selection of participants

Recruitment was conducted using purposive sampling and targeted the full spectrum of EMS personnel who had both patient contact and clinical responsibility (e.g. paramedics, emergency medical technicians [EMTs], clinical supervisors). Recruitment was conducted separate from the study team by the research department of the participating ambulance service through advertisement in the weekly ambulance staff bulletin. Recruitment reminders targeted specific staff subgroups with fewer responses to the first interview invitation. Staff expressing interest in participating were invited to email the research team directly, who screened participants for eligibility and provided a study information pack. Interviewers did not have an established relationship with participants prior to the study. To encourage participation, interviewees received a £25 voucher. Although patients were not interviewed as study participants, the research team involved patients through broader consultation with a patient-representative group.

Data collection

Interviews were conducted using a semi-structured interview guide (Additional file 1), which was developed by the research team in consultation with patient representatives and reviewed by the ambulance service research department prior to study onset. The interviews sought to explore participants’ views on five different areas: work-related wellbeing, engagement, existing support systems, patient safety and feedback. Questions on feedback were informed by the existing prehospital feedback literature [7,8,9, 31] and stakeholder engagement with the ambulance service. This suggested that EMS personnel informally followed up on patient outcomes and therefore this type of feedback was specifically probed during the interview if it was not spontaneously mentioned by the participant.

Semi-structured interviews were chosen as they allowed the interviewer to guide the interviewee to address particular research questions whilst also providing flexibility for the discussion to move with the direction of the participant [36]. Prior to interview, respondents were provided with standardised research information regarding the study’s purpose and informed written consent was obtained. The interviews were audio-recorded and professionally transcribed. All data were anonymised to conceal participant identities. Interview transcripts were imported into NVivo (Version 12 Plus, QSR International) to support analysis.

Data analysis

Data was analysed following Abductive Thematic Network Analysis [37], which builds upon the principles of thematic analysis and thematic networks [38,39,40]. Abductive reasoning was considered the most appropriate analysis approach for this study, because neither inductive nor deductive reasoning in isolation adequately addressed the study aim and intention. Abductive analysis seeks to construct new theory using iterative cycles of analytic interpretation, moving between the literature and empirical data [41, 42].

Themes were developed using iterative cycles of inductive and deductive reasoning, which involved drawing upon suitable theories from the feedback effectiveness and FSB literature [22, 24,25,26]. Developed themes were descriptive and conceptual in nature with linkages between themes depicted in a thematic map. The entire dataset was coded by a researcher from a paramedic background (CW) with input from an undergraduate psychology student (AH) and a senior health services researcher (JB). Although only one part of the interview guide specifically explored feedback, the interview transcripts were analysed in their entirety as part of the present study. Trustworthiness of the analysis was ensured through researcher reflexivity and an audit trail of theme development. The initial interpretation of the findings was presented to ambulance service representatives to ensure face validity.

Within certain branches of qualitative research, the concept of data saturation is firmly embedded, but Braun and Clarke [43] have challenged its relevance in reflexive thematic analysis. Their concerns similarly apply to the Abductive Thematic Network Analysis employed in this study, as the way findings were generated through abductive interpretation of the data brings with it an element of uncertainty and further interpretation of the existing or additional data may alter the developed theory [41]. In line with Braun and Clarke’s [43] suggestion to view ‘saturation’ as “an interpretative judgement related to the purpose and goals of the analysis” (p.10), we believe theoretical sufficiency was achieved through in-depth analysis in accordance with the study aim, as presented in the following.

Results

Twenty-six participants were interviewed, with one interview recording error and one participant not covering the topic of feedback due to time constraints, resulting in a total of 24 interviews for inclusion in the analysis. The interviews lasted between 23 and 87 min, with a mean interview duration of 53 min. The participants were paramedics (n = 9), EMTs (n = 4), Emergency Care Assistants (ECA, n = 4), specialist paramedics (n = 3) and clinical supervisors (n = 4). The majority of participants were male (62.5%) and mean participant length in service was 9.6 years with a range of 1–29 years.

During data analysis, four organizing themes were developed (feedback provision, feedback types, motives for seeking feedback, and feedback mechanisms/outcomes) each comprising a number of basic themes. To provide a visual summary, organizing and basic themes were captured in a thematic network map displayed in Fig. 1, with arrows indicating between-theme relationships.

Fig. 1
figure 1

Prehospital feedback - thematic network map

The descriptive themes of feedback provision and feedback types are presented below, followed by the conceptual themes of motives for seeking feedback and feedback mechanisms/outcomes. Representative quotes are presented in tables for descriptive themes and integrated within the narrative text for conceptual themes, with additional illustrative quotes provided in Additional file 2. Our definition of mechanisms mirrors that of CP-FIT, i.e. explanatory mechanisms by which feedback impacts upon practice, not the actual mode of delivery of the feedback, which we have included under ‘feedback provision’ [22].

Feedback provision

A majority of participants indicated that current feedback provision was inadequate, with feedback having to be self-initiated and some feeling like they only received negative feedback (Table 1). Participants consistently expressed a desire for more feedback, with several stating they wanted feedback, even if the message was not positive, for example: “sometimes I think the not knowing is kind of worse” (ECA, 3916). Three participants described their current feedback provision to be good, of which two were specialist paramedics who identified that the level of feedback they received was due to their specialist role. The remaining participant was a newly qualified paramedic who acknowledged that they received increased support due to being newly qualified. One male paramedic (P3924) suggested that females were more likely than males to seek and receive feedback but this was not mentioned by other participants so may be a unique perspective in our dataset.

Table 1 Feedback provision – basic themes and representative quotes

Participants identified several potential barriers to prehospital feedback such as patient confidentiality, the time and effort involved in providing feedback, a geographically dispersed workforce, solitary working and a lack of data linkage. Participants wanted feedback to be detailed, timely, target driven, consistent and provided for ‘the right cases’. However, descriptions of what ‘the right cases’ were varied from difficult diagnoses, to non-conveyance, major incidents or critical patients. Participants described that they would prefer to receive feedback verbally as part of a face-to-face conversation, but acknowledged that written feedback via email or text may be more practical to provide. Participants reported being accepting of negative feedback so long as this was provided in a sensitive manner to avoid feeling like feedback was “disciplinary, rather than a learning experience” (Paramedic, P3912).

Feedback types

As previously highlighted, the interview guide (Additional file 1) specifically set out to explore patient outcome feedback. However, participants referred to a wide variety of feedback types in their responses when talking about current and desired feedback despite not being prompted for them. Interpretation of the data suggests seven different types of prehospital feedback with four different sources (Table 2). Patient outcome feedback (predominantly, its absence) was most frequently mentioned: “A lot of the time there is not much follow-up from patients” (Specialist paramedic, P3904). Patient-experience feedback was the second most common feedback type mentioned by participants and was usually referred to in the context of thank you letters (and less frequently, complaints). Peer-to-peer feedback was described as feedback from “your own crew mate that says: ‘You did really good on that job’” (ECA, P3910).

Table 2 Types of prehospital feedback – basic themes and representative quotes

Performance feedback related to regular appraisals or development reviews, whilst on-scene advice was captured as a feedforward mechanism, in which participants suggested they could “ring the clinical hub and they can give you some advice” (Paramedic, P3905). On-scene advice is conceptually different than the other feedback types, as it does not represent feedback on past performance but rather feedback on planned action and anticipated outcome of that, i.e. “I have got this situation and I was going to do this, is that the right thing to do?” (Paramedic, P3906).

Debriefings were repeatedly mentioned as occurring after unusual incidents or those involving multiple resources, for example “a serious trauma job, there will be multiple team members there and you will do a debrief after the job” (ECA, P3916). Lastly, investigations and feedback from coroners’ reports were identified but mentioned least frequently by participants.

Motives for seeking feedback

Upon identifying the different types of feedback mentioned by participants, it became clear that sometimes feedback was simply provided routinely as part of performance appraisals, but on other occasions was sought intentionally by EMS professionals. When actively seeking feedback, interpretation of the data revealed a wide variety of motives. The most commonly mentioned motive was to improve patient care, which was solely mentioned in relation to patient outcome feedback and was about the desire to “improve the standard and quality of the care that I can provide as a clinician” (Specialist Paramedic, P3904).

A desire for closure was a motivating factor for seeking several types of feedback, with a specialist paramedic (P3935) describing that patient outcome feedback “help [s] you to put it to bed a bit more”. A motive relating to all feedback types was desiring reassurance and praise with an ECA (P3910) stating that “everybody wants to be told they’ve done a good job”.

Another frequently mentioned motive was clinical curiosity or reducing uncertainty: “Sometimes I would like to know that bit more, not the full ins and outs but to actually know whether or not I had gone down the correct pathway, or my hunch was right with what that patient was, the injury or what it was and if it wasn’t and I had missed something then I would like to know, so that I can learn from it” (EMT, P3911). Clinical curiosity appeared to be heightened given the isolated working environment of EMS professionals, with one clinical supervisor (P3918) stating “because they are autonomously treating and assessing patients they do need to know if they have gone the right way”.

Feedback mechanisms and outcomes

Basic themes related to participants’ perceptions of the outcomes of feedback predominantly addressed the learning processes of both professional and personal development. In the context of professional development, increased knowledge and reflection were perceived to lead to better decision-making and behavior change: “You would know that you were doing it right or if you were doing it wrong, then you would change something” (Paramedic, P3938) and “It is for your own clinical development. It kind of builds your knowledge” (Paramedic, P3905).

Another participant referred to the mechanisms of learning and reflection as “recruiting their own clinical practices” (Specialist paramedic, P3904) as exemplified in the following: “It is nice to know [what happened to the patient] but also it just helps you to learn, to recognize symptoms. You know, if you’re thinking ‘it’s this’ and it turns out to be something else. You can try to recognize little pointers, little signs and symptoms that’ll help you make your decision next time” (Paramedic, P3919).

Increased confidence was also perceived to play a role in professional development with one ECA (P3016) indicating that positive feedback “gives you a bit of a confidence boost that you are knowledgeable in what you are doing”. Similarly, there was an acknowledgement of the benefits of increased intra-professional dialogue: “there can be a million ways in which you can do the same job, so it is quite good to get feedback from people. To get a pool of ideas together just for your own practice really.” (ECA, P3916).

Concerning personal development, participants talked about the role of feedback in increasing staff mental health, job satisfaction and dialogue with peers: “If you had a little feedback that ‘Actually you’ve done that really well’, ‘you made this sort of positive impact’, maybe it would have a little bit more impact on your wellbeing and it would sort of affirm in your mind that you’ve done the best that you could do. It would make everyone feel a bit better” (EMT, P3926).

In many cases, participants related this back to their work and increased job satisfaction, with one EMT (P3925) surmising that “getting a thank you would probably change staff’s mind set on things, willing to do more as opposed to digging their heels in the ground which a lot of us do because we’ve just had enough of being abused for such a long time”.

These mechanisms and outcomes appeared to relate to the majority of feedback types and motives mentioned, although participants did not seem to link any of these outcomes to unsought feedback from routine appraisals, as illustrated in the arrows in Fig. 1.

Discussion

This study aimed to explore the experience of EMS professionals regarding current feedback provision and their views on how feedback impacts on patient safety, staff wellbeing and professional development. Qualitative analysis of interview transcripts yielded rich insights into current feedback provision, feedback types, and motives for seeking feedback, as well as mechanisms and outcomes of prehospital feedback (Fig. 1). An important finding from this study is that EMS personnel viewed current feedback provision as inadequate and consistently expressed a desire for more feedback, especially those in a non-specialist, post-training role. Enhancing feedback provision was thought to improve patient safety by supporting professional development and clinical decision-making, facilitating reflection, knowledge acquisition and professional behavior change. Similarly, participants thought that enhanced feedback could improve staff wellbeing by enabling closure and encouraging intra-professional dialogue and peer-support.

An important contribution of our study to the existing literature is the identification of a potential typology of feedback for prehospital clinicians that includes: patient outcome feedback, patient-experience feedback, peer-to-peer feedback, performance feedback, feedforward: on-scene advice, debriefing and investigations or coroners’ reports. Although this typology is based upon testimony from one EMS context, it may serve as a useful model for further development of prehospital feedback interventions or further evaluative research. The reported inadequacy in current feedback provision observed in this study is congruent with other studies’ findings; although, all participants in this study were able to describe examples of when they had received feedback [7, 8, 31]. Study participants named several barriers such as patient confidentiality and the time and resources involved as possible reasons for inadequate feedback provision, consistent with those reported in the literature [44].

Prior audit and feedback research has identified a range of characteristics for effective feedback in non-EMS settings [12, 45, 46]. Our study provides insight into the characteristics that are important for feedback in prehospital care, including: timeliness, inclusion of explicit targets and individualized reports with relevant detail. The concept of providing feedback on ‘the right cases’ was similarly discussed in a smaller qualitative prehospital study where participants requested feedback on patient presentations with diagnostic uncertainty, incident closure, non-conveyance and patients discharged from ED without treatment [31]. These categories emphasize the increased complexity of decisions made by EMS professionals whilst faced with inadequate feedback provision, referred to as the ‘feedback paradox’ in other studies [47].

Although, FSB has been alluded to in other prehospital feedback studies [7, 31], we have sought to develop further insight through our analysis by identifying FSB motives. With the exception of improving patient care, participants’ motives for seeking feedback appear to fit within models used in the broader FSB literature [26]. The feedback-seeking motive of improving patient care was the only outward-facing motive, whilst clinical curiosity, desiring reassurance and praise and closure were inward-facing motives relating to self [26]. Interestingly, improving patient care was only mentioned in connection with patient outcome feedback, whilst patient-experience feedback was perceived as only being associated with desiring reassurance and praise. In contrast, the other types of feedback provided by hospitals, peers or EMS organizations were frequently mentioned in relation to clinical curiosity and closure (Fig. 1).

To consolidate the hypotheses and practical insights for future feedback interventions generated from our analysis, we developed a logic model combining themes from our analysis (Fig. 1), Brown’s CP-FIT model and FSB theory. The resulting framework is intended to serve as a guide for future research and intervention. Crucially, CP-FIT excludes sought feedback whereas our study suggested that participants viewed existing prehospital feedback as isolated occurrences, relating to individual patients and often involving feedback-seeking behavior [22]. Existing models from the FSB literature do not capture unsought feedback types or organizational outcomes described by our participants. We therefore combined elements from both theories in our logic model to account for the study findings concerning prehospital feedback (Fig. 2) [24, 25].

Fig. 2
figure 2

Logic model for prehospital feedback interventions

Most elements of our study findings were easily reconciled to the theoretical models. However, feedback-provider aspects could not be integrated as the interview study did not set out to explore this aspect of feedback provision. The new concepts generated in this study are: the typology of prehospital feedback; the seeking or non-seeking behavior; the motive of improving patient care and the outcome of improved team climate.

Mechanisms were difficult to separate from outcomes in our data analysis, which mirrors the poor understanding of feedback mechanisms reported in the wider health services literature [23]. One of our basic themes – reflection – has previously been mentioned as a feedback effect in the prehospital literature [31, 48]. However, viewed through the lens of CP-FIT we interpret reflection as a mechanism underpinning the effect of prehospital feedback [22]. Further research is needed to explore reflection as a mechanism within prehospital feedback and feedback mechanisms more broadly.

Limitations

The study participants were professionals from the same EMS. It is also possible they had a particular interest in the topic. Therefore, direct transferability of certain contextual and perceptual observations concerning experienced feedback to a wider EMS population may be limited [49, 50]. The semi-structured nature of this qualitative study, however, permitted depth of insight into prehospital feedback processes and outcomes and the resulting logic model can be used to test transferability to other contexts.

Some interviews were undertaken by telephone which deprives the researcher of the usual non-verbal cues present in face-to-face dialogue, requiring greater reflexivity on the part of the researcher [51]. The analysis did not reveal any differences depending on how the interview was conducted, however, and the option of telephone interviews aided recruitment.

Participants often recalled examples of when they received or sought feedback, which may have been subject to recall bias. Future studies might employ different or complementary designs in which real-time data is collected when EMS professionals actually desire or receive feedback.

The lead author (CW) is a practising paramedic in a different UK ambulance service with her own clinical and feedback experiences, which might have influenced interpretation of the data. CW was not involved in data collection and arguably the researcher’s insider positionality facilitated a deeper insight into the data, supported by frequent discussions with non-clinical members of the research team (AH, JB) regarding decisions made during data analysis [52].

As previously described, abductive reasoning was employed when developing the logic model; therefore, we acknowledge that this model is provisional, tentative and in need of confirmation in keeping with the methodology we employed [37, 40]. We propose this could be done both by testing interventions based upon the model and further non-interventional studies to explore specific hypothesised mechanisms. In particular, exploring the effect of individual-level characteristics on impact and behaviors linked to feedback may be an important area of future study.

Implications for practice and research

The effects of prehospital feedback are receiving growing attention in published literature [7, 31, 44]. Our study emphasizes the potential impact of effective feedback interventions on increasing intra-professional communication; which elsewhere has been identified as a cornerstone of complex prehospital decision-making [48]. The psychological impact of prehospital feedback has previously been highlighted in two qualitative studies, which similarly suggested that EMS professionals believe feedback has a positive impact on patient care [7, 31]. However, a recent literature review on prehospital feedback concluded that few interventional studies have been able to demonstrate any effects of prehospital feedback on patient outcomes [44].

Whilst our study was non-interventional, the proposed logic model has implications for current prehospital feedback practice and research, as EMS agencies could use it to design, monitor and evaluate prehospital feedback initiatives. Further research could include empirically testing our logic model in the prehospital setting or adapting it for use in other healthcare settings. Seeing how our logic model could be implemented to support professional development and performance management is an important future area to explore. With improved feedback systems in place, EMS professionals should be able to demonstrate that they are actively seeking and using feedback to support their professional development, which is a fundamental part of professional competency frameworks for EMS professionals [53]. In other specialties, such as anesthesia, strengthening performance feedback systems has supported professional validation and continuous improvement [54].

Conclusions

This study emphasizes limitations in current feedback provision for prehospital clinicians and highlights EMS professionals’ strong desire for feedback. It builds upon existing studies by outlining a typology of prehospital feedback by source, identifying motives for seeking prehospital feedback and proposing a logic model that integrates current theory related to feedback in a clinical setting with insights from empirical data in order to guide future prehospital feedback interventions.

Availability of data and materials

The datasets generated and analyzed during the current study are not publically available as sharing entire transcripts or long excerpts would violate the agreement to which participants consented; however, an extensive list of quotes is provided within the manuscript and supporting information files, and the datasets are available from the corresponding author on reasonable request.

Abbreviations

CP-FIT:

Clinical Performance Feedback Intervention Theory

ECA:

Emergency care assistant

EMS:

Emergency medical services

EMT:

Emergency medical technician

ED:

Emergency department

FSB:

Feedback-seeking behavior

UK:

United Kingdom

References

  1. Department of Health. Taking healthcare to the patient: transforming NHS ambulance services. London: Department of Health; 2005.

    Google Scholar 

  2. Department of Health. Taking healthcare to the patient 2: a review of 6 years' progress and recommendations for the future. London: Department of Health; 2011.

    Google Scholar 

  3. Institute of Medicine. Emergency medical services: at the crossroads. Washington, DC: The National Academies Press; 2007. https://doi.org/10.17226/11629.

    Book  Google Scholar 

  4. Jensen JL, Croskerry P, Travers AH. Paramedic clinical decision making during high acuity emergency calls: design and methodology of a Delphi study. BMC Emerg Med. 2009;9:17.

    PubMed  PubMed Central  Google Scholar 

  5. O'Hara R, Johnson M, Siriwardena AN, Weyman A, Turner J, Shaw D, et al. A qualitative study of systemic influences on paramedic decision making: care transitions and patient safety. J Health Serv Res Policy. 2015;20:45–53.

    PubMed  Google Scholar 

  6. Van Dreven A, Williams B. Professional development. In: Curtis K, Ramsden C, editors. Emergency and trauma Care for Nurses and Paramedics. London: Mosby Elsevier; 2011. p. 93–108.

    Google Scholar 

  7. Morrison L, Cassidy L, Welsford M, Chan TM. Clinical performance feedback to paramedics: what they receive and what they need. AEM Educ Train. 2017;1(2):87–97.

    PubMed  PubMed Central  Google Scholar 

  8. Cash RE, Crowe RP, Rodriguez SA, Panchal AR. Disparities in feedback provision to emergency medical services professionals. Prehospital Emerg Care. 2017;21(6):773–81.

    Google Scholar 

  9. Jenkinson E, Hayman T, Bleetman A. Clinical feedback to ambulance crews: supporting professional development. Emerg Med J. 2009;26(4):309.

    CAS  PubMed  Google Scholar 

  10. Croskerry P. The feedback sanction. Acad Emerg Med Off J Soc Acad Emerg Med. 2000;7(11):1232–8.

    CAS  Google Scholar 

  11. Archer JC. State of the science in health professional education: effective feedback. Med Educ. 2010;44(1):101–8.

    PubMed  Google Scholar 

  12. Ivers N, Jamtvedt G, Flottorp S, Young JM, Odgaard-Jensen J, French SD, et al. Audit and feedback: effects on professional practice and healthcare outcomes. Cochrane Database Syst Rev. 2012;(6):CD000259. https://doi.org/10.1002/14651858.CD000259.pub3.

  13. Michie S, Williams S. Reducing work related psychological ill health and sickness absence: a systematic literature review. Occup Environ Med. 2003;60(1):3.

    CAS  PubMed  PubMed Central  Google Scholar 

  14. Petrie K, Milligan-Saville J, Gayed A, Deady M, Phelps A, Dell L, et al. Prevalence of PTSD and common mental disorders amongst ambulance personnel: a systematic review and meta-analysis. Soc Psychiatry Psychiatr Epidemiol. 2018;53(9):897–909.

    PubMed  Google Scholar 

  15. Mitchell I, Schuster A, Smith K, Pronovost P, Wu A. Patient safety incident reporting: a qualitative study of thoughts and perceptions of experts 15 years after 'To err is Human'. BMJ Qual Saf. 2016;25(2):92–9.

    PubMed  Google Scholar 

  16. Benn J, Koutantji M, Wallace L, Spurgeon P, Rejman M, Healey A, et al. Feedback from incident reporting: information and action to improve patient safety. Qual Saf Health Care. 2009;18(1):11.

    CAS  PubMed  Google Scholar 

  17. Wallace LM, Spurgeon P, Benn J, Koutantji M, Vincent C. Improving patient safety incident reporting systems by focusing upon feedback – lessons from English and welsh trusts. Health Serv Manag Res. 2009;22(3):129–35.

    Google Scholar 

  18. Bigham BL, Buick JE, Brooks SC, Morrison M, Shojania KG, Morrison LJ. Patient safety in emergency medical services: a systematic review of the literature. Prehosp Emerg Care. 2012;16(1):20–35.

    PubMed  Google Scholar 

  19. Fisher JD, Freeman K, Clarke A, Spurgeon P, Smyth M, Perkins GD, et al. Patient safety in ambulance services: a scoping review. Southampton (UK): NIHR Journals Library. Health Serv Deliv Res. 2015;3(21). https://doi.org/10.3310/hsdr03210.

  20. Ebben RHA, Vloet LCM, Speijers RF, Tönjes NW, Loef J, Pelgrim T, et al. A patient-safety and professional perspective on non-conveyance in ambulance care: a systematic review. Scand J Trauma Resusc Emerg Med. 2017;25(1):71.

    PubMed  PubMed Central  Google Scholar 

  21. O’Cathain A, Knowles E, Bishop-Edwards L, Coster J, Crum A, Jacques R, et al. Understanding variation in ambulance service non-conveyance rates: a mixed methods study. Health Serv Deliv Res. 2018;6(19):1–192.

    Google Scholar 

  22. Brown B, Gude WT, Blakeman T, van der Veer SN, Ivers N, Francis JJ, et al. Clinical performance feedback intervention theory (CP-FIT): a new theory for designing, implementing, and evaluating feedback in health care based on a systematic review and meta-synthesis of qualitative research. Implement Sci. 2019;14(1):40.

    PubMed  PubMed Central  Google Scholar 

  23. Ivers NM, Sales A, Colquhoun H, Michie S, Foy R, Francis JJ, et al. No more ‘business as usual’ with audit and feedback interventions: towards an agenda for a reinvigorated intervention. Implement Sci. 2014;9(1):14.

    PubMed  PubMed Central  Google Scholar 

  24. Ashford SJ, De Stobbeleir K, Nujella M. To seek or not to seek: is that the only question? Recent developments in feedback-seeking literature. Ann Rev Organ Psychol Organ Behav. 2016;3(1):213–39.

    Google Scholar 

  25. Anseel F, Beatty AS, Shen W, Lievens F, Sackett PR. How are we doing after 30 years? A Meta-analytic review of the antecedents and outcomes of feedback-seeking behavior. J Manag. 2015;41(1):318–48.

    Google Scholar 

  26. Anseel F, Lievens F, Levy P. A self-motives perspective on feedback-seeking behavior: linking organizational behavior and social psychology research. Int J Manag Rev. 2007;9(3):211–36.

    Google Scholar 

  27. Denisi A, Sockbeson CES. Feedback sought vs feedback given: a tale of two literatures. Manage Res. 2018;16(4):320–33.

    Google Scholar 

  28. Castonguay V, Lavoie P, Karazivan P, Morris J, Gagnon R. Perceptions of emergency medicine residents of multisource feedback: different, relevant, and useful information. Ann Emerg Med. 2019;74(5):660–9.

    PubMed  Google Scholar 

  29. Rieves A. Translating feedback to action through self-reflection. Ann Emerg Med. 2020;75(5):673–4.

    PubMed  Google Scholar 

  30. Buckley C, Natesan S, Breslin A, Gottlieb M. Finessing feedback: recommendations for effective feedback in the emergency department. Ann Emerg Med. 2020;75(3):445–51.

    PubMed  Google Scholar 

  31. Eaton-Williams P, Mold F, Magnusson C. Exploring paramedic perceptions of feedback using a phenomenological approach. Br Paramed J. 2020;5(1):7–14.

    PubMed  PubMed Central  Google Scholar 

  32. Gunderson MR, Florin A, Price M, Reed J. NEMSMA position statement and white paper: process and outcomes data sharing between EMS and receiving hospitals. Prehosp Emerg Care. 2021;25(2):307–13.

    PubMed  Google Scholar 

  33. EMS Agenda 2050 Technical Expert Panel. EMS Agenda 2050: A People-Centered Vision for the Future of Emergency Medical Services (Report No. DOT HS 812 664). Washington, DC: National Highway Traffic Safety Administration; 2019. Available from: https://www.ems.gov/pdf/EMS-Agenda-2050.pdf

    Google Scholar 

  34. NHS Health Research Authority. UK policy framework for health and social care research. London: NHS Health Research Authority; 2017.

    Google Scholar 

  35. Tong A, Sainsbury P, Craig J. Consolidated criteria for reporting qualitative research (COREQ): a 32-item checklist for interviews and focus groups. Int J Qual Health Care. 2007;19(6):349–57.

    PubMed  Google Scholar 

  36. Galletta A, Cross WE. Mastering The semi-structured interview and beyond: from research design to analysis and publication. New York: NYU Press; 2013.

  37. Rambaree K. Abductive thematic network analysis (ATNA) using ATLAS-ti. In: Moutinho L, Sokele M, editors. Innovative research methodologies in management. Cham: Palgrave Macmillan; 2018. p. 61–86.

    Google Scholar 

  38. Braun V, Clarke V. Using thematic analysis in psychology. Qual Res Psychol. 2006;3(2):77–101.

    Google Scholar 

  39. Braun V, Clarke V. Reflecting on reflexive thematic analysis. Qual Res Sport Exerc Health. 2019;11(4):589–97.

    Google Scholar 

  40. Attride-Stirling J. Thematic networks: an analytic tool for qualitative research. Qual Res. 2001;1(3):385–405.

    Google Scholar 

  41. Tavory I, Stefan T. Abductive analysis : theorizing qualitative research. Chicago: The University of Chicago Press; 2014.

    Google Scholar 

  42. Timmermans S, Tavory I. Theory construction in qualitative research: from grounded theory to Abductive analysis. Sociol Theory. 2012;30(3):167–86.

    Google Scholar 

  43. Braun V, Clarke V. To saturate or not to saturate? Questioning data saturation as a useful concept for thematic analysis and sample-size rationales. Qual Res Sport Exerc Health. 2021;13(2):201–16.

    Google Scholar 

  44. Eaton-Williams P, Mold F, Magnusson C. Effective clinical feedback provision to ambulance clinicians: a literature review. J Paramed Pract. 2020;12(3):109–17.

    Google Scholar 

  45. Brehaut JC, Colquhoun HL, Eva KW, Carroll K, Sales A, Michie S, et al. Practice feedback interventions: 15 suggestions for optimizing effectiveness. Ann Intern Med. 2016;164(6):435–41.

    PubMed  Google Scholar 

  46. van der Veer SN, de Keizer NF, Ravelli AC, Tenkink S, Jager KJ. Improving quality of care. A systematic review on how medical registries provide information feedback to health care providers. Int J Med Inform. 2010;79(5):305–23.

    PubMed  Google Scholar 

  47. Lederman J, Löfvenmark C, Djärv T, Lindström V, Elmqvist C. Assessing non-conveyed patients in the ambulance service: a phenomenological interview study with Swedish ambulance clinicians. BMJ Open. 2019;9(9):e030203.

    PubMed  PubMed Central  Google Scholar 

  48. Perona M, Rahman MA, Meara P. Paramedic judgement, decision-making and cognitive processing: a review of the literature. Australas J Paramed. 2019;2019:16.

  49. Lincoln YS, Guba EG. Naturalistic inquiry. Beverly Hills: Sage Publications; 1985.

    Google Scholar 

  50. Polit DF, Beck CT. Generalization in quantitative and qualitative research: myths and strategies. Int J Nurs Stud. 2010;47(11):1451–8.

    PubMed  Google Scholar 

  51. Novick G. Is there a bias against telephone interviews in qualitative research? Res Nurs Health. 2008;31(4):391–8.

    PubMed  PubMed Central  Google Scholar 

  52. Brannick T, Coghlan D. In defense of being “native”: the case for insider academic research. Organ Res Methods. 2007;10(1):59–74.

    Google Scholar 

  53. AlShammari T, Jennings PA, Williams B. Emergency medical services Core competencies: a scoping review. Health Prof Educ. 2018;4(4):245–58.

    Google Scholar 

  54. Benn J, Arnold G, Wei I, Riley C, Aleva F. Using quality indicators in anaesthesia: feeding back data to improve care. Br J Anaesth. 2012;109(1):80–91.

    CAS  PubMed  Google Scholar 

Download references

Acknowledgements

The authors would like to thank the EMS professionals who participated in this study, Dr. Thomas Mills for his support in study design and set-up, Dr. Binish Khatoon and Freya Thompson for assisting with data collection and Prof Rebecca Lawton for her valuable contributions to the final revision of this article.

Funding

This research was funded by the National Institute for Health Research (NIHR) Yorkshire and Humber Patient Safety Translational Research Centre (YHPSTRC). The views expressed are those of the author(s) and not necessarily those of the NIHR or the Department of Health and Social Care. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

Author information

Authors and Affiliations

Authors

Contributions

GJ and JB conceived the study and obtained research funding. GJ conducted the interviews and managed the data. CW analyzed the data with input from AH and supervision and guidance from JB. CW drafted the article and all authors contributed substantially to its revision and approved the final version. CW takes responsibility for the paper as a whole. The author(s) read and approved the final manuscript.

Corresponding author

Correspondence to Caitlin Wilson.

Ethics declarations

Ethics approval and consent to participate

The study was carried out in accordance with the UK Policy Framework for Health and Social Care Research (Health Research Authority, 2017) and was approved by the Health Research Authority (IRAS project ID 255406) and the University of Leeds ethics committee (PSC-518 22/11/2018). Prior to initiation of the interview, respondents were provided with standardized research information regarding the study’s purpose and informed written consent was obtained.

Consent for publication

Not applicable.

Competing interests

The authors have declared that no competing interests exist.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1.

Interview guide.

Additional file 2.

Additional quotes to illustrate themes.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Wilson, C., Howell, AM., Janes, G. et al. The role of feedback in emergency ambulance services: a qualitative interview study. BMC Health Serv Res 22, 296 (2022). https://doi.org/10.1186/s12913-022-07676-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12913-022-07676-1

Keywords