- Research
- Open access
- Published:
Using a human-centered, mixed methods approach to understand the patient waiting experience and its impact on medically underserved populations
BMC Health Services Research volume 22, Article number: 1388 (2022)
Abstract
Purpose
To use a mixed methods approach to investigate the patient waiting experience for a medically underserved population at an outpatient surgical clinic.
Methods
We used lean methodology to perform 96 time-tracked observations of the patient journey in clinic, documenting the duration of activities from arrival to departure. We also used human-centered design (HCD) to perform and analyze 43 semi-structured interviews to understand patients’ unmet needs.
Results
Patients spent an average of 68.5% of their total clinic visit waiting to be seen. While the average visit was 95.8 minutes, over a quarter of visits (27%) were over 2 hours. Patients waited an average of 24.4 minutes in the waiting room and 41.2 minutes in the exam room; and only spent 19.7% of their visit with an attending provider and 11.8% with a medical assistant. Interviews revealed that patients arrive to their visit already frustrated due to difficulties related to scheduling and attending their appointment. This is exacerbated during the visit due to long wait times, perceived information opacity, and an uncomfortable waiting room, resulting in frustration and anxiety.
Conclusions
While time tracking demonstrated that patients spend a majority of their visit waiting to be seen, HCD revealed that patient frustrations span the waiting experience from accessing the appointment to visit completion. These combined findings are crucial for intervention design and implementation for medically underserved populations to improve the quality and experience with healthcare and also address system inefficiencies such as long wait times.
Introduction
Patient wait times are an important indicator of healthcare service delivery, as long wait times have been shown to negatively impact access to care and patient satisfaction [1,2,3,4,5,6,7]. In particular, patients from medically underserved populations not only have a higher burden of disease but also experience longer wait times [1, 8, 9]. For instance, Medicaid patients were found in one study to be 20 % more likely to wait longer than 20 minutes than their privately insured counterparts for an outpatient visit [10]. These factors further exacerbate their medical conditions and outcomes.
While the consequences of long wait times are well-described, patient perceptions of their waiting experience are poorly understood [11]. Several studies have attempted to characterize factors that affect the waiting experience, including communication, information transparency, trust and being respected [2, 11,12,13]. However, the number of aspects identified as affecting the waiting experience ranges from 11 in an emergency department [12] to 20 in a cancer radiology center [11]. Hospitals, providers, and payors use quantitative tools, such as the CAHPS Clinician and Group Survey (CG-CAHPS) [14], to assess the patient experience and quality of healthcare delivery, which fail to fully capture the multitude of factors that affect these experiences [15,16,17]. Similarly, qualitative studies cannot accurately take into consideration certain quantifiable patient experiences such as length of visit [13, 18, 19]. Of the few studies that used both quantitative and qualitative methods to describe the waiting experience, none have measured the waiting experience for patients from medically underserved populations [11, 20].
The goal of this study was therefore to apply a mixed methods approach to investigate the waiting experience for medically underserved patients at an urban safety-net hospital. By combining human-centered design (HCD) [21] and the lean methodology [22], we aimed to develop a deeper understanding of the current state of patients’ unmet needs at an elective surgery outpatient clinic.
Methods
Study design
This study follows a prospective observational study design using a mixed methods approach (Fig. 1). Mixed methods approaches have been shown to provide a more accurate view of certain research topics [23], allowing us to uncover more multidimensional insights surrounding the patient experience. As such, we combined quantitative and qualitative data in order to better understand patients’ expressed and unexpressed needs in clinic. First, we collected quantitative data (February–May 2018) through retrospective chart review and components of the lean methodology to identify idle waiting times [24]. The lean methodology is an improvement process adapted from the car manufacturing industry and that has been broadly incorporated into healthcare quality improvement [22]. Then, to bring context to and build upon the quantitative findings, we subsequently collected qualitative data through HCD interviews (April–June 2018; June–July 2019.) HCD is an approach to problem-solving that relies on ethnographic research to understand unique challenges and unmet needs of stakeholders [21]. HCD research uses in-depth interviews and in-context observations to understand stakeholder needs, contexts, behaviors, and emotions. We used this dual approach due to the complementary nature of the two methodologies: while lean aims to identify and streamline inefficiencies in an established system, HCD aims to investigate how to redesign the system based on user-centered insights.
Setting and population
This study was conducted at the Zuckerberg San Francisco General Hospital and Trauma Center (ZSFG), an urban safety-net hospital and level 1 trauma center in the city of San Francisco. ZSFG is an academic teaching hospital in the University of California, San Francisco (UCSF) network. The hospital treats medically underserved patients, including those who are indigent, un-insured or underinsured, are racial and ethnic minorities, and disenfranchised. The U.S. Department of Health and Human Services has defined such populations to be communities with members who have experienced health disparities, including refugees, religious minorities, and those identifying as African American [25]. As of 2021, almost all of ZSFG patients (96%) were publicly-insured (57% through Medi-Cal and 35% through Medicare.) Only 2% of patients were uninsured, while 4% of patients received care through private insurance [26]. The majority of patients were Hispanic (37%), followed by Asian/Pacific Islander (14%), White (17%) and Black (14%). Most patients were between 18 and 64 (71%), while 18% were over 64 years of age and 11% were under 18 years of age [26].
All study activities occurred at the general surgery outpatient clinic, which shares the same space with other surgical clinics, including podiatry, colorectal surgery, breast surgery, plastic surgery, and vascular surgery. At any given time, up to three services share the same clinical and waiting space. At the time of this study, the general surgery clinic was staffed by an attending general surgeon, a nurse practitioner (NP) and two medical assistants (MEAs). As an academic teaching hospital, medical students attend the clinic irregularly, depending on didactic and inpatient clinical activities. There are no residents staffed in the clinic because their rotation at ZSFG is in trauma surgery, rather than general surgery. Morning clinics were held Monday through Friday between 9 am and 12 pm, and afternoon clinics were held between 1 pm and 4 pm. There were 4 scheduled attending-led clinics per week (3 morning and 1 afternoon) and 1 scheduled NP-led clinic per week (afternoon.) This study was approved and informed consent was granted by the UCSF Institutional Review Board.
Quantitative data collection and analysis
Patient age, gender, ethnicity, race, primary home language, family size, and income source were collected and analyzed in February 2018 via chart review on patients who had a scheduled patient visit at the general surgery outpatient clinic from Jan 1, 2008 to Jan 1, 2018. We conducted this analysis to understand the sociodemographic distribution of our patients.
Using the lean methodology, three quantitative researchers tracked patients throughout a clinic visit, documenting times for the following activities: patient entered the waiting room; patient entered the exam room; MEA entry and exit from the exam room; attending surgeon or NP entry and exit from the exam room; patient exited the exam room; patient exited clinic. Researchers observed 11 general surgery clinics between February 2018 and May 2018 and tracked all patients who attended their appointment during these clinics.
Data were collected in a custom-built Microsoft Excel 2011 tool that used a circular formula to timestamp the start and end of each activity to track duration and frequency. Quantitative researchers were trained in the use of this tool and educated on how to identify and code each activity. Data were analyzed using basic frequency and descriptive statistics for the following activities: time patient spent waiting (in the waiting room and exam room); time spent with the provider (surgeon and/or NP); and time with staff (time with MEA taking vitals and/or additional visits).
Qualitative data collection and analysis
We used HCD to conduct and analyze semi-structured interviews with patients about their experience in clinic. HCD provides a unique approach for homing in on problems and finding solutions for them. As such, during the interview process and when analyzing the interviews, we focus on understanding the challenges and unmet needs of each stakeholder. This differs from traditional qualitative interview techniques, which focus on observing a culture, understanding an experience, and developing a theory [27].
Three qualitative researchers trained in HCD interview methods conducted “intercept” interviews with a convenience sample of patients during two time periods: April to June 2018, and June to July 2019. Intercept interviews are conducted while the participant is still on site and engaged with the experience or product in question. They are commonly used in consumer research where potential participants are difficult to reach and engagement with the experience or product is key to the interview [28, 29]. These researchers were different than the quantitative researchers who performed time-tracking. All adult, English-speaking patients who were in the waiting room at the time of interviews were eligible for inclusion. Patients were asked if they would like to participate and if they gave verbal consent, the interview commenced immediately, allowing for real-time reactions to situations and environments. The interview concluded when the patient or researcher ended the interview, or when the patient was called by staff to exit the waiting room. Interviews lasted under 30 minutes and aimed to elicit perspectives on patients’ experiences with the surgical clinic, focusing on waiting periods. Interviews were anonymous to preserve patient privacy and initials were randomly generated for each patient. Notes and key quotes were documented during the interview, and recruitment ended once thematic saturation was reached.
Two of the qualitative researchers independently performed inductive analysis in order to identify initial themes, in accordance with the HCD method for qualitative analysis [30]. They met to develop and refine themes, consolidate based on redundancy, and group them into thematic categories. Discrepancies were reconciled through discussion. Key quotes associated with each thematic category were extracted from interview notes, after which the researchers met to ensure that supporting quotes and descriptions for each thematic category were defined and agreed upon. Per the HCD methodology, the researchers then extrapolated ‘insight statements’ from these themes [31]. Insight statement development is an integral step in the HCD analysis process and involves re-reviewing the notes to understand themes in the context of the individual interviews in order to deduce unique human perspectives, motivations, or tensions from the thematic data [31, 32] (See Fig. 2 for design process of developing insights).
Results
Study population
17,632 patients scheduled 65,211 visits with the general surgery outpatient clinic from 2008 to 2018. Their sociodemographic characteristics are described in Table 1. This population was considerably diverse: the average age of the patients at the visit was 52.5 years (SD 15.3), 11,412 (64.7%) patients identified as male, 13,097 (74.2%) did not identify as Non-Hispanic White, and 5937 (33.6) did not speak English as their primary language. 14,305 (81.1%) were the only family members in their household and 10,767 (61.1%) listed that they had no income source.
Quantitative time tracking
We documented the patient journey for 96 patients across 11 clinics, each led by 5 attending surgeons (Table 2). The average patient visit lasted 95.8 minutes. About a quarter of the visits (n = 26, 27%) were over 2 hours long. On average, patients spent 68.5% of their visit waiting to be seen by a provider or staff member. While a majority of their waiting period was spent alone in their exam room (43.0%), the remainder was spent in the clinic waiting room (25.5%). Patients spent 19.7% of their visit with the attending physician or a nurse practitioner, and 11.8% of their visit with a staff member. Of the time spent with a staff member, 5.4% of the visit was spent performing vitals and 6.6% of the visit was spent on additional visits with an MEA (Fig. 3).
Insights from qualitative interviews
Analysis of 43 interviews with patients and their families revealed 6 distinct insights: 3 were related to patients’ “pre-visit experience”, and 3 were related to the “during visit experience” (Table 3).
Pre-visit experience
Insight 1
Patients’ schedules and personal constraints are not prioritized when making an appointment, making patients feel the need to “fight” to access their care.
Description:
For many patients, the waiting experience started with scheduling an appointment. Patients’ feedback around scheduling could be categorized into 3 issues: not being able to get an appointment in a timely manner, not being able to get an appointment at a time that accommodates their schedule, and last-minute cancellations from the clinic with minimal or no notification. These issues caused a significant amount of emotional distress for the patients. One patient (BH) expressed it as feeling like the doctors were playing with her health. Patients felt that they needed to “fight” (AN) and “sue” (BH) to be seen and taken care of by their providers. In addition to emotional distress felt by patients, patients also reported that difficulties in scheduling their appointment resulted in delays of care. For instance, it took AN “1.5 years” to get their surgery done. Finally, it was not an infrequent occurrence for patients to learn that their appointment was canceled or rescheduled only after they arrived in clinic. This exacerbated their sense of frustration and mistrust as they reported having already made the difficult rearrangements to attend their appointment.
Insight 2
Patients struggle to find the support necessary to attend their appointment, leading to frequent non-attendance and increased socioeconomic stressors.
Description:
The clinic operates during standard work hours, which conflicts with primary work responsibilities for many patients. Patients are low-income and have jobs and responsibilities for which they are unable to miss without significant consequences. As such, the opportunity cost of attending clinic appointments is high – it may mean reduced pay or leaving loved ones unattended. Many patients reported missing their appointments for these reasons. For instance, AY is a care provider and lives with her client “24/7”. Her goal in life “is to keep clients alive and out of the hospital”. Finding a time to make it to the appointment while also ensuring that her client is taken care of in her absence is difficult and rare.
Insight 3
Patients lack affordable and accessible transportation options that fit within their medical and socioeconomic constraints, leading to increased stress and missed appointments. Description:
Transportation was a common barrier to attendance. Patients reported using the following forms of transportation: driving their own cars, having other people give them a ride, taking a taxi or rideshare, and taking public transportation. Each had limitations; there was no ideal option. Due to the high cost of living within the Bay Area and in San Francisco, many of our patients live over 20 miles away from the hospital. This resulted in patients making significant rearrangements to make it to the clinic on time. “I drove starting at 3AM to get here today” (AL), was a typical experience echoed by many patients. For those that were late to their appointment or not able to make their appointment, patients were labeled as “no-show” and had their appointment canceled. This resulted in delays in care and poor patient experience.
For those who drove their own cars, many cited parking as a source of stress. At the time of our interviews, there was a 1-hour limit enforced on street parking surrounding the hospital. With the average visit lasting over an hour, and many lasting more than 2 hours, parking is a nontrivial matter. Deciding whether to step out of clinic to move their car or to stay and risk getting a hefty fine, added a significant amount of stress for patients. As BO stated: “Once I had to wait for 45 minutes in a room, and got a $75 dollar parking ticket.” Patients worried that they would miss their turn getting called for their visit if they left clinic, thereby increasing their waiting time to see their provider.
Patients without personal transportation either sacrifice time or money. For patients who relied on friends or family to drive them to their appointment, they had to sacrifice some of their own time to make the appointment. For instance, BP had to work around his son’s schedule, resulting in him being “dropped off early in the morning before [his] son goes to work and waiting for him to pick [BP] up.” Those who took taxis or ride shares found the cost prohibitive. As BD stated: “I missed some appointments...I try to make this a priority but every time I have to take a taxi over here, it’s expensive.” Those who took public transport sometimes got lost or were late to their appointments because the transportation was not reliable. As AV stated, “I got lost from the bus stop, it’s a long walk, I had no idea where [the clinic] was.”
Even once they reached the hospital, patients faced difficulty getting to the clinic. Many patients used a wheelchair or crutches or had other mobility issues; the clinic is on the third floor and is not close to the elevator. On top of that, patients frequently got lost in the hospital while looking for the clinic. As BJ, who used crutches, said: “[the clinic is] on the third floor. Even the check in place was pretty far from the elevator. All the way to this waiting room is not the shortest walk that I’ve done.”
During visit experience
Insight 4
Patients spend most of their visit in the clinic waiting to be seen by a provider, leading to anxiety and frustration.
Description:
Patients reported wanting to spend a meaningful amount of time with their care team, and for the time spent waiting to be outweighed by the benefits of being seen by a provider. However, many expressed doubts that this was the case, and wondered aloud if their visit justified the hardships they faced in accessing their appointment and the experience of waiting to be seen by their provider. As BN put it: “The procedure is not even five minutes but sometimes I have to sit in the room waiting for 45 minutes. I can’t do anything while I’m waiting.” Another patient (AU) put it this way: “I’m here because it’s either be here or be in pain…I wouldn’t come if I had to wait this long, and my leg didn’t hurt”.
Patients managed their frustration and anxiety with extended wait times in different ways. Some patients, like BE and AU, developed workarounds in attempt to decrease their waiting time, such as coming in earlier or later than their appointment time. Others felt resigned to waiting; they felt that it was a part of life or that things could be worse, so they chose not to complain about it. As AG stated, “wait time is long, but I can’t complain, there’s a reason why, but I’ve heard horror stories.”
Insight 5
Information opacity makes patients feel disrespected and incapable of managing their medical conditions, leading to frustration and disempowerment.
Description:
Patients wanted information that allowed them to participate in their care and sought information at two points in time: before their clinic appointment and during their visit. Unfortunately, there was information opacity at both points. For the former, the questions centered around logistics. As noted in insights 1 and 3, patients often did not receive enough information about their appointment or where the clinic was located. For the latter, patients wanted updated waiting time estimates and to learn how to manage their medical conditions. While patients were dissatisfied with the long wait times, they were especially frustrated that they did not know when they would be called – especially after their original appointment time had passed. In addition, some patients stated they experienced disease progression and complications because they did not receive adequate patient instruction on how to take care of themselves and their health conditions. As AK explained: “I followed all the directions, but I still ended up injuring myself post-surgery. I’m not happy with this, it was not explained, I wasn’t given adequate instruction to protect myself.”
Patients responded to this information opacity in a variety of ways. Most expressed feelings of frustration and disrespect. Some expressed resignation and felt that complaining wouldn’t lead to their desired outcome; all they could do was practice patience and endure. For instance, BH was waiting to be seen and was frustrated that her hernia repair had been delayed. Even though she had been waiting in the waiting room for a long time and was angry at the providers and hospital to the point of breaking down and crying during our interview, she decided to not “go off on no body which I feel like doing...I have more patience...that’s all I can do. What else can you do?”
Insight 6
An uncomfortable physical environment in clinic exacerbates patients’ anxieties related to waiting for their appointment, adversely impacting their mental and emotional states.
Description:
The environment of the waiting room was an important aspect of the waiting experience for many patients as it helped determine how calm or anxious the patients felt. Cleanliness was one factor that patients used to assess a waiting room. For many, it was the only factor they considered; if the room was clean, they were satisfied. As AQ put it: “As long as it’s clean here, I’m fine with it.” Some patients associated cleanliness with the people occupying the same space. As AH elucidated: “[the waiting room is] not clean, there are so many types of people”; and as BM put it (referring to another patient), “when that man stands up, his seat will be wet”. Since many patients prioritized their health and often saw their fellow patients as “dirty, filthy” (BL), personal space was highly valued. Patients preferred larger waiting rooms so that they could have more space and have more choices on where to sit.
Patients also wanted a waiting experience that was calming, with minimal noise. Many patients, such as BJ and AN, noted that the TV audio was bothersome and would prefer it to be off.
Patients also preferred waiting experiences that had distracting activities to calm them down. Suggestions included adding refreshments (coffee bars, water fountain, and snack machine) and things to do (magazines, computer, things for kids to play with, video games/entertainment), followed by improving the existing environment (making the chairs more comfortable, updating the pictures on the walls). When asked what benefit these would serve, they responded that such interventions would “help [them] calm down” (BL), “not stuff that’s rousing of emotion” (AN).
Discussion
Our study used a mixed methods approach to understand the waiting experience for a medically underserved population. Quantitative analysis found that 74% of their time was spent waiting to see a provider or staff while in the waiting room or in the exam room. This corresponded with previous research that demonstrated that patients who were uninsured or had Medicaid experienced long wait times in comparison to the time spent with their provider [8, 9]. Qualitative analysis revealed that patient frustrations were rooted in the pre-visit experience and were further exacerbated during their visit. Insights 1–3 (pre-visit) illuminate the need for improved approaches to scheduling and access, as patients in medically underserved populations face unique barriers and opportunity costs in order to attend their appointments. Insights 4–6 (during visit), coupled with our quantitative findings of patient time tracking in clinic, demonstrated a poor patient experience exacerbated by information opacity, long wait times and an uncomfortable physical environment.
Using a mixed methods approach allowed us to use qualitative data to augment, add meaning to, and confirm findings from the quantitative data. For instance, our quantitative findings showed that patients spend the majority of their time waiting to be seen; our qualitative findings demonstrated that patients perceived this time as sources of anxiety and frustration and wondered whether the cost of waiting was justified. Most notably, qualitative analysis revealed that the ‘pre-visit’ waiting experience significantly impacts perceived satisfaction. Interventions based on quantitative data alone would have aimed at decreasing wait times and improving the experience of waiting in clinic, and thus would have fall short of meeting patients’ core needs. By using the lean methodology to assess the extent to which patients wait, and HCD to capture an in-depth view of patient frustrations and unmet needs, we can design patient-centered solutions that improve efficiency and experience.
This study had limitations. First, all interviews were conducted in one surgical waiting room at one hospital with a medically underserved population. As such, our results have limited generalizability for patients who might seek care at private hospitals. Second, interviews were conducted in the waiting room, which is a public space, rather than a private room, so that we could capture as many perspectives as possible. This meant that other patients could hear the conversation, which may have led to some response bias. For instance, while patients expressed anxiety that they would get sicker if they came into contact with other patients, many were hesitant to elaborate more about these fears within earshot of their fellow patients. Third, intercept interviews, by their nature, use convenient sampling. Eligible patients were those who were in the waiting room at the same time as when the researchers were conducting interviews. Also, given the nature of our study design, patient-specific sociodemographic information on the patients we observed and interviewed are not available. These may limit generalizability and internal validity, due to the possibility of sampling error and lack of representation of certain populations. As such, the exact insights and opportunities generated from this research are not directly generalizable to other contexts. However, the HCD and time tracking methodologies themselves are repeatable.
The surgical clinic where our study took place is at a safety-net hospital that treats patients who have a historically and/or personally poor relationship with the health system. A striking finding was that when interviewed, many patients felt hesitant to “complain” about their problems (AG, BE, BH, BL). Rather, they felt that their role was to be “patient” (AJ, AK, BH) and wait quietly for their turn. For instance, for AJ, waiting several months to be seen was the standard of healthcare delivery that he had experienced and so understood to be the norm: “There’s a wait time, sometimes 10-12 weeks, I understand, you just have to be patient, that’s what you expect at a hospital”. Another patient BH had already waited about 1 hour by the time we interviewed her. She was getting impatient since she had four young children under 10 years of age waiting at home, but didn’t think it was appropriate to ask to be seen. BH and others saw complaining as a character flaw; i.e., giving constructive feedback (something positive) had been internalized into something negative (complaining). By interpreting qualitative interviews through this lens, and realizing that some areas for improvement may go unrecognized and that others may be delivered in muted language and tone by our patients, we can help amplify their concerns and improve the care that they receive.
Our study must be considered within the broader context of racism and the inequities that it has brought and continues to bring into healthcare, especially in the U.S., and how those inequities impact our patients before they even enter the waiting room. Racism is a system of policies, practices, and norms that affects how people interact with the world based on their outer appearance. Historic policies, such as redlining, disproportionately affected and continue to affect people of color, placing them at higher risk for being poor, falling sick, and dying [34,35,36]. Such systems influence a person’s social circumstances, which are estimated to contribute to 24% of a person’s health status; medical care and the environment (under which the waiting experience falls) contributes to 18% [37,38,39,40,41,42]. At the local level, neighborhoods in San Francisco County with high rates of poverty are disproportionately composed of communities of color, have a higher density of stores that sell alcohol, tobacco, and fast foods, and a lower density of stores that sell fresh produce, lack of parks and open space, have limited public transportation, and have multiple sources of toxic exposures. These increase the risk for acute and chronic medical conditions such as heart disease, cancer, stroke, substance abuse, asthma, etc. [43] Our study contributes to the growing recognition and acknowledgement that the environments and processes that deliver healthcare to disadvantaged communities negatively impact their mental, emotional, and physical health.
Conclusion
By using a mixed methods approach consisting of HCD in combination with lean methodology, we gained an in-depth understanding of the waiting experience in a general surgery outpatient clinic from the patient and system’s perspective. This dual approach, which places the patient at the center, will contribute to the development and implementation of patient-focused interventions that prioritize patients’ unmet needs.
Availability of data and materials
The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.
Change history
14 June 2023
The outdated/broken URL in reference 34 was corrected.
References
McIntyre D, Chow CK. Waiting time as an Indicator for health services under strain: a narrative review. Inq. 2020;57:0046958020910305. https://doi.org/10.1177/0046958020910305.
Clifford Bleustein MD, David B. Rothschild BS, Andrew Valen MHA, Eduardas Valaitis P, Laura Schweitzer MS, Raleigh Jones MD. Wait times, patient satisfaction scores, and the perception of care. Published online May 20, 2014. Accessed January 4, 2022. https://www.ajmc.com/view/wait-times-patient-satisfaction-scores-and-the-perception-of-care
McKinnon K, Crofts PD, Edwards R, Campion PD, Edwards RH. The outpatient experience: results of a patient feedback survey. Int J Health Care Qual Assur Inc Leadersh Health Serv. 1998;11(4–5):156–60. https://doi.org/10.1108/09526869810230858.
Feddock CA, Hoellein AR, Griffith CH, et al. Can physicians improve patient satisfaction with long waiting times? Eval Health Prof. 2005;28(1):40–52. https://doi.org/10.1177/0163278704273084.
Rondeau KV. Managing the clinic wait: an important quality of care challenge. J Nurs Care Qual. 1998;13(2):11–20. https://doi.org/10.1097/00001786-199812000-00003.
Fernandes CM, Daya MR, Barry S, Palmer N. Emergency department patients who leave without seeing a physician: the Toronto hospital experience. Ann Emerg Med. 1994;24(6):1092–6. https://doi.org/10.1016/s0196-0644(94)70238-1.
Zakare-Fagbamila RT, Park C, Dickson W, Cheng TZ, Gottfried ON. The true penalty of the waiting room: the role of wait time in patient satisfaction in a busy spine practice. J Neurosurg Spine. 2020;21:1–11. https://doi.org/10.3171/2019.12.SPINE191257.
Gotlieb EG, Rhodes KV, Candon MK. Disparities in primary care wait times in Medicaid versus commercial insurance. J Am Board Fam Med. 2021;34(3):571–8. https://doi.org/10.3122/jabfm.2021.03.200496.
Huq F, Nakamura M, Black K, Chubb H, Helfrich Y. Association of dermatology wait times with insurance coverage in Michigan. Am J Manag Care. 2020;26(10):432–7. https://doi.org/10.37765/ajmc.2020.88501.
Oostrom T, Einav L, Finkelstein A. Outpatient office wait times and quality of care for Medicaid patients. Health Aff. 2017;36(5):826–32. https://doi.org/10.1377/hlthaff.2016.1478.
Steele JR, Jones AK, Clarke RK, Shoemaker S. Health care delivery meets hospitality: a pilot study in radiology. J Am Coll Radiol. 2015;12(6):587–93. https://doi.org/10.1016/j.jacr.2014.10.008.
Manolitzas P, Kostagiolas P, Grigoroudis E, Intas G, Stergiannis P. Data on patient’s satisfaction from an emergency department: developing strategies with the multicriteria satisfaction analysis. Data in Brief. 2018;21:956–61. https://doi.org/10.1016/j.dib.2018.10.041.
Chu H, Westbrook RA, Njue-Marendes S, Giordano TP, Dang BN. The psychology of the wait time experience – what clinics can do to manage the waiting experience for patients: a longitudinal, qualitative study. BMC Health Serv Res. 2019;19(1). https://doi.org/10.1186/s12913-019-4301-0.
CAHPS Clinician & Group Survey. Accessed December 21, 2021. https://www.ahrq.gov/cahps/surveys-guidance/cg/index.html
Gualandi R, Masella C, Viglione D, Tartaglini D. Exploring the hospital patient journey: what does the patient experience? PLoS One. 2019;14(12):e0224899. https://doi.org/10.1371/journal.pone.0224899.
Kjellsson G, Clarke P, Gerdtham UG. Forgetting to remember or remembering to forget: a study of the recall period length in health care survey questions. J Health Econ. 2014;35:34–46. https://doi.org/10.1016/j.jhealeco.2014.01.007.
Agarwal N, Faramand A, Bellon J, et al. Limitations of patient experience reports to evaluate physician quality in spine surgery: analysis of 7485 surveys. J Neurosurg Spine. 2019;30(4):520–3. https://doi.org/10.3171/2018.8.SPINE18104.
Ebbevi D, Hasson H, Lönnroth K, Augustsson H. Challenges to ensuring valid and useful waiting time monitoring – a qualitative study in Swedish specialist care. BMC Health Serv Res. 2021;21(1):1024. https://doi.org/10.1186/s12913-021-07021-y.
Wright S. From ‘holding pen’ to ‘a space to breathe’: affective landscapes in a newly-integrated sexual health clinic. Soc of Health & Illn. 2019;41(4):806–20. https://doi.org/10.1111/1467-9566.12852.
Tabler J. Surveying Underserved Patients at the United States–Mexico Border: Utilizing the Clinic Waiting Room. New York: SAGE Publications Ltd; 2020. https://doi.org/10.4135/9781529709599.
Design Kit. Accessed March 11, 2022. https://www.designkit.org/human-centered-design
Mason SE, Nicolay CR, Darzi A. The use of lean and six sigma methodologies in surgery: a systematic review. Surgeon. 2015;13(2):91–100. https://doi.org/10.1016/j.surge.2014.08.002.
Burns A. Mixed methods. In: Heigham J, Croker RA, editors. Qualitative research in applied linguistics: a practical introduction. UK: Palgrave Macmillan; 2009. p. 135–61. https://doi.org/10.1057/9780230239517_7.
What Is Lean Healthcare? Accessed August 21, 2022. https://catalyst.nejm.org/doi/full/10.1056/CAT.18.0193
Serving Vulnerable and Underserved Populations. (n.d.). https://Marketplace.Cms.Gov/Technical-Assistance-Resources/Training-Materials/Vulnerable-and-Underserved-Populations.pdf.
ZSFG, FY 2020-2021 Annual Report, https://Sf.Gov/Sites/Default/Files/2021-10/05%20ZSFG%20FY%20Annual%20Report%202020-2021.pdf. Accessed 20 Jan. 2022.
Hanson JL, Balmer DF, Giardino AP. Qualitative research methods for medical educators. Acad Pediatr. 2011;11(5):375–86. https://doi.org/10.1016/j.acap.2011.05.001.
Smith N, Georgiou M, King AC, Tieges Z, Chastin S. Factors influencing usage of urban blue spaces: a systems-based approach to identify leverage points. Health & Place. 2022;73:102735. https://doi.org/10.1016/j.healthplace.2021.102735.
Guillory J, Wiant KF, Farrelly M, et al. Recruiting hard-to-reach Populations for survey research: using Facebook and Instagram advertisements and in-person intercept in LGBT bars and nightclubs to recruit LGBT young adults. J Med Internet Res. 2018;20(6):e197. https://doi.org/10.2196/jmir.9461.
Design Kit. Accessed July 25, 2022. https://www.designkit.org/methods/find-themes
Design Kit. Accessed December 23, 2021. https://www.designkit.org/methods/create-insight-statements
Patel D, Sarlati S, Martin-Tuite P, et al. Designing an information and communications technology tool with and for victims of violence and their case managers in San Francisco: human-centered design study. JMIR Mhealth Uhealth. 2020;8(8):e15866. https://doi.org/10.2196/15866.
Nijagal MA, Patel D, Lyles C, Liao J, Chehab L, Williams S, Sammann A. Using human centered design to identify opportunities for reducing inequities in perinatal care. BMC Health Serv Res. 2021;21(1):714. https://doi.org/10.1186/s12913-021-06609-8.
Underrepresented Minority Definition | Office of Diversity and Outreach UCSF [Internet]. [cited 2023 May 9]; Available from: https://diversity.ucsf.edu/programs-resources/urm-definition.
Social Determinants of Health - PAHO/WHO | Pan American Health Organization. Accessed December 21, 2021. https://www.paho.org/en/topics/social-determinants-health
Bryant AS, Worjoloh A, Caughey AB, Washington AE. Racial/ethnic disparities in obstetric outcomes and care: prevalence and determinants. Am J Obstet Gynecol. 2010;202(4):335–43. https://doi.org/10.1016/j.ajog.2009.10.864.
NCHHSTP Social Determinants of Health. (2014). Retrieved December 21, 2021: http://www.cdc.gov/nchhstp/socialdeterminants/definitions.html.
Social Determinants of Health | CDC. Published September 30, 2021. Accessed December 21, 2021. https://www.cdc.gov/socialdeterminants/index.htm
The Relative Contribution of Multiple Determinants to Health | Health Affairs Brief. Accessed December 21, 2021. https://www.healthaffairs.org/do/10.1377/hpb20140821.404487/full/
May 10 EHP, 2018. Beyond health care: the role of social determinants in promoting health and health equity. KFF Published May 10, 2018. Accessed December 21, 2021. https://www.kff.org/racial-equity-and-health-policy/issue-brief/beyond-health-care-the-role-of-social-determinants-in-promoting-health-and-health-equity/
Schroeder SA. We can do better — improving the health of the American people. N Engl J Med. 2007;357(12):1221–8. https://doi.org/10.1056/NEJMsa073350.
Committee on the recommended social and behavioral domains and measures for electronic health records, board on population health and public health practice, Institute of Medicine. Capturing social and behavioral domains and measures in electronic health records: phase 2. National Academies Press (US); 2015. Accessed December 21, 2021. http://www.ncbi.nlm.nih.gov/books/NBK268995/
Health Inequities in the Bay Area. Public Health Institute. Accessed December 21, 2021. https://www.phi.org/thought-leadership/health-inequities-in-the-bay-area/
Acknowledgements
We would like to thank all the people at the Better Lab for helping us generate ideas and themes from the interviews. We would like to thank Pam Derish in the UCSF Department of Surgery for reviewing and editing our manuscript.
Funding
This study was funded by miscellaneous funds by the UCSF Department of General Surgery.
Author information
Authors and Affiliations
Contributions
ENL and LZC drafted and revised the manuscript text and conducted and analyzed the qualitative interviews. ENL prepared the figures and tables. KN, LZC, and JL gathered and analyzed the quantitative data. All authors reviewed the manuscript.
Corresponding author
Ethics declarations
Ethics approval and consent to participate
Research involving human participants were performed in accordance with the Declaration of Helsinki. All participants were given informed consent. This study was approved by the University of California, San Francisco (UCSF) Institutional Review Board (IRB#: 18–25314).
Consent for publication
Not applicable.
Competing interests
AS is the founder and a consultant for the Empathy Studio, LLC. LZC and DP are human-centered design consultants for The Empathy Studio, LLC. DP received honoraria from the Diversity Innovation Hub for lecturing on human-centered design. All other authors have no competing interests.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
About this article
Cite this article
Liao, E.N., Chehab, L.Z., Neville, K. et al. Using a human-centered, mixed methods approach to understand the patient waiting experience and its impact on medically underserved populations. BMC Health Serv Res 22, 1388 (2022). https://doi.org/10.1186/s12913-022-08792-8
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s12913-022-08792-8