- Research article
- Open Access
- Open Peer Review
The difficult doctor? Characteristics of physicians who report frustration with patients: an analysis of survey data
BMC Health Services Researchvolume 6, Article number: 128 (2006)
Literature on difficult doctor-patient relationships has focused on the "difficult patient." Our objective was to determine physician and practice characteristics associated with greater physician-reported frustration with patients.
We conducted a secondary analysis of the Physicians Worklife Survey, which surveyed a random national sample of physicians. Participants were 1391 family medicine, general internal medicine, and medicine subspecialty physicians. The survey assessed physician and practice characteristics, including stress, depression and anxiety symptoms, practice setting, work hours, case-mix, and control over administrative and clinical practice. Physicians estimated the percentage of their patients who were "generally frustrating to deal with." We categorized physicians by quartile of reported frustrating patients and compared characteristics of physicians in the top quartile to those in the other three quartiles. We used logistic regression to model physician characteristics associated with greater frustration.
In unadjusted analyses, physicians who reported high frustration with patients were younger (p < 0.001); worked more hours per week (p = 0.041); and had more symptoms of depression, stress, and anxiety (p < 0.004 for all). In the final model, factors independently associated with high frustration included age < 40 years, work hours > 55 per week, higher stress, practice in a medicine subspeciality, and greater number of patients with psychosocial problems or substance abuse.
Personal and practice characteristics of physicians who report high frustration with patients differ from those of other physicians. Understanding factors contributing to physician frustration with patients may allow us to improve the quality of patient-physician relationships.
Approximately 15% of patient encounters in adult primary care settings are unusually difficult from the physician's perspective[1, 2]. Most of the literature related to these difficult doctor-patient encounters has focused on the patient, rather than on the physician or practice setting involved. Patients who are perceived as difficult or frustrating are more likely than other patients to have psychiatric conditions, abrasive personality traits, and personality disorders [1–5]. They are more likely to report multiple physical symptoms, which are often medically unexplained[1, 2, 6]. Not surprisingly, these patients are also more frequently dissatisfied with their medical care[2, 7].
Although it is generally acknowledged that physicians share responsibility for difficult relationships, characteristics of physicians who report frustration with patients are not well defined. Data about the influence of practice settings and health care systems on perceived difficulty of patient-physician encounters are also scarce. It has been suggested that system factors such as time pressure, administrative burdens, and lack of control over clinical care may lead to more physician frustration with patients, especially in managed care settings [8–10]. The objective of this study was to describe physician and practice characteristics associated with greater physician-reported frustration with patients.
The Physician Worklife Survey measured personal and practice characteristics and work satisfaction of a national sample of US physicians in 1996–97. The survey was developed in a multi-step process and pilot tested with a large sample of physicians. Detailed descriptions of this process have been published [11–13]. The Physician Worklife Survey was mailed to a national stratified random sample of physicians in family medicine, internal medicine and pediatric specialties, selected from the American Medical Association Masterfile. The sample was stratified by race, specialty, and regional level of participation in managed care. Physicians returned 2326 usable surveys, yielding an adjusted response rate of 52% after correction for incorrect addresses, refusals, and ineligible responses. We excluded pediatricians and pediatric subspecialists from our analysis, leaving 1391 eligible family medicine, general internal medicine, and medical subspecialist physicians.
Frustration with patients
Physicians were asked to estimate the percentage of patients in their practices who were "generally frustrating to deal with." We categorized their responses into quartiles and defined physicians in the top quartile as "highly frustrated."
Physician and practice variables
Participants rated their general health on a 5-point scale from poor to excellent. They reported how often, on a 5-point scale, they felt "sad or depressed" in the past year. We refer to physicians as "often depressed" if they reported symptoms occurring fairly or very often. Participants also reported how often they felt "anxious or nervous." We referred to them as "often anxious" if they reported symptoms fairly or very often. Stress was measured using the 4-item version of the Perceived Stress Scale. We calculated the total number of hours worked per week by summing the hours spent seeing patients in the clinic and in the hospital, performing other patient-related activities (such as paperwork and phone calls), and doing other work-related activities (such as administration or teaching).
Physician control scales
A total of 12 items measuring perceived control over aspects of practice were included in the survey. We performed principal component analysis with oblimin rotation using our sample of non-pediatricians (see Additional file 1). Ten items loaded on 2 factors, which we described as clinical control (4 items) and administrative control (6 items). The alpha coefficients for these scales were 0.702 and 0.803, respectively. The remaining 2 items, which could represent either administrative or clinical domains depending on the work context, had cross loadings on both factors and were excluded from the control scales. We imputed missing values of component items using best subset regression when only 1 value from a scale was missing, and excluded responses if >1 value was missing.
Patient case-mix variables
Physicians were asked to report the percentage of patients in their practices who were white, black, Hispanic, Native American/Alaskan, and Asian/Pacific Islander. For our analysis, we used a dichotomous variable of percent white/non-white patients. Physicians reported the percentage of their patients who were uninsured, who received Medicaid, who had substance abuse problems, and who had "complex or numerous" medical problems or psychosocial problems.
We used Pearson's chi-square tests to compare characteristics of "highly frustrated" physicians to those of other physicians. We fit multivariable logistic regression models using a two-stage strategy to assess characteristics associated with greater physician-reported frustration with patients. In the first stage, we modeled associations between frustration and physician and practice characteristics, which included all physician and practice variables from the bivariable analyses. We used multiple degree-of-freedom Wald tests to remove groups of variables that were not significantly associated with high frustration. Secondly, we added patient case-mix variables (percent of patients who are white, who are uninsured, who receive Medicaid, who have substance abuse problems, who have complex medical problems, and who have complex psychosocial problems) that might explain any of the observed associations between physician and practice characteristics and frustration. Case-mix variables that did not confound these relationships were removed from the final model. The final model included the set of variables that were statistically significant (p < 0.05) after adjustment for other variables in the model. Results did not substantially differ when continuous variables in the final model were categorized into dichotomous variables. Therefore, we used the dichotomous form of the variables for ease of interpretation, reporting percentages for the bivariate analyses and odds ratios (OR) and 95% confidence intervals (CI) for the logistic regression models. We adjusted all analyses for sampling weights and strata included in the sample design using the statistical package Stata version 8.0 (Stata Corp, College Station, TX).
Table 1 shows personal and practice characteristics of the 1391 physician participants. Their mean age was 47 years, and most were male (77%) and white (82%). Forty percent worked in a small group practice setting, 21% worked in solo practice, 18% in a large group practice, 7% in academic medicine, and 6% in a group or staff model health maintenance organization. 12% of physicians were often anxious, 10% were often depressed. Physicians worked a mean of 55 hours per week. Physicians reported, on average, that 12% of their patients were "generally frustrating to deal with." Those who reported that >15% of their patients were frustrating were in the top quartile (Figure 1).
In the unadjusted analysis, all of the personal physician characteristics, with the exception of physician race (p = 0.96), were significantly related to high frustration (Table 2). Similarly, nearly all of the practice characteristics assessed were significantly associated with high frustration (Table 3). Physicians who practiced in group or staff model health maintenance organizations (HMO) and those who practiced in miscellaneous settings (such as urgent care or emergency departments) were more likely than physicians in other settings to be highly frustrated. Having less reported control over administrative aspects of practice was associated with greater frustration (p < 0.001). The association between control over clinical practice and frustration was of borderline statistical significance (p = 0.053).
Multivariable model results
Physician and practice characteristics
In the model considering physician and practice characteristics alone (without case-mix), the characteristics independently associated with high frustration were younger age, higher stress, greater number of hours worked per week, medicine subspecialty, HMO practice setting, and miscellaneous practice setting (such as urgent care).
When we added case-mix variables to the model, the only variables with an effect were percentage of patients with substance abuse (p = 0.024) and percentage of patients with complex psychosocial problems (p < 0.001).
The final multivariable model of characteristics independently associated with high frustration included younger age, higher stress, more hours worked per week (borderline significance), medicine subspecialty, and higher reported percentages of patients with psychosocial and substance abuse problems (Table 4). Practice setting was no longer significantly associated with high frustration when adjusted for case-mix.
Younger physicians and those with above-average stress had greater odds of frustration. Specialty was also independently associated with frustration; both subspecialists and general internists appeared to have greater odds of high frustration than family physicians, but this difference only reached statistical significance for medicine subspecialists (OR = 2.0, 95% CI 1.3–3.3). After adjustment for case-mix, the association between longer work hours and frustration was of borderline statistical significance (OR = 1.5, 95% CI 1.0–2.2).
Moderate correlation was present between the anxiety, depression, and stress variables (r = 0.36–0.58). To assess for independent associations between these variables and high frustration, we evaluated 3 additional logistic regression models, excluding all but 1 of the 3 correlated variables at a time (data not shown). Each of the individual variables was significantly associated with frustration when the other 2 variables were excluded; this did not substantially change results for other variables in the full model.
We also conducted analyses evaluating physicians in the top decile of reported frustrating patients (those who reported more than 25% of their patients were frustrating to deal with), but found similar results to those we have reported using our quartile definition.
Although the difficult doctor-patient relationship has been a focus of inquiry for many years, research has largely focused on characteristics of "difficult patients." Personal and practice characteristics of physicians who report frustration with patients have received less attention. We found that physicians vary substantially in the percentage of patients they perceive to be frustrating, and that physicians who report a high percentage of frustrating patients differ from other physicians in a number of ways. In particular, highly frustrated physicians were younger, more likely to practice subspecialty internal medicine, and more likely to have high stress. Some of the variability we observed between physicians may be due their differing tendencies to perceive a given patient as frustrating. However, physician behaviors may also affect reported frustration with patients. The clinical encounter is a dynamic process, and physician behaviors, especially communication methods, may alter the character of a patient encounter in ways that promote or alleviate interpersonal difficulty.
We found that physicians who reported more patients with psychosocial problems and with substance abuse problems were more likely to be highly frustrated, while those who reported more patients with complex medical problems were not. This finding is consistent with studies of difficult doctor-patient encounters, which have consistently found that patients with psychiatric illness are more likely to be perceived as difficult by their physicians [1–5]. Physicians in general are better prepared by training to address biomedical problems than psychosocial problems[17, 18]. However, individual physicians vary in their perspectives on the importance of psychosocial care. This variation may explain some of the differences we observed between physicians. In one study involving 38 primary care physicians practicing in a walk-in clinic, investigators found that physicians with negative beliefs about the value of psychosocial care rated more encounters as difficult. Notably, patients involved in these difficult encounters had worse outcomes in terms of less satisfaction with the visit, more unmet expectations for care, and higher subsequent health care utilization.
Physician beliefs about psychosocial aspects of practice may be a factor in the association we observed between specialty and frustration. We found that family physicians were less likely to report high frustration with patients than physicians in both general internal medicine and medicine subspecialties, although this association reached statistical significance only for subspecialists. The philosophy of family medicine embraces a relatively holistic approach to patient care,  and there is some evidence that family physicians may have more favorable beliefs about psychosocial care than internists .
Older physicians were less likely to report high frustration with patients, perhaps because of greater clinical experience or a more flexible and humanistic approach to patient care. It is also possible that there are fewer highly frustrated physicians in the older age group because these physicians are less likely to continue practicing clinical medicine.
In our preliminary exploration of the relationship between practice factors and frustration with patients, we evaluated practice factors that have been hypothesized to be potential contributors to difficult doctor-patient relationships, including length of appointment time, type of practice, number of hours worked per week, and perceived control over administrative and clinical issues. The association between frustration and HMO or miscellaneous practice setting was no longer statistically significant after adjustment for case-mix. Only number of hours worked per week was associated with frustration in the full model; this association had borderline statistical significance after adjustment for case-mix. The effect of prolonged work hours on physician wellbeing, physician-patient relationships, and patient safety is an area of ongoing interest, especially in the context of policies limiting resident physician work hours. We speculate that working long hours may decrease tolerance for dealing with challenging patient issues, but this hypothesis requires further study.
Several limitations of our study deserve consideration. First, our data are based on physician report, so we are unable to determine how much of the variation in reported frustrating patients is due to differences between physicians' case-loads and how much is due to differences between physicians themselves. While some physicians certainly have more challenging patient panels, prior research has found that physicians report substantial differences in perceived difficulty with patients even when patients are new and arbitrarily assigned. Second, our measures of physician mental health characteristics relied on brief measures. Detailed assessments of physician personality, mental health, and interpersonal skills were beyond the scope of this survey. Finally, because the data are cross-sectional, we cannot draw conclusions about the direction of relationships between physician factors and reported frustration with patients.
Are the highly frustrated physicians we identified truly "difficult doctors"? More likely, they are a diverse group of doctors facing varied personal and clinical challenges. Among them may be physicians who are inadequately equipped to address the complex psychosocial needs of their patients. Ultimately, we need better understanding of the role that physicians play in frustrating doctor-patient relationships so we can develop strategies to improve the wellbeing of both patients and their doctors.
Hahn SR, Kroenke K, Spitzer RL, Brody D, Williams JB, Linzer M, deGruy FV: The difficult patient: prevalence, psychopathology, and functional impairment. J Gen Intern Med. 1996, 11: 1-8.
Jackson JL, Kroenke K: Difficult Patient Encounters in the Ambulatory Clinic: Clinical Predictors and Outcomes. Arch Intern Med. 1999, 159: 1069-1075. 10.1001/archinte.159.10.1069.
Schwenk TL, Marquez JT, Lefever RD, Cohen M: Physician and patient determinants of difficult physician-patient relationships. J Fam Pract. 1989, 28: 59-63.
Hahn SR, Thompson KS, Wills TA, Stern V, Budner NS: The difficult doctor-patient relationship: somatization, personality and psychopathology. J Clin Epidemiol. 1994, 47: 647-657. 10.1016/0895-4356(94)90212-7.
Walker EA, Katon WJ, Keegan D, Gardner G, Sullivan M: Predictors of physician frustration in the care of patients with rheumatological complaints. Gen Hosp Psychiatry. 1997, 19: 315-323. 10.1016/S0163-8343(97)00042-X.
Lin EH, Katon W, Von Korff M, Bush T, Lipscomb P, Russo J, Wagner E: Frustrating patients: physician and patient perspectives among distressed high users of medical services. J Gen Intern Med. 1991, 6: 241-246.
Sharpe M, Mayou R, Seagroatt V, Surawy C, Warwick H, Bulstrode C, Dawber R, Lane D: Why do doctors find some patients difficult to help?. Q J Med. 1994, 87: 187-193.
Lipsitt DR: The challenge of the "difficult patient" (deja vu all over again--only more so). Gen Hosp Psychiatry. 1997, 19: 313-314. 10.1016/S0163-8343(97)00062-5.
Barsky AJ, Borus JF: Somatization and medicalization in the era of managed care. JAMA. 1995, 274: 1931-1934. 10.1001/jama.274.24.1931.
Freidson E: Prepaid group practice and the new "demanding patient". Milbank Mem Fund Q Health Soc. 1973, 51: 473-488. 10.2307/3349630.
Linzer M, Konrad TR, Douglas J, McMurray JE, Pathman DE, Williams ES, Schwartz MD, Gerrity M, Scheckler W, Bigby JA, Rhodes E: Managed care, time pressure, and physician job satisfaction: results from the physician worklife study. J Gen Intern Med. 2000, 15: 441-450. 10.1046/j.1525-1497.2000.05239.x.
Williams ES, Konrad TR, Linzer M, McMurray J, Pathman DE, Gerrity M, Schwartz MD, Scheckler WE, Van Kirk J, Rhodes E, Douglas J: Refining the measurement of physician job satisfaction: results from the Physician Worklife Survey. Med Care. 1999, 37: 1140-1154. 10.1097/00005650-199911000-00006.
Konrad TR, Williams ES, Linzer M, McMurray J, Pathman DE, Gerrity M, Schwartz MD, Scheckler WE, Van Kirk J, Rhodes E, Douglas J: Measuring physician job satisfaction in a changing workplace and a challenging environment. Med Care. 1999, 37: 1174-1182. 10.1097/00005650-199911000-00010.
Cohen S, Kamarck T, Mermelstein R: A global measure of perceived stress. J Health Soc Behav. 1983, 24: 385-396. 10.2307/2136404.
Novack DH, Volk G, Drossman DA, Lipkin MJ: Medical interviewing and interpersonal skills teaching in US medical schools. Progress, problems, and promise. JAMA. 1993, 269: 2101-2105. 10.1001/jama.269.16.2101.
Waldstein SR, Neumann SA, Drossman DA, Novack DH: Teaching psychosomatic (biopsychosocial) medicine in United States medical schools: survey findings. Psychosom Med. 2001, 63: 335-343.
Frey J: The clinical philosophy of family medicine. Am J Med. 1998, 104: 327-329.
Ashworth CD, Williamson P, Montano D: A scale to measure physician beliefs about psychosocial aspects of patient care. Soc Sci Med. 1984, 19: 1235-1238. 10.1016/0277-9536(84)90376-9.
The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1472-6963/6/128/prepub
■ An earlier version of this work was presented as an oral abstract at the 28th annual meeting of the Society of General Internal Medicine, May 11–14, 2005.
■ Both the Physician Worklife Survey and the authors of this secondary analysis were supported by the Robert Wood Johnson Foundation. Dr. Krebs was a Robert Wood Johnson Clinical Scholar at the University of North Carolina at Chapel Hill when this study was conducted.
■ We thank the Society of General Internal Medicine Career Satisfaction Study Group for making their data available for this secondary analysis.
■ We thank Carol Q. Porter for help with data management.
The author(s) declare that they have no competing interests.
EEK developed the study design, performed statistical analyses, and drafted the manuscript. JMG participated in the study design, performed statistical analysis, and edited the manuscript. TRK participated in the design and administration of the original survey, participated in the design of this secondary study, performed statistical analysis, and edited the manuscript. All authors read and approved the final manuscript.
Authors’ original submitted files for images
Below are the links to the authors’ original submitted files for images.