The impact of health literacy on shared decision making before elective surgery: a propensity matched case control analysis
BMC Health Services Research volume 18, Article number: 958 (2018)
Poor health literacy affects over 90 million Americans. The primary aim of the study was to evaluate a possible association between health literacy and decision conflict in surgical patients.
Patients undergoing a diverse number of elective surgeries were enrolled in the study. Health literacy was measured using the Newest Vital Sign instrument and decision conflict using the low literacy version of the Decision Conflict Scale.
200 patients undergoing elective surgeries were included in the study. Patients who had greater health literacy scores had lower decision conflict scores, Spearman’s rho = − 0.43, P < 0.001. Following propensity-score matching to account for potential covariates, the median (IQR) decision conflict score was 20 (0 to 40) for patients with poor health literacy compared to 0 (0 to 5) for patients with adequate literacy, P < 0.001.
Poor health literacy is associated with greater decision conflict in patients undergoing elective surgical procedures. Strategies should be implemented to minimize decision conflict in poor health literacy patients undergoing elective surgical procedures.
Health literacy is defined as the ability to obtain, read, understand, and use healthcare information in order to make appropriate health decisions and follow instructions for treatment . More than 90 million Americans have poor health literacy . Poor health literacy has been associated with poor health outcomes (e.g., hospitalizations, readmissions and mortality) in medical patients [2,3,4]. Health literacy directly affects patients’ ability to navigate complex health care systems, to make informed decisions and provide self-care . It is, therefore, expected that poor health literacy can have a large impact on the care and health outcomes of surgical patients who often need to follow important instructions during the perioperative phases [6,7,8,9]. Nonetheless, our group has demonstrated that studies evaluating the impact of poor health literacy on the care of surgical patients are vastly scarce .
The decision making process for surgical patients undergoing various elective surgeries for different conditions frequently involves uncertainties that can lead to decisional conflict . The simple lack of comprehension by patients regarding surgical risks and benefits is a major contributor to the development of decision conflict and poor shared decision making [12,13,14]. It has been demonstrated that poor health literacy influences decision making in non-surgical settings, but it is unknown the extent to which patients with poor health literacy are at risk for greater decision conflict before surgery.
The primary purpose of the study is to explore the association between health literacy and decision conflict in surgical patients undergoing a diverse number of elective surgeries. We hypothesized that patient with poor health literacy would have greater decision conflict than patients with adequate health literacy. In addition, we also sought to explore a potential accord between the patients’ overestimation of surgical mortality risk and the decision conflict prior to elective surgeries.
This cross-sectional study included consecutive English speaking patients eighteen years or older who were scheduled to undergo elective surgeries. This study received institutional review board approval by Northwestern University. The work adheres in line with the STROCSS criteria and was registered at http://www.researchregistry.com, unique identifier number: researchregistry3296 . Each participant provided written informed consent prior to enrollment. Patients were excluded if they had ailments that could affect communication (e.g., uncorrected visual and/or hearing impairment, aphasia), Alzheimer’s disease and if they were undergoing oncological or emergency procedures.
Patients undergoing elective surgical procedures were evaluated in the preoperative characteristics (e.g., age, gender, race), 2) American Society of Anesthesiology (ASA) physical classification, 3) medical history, 4) educational level, 5) annual income, and 6) surgical procedure specialty.
The questionnaires were administered to patients in the preoperative holding area face to face by a research assistant. Patients’ health literacy was evaluated using a specific, validated tool, called the Newest Vital Sign (NVS) . The NVS is a 6-item assessment of health literacy and numeracy using questions about an ice cream nutrition label. It is a reliable (Cronbach’s alpha in 3 studies range from 0.74–0.81) screening tool used to determine risk for poor health literacy. It includes computational skills as well as reading comprehension, and is felt to assess more complex cognitive functions than shorter word-recognition tests of literacy. Patients are given an ice cream nutrition label and are asked 6 questions about how they would interpret and act on the information contained on the label. Each question correctly answered is given one point; Scores ≤3 indicates poor health literacy, while scores ≥4 indicates adequate health literacy. The NVS has been shown to have a high sensitivity for predicting poor health literacy skills and has a strong correlation with other established measures, such as the REALM and TOFHLA .
Decision conflict was evaluated using the low literacy version of the decision conflict scale which is a validated tool that consists of 10 questions . Each question is scored using yes = 0, unsure = 2 and no = 4. The values are then summed and multiplied by a factor of 2.5. Scores from the scale range from Zero (no decisional conflict) to 100 (extremely high decisional conflict). A total score greater than 30 has been considered high decisional conflict in healthcare as this score may imply that patients were unsure in more than 5 out 10 questions of the questionnaire [19, 20].
Patients were asked to give an estimate on the chance of dying as a result of the surgical procedure. The probability of postsurgical mortality was determined by using the web-based online American College of Surgeons NSQIP surgical risk calculator . The surgical risk calculator is an on-line tool created in 2013 to improve communication between surgeons and patients by proving a customized risk assessment of undesirable surgical postoperative outcomes including mortality. The calculator has outstanding properties when assessing mortality (c-statistic = 0.944; Brier score = 0.011 [where scores approaching 0 are better]). Overestimation of mortality probability was obtained through the difference between the patient’s estimation of surgical mortality and the value obtained by American College of Surgeons NSQIP surgical risk calculator.
We performed a power analysis that estimated a sample size of 193 patients would be required to achieve 80% power to detect a difference of − 0.2 between the null hypothesis correlation of 0.0 and the alternative hypothesis correlation of 0.2 for the association between health literacy and decision conflict using a two-sided hypothesis test with a significance level of 0.05. Continuous data were analyzed using independent t-tests or Mann-Whitney U test as appropriate. Categorical data were analyzed using the Fisher’s exact test.
Spearman’s rank correlation coefficient was used to measure an association between mortality risk overestimation and decision conflict. A propensity score matching analysis was conducted to confirm the relationship between health literacy and decision conflict. Variables that were associated with poor shared decision making in other clinical settings or that were linked with decision conflicts in the current dataset (P < 0.2) were included in the analysis.
The propensity score is the conditional probability for patients who experienced high decision conflict (≥30) and for those who did not have a high decision conflict (< 30) as a function of predefined covariates which was added into a multiple logistic regression. Continuous variables were dichotomized by analyzing their discriminant properties following the construction of receiver operating curves for decision conflict. Individual propensity scores derived from the logistic regression analysis were calculated.
The propensity scores were used to create a one to one matched analysis (nearest neighbor with caliber matching) of patients who had poor health literacy with patients who did not have poor health literacy by a random selection. Following the Cochran and Rubin algorithm, we used a caliper width of the pair to be within 0.6 standard deviations (SD) to match the pairs . Patients who did not follow within the caliper width was excluded. Simple bivariate analysis was used with the matched groups to examine an independent association among patients with poor health literacy and high decision conflict. A two-sided p value < 0.05 was considered statistically significant.
Among 218 patients undergoing elective surgical procedures who were screened between June 2014 and September 2014, 200 met our inclusion criteria. Patients were undergoing large and diverse types of elective surgeries (Table 1). 63 out of 200 (32%) patients had poor health literacy. Poor health literacy was more common in older, non-White, poorly educated and lower income patients (Table 2).
There was an inverse correlation between health literacy scores and decision conflict score. Patients who had greater health literacy scores had lower decision conflict scores (Fig. 1, P < 0.001). The median (IQR) for decision conflict score in patients with poor health literacy was 30 (0 to 45) compared to 0 (0 to 5) in patients with adequate literacy, P < 0.001.
Forty-seven patients with poor health literacy were propensity matched to 47 patients who had adequate health literacy. Confounding covariates were similarly distributed in the propensity matched groups (Table 3). In the propensity matched groups, the median (IQR) decision conflict score was 20 (0 to 40) for patients with poor health literacy compared to 0 (0 to 5) for patients with adequate literacy, P < 0.001. Twenty five out of 47 (53%) patients with poor health literacy had high decision conflict compared to 5 out 47 (11%) patients with adequate literacy, P < 0.001.
There was not a significant correlation between overestimation of surgical risk and the decision conflict, rho = 0.06, P = 0.47. Eleven from 29 subjects who overestimated mortality risk by ≥5% had high decision conflict compared to 30 out 119 who overestimated surgical risk < 5%, P = 0.17.
The most important finding of the current study is the robust association between health literacy and decision conflict in patients undergoing elective surgical procedures. Patients with poor health literacy had greater decision conflict when compared to patients with adequate health literacy. The association was still detected even after it was adjusted for potential confounding covariates (e.g., education, race, income) using propensity matching analysis. Taken together, our results suggest that patients with poor health literacy are likely at risk for poor shared decision making before elective surgeries.
Our results are clinically important since shared decision making is considered an important strategy to improve quality of care, while still reducing healthcare costs [23,24,25]. Furthermore, shared decision making has been considered the pinnacle of patient-centered care [26, 27]. Since it is estimated that over 90 million Americans have poor health literacy, targeted efforts to improve shared decision making for patients with poor health literacy undergoing elective surgery can improve quality of surgical care in the United States. To the best of our knowledge, this is the first study to detect health literacy as an important factor for shared decision making in surgery.
Another important finding was the lack of correlation between patients’ estimation of surgical risk and decision conflict. The creation of precise risk estimation (such as the NSQIP risk calculator used in this study) represents an important effort to promote shared decision making in surgical patients [28,29,30,31,32]. Nonetheless, our current results suggest that precise risk estimation alone may not always lead to shared decision making. Patients with poor health literacy may not comprehend surgical risk estimates as it is currently presented in the clinical settings. Improvements in risk communication strategies targeting the needs of patients with poor health literacy before surgery are warranted.
The use of decision aids results in a small (− 5.0, 95%CI: -7.1 to − 2.9 points), but effective strategy to reduce decision conflict in patients facing a surgical treatment . Nevertheless, the effect of decision aids on decision conflict is not entirely clear for patients undergoing elective surgical procedures as four studies showed benefit and two did not in a recent systematic review . Another systematic review demonstrated that most studies do not incorporate health literacy best practices when developing decision aids for patients . Our current results support the need to develop decision aids using health literacy best practices for patients undergoing elective surgeries.
Recently, the American College of Surgeons (ACS) and National Institutes of Health (NIH) convened a research summit to develop a national surgical disparities agenda . The improvement of patient clinical communication was described as a major priority, specifically the need to address patients’ health literacy and decision making. The current investigation reinforces the need to improve patient-clinician communication and the potential role of health literacy in mediating disparities in surgical care.
Although we studied primarily the impact of health literacy on share decision making during elective surgery, it is possible that health literacy may have an important impact on other phases of the surgery. Patients who do not understand preoperative instructions may not follow them and this may result in cancellations [37, 38]. Patients who do not understand how to take postoperative pain analgesics may develop greater postoperative pain than patients who take their medications appropriately after surgery [39, 40].
Our study suggests the need to improve preoperative communication between health care providers (e.g., surgeons, nurses) and patients. This could be achieved by incorporating decision aids into the preoperative workflow, preferably during the pre-anesthesia evaluation many days before the day of surgery. This would allow patients to consider their options, ask questions, discuss the process and follow up care over time.
This investigation must be interpreted according to its limitations. We only studied patients undergoing non-cancerous elective surgical procedures, and we cannot generalize our findings to patients undergoing oncologic or emergent surgery. Nonetheless, we hypothesize that due to time constraints, patient-clinician communication in oncologic and emergent surgery can be severely jeopardized with greater implications to shared decision making. Although a positive correlation between decision conflict and regret has been established in other clinical scenarios, we did not evaluate long term decision regret in the current study population . Future studies assessing shared decision making in surgical patients would benefit from including a longitudinal evaluation of patients’ decision regret.
Shared decision making is considered a key component of patient-centered care. We demonstrate that patients with poor health literacy are more likely to have decision conflict before elective surgeries. Targeting patients with poor health literacy (approximately 90 million American) can be an important strategy to improve shared decision making and, ultimately, the overall quality of care experienced by surgical patients.
American college of surgeons
American Society of Anesthesiology
Decision Conflict Scale
Newest Vital Sign
Rapid Estimate of Adult Literacy in Medicine
Strengthening the Reporting of Cohort Studies in Surgery
Test of Functional Health Literacy in Adults
Garcia CH, Espinoza SE, Lichtenstein M, Hazuda HP. Health literacy associations between Hispanic elderly patients and their caregivers. J Health Commun. 2013;18(Suppl 1):256–72.
Mitchell SE, Sadikova E, Jack BW, Paasche-Orlow MK. Health literacy and 30-day postdischarge hospital utilization. J Health Commun. 2012;17(Suppl 3):325–38.
Baker DW, Gazmararian JA, Williams MV, Scott T, Parker RM, Green D, Ren J, Peel J. Functional health literacy and the risk of hospital admission among Medicare managed care enrollees. Am J Public Health. 2002;92:1278–83.
Andreae MH, Nair S, Gabry JS, Goodrich B, Hall C, Shaparin N. A pragmatic trial to improve adherence with scheduled appointments in an inner-city pain clinic by human phone calls in the patient's preferred language. J Clin Anesth. 2017;42:77–83.
Schonberger RB, Dai F, Brandt C, Burg MM. The effect of race on postsurgical ambulatory medical follow-up among United States Veterans. J Clin Anesth. 2017;40:55–61.
Cai Y, Lopata L, Roh A, Huang M, Monteleone MA, Wang S, Sun LS. Factors influencing postoperative pain following discharge in pediatric ambulatory surgery patients. J Clin Anesth. 2017;39:100–4.
Fandino W. Strategies to prevent ischemic optic neuropathy following major spine surgery: A narrative review. J Clin Anesth. 2017;43:50–8.
Teunkens A, Vanhaecht K, Vermeulen K, Fieuws S, Van de Velde M, Rex S, Bruyneel L. Measuring satisfaction and anesthesia related outcomes in a surgical day care centre: A three-year single-centre observational study. J Clin Anesth. 2017;43:15–23.
Whitten I, De Oliveira GS Jr. Selection of anesthesia technique: Not always the right reasons or the right outcomes…. J Clin Anesth 2017; 42:49–50.
De Oliveira GS Jr, McCarthy RJ, Wolf MS, Holl J. The impact of health literacy in the care of surgical patients: a qualitative systematic review. BMC Surg. 2015 Jul 17;15:86.
LeBlanc A, Kenny DA, O'Connor AM, Légaré F. Decisional conflict in patients and their physicians: a dyadic approach to shared decision making. Med Decis Mak. 2009;29:61–8.
Orom H, Biddle C, Underwood W 3rd, Nelson CJ, Homish DL. What Is a "Good" Treatment Decision? Decisional Control, Knowledge, Treatment Decision Making, and Quality of Life in Men with Clinically Localized Prostate Cancer. Med Decis Mak. 2016 Aug;36(6):714–25.
Copeland CC, Young A, Grogan T, Gabel E, Dhillon A, Gudzenko V. Preoperative risk stratification of critically ill patients. J Clin Anesth. 2017;39:122–7.
Cavalcante AN, Hofer RE, Tippmann-Peikert M, Sprung J, Weingarten TN. Perioperative risks of narcolepsy in patients undergoing general anesthesia: A case-control study. J Clin Anesth. 2017;41:120–5.
Agha RA, Borrelli MR, Vella-Baldacchino M, Thavayogan R, Orgill DP. For the STROCSS group. The STROCSS statement: strengthening the reporting of cohort studies in surgery. Int J Surg. 2017;46:198–202.
Weiss BD, Mays MZ, Martz W, Castro KM, DeWalt DA, Pignone MP, Mockbee J, Hale FA. Quick assessment of literacy in primary care: the newest vital sign. Ann Fam Med. 2005;3:514–22.
Osborn CY, Weiss BD, Davis TC, Skripkauskas S, Rodrigue C, Bass PF, Wolf MS. Measuring adult literacy in health care: performance of the newest vital sign. Am J Health Behav. 2007;31:S36–46.
Linder SK, Swank PR, Vernon SW, Mullen PD, Morgan RO, Volk RJ. Validity of a low literacy version of the decisional conflict scale. Patient Educ Couns. 2011;85:521–4.
Chiarchiaro J, Buddadhumaruk P, Arnold RM, White DB. Prior advance care planning is associated with less decisional conflict among surrogates for critically ill patients. Ann Am Thorac Soc. 2015;12:1528–33.
Walton GD, Ross LE, Stewart DE, Grigoriadis S, Dennis CL, Vigod S. Decisional conflict among women considering antidepressant medication use in pregnancy. Arch Womens Ment Health. 2014;17:493–501.
Bilimoria KY, Liu Y, Paruch JL, Zhou L, Kmiecik TE, Ko CY, Cohen ME. Development and evaluation of the universal ACS NSQIP surgical risk calculator: a decision aid and informed consent tool for patients and surgeons. J Am Coll Surg 2013 Nov;217(5):833–42.e1–3.
Gu XS, Rosenbaum PR. Comparison of multivariate matching methods: structures, distances and algorithms. J Comput Graph Stat. 1993;2(4):405–20.
Ituk U, Wong CA. Epidural labor analgesia: Whence come our patients' misconceptions? J Clin Anesth. 2017;42:84–5.
Echevarria GC, Grant GJ, Chung Y, Lax J. Survey of nulliparous parturients' attitudes regarding timing of epidural analgesia initiation. J Clin Anesth. 2017;41:106–11.
Oliver JB, Kashef K, Bader AM, Correll DJ. A survey of patients' understanding and expectations of persistent postsurgical pain in a preoperative testing center. J Clin Anesth. 2016;34:494–501.
Oshima Lee E, Emanuel EJ. Shared decision making to improve care and reduce costs. N Engl J Med. 2013;368:6–8.
Barry MJ, Edgman-Levitan S. Shared decision making--pinnacle of patient-centered care. N Engl J Med. 2013;368:6–8.
Yee JN, Koht A, McCarthy RJ, Bebawy JF. Factors associated with blood transfusion during intracranial aneurysm surgery. J Clin Anesth. 2017;36:164–7.
Maile MD, Armstrong WF, Jewell ES, Engoren MC. Impact of ejection fraction on infectious, renal, and respiratory morbidity for patients undergoing noncardiac surgery. J Clin Anesth. 2017;36:1–9.
Rivard C, Nahum R, Slagle E, Duininck M, Isaksson Vogel R, Teoh D. Evaluation of the performance of the ACS NSQIP surgical risk calculator in gynecologic oncology patients undergoing laparotomy. Gynecol Oncol. 2016 Feb 24; [Epub ahead of print].
Moran J, Wilson F, Guinan E, McCormick P, Hussey J, Moriarty J. The preoperative use of field tests of exercise tolerance to predict postoperative outcome in intra-abdominal surgery: a systematic review. J Clin Anesth. 2016;35:446–55.
Cheng H, Udesh R, Mehta A, Thirumala PD. Perioperative strokes after coronary artery bypass grafting with staged carotid endarterectomy: A nationwide perspective. J Clin Anesth. 2017;39:25–30.
Knops AM, Legemate DA, Goossens A, Bossuyt PM, Ubbink DT. Decision aids for patients facing a surgical treatment decision: a systematic review and meta-analysis. Ann Surg. 2013;257:860–6.
Fragneto MDRY, Gaiser MDR. Labor analgesia: We need to better understand and educate our obstetric patients. J Clin Anesth. 2017;41:42–3.
McCaffery KJ, Holmes-Rovner M, Smith SK, Rovner D, Nutbeam D, Clayman ML, Kelly-Blake K, Wolf MS, Sheridan SL. Addressing health literacy in patient decision aids. BMC Med Inform Decis Mak. 2013;13:S10.
Haider AH , Dankwa-Mullan I , Maragh-Bass AC , Torain M , Zogg CK , Lilley EJ , Kodadek LM , Changoor NR , Najjar P , Rose JA Jr , Ford HR , Salim A , Stain SC , Shafi S , Sutton B , Hoyt D , Maddox YT , Britt LD . Setting a National Agenda for surgical disparities research: recommendations from the National Institutes of Health and American College of Surgeons summit. JAMA Surg 2016 Mar 16. doi: 10.1001/jamasurg.2016.0014. [Epub ahead of print].
Gabriel RA, Wu A, Huang CC, Dutton RP, Urman RD. National incidences and predictors of inefficiencies in perioperative care. J Clin Anesth. 2016;31:238–46.
Lozada MJ, Nguyen JT, Abouleish A, Prough D, Przkora R. Patient preference for the pre-anesthesia evaluation: Telephone versus in-office assessment. J Clin Anesth. 2016;31:145–8.
Ardon AE, Clendenen SR, Porter SB, Robards CB, Greengrass RA. Opioid consumption in total knee arthroplasty patients: a retrospective comparison of adductor canal and femoral nerve continuous infusions in the presence of a sciatic nerve catheter. J Clin Anesth. 2016;31:19–26.
Maheshwari K, Cummings KC 3rd, Farag E, Makarova N, Turan A, Kurz A. A temporal analysis of opioid use, patient satisfaction, and pain scores in colorectal surgery patients. J Clin Anesth 2016; 34:661–667.
The author would like to thank Dr. Martin Errea for his help in conducting the study.
This project was supported by a grant number K08HS024158 from the Agency for HealthCare Research and Quality. The content is solely the responsibility of the authors and does not necessarily represent the official views of the Agency for Healthcare Research and Quality.
Availability of data and materials
Data availability may be granted by contacting the corresponding author.
Ethics approval and consent to participate
This investigation was a cross-sectional study. Northwestern University Institutional review board approved the study. All participating patients provided written informed consent. The study protocol was registered at http://www.researchregistry.com, unique identifier: researchregistry3296.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
De Oliveira, G.S., Errea, M., Bialek, J. et al. The impact of health literacy on shared decision making before elective surgery: a propensity matched case control analysis. BMC Health Serv Res 18, 958 (2018). https://doi.org/10.1186/s12913-018-3755-9