Skip to main content
Download PDF

The association between Asian patient race/ethnicity and lower satisfaction scores

BMC Health Services Research volume 20, Article number: 678 (2020) Cite this article

Abstract

Background

Patient satisfaction is increasingly being used to assess, and financially reward, provider performance. Previous studies suggest that race/ethnicity (R/E) may impact satisfaction, yet few practices adjust for patient R/E. The objective of this study is to examine R/E differences in patient satisfaction ratings and how these differences impact provider rankings.

Methods

Patient satisfaction survey data linked to electronic health records from two large outpatient centers in northern California – a non-profit organization of community-based clinics (Site A) and an academic medical center (Site B) – was collected and analyzed. Participants consisted of adult patients who received outpatient care at Site A from December 2010 to November 2014 and Site B from March 2013 to August 2014, and completed Press-Ganey Medical Practice Survey questionnaires (N = 216,392 (Site A) and 30,690 (Site B)). Self-reported non-Hispanic white (NHW), Black, Latino, and Asian patients were studied. For six questions each representing a survey subdomain, favorable ratings were defined as top-box (“very good”) compared to all other categories (“very poor,” “poor,” “fair,” and “good”). Using multivariable logistic regression with provider random effects, we assessed whether the likelihood of giving favorable ratings differed by patient R/E, adjusting for patient age and sex.

Results

Asian, younger and female patients provided less favorable ratings than other R/E, older and male patients. After adjustment, Asian patients were less likely than NHW patients to provide top-box ratings to the overall assessment question “likelihood of recommending this practice to others” (Site A: Asian predicted probability (PP) 0.680, 95% confidence interval (CI): 0.675–0.685 compared to NHW PP 0.820, 95% CI: 0.818–0.822; Site B: Asian PP 0.734, 95% CI: 0.733–0.736 compared to NHW PP 0.859, 95% CI: 0.859–0.859). The effect sizes for Asian R/E were greater than the effect sizes for older age and female sex. An absolute 3% decrease in mean composite score between providers serving different percentages of Asian patients translated to an absolute 40% drop in national ranking.

Conclusions

Patient satisfaction scores may need to be adjusted for patient R/E, particularly for providers caring for high panel percentages of Asian patients.

Peer Review reports

Background

Patient satisfaction surveys are increasingly being used by healthcare organizations to monitor patient experience, assess provider performance and inform compensation decisions [1,2,3,4]. Similar to other metrics for provider assessment such as cost or clinical quality indicators, patient satisfaction measures may require adjustment for patient characteristics to ensure that reported differences are due to real differences in performance rather than differences in patient mix. Different studies have found patient age, self-perceived health status, education level, sex, marital status, and race/ethnicity (R/E) to be associated with patient satisfaction measures [5,6,7,8,9,10,11,12,13,14,15,16,17]. However, which of these associated patient characteristics should actually be adjusted for in practice to ensure valid comparisons among providers is a debate that has yet to reach consensus [18].

The importance of adjusting satisfaction scores is underscored by the fact that the relative ranking of providers is highly sensitive to small differences in mean patient satisfaction scores. Since patient satisfaction data are not normally distributed and left-skewed (the majority of respondents select the highest ratings), a minor difference in mean rating can dramatically lower a provider’s relative ranking [19]. For example, an absolute 3% decrease in mean composite score translates to an absolute 40% drop in national ranking, from 58th percentile to 18th percentile (“A Press, Ganey Report: Medical Practice Means and Ranks,” 2012). Lower scores and ranking can have consequences on a physician’s compensation and mental well-being. In 2013, 2 % of primary care physicians’ compensation and 1 % of specialist physician compensation were based on patient satisfaction metrics [4]. Additionally, several studies have found lower patient satisfaction scores and higher physician burnout to be correlated [20,21,22,23], and while the directionality of this relationship is not clear, receiving low scores for reasons beyond one’s control could contribute to burnout.

The Consumer Assessment of Healthcare Providers and Systems (CAHPS) Consortium currently recommends adjusting CAHPS surveys for general health status, age, and education [24]. However, the Medicare Advantage and Prescription Drug Program CAHPS Survey has historically adjusted for additional variables, the most recent of which include mental health status, whether a respondent received help responding, whether a proxy answered questions for the respondent, Medicaid status, low income subsidy, and Chinese language [18]. Furthermore, many studies have advised implementing case-mix adjustment of satisfaction scores and finer reporting of data by additional patient characteristics [10, 12,13,14, 16, 17, 25, 26]. One such additional patient characteristic that has frequently been studied is patient R/E.

A strong trend that has been noted throughout literature regarding satisfaction scores and patient R/E is that Asian patients provide lower patient satisfaction ratings than non-Hispanic white (NHW) patients [16, 27] and other R/E groups [7, 13, 28,29,30,31,32,33,34]. These studies have utilized various survey instruments such CG-CAHPS, which unlike its inpatient counterpart H-CAHPS is not nationally implemented and is only required for accountable care organizations and group practices participating in Medicare and Medicaid initiatives [35]. On the other hand, the Press-Ganey Medical Practice Survey is most commonly used outpatient survey in the U. S [36]. To our knowledge, no largescale studies of Asian patient satisfaction in the outpatient setting using the most prevalent survey instrument have been conducted in the U.S. recently, when patient satisfaction scores are increasingly used to drive physician compensation [4].

To investigate whether patient satisfaction scores should be adjusted for patient R/E, we conducted a large-scale analysis of Press-Ganey Medical Practice Survey data linked to electronic health record data. To assess the generalizability of our findings, we conducted this analysis in two separate outpatient sites in northern California – a non-profit community-based healthcare organization and an academic medical center. We examined R/E differences in patient satisfaction ratings, focusing in particular on Asian patient R/E, and showed how provider scores decline as the percentage of Asians in a provider’s panel increases, an effect that holds even greater consequences when translated to provider ranking. This paper discusses the need to adjust satisfaction scores for Asian patient R/E, especially for providers caring for high proportions of Asian patients.

Methods

Setting

Site A

Press-Ganey Medical Practice Survey data from December 2010 to November 2014 were obtained from a non-profit organization of community-based outpatient clinics (Site A) serving predominantly urban counties of northern California. Site A serves more than 1 million patients annually whose demographic characteristics reflect the local population with respect to age, sex, and R/E (42.4% White, 23.5% Latino/Hispanic, 6.4% African American, 23.0% Asian) [37]. Providers at Site A are mostly female and have more than 15 years of clinical experience beyond medical school, with a majority of providers being NHW and more than one-third of the providers being Asian [38].

Site B

The analysis was also conducted using data from the outpatient sites of an academic medical center (Site B) serving predominantly urban counties of northern California. Press-Ganey Medical Practice Survey data were obtained from March 2013 to August 2014. Site B has over 1500 physicians, oversees approximately 500,000 outpatient visits each year, and like Site A serves a patient population whose demographic characteristics reflect the local population with respect to age, sex, and R/E (42.4% White, 23.5% Latino/Hispanic, 6.4% African American, 23.0% Asian) [37]. Approval of this study was provided by the institutional review boards of both health organizations.

Patient Satisfaction survey

The Press-Ganey Medical Practice Survey is a commonly used proprietary measure of patient satisfaction [36], and it is composed of 24 core questions grouped into 6 subdomains that assess a patient’s rating of different aspects of care in the outpatient setting: access, moving through the visit, nurse/assistant, care provider, personal issues, and overall assessment. Responses are given using a 1–5 Likert scale, ranging from “very poor” to “very good.”

Sampling

Five randomly selected patients from each physician were selected each month and mailed surveys, with no more than one survey sent to a patient within 90 days. At Site B, surveys were also available to be completed electronically by patients through individual patient portal accounts (Site A: N = 216,293; Site B: N = 30,690).

The overall response rates of Site A (17.5%) and Site B (18.0–25.0%) are comparable to other published studies that have used Press-Ganey Medical Practice Survey [39,40,41,42,43]. R/E-specific response rates were available at Site A (NHW: 22.7%; Latino: 14.3%; African-American: 13.6%; Asian: 11.8%; Multiracial/Other Race: 11.9%; Missing/Unknown: 15.0%).

R/E variable

Patient age, sex, and R/E were extracted from electronic health records and linked to patient satisfaction data. Patient R/E was self-reported. The accuracy of data entry of self-reported patient R/E into electronic health records has been shown to be high, ranging from 92 to 97% [44]. R/E comparisons included NHW, Blacks, Latinos, and Asians. All other racial/ethnic groups (e.g., mixed race, Pacific Islanders) which constitute about 1% of the respondents, and those who did not report their race/ethnicity were grouped into the “Other/Unknown” category.

Data analysis

Score reporting

Press-Ganey survey results are typically reported through three ways: mean score, top-box score, or percentile rank [45]. Because survey responses were left-skewed, violating the linear regression requirement for all variables to be multivariate normal, top-box scoring was used to allow modeling of our outcome as a binary variable using logistic regression analyses. For consistency, we also descriptive and stratified analyses were also reported in terms of top-box scores. In final analyses stratified by panel percentage of Asians, however, mean scores were used in order to match corresponding national rankings provided by Press-Ganey.

Descriptive and stratified analyses

Differences in satisfaction scores by patient age, sex, and R/E were examined using chi-square tests. We focused on the care provider subdomain question “likelihood to recommend care provider,” since this question is typically used for physician assessment and compensation [20, 46,47,48,49].

Regression analyses

For each subdomain, differences in satisfaction scores based on respondent demographic characteristics were examined by performing multivariable logistic regression, adjusting for patient age, sex, and R/E. The outcome of interest was a top-box response (“very good” versus all other categories which included “good”, “fair”, “poor”, and “very poor”). Provider random effects, which use both within- and between-provider variation in the regression estimation, were used to take into account clustering across responses within each provider.

One question was selected from each subdomain to serve as the main assessment question. The questions chosen for analysis in each subdomain were as follows: access (ease of scheduling your appointment); moving through visit (wait time at clinic); nurse/assistant (friendliness/courtesy of the nurse/assistant); care provider (likelihood to recommend care provider); personal issues (our concern for your privacy); overall (likelihood of recommending this practice to others). This main assessment question chosen was that which was most closely associated in meaning with the subdomain overall and had no greater than 10% in missing response. The logistic regression model performed using data from Site A and Site B to assess if consistent R/E differences would be observed.

Analysis of provider scores and rankings, stratified by panel percentage of Asians

The impact of increasing percentage of Asian responses on provider scores was assessed by stratifying providers by panel percentages of Asian patients (defined as the proportion of surveys completed by Asian respondents) and comparing mean scores between strata for the subdomain question “likelihood to recommend care provider” [20, 46,47,48,49]. For ease of interpretation, the first three strata were cut by intervals of 10% (less than or equal to 10%, 11–20%, and 21–30%) and the fourth and last strata pooled the remaining 31–100% as 10% intervals in this range had very small stratums. In addition to calculating mean scores based on all respondents (regardless of R/E), mean scores based on only NHW and only Asian respondents were calculated. Mean scores were matched to corresponding national rankings provided by Press-Ganey (“A Press, Ganey Report: Medical Practice Means and Ranks,” 2012).

To match mean scores to national rankings provided by Press-Ganey, mean scores according to the scoring method utilized by Press-Ganey were calculated. A provider’s score was defined as an average of the subdomain scores. A subdomain score was an average of all question scores in the subdomain. A question score was given on a 0–100 scale, assigning 0, 25, 50, 75, and 100 to each response category.

Statistical analyses were performed using SAS and STATA. Hypothesis testing was two-tailed and evaluated at the p = 0.01 level.

Results

Site A. Ratings by Asian patients were 16.1 percentage points lower than those provided by NHW patients (p <  0.001) (Table 1). Ratings by Latino patients were 2.6 percentage points lower (p < 0.001), and ratings by Black patients were 1.4 percentage points lower (p < 0.001) relative to NHW patients. Ratings by female patients were 0.6 percentage points lower than those provided by male patients (p = 0.001). Relative to patients ages 18–44, ratings by patients ages 45–64 were 7.7 percentage points higher, and ratings by patients 65 and older were 10.3 percentage points higher (p <  0.001).

Table 1 Demographics characteristics of survey respondents and % top-box response for the subdomain question “likelihood to recommend care provider”
Full size table

The association between Asian patient R/E and lower top-box rating persisted across all subdomains after adjusting for patient age, sex, and provider random effects (Table 2). In Site A, Asian patients were 11.4 percentage points less likely than NHW patients to provide top-box rating for the overall assessment subdomain. Across subdomains, the difference in likelihood of top-box rating by Asian patients relative to NHW patients was smallest for the subdomain “access” and “care provider” (− 11.4 percentage points), greater for “overall” and “nurse/assistant” (− 14.0 and − 14.1 percentage points), and greatest for “moving” and “personal” (− 14.6 and − 15.3 percentage points). The predicted probabilities for the Asian patient R/E covariate were all significantly different from those for the NHW patient R/E covariate (p <  0.001).

Table 2 Multivariable analysis results showing the predicted probability (95% CI) of a patient of particular sex, age, or R/E providing a top-box response for each survey subdomain
Full size table

The positive association between age and top-box rating also persisted after adjustment. The association with patient sex was not as strong as those for older age and Asian patient R/E, with few subdomains exhibiting statistically significant differences in predicted probabilities between the two sexes. For the overall assessment subdomain, patient sex was not significantly associated with top-box rating.

Site B. Demographic differences found in Site A were also observed in Site B. Asian patients had the greatest score difference relative to NHW patients, with ratings that were 10.0 percentage points lower than those provided by NHW patients (p < 0.001) (Table 1). Ratings by Latino patients were 1.0 percentage points lower (p = NS), and ratings by Black patients were 5.0 percentage points lower (p = 0.003) relative to NHW patients. Ratings by female patients were 1.8 percentage points lower than those provided by male patients (p < 0.001). Relative to people ages 18–44, ratings by patients ages 45–64 were 7.3 percentage points higher and ratings by patients ages 65 and older were 7.5 percentage points higher (p < 0.001; p < 0.001).

As with Site A, the NHW-Asian difference in rating in Site B persisted across all subdomains after adjusting for patient age, sex, and provider random effects (Table 2). In Site B, Asian patients were less likely than NHW patients by 12.5 percentage points to provide top-box rating for the overall assessment subdomain. Furthermore, similar trends in predicted probabilities across subdomains for the Asian patient R/E covariate were also observed in Site B. Across subdomains, the difference in likelihood of top-box rating by Asian patients relative to NHW patients was smallest for the subdomain “care provider” (− 10.3 percentage points), greater for “access” and “overall” (− 12.5 and − 12.6 percentage points), and greatest for “personal,” “nurse” and “moving” (− 14.0, − 14.2, and − 14.4 percentage points). The predicted probabilities for the Asian patient R/E covariate were all significantly different from those for the NHW patient R/E covariate (p <  0.001). Similar findings were also observed in Site B with regards to patient age and sex.

Similar trends in predicted probabilities were observed between Site A and B for the care provider subdomain question, which is frequently used for physician assessment and compensation (Fig. 1). In particular, the predicted probabilities of Asian patients providing top-box rating were similar between Site A and Site B (Site A: predicted probability (PP) 0.718, 95% confidence interval (CI): 0.713–0.723; Site B: PP 0.759, 95% CI: 0.757–0.760).

Fig. 1
figure 1

Bar chart visualizing the predicted probability (95% CI) in Site A and Site B of a patient of particular sex, age, or R/E providing a top-box response for the subdomain question “likelihood to recommend care provider.” Significantly different from reference group *p < 0.01, ***p < 0.001

Full size image

Analysis of provider Scores and rankings, stratified by panel percentage of Asian patients

Plotting percentage of Asians in a provider’s panel against provider score for Site A demonstrated that overall provider score declines as the percentage of Asians in a provider’s panel increases (Fig. 2). When we only considering responses provided by either NHW or Asian patients alone, mean score does not significantly change as the percentage of Asians in a provider’s panel increases (p = 0.1437 and p = 0.0269, respectively). However, when considering responses from all respondents regardless of R/E, the mean score significantly declines as the percentage of Asians in a provider’s panel increases (p <  0.00001). Similar trends were observed in Site B.

Fig. 2
figure 2

The impact of Asian patient R/E on provider satisfaction score and national ranking. The Press-Ganey mean satisfaction scores (1–100) and respective national rankings (note right-hand side vertical axis of close-up) for providers with varying percentages of Asian patients, considering responses from only Non-Hispanic White patients, and only Asian patients, and all patients regardless of race. Bars indicate 95% CI. Data based on the original site (Site A)

Full size image

Collectively considering responses from Asian and NHW patients, an increase in the percentage of Asian patients in a provider’s panel from low (3–10%) to high (> 30%) is associated with a 40% drop in national ranking, from 58th to 18th percentile (Fig. 2, right-hand side vertical axis of close-up).

Discussion

We found that Asian patients, compared to NHW patients, were less likely to give the highest rating on satisfaction surveys, even after adjusting for patient age, patient sex, and provider random effects. This Asian-NHW difference in rating was observed in two different outpatient settings with high densities of Asian patients – a non-profit organization of community-based clinics and an academic medical center located in northern California. The effect of Asian R/E was stronger than effects observed for patient sex or age, two factors for which patient satisfaction scores are commonly adjusted when comparing providers [8, 11, 50,51,52].

We hypothesize that the observed Asian-NHW rating difference is more likely due to R/E differences in survey response than differential care. It has been consistently observed that Asians are less likely to select extremes and less likely to choose top-box responses to surveys [17, 53,54,55]. This effect is exaggerated when questions are rated subjectively using Likert-type scales [56,57,58]. Despite providing lower satisfaction ratings, Asian patients are not more likely to change providers, indicating that lower ratings may not necessarily imply greater dissatisfaction with care [27, 30]. Our hypothesis is strongly supported by a study evaluating patient satisfaction in an objectively quantifiable domain—wait time. Given the same wait time for an office visit, Asian patients were found to perceive longer wait time and be less satisfied with wait time compared to NHW patients [59]. The Asian-NHW rating difference is also observed in other domains such as life satisfaction. Asians express lower levels of overall life satisfaction than NHWs, despite greater educational attainment and income which are known to be correlated with life satisfaction [60]. Together, these findings suggest that the observed lower satisfaction ratings provided by Asian patients may be due to R/E differences in survey response and that scores should be adjusted for Asian patient R/E to prevent inaccurate comparison of satisfaction scores across providers.

We showed that providers with higher percentages of Asian patients have markedly lower rankings than providers with lower percentages of Asian patients (Fig. 2, close-up). This is consistent a study showing that lower CAHPS patient experience ratings in California (which has the second highest Asian population in the U.S.) compared to the rest of the nation are primarily driven by lower ratings provided by Asians compared to other R/E groups in California; this rating difference disappears only after adjusting for several variables including race/ethnicity [13]. Whether it be at the provider-level or state-level, the satisfaction scores of provider serving regions with larger Asian populations may be disproportionately affected by the Asian-NHW patient rating difference.

The decision to adjust for R/E when using patient satisfaction as a metric is contingent on whether Asian patients are actually receiving inferior care. If so, adjustment should be avoided to prevent erasing meaningful differences in patient satisfaction. However, given evidence that Asian patients are not receiving inferior care, adjustment can be considered for physicians caring for more than or equal to 10% Asians or when the difference in panel percentage of Asian patients is 10% between the highest and lowest providers. When comparing responses from all patients regardless of R/E with responses from only NHW patients, mean scores are significantly different at an alpha level of 0.05 for panel percentages greater than 3–10% (Supplemental Table 1). However, it is important to remember that adjustment is not an either/or decision; administrators can examine both race-adjusted and unadjusted data to determine how to best utilize results.

Limitations

A few limitations should be considered when interpreting the results of the study. One limitation is that the region under study has a larger Asian population than other parts of the country, and that the observed Asian-NHW rating difference may not be found in areas with smaller Asian populations. However, if is true that the Asian-NHW rating difference is driven by R/E difference in survey response, and that this rating difference is only observed in areas with larger Asian populations, then accounting for this rating difference should have even greater relevance when using national rankings to compare providers across populations with varying percentages of Asians.

Low response rates of 17.5% and 18.0–25.0% for Sites A and B, respectively, pose a second limitation and could potentially bias our results. However, our “real-world” response rates are comparable to those reported elsewhere and in studies that have used the same Press-Ganey Medical Practice Survey [39,40,41,42]. The fact that low response rates are commonly observed for Press-Ganey satisfaction surveys underscores the importance of studying survey response and its effect on providers’ scores. Furthermore, it is important to remember that even if patient satisfaction scores may not necessarily be a “true” measure of provider performance (due to low response rates or other factors), they are considered “true” in the eyes of the hospital and reimbursement systems that currently utilize them. Therefore, it is important to study patient satisfaction scores and base adjustment decisions within the settings in which these patient satisfaction surveys are implemented.

Variation in response rates among R/E groups is also a potential source of bias. Compared to the local population, the survey respondents had a higher percentage of NHWs and lower percentage of Asians, Latino/Hispanics, and African Americans. Despite this information, we cannot make any conclusions about directionality of R/E-specific response biases (i.e. whether the NHWs that responded were more satisfied than the average NHW or whether Asians that responded were less happy than the average Asian). R/E-specific survey response rates have been found to vary depending on survey mode, length of questionnaire, survey language, and cultural sensitivity [61]. More work is needed to understand R/E-specific survey response behaviors and to create surveys that more representatively sample R/E minority groups.

Our inability to assess differences in quality of care is another limitation of the study. We cannot exclude the possibility that Asians were provided lower quality care. However, studies investigating R/E differences in quality of care in terms of clinical measures can provide additional insight as to whether Asians are truly receiving inferior care compared to other R/E groups. Asian patients enrolled in Medicare+Choice have been found to receive equal or better frequency of care compared to NHW patients for mammograms, use of beta-blockers, diabetes care, and testing for cholesterol and blood pressure [62]. However, Asian patients enrolled in traditional Medicare have also been found to be less likely than NHW patients to receive screening and diabetic services in several major metropolitan statistical areas with large Asian populations [63]. In terms of clinical outcomes, Asian patients enrolled in Medicare+Choice have been found to have lower blood pressure, lower cholesterol levels, and similar glycated hemoglobin levels compared to NHW patients even after adjustment for age and sex [64]. Together, these studies suggest that difference in quality of care between Asians and NHWs may depend on various factors, such as health plan and region. More work is needed to define “quality of care” and determine what measures appropriately capture its differences among R/E groups.

Data on Asian subgroups, language spoken, degree of acculturation, and immigration status at both sites were limited, preventing finer examination of the effect of Asian R/E. Primary care experience has been found to vary among Asian subgroups and between native and non-native Asian speakers of English [34, 65] and sampling bias has been shown to promote overrepresentation of English-speaking and well-acculturated Asians in surveys [66]. When surveyed about life satisfaction, U.S.-born Asians are less likely than foreign-born Asians to be “very happy” as opposed to “pretty happy” [60]. It is possible that this observed Asian-NHW rating difference is a result of one or more Asian subgroups with greater language fluency and acculturation masking less represented subgroups. As a result, findings from our study might be generalizable to the Asian population in northern California broadly consisting of the largest Asian subgroups (Chinese, Asian Indian, Vietnamese, Filipino, Korean, Japanese) with higher education, English fluency, and income compared to the Asian population in Minnesota which is drawn narrowly from one of the largest Hmong communities in the U.S. [67] With a majority of studies on this topic being conducted through secondary data analysis, there is a need to improve coding of R/E, linguistic, and acculturation information in health surveys to enable more disaggregated analyses in the future.

Conclusion

Asian patients were less likely than NHW patients to provide top-box rating for the Press-Ganey Medical Practice Survey, even after adjusting for age, sex, and provider random effects. Existing literature showing that Asians tend to select less extreme responses suggests that the Asian-NHW difference in rating may be due to R/E differences in survey response rather than differential care. Therefore, providers with higher panel percentages of Asian patients may be unduly penalized in their satisfaction scores, an effect that is further exaggerated in the ranking context. When compensation incentives are based on patient satisfaction results and R/E composition varies across providers, scores may need to be adjusted for Asian patient R/E to avoid penalizing providers with higher panel percentages of Asian patients.

Availability of data and materials

The datasets used and/or analyzed during the current study are available from the corresponding author on reasonable request.

Abbreviations

R/E:

Race/ethnicity

NHW:

Non-Hispanic white

CAHPS:

Consumer Assessment of Healthcare Providers and Systems

PP:

Predicted probability

CI:

Confidence interval

References

  1. Scott A, Sivey P, Ait Ouakrim D, Willenberg L, Naccarella L, Furler J, et al. The effect of financial incentives on the quality of health care provided by primary care physicians. Cochrane Database Syst Rev. 2011;(9):CD008451.

  2. Rangel C. H.R.3590 - 111th Congress (2009–2010): Patient Protection and Affordable Care Act. 2010 [cited 2018 Jul 6]; Available from: https://www.congress.gov/bill/111th-congress/house-bill/3590.

  3. Burgess M. H.R.4015 - 113th Congress (2013–2014): SGR Repeal and Medicare Provider Payment Modernization Act of 2014. 2014 [cited 2018 Jul 6]; Available from: https://www.congress.gov/bill/113th-congress/house-bill/4015.

  4. MGMA Physician Compensation and Production Survey: 2014 Report Based on 2013 Data Key Findings Summary Report [Internet]. [cited 2018 Jul 25]. Available from: https://cdn.ymaws.com/welcome.ahsnet.org/resource/resmgr/2016_Scottsdale_Headache_Symposium/Handouts/Thursday/Parikh-Neil_Running-the-Prac.pdf.

  5. Cooper-Patrick L, Gallo JJ, Gonzales JJ, Vu HT, Powe NR, Nelson C, et al. Race, gender, and partnership in the patient-physician relationship. JAMA [Internet]. 1999;282(6):583–9 Available from: http://www.ncbi.nlm.nih.gov/pubmed/10450723.

    Article  CAS  Google Scholar 

  6. Young GJ, Meterko M, Desai KR. Patient satisfaction with hospital care: effects of demographic and institutional characteristics. Medical Care. 2000;38:325–34.

  7. Campbell JL, Ramsay J, Green J. Age, gender, socioeconomic, and ethnic differences in patients’ assessments of primary health care. Qual Health Care [Internet]. 2001;10(2):90–5 Available from: http://www.pubmedcentral.nih.gov/articlerender.fcgi?artid=1757978&tool=pmcentrez&rendertype=abstract.

    Article  CAS  Google Scholar 

  8. Rahmqvist M. Patient satisfaction in relation to age, health status and other background factors: a model for comparisons of care units. Int J Qual Heal Care. 2001;13(5):385–90.

    Article  CAS  Google Scholar 

  9. Barr DA. Race/ethnicity and Patient Satisfaction. J Gen Intern Med. 2004;19:937–43.

    Article  PubMed  PubMed Central  Google Scholar 

  10. O’Malley AJ, Zaslavsky AM, Elliott MN, Zaborski L, Cleary PD. Case-Mix Adjustment of the CAHPS® Hospital Survey. Health Serv Res. 2005;40(6p2):2162–81 [cited 2018 Jul 6] Available from: http://www.ncbi.nlm.nih.gov/pubmed/16316443.

    Article  PubMed  PubMed Central  Google Scholar 

  11. Xiao H, Barber JP. The effect of perceived health status on patient satisfaction. Value Heal. 2008;11(4):719–25.

    Article  Google Scholar 

  12. Elliott MN, Zaslavsky AM, Goldstein E, Lehrman W, Hambarsoomians K, Beckett MK, et al. Effects of Survey Mode, Patient Mix, and Nonresponse on CAHPS ® Hospital Survey Scores. Health Serv Res. 2009;44(2p1):501–18 [cited 2018 Jul 6] Available from: http://www.ncbi.nlm.nih.gov/pubmed/19317857.

    Article  PubMed  PubMed Central  Google Scholar 

  13. Zweifler J, Hughes S, Lopez RA. Controlling for race/ethnicity: a comparison of California commercial health plans CAHPS scores to NCBD benchmarks. Int J Equity Health [Internet]. 2010 Jan 25 [cited 2018 Jul 6];9(1):4. Available from: http://www.ncbi.nlm.nih.gov/pubmed/20181011.

  14. Farley DO, Elliott MN, Haviland AM, Slaughter ME, Heller A. Understanding Variations in Medicare Consumer Assessment of Health Care Providers and Systems Scores: California as an Example. Health Serv Res [Internet]. 2011 Oct [cited 2018 Jul 6];46(5):1646–62. Available from: http://www.ncbi.nlm.nih.gov/pubmed/21644970.

  15. Hausmann LRM, Gao S, Mor MK, Schaefer JH, Fine MJ. Understanding racial and ethnic differences in patient experiences with outpatient health care in veterans affairs medical centers. Med Care [Internet]. 2013;51(6):532–9 Available from: http://www.ncbi.nlm.nih.gov/pubmed/23673395.

    Article  Google Scholar 

  16. Martino SC, Elliott MN, Hambarsoomian K, Weech-Maldonado R, Gaillot S, Haffer SC, et al. Racial/Ethnic Disparities in Medicare Beneficiaries’ Care Coordination Experiences. Med Care [Internet]. 2016 Aug [cited 2018 Jul 6];54(8):765–71. Available from: http://www.ncbi.nlm.nih.gov/pubmed/27116106.

  17. Mayer LA, Elliott MN, Haas A, Hays RD, Weinick RM. Less Use of Extreme Response Options by Asians to Standardized Care Scenarios May Explain Some Racial/Ethnic Differences in CAHPS Scores. Med Care [Internet]. 2016 Jan [cited 2018 Jul 6];54(1):38–44. Available from: http://www.ncbi.nlm.nih.gov/pubmed/26783857.

  18. Centers for Medicare and Medicaid Services. MA &amp; PDP CAHPS: Variables Used as Case-Mix Adjustors, 1998-2017. 2017 [cited 2018 Jul 9]; Available from: https://www.ma-pdpcahps.org/globalassets/ma-pdp/case-mix-adjustment/case-mix_1998_2017_pdf.pdf.

  19. Seth W. Glickman, MD, MBA; and Kevin A. Schulman M. The Mis-Measure of Physician Performance. [cited 2017 Sep 7]; Available from: http://bivarus.com/wp-content/uploads/2014/09/The-Mis-Measure-of-Physician-Performance.pdf.

  20. Halbesleben JRB, Rathert C. Linking physician burnout and patient outcomes: exploring the dyadic relationship between physicians and patients. Health Care manage rev [Internet]. 2008;33(1):29–39. Available from: http://www.ncbi.nlm.nih.gov/pubmed/18091442.

  21. Ratanawongsa N, Roter D, Beach MC, Laird SL, Larson SM, Carson KA, et al. Physician Burnout and Patient-Physician Communication During Primary Care Encounters. J Gen Intern Med [Internet]. 2008 Oct 10 [cited 2018 Jul 9];23(10):1581–8. Available from: http://link.springer.com/10.1007/s11606-008-0702-1.

  22. Anagnostopoulos F, Liolios E, Persefonis G, Slater J, Kafetsios K, Niakas D. Physician Burnout and Patient Satisfaction with Consultation in Primary Health Care Settings: Evidence of Relationships from a one-with-many Design. J Clin Psychol Med Settings [Internet]. 2012 Dec 11 [cited 2018 Jul 9];19(4):401–10. Available from: http://www.ncbi.nlm.nih.gov/pubmed/22327237.

  23. Dewa CS, Loong D, Bonato S, Trojanowski L. The relationship between physician burnout and quality of healthcare in terms of safety and acceptability: a systematic review. BMJ Open [Internet]. 2017 Jun 21 [cited 2018 Jul 9];7(6):e015141. Available from: http://www.ncbi.nlm.nih.gov/pubmed/28637730.

  24. Agency for Healthcare Research and Quality. Instructions for Analyzing Data from CAHPS® Surveys: Using the CAHPS Analysis Program Version 4.1. [cited 2018 Jul 9]; Available from: www.ahrq.gov/cahps/.

  25. Fenton JJ, Jerant A, Kravitz RL, Bertakis KD, Tancredi DJ, Magnan EM, et al. Reliability of Physician-Level Measures of Patient Experience in Primary Care. J Gen Intern Med [Internet]. 2017 Dec 12 [cited 2018 Jul 6];32(12):1323–9. Available from: http://www.ncbi.nlm.nih.gov/pubmed/28900821.

  26. Hatfield LA, Zaslavsky AM. Implications of Variation in the Relationships between Beneficiary Characteristics and Medicare Advantage CAHPS Measures. Health Serv Res [Internet]. 2017 Aug [cited 2018 Jul 6];52(4):1310–29. Available from: http://www.ncbi.nlm.nih.gov/pubmed/27500888.

  27. Ngo-Metzger Q, ATR L, Phillips RS. Asian Americans’ reports of their health care experiences: Results of a national survey. J Gen Int Med. 2004;19:111–9.

  28. Taira DA, Safran DG, Seto TB, Rogers WH, Kosinski M, Ware JE, et al. Asian-American patient ratings of physician primary care performance. J Gen Intern Med. 1997;12(4):237–42.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  29. Murray-García JL, Selby JV, Schmittdiel J, Grumbach K, Quesenberry CP. Racial and ethnic differences in a patient survey: patients’ values, ratings, and reports regarding physician primary care performance in a large health maintenance organization. Med Care [Internet]. 2000;38(3):300–10 Available from: http://www.ncbi.nlm.nih.gov/pubmed/10718355.

    Article  Google Scholar 

  30. Saha S, Hickam DH. Explaining low ratings of patient satisfaction among Asian-Americans. Am J Med Qual [Internet]. 2003;18(6):256–64 Available from: http://www.ncbi.nlm.nih.gov/pubmed/14738037.

    Article  Google Scholar 

  31. van Zanten M, Boulet JR, McKinley DW. The influence of ethnicity on patient satisfaction in a standardized patient assessment. Acad Med [Internet]. 2004;79(10 Suppl):S15–7 Available from: http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?cmd=Retrieve&db=PubMed&dopt=Citation&list_uids=15383378.

    Article  Google Scholar 

  32. Mead N, Roland M. Understanding why some ethnic minority patients evaluate medical care more negatively than white patients: a cross sectional analysis of a routine patient survey in English general practices. BMJ. 2009;339:b3450.

    Article  PubMed  PubMed Central  Google Scholar 

  33. Kontopantelis E, Roland M, Reeves D. Patient experience of access to primary care: identification of predictors in a national patient survey. BMC Fam Pract. 2010;11:61 Available from: http://www.ncbi.nlm.nih.gov/pubmed/20799981%5Cnhttp://www.pubmedcentral.nih.gov/articlerender.fcgi?artid=PMC2936332.

    Article  PubMed  PubMed Central  Google Scholar 

  34. Lyratzopoulos G, Elliott M, Barbiere JM, Henderson A, Staetsky L, Paddison C, et al. Understanding ethnic and other socio-demographic differences in patient experience of primary care: evidence from the English general practice Patient survey. BMJ Qual Saf [Internet]. 2012;21(1):21–9 Available from: http://qualitysafety.bmj.com/content/21/1/21.

    Article  CAS  Google Scholar 

  35. CAHPS Clinician &amp; Group Survey | Agency for Healthcare Research &amp; Quality [Internet]. [cited 2018 Jul 9]. Available from: https://www.ahrq.gov/cahps/surveys-guidance/cg/index.html.

  36. Graham B, Green A, James M, Katz J, Swiontkowski M. Measuring Patient Satisfaction in Orthopaedic Surgery. J Bone Jt Surgery-American Vol [Internet]. 2014 Jan 7 [cited 2018 Jul 9];97(1):80–4. Available from: http://www.ncbi.nlm.nih.gov/pubmed/25568398.

  37. Bay Area Census -- Bay Area Data [Internet]. [cited 2018 Jul 10]. Available from: http://www.bayareacensus.ca.gov/bayarea.htm.

  38. Garcia LC, Chung S, Liao L, Altamirano J, Fassiotto M, Maldonado B, et al. Comparison of Outpatient Satisfaction survey Scores for Asian physicians and non-Hispanic white physicians. JAMA Netw Open. 2019 Feb 1;2(2):e190027.

    Article  PubMed  PubMed Central  Google Scholar 

  39. Tyser AR, Abtahi AM, McFadden M, Presson AP. Evidence of non-response bias in the Press-Ganey patient satisfaction survey. BMC Health Serv Res. 2016;16(a):350.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  40. Olsen JC, Olsen EC. Patient satisfaction in the emergency department and the use of business cards by physicians. J Emerg Med. 2012;42(3):317–21.

    Article  PubMed  Google Scholar 

  41. Rhee KJ, Bird J. Perceptions and satisfaction with emergency department care. J Emerg Med. 1996;14(6):679–83.

    Article  PubMed  CAS  Google Scholar 

  42. Etier BE, Orr SP, Antonetti J, Thomas SB, Theiss SM. Factors impacting Press Ganey patient satisfaction scores in orthopedic surgery spine clinic. Spine J. 2016;16(11):1285–9.

    Article  PubMed  Google Scholar 

  43. Li SS, Herrick NL, Deshpande RR, Cronin BJ, Reid CM, Brandel MG, et al. The Impact of Residents on Patient Satisfaction. Ann Plast Surg [Internet]. 2018 Feb [cited 2018 Jul 9];80(5S Suppl 5):1. Available from: http://www.ncbi.nlm.nih.gov/pubmed/29401130.

  44. Azar KMJ, Moreno MR, Wong EC, Shin JJ, Soto C, Palaniappan LP. Accuracy of data entry of patient race/ethnicity/ancestry and preferred spoken language in an ambulatory care setting. Health Serv Res. 2012;47(1 PART 1):228–40.

    Article  PubMed  Google Scholar 

  45. Scoring Quick Guide for Quick Reports Rank, Top Box or Mean Score? 2013 [cited 2018 Jul 9]; Available from: https://helpandtraining.pressganey.com/lib-docs/default-source/ip-training-resources/Scoring_Quick_Guide_for_Quick_Reports.pdf?sfvrsn=0.

  46. A Proposed Quality Report Card for Boards. [cited 2018 Jul 9]; Available from: http://images.healthcare.pressganey.com/Web/PressGaneyAssociatesInc/%7B613ee39c-87aa-46a1-8b2b-96a01f7d52e3%7D_PG_White_Paper_Board_Report_Card.pdf.

  47. Strategies for Improving the Patient Experience | Stanford Health Care [Internet]. [cited 2018 Jul 9]. Available from: https://stanfordhealthcare.org/health-care-professionals/medical-staff/medstaff-update/2013-february/201302-strategies-for-improving-the-patient-experience.html.

  48. Nichol JR, Fu R, French K, Momberger J, Handel DA. Association Between Patient and Emergency Department Operational Characteristics and Patient Satisfaction Scores in a Pediatric Population. Pediatr Emerg Care [Internet]. 2016 Mar [cited 2018 Jul 9];32(3):139–41. Available from: http://www.ncbi.nlm.nih.gov/pubmed/26928092.

  49. Rogo-Gupta LJ, Haunschild C, Altamirano J, Maldonado YA, Fassiotto M. Physician Gender Is Associated with Press Ganey Patient Satisfaction Scores in Outpatient Gynecology. Women’s Heal Issues [Internet]. 2018 May [cited 2018 Jul 9];28(3):281–5. Available from: http://www.ncbi.nlm.nih.gov/pubmed/29429946.

  50. Hargraves JL, Wilson IB, Zaslavsky A, James C, Walker JD, Rogers G, et al. Adjusting for patient characteristics when analyzing reports from patients about hospital care. Med Care. 2001;39(6):635–41.

    Article  PubMed  CAS  Google Scholar 

  51. Nguyen Thi PL, Briançon S, Empereur F, Guillemin F. Factors determining inpatient satisfaction with care. Soc Sci Med. 2002;54(4):493–504.

    Article  PubMed  Google Scholar 

  52. Quintana JM, González N, Bilbao A, Aizpuru F, Escobar A, Esteban C, et al. Predictors of patient satisfaction with hospital health care. BMC Health Serv Res. 2006;6:102.

    Article  PubMed  PubMed Central  Google Scholar 

  53. Chen C, Lee S-Y, Stevenson HW. Response style and cross-cultural comparisons of rating scales among east Asian and north American students. Psychol Sci [Internet]. 1995;6(3):170–5 Available from: http://www.jstor.org/stable/40063010.

    Article  Google Scholar 

  54. Lee JW, Jones PS, Mineyama Y, Zhang XE. Cultural differences in responses to a Likert scale. Res Nurs Health. 2002;25(4):295–306.

    Article  PubMed  Google Scholar 

  55. Reynolds N, Smith A. Assessing the Impact of Response Styles on Cross-Cultural Service Quality Evaluation: A Simplified Approach to Eliminating the Problem. J Serv Res. 2010;13:230–43.

    Article  Google Scholar 

  56. Thissen-Roe A, Thissen D. A two-decision model for responses to Likert-type items. J Educ Behav Stat [Internet]. 2013;38(5):522–47 Available from: http://jeb.sagepub.com/cgi/doi/10.3102/1076998613481500%5Cnhttp://jeb.sagepub.com/content/early/2013/03/28/1076998613481500.abstract%5Cnhttp://jeb.sagepub.com/cgi/doi/10.3102/1076998613481500.

    Article  Google Scholar 

  57. Van Vaerenbergh Y, Thomas TD. Response styles in survey research: A literature review of antecedents, consequences, and remedies. Int J Public Opin Res. 2013;25:195–217.

  58. Böckenholt U. Measuring response styles in Likert items. Psychol Methods [Internet]. 2017;22(1):69–83 Available from: http://doi.apa.org/getdoi.cfm?doi=10.1037/met0000106.

    Article  Google Scholar 

  59. Chung S, Johns N, Zhao B, Romanelli R, Pu J, Palaniappan LP, et al. Clocks Moving at Different Speeds. Med Care [Internet]. 2016 Mar [cited 2017 Aug 28];54(3):269–76. Available from: http://content.wkhealth.com/linkback/openurl?sid=WKPTLP:landingpage&an=00005650-201603000-00008.

  60. Sakamoto A, Chiu C-T, Li J, Wang SX. The Life Satisfaction of Asian Americans: Evidence from the U.S. General Social Survey, 1972 to 2010. Sociol Mind [Internet]. 2016;06(02):40–52 [cited 2018 Jul 10] Available from: http://www.scirp.org/journal/doi.aspx? DOI=10.4236/sm.2016.62003.

    Article  Google Scholar 

  61. Sykes LL, Walker RL, Ngwakongnwi E, Quan H. A systematic literature review on response rates across racial and ethnic populations. Can J Public Health [Internet]. [cited 2018 Jul 25];101(3):213–9. Available from: http://www.ncbi.nlm.nih.gov/pubmed/20737812.

  62. Virnig BA, Lurie N, Huang Z, Musgrave D, McBean AM, Dowd B. Racial Variation In Quality Of Care Among Medicare+Choice Enrollees. Health Aff [Internet]. 2002 Nov 17 [cited 2018 Jul 10];21(6):224–30. Available from: http://www.healthaffairs.org/doi/10.1377/hlthaff.21.6.224.

  63. Moy E, Greenberg LG, Borsky AE. Community Variation: Disparities In Health Care Quality Between Asian And White Medicare Beneficiaries. Health Aff [Internet]. 2008 Mar 2 [cited 2018 Jul 9];27(2):538–49. Available from: http://www.healthaffairs.org/doi/10.1377/hlthaff.27.2.538.

  64. Ayanian JZ, Landon BE, Newhouse JP, Zaslavsky AM. Racial and Ethnic Disparities among Enrollees in Medicare Advantage Plans. N Engl J Med. 2014;371(24):2288–97 [cited 2018 Jul 9] Available from: http://www.ncbi.nlm.nih.gov/pubmed/25494268.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  65. Hughes D. Quality of Health Care for Asian Americans: Findings from The Commonwealth Fund 2001 Health Care Quality Survey [Internet]. [cited 2018 Jul 10]. Available from: http://www.aapcho.org/wp/wp-content/uploads/2012/02/CommonwealthFund-QualityofHealthCareforAAs.pdf.

  66. Kim W, Keefe RH, ACSW. Social Work in Public Health. Soc Work Public Health [Internet]. 2010 [cited 2018 Jul 10];25(3–4):286–95. Available from: http://www.tandfonline.com/action/journalInformation?journalCode=whsp20.

  67. U.S. Census Bureau. Profile of General Population and Housing Characteristics: 2010, 2010 Demographic Profile Data, Table DP-1 [Internet]. [cited 2018 Jul 11]. Available from: https://factfinder.census.gov/.

Download references

Acknowledgements

We would like to thank Merisa Kline, Carlos Montalvo, Stanford School of Medicine’s Office of Academic Affairs, and Elizabeth Otto Hamel for their additional administrative, technical, and material support.

Funding

Not applicable.

Author information

Authors and Affiliations

  1. Department of Health Research and Policy, Stanford University School of Medicine, Stanford, USA

    Lillian Liao

  2. Department of Medicine, Stanford University School of Medicine, Stanford, USA

    Lillian Liao, Paul Heidenreich & Latha Palaniappan

  3. Columbia University Vagelos College of Physicians and Surgeons, 50 Haven Avenue Box #B-26, New York, NY10032, USA

    Lillian Liao

  4. Palo Alto Medical Foundation Research Institute, Palo Alto, USA

    Sukyung Chung

  5. Office of Faculty Development and Diversity, Stanford University School of Medicine, Stanford, USA

    Jonathan Altamirano, Luis Garcia, Magali Fassiotto & Bonnie Maldonado

Authors
  1. Lillian Liao
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Sukyung Chung
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jonathan Altamirano
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Luis Garcia
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Magali Fassiotto
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Bonnie Maldonado
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Paul Heidenreich
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Latha Palaniappan
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

LL and SC had full access to all the data in the study and take responsibility for the integrity of the data and accuracy of the data analysis. All authors contributed to the conceptualizing and designing of the study. LL, SC, LG, JA, MF, PH, and LP contributed to the acquisition, analysis, and interpretation of the data. LL, SC, JA, and LP contributed to the drafting of the manuscript. All authors contributed to the critical revision of the manuscript for important intellectual content. LL, SC, and JA contributed to statistical analysis. LL and LP contributed to administrative, technical, and material support. LL, LP, MF, PH, and BM contributed to the overall supervision of this study. All authors have read and approved the manuscript.

Corresponding author

Correspondence to Lillian Liao.

Ethics declarations

Ethics approval and consent to participate

Approval for this study was provided by the institutional review boards at the Palo Alto Medical Foundation Research Institute and Stanford University School of Medicine. The need for informed consent was waived because the data were de-identified.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary information

Additional file 1: Table S1.

The Press-Ganey mean satisfaction scores (1–100) for providers with varying percentages of Asian patients, considering responses from only Non-Hispanic White patients, and only Asian patients, and all patients regardless of race. These values correspond to those shown in Fig. 2. Data based on the original site (Site A).

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Liao, L., Chung, S., Altamirano, J. et al. The association between Asian patient race/ethnicity and lower satisfaction scores. BMC Health Serv Res 20, 678 (2020). https://doi.org/10.1186/s12913-020-05534-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12913-020-05534-6

Keywords

BMC Health Services Research

ISSN: 1472-6963

Contact us