Skip to main content
Download PDF

Patients’ perspective on supposedly patient-relevant process and outcome parameters: a cross-sectional survey within the ‘PRO patients study’

BMC Health Services Research volume 22, Article number: 72 (2022) Cite this article

Abstract

Background

To be able to make informed choices based on their individual preferences, patients need to be adequately informed about treatment options and their potential outcomes. This implies that studies measure the effects of care based on parameters that are relevant to patients. In a previous scoping review, we found a wide variety of supposedly patient-relevant parameters that equally addressed processes and outcomes of care. We were unable to identify a consistent understanding of patient relevance and therefore aimed to develop an empirically based concept including a generic set of patient-relevant parameters. As a first step we evaluated the process and outcome parameters identified in the scoping review from the patients’ perspective.

Methods

We conducted a cross-sectional survey among German general practice patients. Ten research practices of Witten/Herdecke University supported the study. During a two-week period in the fall of 2020, patients willing to participate self-administered a short questionnaire. It evaluated the relevance of the 32 parameters identified in the scoping review on a 5-point Likert scale and offered a free-text field for additional parameters. These free-text answers were inductively categorized by two researchers. Quantitative data were analyzed using descriptive statistics. Bivariate analyses were performed to determine whether there are any correlations between rating a parameter as highly relevant and patients’ characteristics.

Results

Data from 299 patients were eligible for analysis. All outcomes except ‘sexuality’ and ‘frequency of healthcare service utilization’ were rated important. ‘Confidence in therapy’ was rated most important, followed by ‘prevention of comorbidity’ and ‘mobility’. Relevance ratings of five parameters were associated with patients’ age and gender, but not with their chronic status. The free-text analysis revealed 15 additional parameters, 12 of which addressed processes of care, i.e., ‘enough time in physician consultation’.

Conclusion

Patients attach great value to parameters addressing processes of care. It appears as though the way in which patients experience the care process is not less relevant than what comes of it. Relevance ratings were not associated with chronic status, but few parameters were gender- and age-related.

Trial registration

Core Outcome Measures in Effectiveness Trials Initiative, registration number: 1685.

Peer Review reports

Background

Patient-centered care implies that patients, their values, preferences, and individual life and health goals are at the heart of care processes and that patients are involved in care decisions [1]. To be able to make a choice based on personal preferences, patients need to be adequately informed about care options and their potential effects, understand the different options, and explore what is most relevant for them [2]. To facilitate this goal, studies must examine the effects of care based on parameters that matter to patients and thereby enable them to make an informed decision.

Recent systematic reviews conclude that outcomes relevant to patients are underrepresented in clinical trials [3,4,5]. Aiming to explore which parameters are thought to be particularly relevant to patients in current research, we conducted a scoping review on patient relevance that included clinical and epidemiological trials and reviews on such studies from the past 20 years [6]. Interestingly, only one third of the 44 studies analyzed actually applied patient-driven approaches to define and select parameters that are explicitly relevant to patients when designing the study [7,8,9,10,11,12,13,14,15,16,17,18,19,20]. All of these studies were conducted among specific patient groups. Studies addressing generic patient groups and not focusing on one specific disease were underrepresented [4, 5, 21,22,23,24,25,26,27,28,29]. Overall, the content analysis of the 44 studies yielded neither a consistent terminology or well-founded definition, nor a consistent set of parameters relevant to patients across diseases [6]. Instead, the parameters which were thought to be patient-relevant varied widely from typical clinical trial endpoints like morbidity, mortality, and quality of life, to softer social aspects like, for instance, participation or the ability to work or fulfil social roles. In total, 32 different categories of parameters which addressed processes of care as well as outcomes of care were identified [6]. Another recent review about the use of patient-reported outcomes in core outcome sets found that different outcome sets covered the same domains but recommended different instruments [30]. Even though patient-reported outcomes and patient-relevant outcomes might not necessarily be the same, the findings of both reviews demonstrate inconsistencies in effect measurement which limit the comparability of study results regarding the patient benefit.

In a larger-scale research project called ‘PRO patients study’ we therefore aim to achieve a consensus regarding a concept on patient relevance that is based on the recent literature, considers the patient’s perspective, and is feasible for scientific purposes [31]. This concept will determine the terminology that is most suitable to describe patient-relevant outcomes while also providing insights into the criteria that are appropriate to characterize outcomes relevant to patients in the sense of a definition. Hypothesizing that some parameters are relevant for all patients, regardless of their ailment, the concept will also include a prioritization of parameters that mostly represent generic patient relevance independently of diseases. Based on the results of grading outcomes and on the experiences made during the consensus process, an empirically based methodological framework on how to select and weigh parameters according to patients’ preferences will be derived in the long-term. This framework will be applicable and adaptable to different contexts and will consider not only the process of designing trials, but also that of shared decision-making [31]. Regarding shared decision-making it will help to individually prioritize trial outcomes from the patients’ perspective in order to facilitate the process of exploring what is most relevant for them as also described in other approaches [32, 33].

As a first step of the ‘PRO patients study’ we conducted a cross-sectional survey among German general practice patients to evaluate their views and beliefs concerning different general treatment outcomes that had been considered as relevant to patients in former clinical and epidemiological trials including reviews on such trials [6]. The aim of this survey presented in this paper is to gain insight into how patients evaluate and weigh the different outcome dimensions of medical treatments in order to contribute to an empirically based methodological concept of patient relevance in medical decision-making in the future.

Methods

This paper is reported in accordance with the STROBE statement [34]. It reports only on the first phase of the ‘PRO patients study’, which consists of four phases in total. Knowing that the outcomes extracted from former studies might not be exhausting, the results of the first phase will provide the basis for a multi-professional group discussion on patient-relevant outcomes in the second step, which will finally lead to a two-round online Delphi consensus process [31]. More details on the method of the whole ‘PRO patients study’ are published in a study protocol [31].

Study design

The study was designed as a cross-sectional survey.

Setting and participants

The survey was conducted among German general practice patients. Participants were required to be at least 18 years old and possess sufficient German language skills to answer a written questionnaire. No further inclusion and exclusion criteria were defined, as patients of different age, gender, and diseases were included. In order to obtain meaningful results, the minimum sample size was defined as 100.

Patients were recruited via teaching and research practices of the Chairs of General Practice of Witten/Herdecke University. These practices are affiliated with the University as they support research projects and students’ teaching. They do not, however, differ from other general practices in terms of patient care [35]. All 13 practices that attended the network meeting in the fall of 2020 were asked to support the study and were trained on how to conduct the survey within their practices. For each practice, data were collected during a two-week period between September 28th, 2020, and November 13th, 2020. During the data collection period, every fifth patient who visited their doctor for a scheduled appointment and met the inclusion criteria was asked to complete the survey. This specific procedure for selecting patients was chosen to prevent convenience sampling of patients by the practice teams. Furthermore, this approach aimed to make the recruitment process and the study conduct feasible for the practices as the questionnaires were completed in the practices’ waiting rooms whose capacities were limited due to the COVID-19 pandemic.

Variables and data sources

Patients willing to participate self-administered a three-page, anonymous questionnaire. The questionnaire was developed by the authors on the basis of the results from the previous scoping review [6]: All 32 patient-relevant parameters extracted from the clinical trials, epidemiological studies, and reviews analyzed in the scoping review were included in the questionnaire. In order to structure the questionnaire, the parameters were categorized into parameters related to body and mind (11 parameters), personality and social life (12 parameter), and diagnosis and care processes (9 parameters). Patients were asked to rate the overall relevance of each parameter from their individual perspective on a 5-point Likert scale ranging from ‘not relevant’ to ‘highly relevant’. Additionally, a free-text field provided the opportunity to add further relevant parameters. In the first pretest the reliability and validity of items and response categories were evaluated and discussed by the chair’s study group and further scientists of Witten/Herdecke University conducting research in the outpatient setting. After revision, the questionnaire was pretested with the general practitioners and health care assistants who attended the network’s 2020 fall meeting. This approach was considered sufficient as both groups are occupationally experienced in using questions and wordings that are comprehensible for patients.

For patients unwilling to participate, age, gender, chronic disease (yes/no), and occupational status were documented.

Bias

To minimize the risk of selection bias due to non-response on an item level, the questionnaire provided the possibility to select a neutral answer (outcome neither relevant nor irrelevant) and to declare that the responder did not know what a specific parameter meant (unsure what this parameter means). Additionally, characteristics of patients unwilling to participate were documented to control for a potential selection bias due to study non-response.

Statistical methods

Responders and non-responders were compared regarding age, gender, employment, and chronical illness using a t-test for independent samples for continuous variables and a Pearson’s chi-squared test for categorical variables (Fisher’s exact test if cells were < 5) [36]. The nominal significance level for these bivariate analyses was defined as p < 0.05.

The relevance of parameters was determined by a simple frequency calculation and a calculation of mean values for each of the 32 parameters included in the questionnaire. Only valid scorings were included for the analysis of mean values, i.e., answers stating ‘unsure what this parameter means’ were excluded. Parameters that scored ≥ 4 on average were considered relevant. In order to determine whether there were any differences in rating a parameter as highly relevant (yes/no) with regard to age (continuously), gender (male/female), and chronic status (chronically ill/not chronically ill), bivariate analyses were performed using a Mann–Whitney U test for continuous variables and a Pearson’s chi-squared test for categorical variables (Fisher’s exact test if cells were < 5) [36]. In order to control for multiple testing, p-values were corrected by applying the Bonferroni-Holm method [37, 38]. Aiming to additionally identify potential redundancies between parameters and to extract the most important factors, one principal component analysis (PCA) each was performed for parameters related to body and mind, personality and social life, and diagnosis and care processes. In case of Kaiser–Meyer–Olkin measure of sampling adequacy > 0.5 and a significant value for the Bartlett’s sphericity test (< 0.05) correlations between the variables selected were considered sufficient for conducting a PCA [39]. Factors were extracted based on the Kaiser’s criteria (eigenvalue ≥ 1) and the scree-plot [39].

The free-text answers were inductively categorized by two researchers (CK, JH). Simple frequency calculations were then applied.

All statistical analyses were performed using IBM SPSS Statistics for Windows, Version 26 (Armonk, New York: IBM Corp.). Percentages and mean values are reported for valid cases.

Results

Participants

In the end, ten of the 13 practices that attended the fall research meeting supported the study (practice response: 76.9%). Two practices were not interested in participating, one practice had no time to support the study. The participating practices asked 345 patients to participate (Fig. 1); of these, 32 did not respond (patient response: 90.7%). After excluding participants younger than 18 years who did not meet the inclusion criteria (n = 14), data from 299 primary care patients provided the basis for the analysis.

Fig. 1
figure 1

Flow chart of study participants

Full size image

The participating patients were aged 18 to 88 years (mean: 52.9, standard deviation: 16.3); 173 of them were female (57.9%). More details are provided in Table 1.

Table 1 Characteristics of participating patients (N = 299)
Full size table

A comparison of the characteristics of responders and non-responders showed that responders were less frequently retired (29.8% versus 50.0%, p = 0.023). They did not differ with regard to age (52.9 ± 16.3 vs. 56.6 ± 20.6 years, p = 0.336), gender (57.9% vs. 53.1% female, p = 0.607), and chronic illness (45.9% vs. 46.4% chronically ill, p = 0.954).

Relevance of parameters applied in recent studies

Within the category body and mind (Fig. 2a), more than 75% of all responders rated the parameters ‘prevention of comorbidity’, ‘mobility’, ‘mental health’, and ‘cognitive performance’ as highly relevant. ‘Sexual function/sexuality’ was rated lowest within this category and overall. It was one of only two parameters with an average score lower than 4. In comparison with all parameters assessed, participants were most commonly unsure about what was meant by ‘survival/mortality’ (n = 20, 6.7%).

Fig. 2
figure 2

Relevance of supposedly patient-relevant parameters from the patients’ perspective: parameters related to a) body and mind, b) personality and social life, c) diagnosis and care

Full size image

In the category personality and social life (Fig. 2b), three parameters were rated as highly relevant by more than 75% of participants: ‘independence’, ‘generic quality of life’, and ‘communication skills’. In this category all parameters received an average score higher than 4, indicating that all of them were considered relevant.

Within the category diagnosis and care processes (Fig. 2c), the four parameters ‘confidence in therapy’, ‘clear therapeutic decision’, ‘reliable diagnosis and therapy’, and ‘satisfaction with care’ were rated as highly relevant by more than 75% of responders. ‘Confidence in therapy’ was also the highest rated parameter overall, considered highly relevant by nearly 90% of participants, and scored 4.9 on average. ‘Frequency of healthcare utilization’ was rated lowest within this category and second lowest overall.

In total, all parameters except ‘sexuality’ and ‘frequency of healthcare utilization’ received an average score higher than 4 and were considered relevant. All mean values and corresponding standard deviations (SD) are presented in Fig. 2a-c.

Correlations between high relevance and patients’ characteristics

After correcting for multiple testing, comparisons of patients rating a parameter highly relevant with those rating it not highly relevant revealed age- and gender-related differences for five of the 32 parameters, whereas no differences were found for chronic status:

Age-related differences: Patients who rated the parameter working ability as highly relevant were significantly younger compared to those not rating it highly relevant (48.9 ± 1.3 vs. 56.8 ± 1.4 years, p < 0.001).

Gender-related differences: The proportion of women was significantly higher among those rating cognitive performance (63.2% vs. 39.1% female, p < 0.001), mental health (63.3% vs. 34.5% female, p < 0.001), ability to fulfil social roles (70.0% vs. 39.2% female, p < 0.001), and pain relief (63.2% vs. 42.9% female, p = 0.001) highly relevant when compared with those rating these parameters not highly relevant.

Differences found referred to parameters of the categories body and mind as well as personality and social life. There were no correlations between high ratings of any parameter addressing diagnosis and care processes and patients’ characteristics.

Redundancies between parameters

The Kaiser–Meyer–Olkin measure of sampling adequacy and Bartlett’s sphericity test indicated sufficient correlations between the variables selected for each PCA. Kaiser’s criteria and scree-plots empirically justified to retain two factors with eigenvalues ≥ 1 for each PCA. The varimax-rotated two-factor solution yielded the most interpretable solution with most parameters loading highly on one of the two factors only (Table 2).

Table 2 Principal component analysis
Full size table

Relevant parameters additionally addressed by patients

Thirty-eight of the 299 patients (13.4%) stated that they were missing some relevant parameters in the questionnaire. Of these, one patient did not provide a free-text answer and six answers did not address any specific parameters. The remaining 31 evaluable answers resulted in 15 additional parameters, most of them addressing processes of care and related to the category diagnosis and care processes. Those most commonly mentioned parameters were ‘confidence in practitioner’, ‘inclusion of alternative medicine/treatment methods’, ‘enough time in physician consultation’, and ‘being heard’. All parameters added by patients are listed in Table 3.

Table 3 Patient-relevant parameters newly addressed by patients (n = 31)
Full size table

Discussion

The evaluation of parameters identified as patient-relevant in our previous scoping review [6] showed that both parameters addressing processes of care (e.g., ‘confidence in therapy’) and those addressing outcomes of care (e.g., ‘prevention of secondary diseases’) are extremely important to patients. Fifteen parameters were newly identified as relevant. Interestingly, most of them addressed processes of care. Participants assigning high relevance to the parameters cognition, mental health, ability to fulfil social roles, and pain relief were more commonly women, those who consider working ability as highly relevant were younger. No correlations between high ratings of parameters and chronic status were found when correcting for multiple testing. In addition, high ratings of parameters addressing diagnosis and care processes were not associated with any patient characteristics. However, factor analyses revealed that there might be redundancies between some parameters assessed or overlaps between the constructs underlying these parameters.

When comparing the results with other studies that applied patient-driven approaches to define relevant parameters we found that –contrary to our results– parameters addressing processes of care play a secondary role [7,8,9,10,11,12,13,14,15,16,17,18,19,20]. When looking at studies that report patient-relevant parameters for generic patient groups, it appears as though process indicators also play a subordinate role [4, 5, 21,22,23,24,25,26,27,28,29]. Only few studies have considered such parameters [4, 7, 8, 12, 13, 20, 22, 29]. Those predominantly mentioned are ‘clear therapeutic decision’, ‘confidence in therapy’, ‘reliable diagnosis and therapy’, and ‘optimal support’ [4, 7, 8, 12, 22, 29]. Interestingly, these parameters were mentioned in studies focusing on generic groups as well as in studies focusing on specific diseases. This emphasizes the relevance of these aspects irrespective of the disease, as also indicated by the high scores found in our generic patient sample. Our hypothesis that there are several parameters that are relevant for patients regardless of disease is thus supported.

However, our survey provides only a mere indication of how patients rate the relevance of single parameters without balancing them against each other or providing insight into why some parameters are more relevant than others. It therefore remains unclear how patients ultimately make a choice and which factors or experiences influence their decision or cause their priorities to shift. As our overarching objective is to contribute to an empirically based methodological concept of patient relevance, including a generic set of patient-relevant parameters, it is important for us to understand the processes underlying patients’ decision making. For this purpose, microeconomic approaches might be helpful and need to be considered when developing the concept. Discrete choice experiments or conjoint analyses, for example, are designed to document decisions and are based on the assumption that a higher priority of one option against another also implies a stronger benefit [40]. Implementing such approaches while developing the concept will help us understand what really matters to patients and thereby enable us to derive a framework on how to adequately select and weigh process and outcome parameters when designing a clinical trial and use study results for the process of shared clinical decision-making between doctors and patients. This will be a useful supplement to the planned generic set of patient-relevant parameters.

In order to contribute to the overarching aim of our project, potentially lacking parameters, the relevance of newly identified parameters, the relevance rankings resulting from this survey, and potential redundancies between parameters emerging from the factor analysis will in the next step be discussed with patients, medical and therapeutic professionals, and researchers. Those results will then provide the basis for an online Delphi. The multi-professional approach will ensure that the future concept on patient relevance adequately addresses the patient’s perspective and is feasible for scientific purposes at the same time [31].

Limitations

One strength of our survey is the high response rate. Nevertheless, we cannot exclude that the results might be limited due to a potential selection bias. Even though we asked the practices to complete non-responder questionnaires for each patient who refused to participate, the number of non-responders is very low, which suggests that the practices might not have consistently completed these questionnaires. Additionally, non-responders differed slightly from responders regarding retirement. Therefore, we cannot finally exclude a selection bias due to systematic study non-response.

One key limitation is that the study sample is small and not representative. In detail, in Germany and in all other European countries the population is slightly younger than the study population and commonly has an almost balanced gender ratio [41], whereas the proportion of chronically ill people is comparable to those reported for Germany and some other European countries [42]. In addition, the parameters assessed were based on a previous scoping review which aimed to identify parameters considered relevant to patients in recent research projects. It cannot be excluded that the review and its search strategy might not have covered all parameters and that the parameters extracted from the studies are incomplete. Due to these limitations the results of this survey only give an indication and provide first insights into how patients rate the relevance of parameters without being generalizable.

Conclusion

In due consideration of the limitations outlined above, the fact that no correlations were found between chronic status and relevance ratings appears to support the hypothesis that some parameters are relevant to patients regardless of their ailment. In addition, the results of this survey indicate that patients attach great value to parameters that address the process of care. It appears as though the way in which patients experience the care process is not altogether less relevant than its outcome. This is reinforced by the fact that high ratings of parameters addressing processes were not associated with any patient characteristics. However, outcome parameters that have commonly been used in recent studies are still strongly characterized by clinical trial endpoints that focus more on effects of care than on processes of care. This might not adequately represent patients’ reality and satisfy their need for information to make informed choices in the sense of shared decision-making. Addressing patient preferences and parameters that evaluate processes of care from patients’ perspective should become part of the professional self-conception of all researchers and be sufficiently considered when designing studies. In order to harmonize such approaches, there is a need to develop methodological frameworks on how to select and weigh process- and outcome-related parameters when designing trials and that is applicable and adaptable to different contexts.

Availability of data and materials

The datasets analyzed during the current study are available from the corresponding author on reasonable request.

References

  1. American Geriatrics Society Expert Panel on Person-Centered Care. Person-Centered Care: A Definition and Essential Elements. J Am Geriatr Soc. 2016;64:15–8. https://doi.org/10.1111/jgs.13866.

    Article  Google Scholar 

  2. Elwyn G, Frosch D, Thomson R, Joseph-Williams N, Lloyd A, Kinnersley P, et al. Shared decision making: a model for clinical practice. J Gen Intern Med. 2012;27:1361–7. https://doi.org/10.1007/s11606-012-2077-6.

    Article  PubMed  PubMed Central  Google Scholar 

  3. Gandhi GY, Murad MH, Fujiyoshi A, Mullan RJ, Flynn DN, Elamin MB, et al. Patient-important outcomes in registered diabetes trials. JAMA. 2008;299:2543–9. https://doi.org/10.1001/jama.299.21.2543.

    Article  CAS  PubMed  Google Scholar 

  4. Adie S, Harris IA, Naylor JM, Mittal R. Are outcomes reported in surgical randomized trials patient-important? A systematic review and meta-analysis. Can J Surg. 2017;60:86–93.

    Article  Google Scholar 

  5. Gaudry S, Messika J, Ricard J-D, Guillo S, Pasquet B, Dubief E, et al. Patient-important outcomes in randomized controlled trials in critically ill patients: A systematic review. Ann Intensive Care. 2017;7:28. https://doi.org/10.1186/s13613-017-0243-z.

    Article  PubMed  PubMed Central  Google Scholar 

  6. Kersting C, Kneer M, Barzel A. Patient-relevant outcomes: What are we talking about? A scoping review to improve conceptual clarity. BMC Health Serv Res. 2020;20:596. https://doi.org/10.1186/s12913-020-05442-9.

    Article  PubMed  PubMed Central  Google Scholar 

  7. Blome C, Augustin M, Siepmann D, Phan NQ, Rustenbach SJ, Stander S. Measuring patient-relevant benefits in pruritus treatment: Development and validation of a specific outcomes tool. Br J Dermatol. 2009;161:1143–8. https://doi.org/10.1111/j.1365-2133.2009.09328.x.

    Article  CAS  PubMed  Google Scholar 

  8. Blome C, Augustin M, Heyer K, Knofel J, Cornelsen H, Purwins S, Herberger K. Evaluation of patient-relevant outcomes of lymphedema and lipedema treatment: Development and validation of a new benefit tool. Eur J Vasc Endovasc Surg. 2014;47:100–7. https://doi.org/10.1016/j.ejvs.2013.10.009.

    Article  CAS  PubMed  Google Scholar 

  9. Cho Y, Sautenet B, Gutman T, Rangan G, Craig JC, Ong AC, et al. Identifying patient-important outcomes in polycystic kidney disease: An international nominal group technique study. Nephrology (Carlton). 2019. https://doi.org/10.1111/nep.13566.

    Article  Google Scholar 

  10. Dinglas VD, Faraone LN, Needham DM. Understanding patient-important outcomes after critical illness: A synthesis of recent qualitative, empirical, and consensus-related studies. Curr Opin Crit Care. 2018;24:401–9. https://doi.org/10.1097/MCC.0000000000000533.

    Article  PubMed  PubMed Central  Google Scholar 

  11. Eiring O, Nylenna M, Nytroen K. Patient-Important Outcomes in the Long-Term Treatment of Bipolar Disorder: A Mixed-Methods Approach Investigating Relative Preferences and a Proposed Taxonomy. Patient. 2016;9:91–102. https://doi.org/10.1007/s40271-015-0128-x.

    Article  PubMed  Google Scholar 

  12. Kinter ET, Schmeding A, Rudolph I, dosReis S, Bridges JFP. Identifying patient-relevant endpoints among individuals with schizophrenia: An application of patient-centered health technology assessment. Int J Technol Assess Health Care. 2009;25:35–41. https://doi.org/10.1017/S0266462309090059.

    Article  PubMed  Google Scholar 

  13. Konkle BA, Skinner M, Iorio A. Hemophilia trials in the twenty-first century: Defining patient important outcomes. Res Pract Thromb Haemost. 2019;3:184–92. https://doi.org/10.1002/rth2.12195.

    Article  PubMed  PubMed Central  Google Scholar 

  14. Lindsley KB, Hutfless S, Hawkins BS, Blim JF, Roberts D, Olsen TW, et al. Evaluation of Clinical Questions and Patient-Important Outcomes Associated With the Treatment of Age-Related Macular Degeneration. JAMA Ophthalmol. 2018;136:1217–25. https://doi.org/10.1001/jamaophthalmol.2018.3456.

    Article  PubMed  PubMed Central  Google Scholar 

  15. Murad MH, Shah ND, van Houten HK, Ziegenfuss JY, Deming JR, Beebe TJ, et al. Individuals with diabetes preferred that future trials use patient-important outcomes and provide pragmatic inferences. J Clin Epidemiol. 2011;64:743–8. https://doi.org/10.1016/j.jclinepi.2010.08.005.

    Article  PubMed  Google Scholar 

  16. Nabbout R, Auvin S, Chiron C, Irwin J, Mistry A, Bonner N, et al. Development and content validation of a preliminary core set of patient- and caregiver-relevant outcomes for inclusion in a potential composite endpoint for Dravet Syndrome. Epilepsy Behav. 2018;78:232–42. https://doi.org/10.1016/j.yebeh.2017.08.029.

    Article  PubMed  Google Scholar 

  17. Sanderson T, Morris M, Calnan M, Richards P, Hewlett S. What outcomes from pharmacologic treatments are important to people with rheumatoid arthritis? Creating the basis of a patient core set. Arthritis Care Res (Hoboken). 2010;62:640–6. https://doi.org/10.1002/acr.20034.

    Article  CAS  Google Scholar 

  18. Sung VW, Rogers RG, Barber MD, Clark MA. Conceptual framework for patient-important treatment outcomes for pelvic organ prolapse. Neurourol Urodyn. 2014;33:414–9. https://doi.org/10.1002/nau.22397.

    Article  PubMed  Google Scholar 

  19. van der Elst K, Meyfroidt S, de Cock D, de Groef A, Binnard E, Moons P, et al. Unraveling Patient-Preferred Health and Treatment Outcomes in Early Rheumatoid Arthritis: A Longitudinal Qualitative Study. Arthritis Care Res (Hoboken). 2016;68:1278–87. https://doi.org/10.1002/acr.22824.

    Article  Google Scholar 

  20. Wilson HA, Middleton R, Abram SGF, Smith S, Alvand A, Jackson WF, et al. Patient relevant outcomes of unicompartmental versus total knee replacement: Systematic review and meta-analysis. BMJ. 2019;364: l352. https://doi.org/10.1136/bmj.l352.

    Article  PubMed  PubMed Central  Google Scholar 

  21. Agarwal A, Johnston BC, Vernooij RWM, Carrasco-Labra A, Brignardello-Petersen R, Neumann I, et al. Authors seldom report the most patient-important outcomes and absolute effect measures in systematic review abstracts. J Clin Epidemiol. 2017;81:3–12. https://doi.org/10.1016/j.jclinepi.2016.08.004.

    Article  PubMed  Google Scholar 

  22. Ameur H, Ravaud P, Fayard F, Riveros C, Dechartres A. Systematic reviews of therapeutic interventions frequently consider patient-important outcomes. J Clin Epidemiol. 2017;84:70–7. https://doi.org/10.1016/j.jclinepi.2017.01.006.

    Article  PubMed  Google Scholar 

  23. El Dib R, Tikkinen KAO, Akl EA, Gomaa HA, Mustafa RA, Agarwal A, et al. Systematic survey of randomized trials evaluating the impact of alternative diagnostic strategies on patient-important outcomes. J Clin Epidemiol. 2017;84:61–9. https://doi.org/10.1016/j.jclinepi.2016.12.009.

    Article  PubMed  Google Scholar 

  24. Fayed N, de Camargo OK, Elahi I, Dubey A, Fernandes RM, Houtrow A, Cohen E. Patient-important activity and participation outcomes in clinical trials involving children with chronic conditions. Qual Life Res. 2014;23:751–7. https://doi.org/10.1007/s11136-013-0483-9.

    Article  PubMed  Google Scholar 

  25. Fei Y, Guyatt GH, Alexander PE, El Dib R, Siemieniuk RAC, Vandvik PO, et al. Addition of Ezetimibe to statins for patients at high cardiovascular risk: Systematic review of patient-important outcomes. J Eval Clin Pract. 2018;1:222–31. https://doi.org/10.1111/jep.12663.

    Article  Google Scholar 

  26. Griffith LE, Gilsing A, Mangin D, Patterson C, van den Heuvel E, Sohel N, et al. Multimorbidity Frameworks Impact Prevalence and Relationships with Patient-Important Outcomes. J Am Geriatr Soc. 2019. https://doi.org/10.1111/jgs.15921.

    Article  PubMed  Google Scholar 

  27. Kvitkina T, Haaf A ten, Reken S, McGauran N, Wieseler B. Patient-relevant outcomes and surrogates in the early benefit assessment of drugs: First experiences [Patientenrelevante Endpunkte und Surrogate in der fruhen Nutzenbewertung von Arzneimitteln: erste Erfahrungen]. Z Evid Fortbild Qual Gesundhwes. 2014;108:528–38. https://doi.org/10.1016/j.zefq.2014.06.015.

    Article  PubMed  Google Scholar 

  28. Wieseler B, Wolfram N, McGauran N, Kerekes MF, Vervolgyi V, Kohlepp P, et al. Completeness of reporting of patient-relevant clinical trial outcomes: Comparison of unpublished clinical study reports with publicly available data. PLoS Med. 2013;10: e1001526. https://doi.org/10.1371/journal.pmed.1001526.

    Article  PubMed  PubMed Central  Google Scholar 

  29. Yordanov Y, Dechartres A, Ravaud P. Patient-important outcomes in systematic reviews: Poor quality of evidence. PLoS ONE. 2018;13: e0195460. https://doi.org/10.1371/journal.pone.0195460.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  30. Ciani O, Salcher-Konrad M, Meregaglia M, Smith K, Gorst SL, Dodd S, et al. Patient-reported outcome measures in core outcome sets targeted overlapping domains but through different instruments. J Clin Epidemiol. 2021;136:26–36. https://doi.org/10.1016/j.jclinepi.2021.03.003.

    Article  PubMed  Google Scholar 

  31. Kersting C, Barzel A, Mortsiefer A. Mixed-methods approach to develop an agreed concept on patient relevance: Study protocol for the “PRO patients study.” BMJ Open. 2021;11:e047679.

  32. Llewellyn-Thomas HA. Patients’ health-care decision making: a framework for descriptive and experimental investigations. Med Decis Making. 1995;15:101–6. https://doi.org/10.1177/0272989X9501500201.

  33. Entwistle VA, Watt IS. Patient involvement in treatment decision-making: the case for a broader conceptual framework. Patient Educ Couns. 2006;63:268–78. https://doi.org/10.1016/j.pec.2006.05.002.

    Article  PubMed  Google Scholar 

  34. von Elm E, Altman DG, Egger M, Pocock SJ, Gøtzsche PC, Vandenbroucke JP. Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement: guidelines for reporting observational studies. BMJ. 2007;335:806–8. https://doi.org/10.1136/bmj.39335.541782.AD.

    Article  Google Scholar 

  35. Viehmann A, Thielmann A, Gesenhues S, Weltermann B. Repräsentieren akademische Hausarztpraxen die hausärztliche Regelversorgung? Eine methodische Annäherung. [Do Academic Family Practices Reflect Routine Primary Care? A Methodological Approach]. Z Allg Med. 2014;90:354–9. https://doi.org/10.3238/zfa.2014.0354-0359.

    Article  Google Scholar 

  36. Bender R, Lange S, Ziegler A. Wichtige Signifikanztests [Common significance tests]. Dtsch Med Wochenschr. 2007;132(Suppl 1):e24-5. https://doi.org/10.1055/s-2007-959034.

    Article  PubMed  Google Scholar 

  37. Holm S. A Simple Sequentially Rejective Multiple Test Procedure. Scand J Statist. 1979;6:65–70.

    Google Scholar 

  38. Giacalone M, Agata Z, Cozzucoli PC, Alibrandi A. Bonferroni-Holm and permutation tests to compare health data: methodological and applicative issues. BMC Med Res Methodol. 2018;18:81. https://doi.org/10.1186/s12874-018-0540-8.

    Article  PubMed  PubMed Central  Google Scholar 

  39. Child D. The essentials of factor analysis. 3rd ed. London: Continuum; 2006.

    Google Scholar 

  40. Mühlbacher A, Bethge S, Tockhorn A. Measuring Preferences in Healthcare: Introduction to Discrete-Choice Experiments. Gesundh ökon Qual manag. 2013;18:159–72. https://doi.org/10.1055/s-0032-1330500.

    Article  Google Scholar 

  41. Eurostat. Demography of Europe: Statistics visualized - 2021 Edition. 2021. https://ec.europa.eu/eurostat/cache/digpub/demography/index.html?lang=en.

  42. OECD. Chronic conditions. In: OECD, editor. Health at a Glance 2021: OECD Indicators. Paris: OECD Publishing; 2021. doi:https://doi.org/10.1787/908b2da3-en.

Download references

Acknowledgements

We thank all general practice teams who supported this study: Christina Tan Tjhen, Anna Muscat, and team; Dr. Florian Kühme and team; Dr. Lucas Bisplinghoff and team; Agnes Rauter-Ullrich and team; Jana Isfort and team; Dr. Hartmut Gehlhar and team; Dr. Niels Grundmann, Britta Fleischer and team; Dr. Marcus Dormann and team; Dr. Petra Zimmermann and team; Prof. Dr. Klaus Weckbecker and team. Our thanks also go to all researchers, general practitioners, and health care assistants who supported the pretest and revision of the data collection material, and to all patients who participated in the study.

Funding

Open Access funding enabled and organized by Projekt DEAL. This research received no specific grant from any funding agency in the public, commercial, or not-for-profit sector.

Author information

Authors and Affiliations

  1. Chair of General Practice II and Patient-Centeredness in Primary Care, Institute of General Practice and Primary Care, Faculty of Health, Witten/Herdecke University, Alfred-Herrhausen-Str. 50, 58448, Witten, Germany

    Christine Kersting & Achim Mortsiefer

  2. Chair of General Practice I and Interprofessional Care, Institute of General Practice and Primary Care, Faculty of Health, Witten/Herdecke University, Alfred-Herrhausen-Str. 50, 58448, Witten, Germany

    Julia Hülsmann & Klaus Weckbecker

Authors
  1. Christine Kersting
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Julia Hülsmann
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Klaus Weckbecker
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Achim Mortsiefer
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

CK and KW designed the study; CK and JH conducted it. Supervised by AM, CK performed the analyses and interpreted the results; when categorizing the free-text answers CK was supported by JH. CK drafted the first manuscript including figures and tables, which was critically reviewed by AM first and afterwards by JH and KW. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Christine Kersting.

Ethics declarations

Ethics approval and consent to participate

The ‘PRO patients study’ was performed in accordance with the Declaration of Helsinki. It obtained ethical approval from the Ethics Commission of Witten/Herdecke University (reference number: 156/2020, date of approval: 08/26/2020). Participants received written information and provided informed consent.

Consent for publication

All participants provided informed consent for the analysis and publication of data assessed during the cross-sectional survey.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kersting, C., Hülsmann, J., Weckbecker, K. et al. Patients’ perspective on supposedly patient-relevant process and outcome parameters: a cross-sectional survey within the ‘PRO patients study’. BMC Health Serv Res 22, 72 (2022). https://doi.org/10.1186/s12913-021-07437-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12913-021-07437-6

Keywords

BMC Health Services Research

ISSN: 1472-6963

Contact us