Skip to main content
  • Research article
  • Open access
  • Published:

Adherence to evidence-based practice across healthcare professionals in Germany: results from a cross-sectional, nationwide survey

Abstract

Background

Adherence to evidence-based practice (EBP) is considered a key competence to improve healthcare quality. In this study, we aimed to describe the EBP adherence of healthcare professionals working in Germany and to explore barriers and facilitators regarding the implementation of EBP in clinical practice.

Methods

A nationwide online survey was performed among healthcare professionals in Germany from January to April 2018 using the German version of the Evidence-based Practice Inventory (EBPI) questionnaire for a comprehensive assessment of adherence to EBP. Univariate logistic regression analyses were performed to explore the association between demographic and professional determinants and each EBPI dimension.

Results

We analysed data of 889 participants, including 318 physical therapists, 154 occupational therapists, 137 midwifes and 280 participants of six other healthcare professions. Approximately 70% of the participants generally demonstrated a positive attitude towards EBP and believed that EBP was useful in clinical practice. Broadly, 80% of the respondents evaluated themselves as being able to enact EBP behaviour in clinical practice. In contrast, less than 70% preferred to use quantitative information instead of their intuition to inform their habitual clinical behaviour. Still, 20 to 30% reported that EBP did not sufficiently account for their clinical experience and differences between patients.

The strongest facilitators to EBP adherence across at least three dimensions of the EBPI were the availability of ≥ 60 min for scientific literature at work (OR: 9.67; 95% CI: 5.86; 16.30), followed by a master or higher academic degree (OR: 9.09, 95% CI: 5.86; 14.28) and the involvement in ≥ 1 scientific publication (OR: 7.06, 95% CI: 5.10; 9.85).

Conclusions

This study showed that healthcare professionals in Germany in general had a positive attitude towards EBP although they currently do not consider EBP principles in its entirety. The most important determinant positively influencing a healthcare professional’s decision to perform EBP was the time available for scientific literature at work. German healthcare professionals experience similar barriers towards the implementation of EBP in clinical practice compared to other international healthcare settings. These barriers should be targeted by future research.

Trial registration

German Clinical Trials Register (DRKS00013792). Registered 19 January 2018.

Peer Review reports

Background

The use of an evidence-based approach in clinical practice is accepted as a core competence across most health professions [1]. Decisions in clinical practice, based on research evidence as well as a clinician’s expertise and patient preferences and contextual resources, improve patient outcomes and help to reduce variations not explainable by need or preferences of certain populations [2] in clinical decisions across healthcare professions and settings [3]. Despite this accepted notion, the implementation of research evidence into clinical practice still varies greatly among healthcare professions, especially regarding the extent as to which research evidence currently informs their clinical decision making [4]. For the improvement of clinical care, the gap between clinical practice and research evidence needs to be narrowed, e.g. by using an evidence-based practice (EBP) approach [5].

EBP has been initially defined as a ‘problem solving approach aiming to improve the quality of patient care by informing clinical decision making in patient care by the current best evidence’ [5]. Still, the creation of clinical settings and requirements that facilitate EBP for healthcare professionals who wish to provide high-quality patient care remains a major challenge [6].

Across many settings and professions, a wide range of studies reported barriers and facilitators regarding the implementation of research evidence into clinical practice [7]. Major barriers and facilitators identified were related to the clinician’s individual evaluation of the EBP concept, perceived individual competencies to perform EBP, or an individual’s estimation in how far an EBP culture or conform behaviour was assumed by superiors or colleagues [8].

Acknowledging that EBP is influenced by several and individually varying factors, the evaluation and implementation of EBP remains challenging. The ‘Evidence-based Practice Inventory (EBPI)’ is a questionnaire developed to assess the construct of ‘EBP adherence’ and to identify barriers and facilitators for EBP across a variety of healthcare professions and settings [9]. It can be used to assess EBP adherence under local conditions to provide insights into potential barriers and facilitators, which could then be used to develop strategies for a further evaluation and implementation of EBP.

In Germany, training of most allied healthcare professions is or has been mostly performed at vocational schools and not at higher education institutions [9]. Although physicians and psychologists are trained at higher education institutions, other professions such as physical therapy, occupational or speech therapy remain mostly at vocational schools. Training of nursing is being performed at least partly at higher education institutions, and for midwifery a recent EU legislation caused change from vocational schools to education of midwives at tertiary institutions [10]. Due to different academic and non-academic training routes, imparting of EBP knowledge as part of the formal training is different [11]. However, incorporating the best research evidence into clinical practice to ensure high quality patient care needs to be ensured.

Methods

This study aimed to describe the EBP adherence of healthcare professionals working in Germany and to identify barriers and facilitators regarding the implementation of and adherence to EBP in clinical practice.

The guidelines for Reporting of Observational Studies in Epidemiology (STROBE) [12] and the Checklist for Reporting Results of Internet E-Surveys (CHERRIES) [13, 14] were followed in the reporting of this study. The reporting of statistical results was further informed by the ‘Statistical Analyses and Methods in the Published Literature’ (SAMPL) guidelines [15].

Study Design

The present report is based on data from a cross-sectional study which aimed to (a) evaluate the measurement properties of a German language version of the EBPI [14] and (b) to identify barriers and facilitators in the implementation and adherence to EBP. Details of this study have been reported elsewhere [14, 16]. Briefly, the EBPI was completed twice in an online survey by healthcare professionals in Germany. In the present study, we used only the baseline data (first assessment of the EBPI).

Participants

This online survey was made accessible to all German-speaking healthcare professionals via an unconfined public internet link and by means of convenience sampling. Only data from adult (≥ 18 years) healthcare professionals (e.g. medicine, midwifery, nursing, occupational therapy, speech and language therapy, sports therapy, psychology, physical therapy), predominantly working in Germany were included. Questionnaires from respondents (a) who stated to work < 1 h per week with patients or in clinical care, (b) who terminated the survey before completing the 12th screen and, (c) those who did not fill in any of the five dimensions of the EBPI [14].

For the recruitment of healthcare professionals, miscellaneous media and communication paths were employed. We conceptualized an invitation letter, a statement to the press and a short “advertisement”, all comprising an outline of the study aim and procedure as well as contact information. We informed the health care professionals community in Germany about the survey by means of publication via different media by the institutions, professional societies and journals (See Additional file 2) and asked to spread the survey link and the project description to as many colleagues as possible (“snowball principle”). We offered no incentives for participation [14]. A total sample size of 800 participants was targeted per protocol for the analyses of measurement properties of the EBPI [14]. However, it was intended to include as many participants as possible and therefore, a maximum sample for the survey was not defined a priori.

Data collection

Survey instrument

EBP adherence among healthcare professionals working in Germany was assessed using the EBPI, an instrument covering five dimensions with 26 items in total [4].

  1. 1.

    ‘Attitude’ (a clinician’s individual evaluation of EBP)

  2. 2.

    ‘Subjective norm’ (a clinician’s own estimate of the social pressure to perform or not to perform EBP behaviour)

  3. 3.

    ‘Perceived behavioural control’ (the extent to which a clinician feels able to enact EBP behaviour)

  4. 4.

    ‘Decision making’ (the extent to which new information reshapes the clinician’s current understanding and (habitual) behaviour)

  5. 5.

    ‘Intention and behaviour’ (the clinician’s aim and actual response, respectively, to apply EBP) [4, 17,18,19].

Respondents rated 26 statements (items) on a scale ranging from 1 to 6 with two antonyms (e.g. useful versus useless or ability versus inability). Based on the operationalisation by Kaper et al. [4], the term ‘EBP adherence’ was defined as the overall self-reported estimation a health professional provided across all dimensions, which together capture EBP as a complex construct [1, 14].

Online Survey

We performed an online survey among healthcare professionals in Germany, set up by using the software “SoSci Survey” (SoSci Survey GmbH, Munich, Germany; https: //www. soscisurvey.de). The survey could be accessed online only via an internet link to a “survey homepage” [14]. The survey comprised 14 pages. Participants had the opportunity to provide socio-demographic data if they so wished [14]. This freedom of choice was decided to ensure anonymous participation and to support survey completion. These characteristics were defined a priori as potentially influencing factors for the adherence to EBP based on findings from the current literature [20,21,22,23]. These were: age, sex, profession, highest professional degree, contact time with patients per week, primary setting of work, work experience, size of community/municipality of employment, federal state of employment, hosting of lectures or workshops on EBP, the availability of scientific literature at work, involvement of ≥ 1 scientific publication, available time for studying scientific literature at work per week [4]. The full German language EBPI was presented with one screen displaying each scale dimension. The survey’s items were provided in a standardised, unchanged sequence and participants had the possibility to review and change their answers at any time before survey termination (See Additional file 1 for an English version of the online survey) [14].

The survey was conducted from 25th January to 15th April 2018.

Data analysis

Descriptive statistics (such as mean values with standard deviation and range) were employed to present sample characteristics. Missing values were not imputed. Neither a weighting of items nor propensity scores were used [14].

The 6-point Likert scale response options of the EBPI were dichotomized for further analyses. A rating of point 1 to 3 was rated as an unfavourable answer (e.g. ‘not capable of’), whilst a reporting of points 4 to 6 was viewed as a favourable answer (e.g. ‘capable of’). For example, for dimension 1, item 1 was coded as „useless “ and „useful “, whereas item 5 was coded as “disregards” and “respects” as antonyms.

A favourable evaluation of EBP was further operationalised by considering the sum scores for each dimension separately. The cut-off value for dichotomisation was chosen as the lowest value of the third quartile of the sum score per dimension [24, 25]. For instance, dimension 3 (perceived behavioural control) comprised items 14 to 19 (6 Items), hence the maximally attainable sum score was 36. A clinician was defined as estimating himself being able to enact EBP (favourable evaluation of EBP) when the sum score of items 14 to 19 equalled or was greater than 75% of the study population’s sum score for this dimension. With this approach, a population specific description of results was intended, facilitating future comparisons across different populations [25].

Univariate logistic regression analyses were performed to explore the association between each potentially influencing factor and each EBPI dimension. An univariate logistic regression model was chosen rather than a multivariate approach to present results at its most modest level so as to provide a basis for future hypothesis generation [26]. Influencing factors were identified and incorporated, when they have been used in prior studies assessing EBP adherence.

Odds ratios (OR) and their associated 95% confidence intervals (CI) were reported for each sub-category of the demographic characteristics. OR were defined to describe the likelihood of demonstrating a favourable evaluation of a particular dimension of the EBPI (e.g. dimension 2 ‘subjective norm’: the estimate of the social pressure to perform or not to perform EBP behaviour) given a particular characteristic (e.g. having more than 10 h contact time with patients). One sub-category of each characteristic was used as the reference against which the odds of all other sub-categories was calculated. The reference was either the greatest subsample or, for dichotomous determinants, the more likely characteristic variable in clinical practice (based on the evaluation of the author team, e.g., reference “no” for availability of scientific literature at work place) to arrive at the most informative interpretation of results.

For some of the demographic characteristics, where subsamples were considered to be too small, some categories were collapsed in order to allow further analysis using them as determinants in the logistic regression analysis. For example, only 40 individuals indicated to have a higher academic degree (PhD) as their highest professional degree which was decided to be combined with the “masters” category (n = 106). In addition, some of the demographic characteristics were not included in the regression analysis, as they were determined not to provide reliable results regarding a clinician’s evaluation of EBP (e.g. age, as inherently expressed in work experience).

Data from the online survey were stored and processed as SPSS and R data files by SoSci Survey. For data analysis SPSS Version 25.0 statistical software (SPSS Inc., Chicago, IL, USA) and R Version 3.5.0 (The R Project for Statistical Computing, Vienna, Austria) were used.

Ethical considerations

Ethical approval was obtained from the ethics committee of the German association of physical therapists (Deutscher Verband für Physiotherapie e. V., Ethics Committee No.: 2017–13). Before taking part, participants provided written informed consent for data analysis and publication. The study was registered a priori in the German Clinical Trials Register (DRKS00013792).

Results

Participants

The online survey homepage was accessed 6628 times and 1459 participants initiated the survey. In total, 889 questionnaires were finally included in the analysis (see Fig. 1 for details), resulting in an overall response rate of 13.4% according to the number of accesses to the survey homepage [14].

Fig. 1
figure 1

Flow chart of the study

Six hundred fifty-seven (73.2%) of the 889 healthcare professionals involved were female. Participants were on average 37.4 ± 11.5 years old. In total, individuals from nine different healthcare professions took part in the survey with the group of physical therapists being the largest (n = 318; 35.8%). Most of the participants completed all dimensions of the questionnaire. Socio-demographic characteristics of the participants are provided in Table 1.

Table 1 Socio-demographic characteristics of the study participants (n = 889)

EBP adherence of healthcare professionals

Response pattern

A comprehensive overview regarding the response pattern per item is illustrated in Fig. 2.

Fig. 2
figure 2

Response pattern per item

Dimension 1 – Attitude

The majority of respondents demonstrated a generally positive attitude towards EBP, as 94% accounted it as useful to improve their patients’ outcomes (item 1), 94% considered it an important aspect of high-quality care (item 2) and 95% as an improvement in their clinical decisions (item 3). 80% of the respondents stated that EBP respects their clinical experience (item 4). Respondents were more cautious regarding the evaluation as to whether EBP respects individual differences between their patients (item 5) or leaves them autonomous in their individual clinical decision (item 6). 91% rated EBP as helpful for better clinical decisions (item 7) and 87% judged clinical guidelines as helpful for making decisions (item 8).

Dimension 2 – subjective norm

Respondents were equally balanced (53%) as to whether colleagues discouraged or encourage them (item 9) or the department they are working in pays a lot of or no attention to the application of EBP principles in their clinical decisions (item 10) (48%). 64% of the respondents reported that managers in their department supported them to apply EBP principles in their clinical decisions (item 11), of which 78% (223 out of 287 respondents) simultaneously occupied a leadership position themselves. 65% stated that they frequently discussed and challenged how they make clinical decisions (item 12). In contrast, 60% stated that they rarely discussed research evidence from the literature with colleagues (item 13).

Dimension 3 – perceived behavioural control

Respondents felt similarly capable of applying the core principles of EBP in clinical practice and to critically appraise research evidence from scientific literature (item 14 and 17), as well as searching for evidence and translating it to the individual care of patients (item 16 and 18). 83% reported to be capable of translating information needs into relevant clinical questions (item 15). Of all respondents, 72% felt capable of keeping up with the latest research evidence from the literature (item 19).

Dimension 4 – decision making

90% gave a high priority to the thorough understanding of all relevant background information to answer individual clinical questions (item 20). 68% reported to be in favour of incorporating quantitative information (item 21) and 64% of using facts and arguments into their clinical decisions respectively (item 22).

Dimension 5 – intention and behaviour

Of all respondents, 69% stated to frequently use (item 23) and 61% to prefer to use research evidence for the support of individual clinical decisions (item 24). Response rates were nearly balanced as to whether asking colleagues or a literature search was preferred to find answers for clinical decisions (item 25) or whether available research evidence was incorporated rarely or frequently to answer clinical questions (item 26).

The response pattern regarding the overall favourable evaluation of EBP, dichotomised according to the population specific cut-off values (upper quartile – favourable evaluation of EBP) are detailed in Table 2. Across all dimensions, 26% to 30.0% demonstrated an overall favourable evaluation of EBP.

Table 2 Response pattern—overall favourable evaluation of EBP

Barriers and facilitators of EBP

The results of the regression analysis regarding facilitators and barriers for EBP adherence are detailed in Table 3. Determinants which demonstrated a positive influence towards EBP adherence in at least three dimensions, were: the availability of at least 60 min for scientific literature at work (OR 9.67; 95% CI: 5.86—16.30), followed by a master or higher academic degree (OR 9.09; 95% CI: 5.86—14.28), the drafting or involvement in at least one scientific publication (OR 7.06; 95% CI: 5.10—9.85), the hosting of EBP lectures (OR 7.02; 95% CI: 4.67—10.69), the availability of scientific literature at work (OR 4.49; 95% CI: 3.03—6.85), a weekly contact time of up to 10 h (OR 2.49; 95% CI: 1.58—3.93) and a work experience of 26–35 years (OR 2.58; 95% CI: 1.55—4.29).

Table 3 Association between EBP and socio-demographic factors analysed via exploratory univariate logistic regression analyses

The primary setting of work did not show to be a determinant regarding EBP adherence across all dimensions, whereas a smaller size of the city/municipality of employment demonstrated to have a negative influence towards EBP adherence in dimensions 1, 3 and 4 (see Table 3 for details).

Discussion

The consideration of EBP principles in clinical practice depends on the healthcare professional’s willingness and ability to combine the current best research evidence with patient preferences and his/her clinical experience.

This study aimed to describe the EBP adherence of healthcare professionals working in Germany and to explore barriers and facilitators to the implementation of and adherence to EBP. This is, to our knowledge, the first study to provide comprehensive evidence concerning the EBP adherence across healthcare professionals in Germany.

EBP adherence

Our results showed that EBP adherence varied considerably across dimensions. In dimension 1 (attitude) and 3 (perceived behavioural control) more than 50% of the participants demonstrated a marked adherence to EBP, whereas in other dimensions, participants were more ambivalent (e.g., dimension 2 – subjective norm).

The findings from this study are in line with results from other international research findings. In 2011, Heiwe et al. [27] assessed EBP adherence and knowledge among Swedish healthcare professionals. Their findings showed positive attitudes towards EBP and its use to support clinical decision-making. Although literature and research findings were rated as useful in clinical practice, EBP was not perceived as taking into account the patient and healthcare professionals’ preferences. This finding mirrors a major criticism of EBP in general: the insufficient appreciation of the patients’ preferences is criticised as probably the most difficult and poorly mapped facet of EBP and was considered to receive the least attention in EBP research [28], which was explicitly not intended by Sackett et al. [29]. Hoffmann et al. [30, 31] advocated the incorporation of a shared decision making skills training into the actual EBP training for medical and health care students as a potential means to overcome this discrepancy in clinical practice.

Facilitators and barriers

According to the literature, a major influencing factor regarding the adherence to and implementation of EBP is the healthcare professional’s individual attitude towards EBP [32]. With reference to the answers to dimension 1, the overall attitude of the current study sample towards EBP, was positive. However, still 20 to 30% were of the opinion that EBP does not sufficiently account for their clinical experience and individual differences between patients. This indicates an incomplete understanding of the EBP construct, which clearly incorporates external evidence with patient’s preferences and clinician’s individual expertise [1]. An academic training [33] or EBP workshops [34] could help to improve a healthcare professional’s knowledge of EBP principles and hence reduce current misconceptions.

To ensure sound clinical decision making, research evidence must be transformed into healthcare professional’s knowledge [1]. Regarding answers to dimension 3, participants in this study generally assessed themselves as being able to enact EBP in clinical practice, although keeping up with latest research evidence from the literature was stated to be the most challenging aspect (question 20). As most respondents reported to feel able to apply the 5 steps of EBP (questions 14 to 19), this inability needs to be further investigated, as external factors, such as lack of time and/or internet access could explain this issue and were reported in the literature to be barriers to EBP in clinical practice [35]. However, 52% (n = 458) of the respondents from the current study sample had a diploma or bachelor degree as highest professional degree. Therefore, the general self-reporting of being able to enact all 5 steps of EBP in clinical practice should be viewed cautiously, as it could also be estimated that some clinicians might not be interested in acquiring the necessary level of training to critically appraise research evidence [36]. However, Dawes et al. [1] stated that not all health care professionals needed to be able to appraise evidence from the ground up. Instead, individuals on different levels of responsibility within an organisation needed varying levels of sophistication in appraising research evidence. Managers and educators should use their critical appraisal skills to aim at producing more comprehensive and easy-to-access pre-appraised EBP material to inform ‘EBP users’, which could be seen as an additional strategy to ensure EBP in clinical practice [1, 36].

Although 41% of the respondents in our study sample reported to have a diploma from vocational school to be their highest professional degree and hence did not necessarily receive a curricularly established EBP training, 28% favourably evaluated EBP (sum scores across dimension 1). This is in keeping with findings from previous international studies of a variety of healthcare professionals [22, 26, 37, 38], which support the general positive attitude of healthcare professionals towards EBP. Yahui et al. [22] and Jette et al. [26] reported that physical therapists in Malaysia and the USA, respectively, had a positive attitude towards EBP and are inclined towards implementing evidence into their clinical practice. Philibert et al. [37] also reported that American occupational therapists generally had a positive attitude regarding EBP although ratings regarding the usefulness of research to inform clinical practice were less favourable. In the study by Knops et al. [38], Dutch surgeons and nurses also had a generally positive attitude towards EBP and were familiar with the EBP terminology, although more frequent staff meetings for the critical appraisal of research evidence was advocated.

Regression analysis—determinants

The most important influencing factor of EBP adherence found in this study was the time available for studying or reading scientific literature at work. According to our results, at least one hour for studying scientific literature at work significantly increases a healthcare professionals’ chance to improve his/her own estimate of the social pressure to perform an EBP conform behaviour. These findings are in line with results of previous studies of American occupational and physical therapists [26, 37]. In the study by Jette et al. [26], 46% of the respondents named insufficient time as the most important barrier to the use of EBP in practice. Philibert et al. [37] reported time constraints to be the most important barrier for American occupational therapists to read scholarly journals. In 2006, [39], the study results by Upton and Upton showed that healthcare professionals across 14 different professional groups, such as speech and language therapists and psychologists, reported lack of both, time and money as main barrier to the implementation of EBP. Hence, considerable attention needs to be paid to further develop a German healthcare infrastructure, which is committed to best practice [1], requiring health policy action such as the implementation of a financial compensation system to offset the time invested for scientific literature at work [40].

Based on our results, persons with a higher academic degree were more likely to adhere to EBP. Dawes et al. [41] claimed that professions and their educational institutions need to incorporate the necessary knowledge, skills, and attitudes of EBP into their training and registration requirements. However, in Germany, currently only midwifery is legally established as a primary qualifying university degree course [10] among allied healthcare professions, constituting the principal legal stipulations to provide students with a basic understanding and level of EBP capability upon graduation [42]. As, for example, the German Training and Examination Regulations for Physical therapists (PhysTh-AprV) currently do not stipulate EBP training components, German physiotherapy education was stated not to meet the World Congress of Physiotherapy’s expectations regarding educational standards, which was considered a crucial issue to be addressed in the current debate on health policy [43]. However, our study sample also comprised professions trained in higher education institutions, such as medicine, psychology, and sports sciences, but they only represented 7% of the total sample (n = 63). The highest chances across all dimensions to adhere to EBP were shown to be associated with a postgraduate or higher academic degree, mirroring the fact that a mere university degree does not automatically implicate EBP adherence in clinical practice. These findings are in line with international requirements for medical training curricula which should enable their graduates’to have the ability to adapt to changing circumstances throughout their professional life’ [44]. An early claim by Shin et al. [45] supports the notion that in order to 'futureproof' healthcare graduates, they need to be trained in the necessary skills to support life-long learning through all the steps of EBP.

However, for those healthcare professionals who need to improve their EBP skills in clinical practice, the way with which to achieve this goal remains unclear. The design of effective training programmes, fostering not only healthcare professional’s attitudes and knowledge about EBP but also its implementation into clinical practice, is still matter to ongoing research [46,47,48]. In a systematic review from 2016, Hecht et al. [49] reported insufficient evidence as to whether currently available EBP trainings for healthcare professionals resulted in a meaningful change in EBP behaviour in clinical practice. However, in a recent study by Draaisma et al. [50] the authors showed that healthcare professionals who were exposed to deliberate practice of EBP in a routine clinical setting, evaluated EBP as more useful and were more likely to use it in decision making than their peers who only followed a standard EBP workshop.

Participants who stated to have drafted or have been involved in at least one scientific publication or have hosted lectures and workshops on EBP, felt more able to enable EBP behaviour (dimension 3). Hosting lectures as well as drafting a scientific publication presupposes a thorough understanding of the complex construct of EBP as well as comprehensive skills regarding its teaching [51]. However, both aspects may not directly mirror a person’s ability to adhere to EBP in clinical practice. Kaper et al. [4] noted that the EBPI does not concern step 4 (application) and 5 (audit) of the EBP process but explicitly assesses attitude, behaviour, information processing, decision making, and department setting conditions via self-report. Hence, both these factors need to be further assessed as to whether they actually influence a person’s adherence to EBP in clinical practice by means of qualitative [52] or mixed methods research approaches [53, 54], going beyond the sole self-report of EBP adherence.

Study strengths and limitations

A major limitation of this study, as already published elsewhere [14, 55], might have been the issue of sampling bias, mirrored by the above mentioned relatively low response rate of 13% (according to the number of accesses to the survey homepage). We strived to include a representative sample in the online survey by employing different media to bring the survey to the community of German healthcare professional’s attention. Yet, with respect to the total number of healthcare professionals working in Germany, the total number of participants (n = 889) was relatively low [14]. Currently, there are approximately 385,100 active physicians (in 2017) [56], approximately 1,064,342 healthcare professionals who are subjected to social insurance contributions (in 2018) [57] and approximately 192,000 physical therapists (in 2016) [58] working in Germany [14]. Therefore, we must presume that most healthcare professionals in Germany were not aware of the survey or decided not to participate, although we tried to distribute the information about the survey as broadly as possible [14]. In particular, medical physicians and nurses were not sufficiently represented [14]. A wider announcement of the survey among these professionals as well as the utilization of the Total Design Method provided by D.A. Dillman [59] as well as incentives might have increased the rate of participation [14, 55].

A further limitation was the sole online accessibility of the survey [14, 55]. This fact might have inflated the participation of (younger) healthcare professionals and people familiar with the use of digital media and online contents. In contrast, it might have prevented (older) people from participation, who are not that familiar with online content or healthcare professionals working in institutions without internet access [14]. However, the mean age of participants (37.4 years) in our study was lower than that of the total working population in Germany (43 years) [14, 55, 60]. However, representative data for the age distributions of healthcare professionals working in Germany are not available. In addition, younger healthcare professionals may be distinct from older (more experienced) ones regarding their EPB adherence, as stated by Dysart et al. [61], who reported greater reservation towards research evidence among more experienced occupational therapists compared to less experienced colleagues [14, 55].

In addition, our study was conducted as a self-administered online survey, not as an actual audit of current clinical practice. This might not provide a complete realistic impression of EBP under routine clinical care conditions [62].

Currently, there is no standardised instrument to assess the construct of EBP in its complexity, hampering the comparability of results across studies. In 2014, a systematic review by Fernándes-Dominguez et al. [63] identified 24 instruments assessing EBP adherence as well as barriers and facilitators only among the professional group of physical therapists with all instruments judged to lack sufficient comprehensiveness regarding the validation procedure. We used a cross-culturally adapted German version of the EBPI, an instrument with evidence of sufficient reliability [14] and construct validity [4].

Despite these limitations, our study presents several strengths. This is the first survey to systematically assess self-reported adherence to EBP across healthcare professionals in Germany. In addition, we also explored a broad set of potential facilitators and barriers regarding EBP implementation into clinical practice, which constitutes a crucial component for implementing research evidence into routine clinical practice [62].

Although our sample size did not arrive to be representative for the entire group of healthcare professionals in Germany, we reached 889 respondents across 9 professions, which is comparable to other international nationwide surveys [39] across healthcare professionals [14].

Regarding the univariate logistic regression analysis, we decided to draw influencing factors which were previously used [4] in similar studies, which constitutes a sound methodological approach recommended for exploratory regression analysis [15].

A further strength of this study was the use of the “snowball-principle”, which led to the involvement of many national journals, newspapers, professional societies, informal social media groups and other ways to distribute the survey nationwide to as many potential participants as possible [14]. All healthcare professionals working in Germany were able to access our survey online without any preceding restrictions, such as a password [14, 55].

Conclusion

The significance of our study is based on the focus on assessing EBP adherence across different healthcare professions in Germany. We used a validated and established questionnaire to assess various dimensions of EBP adherence in various clinical settings. Our results demonstrated that most respondents had a generally positive attitude towards EBP and considered it an important aspect of high-quality care. Respondents were more cautious in how far EBP respects individual differences between patients or leaves them autonomous in their individual clinical decision, mirroring an incomplete understanding of EBP. However, EBP and clinical guidelines were both rated as helpful for making better clinical decisions. Our data showed that, although training pathways are distinct from international standards, German healthcare professionals experience similar barriers towards the implementation of EBP in clinical practice. Major influencing factors for the adherence to EBP identified were the time for scientific literature at work, the (highest) professional degree, as well as the involvement in drafting scientific publications or hosting EBP workshops. Our results were in agreement with findings from previous international studies investigating EBP adherence among healthcare professionals with various academic educational biographies. Some of the barriers to EBP adherence were identified to be work place related, such as the time for and availability of scientific literature at work, requiring changes to the current German healthcare infrastructure. Other factors, such as a higher academic degree, are more related to the underlying German healthcare educational system, which modification would warrant a change in the German educational policy of healthcare professionals.

Availability of data and materials

The datasets used and/or analysed is this study are available from the corresponding author upon reasonable request.

Abbreviations

CHERRIES:

Checklist for Reporting Results of Internet E-Surveys

CI:

Confidence interval

EBP:

Evidence-based practice

EBPI:

Evidence-based Practice Inventory

OR:

Odds ratio

PhysTh-AprV:

Ausbildungs- und Prüfungsverordnung für Physiotherapeuten (German Training and Examination Regulations for Physical therapists)

SAMPL:

Guideline for Statistical Analyses and Methods in the Published Literature’

STROBE:

Checklist for Strengthening the Reporting of Observational Studies in Epidemiology

References

  1. Dawes M, Summerskill W, Glasziou P, Cartabellotta A, Martin J, Hopayian K, et al. Sicily statement on evidence-based practice. BMC Med Educ. 2005;5(1):1.

    Article  PubMed  PubMed Central  Google Scholar 

  2. Wennberg DE, Wennberg JE. Addressing variations: is there hope for the future? Health Aff (Millwood). 2003;Suppl Web Exclusives:W3-614–7.

    Google Scholar 

  3. Gray M. Value based healthcare. BMJ. 2017;356:j437.

    Article  PubMed  Google Scholar 

  4. Kaper NM, Swennen MH, van Wijk AJ, Kalkman CJ, van Rheenen N, van der Graaf Y, et al. The “evidence-based practice inventory”: reliability and validity was demonstrated for a novel instrument to identify barriers and facilitators for Evidence Based Practice in health care. J Clin Epidemiol. 2015;68(11):1261–9.

    Article  PubMed  Google Scholar 

  5. Sackett DL. Evidence-based medicine. Semin Perinatol. 1997;21(1):3–5.

    Article  CAS  PubMed  Google Scholar 

  6. Grol R, Grimshaw J. From best evidence to best practice: effective implementation of change in patients’ care. The Lancet. 2003;362(9391):1225–30.

    Article  Google Scholar 

  7. Flores-Mateo G, Argimon JM. Evidence based practice in postgraduate healthcare education: a systematic review. BMC Health Serv Res. 2007;7(1):119.

    Article  PubMed  PubMed Central  Google Scholar 

  8. Voigt-Radloff S, Lang B, Antes G. Potentials for research and innovations in allied health professions in Germany. Z Evid Fortbild Qual Gesundhwes. 2014;108(Suppl 1):S4-8.

    Article  PubMed  Google Scholar 

  9. Konrad R, Konrad A, Geraedts M. Physiotherapy Education in Germany: Ready for Direct Access? Gesundheitswesen. 2017;79(7):e48–55.

    CAS  PubMed  Google Scholar 

  10. Plappert C, Graf J, Simoes E, Schönhardt S, Abele H. The academization of midwifery in the context of the amendment of the German Midwifery Law: current developments and challenges. Geburtshilfe Frauenheilkd. 2019;79(8):854–62.

    Article  PubMed  PubMed Central  Google Scholar 

  11. Küther G. Die Akademisierung der therapeutischen Gesundheitsfachberufe in Deutschland: Eine Übersicht über bisherige Entwicklungen. Physikalische Medizin, Rehabilitationsmedizin, Kurortmedizin. 2013;23(04):205–12.

    Article  Google Scholar 

  12. von Elm E, Altman DG, Egger M, Pocock SJ, Gotzsche PC, Vandenbroucke JP. The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) Statement: guidelines for reporting observational studies. International journal of surgery (London, England). 2014;12(12):1495–9.

    Article  Google Scholar 

  13. Eysenbach G. Improving the quality of web surveys: the Checklist for Reporting Results of Internet E-Surveys (CHERRIES). J Med Internet Res. 2004;6(3):e34.

    Article  PubMed  PubMed Central  Google Scholar 

  14. Braun T, Ehrenbrusthoff K, Bahns C, Happe L, Kopkow C. Cross-cultural adaptation, internal consistency, test-retest reliability and feasibility of the German version of the evidence-based practice inventory. BMC Health Serv Res. 2019;19(1):455-.

    Article  PubMed  PubMed Central  Google Scholar 

  15. Kalil AC, Mattei J, Florescu DF, Sun J, Kalil RS. Recommendations for the assessment and reporting of multivariable logistic regression in transplantation literature. Am J Transplant Off J Am Soc Transplant Am Soc Transplant Surg. 2010;10(7):1686–94.

    Article  CAS  Google Scholar 

  16. Braun T, Ehrenbrusthoff K, Bahns C, Happe L, Kopkow C. Adhärenz und Einflussfaktoren evidenzbasierter Praxis in der physiotherapeutischen Versorgung in Deutschland – eine Querschnittstudie. Z Evid Fortbild Qual Gesundhwes. 2022;168:8–20.

    Article  PubMed  Google Scholar 

  17. Triandis HC. Values, attitudes, and interpersonal behavior. Nebr Symp Motiv. 1980;27:195–259.

    CAS  PubMed  Google Scholar 

  18. Orbell S, Sheeran P. ‘Inclined abstainers’: A problem for predicting health-related behaviour. Br J Soc Psychol. 1998;37(2):151–65.

    Article  PubMed  Google Scholar 

  19. Kahneman D. A Perspective on Judgment and Choice: Mapping Bounded Rationality. Am Psychol. 2003;58(9):697–720.

    Article  PubMed  Google Scholar 

  20. Khammarnia M, Haj Mohammadi M, Amani Z, Rezaeian S, Setoodehzadeh F. Barriers to Implementation of Evidence Based Practice in Zahedan Teaching Hospitals, Iran, 2014. Nutr Res Pract. 2015;2015:5.

    Google Scholar 

  21. Moore JL, Friis S, Graham ID, Gundersen ET, Nordvik JE. Reported use of evidence in clinical practice: a survey of rehabilitation practices in Norway. BMC Health Serv Res. 2018;18(1):379.

    Article  PubMed  PubMed Central  Google Scholar 

  22. Yahui HC, Swaminathan N. Knowledge, attitudes, and barriers towards evidence-based practice among physiotherapists in Malaysia. Hong Kong Physiother J. 2017;37:10–8.

    Article  PubMed  PubMed Central  Google Scholar 

  23. Salbach NM, Jaglal SB, Korner-Bitensky N, Rappolt S, Davis D. Practitioner and organizational barriers to evidence-based practice of physical therapists for people with stroke. Phys Ther. 2007;87(10):1284–303.

    Article  PubMed  Google Scholar 

  24. Osthus AA, Aarstad AK, Olofsson J, Aarstad HJ. Head and neck specific Health Related Quality of Life scores predict subsequent survival in successfully treated head and neck cancer patients: a prospective cohort study. Oral Oncol. 2011;47(10):974–9.

    Article  PubMed  Google Scholar 

  25. Spitaels D, Hermens R, Van Assche D, Verschueren S, Luyten F, Vankrunkelsven P. Are physiotherapists adhering to quality indicators for the management of knee osteoarthritis? An observational study. Manual Therapy. 2016;27:112–23.

    Google Scholar 

  26. Jette DU, Bacon K, Batty C, Carlson M, Ferland A, Hemingway RD, et al. Evidence-based practice: beliefs, attitudes, knowledge, and behaviors of physical therapists. Phys Ther. 2003;83(9):786–805.

    Article  PubMed  Google Scholar 

  27. Heiwe S, Kajermo KN, Tyni-Lenne R, Guidetti S, Samuelsson M, Andersson IL, et al. Evidence-based practice: attitudes, knowledge and behaviour among allied health care professionals. Int J Qual Health Care. 2011;23(2):198–209.

    Article  PubMed  Google Scholar 

  28. Straus SE, Jones G. What has evidence based medicine done for us? BMJ. 2004;329(7473):987–8.

    Article  PubMed  PubMed Central  Google Scholar 

  29. Sackett DL, Rosenberg WM, Gray JA, Haynes RB, Richardson WS. Evidence based medicine: what it is and what it isn’t. BMJ. 1996;312(7023):71–2.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  30. Hoffmann TC, Montori VM, Del Mar C. The Connection Between Evidence-Based Medicine and Shared Decision Making. JAMA. 2014;312(13):1295–6.

    Article  CAS  PubMed  Google Scholar 

  31. Hoffmann TC, Bennett S, Tomsett C, Del Mar C. Brief training of student clinicians in shared decision making: a single-blind randomized controlled trial. J Gen Intern Med. 2014;29(6):844–9.

    Article  PubMed  PubMed Central  Google Scholar 

  32. Albarqouni L, Hoffmann T, Glasziou P. Evidence-based practice educational intervention studies: a systematic review of what is taught and how it is measured. BMC Med Educ. 2018;18(1):177.

    Article  PubMed  PubMed Central  Google Scholar 

  33. Borgetto B, Räbiger J, Rottenecker J, Hansen H, Pfingsten A, Wasner M. Akademisierung: die vollständige hochschulische Ausbildung in der Ergotherapie, Logopädie und Physiotherapie ist notwendig und machbar. Physioscience. 2019;15(01):41–2.

    Article  Google Scholar 

  34. Wong CHL, Wu IXY, Cheung WKW, Ho RST, Leach MJ, Peng W, et al. Impact of evidence-based healthcare education for Chinese medicine practitioners: a pre-post evaluation. Complement Ther Med. 2019;45:38–44.

    Article  PubMed  Google Scholar 

  35. Scurlock-Evans L, Upton P, Upton D. Evidence-Based Practice in physiotherapy: a systematic review of barriers, enablers and interventions. Physiotherapy. 2014;100(3):208–19.

    Article  PubMed  Google Scholar 

  36. Guyatt GH, Meade MO, Jaeschke RZ, Cook DJ, Haynes RB. Practitioners of evidence based care. Not all clinicians need to appraise evidence from scratch but all need some skills. Bmj. 2000;320(7240):954–5.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  37. Philibert DB, Snyder P, Judd D, Windsor MM. Practitioners’ reading patterns, attitudes, and use of research reported in occupational therapy journals. Am J Occup Ther. 2003;57(4):450–8.

    Article  PubMed  Google Scholar 

  38. Knops AM, Vermeulen H, Legemate DA, Ubbink DT. Attitudes, awareness, and barriers regarding evidence-based surgery among surgeons and surgical nurses. World J Surg. 2009;33(7):1348–55.

    Article  PubMed  PubMed Central  Google Scholar 

  39. Upton D, Upton P. Knowledge and use of evidence-based practice by allied health and health science professionals in the United Kingdom. J Allied Health. 2006;35(3):127–33.

    PubMed  Google Scholar 

  40. Altin S, Passon A, Kautz-Freimuth S, Berger B, Stock S. A qualitative study on barriers to evidence-based practice in patient counseling and advocacy in Germany. BMC Health Serv Res. 2015;15:317.

    Article  PubMed  PubMed Central  Google Scholar 

  41. Dawes M, Summerskill W, Glasziou P, Cartabellotta A, Martin J, Hopayian K, et al. Sicily statement on evidence-based practice. BMC Med Educ. 2005;5(1):1.

    Article  PubMed  PubMed Central  Google Scholar 

  42. Ramis MA, Chang A, Conway A, Lim D, Munday J, Nissen L. Theory-based strategies for teaching evidence-based practice to undergraduate health students: a systematic review. BMC Med Educ. 2019;19(1):267.

    Article  PubMed  PubMed Central  Google Scholar 

  43. Konrad R, Konrad A, Geraedts M. Ausbildung von Physiotherapeutinnen und Physiotherapeuten in Deutschland: Bereit für den Direktzugang? Das Gesundheitswesen. 2017;79(07):e48–55.

    Article  CAS  PubMed  Google Scholar 

  44. Rubin P, Franchi-Christopher D. New edition of Tomorrow’s Doctors. Med Teach. 2002;24(4):368–9.

    Article  CAS  PubMed  Google Scholar 

  45. Shin JH, Haynes RB, Johnston ME. Effect of problem-based, self-directed undergraduate education on life-long learning. CMAJ. 1993;148(6):969–76.

    CAS  PubMed  PubMed Central  Google Scholar 

  46. Khan KS, Coomarasamy A. A hierarchy of effective teaching and learning to acquire competence in evidenced-based medicine. BMC Med Educ. 2006;6:59.

    Article  PubMed  PubMed Central  Google Scholar 

  47. Zwolsman SE, van Dijk N, Te Pas E, Wieringa-de WM. Barriers to the use of evidence-based medicine: knowledge and skills, attitude, and external factors. Perspect Med Educ. 2013;2(1):4–13.

    Article  PubMed  PubMed Central  Google Scholar 

  48. Dizon JM, Grimmer-Somers KA, Kumar S. Current evidence on evidence-based practice training in allied health: a systematic review of the literature. Int J Evid Based Healthc. 2012;10(4):347–60.

    Article  PubMed  Google Scholar 

  49. Hecht L, Buhse S, Meyer G. Effectiveness of training in evidence-based medicine skills for healthcare professionals: a systematic review. BMC Med Educ. 2016;16:103.

    Article  PubMed  PubMed Central  Google Scholar 

  50. Draaisma E, Maggio LA, Bekhof J, Jaarsma ADC, Brand PLP. Impact of deliberate practice on evidence-based medicine attitudes and behaviours of health care professionals. Perspect Med Educ. 2021;10(2):118–24.

    Article  PubMed  Google Scholar 

  51. Kirkpatrick JD, Kirkpatrick WK. Kirkpatrick’s four levels of training evaluation: association for Talent Development. 2016.

    Google Scholar 

  52. Al Zoubi FM, French SD, Patey AM, Mayo NE, Bussières AE. Professional barriers and facilitators to using stratified care approaches for managing non-specific low back pain: a qualitative study with Canadian physiotherapists and chiropractors. Chiropr Man Therap. 2019;27:68.

    Article  PubMed  PubMed Central  Google Scholar 

  53. Tilson JK, Mickan S, Sum JC, Zibell M, Dylla JM, Howard R. Promoting physical therapists’ use of research evidence to inform clinical practice: part 2–a mixed methods evaluation of the PEAK program. BMC Med Educ. 2014;14:126.

    Article  PubMed  PubMed Central  Google Scholar 

  54. Eaton LH, Meins AR, Mitchell PH, Voss J, Doorenbos AZ. Evidence-based practice beliefs and behaviors of nurses providing cancer pain management: a mixed-methods approach. Oncol Nurs Forum. 2015;42(2):165–73.

    Article  PubMed  PubMed Central  Google Scholar 

  55. Braun T, Ehrenbrusthoff K, Bahns C, Happe L, Nordbruch L, Kopkow C. Interkulturelle adaption und test-retest Reliabilität der Deutschen version des „ evidence-based practice inventory. Luebeck, Germany: 3 Forschungssymposim Physiotherapie; 2018.

    Google Scholar 

  56. Bundesärztekammer. Gesamtzahl der Ärzte in Deutschland im Zeitraum von 1990 bis 2019 (in 1.000) Statista. 2020. Available from: https://de.statista.com/statistik/daten/studie/158869/umfrage/anzahl-der-aerzte-in-deutschland-seit-1990/.

    Google Scholar 

  57. Bundesagentur für Arbeit. Anzahl der sozialversicherungspflichtig beschäftigten Krankenschwestern, -pfleger, Hebammen und Rettungsdienstler in Deutschland von 1999 bis 2020: Statista; 2020. Available from: https://de.statista.com/statistik/daten/studie/243449/umfrage/anzahl-der-beschaeftigten-krankenschwestern-und-hebammen-in-deutschland/. Updated 13. Oct 2020.

  58. PhysioDeutschland DVfPZeV. Zahlen, Daten, Fakten aus berufsrelevanten Statistiken. 2018. Availble from: https://www.physiodeutschland.de/fileadmin/data/bund/Dateien_oeffentlich/Beruf_und_Bildung/Zahlen__Daten__Fakten/Zahlen-Daten-Fakten_01.pdf.

    Google Scholar 

  59. Dillman DA. Mail and Internet surveys: The tailored design method--2007 Update with new Internet, visual, and mixed-mode guide. Hoboken: Wiley; 2011.

  60. Statistisches Bundesamt. Zahl der Woche vom 27. Juni 2017: Erwerbstätige sind im Durchschnitt 43 Jahre alt. 2017. Available from: https://www.destatis.de/DE/PresseService/Presse/Pressemitteilungen/zdw/2017/PD17_26_p002.html.

    Google Scholar 

  61. Dysart AM, Tomlin GS. Factors related to evidence-based practice among U.S. occupational therapy clinicians. Am J Occup Ther. 2002;56(3):275–84.

    Article  PubMed  Google Scholar 

  62. Thompson C, McCaughan D, Cullum N, Sheldon T, Raynor P. Barriers to evidence-based practice in primary care nursing–why viewing decision-making as context is helpful. J Adv Nurs. 2005;52(4):432–44.

    Article  PubMed  Google Scholar 

  63. Fernández-Domínguez JC, Sesé-Abad A, Morales-Asencio JM, Oliva-Pascual-Vaca A, Salinas-Bueno I, de Pedro-Gómez JE. Validity and reliability of instruments aimed at measuring Evidence-Based Practice in Physical Therapy: a systematic review of the literature. J Eval Clin Pract. 2014;20(6):767–78.

    Article  PubMed  Google Scholar 

Download references

Acknowledgements

We would like to thank all the respondents for participating in this study, and all colleagues for distributing the survey via personal communication. We highly appreciate the support of the “Deutsche Gesellschaft für Physiotherapiewissenschaften” (DGPTW; www.dgptw.org) for the research collaboration within this project. We would also like to express our sincere thanks to all universities, research centres, institutions, professional societies, journals, newspapers, social media groups and to all people who supported the project and distributed the survey. We further acknowledge the support in data acquisition by Lili-Sophie Nordbruch. We thank Nina Kaper for the supportive and kind collaboration.

Funding

Open Access funding enabled and organized by Projekt DEAL. This research was funded by an intramural grant from the Hochschule für Gesundheit Bochum (University of Applied Sciences; QVM2017–70). The funder had no role in study design, data collection, analysis and interpretation, decision to publish, or preparation of the manuscript.

Author information

Authors and Affiliations

Authors

Contributions

Study concept and design: KE, TB, CB, LH, CK. Acquisition of data: KE, TB, CB, LH, CK. Analysis of data: KE, TB, CB, LH. Interpretation of data: KE, TB, CB, LH, CK. Manuscript drafting: KE. Manuscript revision for important intellectual content: TB, CB, LH, CK. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Katja Ehrenbrusthoff.

Ethics declarations

Ethics approval and consent to participate

Approval was obtained from the Ethical Review Board of the German Confederation for Physiotherapy (registration number: 2017–13). The introductory text of the survey informed the participants that the survey was part of a scientific project and that the results were to be presented anonymously. Participation was optional. Consent for participation was assumed when participants submitted their completed questionnaire online. No cookies were used to assign a unique user identifier to each respondent’s computer. The respondents’ IP addresses were not available in the “SoSci Survey” analysis. Thus, it was not possible for the assessors to allocate individual respondents. No other techniques to analyse the log file for identification of multiple entries were used. No incentives were offered for participation.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1.

Online Survey (in English language).

Additional file 2.

Media used to inform the community of healthcare professionals in Germany about the online survey.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ehrenbrusthoff, K., Braun, T., Bahns, C. et al. Adherence to evidence-based practice across healthcare professionals in Germany: results from a cross-sectional, nationwide survey. BMC Health Serv Res 22, 1285 (2022). https://doi.org/10.1186/s12913-022-08682-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12913-022-08682-z

Keywords