Skip to main content

Measuring care coordination in German primary care – adaptation and psychometric properties of the Medical Home Care Coordination Survey

Abstract

Background

Continuity of care is associated with many benefits for patients and health care systems. Therefore measuring care coordination - the deliberate organization of patient care activities between two or more participants - is especially needed to identify entries for improvement. The aim of this study was the translation and cultural adaptation of the Medical Home Care Coordination Survey (MHCCS) into German, and the examination of the psychometric properties of the resulting German versions of the MHCCS-P (patient version) and MHCCS-H (healthcare team version).

Methods

We conducted a paper-based, cross-sectional survey in primary care practices in three German federal states (Schleswig-Holstein, Hamburg, Baden-Württemberg) with patients and health care team members from May 2018 to April 2019. Descriptive item analysis, factor analysis, internal consistency and convergent, discriminant and predictive validity of the German instrument versions were calculated by using SPSS 25.0 (Inc., IBM).

Results

Response rates were 43% (n = 350) for patients and 34% (n = 141) for healthcare team members. In total, 300 patient questionnaires and 140 team member questionnaires could be included into further analysis. Exploratory factor analyses resulted in three domains in the MHCCS-D-P and seven domains in the MHCCS-D-H: “link to community resources”, “communication”, “care transitions”, and additionally “self-management”, “accountability”, “information technology for quality assurance”, and “information technology supporting patient care” for the MHCCS-D-H. The domains showed acceptable and good internal consistency (α = 0.838 to α = 0.936 for the MHCCS-D-P and α = 0.680 to α = 0.819 for the MHCCS-D-H).

As 77% of patients (n = 232) and 63% of health care team members denied to have or make written care plans, items regarding the “plan of care” of the original MHCCS have been removed from the MHCCS-D.

Conclusions

The German versions of the Medical Home Care Coordination Survey for patients and healthcare team members are reliable instruments in measuring the care coordination in German primary care practices. Practicability is high since the total number of items is low (9 for patients and 27 for team members).

Peer Review reports

Background

Continuity of care is associated with benefits for patients and health care systems such as increased patient satisfaction, greater adherence to medical advice, decreased use of hospital services and even lower mortality rates [1]. Care coordination as one important aspect of continuity of care is defined as “the deliberate organization of patient care activities between two or more participants (including the patient) involved in a patient’s care to facilitate the appropriate delivery of health care services. Organizing care involves the marshalling of personnel and other resources needed to carry out all required patient care activities, and is often managed by the exchange of information among participants responsible for different aspects of care” [2].

The Patient-Centered Medical Home (PCMH) as an example for a model of delivering primary care aspires to expand the existing primary health care in the following five functions: comprehensiveness of care, patient-centered health care, coordination of care, accessibility of services and quality and safety [3, 4]. The PCMH has been implemented in the US-American health care system and showed promising results related to clinical outcomes, utilization of health care services and costs [5, 6]. In 2009, based on international and national primary care concepts the German Advisory Council on the Assessment of Developments in the Health Care System proposed the model of the “Primary Care Practice” as a future-oriented, population-based concept in German primary care [7]. Key feature is a team-based, patient-centered approach containing elements of the PCMH in order to resolve shortcomings of the German health care system that were all attributed to various coordination challenges [7]. In 2019, care coordination deficits were still visible in German primary care in comparison to ten other countries [8]. In particular the exchange of relevant information about patients between primary care physicians and specialists and the information technology that facilitates care coordination with patients and other clinical providers have potential for improvement [8].

In Germany, primary care of the adult population is delivered by specialists in family medicine, specialists in internal medicine and general practitioners without further specialization [9]. The German health system allows patients to choose their physicians in primary as well as in secondary care [10]. A contact with the primary care physician to get access to secondary care is not necessary, which complicates care coordination efforts. However, there are approaches to foster the gate keeping role of primary care physicians. The “general practitioner centered care” stipulates that referrals to medical specialists in secondary care “are preceded by relevant diagnostic procedures and treatments [at the primary care physician] and, in case of referral, the findings are clearly communicated to medical specialists and backwards” [11]. Participation in this program is voluntary for physicians and patients, and comes with an about 40% additional reimbursement for enrolled patients [11].

Physicians working in German primary care are usually self-employed in individual or joint practices or medical treatment centers [12], whereat office-based single handed primary care physicians dominate [10]. It is reported that primary care physicians in Germany experience noticeable time constraints during patient visits, which further impedes the task of care coordination [13]. Thus, German primary care physicians were found to ask less questions and give less advice than physicians in Great Britain or the US [14, 15]. Consistently, primary prevention approaches (e.g. lifestyle counseling) are probably insufficient established in primary care [16]. German primary care physicians are supported by non-physician health professionals in their practice, which are comparable to medical assistants in the US [17]. Facing more complex health needs of patients, their fields of responsibility have been extended from administrative and simple medical tasks to more complex tasks including disease and care management over the last years, provided that additional training is completed [17].

Positive experiences regarding care coordination and access to care received by primary care physicians led to a higher satisfaction with care in German adults [18]. Moreover, a qualitative study showed that patients perceive coordination and continuity of care as very important [19]. Care coordination showed to have positive effects on health-related functional status and the reduction of hospital readmission and healthcare costs [20, 21]. This applies in particular to patients with chronic conditions who benefit from a strong primary care system [22, 23]. However, coordinating the appropriate care for the patient’s needs in the health care system requires good knowledge of the patient and the system itself [24].

For improvement, care coordination needs measurement. Suitable tools must cover for instance different aspects of communication, transfer of information and transition between different health sectors to meet the multidimensional concept. The “Care coordination Measures Atlas” published by the Agency for Healthcare Research and Quality (AHRQ) encompasses a range of tools for evaluating several domains of care coordination [25]. A systematic review of the care coordination landscape showed that none of the included instruments was able to cover all aspects of care coordination defined by the AHRQ [2, 26].

Due to the deficits of the available tools the Medical Home Care Coordination Survey (MHCCS) was developed, containing a patient (MHCCS-P) and a healthcare team version (MHCCS-H) to measure care coordination from both perspectives [27]. The authors of a review that explored tools which evaluate progress during PCMH-transformation concluded that the MHCCS-H was the only instrument out of five that also included items on the comprehensiveness of care, e.g. MHCCS-H item “the primary care practice has behavior change interventions readily available for patients as part of routine care” [28]. Comprehensiveness of care describes “the breadth of services a practice offers to address any health problem at any given stage of patient’s life” [28].

The aim of this study was the translation and cultural adaptation of the MHCCS into German and the examination of the psychometric properties of the resulting German versions of the MHCCS-P and MHCCS-H in order to provide an instrument that is able to measure and, consequently, optimize care coordination in German primary care.

Methods

Study design

The study was carried out as a cross-sectional, paper-based survey.

Translation and cultural adaptation

The translation and cultural adaptation followed the Principles of Good Practice for the Translation and Cultural Adaptation Process by the International Society for Pharmacoeconomics and Outcomes Research (ISPOR) task force [29]. After obtaining permission from the first author of the original publication for the development and validation of the MHCCS, Ianita Zlateva from the Weitzman Institute, USA, two postgraduate family medicine trainees independently translated the English versions of the MHCCS-P and MHCCS-H into German. The results were discussed during two consensus telephone meetings with other researchers in an interdisciplinary team of two physicians (JS, KF), a medical student (AR), a nursing scientist (NF) and a health scientist (AS) in order to reconcile the forward translations into a single forward translation of both the MHCCS-P and the MHCCS-H. The consented versions were back translated. In a back translation review between back translator and one researcher (KF) discrepancies were discussed and solved. The back translations with explanatory notes were sent to Ianita Zlateva who approved those versions. The cognitive debriefing was successfully executed in one primary care teaching practice of the Institute of Family Medicine in Lübeck, Germany. In this teaching practice, the instruments were tested on a small group of respondents from the target populations – all health care team members and patients that were present at the time of the researcher’s practice visit were invited to participate - to check for understandability, cultural relevance and interpretation of the translation [29]. A researcher team (JS, KF, AR) followed through the review of the cognitive debriefing results in order to finalize the German version.

Recruitment and data collection

The recruitment was realized as a convenience sample of teaching and research practices of the Lübeck Institute of Family Medicine in Schleswig-Holstein as well as primary care practices approached by the doctoral candidate AR in Hamburg and Baden-Württemberg. Four primary care practices took part in the healthcare team member survey, whereas eight primary care practices took part in both the healthcare team member survey and the patient survey. Additionally, members of a network of primary care practices in Northern Germany and primary care practice assistants of a continuing education course were invited to participate in the healthcare team member survey. The aim were sample sizes of about 232 patients and 164 healthcare team members as these were the numbers used in the original validation study [27].

Within participating primary care practices, inclusion criteria for both patients and healthcare team members were a minimum age of 18 years and a sufficient knowledge in the German language. Within the interval of one week all patients were invited by the practice team to participate in the survey. The healthcare team included everyone who was involved in the patient’s care to facilitate the appropriate delivery of health care services [2].

Each participant received a paper-based questionnaire and an unlabeled envelope to deposit the completed questionnaire. The envelopes were put into a box, which was sent to the Institute of Family Medicine by the practice team for data analysis. Data collection took place from May 2018 until the end of April 2019.

Measures

The MHCCS-P and MHCCS-H are validated, multidimensional instruments, which assess the structures behind care coordination in primary care practices from the perspective of the patient as well as from the perspective of the healthcare team member [27].

MHCCS-P

The original patient version (MHCCS-P) contains 13 items out of four care coordination domains (plan of care, communication, link to community resources and care transitions).

To quantify the convergent construct validity of the German MHCCS-P the established German version of the European Project on Patient Evaluation of General Practice Care (EUROPEP) was added to the MHCCS-P [30, 31].

The EUROPEP is an internationally validated, multidimensional and established instrument with 23 items measured on a 5-point Likert scale from “poor” to “excellent”. The items are represented by the two dimensions “clinical behaviour” (items 1–16) and “organisation of care” (items 17–23) [32].

The final German version of the patient questionnaire used for this survey consisted of 48 items: 13 items representing the German MHCCS-P measured on 5-point Likert scales (“always”/“agree” to “never”/“disagree”), two overall rating items of received health care and felt care coordination (“very good”/“agree” to “very bad”/“disagree”), four yes/no-questions in between, six sociodemographic items, and 23 German EUROPEP items. Participants could add their comments in a free text box.

MHCCS-H

The team version (MHCCS-H) of the original MHCCS includes 32 items covering eight care coordination domains (Accountability, IT capacity, Follow-up Plan of Care and Self-management in addition to those of the MHCCS-P) [27]. The final German version of the healthcare team member survey included 44 items: 35 items representing the German MHCCS-H, one yes/no-question in between, one overall rating of practice’s care coordination (“very good” to “very bad”) and seven additional items asking for sociodemographic data. Healthcare team members could add their comments in a free text box as well.

Statistical analysis

Statistical analysis was performed using SPSS 25.0 (Inc., IBM). The descriptive analysis of sociodemographic data delineated frequencies with means and standard deviations for the patient and the team survey.

The assessment of psychometric properties comprised an item analysis including descriptive statistics of mean, standard deviation, variance, skewness and kurtosis as well as item difficulty. Values from 20 to 80% are considered preferable [33]. The corrected item-total correlation was calculated in order to assess whether the individual items measure the same construct as the other items as a whole. Correlation values less than 0.3 specified items that did not correspond well with the overall scale [34].

Exploratory factor analyses were carried out to test the construct validities of the MHCCS-P and MHCCS-H. Due to a high number of missing values the approaches with listwise deletion of cases with missing values and the replacement of missing values with the variable mean were compared for the MHCCS-P. In order to test the dimensionality of the domains a principal component analysis (eigenvalue> 1 or retention of a specified number of factors in consideration of the original domain structure, varimax rotation) with extraction of component loadings was performed. Sample suitability was evaluated with the Kaiser-Meyer-Olkin (KMO) criterion. Additionally, the measure of sampling adequacy (MSA) for each item was included in the evaluation of the analysis. Bartlett’s test was used for examining sphericity [34]. The variances of the variables that has been accounted for by the extracted factors (R2) were considered. By showing component loadings λ > 0.3, the items were assigned to that particular component. Reliability was described with Cronbach’s α as a measure for the internal consistency [35].

Convergent, discriminant and predictive validity were calculated using Spearman’s rank order correlation. To determine if the expected measures correlated with the domains convergent validity was tested by correlating the general care given by the primary care practice team with all domains of the German MHCCS-H. For calculating the convergent validity for the German MHCCS-P the resulting domains from factor analysis were correlated with the two EUROPEP dimensions “clinical behaviour” and “organisation of care” [32]. In line with the authors of the original instrument development discriminant validity was calculated by correlating the gender of the team members with the domains for the MHCCS-H and the gender of the patients with the domains of the MHCCS-P to show that no relationships existed with non-related concepts. Thus, the predictive validity, which examines if the instrument is able to predict other important outcomes, was calculated for the MHCCS-P by correlating the domains of the MHCCS-P with both the self-reported general health status and the self-reported overall coordination of care. Correlations between 0.4 and 0.6 represented good correlations [36].

An alpha level p ≤ 0.05 was used for tests of statistical significance.

Ethical approval

Ethical approval was given by the ethics committee of the University of Lübeck (No 17–374) on January 10, 2018. The return of the completed anonymous, paper-based questionnaire in a closed envelope was classified as informed consent.

Results

Translation and cultural adaptation

During the translation process, the expression “the primary care team” was changed into “our primary care team” in the MHCCS-H in order to clarify which team is meant, to make the team members feel more involved and to refer to the style of the patient questionnaire using “my primary care team” throughout the questionnaire. Item 3 of the MHCCS was changed from “The primary care team is characterized by collaboration and trust” to “… characterized by trusting collaboration” to ask specifically for one concept instead of two in one item. Item 5b “The primary care team uses electronic data to monitor and track patient health indicators and outcomes” was divided into two items “…monitor the outcomes of patient treatment” and “…track quality indicators of patient care…”. The item 7c “The primary care team considers and respects patients’ values, beliefs and traditions when recommending treatments” was changed into “Our primary care team considers and respects patients’ individual values when recommending treatments”, since the German word for “individual values” was considered covering “beliefs and traditions” as well.

As German survey response scales usually begin with the positive answer and end with the negative one matching the grading system in school education, all scales were used in reverse order in the German version. Furthermore, since “financial services” as support for patients were not considered as relevant as in the US we deleted this phrase from the example list of support options in item 6a of the patient questionnaire and item 15 of the MHCCS-H. Finally, clearly defined roles in health care teams such as patient self-management education, proactive follow-up and resource coordination were not explicitly known in Germany. Consequently, the consensus team decided to refrain from giving examples of clearly defined roles in item 1 of the MHCCS-H.

Eight patients (four female, four male) completed the consensus version of the German MHCCS-P while cognitive debriefing. It showed that further definitions, e.g. for “chronic disease”, were needed for the patient questionnaire. The response option “This doesn’t apply to me” was added for questions concerning the support needed while having a chronic disease, e.g. “receiving information about rehabilitation programs”. The German MHCCS-H was tested within the cognitive debriefing process by three physicians, seven practice assistants and one practice assistant trainee, overall eleven out of 15 health care team members of this primary care practice. Terms as “care plan” and “electronic data” needed more explanation, which was then added to the questionnaire.

Sociodemographic data of participants

Out of 800 provided patient questionnaires, 350 were returned by participating primary care practices (response rate: 43%). For further analysis, 300 questionnaires were included; seven participants did not meet inclusion criteria and 43 did not visit the primary care practice in the last twelve months (first yes/no-question in the instrument). More than half of the respondents were female (n = 163, 54%). The average age was 55 years, and 149 (50%) declared that they had a chronic disease.

In total, 410 team surveys were provided for participating primary care practices and the network of primary care practices, whereof 141 were returned (response rate: 34%). Out of 140 included questionnaires, the majority was female (n = 119, 85%); the mean age was 41 years (SD 13.2). Job title was provided by 135 participants in a multiple-answer-question resulting in 156 job titles, whereof 89 were practice assistants (57%), 31 primary care physicians (20%) and 36 other job titles (23%), e.g. practice manager or practice assistant with additional qualification. Further details are shown in Table 1.

Table 1 Sociodemographic characteristics of participating patients (n = 300) and healthcare team members (n = 140)

Determination of the psychometric properties of the German MHCCS-P

The descriptive analyses of the items showed means between 1.23 and 2.08 and item difficulties ranging from 5.75 to 27%. The item “my primary care team follows through with the care plan it creates with me” showed lowest variance. “My primary care team helps me to plan ahead so I can take care of my health even when things change or unexpected things happen” exhibited conspicuous skewness (3.349) and kurtosis (13.914). Corrected item-total correlation ranged from 0.341 to 0.933. The lowest corrected item-total correlations were seen for the items of the original domain “plan of care” (0.341 to 0.580). Further details are reported in Table 2.

Table 2 Descriptive statistics of the German MHCCS-P

It was not possible to conduct a factor analysis for the German MHCCS-P including all items and listwise deletion of cases. A factor analysis of all items with the replacement of missing values with the variable mean showed KMO = 0.721 and Bartlett’s test = 0.261. MSA were lowest for the items of the original domain “plan of care” (0.619 to 0.653). Hence, we decided to delete those items from factor analysis supported by the findings from descriptive analysis (low variance, extreme skewness and kurtosis, low item-total correlations). The factor analysis with listwise deletion of cases with missing values resulted in 29 observations included in analysis. Extracting eigenvalues over one resulted in a two-factor-solution with the items of the original domain “care transitions” loading on both factors equally. Because of this observation, the theoretical background of the original domain structure and the consideration of the scree plot we forced the extraction of three factors. The original domains (“link to community resources”, “communication” and “care transitions”) could be confirmed. The item “after I leave the hospital, my primary care team knows about new prescriptions or if there was a change in my medication” loaded on all three factors (λ = 0.462, λ = 0.487 and λ = 0.479) and was assigned to its original domain. In the factor analysis with the replacement of missing values with the variable mean each of the nine items loaded high on only one of the three factors (λ = 0.732 to λ = 0.908). MSA and R2 were high for both approaches and all items. Cronbach’s α ranged between 0.838 and 0.936 for the three domains. Details are shown in Table 3.

Table 3 Structure of the final 3 domain German patient survey as emerged from analysis (9 items, Cronbach’s α = 0.917)

The convergent validity was acceptable with rrho varying between 0.329 and 0.485. It proved that the “clinical behaviour” and the “organisation of care” of the EUROPEP correlated significantly with all domains of the MHCCS-P. Further details are displayed in Table 4.

Table 4 Correlation of “clinical behaviour” and “organisation of care” of the EUROPEP with the domains of the MHCCS-P.

The discriminant validity was not significant with rrho between − 0.139 and − 0.029 (p between 0.231 and 0.713), i.e. the gender of the patients was not correlated with the domains.

The predictive validity was acceptable and significant (p < 0.05) for the self-reported general health correlating with the domains “link to community resources” (rrho = 0.163, p = 0.032) and “communication” (rrho = 0.124, p = 0.049) but not significant for the domain “care transitions” (rrho = 0.109, p = 0.335). The predictive validity for the self-reported coordination of care was acceptable and correlated with all domains with rrho between 0.523 and 0.683 (p < 0.001).

Determination of the psychometric properties of the German MHCCS-H

The descriptive analysis of the items showed means between 1.24 and 3.71. Item difficulties’ values ranged from 6.00 to 67.75%. Corrected item-total correlation showed values from 0.288 to 0.811. Missings were high (> 30%) for the items of the original domains “plan of care” and “follow-up plan of care” since 88 of 140 participants denied that their practice made care plans for their patients. More information are displayed in Table 5.

Table 5 Descriptive statistics of the German MHCCS-H

An exploratory factor analysis with all items and listwise deletion of cases included 23 datasets which is insufficient to describe 35 items. The approach of the replacement of missing values with the variable mean resulted in the inclusion of 140 datasets. This factor analysis showed KMO = 0.790 and Bartlett’s test = 1.000. MSA were lowest for the items “our primary care team gives patients a copy of their care plan” (MSA = 0.431), “our primary care team follows through with the care plans” (MSA = 0.589), “our primary care team uses patients‘ care plans to follow progress” (MSA = 0.616), “someone on our primary care team asks for patients‘ input when making a plan for their care” (MSA = 0.664), “someone on our primary care team helps make care plans that patients can follow in their daily life” (MSA = 0.688), and “when patients are discharged from the hospital and there are test results pending, they will be integrated into the patient records within two weeks” (MSA = 0.685). As a result of those values and the high number of missings in the items of the original domains “plan of care” and “follow-up plan of care” all items regarding the original domains “plan of care” and “follow-up plan of care” and the item “when patients are discharged from the hospital and there are test results pending, they will be integrated into the patient records within two weeks” were excluded from factor analysis. The exploratory factor analysis of the remaining 27 items with listwise deletion of cases with missing values included 88 observations. The Bartlett’s test of sphericity was significant (< 0.001) for all domains, the Kaiser-Meyer-Olkin measure of sampling adequacy (KMO = 0.828) indicated that the sample was suitable for factor analysis. It resulted in the seven domains “accountability”, “information technology for quality assurance”, “information technology supporting patient care”, “self-management”, “communication”, “link to community resources” and “care transitions”. Three items were assigned to other domains in comparison to the original validation study; the domain “IT capacity” was split into “information technology for quality assurance” and “information technology supporting patient care”. Cronbach’s α was acceptable for the domains “accountability” (α = 0.698), “information technology for quality assurance” (α = 0.680), “information technology supporting patient care” (α = 0.690), and “self-management” (α = 0.732), and good for the domains “care transitions” (α = 0.808), “communication” (α = 0.815), and “link to community resources” (α = 0.819). Factor loadings (λ), explained variances (R2) and Cronbach’s α are shown in Table 6.

Table 6 Structure of the final 7 domain German healthcare team survey as emerged from analysis (27 items, Cronbach’s α = 0.926)

The convergent validity was acceptable with rrho ranging from 0.355 to 0.498 (p < 0.001) implying that the domains were associated with the general care given by the primary care team. The calculation of the discriminant validity resulted in rrho between − 0.088 and 0.069 (p value between 0.313 and 0.849). Hence, there was no significant correlation between the gender of the participants and the domains.

Discussion

The MHCCS-P and the MHCCS-H were successfully translated into German, culturally adapted, and examined for their psychometric properties for utilization in the German primary care system.

The instruments were developed to measure care coordination, a core element of the PCMH, from the view of the patients and the healthcare team. Exploratory factor analyses revealed a three-domain MHCCS-D-P and a seven-domain MHCCS-D-H with acceptable or good internal consistencies (α = 0.680 to α = 0.936). While many authors state α ≥ 0.7 as acceptable e.g. [37], it is also argued that this appears to be an artificial threshold [38]. Even low values of 0.5 “do not seriously attenuate validity coefficients” [39]. Scales that are designed to measure seemingly unidimensional concepts with a resulting high Cronbach’s α will have some degree of heterogeneity among the items since there are probably different aspects in these concepts [40]. Since α depends on the length of the scale [40], it can be assumed that a scale with a low number of items tends to show lower α values. All scales in this study with α < 0.8 consisted of only three or four items.

The approach of an exploratory factor analysis seemed appropriate for the testing of psychometric properties of the MHCCS-D because of the differences between the German and the American health care system, e.g. in the accessibility of the health care system in terms of the statutory regulated linkage to health care insurance. In Germany, 99.9% of the population had a health care insurance in 2015, almost 88% in statutory health care institutions [41]. In the United States of America, 91.2% of the population had a health care insurance in 2017; 37.7% were on government coverage [42]. In a comparison between the health care systems, German patients were described as having “no incentive to limit their demand” [43]. Consequences might be more doctors’ consultations in one year per capita of the German population than the population of other major developed countries as seen in the OECD data [44]. Clearly, this might affect the needs in and the status of care coordination measures in different countries. Moreover, the authors of the original publication of instrument development themselves experienced changes from hypothesized item assignment to item assignment in analyses. As a result, a solely confirmative approach seemed too restrictive in order to appreciate the efforts behind the development of the conceptual model and the establishment of content validity by the authors of the MHCCS.

The comprehensive development process of the MHCCS as well as the translation and cultural adaptation process of the MHCCS-D supports content validity of the MHCCS-D. Construct validity was established by exploratory factor analysis revealing relevant domains in the care for people with chronic diseases. Thus, the domains of the MHCCS-D “link to community resources”, “self-management”, “information technology for quality assurance” and “information technology supporting patient care” are also represented in the Chronic Care Model (CCM) [45]. It is known that interventions including at least one CCM element improve clinical outcomes and the quality of life of patients with chronic diseases [46]. Former research based on the CCM suggests that the structure of care in Germany can be improved especially by specific goal setting, care coordination and follow-up [47].

In total, 77% of patients (n = 232) and 63% of health care team members denied to have a written care plan or make written care plans for their patients. It might be concluded that a plan of care is not yet established in German primary care practices. Discrepancies in descriptive item analysis and factor analysis led to the exclusion of the items regarding the plan of care in the final MHCCS-D. However, the use of individual care plans has shown better clinical outcomes as well as better quality of care by primary care physicians [48, 49]. In October 2016, standard medication plans were established on a national level in Germany as a result of varying quality of plans used up to then. Patients have to get a medication plan (including information on registered trade names, active components, dose, dosage form and reminder on how to take the prescribed drugs) if they get three or more different drugs on a regular basis [50]. The further introduction of individual care plans - in addition to medication plans - that are followed through and updated on a regular basis would additionally enhance structure quality [51].

That the concepts “plan of care”, “primary care team” and “primary care practice” are not well-established in Germany was confirmed in this study, in the translation and piloting process as well as in the results, comments and remarks of participants. Hence, the applicability of these terms is not given. Currently, the instrument is being tested with relevant changes in another study.

The MHCCS-D showed acceptable convergent validity with self-reported general care given by the primary care team and with the EUROPEP, an internationally established instrument reflecting indicators for patients to evaluate their perceived quality of care. Additionally, the predictive validity of the MHCCS-D-P was proven for all domains with the self-reported coordination of care suggesting a reliable instrument in order to reflect the quality of care in three domains.

All in all, both instruments can be used in further studies to measure care coordination in German primary care practices with patients’ as well as healthcare team members’ self-assessments. Since the total number of items is low (9 for patients and 27 for team members), practicability is high.

Strengths and limitations

The response rates of 43 and 34% were similar compared to other studies in primary care [52]. The convenient sample of patients led to a female/male-ratio that is similar with other studies performed in primary care [30, 31]. Nearly half of the participants reported having a chronic disease which appears to be higher than in the general population with about 44.2% reporting to have a long-standing illness or health problem in 2017 in Germany [53]. However, it is known that in German primary care practices more than 60% of the patients are older than 60 years and among these patients about 60% suffer from multimorbidity [54].

The authors of the original MHCCS described their patient sample as a “low-income, low-literacy patient population” with higher rates of chronic illness and poorer health outcomes. This was described as both strength and limitation of the study. Inclusion criteria of this study were not restricted to patients with chronic illness in order to test the applicability to the unselected patient population of primary care practices. This approach might lead to a better generalizability of results to a wider patient population without focusing on chronic diseases. However, the transferability of the results to primary care practices and patients in general is not guaranteed, especially because a selection bias of primary care practices is possible due to higher participation interest of practices that are already thinking of ways for improving their care coordination.

Since the patient questionnaire contained further items due to the willingness to evaluate the convergent validity with EUROPEP, healthcare team members might not have invited every patient to participate in this study consecutively, but chose patients they knew better because of regular visits to the practice. The healthcare teams might be interested in not deterring patients from coming back into the practice by burdening them with a time-consuming questionnaire.

Issues with response rate and selection of patients can be approached by repeating this study - after some time or in other areas if necessary - or administrating questionnaires by interviews.

The employed, non-physician health professionals were declared to be 3.8 per primary care practice owner in Germany in 2013 [55]. Our physician/non-physician-ratio of 3.4 is near that number.

Finally, the test-retest reliability was not measured. Therefore, no conclusions about the sensitivity to change can be drawn.

Conclusions

The German versions of the Medical Home Care Coordination Survey for patients and health care team members make care coordination measurable in German primary care practices.

Shortcomings of the German health care system - all attributed to various coordination challenges - can be approached by measuring different aspects of care coordination with these instruments and consequently, they are revealing needs for improvement. As suggested by the authors of the original instrument development the adapted German versions are currently tested in a longitudinal approach to determine whether these instruments are capable of detecting changes in care coordination over time.

Availability of data and materials

The datasets used and analysed during the current study are available from the corresponding author on reasonable request.

Abbreviations

AHRQ:

Agency for Healthcare Research and Quality

MHCCS:

Medical Home Care Coordination Survey

MHCCS-D:

German version of the Medical Home Care Coordination Survey

MHCCS-D-H:

German version of the Medical Home Care Coordination Survey - assessment by healthcare team

MHCCS-D-P:

German version of the Medical Home Care Coordination Survey - assessment by patient

MHCCS-H:

Medical Home Care Coordination Survey – assessment by healthcare team

MHCCS-P:

Medical Home Care Coordination Survey – assessment by patient

ISPOR:

International Society for Pharmacoeconomics and Outcomes Research

EUROPEP:

European Project on Patient Evaluation of General Practice Care

References

  1. Pereira Gray DJ, Sidaway-Lee K, White E, Thorne A, Evans PH. Continuity of care with doctors-a matter of life and death? A systematic review of continuity of care and mortality. BMJ Open. 2018;8(6):e021161. https://doi.org/10.1136/bmjopen-2017-021161.

    Article  PubMed  PubMed Central  Google Scholar 

  2. McDonald KM, Sundaram V, Bravata DM, Lewis R, Lin N, Kraft SA, et al. Care coordination. Volume 7 of: Shojania KG, McDonald KM, Wachter RM, Owens DK, editors. Closing the quality gap: a critical analysis of quality improvement strategies. Technical review 9 (prepared by the Stanford University-UCSF evidence-based practice center under contract 290–02-0017). AHRQ publication no. 04(07)-0051–7. Rockville: Agency for Healthcare Research and Quality; 2007.

  3. American Academy of Family Physicians. Joint principles of the patient-centered medical home. Del Med J. 2008;80:21–2.

    Google Scholar 

  4. Working Party Group on Integrated Behavioral Healthcare, Baird M, Blount A, Brungardt S, Dickinson P, Dietrich A, et al. Joint principles: integrating behavioral health care into the patient-centered medical home. Ann Fam Med. 2014;12(2):183–5. https://doi.org/10.1370/afm.1633.

    Article  Google Scholar 

  5. Veet CA, Radomski TR, D’Avella C, Hernandez I, Wessel C, Swart E, et al. Impact of healthcare delivery system type on clinical, utilization, and cost outcomes of patient-centered medical homes: a systematic review. J Gen Intern Med. 2020;35(4):1276–84. https://doi.org/10.1007/s11606-019-05594-3.

    Article  PubMed  PubMed Central  Google Scholar 

  6. John JR, Jani H, Peters K, Agho K, Tannous WK. The effectiveness of patient-Centred medical home-based models of care versus standard primary Care in Chronic Disease Management: a systematic review and Meta-analysis of randomised and non-randomised controlled trials. Int J Environ Res Public Health. 2020;17(18):6886. https://doi.org/10.3390/ijerph17186886.

    Article  CAS  PubMed Central  Google Scholar 

  7. German Advisory Council on the Assessment of Developments in the Health Care System. Coordination and Integration - Health Care in an Ageing Society. 2009. https://www.svr-gesundheit.de/fileadmin/Gutachten/Sondergutachten_2009/Kurzfassung_engl_2009.pdf. Accessed 25 May 2021.

  8. Doty MM, Tikkanen R, Shah A, Schneider EC. Primary care physicians’ role in coordinating medical and health-related social needs in eleven countries. Health Aff (Millwood). 2019;39(1):115–23. https://doi.org/10.1377/hlthaff.2019.01088.

    Article  PubMed  Google Scholar 

  9. German Social Code. Book V. Statutory Health Insurance. § 73 Kassenärztliche Versorgung, Verordnungsermächtigung. https://www.sozialgesetzbuch-sgb.de/sgbv/73.html. Accessed 15 Aug 2021.

  10. Glonti K, Struckmann V, Alconda A, Pettigrew LM, Hernandez-Santiago V, Minue S, et al. Exploring the training and scope of practice of GPs in England, Germany and Spain. Gac Sanit. 2019;33(2):148–55. https://doi.org/10.1016/j.gaceta.2017.10.011.

    Article  PubMed  Google Scholar 

  11. Wensing M, Szecsenyi J, Stock C, Kaufmann Kolle P, Laux G. Evaluation of a program to strengthen general practice care for patients with chronic disease in Germany. BMC Health Serv Res. 2017;17(1):62. https://doi.org/10.1186/s12913-017-2000-2.

    Article  PubMed  PubMed Central  Google Scholar 

  12. Döring A, Paul F. The German healthcare system. EPMA J. 2010;1(4):535–47. https://doi.org/10.1007/s13167-010-0060-z.

    Article  PubMed  PubMed Central  Google Scholar 

  13. Knesebeck v d, Koens S, Marx G, Scherer M. Perceptions of time constraints among primary care physicians in Germany. BMC Fam Pract. 2019;20:142.

    Article  Google Scholar 

  14. von dem Knesebeck O, Höhne A, Link C, Marceau L, Adams A, Roland M, et al. Talking about smoking in primary care medical practice – results of experimental studies from the US, UK and Germany. Patient Educ Couns. 2012;89(1):51–6. https://doi.org/10.1016/j.pec.2012.04.011.

    Article  PubMed Central  Google Scholar 

  15. von dem Knesebeck O, Gerstenberger E, Link C, Marceau L, Roland M, Campbell S, et al. Differences in the diagnosis and management of type 2 diabetes in three countries (US, UK and Germany): results from a factorial experiment. Med Care. 2010;48(4):321–6. https://doi.org/10.1097/MLR.0b013e3181ca3ffc.

    Article  Google Scholar 

  16. Holmberg C, Sarganas G, Mittring N, Braun V, Dini L, Heintze C, et al. Primary prevention in general practice – views of German general practitioners: a mixed-methods study. BMC Fam Pract. 2014;15(1):103. https://doi.org/10.1186/1471-2296-15-103.

    Article  PubMed  PubMed Central  Google Scholar 

  17. Freund T, Everett C, Griffiths P, Hudon C, Naccarella L, Laurant M. Skill mix, roles and remuneration in the primary care workforce: who are the healthcare professionals in the primary care teams across the world? Int J Nurs Stud. 2015;52(3):727–43. https://doi.org/10.1016/j.ijnurstu.2014.11.014.

    Article  PubMed  Google Scholar 

  18. Altin SV, Stock S. Impact of health literacy, accessibility and coordination of care on patient’s satisfaction with primary care in Germany. BMC Fam Pract. 2015;16(1):148. https://doi.org/10.1186/s12875-015-0372-0.

    Article  PubMed  PubMed Central  Google Scholar 

  19. Droz M, Senn N, Cohidon C. Communication, continuity and coordination of care are the most important patients’ values for family medicine in a fee-for-services health system. BMC Fam Pract. 2019;20(1):19. https://doi.org/10.1186/s12875-018-0895-2.

    Article  PubMed  PubMed Central  Google Scholar 

  20. Berkowitz SA, Parashuram S, Rowan K, Andon L, Bass EB, Bellantoni M, et al. Association of a Care Coordination Model with Health Care Costs and Utilization: the Johns Hopkins Community health partnership (J-CHiP). JAMA Netw Open. 2018;1(7):e184273. https://doi.org/10.1001/jamanetworkopen.2018.4273.

    Article  PubMed  PubMed Central  Google Scholar 

  21. Kastner M, Cardoso R, Lai Y, Treister V, Hamid JS, Hayden L, et al. Effectiveness of interventions for managing multiple high-burden chronic diseases in older adults: a systematic review and meta-analysis. CMAJ. 2018;190(34):E1004–12. https://doi.org/10.1503/cmaj.171391.

    Article  PubMed  PubMed Central  Google Scholar 

  22. Hansen J, Groenewegen PP, Boerma WGW, Kringos DS. Living in a country with a strong primary care system is beneficial to people with chronic conditions. Health Aff (Millwood). 2015;34(9):1531–7. https://doi.org/10.1377/hlthaff.2015.0582.

    Article  PubMed  Google Scholar 

  23. Wensing M, Szecsenyi J, Kaufmann-Kolle P, Laux G. Strong primary care and patients’ survival. Sci Rep. 2019;9(1):10859. https://doi.org/10.1038/s41598-019-47344-9.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  24. Izumi S, Barfield PA, Basin B, Mood L, Neunzert C, Tadesse R, et al. Care coordination: identifying and connecting the most appropriate care to the patients. Res Nurs Health. 2018;41(1):49–56. https://doi.org/10.1002/nur.21843.

    Article  PubMed  Google Scholar 

  25. McDonald KM, Schultz E, Albin L, Pineda N, Lonhart J, Sundaram V, et al. Care coordination atlas version 4 (prepared by Stanford University under subcontract to American Institutes for Research on contract no. HHSA290–2010-00005I). AHRQ publication no. 14–0037- EF. Rockville: Agency for Healthcare Research and Quality; 2014.

    Google Scholar 

  26. Schultz EM, Pineda N, Lonhart J, Davies SM, McDonald KM. A systematic review of the care coordination measurement landscape. BMC Health Serv Res. 2013;13(1):119. https://doi.org/10.1186/1472-6963-13-119.

    Article  PubMed  PubMed Central  Google Scholar 

  27. Zlateva I, Anderson D, Coman E, Khatri K, Tian T, Fifield J. Development and validation of the medical home care coordination survey for assessing care coordination in the primary care setting from the patient and provider perspectives. BMC Health Serv Res. 2015;15(1):226. https://doi.org/10.1186/s12913-015-0893-1.

    Article  PubMed  PubMed Central  Google Scholar 

  28. Quigley DD, Predmore ZS, Hays RD. Tools to gauge Progress during patient- centered medical home transformation. Am J Accountable Care. 2017;5:e8–e18.

    Google Scholar 

  29. Wild D, Grove A, Martin M, Eremenco S, McElroy S, Verjee-Lorenz A, et al. Principles of good practice for the translation and cultural adaptation process for patient-reported outcomes (PRO) measures: report of the ISPOR task force for translation and cultural adaptation. Value Health. 2005;8(2):94–104. https://doi.org/10.1111/j.1524-4733.2005.04054.x.

    Article  PubMed  Google Scholar 

  30. Goetz K, Jossen M, Rosemann T, Hess S, Brodowski M, Bezzola P. Is patient loyalty associated with quality of care? Results of a patient survey over primary care in Switzerland. Int J Qual Health Care. 2019;31(3):199–204. https://doi.org/10.1093/intqhc/mzy142.

    Article  PubMed  Google Scholar 

  31. Goetz K, Campbell S, Rochon J, Klingenberg A, Szecsenyi J. How do chronically ill patients evaluate their medical care? An observational study with 46919 patients in 676 primary care practices of direct relevance to person-centered medicine. Int J Pers Centered Med. 2011;1(2):338–46. https://doi.org/10.5750/ijpcm.v1i2.75.

    Article  Google Scholar 

  32. Grol R, Wensing M, Kersnik J. Patients evaluate general/family practice: the EUROPEP instrument. Nijmegen: The Task Force on Patient Evaluations of General Practice Care; 2000.

    Google Scholar 

  33. Döring N, Bortz J. Forschungsmethoden und Evaluation in den Sozial- und Humanwissenschaften. 5th ed. Berlin: Springer; 2016. https://doi.org/10.1007/978-3-642-41089-5.

    Book  Google Scholar 

  34. Field A. Discovering statistics using IBM SPSS statistics. 4th ed. Thousand Oaks: Sage Publications Ltd.; 2013.

    Google Scholar 

  35. Cronbach LJ. Coefficient alpha and the internal structure of tests. Psychometrika. 1951;16(3):297–334. https://doi.org/10.1007/BF02310555.

    Article  Google Scholar 

  36. Nunnally JC. Psychometric theory. New York: McGraw-Hill; 1978.

    Google Scholar 

  37. Nunnally JC, Bernstein IH. Psychometric theory. 3rd ed. New York: McGraw-Hill; 1994.

    Google Scholar 

  38. Taber KS. The use of Cronbach’s AlphaWhen developing and reporting research instruments in science education. Res Sci Edu. 2018;48(6):1273–96. https://doi.org/10.1007/s11165-016-9602-2.

    Article  Google Scholar 

  39. Schmitt N. Uses and abuses of coefficient alpha. Psychol Assess. 1996;8(4):350–3. https://doi.org/10.1037/1040-3590.8.4.350.

    Article  Google Scholar 

  40. Streiner DL. Starting at the beginning: an introduction to coefficient alpha and internal consistency. J Pers Assess. 2003;80(1):99–103. https://doi.org/10.1207/S15327752JPA8001_18.

    Article  PubMed  Google Scholar 

  41. Federal Statistical Office. Sozialleistungen. Angaben zur Krankenversicherung. 2015. https://www.destatis.de/DE/Themen/Gesellschaft-Umwelt/Gesundheit/Gesundheitszustand-Relevantes-Verhalten/Publikationen/Downloads-Gesundheitszustand/krankenversicherung-mikrozensus-2130110159004.pdf?__blob=publicationFile. Accessed 25 May 2021.

  42. Berchick ER, Hood E, Barnett JC. Health Insurance Coverage in the United States: 2017. https://www.census.gov/content/dam/Census/library/publications/2018/demo/p60-264.pdf.

  43. Ridic G, Gleason S, Ridic O. Comparisons of health Care Systems in the United States, Germany and Canada. Mater Sociomed. 2012;24(2):112–20. https://doi.org/10.5455/msm.2012.24.112-120.

    Article  PubMed  PubMed Central  Google Scholar 

  44. OECD. Doctors' consultations (indicator). 2021. https://doi.org/10.1787/173dcf26-en. Accessed 25 May 2021.

  45. Wagner EH, Austin BT, Davis C, Hindmarsh M, Schaefer J, Bonomi A. Improving chronic illness care: translating evidence into action. Health Aff (Millwood). 2001;20(6):64–78. https://doi.org/10.1377/hlthaff.20.6.64.

    Article  CAS  Google Scholar 

  46. Tsai AC, Morton SC, Mangione CM, Keeler EB. A Meta-analysis of interventions to improve care for chronic illnesses. Am J Manag Care. 2005;11(8):478–88.

    PubMed  PubMed Central  Google Scholar 

  47. Petersen JJ, Paulitsch MA, Mergenthal K, Gensichen J, Hansen H, Weyerer S, et al. Implementation of chronic illness care in German primary care practices – how do multimorbid older patients view routine care? A cross-sectional study using multilevel hierarchical modeling. BMC Health Serv Res. 2014;14(1):336. https://doi.org/10.1186/1472-6963-14-336.

    Article  PubMed  PubMed Central  Google Scholar 

  48. LaGrandeur W, Armin J, Howe CL, Ali-Akbarian L. Survivorship care plan outcomes for primary care physicians, cancer survivors, and systems: a scoping review. J Cancer Surviv. 2018;12(3):334–47. https://doi.org/10.1007/s11764-017-0673-5.

    Article  PubMed  Google Scholar 

  49. Mikkola I, Hagnäs M, Hartsenko J, Kaila M, Winell K. A personalized care plan is positively associated with better clinical outcomes in the Care of Patients with Type 2 diabetes: a cross-sectional real-life study. Can J Diabetes. 2020;44(2):133–8. https://doi.org/10.1016/j.jcjd.2019.05.003.

    Article  PubMed  Google Scholar 

  50. National Association of Statutory Health Insurance Physicians. Medikationsplan. https://www.kbv.de/html/medikationsplan.php. Accessed 25 May 2021.

  51. Steinhaeuser J, Miksch A, Ose D, Glassen K, Natanzon I, Szecsenyi J, et al. Questionnaire of chronic illness care in primary care - psychometric properties and test-retest reliability. BMC Health Serv Res. 2011;11(1):295. https://doi.org/10.1186/1472-6963-11-295.

    Article  PubMed  PubMed Central  Google Scholar 

  52. Cottrell E, Roddy E, Rathod T, Thomas E, Porcheret M, Foster NE. Maximising response from GPs to questionnaire surveys: do length or incentives make a difference? BMC Med Res Methodol. 2015;15(1):3. https://doi.org/10.1186/1471-2288-15-3.

    Article  PubMed  PubMed Central  Google Scholar 

  53. European Commission. Eurostat Database. People having a long-standing illness or health problem, by sex, age and labour status. https://appsso.eurostat.ec.europa.eu/nui/show.do?dataset=hlth_silc_04&lang=en.

  54. van den Bussche H, Schäfer I, Koller D, Hansen H, von Leitner EC, Scherer M, et al. Multimorbidity in the German elderly population - part 1: prevalence in ambulatory medical care. Z Allg Med. 2012;88(9):365–71.

    Google Scholar 

  55. Busse R, Schreyögg J, Stargardt T, editors. Management im Gesundheitswesen: Das Lehrbuch für Studium und Praxis. 3rd ed. Berlin: Springer; 2013. https://doi.org/10.1007/978-3-642-34795-5.

    Book  Google Scholar 

Download references

Acknowledgements

First of all, sincere thanks are given to Ianita Zlateva for providing the original instrument and commenting on the back translation.

Additionally, the authors want to thank Freya Ingendae and Lisa Weinmayr for their support in preparing the initial forward translations of the MHCCS.

Anna Heinrichs is thanked for her direct help in the preparation of the study by being the back translator of the MHCCS to fulfill step 4 in the ISPOR framework for translation and cultural adaptation.

Furthermore, sincere thanks are given to all participating practices, their health care team members and patients for supporting this study.

Funding

This work was supported by the Robert Bosch Foundation [grant number 01000175–001]. The foundation was neither involved in the design of the study, nor the collection, analysis, and interpretation of data and in writing the manuscript. Open Access funding enabled and organized by Projekt DEAL.

Author information

Authors and Affiliations

Authors

Contributions

AR adapted the final German questionnaires based on two translations into German and the results of pilot testing, managed participant recruitment, was responsible for data entry, and drafted the manuscript. KG substantially contributed in data analysis and interpretation as well as in revising the initial manuscript. JS initiated the translation and adaptation process, coordinated the study and substantially contributed in revising the initial manuscript. NF and AS supported the translation process and the cultural adaptation of the MHCCS. Both commented the first draft of the manuscript. KF supported the translation and adaptation process, coordinated this study, performed data analysis and interpretation and finalised the manuscript. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Kristina Flaegel.

Ethics declarations

Ethics approval and consent to participate

This study was carried out in consideration of the Declaration of Helsinki. It was approved by the ethics committee of the University of Lübeck on January 10, 2018 (File reference 17–374). This ethical approval comprised that the need for obtaining explicit written consent from the participants was not felt necessary as this paper-based survey was planned and executed as collection of anonymous data. Participants - patients as well as health care team members - were fully informed in a study information form about the consequences of participation, especially that the return of the questionnaires would result in data publication and will be seen as informed consent for participation. In line with the ethical approval, the return of the completed questionnaire was seen as consent to participate. All returned questionnaires were filed, numbered consecutively with an identification number and entered into a SPSS database.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ringwald, A., Goetz, K., Steinhaeuser, J. et al. Measuring care coordination in German primary care – adaptation and psychometric properties of the Medical Home Care Coordination Survey. BMC Health Serv Res 21, 1134 (2021). https://doi.org/10.1186/s12913-021-07100-0

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12913-021-07100-0

Keywords