- Research article
- Open Access
Development and psychometric properties of a scale for measuring internal participation from a patient and health care professional perspective
BMC Health Services Research volume 13, Article number: 374 (2013)
Effective patient-centred health care requires internal participation, which is defined as interprofessional patient-centred teamwork. Many scales are designed for measuring teamwork from the perspective of one type of health care professional (e.g. physician or nurse), rather than for the use for all health care professionals as well as patients. Hence, this paper’s purpose is to develop a scale for measuring internal participation from all relevant perspectives and to check its psychometric properties.
In a multicentre cross-sectional study, a 6-item Internal Participation Scale (IPS) was developed and administered to 661 health care professionals (staff) and 1419 patients in 15 rehabilitation clinics to test item characteristics, acceptance, reliability (internal consistency) and construct validity. Additionally, we performed an exploratory factor analysis (EFA) to determine the factorial structure and explained variance. Confirmatory factor analysis (CFA) was used to verify the theoretically assumed one-dimensional factorial structure.
A total of 275 health care professionals and 662 patients participated, and the complete data sets of 272 staff members and 536 patients were included in the final analysis. The discrimination index was above .4 for all items in both samples. Internal consistency was very good, with Cronbach’s alpha equalling .87 for the staff and .88 for the patient sample. EFA supported a one-dimensional structure of the instrument (explained variance: 61.1% (staff) and 62.3% (patients)). CFA verified the factorial structure, with the factor loadings exceeding .4 for five of six items in both samples. Global goodness-of-fit indices indicated a good model fit, with a Tucker-Lewis index (TLI) of .974 (staff) and .976 (patients) and a comparative fit index (CFI) of .988 (staff) and .989 (patients). The root mean square error of approximation (RMSEA) amounted to .068 for the patient sample and .069 for the staff sample. There is evidence of construct validity for both populations.
The analysis of the scale’s psychometric properties resulted in good values. The scale is a promising instrument to assess internal participation from the perspective of both patients and staff. Further research should investigate the scale’s psychometric properties in other interprofessional health care settings to examine its generalizability as well as its sensitivity to change.
Patient-centredness is one of the most essential quality and outcome criteria in health care. The concepts about the dimensions of patient-centredness varied widely [1–7]. Some focus exclusively on the patient and physician and their interaction [5–7], while broader concepts include structural and organizational aspects such as access to care, coordination and continuity, information technology, interprofessional teamwork, etc. [2, 4, 8, 9]. Based on the model of integrated patient-centredness [8, 9], the core dimension of patient-centredness is participation – patient participation in the encounter between patient and health care professional (external participation) as well as participation within the interprofessional team of health care professionals (internal participation) [8, 9]. Both participation forms are described through four Cs – communication, cooperation, coordination, and (working) climate (see Figure 1).
Internal participation is a key factor to increase the effectiveness of health care services ; it can help to enhance patient-centredness, patient safety and successful treatment [11–17] and is associated with improved patient satisfaction [17–19] and employee satisfaction  as well as cost savings [11, 20].
The term internal participation is used to describe teamwork, e.g. goal setting, negotiation of roles, leadership, and shared decision-making in health care settings . The aim of internal participation is to create a partnership between health care professionals “in a participatory, collaborative and coordinated approach to shared decision making around health and social issues” of the patients. , p. 11]. Hence, internal participation is defined as teamwork between two or more health care professionals from different disciplines to provide comprehensive services to patients, or in other words interprofessional patient-centred teamwork [9, 22–25].
Several instruments are available to assess teamwork in health care settings [20, 26]. However, none of them have been specifically developed for interprofessional patient-centred teamwork, and none include the patients’ perspective. For example, the current review by Valentine et al.  identified and described 39 surveys designed to measure teamwork, whereof only ten met all criteria of psychometric validity. Among these ten, none measured the dimensions of internal participation with a short scale from the perspectives of health care professionals and patients in health care settings such as rehabilitation clinics.
Medical rehabilitation in Germany mostly takes place in an inpatient setting, where multiple health care professionals (physician, psychologist, occupational therapist, physical therapist, nurse, social worker, etc.) work together in a team to deliver comprehensive patient care. Measuring the patient’s opinion of internal participation is important based on the idea that the patient is an equal partner in treatment and should be involved as a partner in the treatment communication and coordination process . This is substantiated by the fact that in some fields of medicine (e.g. psychosomatics, oncology, and addiction), patients and their families are even involved as members of the treatment team. In addition, the fact that the evaluation by different health care professionals as well as internal evaluation (staff) and external evaluation (patients) often differ significantly underpins the relevance of assessing multiple perspectives. Different perspectives may complement each other to reveal a valid impression of the general situation or document unique characteristics of stakeholder perspectives, respectively. The main benefit is that the stakeholder perspectives could be used as basic information for intervention programmes, such as team development or interprofessional training to enhance patient-orientation.
Since the daily practice in health care organizations is very hectic and internal participation is only one part of measuring patient-centredness, the instrument should be extremely brief, a short scale with five to ten items.
Based on these assumptions, the aim of the study was to develop and psychometrically test a brief instrument (short scale) for measuring internal participation in interprofessional health care settings from a patient and staff perspective.
Study design and population
This study was part of the project “Development and evaluation of a shared-decision-making training program in medical rehabilitation”, which is a multi-centre cluster-randomised controlled study. For the purpose of this study, we used the patient and staff questionnaires of the first data collection period (cross-sectional data).
Twenty-two inpatient medical rehabilitation clinics in southwest Germany originally expressed interest in the study; of these, fifteen took part in both surveys. Each clinic determined a contact person responsible for the study process: all surveys were then sent to this contact person (mostly senior physician or psychologist), who distributed them to the patients at the end of their stay in the rehabilitation clinic and to health care professionals in the treatment team. We only had one contact to patients and sent out one reminder to health care professionals working at the clinics two weeks after the deadline for returning questionnaires.
Inclusion criteria for patients were: chronic disease (somatic or psychosomatic), treated at one of the rehabilitation clinics, age of 18 years or older, sufficient German language abilities, no cognitive impairments and written informed consent. Inclusion criteria for the staff were: health care professional (e.g. physician, nurse, physical therapist, sports teacher, masseur, occupational therapist, psychologist or other psychosocial therapist, dietician or social worker), involvement in a treatment team in the inpatient rehabilitation clinics and direct participation in patient treatment.
The study was approved by the Ethics Committee of the University of Freiburg without any ethical concerns.
Internal participation scale (IPS)
The Internal Participation Scale (IPS) was developed based on theory. The items were selected based on the key dimensions of participation (communication, coordination, cooperation, and climate) in the model of patient-centred interprofessional participation, which is the main part of the model of integrated-patient-centredness [8, 9]. The literature on teamwork assessment underpins the importance of these dimensions [20, 26]. In the review by Valentine et al. , the core dimensions of existing English-language teamwork assessments for health care are communication, coordination, and respect. Therefore we added “respect” as a further dimension of internal participation to the scale with one item. In addition, the development process took into account the two fundamental elements of team functioning in team models (e.g. the model of “team reflexivity”, the Kassel team pyramid) and teamwork questionnaires (e.g. Team Reflexivity Questionnaire, Questionnaire on Teamwork) – task-specific and social elements [28, 29]. Both dimensions proved to be important for high team functioning and team development. Since common tasks can only be managed through effective and efficient patient-centred communication, cooperation and coordination among the different health care professionals, we first developed items to measure these task-oriented aspects of internal participation (items 2–5). To assess the entire spectrum of internal participation two items measuring social-oriented aspects - respect (item 6) and working climate (item 1) – have been newly developed to complete the scale. The final items and their short labels are listed in Table 1.
The IPS was designed for use in patient and in staff surveys. Therefore, its language should be appropriate for both groups. The selection and wording of the items of the IPS were the result of a discussion and consensus process in which three health care research experts (university-based staff of the project) engaged, with feedback from two rehabilitation experts (one quality manager and one senior physician) and three persons with chronic diseases (different ages, genders, and education) with experience as rehabilitation patients.
The items of the scale were rated on a four-point Likert scale, ranging from 1 (does not apply at all), to 2 (does not generally apply), 3 (generally applies) and 4 (fully applies), with the further possibility to tick a box “I can’t judge this”. The scale value was calculated as the mean of the six items and transformed to a scale from 0 (minimal participation) to 100 (maximal participation). When calculating the total score (team score), one missing item was accepted. If more than one item was missing, no total score was calculated.
The items of the IPS were translated from Germana into English by a bilingual professional translator and then translated back by another bilingual professional translator. Then the original German version was compared with the back-translated version. After discussion of the differences in the items, the final English version was generated. The result was again provided to a bilingual speaker for translation into German to confirm the accuracy of the translation process.
Instruments for testing validity
For testing discriminant validity of the IPS, we used the construct “external participation” measured by the 9-item Shared Decision Making Questionnaire (SDM-Q-9) in the patient survey and the Shared Decision Making Questionnaire – physician version (SDM-Q-Doc) in the staff survey. They are both standardised brief instruments (9 items) for assessing shared decision-making (external participation) in clinical encounters. Both instruments were originally developed for physicians and were adapted to all health care professionals in our study. Item and scale characteristics were tested in the study and were comparable with the original version. Furthermore, “health status” (IRES-24) was used for determining discriminant validity for patient data.
For defining convergent validity, the standardised Questionnaire on staff satisfaction in medical rehabilitation was used [33, 34]. It consists of three scales: workplace atmosphere/climate (7 items), leadership (14 items) as well as organization and communication (10 items). All three scales show good to acceptable reliability .
To test convergent validity for the patient population, the established and validated Questionnaire on Patient Satisfaction[35, 36] was applied. It consists of eight items and is based on the American “Client Satisfaction Questionnaire CSQ-8” .
Before analysis, quality was tested by verification of random samples, the items were checked for plausibility, and missing data analysis was performed. If there was more than one missing item in the IPS or more than 30% of items missing in one whole data set of one patient or health care professional, the data set was excluded; otherwise, data was imputed by means of the expectation maximisation algorithm, which is one of the recommended methods to avoid bias even in cases of data missing at random (MAR) .
Descriptive statistics were calculated using SPSS version 20.0, and structural equation modelling (SEM) was carried out using the AMOS software version 20.0 (maximum likelihood method). Acceptance (completion rate of the items in per cent), discrimination (corrected item-total correlation), and difficulty (mean) were used for all items in both samples to describe item characteristics. The reliability of the IPS was measured by calculating internal consistency (Cronbach’s alpha), which is a commonly used statistical parameter. For newly developed scales or surveys, a minimum of .70 Cronbach’s alpha is generally considered acceptable. A good value of Cronbach’s alpha is between .70 and .90. [39–42]. Additionally, the item characteristics were calculated for different subgroups based on organizational (indication field) and demographic characteristics (gender, education, profession, and age) to identify potential differential item functioning.
After conducting an exploratory factor analysis (EFA) to determine the factorial structure and the explained variance of the construct internal participation, confirmatory factor analysis (CFA, structural equation modelling, SEM with AMOS 20.0) was used to verify the theoretically assumed one-dimensional structure. Several global fit measures have been calculated to determine whether the empirical associations are in accordance with the proposed one-dimensional model assumption, normed chi-squared (χ 2/df), comparative fit index (CFI), Tucker-Lewis index (TLI), and Root Mean Square Error of Approximation (RMSEA) were used as Goodness-of-fit indicators. The χ 2-test is the strictest form of model testing  as it tests the equality of information assumed by the model and measured in the empirical covariance matrix. For the normed chi-squared value, a cut off value of ≤ 2.5 is recommended . However, both measures depend critically on sample size, and may lead to inappropriate high power especially in larger samples (N > 300) . Therefore measures of the approximate model fit have been developed. The Root Mean Square Error of Approximation (RMSEA) is the proportion of variance-covariance information not correctly predicted by the model, with values of ≤ .08 indicating an acceptable fit and values ≤ .05 a good fit . In addition the Tucker-Lewis Index (TLI) and the Comparative Fit Index (CFI) were calculated. For these measures, values ≥ .90 are suggested for an acceptable model fit and ≥ .95 for a good model fit [44, 45]. Indicators of local fit were also applied. The proportion of variance of the indicator reliability (IR) explained by the construct should amount to > .40, and the average proportion of variance (AVE) measured by the construct should be > .50 . As criterion for factor reliability (FR), values > .60 are accepted as satisfactory .
Besides these analyses, we examined construct validity of the IPS. The association with similar (convergent validity) and different scales (discriminant validity) was tested using bivariate analysis (Pearson’s correlation coefficient). For discriminant validity, a weak association (r ≤ .4) is expected between the constructs internal participation (IPS) and external participation (SDM-Q-9  or SDM-Q-Doc ) and health status (IRES-24 )), and for convergent validity, a high association (r ≥ .6) is expected between the constructs internal participation (IPS) and satisfaction (staff: Questionnaire on staff satisfaction in medical rehabilitation ; patients: Questionnaire on patient satisfaction [35, 36]).
Sample characteristics of patients
A total of N = 1419 questionnaires were sent out, with N = 662 filled out and returned (response rate = 46.6%). After missing data analysis, a total of 536 complete data sets were included in the current analysis. Table 2 provides a description of the patient sample and shows that more men than women completed the questionnaire. The average age of the patient sample was 52.7 years. The majority of respondents was German and had a low educational level. Almost half of the patients were employed, and more than half were married. Nearly two thirds had undergone treatment in somatic rehabilitation clinics and slightly more than one third in psychosomatic rehabilitation clinics. Of the psychosomatic patients, 25% were in rehabilitation because of addiction. Slightly more than one fourth had suffered from their illness for more than ten years (see Table 2).
Comparing gender and age of the patient sample with the statistics of the German statutory pension insurance scheme  revealed significant differences. When compared to all rehabilitation patients in Germany, the proportion of men in the sample is higher (by approximately 10%). Furthermore, the average age of study patients is three years higher than that of all patients in Germany whose rehabilitation is paid by the German statutory pension insurance scheme .
Sample characteristics of staff
Of 661 questionnaires sent out to staff of the health care teams in the medical rehabilitation clinics, 275 were returned (rate of return: 41.6%). Three questionnaires were excluded because too much information was missing (more than 30% of the total questionnaire), resulting in a total of 272 staff surveys that could be analysed. Table 3 displays the sample characteristics of the staff survey. In contrast to the patient survey, more females (60.3%) than males (34.6%) participated here. Most of the health care professionals were in the age groups ’36 to 45’ (30.1%) and ’46 to 55’ (32.4%), worked full time, and had worked more than five years in the clinic.
Item characteristics and reliability of IPS
Table 4 shows the completion rates of IPS as an indicator of acceptance, item difficulty, and item discriminations. The patient completion rate ranged between 85.1% and 99.3%, with the staff rate slightly higher (93.6% to 99.6%). The mean of the items (difficulty) ranged from 3.36 to 3.63 for patients and 2.84 to 3.22 for the staff on a scale from 1 (does not apply at all) to 4 (fully applies). Corrected item-total correlation (discrimination) was above .4 for all items in both samples, while internal consistency (Cronbach’s alpha) was .878 for patients and .871 for staff. In the exploratory factor analysis, all six items loaded on one factor (explained variance: 61.1% staff, 62.3% patient).
Inter-item correlations for the patient survey ranged from .377 to .733 and for the staff survey from .349 to .686 (see Table 5).
Characteristics of the IPS for subgroups
Table 6 summarises the item characteristics of the IPS for subgroups in both populations, patient and staff. The patient analyses show a discrimination coefficient > .4 for all subgroups. Most of the discrimination coefficients in the staff subgroups are also above .4, with only two below: for item 5 (communication item) in both cases. The difficulty of the items ranges from 2.56 to 3.98, and internal consistency measured by Cronbach’s alpha is higher than .8, except in psychosocial therapists. For the physicians and age group 56 years and older, it is above .9.
The model fit indices in Table 7 indicate that in part, the data insufficiently fit the original model (see especially RMSEA, row original model). Local dependencies between items 1 (climate) and 3 (agreements) and between items 5 (communication) and 6 (respect) were the sources of this problem. Considering these two local dependencies (error correlations, see Figure 2), the thresholds for an acceptable to good model fit was reached. Global goodness-of-fit indices of the modified model showed a good model fit with a normed χ 2 of 2.241 for the staff, but not for the patient sample (normed χ 2 = 3.526). Excellent model fit is reached with a TLI of .974 for staff and .976 for patients and a CFI of .988 and .989, respectively (see Table 7). RMSEA is .069 for the patient survey and .068 for the staff survey.
Despite these local dependencies, the factor loadings of the items on the IPS were high (see Figure 2: final confirmatory factor model). In total, factor loadings exceed .4 for five of six items in both populations. Item 4 (coordination) (.29) in the staff sample and item 1 (climate) (.37) in the patient sample had somewhat lower loadings (see Table 8). The average variance explained is .54 for both samples, and factor reliability is also good for both (.87).
Construct validity of IPS
There was evidence of validity since the scales correlated highly with the related but independent indicators for teamwork. The IPS correlated significantly with organization and communication with a correlation coefficient of .578, with workplace atmosphere/climate to .748, and leadership appraisal to .551 in the staff survey. There was also a significant high correlation (.593) for IPS with patient satisfaction in the patient survey. In contrast, correlation with the non-related individual items was low. Internal participation showed significant low correlation with external participation in both surveys (staff: .249, patients: .262), and there was no association (r = .039) with health status in the patient survey (see Table 9).
Within the context of this study, we developed a short scale for assessing internal participation as seen from the patients’ and staff members’ perspective. The study tested the psychometric properties of the self-compiled IPS and analysed the theoretically assumed one-dimensional structure using a confirmatory factor analysis (CFA). The psychometric properties and reliability are good, and construct validity is evident. The data showed acceptable to good model fit for the modified model, which includes the local dependencies between items 1 (climate) and 3 (agreements), and items 5 (communication) and 6 (respect). However, the correlations between these two pairs of items are low in comparison to the factor loadings. These as well as very good indicator reliability (IR) confirm the fit of the items to the construct internal participation.
The IPS can be recommended for measuring internal participation in an interprofessional health care setting from both the patient and staff point of view. It is a very clear, simple, and effective instrument, and it includes the three most important aspects of teamwork measurement according to Valentine et al. , which are the core competencies of interprofessional collaboration [10, 48].
Its suitability for measuring patient and staff perception of internal participation in a health care setting is an innovative feature in comparison to other scales [20, 26]. To the best of our knowledge, there is no existing scale that measures internal participation from the perspectives of all health care professionals and patients. Including both perspectives can reveal different perceptions. The scale can therefore be applied to identify sub-cultures (e.g., among professional groups) [49–51]. For example, physicians evaluated internal participation more positively than the other health care professionals . From previous studies on teamwork in rehabilitation, we know that these other health care professionals are often not equal partners in the team. Traditionally, there is a strict hierarchical structure in rehabilitation clinics with the physicians being the leaders. In addition, teams often have more of a multidisciplinary team approach (hierarchical and discipline-oriented organization, one-way and mostly bilateral communication, authoritarian leadership, autonomous decision-making) than an interdisciplinary team approach (patient-centred organization, participative leadership, mutual and multilateral communication, and shared decision-making in the team), despite the fact that the latter is more effective [52, 53]. Team interventions could be recommended if there is a high variance between the evaluation results of the different health care professionals in the team.
Due to the economics and simplicity of the short scale, the IPS only measures the most relevant aspects of participation (communication, coordination, cooperation, respect and climate) . The instrument is theory-based [8, 9] and offers very good reliability and validity. The clarity of the construct and the quality of the short scale are scientifically proven.
Some limitations must be considered. Representativeness is limited by the absence of data on non-responders and of general data on the patients of the study clinics; therefore we conducted a comparison with the data of the German statutory pension insurance scheme, which revealed differences concerning average age and gender. Generalizability may be limited by a possible self-selection bias due to the voluntary participation of the clinics, patients and staff. It can be assumed that we were only able to reach motivated clinics, staff and patients. Further selection effects are possible with relation to patients since these were recruited within the rehabilitation clinics.
The staff in some clinics had serious doubts regarding the anonymity of the survey. This could be one explanation for the low but acceptable response rate.
As a further limitation of the study, the questionnaire was not pre-tested. Hence, we cannot make any statements about the quality of the wording of the items, e.g. their readability, comprehensibility or interpretation by patients and staff members. Yet, the survey was conducted without problems, and the participants of the study had no difficulties completing the questionnaire.
The lower acceptance rate especially for the items agreements (item 3), respect (item 6), and communication (item 5) in the patient version (these items were answered more often than others with “I can’t judge this”) indicate that evaluating the internal participation aspects is more difficult for patients than for the health care professionals. This shows a lack of involvement in the team for these patients .
Our findings concerning validity are limited as a result of using only one method (one questionnaire) to assess all constructs.
Concerning the fit indices, the normed chi-squared value exceeds the critical value (χ 2/df > 2.5). All other values indicate good to excellent model fit. Because the normed chi-squared depends critically on sample size, it is recommended to use predominantly TLI, CFI, and RMSEA for the interpretation of model fit if the sample size is higher than 300 . Therefore, this variance is negligible, and the model fits well.
It should also be mentioned that the measurement characteristics are not spontaneously transferable across languages. The results are specific to the German versions of the instrument, making further evaluation of the psychometric properties of the English version essential. The psychometric properties should also be tested in other settings, for example at university hospitals. Further evaluation should also be focused on generalizability of the IPS, underpinning the need for the scale to be applied in other health care settings, especially in acute care hospitals. Furthermore, the IPS should also be tested to determine if the instrument can assess pre-post changes (sensitivity to change).
The Internal Participation Scale is the first short scale which allows measuring patient-centred interprofessional teamwork from the perspectives of all health care professionals as well as patients. It is brief and suitable for use in interprofessional health care settings. The item and scale characteristics are good to excellent.
a The German version of the Internal Participation Scale can be requested by the first author of this article.
Average variance extracted
Confirmatory factor analysis
Comparative fit index
Degree of freedom
Indicators of rehabilitation status questionnaire
Internal participation scale
Missing at random
Root mean square error of approximation
Structural equation modeling
9-item shared decision making questionnaire
Shared decision making questionnaire - physician version
Chi-squared value, (X 2/df), normed Chi-squared value.
Bertarkis KD, Azari R: Determinants and outcomes of patient-centered care. Patient Ed Counsel. 85: 46-52.
Bleses H: PhD thesis. Patient-centeredness as a quality feature, in German. 2005, : Medizinische Fakultät der Charité, http://edoc.hu-berlin.de/dissertationen/bleses-helma-2005-01-24/HTML/.
Cott CA, Teare G, McGilton KS, Lineker S: Reliability and construct validity of the client-centred rehabilitation questionnaire. Disab Rehab. 2006, 28: 1387-1397. 10.1080/09638280600638398.
Green SM, Tuzzio L, Cherkin D: A framework for making patient-centered care front and center. Permanent J. 2012, 16: 49-53.
Hudon C, Fortin M, Haggerty J, Loignon C, Lambert M, Poitras M-E: Patient-centered care in chronic disease management: a thematic analysis of the literature in family medicine. Patient Ed Counsel. 2012, 88: 170-176. 10.1016/j.pec.2012.01.009.
Leplege A, Gzil F, Cammelli M, Lefeve C, Pachoud B, Ville I: Person-centredness: conceptual and historical perspectives. Disab rehab. 2007, 29: 1555-1565. 10.1080/09638280701618661.
Mead N, Bower P: Patient-centredness: a conceptual framework and review of the empirical literature. Soc Sci Med. 2000, 51: 1087-1110. 10.1016/S0277-9536(00)00098-8.
Körner M: A model of shared decision-making in medical rehabilitation, in German. Die Rehab. 2009, 48: 160-165. 10.1055/s-0029-1220748.
Körner M, Steger A-K, Ehrhardt H: Designing an interprofessional training program for shared decision-making. J Int. 2013, 27: 146-154.
D‘Amour D, Ferrada-Videla M, San Martin Rodriguez L, Beaulieu MD: The conceptual basis for interprofessional collaboration: core concepts and theoretical frameworks. J Interprof Care. 2005, 20 (1): 116-131.
Grumbach K, Bodenheimer T: Can health care teams improve primary care practice?. J Am Med Assoc. 2004, 291: 1246-1251. 10.1001/jama.291.10.1246.
Kenaszchuk C, Reeves S, Nickolas D, Zwarenstein M: Validity and reliability of a multiple-group scale for interprofessional collaboration. BMC Health Serv Res. 2010, 10: 83-10.1186/1472-6963-10-83.
Lemieux-Charles L, McGuire WL: What do we know about health care team effectiveness? A review of the literature. Med Care Res Rev. 2006, 63: 263-300. 10.1177/1077558706287003.
O’Leary KJ, Sehgal NL, Terrell G, Williams MV: Interdisciplinary teamwork in hospitals: a review and practical recommendations for improvement. J Hosp Med. 2012, 7 (1): 48-54. 10.1002/jhm.970.
Schmitt MH: Collaboration improves the quality of care: methodological challenges and evidence from US health care research. J Interprof Care. 2001, 15: 47-66. 10.1080/13561820020022873.
Sevin C, Moore G, Shepherd J, Jacobs T, Hupke C: Transforming care teams to provice the best possible patient-centered, collaborative care. J Ambulatory Care Manag. 2009, 32: 24-31. 10.1097/01.JAC.0000343121.07844.e0.
Wagner EH: The role of patient care teams in chronic diseases management. BMJ. 2000, 320: 569-572. 10.1136/bmj.320.7234.569.
Canadian Interprofessional Health Collaborative: A national interprofessional competency framework. http://www.cihc.ca/files/CIHC_IPCompetencies_Feb1210.pdf.
Quaschning K, Körner M, Wirtz M: Analyzing the effects of shared decision-making, empathy and team interaction on patient satisfaction and treatment acceptance in medical rehabilitation using a structural equation modeling approach. Patient Educ Couns. 2013, 91: 167-175. 10.1016/j.pec.2012.12.007.
Valentine MA, Nemhard IM, Edmondson AC: Measuring teamwork in health care settings: a review of survey instruments [working paper]. 2012, http://www.rrsstq.com/stock/fra/publications/P217.pdf.
Baldwin JRDC, Royer JA, Edinberg MA: Maintenance of health care teams: internal and external dimensions. J Interprof Care. 2007, 21 (1): 38-51.
Opie A: Effective team work in health care: a review of issues discussed in recent research literature. Health Care Anal. 1997, 5: 62-73.
Cott C: Structure and meaning in multidisciplinary teamwork. Soc Health Illness. 1998, 20: 848-873. 10.1111/1467-9566.00132.
Reeves S, Lewin S, Espin S, Zwarenstein M: Interprofessional teamwork for health and social care. 2010, Chichester in West Sussex: Wiley-Blackwell
Xyrichis A, Ream E: Teamwork: a concept analysis. J Adv Nurs. 2010, 61: 232-241.
Heinemann GD, Zeiss AM: Team performance in health care: assessment and development. 2002, New York: Kluwer
Martin GP, Finn R: Patients as team members: oppurtunities, challgenges and paradoxes of including patients in multi-professional healthcare teams. Soc Health Ilnesses. 2011, 33: 1050-1065. 10.1111/j.1467-9566.2011.01356.x.
West MA: Effective teamwork. Practical lessons from organizational research. Leicester: Blackwell, 3
Kauffeld S: Teamdiagnose. 2001, Göttingen: Hogrefe
Scholl I, Hoelzel L, Simon D, Loh A, Härter M: The 9-item shared decision making questionnaire (SDM-Q-9). development and psychometric properties in a primary care sample. Patient Educ Couns. 2010, 80: 94-99. 10.1016/j.pec.2009.09.034.
Scholl I, Kriston L, Dirmaier J, Buchholz A, Härter M: Development and psychometric properties of the shared decision making questionnaire - physician version (SDM-Q-Doc). Patient Educ Couns. 2012, 88 (2): 284-290. 10.1016/j.pec.2012.03.005.
Frey C, Bührlen B, Gerdes N, Jäckel W: Handbuch zum IRES-3. Indikatoren des Reha-status, version 3 mit IRES-24 Kurzversion. [Handbook IRES-3 indicators of the rehabilitation status, version 3 with IRES-24 short form, in German]. 2007, Roderer: Regensburg
Farin E, Meixner K, Follert P, Jäckel WH, Jacob A: Satisfaction of co-workers in rehabilitation clinics: Development of the rehabilitation co-worker questionnaire and its application in quality assurance, in German. Die Rehab. 2002, 41: 258-267. 10.1055/s-2002-33271.
Farin E, Meixner K, Jäckel WH: Questionnaire on staff satisfaction in medical rehabilitation, in German. 2000, Freiburg: Abteilung für Qualitätsmanagement und Sozialmedizin, http://www.uniklinik-freiburg.de/aqms/live/DLInstrumente/MiZuRehaVersion.pdf.
Schmidt J, Lamprecht F, Wittmann WW: Satisfaction with inpatient management. Development of a questionnaire and initial validity studies. Psychoth Psychosom Med Psychol. 1989, 39: 248-255.
GfQG - Gesellschaft für Qualität im Gesundheitswesen: Questionnaire on Patient Satisfaction (ZUF-8), in German. http://www.gfqg.de/assessment_zuf8.pdf.
Attkisson CC, Zwick R: The client satisfaction questionnaire. Psychometric properties and correlations with service utilization and psychotherapy outcome. Eval Prog Plann. 1982, 5: 233-237. 10.1016/0149-7189(82)90074-X.
Schafer JL, Graham JW: Missing data: our view of the state of the art. Psychol Methods. 2002, 7 (2): 147-177.
Field A: Discovering statistics using SPSS. 2009, London: Sage, u.a
Kline RB: Principles and practice of structural equation modeling. 2005, New York: Guildford
Lance CE, Butts MM, Michels LC: The sources of four commonly reported cutoff criteria – what did they really say?. Org Res Methods. 2006, 9 (2): 202-220. 10.1177/1094428105284919.
Nunnally JC: Psychometric theory. 1967, New York: McGraw-Hill, Vol 2
Bollen KA: Structural equations with latent variables. 1989, New York u.a: Wiley & Sons
Bentler PM: Comparative fit indexes in structural models. Psychol Bull. 1990, 107 (2): 238-246.
Fornell C, Larcker DF: Evaluating structural equation models with unobservable variables and measurement error. J Mark Res. 1981, 18 (1): 39-50. 10.2307/3151312.
Hair JF, Black WC, Babin BJ, Anderson RE: Multivariate data analysis. 2010, Upper Saddle River: Pearson, 7
German Statutory Pension Insurance Scheme [Deutsche Rentenversicherung]: Statistics of the German Statutory Pension Insurance Scheme, in German. 2010, Berlin: Deutsche Rentenversicherung Bund
Bridges DR, Davidson RA, Odegard PS, Maki IV, Tomkawiak J: Interprofessional collaboration: three best practice models of interprofessional education. Med Ed Online. 2011, 16: meo.v16i0.6035/meo.v16i0.6035
Hall P: Interprofessional teamwork: professional cultures as barriers. J Interprof Care. 2005, 188-196. Suppl. 1
Körner M, Ehrhardt H, Steger AK, Bengel J: Interprofessional SDM train-the-trainer program “Fit for SDM”: provider satisfaction and impact on participation. Patient Educ Couns. 2012, 89: 122-128. 10.1016/j.pec.2012.04.008.
Pecukonis E, Doyle O, Bliss SL: Reducing barriers to interprofessional training: promoting interprofessional cultural competence. J Interprof Care. 2008, 22: 417-428. 10.1080/13561820802190442.
Körner M: Team analysis and team development of multiprofesssional teams in medical rehabilitation. GMS Psychosoc Med. 2008, 5: Doc01.
Körner M: Interprofessional teamwork in medical rehabilitation: a comparison of multidisciplinary and interdisciplinary team approach. Clin Rehabil. 2010, 24: 745-755. 10.1177/0269215510367538.
The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1472-6963/13/374/prepub
The study was a part of a research consortium on patient centredness and chronic diseases funded by the German Ministry of Education and Research and the German statutory pension insurance scheme (project number: 01GX720).
We would like to thank all patients and health care professionals in the rehabilitation clinics who supported the study (AOK-Klinik Korbmattfelsenhof, AOK-Klinik Stoeckenhoefe, Askepios Triberg, DAK-Haus Schwaben, Klinik Bad Herrenalb GmbH, Kliniken Dr. Voetisch, Kurpark-Klinik, Neurologisches Rehabilitationszentrum Quellenhof, Rehabilitationsklinik Birkenbuck, Rehabilitationsklinik Gloecklehof, Rehabilitationsklinik St. Landelin, Reha-Zentrum Todtmoos, Rheintalklinik, Rehabilitationsklinik Hoehenblick, Therapiezentrum Muenzesheim). The authors also acknowledge the research assistance of Anne-Kathrin Steger und Heike Ehrhardt.
The authors declare that they have no competing interests.
MK – Conception and design of the study, data analysis, interpretation of the data, drafting and revising the manuscript, final approval. MW – data analysis, interpretation of the data, revising the manuscript, final approval. Both authors read and approved the final manuscript.
About this article
Cite this article
Körner, M., Wirtz, M.A. Development and psychometric properties of a scale for measuring internal participation from a patient and health care professional perspective. BMC Health Serv Res 13, 374 (2013). https://doi.org/10.1186/1472-6963-13-374
- Internal participation
- Interprofessional collaboration
- Scale development