Skip to main content
  • Research article
  • Open access
  • Published:

Validation of the patient assessment of chronic illness care (PACIC) short form scale in heart transplant recipients: the international cross-sectional bright study

Abstract

Background

Transplant recipients are chronically ill patients, who require lifelong follow-up to manage co-morbidities and prevent graft loss. This necessitates a system of care that is congruent with the Chronic Care Model. The eleven-item self-report Patient Assessment of Chronic Illness Care (PACIC) scale assesses whether chronic care is congruent with the Chronic Care Model, yet its validity for heart transplant patients has not been tested.

Methods

We tested the validity of the English version of the PACIC, and compared the similarity of the internal structure of the PACIC across English-speaking countries (USA, Canada, Australia and United Kingdom) and across six languages (French, German, Dutch, Spanish, Italian and Portuguese). This was done using data from the cross-sectional international BRIGHT study that included 1378 heart transplant patients from eleven countries across 4 continents. To test the validity of the instrument, confirmatory factor analyses to check the expected unidimensional internal structure, and relations to other variables, were performed.

Results

Main analyses confirmed the validity of the English PACIC version for heart transplant patients. Exploratory analyses across English-speaking countries and languages also confirmed the single factorial dimension, except in Italian and Spanish.

Conclusion

This scale could help healthcare providers monitor level of chronic illness management and improve transplantation care.

Trial registration

Clinicaltrials.gov ID: NCT01608477, first patient enrolled in March 2012, registered retrospectively: May 30, 2012.

Peer Review reports

Background

Transplantation needs to be regarded as a chronic condition as patients remain dependent on life-long medical follow-up after transplantation and have to follow a complex therapeutic regimen. Moreover, new co-morbidities develop after transplantation, often due to the side effects of immunosuppressive drugs [1]. Worldwide, transplant recipients are thus part of a growing group of patients living with chronic diseases and multi-morbidity, representing a major burden for communities and healthcare systems in terms of morbidity, disability, mortality and healthcare costs.

Improving care for chronically ill patients implies a system of care that integrates building blocks of the Chronic Care Model [2, 3], i.e. support for self-management, delivery system design (e.g. continuity of care), decision support, clinical information systems, community resources and policies, as well as organization of healthcare. In fact, for more than a decade, the implementation of initiatives targeting better coordination and integration of care for patients with chronic disease based on the Chronic Care Model, has flourished [3,4,5]. Attention to care models in transplantation, based on principles of chronic illness management, has also increased [1, 6], and first evidence shows that reengineering transplant follow-up based on the principles of chronic illness management results in better adherence, clinical outcomes, better quality of life, and less health resource utilization [7, 8].

The Patient Assessment of Chronic Illness Care (PACIC) scale [9] assesses how chronic illness care, from the patient’s perspective, is congruent with the Chronic Care Model [2, 3]. It was developed by Glasgow et al. [9], and to our knowledge, has almost exclusively been used and validated in patient populations with highly prevalent chronic diseases such as diabetes [10,11,12,13,14,15,16], chronic pulmonary obstructive diseases [13], arthritis [17] and heart failure [16, 18]. Whereas these prevalent chronic diseases represent those with the highest societal burden in terms of morbidity, disability, mortality and cost [19,20,21,22], the level of chronic illness care in transplantation remains to be explored. In fact, transplant recipients represent a unique group of patients. They not only live with a chronic condition, as patients are not cured with a transplant, and often present with multiple co-morbidities requiring complex treatments and frequent follow-ups, but are also cared for in tertiary care facilities and always by multiple different healthcare professionals.

The PACIC could be used for assessing the level of chronic illness care in transplantation and provide insights in specific aspects of transplant management that could be improved. Moreover, the PACIC could also be used to benchmark transplant centers in relation to their level of chronic illness management, and this information can be taken into consideration when assessing variability in clinical outcomes among centers.

In this context, the primary goal of our study was to test the validity of the existing English version of the PACIC scale in a new group of patients, namely heart transplant recipients. The secondary – exploratory – goal of our study was to compare, in this population of chronic patients, the similarity of the internal structure of the PACIC across English-speaking countries and across various languages.

Methods

Study design

We performed secondary data-analyses, based on cross-sectional data from the BRIGHT study (Building Research Initiative Group: Chronic Illness Management and Adherence in Transplantation) [23], a multi-center, multi-continental study in heart transplantation aiming at describing chronic illness management practice patterns among centers, countries, and continents in heart transplantation. Detailed information on the BRIGHT study aims and methods can be found elsewhere [23].

Using a multi-stage sampling approach, a convenience sample of countries (i.e. Australia, Belgium, Brazil, Canada, France, Germany, Italy, Spain, Switzerland, the UK and the USA) and heart transplant centers (36 centers and minimally 2 per country) were included. Depending on the number of clinicians eligible, a random sample of a maximum of 5 clinicians per center were recruited in this study, and a random sample of 1677 among the 2523 eligible adult (> 18y) single-organ heart transplant recipients (1–5 years post-transplantation) were approached for participating (proportional sampling based on heart transplantation center volume). Details on inclusion/exclusion criteria and sample size calculation can be found in the BRIGHT methods paper [23].

Sample

Among the 1677 eligible participants, 244 declined and 36 died before completing the questionnaire, leaving 1397 participants. Out of the 1397 heart transplant recipients included in the BRIGHT study, 19 were excluded from our study population as they had not answered any of the PACIC questions/items. Among the 1378 patients who answered at least one PACIC question, 43% answered in English, 16% in Spanish, 13% in French, and less than 10% answered in Italian, in German, in Portuguese and in Dutch, respectively (for details see Fig. 1). Patients came from 36 centers which 11% are from non-urban areas (one Dutch-speaking center and three English-speaking centers) and 17% are from non-university teaching hospitals (three Portuguese-speaking centers and three English-speaking centers). There were 17 English-speaking centers, 5 Spanish-speaking centers, 6 French-speaking centers, four German-speaking centers, three Portuguese-speaking centers, three Italian-speaking centers and one Dutch-speaking center. There was one center with patients answering questionnaires in French, in German or in Italian (Switzerland), and another answering in English or in French (Canada).

Fig. 1
figure 1

Distribution of the sample by language and by countries (within English-speaking countries)

The English population of patients (overall and by countries), which represents the main population of interest of the study, is described in Table 1. The mean age was 54.3 years, 70% of English speaking patients were men, and 52% of the causes underlying heart diseases were for idiopathic cardiomyopathy, 34% for ischemic cardiomyopathy, 4% congenital and 1% for valvular disease. Characteristics of the other language populations are presented in Appendix 1.

Table 1 Characteristics of English-speaking patients

Measures

The BRIGHT study used different sources of information (i.e. patient, clinician, heart transplant program director, medical file) to assess variables of interest, i.e. [1] the BRIGHT patient interview questionnaire, [4] the BRIGHT patient self-report (written) questionnaire, [1] the BRIGHT clinician questionnaire, [6] the BRIGHT transplant director questionnaire, and [7] the BRIGHT medical chart structured data collection form [23]. Following Wild et al. recommendations [24], patient questionnaires were translated from the original English version to Dutch, French, German, Italian, Spanish and Brazilian Portuguese by professional translators in a culturally sensitive way, and then pilot tested (further details are available elsewhere [23]). For this study, we will focus on the BRIGHT patient self-reported data.

To describe our sample, data included patients’ socio-demographics and health information: age (in year), gender (being male yes/no), ethnicity (Caucasian yes/no), education attainment (primary school, secondary school and college/university), employment status (being (self-)employed (part-time/full time paid work) yes/no), Charlson comorbidity index post heart transplantation [25] (19 items with weighted score, total ranging from 0 to 37), causes of underlying heart disease (congenital, ischemic, idiopathic, valvular, other) and number of year since transplantation.

To assess the level of chronic illness care from the patient’s perspective, we used the Patient Assessment of Chronic Illness Care (PACIC). More specifically we used the short version of the PACIC, an eleven-items self-reported measure [11, 18, 26, 27]. Patients were asked to score their care experience over the past 6 months in view of the eleven-items (for entire scale see footnote of Table 2) on a 5-point Likert scale: 1) none of the time, 2) a little of the time, 3) some of the time, 4) most of the time and 5) always.

Table 2 Distribution of the PACIC eleven-items: all English-speaking patients (N = 596)

Finally, we also used questions relating to the transplant team: if the transplant team advised the patient to exercise during the past year (yes/no), if the transplant team discussed about the intake of immunosuppressive drugs in daily life (yes/no), the level of satisfaction with transplant team (mean of twelve questions going from 1 = very dissatisfied to 5 = very satisfied [28]) and the trust in the transplant team (mean of ten questions, going from 1 = strongly disagree’ (low trust) to ‘5= strongly agree’ (high trust) [29]).

Validation process

Following the American Psychological Association guidelines of standards for educational and psychological testing, the validation process for an existing scale is composed by two steps: validation of the internal structure of the scale and the relation to other variables [30]. Actually, since we were not developing a new scale but working with the English version of an existing one, we did not repeat the content and response process steps (necessary to consider when validating a new scale) which had been conducted initially in English by Glasgow and his colleagues [9].

Statistical analyses

First, we conducted descriptive analyses to characterize patients (percentage for ordinal or categorical data; means and standard deviation (SD) for continuous data) according to the language of the questionnaires they filled in, and, for English-speaking patients, according to their country. We also described the distribution of the PACIC eleven-items (mean, standard deviation, median, distribution by response category, and percentage of missing values) for each of these groups.

Second, we followed the first step of the American Psychological Association recommended validation process: validation of the internal structure of the scale. Therefore, we ran confirmatory factor analyses based on a polychoric correlation (correlation estimation between theorized normally distributed continuous latent variables measured through ordinal variables) matrix (weighted least squares estimation method (WLSMV) [31] to test the single dimension factorial structure of the PACIC [11, 18, 26, 27], and its expected internal structure. This type of confirmatory factor analyses was chosen because of the ordinal structure of the data (PACIC items measured on a 5-point Likert scale) [32]. Pairwise deletion technique (available-case analysis) was used with WLSMV to handle missing data.

Third, to explore the extent to which the internal structure was equivalent across English-speaking countries (USA, Canada, Australia and United Kingdom) and languages (French, German, Dutch, Spanish, Italian and Portuguese), we tested three forms of measurement invariance (i.e. measurement equivalence [33]): configural, metric and scalar invariance. This was done by comparing a series of multigroup confirmatory factor analyses gradually increasing model constraints. Whereas configural invariance requires the same factorial structure across groups, metric invariance requires equivalent loading across groups and scalar invariance requires equivalent thresholds across groups (for further details see [34,35,36]). In other words, configural invariance implies the same factorial structure across groups, metric variance implies that the loadings (the “weights” of each item) are similar across groups (i.e. the latent construct is understood similarly across groups) and scalar invariance allows conducting valid mean comparisons across groups. Goodness of fits of the various confirmatory factor analyses models were then tested using the Root Mean Square Error of Approximation (RMSEA) and Weighted Root Mean Square Residual (WRMR, recommended for ordinal data [37]); the latter two were checked jointly because of the sensitivity to misspecified factor loading for the RMSEA [38]. The Tucker Lewis index (TLI) and the Comparative Fit Index (CFI) were also presented since they are less affected by sample size [38, 39]. Models were considered to present a “good fit” if the RMSEA was < 0.05, [40], WRMR < 1.00 [37], TLI > 0.97 and CFI > 0.97 [41]. Models were considered to present an “acceptable fit” if RMSEA’s were between 0.05 and 0.08 and TLI’s and CFI’s between 0.95 and 0.97. For comparability reasons, we also computed ordinal alphas (i.e. ordinal reliability coefficients), instead of the usual Cronbach’s alpha because the latter takes into account the ordinal nature of the variables [42].

Finally, we conducted the second step of the standards for educational and psychological testing: the relation to other variables [30]. After having identified variables that we a priori hypothesized to be related to PACIC scores (i.e. variables related to the transplant team), we used them to explore associations between PACIC scores and the following variables: the transplant team’s advice for exercise during the past year (yes/no), discussion regarding intake of immunosuppressive with the transplant team, patient levels of satisfaction and levels of trust with the transplant team. Our hypotheses were that: a) patients who were advised to exercise will have higher PACIC scores than those who were not; b) patients who discussed intake of immunosuppressive medication with the transplant teams will have higher total PACIC scores than those who had not; c) high patients’ satisfaction with the transplant team will be correlated with high PACIC scores; and d) high levels of trust with the transplant team will be correlated with high PACIC scores. According to the different distributions of the latter variables, Spearman correlations were used to test the association between PACIC and continuous variables, whereas t-tests were used for independent groups in dummy variables. Analyses were conducted for the English version, English-speaking countries and different language groups. Whereas Stata 12 was used for most statistical analyses, Mplus 7 [31] was used to run confirmatory factor analyses and R [43] was used to run ordinal alphas.

Results

Level of chronic illness care from patient’s perspective (PACIC scores)

Table 2 provides the distribution of the PACIC eleven-items for all English-speaking patients. Whereas 96% of patients completed all items of the questionnaire and the percentage of missing values by item was very low (variation between 0 and 1.5%), a high percentage of patients ticked the highest response category (variation between 21 and 84%) with 8 out of eleven-items presenting ceiling effects (> 30% of the patients). On the other hand, the lowest response category was less often selected (variation between 1.5 and 19.1%), except for item 5 (31.0%), which can be considered as a floor effect. Details of the distribution of the PACIC items are shown in Appendixes 2a, 2b, 3a and 3b (across English-speaking countries and across language groups).

PACIC structure

The results of confirmatory factor analyses based on a polychoric correlation matrix are presented in Tables 3 and 4, by countries for English-speaking patients, and by language groups for the other patients, respectively. Acceptable to good fits of the single factor structure (RMSEA < 0.08, WRMR <.1.00, CFI > 0.97, TLI > 0.97) were found for the English version of the PACIC and in all English-speaking countries except for one index for USA (RMSEA 0.092 instead of 0.080) and for Australia (RMSEA 0.087 instead of 0.080). Acceptable to good fits were found for the French and German versions. However, the Dutch version showed acceptable to good fits except for the RMSEA (0.110 instead of 0.080), and the Portuguese and the Italian versions showed at least two fits slightly away from the defined acceptable fits threshold. The Spanish version did not reach the expected thresholds.

Table 3 Loadings and model fits (confirmatory factor analyses based on polychoric correlation matrix) for the PACIC English version, overall and by countries
Table 4 Loadings and model fits (confirmatory factor analyses based on polychoric correlation matrix) by language groups

Loadings were similar both across English-speaking countries and between the English, French and German versions. The Dutch and the Portuguese versions did not differ too much for the latter and appeared to be substantially different for the Spanish and the Italian versions, particularly for items 1 and 2.

Configural invariance was established across English-speaking countries, meaning that the factorial structure was identical (i.e. a single dimension) across English-speaking countries. This was not the case for the other language groups. Indeed, whereas the Spanish version did not show acceptable fits, the Spanish and the Italian patients did not use the whole scale of answering, i.e. some anchors (response modality) for item 2 and 4 were never chosen, which prevented us from testing multigroup invariance. Despite these results, we found configural invariance between the English, French, German, Dutch and Portuguese versions with acceptable fits (RMSEA =0.073, CFI =0.986, TLI =0.982). Metric invariance was found neither across English-speaking countries nor across language groups.

Relationship between PACIC’s score and variables of the field

For the English version, the hypothesized relationships between PACIC scores and the variables related to transplant team were confirmed (Table 5). In fact, we found that: a) patients advised to exercise reported higher PACIC scores than those who were not; b) patients with whom immunosuppressive medication intake had been discussed reported higher PACIC scores than those with whom it had not; c) higher levels of satisfaction with the transplant team were associated with higher PACIC scores; and d) higher levels of trust were correlated with higher PACIC scores. Similar results were found across English speaking countries (for details, see appendix 4), except for the UK, where no significant differences were found between the PACIC scores of patients who had received advice to exercise and those who had not, and no significant relation was identified between the PACIC scores and the levels of trust in the transplant team.

Table 5 relations between PACIC global score and other variables by languages

Our hypotheses were also confirmed for the French, German and Spanish versions, whereas they were only partially confirmed for the Italian version of the questionnaire (no significant differences were found between the PACIC scores of patients who received advice to exercise and those who did not), and were not confirmed at all for the Dutch and Portuguese versions.

Discussion

This study aimed to test the validity of the existing English version of the PACIC scale for heart transplant recipients, a new group of chronically ill patients not considered in previous PACIC studies. As a result, the examination of the internal structure of the scale showed goodness of fit values within acceptable range for a single dimension, and the analysis of the relationships with the variables tested confirmed our hypotheses. In fact, perceived level of chronic illness management (PACIC scores) appeared to be positively associated with treatment satisfaction and levels of trust in the transplantation team, and higher perceived levels of chronic illness management were identified when patients had been advised to exercise and when the immunosuppressive treatment had been discussed. This study also intended to explore the extent to which the internal structure of the questionnaire was equivalent in different English-speaking countries (USA, Canada, Australia and United Kingdom) and across language groups (French, German, Dutch, Spanish, Italian and Portuguese). We confirmed the unique factorial dimension across English-speaking countries as well as for the French, German, Dutch and Portuguese versions of the questionnaire but not for the Italian and the Spanish versions of the scale. In addition, while hypothesized relationships between perceived level of chronic illness management and other variables were coherent across English-speaking countries and for the French, German and Spanish versions of the questionnaire, respectively, they were not for the remaining languages (i.e. Dutch, Italian and Portuguese).

Confirming the structural dimension of a questionnaire (i.e. configural invariance, one dimension in the case of the PACIC) is necessary but not sufficient to compare scores across groups and languages. With configural invariance the latent factor of the questionnaire is composed by the same items but this does not mean that they are included in the same proportion (metric invariance) or that the anchors (response modalities) are identical across groups and between languages (scalar invariance). Our analyses did not confirm metric invariance criteria: even if the items composing the PACIC score were the same, they were not combined similarly across groups and languages. This suggests that patients speaking different languages do not interpret/understand the questionnaire similarly. In fact, to ensure a common understanding of self-perceived integrated care, the PACIC score – the latent factor of the PACIC scale - should be composed of at least the same proportion of each item across English speaking countries and across languages (i.e. metric invariance). Varying meanings or interpretations can arise from cultural or/and healthcare system differences indeed. The latter two phenomena, which cannot easily be disentangled, represent key explanations of existing differences to consider when making international comparisons. We nevertheless have to remember that questionnaires (e.g. PACIC) are most often developed for clinical purposes such as following the evolution of a patient state (e.g. comparison of patients’ scores over time) or investigating the impact of an intervention (e.g. comparison of patients’ scores before and after an intervention). This means that any international comparisons should be made with great caution, given that those results represent a detour of the questionnaires’ initial use. Currently, further explorations of the impact of cultural and healthcare system differences on the assessment of provided care are needed.

As mentioned before, we found a positive association between the PACIC score and satisfaction results. Among the twelve satisfaction items, two (‘how consistent the information of the team was’ and ‘how understandable their information was’) are also part of the Chronic Care Model measured with the PACIC. This may contribute to the positive correlation between satisfaction and the perceived level of chronic illness management. The other satisfaction items focus on how the transplantation team takes care of patients by listening and being present (and also, for example, by being ‘friendly’, ‘encouraging’ and ‘supportive’). These communication items probably allow the patient to ask questions and to obtain information on his/her disease. As such, patients may be reassured and report better chronic illness management. This is also supported by the positive association found between trust in the transplantation team and level of chronic illness management. In fact, trust in the transplantation team and care satisfaction should remain central when considering the integration of care of chronically ill patients.

This study presents two main strengths. Firstly, we targeted a population of chronically ill patients which were not previously involved in PACIC-related studies. Secondly, we used data from patients from a variety of countries and languages, allowing us to obtain a more comprehensive perspective on the validity of the PACIC scale. Nevertheless, two limitations need to be addressed. First, although the overall sample is large, the sample size per language or country was low for Dutch, Portuguese, UK and Australia (less than 100) and German, French, Italian and Canada (less than 200), which may explain why acceptable fits were not always reached. In fact, Muthén and Muthén [44] suggest a minimum of 300 patients when working with ordinal data; a number that was only reached when pooling the English-speaking countries or for the USA. A second limiting factor lies in the fact that some language groups included patients from countries with different cultures and health care systems. Indeed, pooling countries speaking and using the same language does not mean that the same context/culture is shared. For example, differences in healthcare systems or expectations as well as care experiences may influence the way PACIC items are understood by patients. These previous reasons brought us to consider our secondary aim - similarity of the internal structure of the PACIC across English-speaking countries and across various languages - as only exploratory.

Conclusion

Heart transplant patients represent an increasing group of chronically ill patients requiring complex treatments as well as life-long follow-up in a variety of care structures and with multiple healthcare professionals. Our results show that the English version of the PACIC, a scale assessing how level of chronic illness care perceived by patients is consistent with the recommendations of the Chronic Care Model, is valid in an international sample of heart transplant patients. Further validation efforts are needed since this scale is also very likely to be relevant for other solid organ transplant groups of patients who are also chronically ill. In the field of transplantation care, this tool could help healthcare professionals and providers in monitoring chronic illness management over time, adjusting it to patients’ needs and experiences, and thus improving transplantation care as well as providing insights into specific aspects of transplant management that could be improved. While awaiting results of further research comparing patients over time or comparing groups of patients where only the type of intervention varies, comparisons across countries or languages should be performed with caution since interpretation of the questions by patients can differ depending on the context, culture or healthcare system.

Availability of data and materials

The datasets generated and/or analyzed during the current study are not publicly available as we have committed to confidentiality to the 36 participating centers at start of the BRIGHT project in 2012. A data sharing protocol has been agreed upon among all 36 centers of the BRIGHT project for internal use.

Abbreviations

BRIGHT:

Building Research Initiative Group: Chronic Illness Management and Adherence in Transplantation

CFI:

Comparative Fit Index

PACIC:

Patient Assessment of Chronic Illness Care

RMSEA:

Root Mean Square Error of Approximation

TLI:

The Tucker Lewis index

WLSMV:

Weighted least squares estimation method

WRMR:

Weighted Root Mean Square Residual

References

  1. De Geest SM, Dobbels F, Gordon E, De Simone P. Chronic illness management as an innovative pathway for enhancing long-term survival in transplantation. Am J Transplant. 2011;11(10):2262–3.

    Article  PubMed  Google Scholar 

  2. Wagner E, Austin B, Davis C, Hindmarsh M, Schaefer J, Bonomi A. Improving chronic illness care: translating evidence into action. Health Aff Millwood. 2001;20:64–78.

    Article  CAS  PubMed  Google Scholar 

  3. Epping-Jordan J, Pruitt S, Bengoa R, Wagner E. Improving the quality of health care for chronic conditions. Qual Saf Health Care. 2004;13:299–305.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  4. Büsse R, Blümel M, Scheller-Kreinsen D, Zentner A. Tackling Chronic Disease In Europe. Strategies, interventions and challenges. Copenhagen: European Observatory on Health Systems and Policies; 2010. (Observatory Studies Series).

    Google Scholar 

  5. Nuño R, Coleman K, Bengoa R, Sauto R. Integrated care for chronic conditions: the contribution of the ICCC framework. Health Policy. 2012;105(1):55–64.

    Article  PubMed  Google Scholar 

  6. De Geest SM, Denhaerynck K, Berben L, Vanhaecke J, Russell C, Dobbels F. Higher level of chronic illness Management in Heart Transplant Centers is associated with better patient survival: the intercontinental BRIGHT study. Circulation. 2015;132(19):A11472.

    Google Scholar 

  7. Bissonnette JM, Woodend K, Davies BL, Stacey D, Knoll GA. Evaluation of a collaborative chronic care approach to improve outcomes in kidney transplant recipients. Clin Transpl. 2013;27(2):232–8.

    Article  CAS  Google Scholar 

  8. Schmid A, Hils S, Kramer-Zucker A, Bogatyreva L, Hauschke D, De Geest SM, et al. Telemedically Supported Case Management for Living Donor Renal Transplant Recipients as Optimization Tool of Routine Evidence-Based Aftercare: A Single-Center Randomized Controlled Trial. Am J Transplant. 2017 [cited 2017 Mar 18];in press. Available from. https://doi.org/10.1111/ajt.14138.

  9. Glasgow R, Wagner E, Schaefer J, Mahoney L, Reid R, Green S. Development and validation of the patient assessment of chronic illness care. Med Care. 2005;43:436–44.

    Article  PubMed  Google Scholar 

  10. Aragones A, Schaefer E, Stevens D, Gourevitch M, Glasgow R, Shah N. Validation of the Spanish translation of the patient assessment of chronic illness care (PACIC) survey. Prev Chronic Dis. 2008;5:1–10.

    Google Scholar 

  11. Gugiu PC, Coryn C, Clark R, Kuehn A. Development and evaluation of the short version of the patient assessment of chronic illness care instrument. Chronic Illn. 2009;5(4):268–76.

    Article  PubMed  Google Scholar 

  12. Gugiu C, Coryn C, Applegate B. Structure and measurement properties of the patient assessment of chronic illness care instrument. J Eval Clin Pract. 2010;16:509–16.

    PubMed  Google Scholar 

  13. Wensing M, Van Lieshout J, Jung H, Hermsen J, Rosemann T. The patient assessment chronic illness care (PACIC) questionnaire in the Netherlands: a validation study in rural general practice. BMC Health Serv Res. 2008;8:182.

    Article  PubMed  PubMed Central  Google Scholar 

  14. Drewes H, de Jong-van Til J, Struijs J, Baan C, Tekle F, Meijboom B, et al. Measuring chronic care management experience of patients with diabetes: PACIC and PACIC+ validation. Int J Integr Care. 2013;12:194.

    Google Scholar 

  15. Maindal H, Sokolowski I, Vedsted P. Adaptation, data quality and confirmatory factor analysis of the Danish version of the PACIC questionnaire. Eur J Pub Health. 2010;22:31–6.

    Article  Google Scholar 

  16. Taggart J, Chan B, Jayasinghe U, Christl B, Proudfoot J, Crookes P, et al. Patients assessment of chronic illness care (PACIC) in two Australian studies: structure and utility. J Eval Clin Pract. 2011;17:215–21.

    Article  PubMed  Google Scholar 

  17. Rosemann T, Laux G, Droesemeyer S, Gensichen J, Szecsenyi J. Evaluation of a culturally adapted German version of the patient assessment of chronic illness care (PACIC 5A) questionnaire in a sample of osteoarthritis patients. J Eval Clin Pract. 2007;13(5):806–13.

    Article  PubMed  Google Scholar 

  18. Cramm JM, Nieboer AP. The chronic care model: congruency and predictors among patients with cardiovascular diseases and chronic obstructive pulmonary disease in the Netherlands. BMC Health Serv Res. 2012;12(1):242.

    Article  PubMed  PubMed Central  Google Scholar 

  19. World Health Organization. Global Health Estimates. Deaths by cause, age, sex, by country and by region, 2000-2015. Geneva; 2015. 2016. Available from: http://www.who.int/healthinfo/global_burden_disease/estimates/en/index1.html.

  20. GBD 2015 Disease and Injury Incidence and Prevalence Collaborators. Global, regional, and national incidence, prevalence, and years lived with disability for 310 diseases and injuries, 1990–2015: a systematic analysis for the Global Burden of Disease Study 2015. Lancet. 2016;388(10053):1545–602.

    Article  Google Scholar 

  21. GBD 2015 Mortality and Causes of Death Collaborators. Global, regional, and national life expectancy, all-cause mortality, and cause-specific mortality for 249 causes of death, 1980–2015: a systematic analysis for the Global Burden of Disease Study 2015. Lancet. 2016;388(10053):1459–544.

    Article  Google Scholar 

  22. Muka T, Imo D, Jaspers L, Colpani V, Chaker L, van der Lee SJ, et al. The global impact of non-communicable diseases on healthcare spending and national income: a systematic review. Eur J Epidemiol. 2015;30(4):251–77.

    Article  PubMed  Google Scholar 

  23. Berben L, Denhaerynck K, Dobbels F, Engberg S, Vanhaecke J, Crespo-Leiro MG, et al. Building research initiative group: chronic illness management and adherence in transplantation (BRIGHT) study: study protocol. J Adv Nurs. 2015;71(3):642–54.

    Article  PubMed  Google Scholar 

  24. Wild D, Grove A, Martin M, Eremenco S, McElroy S, Verjee-Lorenz A, et al. Principles of good practice for the translation and cultural adaptation process for patient-reported outcomes (PRO) measures: report of the ISPOR task force for translation and cultural adaptation. Value Health. 2005;8(2):94–104.

    Article  PubMed  Google Scholar 

  25. Charlson ME, Pompei P, Ales KL, MacKenzie CR. A new method of classifying prognostic comorbidity in longitudinal studies: development and validation. J Chronic Dis. 1987;40(5):373–83.

    Article  CAS  PubMed  Google Scholar 

  26. Goetz K, Freund T, Gensichen J, Miksch A, Szecsenyi J, Steinhaeuser J. Adaptation and psychometric properties of the PACIC short form. Am J Manag Care. 2012;18(2):e55–60.

    PubMed  Google Scholar 

  27. Iglesias K, Burnand B, Peytremann-Bridevaux I. PACIC instrument: disentangling dimensions using published validation models. Int J Qual Health Care. 2014;3(26):250–60.

    Article  Google Scholar 

  28. Westaway MS, Rheeder P, Van Zyl DG, Seager JR. Interpersonal and organizational dimensions of patient satisfaction: the moderating effects of health status. Int J Qual Health Care. 2003;15(4):337–44.

    Article  PubMed  Google Scholar 

  29. Hall MA. Researching medical trust in the United States. J Health Organ Manag. 2006;20(5):456–67.

    Article  PubMed  Google Scholar 

  30. American Educational Research Association., American Psychological Association., National Council on Measurement in Education., & Joint Committee on Standards for Educational and Psychological Testing (U.S.). Standards for educational and psychological testing. 2014.

    Google Scholar 

  31. Muthén L, Muthén B. Mplus user’s guide. 6th ed. Los Angeles CA: Muthén & Muthén; 2010.

    Google Scholar 

  32. Muthén BO. A general structural equation model with dichotomous, ordered categorical, and continuous latent variable indicators. Psychometrika. 1984;49(1):115–32.

    Article  Google Scholar 

  33. Byrne BM, Shavelson RJ, Muthén B. Testing for the equivalence of factor covariance and mean structures: the issue of partial measurement invariance. Psychol Bull. 1989;105(3):456–66.

    Article  Google Scholar 

  34. Byrne BM. Structural equation modeling with Mplus: basic concepts, applications, and programming. New York: Routledge; 2012.

    Google Scholar 

  35. Vandenberg RJ, Lance CE. A review and synthesis of the measurement invariance literature: suggestions, practices, and recommendations for organizational research. Organ Res Methods. 2000;3(1):4–70.

    Article  Google Scholar 

  36. Gregorich SE. Do self-report instruments allow meaningful comparisons across diverse population groups? Testing measurement invariance using the confirmatory factor analysis framework. Med Care. 2006;44(11 Suppl 3):S78–94.

    Article  PubMed  PubMed Central  Google Scholar 

  37. Yu CY, Muthén B. Evaluation of model fit indices for latent variable models with categorical and continuous outcomes. LA: New Orleans; 2002.

    Google Scholar 

  38. Hu L, Bentler PM. Fit indices in covariance structure modeling: sensitivity to underparameterized model misspecification. Psychol Methods. 1998;3(4):424–53.

    Article  Google Scholar 

  39. Marsh RPHW, Balla JR, McDonald. Goodness-of-fit indexes in confirmatory factor analysis: The effect of sample size. Psychol Bull. 1988;103:391–410.

    Article  Google Scholar 

  40. Browne MWCR. Testing structural equation models. In: Bolen KALJS, editor. Newbury. Park, CA: Sage; 1993.

    Google Scholar 

  41. Schermelleh-Engel K, Moosbrugger H, Müller H. Evaluating the fit of structural equation models: tests of significance and descriptive goodness-of-fit measures. Methods Psychol Res Online. 2003;8(2):23–74.

    Google Scholar 

  42. Zumbo BD, Gadermann AM, Zeisser C. Ordinal versions of coefficients alpha and Theta for Likert rating scales. J Mod Appl Stat Methods. 2007;6(1):21–9.

    Article  Google Scholar 

  43. Core R, Team R. a language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing; 2013. Available from: http://www.R-project.org/.

    Google Scholar 

  44. Muthén LK, Muthén BO. How to use a Monte Carlo study to decide on sample size and determine power. Struct Equ Model Multidiscip J. 2002;9(4):599–620.

    Article  Google Scholar 

Download references

Acknowledgements

We wholeheartedly thank all the participating patients, clinicians and the transplant directors for their participation in the BRIGHT study. Furthermore, we want to express our gratitude to all who have contributed to the preparation of the local ethics committees (IRB) submission and to the data collection.

The BRIGHT study team consists of: Maria G. Crespo-Leiro (Hospital Universitario À Coruña, La Coruña, Spain); Sandra Cupples (U.S. Department of Veterans Affairs, Veterans Health Administration, Washington DC, USA); Paolo De Simone (Azienda Ospedaliero-Universitaria Pisana, Ospedale Cisanello, Pisa, Italy); Albert Groenewoud (Astellas Pharma Europe Ltd., UK); Christiane Kugler (Hannover Medical School, Hannover, Germany); Linda Ohler (George Washington University, Washington DC, USA); Johan Van Cleemput (University Hospitals Leuven, Leuven, Belgium); Alain Jean Poncelet (Cliniques Universitaires Saint-Luc, Brussels, Belgium); Laurent Sebbag (Hôpital Louis Pradel, Lyon, France); Magali Michel (Hôpital Nord Laennec, Nantes, France); Andrée Bernard (Hôpital Universitaire Pitié-Salpêtrière, Paris, France); Andreas Doesch (University Hospital Heidelberg, Heidelberg, Germany); Ugolino Livi (University Hospital Udine, Udine, Italy); Valentina Manfredini (University of Bologna, Bologna, Italy); Vicens Brossa-Loidi (Hospital de Sant Pau, Barcelona, Spain); Javier Segovia-Cubero (Hospital Puerta de Hierro, Madrid, Spain); Luis Almenar-Bonet (Hospital Universitari i Politècnic La Fe de Valencia, Valencia, Spain); Carmen Segura Saint-Gerons (Hospital Univeritario Reina Sofia, Córdoba, Spain); Paul Mohacsi (University Hospital of Bern, Bern, Switzerland); Eva Horvath (University Hospital Zurich, Zurich, Switzerland); Cheryl Riotto (Papworth Hospital, Cambridge, UK); Gareth Parry (Freeman Hospital, Newcastle, UK); Ashi Firouzi (Royal Brompton & Harefield NHS Foundation Trust, London, UK); Stella Kozuszko (Toronto General Hospital, Toronto, Canada); Haissam Haddad (University of Ottawa Heart Institute, Ottawa, ON, Canada); Annemarie Kaan (St Paul’s Hospital, Vancouver, BC, Canada); Grant Fisher (London Health Sciences Centre, London, ON, Canada); Tara Miller (Duke University Hospital, Durham, NC, USA); Maureen Flattery (Virginia Commonwealth University Health System, Richmond, VA, USA); Kristin Ludrosky (Cleveland Clinic, OH, USA); Bernice Coleman (Cedars-Sinai Medical Center, Los Angeles, CA, USA); Jacqueline Trammell (Kaiser Permanente Santa Clara Medical Center, Santa Clara, CA, USA); Katherine St. Clair, Andrew Kao (St. Luke’s Hospital, Kansas City, MO, USA); Maria Molina (Hospital of the University of Pennsylvania, Philadelphia, PA, USA); Karyn Ryan Canales (Ochsner Medical Center, New Orleans, LA, USA); Samira Scalso de Almeida (Hospital Israelita Albert Einstein, São Paulo, Brazil); Andrea Cotait Ayoub (Instituto Dante Pazzanese de Cardiologia, São Paulo, Brazil); Fernanda Barone (Instituto do Coração da Universidade de São Paulo, São Paulo Brazil); Michelle Harkess (St. Vincent’s Hospital, Sydney, Australia); Joanne Maddicks-Law (The Prince Charles Hospital, Brisbane, Australia).

Funding

The BRIGHT study was funded by research grants from the International Transplant Nurses Society (ITNS) in 2008, the International Society for Heart and Lung Transplantation (ISHLT) in 2012, the Swiss Academy of Medical Sciences (SAMW) in 2013 as well as by an unrestricted research grant from Astellas Pharma. Co-financed with European Union Regional Development Funds (EURDF). None of the grants has a grant number. The funding organizations neither have access to the data nor were involved in the preparation of the manuscript.

Author information

Authors and Affiliations

Authors

Consortia

Contributions

KI, IPB and SDG wrote the manuscript. KI did the statistical analyses. All authors critically reviewed the manuscript for important intellectual content. The study design and research proposal were mainly developed by SDG, KDH, FD & CLR. LB & RH made substantial contributions to the conception and the design of the study. All authors agree to be accountable for all aspects of the work in ensuring that questions related to the accuracy or integrity of any part of the work are appropriately investigated and resolved. All authors have read and approved the final manuscript.

Corresponding authors

Correspondence to Katia Iglesias or Sabina De Geest.

Ethics declarations

Ethics approval and consent to participate

Ethical approval is obtained from each participating centers’ IRB/ethics committee prior to data collection (e.g.: Ethische commissie UZ / KU Leuven, Number: B322201213667). The patient information and informed consent forms comply with the guidelines of the Declaration of Helsinki (World Medical Organization 1996) and specific national legislation (e.g. consideration of Health Insurance Portability and Accountability Act in the USA). All patients are informed in writing and orally about the aims of the study, why they are selected, what their involvement means in terms of data collection, the risks/benefits of taking part and who the contact persons are for the study. They are also informed that they have the right to discontinue their participation at any time without affecting their treatment by the transplant team or hospital. Safeguards to ensure patient confidentiality are explained and written informed consent is obtained from each patient prior to data collection.

Consent for publication

Not Applicable.

Competing interests

The authors declare that they have no competing interests

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary information

Additional file 1: Appendix 1.

Characteristics of patients, by PACIC language. Appendix 2a. Distribution of the 11 PACIC items, by English-speaking countries (%)..Appendix 2b. Distribution of the 11 PACIC items, by English-speaking countries (%). Appendix 3a. Distribution of the 11 PACIC items by language groups (%). Appendix 3b. Distribution of the 11 PACIC items by language groups (%). Appendix 4. Relations between PACIC global score and other variables by English speaking.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Iglesias, K., De Geest, S., Berben, L. et al. Validation of the patient assessment of chronic illness care (PACIC) short form scale in heart transplant recipients: the international cross-sectional bright study. BMC Health Serv Res 20, 160 (2020). https://doi.org/10.1186/s12913-020-5003-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12913-020-5003-3

Keywords