Cross-cultural adaptation and exploratory factor analysis of the Person-centred Practice Inventory - Staff (PCPI-S) questionnaire among Malaysian primary healthcare providers
BMC Health Services Research volume 21, Article number: 32 (2021)
The Person-centred Practice Inventory-Staff (PCPI-S) instrument was developed to measure healthcare providers’ perception towards their person-centred practice. The study aimed to explore the influence of culture, context, language and local practice towards the PCPI-S instrument adaptation process for use among public primary care healthcare providers in Malaysia.
The original PCPI-S was reviewed and adapted for cultural suitability by an expert committee to ensure conceptual and item equivalence. The instrument was subsequently translated into the local Malay language using the forward-backward translation by two independent native speakers, and modified following pre-tests involving cognitive debriefing interviews. The psychometric properties of the corresponding instrument were determined by assessing the internal consistency, test-retest reliability, and correlation of the instrument, while the underlying structure was analysed using exploratory factor analysis.
Review by expert committee found items applicable to local context. Pre-tests on the translated instrument found multiple domains and questions were misinterpreted. Many translations were heavily influenced by culture, context, and language discrepancies. Results of the subsequent pilot study found mean scores for all items ranged from 2.92 to 4.39. Notable ceiling effects were found. Internal consistency was high (Cronbach’s alpha > 0.9). Exploratory factor analysis found formation of 11 components as opposed to the original 17 constructs.
The results of this study provide evidence regarding the reliability and underlying structure of the PCPI-S instrument with regard to primary care practice. Culture, context, language and local practice heavily influenced the adaptation as well as interpretation of the underlying structure and should be given emphasis when translating person-centred into practice.
In many healthcare systems and organizations, a person-centred care (PCC) model is seen as a possible solution to improve health system performance to meet the growing demand for improved patient experience and health outcomes. It addresses health and social needs by catering to individual preferences and values, thus actively involving consumers and carers in care decisions and planning . As such, person-centred care shifts the conventional medically dominated, disease orientated, fragmented care towards one that is collaborative and relationship focused. This can be explained by the theoretical framework of PCC by McCormack and McCance which emphasized the therapeutic relationship between healthcare providers and service users . The therapeutic relationship is promoted by values of respect for the person, individual’s right to self-determination, mutual respect and understanding. This would involve working with the individual alongside health professionals to develop appropriate solutions, and for the individual to take responsibility for their own health and guide clinical decisions. In Malaysia, this concept has been embraced as a principle embedded in the national health goal since 2006 [3,4,5]. To achieve this, healthcare providers and the workplace are required to embrace a person-centred culture and work collaboratively with patients to improve their health outcomes . Given the evolving concept of person-centred care, an understanding of the various facets of person-centred care, and how they are perceived, are fundamental for policymakers to operationalize this concept.
The Person-centred Practice Inventory-Staff (PCPI-S) questionnaire was originally developed by Slater, McCance and McCormack to examine how healthcare staff perceived their person-centred practice, with the aim that this allows health care teams to translate evidence informed action into an actionable person-centred culture . The PCPI-S is a 59-item questionnaire drawn from 17 constructs, addressing three distinct domains: attributes of healthcare providers, context in which care is delivered and extent of delivering care. The original tool was validated among nursing staff from eight acute hospital settings . Since then, the questionnaire has been translated and used in Norway, which found the tool to be valid with an acceptable goodness of fit when used among nurses .
However, little is known if the PCPI-S questionnaire psychometric quality is maintained when used in a different geographical setting, among diverse healthcare provider categories such as physicians and pharmacists or in a primary care context. While there are studies describing the process of cultural adaptation and validation of various health related tools, limited studies explore and describe in-depth how culture and language influence the adaptation process, and what measures or approach should be put in place to address the complexity and challenges that occur during the adaptation process [8,9,10]. This is important as a poorly translated and adapted tool will ultimately lead to an instrument that is not equivalent to the original version, limiting its comparability as well as validity [11, 12].
The aim of this study was to translate, cross-culturally adapt and conduct exploratory factor analyses of the PCPI-S among multidisciplinary healthcare providers in primary care in Malaysia.
The study is part of a comprehensive study evaluating person-centredness among healthcare providers in Malaysian primary care clinics (NMRR-18-309-40447). The methodology of this study has been published previously . This study was conducted in two phases; the first Phase I which was a cross-cultural adaptation and translation of PCPI-S tool and the second phase, which was the psychometric evaluation of the PCPI tool.
In phase I, the PCPI-S questionnaire was reviewed by an expert committee consisting 8 primary care experts (3 policymakers, 1 public health specialist and 4 primary healthcare providers) to verify practicality of all items to local context. It was subsequently translated into Malay language using the forward-backward translation method by two independent bilingual speaking individuals. The emphasis in the translation was on conceptual and cultural equivalence, instead of linguistic accuracy. Discrepancies were discussed with all team members to achieve consensus. The instrument was pre-tested among the nine primary healthcare provider categories selected from four public primary care clinics. During the pre-tests, recruited respondents completed the bilingual PCPI-S questionnaire, followed by a cognitive debriefing session carried out by authors (NZB, PSS, ASJ, TPZ). Cognitive debriefing interviews were conducted to identify plausible explanations for any problems observed, hence allowing further qualitative analysis of difficulties encountered.
During cognitive debriefing, respondents from each clinic were divided into groups of 5 and interviewed for their understanding, acceptability as well as emotional impact of each item in order to detect confusing or misleading items/terms. The techniques ‘thinking aloud’, ‘probing’, and ‘observation of respondents’ behaviour’ were used to gauge respondents’ ability to comprehend all items [14, 15]. Responses were coded into one of the themes identified using a standardized behaviour coding form used to systematically identify questions requiring revision [16, 17]. The codes were: (1) request for clarification, (2) answer with uncertainty, (3) disagree with terms/sentences used, (4) do not know or wrong interpretation, (5) not applicable or non-response and (6) bilingual differences. When any item received a higher number of codes, further probing was warranted. In-depth exploration of these items helped clarify comprehension problems. It also allowed progress of the questionnaire improvement to be tracked systematically.
In phase II, the instrument was completed by public primary care healthcare providers from an urban state in Malaysia. Upon receiving organizational approval, printed questionnaires were distributed to eligible respondents from the nine healthcare providers category; family medicine specialists, medical doctors, pharmacists, medical assistants, nurses, occupational therapists, physiotherapists, dietitians, and nutritionists of any duration of work in the clinics. Healthcare providers who were unavailable during data collection were excluded from the study. All responses were returned in an opaque sealed envelope to ensure privacy and confidentiality. A minimum of 300 respondents were targeted to achieve a minimum of 5:1 ratio per item for factor analyses . Data collection was conducted over 3 months for instrument adaptation and subsequently 2 months for psychometric evaluation, offering all respondents the opportunity to complete the questionnaire.
The instrument was assessed for its psychometric properties, including the items’ floor and ceiling effects evaluated at 15% acceptance level . Test-retest reliability and internal consistency was determined respectively using intraclass correlation coefficient and Cronbach’s alpha. Multicollinearity and sampling adequacy were done using Bartlett’s test of sphericity and Kaiser-Meyer-Olkin criterion (≥ 0.50) . The factors were examined using Eigenvalue> = 1 (Kaiser criterion) and scree plot. The Exploratory Factor Analysis (EFA) was performed using the extraction method of Principal Component with Varimax (Variation Maximization) Rotation . Cross loadings were examined and small coefficients below 0.4 suppressed. The percentage of variance explained was considered acceptable if it exceeded 60% [21,22,23,24,25]. All responses were included in the analysis as responses were randomly missing with negligible impact upon removal. All analyses were performed in SPSS version 21 (IBM Corp, Armonyx).
Expert review and questionnaire translation
A team of 8 primary care experts reviewed the PCPI-S instrument to assess items relevance and acceptance for use in Malaysia. No items were dropped. The complexity and singularity of the PCC framework directly correlates to the difficulty of translation. Minor modifications were made on the terminology used and sentence structure to reflect a culturally, semantically and regionally appropriate questionnaire.
Demographic background of pre-test respondents
Respondents (n = 194) were recruited from 20 primary care clinics in 4 major states in Malaysia over five rounds of pre-tests; with 4 clinics involved in each round. The mean of respondents’ service years was 10.9 ± 6.6 (0.2–31 years). Majority of the respondents were nurses (n = 82, 42%). Other sociodemographic characteristics are presented in Table 1.
Participants required approximately 20 min to complete the questionnaire. During the cognitive debriefing session, respondents were also asked 22 specific probing questions, developed by the authors (Appendix 1). Issues indicating comprehension problems across the pre-tests is shown in Fig. 1.
Most of the modifications focused on improving individual translations in each item. For example, 64 respondents requested for clarification (Code 1) across all the 59 items in the questionnaire, necessitating substantial questionnaire modification. These can be broadly categorised into seven areas (Table 2): (1) words/phrases which were ambiguous, (2) synonyms, (3) grammatical meaning, (4) homonyms, (5) compound words, (6) unfamiliarity with subject experiences, and (7) words bearing emotional weight and action words. One-quarter of respondents requested clarification on the item “I continuously look for opportunities to improve the care experiences”. Reconciled comments revealed that respondents were unsure of the recipient of the care experiences in the question. Thus, examples were provided in the revised question which now read: “I continuously look for opportunities to improve the care experiences (example patient, family members, healthcare provider)”.
Modifications (such as sentence restructuring) were made to improve discrepancy from cultural and language aspects. In items E17 and J35, the translated term for the word “challenge” in Malay, “mempertikai” appeared too intimidating for the respondents; suggesting an expression of sharp disapproval or criticism of someone. Comments reconciled from respondents viewed “challenging someone” as a negative and unacceptable practice in the local culture. Instead, respondents suggested alternative (translated) terms such as “negotiate”, “rebuke”, “advice” or “offer” but were not accepted in the adapted questionnaire as the authors felt that it does not reflect the intended meaning of “stimulating or triggering by the way of disputing someone”. The term “mempertikai” was therefore retained.
Overall, respondents seemed to be confused with the term “person” in the questionnaire and wanted clarification whether it was referring to a patient. They expressed that they were more familiar with the ‘patient-centred care’ term. Following this, the definition of person-centred care was included as an introductory statement to describe the person as the patient, carer/family member and healthcare provider.
A detailed listing of issues and solutions are presented in Appendix 2 and Appendix 3.
Respondents were observed to rate highly on all constructs of the questionnaire (mean score between 3.9 and 4.3) in the first 2 pre-tests. Cognitive debriefing revealed inaccurate ratings as respondents misconstrued the meaning of the “agree” scale as a personal opinion of “what should be carried out”, instead of “what is currently practised”. Furthermore, respondents revealed it was difficult to select “disagree” as it implied that they object to the ideas being proposed, or they were not competent in doing their work.
The scale was then changed to a 5-point frequency rating of “never – rarely – sometimes – often – very often” to adequately capture the level of practice. Subsequent pre-tests indicated differences across constructs, with the lowest mean score in “supportive organizational systems” (mean score 3.2 ± 0.68), “potential for innovation and risk-taking” (mean score 3.4 ± 0.62) and “clarity of beliefs and values” (mean score 3.4 ± 0.57). Independent sample t-test showed significant mean differences and p-value, favouring the use of frequency-based scale (Fig. 2).
A total of 1133 participants from 16 public primary care clinics in a southern state of Malaysia were invited to participate in this phase, with an overall response rate of 81.1% (Table 3). Thirty-five respondents repeated the questionnaire 2 weeks later. Respondents’ mean service years was 8.9 ± 6.7 (range 0.1 to 36 years). Nurses, which included matrons, sisters, staff nurses and community nurses, comprised half of the total respondents (50.2%).
Mean scores ranged from 2.92 to 4.39 and were mostly positively scored. The higher scores coincided with high ceiling effects in 21 items (Table 4).
The overall Cronbach’s alpha for the PCPI-S questionnaire was satisfactory (α = 0.96), indicating that the items measured the same underlying constructs. Several domains had values lower than 0.7, possibly due to the small amount of variance among the respondents and fewer items constituting the construct. The item-scale correlations were generally good, with all item-scale correlations between 0.4 and 0.75.
The test–retest reliability of the questionnaire was satisfactory, with an intra-class correlation coefficient of 0.60, (95% CI: 0.49–0.73, p < .001). The correlation coefficients for each item by domain are shown in Table 4.
Exploratory factor analysis
The Kaiser-Meyer-Olkin (KMO) measure of sampling adequacy of 0.953 and significance of Bartlett’s test of sphericity (χ2 (1711) = 25,404.292, p < .005) signified data adequacy for analysis through data reduction procedure. The total variance explained at 60.85% was considered acceptable.
Figure 3 shows the item factor loadings and 11 components that emerged with a computed Eigenvalue greater than 1.
The 11 components differed from the original 17 constructs that formed the PCPI-S instrument. Component 1 included all the items of domain ‘Care Processes’ of the framework, except for m44 which did not achieve the minimum loading. Components 2, 9 and 11 were noted similar to the original constructs of ‘Supportive Organisational Systems’, ‘Knowing Self’ and ‘Professionally Competent’. Component 3 was deemed related to ‘team building’, as all 8 items pointed towards encouraging one another towards improvement. Component 4 comprised of all the same 5 items construct ‘shared decision-making systems’ with the addition of h26, interpreted as an embedded process of decision-making in the clinic. Component 5 was associated with ‘quality of work’ in which healthcare providers strived to give their best in the assigned tasks within the allocated working hours. Component 6 was closely linked to ‘working overtime’ or needing extra time to perform certain tasks. Cognitive debriefing findings indicated that respondents felt that some tasks (specifically items c9, c10 and c12) were only feasible to be carried out after working hours or on weekends. This was due to the high workload and busy schedule in the public primary care clinics. Component 7 was centred on ‘quality improvement processes’ which included care enhancement and consideration of physical environment. Component 8 was possibly explained by ‘team reflection’ from items that denoted recognition of the need for skill mix within a team. An overarching theme of ‘autonomy in patients and family members’ was considered to suit component 10. However, these 3 items were also closely loaded into component 1, suggesting that the autonomous decision-making may also occur during the patient care process.
The cross-cultural adaptation, translation and psychometric evaluation of the PCPI-S questionnaire were the outcomes of this study. The questionnaire adaptation strongly emphasised on the culture, context, language and local practice for the tool to be used in Malaysia. The challenge as in other studies lies in balancing content validity at conceptual level to allow comparability and being culturally and linguistically accurate [11, 26,27,28]. In this context, a term or phrase in the original questionnaire used in a different country may vary significantly when used in a different language . Among the few items observed in this study, the translated terms used were also heavily influenced by culture, rendering the translation conceptually different. These problems encountered were similar to the Norwegian study . The pre-testing process in this study was therefore optimized to achieve conceptual, semantic, idiomatic, and experiential equivalence between the original and translated questionnaires . The interpretation of the behaviour codes was also vigilantly reviewed by item. Higher number of codes suggested more respondents had comprehension problems but not necessarily reflecting the magnitude associated with the item.
Rescaling the 5-point Likert scale to frequency-based was justified to capture their level of person-centred practice in the clinics more meaningfully. This also avoided presence of acquiescence bias whereby respondents had the propensity to agree in the original agreement-based scale . As observed in earlier pre-tests in this study, respondents replied in a way that corresponds with what is perceived as “desirable” personality characteristics. The choice of the scale’s evaluative dimension has therefore an impact on data quality.
This study showed similar mean scores to the other PCPI-S studies [7, 8]. The high ceiling effects may be explained with two possibilities. Firstly, this may imply a limited content validity and responsiveness of the instrument . Alternatively, the findings could be modestly accurate in representing person-centred practice in Malaysia, ensued from the Health Ministry’s vision and mission on providing a customer-centred care .
The components established from factor exploration differed from the original questionnaire. While some original components were retained, others collapsed into a broader new group. For instance, almost all items from the domain ‘Care Processes’ formed a single component. The overarching theme of care processes indicated meaningful interactions between service providers and users (patients and their families) in activities that constitute healthcare - including diagnosis, treatment, rehabilitation, prevention and patient education. New components were formed from a combination of items originating from different constructs. Our exploration found differing local context and culture influenced the healthcare providers’ practice, hence influencing factor interpretation. The overall conceptual ideas of person-centred practice remained similar.
One of the major strengths of this study is the extensive exploration of culture, context and language in influencing the cross-cultural adaptation process, which not only ensured translation accuracy but validity of the instrument. Findings allowed greater understanding on what constitutes local person-centred practice and how such practice comes into place. By enhancing its contextualization and practicality, clinics will be inclined to utilise the questionnaire findings for their practice. We believe that our contribution in the development of this locally validated tool could allow researchers and stakeholders to assess person-centred practices in the Asian region. To our knowledge, this was the first study that investigated the reliability and validity of the PCPI-S questionnaire in a primary care context, which supports and extends applicability of the instrument in various healthcare settings.
However, this study has certain limitations. The cognitive debriefing process by itself can indicate the existence of problems with questions but not the quantitative information on the quality of self-reported data. To obtain this type of information, studies comparing self-reported data to data from alternative sources are required. Secondly, this study was only tested among public primary healthcare providers. The conceptual, cultural, linguistic influence, as well as formation of the components seen in this study might be heavily influenced by healthcare practice, and therefore might render different results if tested in other fields or backgrounds. While the constructs should be viewed with caution, the findings may be useful for comparison in follow-up assessment of the underlying structure.
The adapted PCPI-S questionnaire can be a practicable instrument in assessing the Malaysian person-centred practice among primary healthcare providers. The influence of culture, context, language as well as local practice should be taken into consideration and tested again should this instrument be used in a different set of population in the future, or when translating evidence into person-centred practice. Altogether, the present study makes an important contribution to the reliability and underlying structure of person-centred practice in a primary care background.
Availability of data and materials
The dataset that supports the findings of this article belongs to the Primary Care Systems for Person-Centred Provider Practices study. Requests for the data can be obtained from Dr. Mohd Azahadi Omar (email@example.com), the head of sector for Biostatistics & Data Repository, National Institute of Health, Ministry of Health Malaysia and with the permission from the Director-General of Health, Malaysia.
Exploratory Factor Analysis
Person-centred Practice Inventory-Staff
Valentijn PP, Schepman SM, Opheij W, Bruijnzeels MA. Understanding integrated care: a comprehensive conceptual framework based on the integrative functions of primary care. Int J Integr Care. 2013;13:4.
McCormack B, McCance T. Person-centred practice in nursing and health care: theory and practice: John Wiley & Sons; 2016.
Malaysia. Prime Minister's Department, & The Economic Planning Unit, Ninth Malaysia Plan 2006–2010. Putrajaya; 2006. p. 449.
Minister of Health. Persidangan Penyediaan Rancangan Malaysia Kedua Belas (Rmke-12) Untuk Sektor Kesihatan. 2019.
Organization WH. People-centred care in low-and middle-income countries: report of meeting held 5 May 2010. Geneva: World Health Organization; 2010.
McCormack B, Dewing J, McCance T. Developing person-centred care: addressing contextual challenges through practice development; 2011.
Slater P, McCance T, McCormack B. The development and testing of the person-centred practice inventory–staff (PCPI-S). Int J Qual Health Care. 2017;29(4):541–7.
Bing-Jonsson PC, Slater P, McCormack B, Fagerström L. Norwegian translation, cultural adaption and testing of the person-centred practice inventory–staff (PCPI-S). BMC Health Serv Res. 2018;18(1):555.
Silva TO. Alves LBdO, Balieiro MMFG, Mandetta MA, Tanner a, shields L. cross-cultural adaptation of an instrument to measure the family-centered care. Acta Paulista de Enfermagem. 2015;28(2):107–12.
Vasli P. Translation, cross-cultural adaptation, and psychometric testing of perception of family-centered care measurement questionnaires in the hospitalized children in Iran. J Pediatr Nurs. 2018;43:e26–34.
Guillemin F, Bombardier C, Beaton D. Cross-cultural adaptation of health-related quality of life measures: literature review and proposed guidelines. J Clin Epidemiol. 1993;46(12):1417–32.
Herdman M, Fox-Rushby J, Badia X. A model of equivalence in the cultural adaptation of HRQoL instruments: the universalist approach. Qual Life Res. 1998;7(4):323–35.
Balqis-Ali NZ, San Saw P, Jailani AS, Yeoh TW, Fun WH, Mohd-Salleh N, et al. Protocol for a cross-sectional study measuring person-centredness among healthcare providers in Malaysian primary care clinics: the adaptation and validation of the person-Centred practice inventory-staff (PCPI-S) questionnaire. BMJ Open. 2020;10(3):e034128.
Collins D. Pretesting survey instruments: an overview of cognitive methods. Qual Life Res. 2003;12(3):229–38.
Drennan J. Cognitive interviewing: verbal data in the design and pretesting of questionnaires. J Adv Nurs. 2003;42(1):57–63.
Chernyak N, Ernsting C, Icks A. Pre-test of questions on health-related resource use and expenditure, using behaviour coding and cognitive interviewing techniques. BMC Health Serv Res. 2012;12(1):303.
Oksenberg L, Kalton G. New strategies for pretesting survey questions. J Off Stat. 1991;7(3):349.
Comrey AL, Lee HB. A first course in factor analysis: psychology press; 2013.
Terwee CB, Bot SD, de Boer MR, van der Windt DA, Knol DL, Dekker J, et al. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60(1):34–42.
O’connor BP. SPSS and SAS programs for determining the number of components using parallel analysis and Velicer’s MAP test. Behav Res Methods Instrum Comput. 2000;32(3):396–402.
Awang Z. Research methodology and data analysis: Penerbit Universiti Teknologi MARA press; 2012.
Awang ZH. Research methodology for business & social science: Pusat Penerbitan Universiti, Universiti Teknologi MARA; 2010.
Hoque ASMM, Siddiqui BA, Awang ZB, Baharu SMAT. Exploratory factor analysis of entrepreneurial orientation in the context of Bangladeshi small and medium enterprises (SMEs). Eur J Manage Mark Stud. 2018;3(2):86–7.
Noor NM, Aziz AA, Mostapa MR, Awang Z. Validation of the Malay version of the inventory of functional status after childbirth questionnaire. Biomed Res Int. 2015;2015:3.
Yahaya T, Idris K, Suandi T, Ismail I. Adapting instruments and modifying statements: the confirmation method for the inventory and model for information sharing behavior using social media. Manage Sci Lett. 2018;8(5):271–82.
Beaton DE, Bombardier C, Guillemin F, Ferraz MB. Guidelines for the process of cross-cultural adaptation of self-report measures. Spine. 2000;25(24):3186–91.
Ferraz M. Cross cultural adaptation of questionnaires: what is it and when should it be performed? J Rheumatol. 1997;24(11):2066.
Guyatt GH. The philosophy of health-related quality of life translation. Qual Life Res. 1993;2(6):461–5.
Hendricson WD, Jon Russell I, Prihoda TJ, Jacobson JM, Rogan A, Bishop GD, et al. Development and initial validation of a dual-language English–Spanish format for the arthritis impact measurement scales. Arthritis Rheum. 1989;32(9):1153–9.
Billiet JB, McClendon MJ. Modeling acquiescence in measurement models for two balanced sets of items. Struct Equ Model. 2000;7(4):608–28.
Vision and Mission Ministry of Health [Internet]. 2019 [cited 25th November 2019]. Available from: http://www.moh.gov.my/index.php/pages/view/137?mid=14.
The authors would like to declare our gratitude to the Director-General of Health Malaysia for his permission to publish this paper. We thank Dr. Paul Slater, Professor Brendan McCormack and Professor Tanya McCance for giving us permission to use the PCPI-S questionnaire.
Funding for this study is from the Ministry of Health Malaysia research grant. The funder had no role in the study design, data collection, analysis, decision to publish, preparation or review of the manuscript.
Ethics approval and consent to participate
The study was approved by the Medical Research and Ethics Committee (MREC), Ministry of Health Malaysia (KKM/NIHSEC/ P18–766 (14)) and Monash University Human Research Ethics Committee (2018–14363-19627). Informed written consent was obtained from all respondents in the study and respondents were provided with a copy of the information sheet with details of the study and its aims prior to consenting.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Balqis-Ali, N.Z., Saw, P.S., Jailani, A.S. et al. Cross-cultural adaptation and exploratory factor analysis of the Person-centred Practice Inventory - Staff (PCPI-S) questionnaire among Malaysian primary healthcare providers. BMC Health Serv Res 21, 32 (2021). https://doi.org/10.1186/s12913-020-06012-9