Skip to main content
Download PDF

Adaption and validation of Nijmegen continuity questionnaire to recognize the influencing factors of continuity of care for hypertensive patients in China

BMC Health Services Research volume 19, Article number: 79 (2019) Cite this article

Abstract

Background

Continuity of care (COC) has become a primary point of concern for care providers in both developed and developing countries, which is regarded as the “cornerstone of care” and an “essential element” of good health care. A robust and proper instrument is of necessity to identify problems and evaluate intervention aimed at improving continuity of care. This study aimed to adapt Nijmegen continuity questionnaire (NCQ) into a Chinese version (NCQ-C) and to delineate the status of COC as well as explore its influencing factors for hypertensive patients in China.

Methods

A forward-back-translation procedure was adopted for the determination of the adaption of NCQ. Then a total of 448 patients completed questionnaires and 24-h ambulatory blood pressure monitoring (ABPM). Proper indexes were calculated to test the reliability and validity of NCQ-C. Logistic analysis were used to detect the influencing factors of COC.

Results

The NCQ-C had excellent intraclass correlation coefficient of 0.855 and internal consistency of seven dimensions varied from 0.907 to 0.944. The item-content validity index ranged from 0.71 to 1.00. For construct validity, seven-factor structure was confirmed as original questionnaire and all the fit indices indicated acceptable levels. Gender, education level, medical insurance and frequency of family visits, blood pressure level, depression status as well as general health perception were demonstrated to be statistically related to COC.

Conclusions

In addition, all the parameters of ABPM were negatively significant with COC. The NCQ-C has shown acceptable level of reliability and validity. The related factors of COC should arouse care providers’ attention.

Peer Review reports

Background

The ranking of chronic diseases reached the top position of spectrum of diseases since twenty-first century. According to the report on the global status of chronic diseases, nearly two-thirds of death all over the world could be explained by chronic diseases [1]. The numbers of patients with one or more chronic diseases are increasing and these patients are prone to go through referral among different medical settings and communicate with various health care providers [2], which lead to the potential risk of “fragmentation of health care” [3]. Therefore, continuity of care (COC) gradually became a primary point of concern for care providers in both developed and developing countries. COC is regarded as the “cornerstone of care” and an “essential element” of good health care [4, 5]. A substantial of evidence bodies have indicated that greater COC was related to lower readmission rate [6], higher quality of life [7] and more satisfaction [8].

According to literature review, COC first appeared in the 1950s [9,10,11]. It is a complex concept which has changed over time due to contextual factors. At different times, researchers in various organizations emphasized COC from different aspects [10]. Around mid-1970s, COC was thought to be the synonym of building relationships with the same health care providers [12, 13]. Several measurement instruments of COC, such as Usual Provider of Continuity (UPC) Index [7], the sequential continuity index (SCN) [14] were developed, all of which pursued largely from a service-orientated, clinician-centered perspective [15]. From the 1990s on, with much more in-depth and integrated understanding, providers realized that research on COC would benefit from a much stronger focus on the patients’ perspective [16] and tended to endorse COC a multi-facial definition. Nowadays, COC was defined from patients’ viewpoint as “the patients’ experience of a coordinated and smooth progression of care” [10] and was considered as a multi-faced model including not only personal or relational continuity but also informational continuity and team/cross-boundary continuity requiring communication and collaboration between care providers [17, 18]. But for some patients, informational continuity and team/cross-boundary continuity were hard to distinguish [19].

To optimize management process of hypertensive patients and achieved optimal management effectiveness, China passed the notice on the pilot work of hierarchical diagnosis and treatment for patients with hypertension in 2015 [20]. It depicted the process of hierarchical diagnosis and treatment which could be achieved by the collaboration between primary health care and high-lever hospitals through bi-directional referral system. Specifically, patients with hypertension in China were managed in cooperation among a panel of care providers including general practitioners, nurses in primary care settings as well as specialists and nurses in higher level hospitals, and all these health care providers are assigned with definite division of labor [21, 22]. General practitioners who work as gatekeepers on communities or clinics basis, guarantee daily management for hypertensive patients [23]. They play a prominent role to provide basic prescription and referee emergency patients to higher level hospitals. Nurses in primary care settings assisted general practitioners to perform routine family visits and patient education, counseling program [24], which have been proved to be effective to improve lifestyle modification and antihypertensive medications. Specialists and nurses in higher level hospital provide necessary instructions when hypertensive patients with deteriorating status were referred to seek further treatment [25]. The entire service process emphasize the necessity of collaboration among care providers and information handover within and between primary care and hospitals, and personal continuity and commitment is crucial to build trust and promote partnerships with all health care providers involved in [26], which further demand the need for higher level of COC. Measurement of COC by robust and convenient instruments would allow us to identify problems and evaluate intervention aimed at improving COC. However, there was a blank for reliable and specific instruments concerning COC for hypertensive patients in China. Nijmegen continuity questionnaire (NCQ) is a general questionnaire [19] and it is the only questionnaire that has been tested in both primary and secondary care [27]. NCQ can not only measure COC from a macro scope to evaluate the entire quality of the medical service, but also a micro scope to assess single (respective) COC of primary care and hospital [28], which suits medical system in China to a large extent. The purpose of this study was to adapt NCQ into a Chinese version (NCQ-C) and to describe the status of COC as well as explore the influencing factors of COC for hypertensive patients in China.

Methods

Translation and adaption

The original questionnaire was developed by Annemarie in Netherlands [19]. With the permission of original author, a forward-back-translation procedure was adopted as recommended in a guideline by Beaton et al. [29]. Two authors, a post graduate student majoring in nursing and a professor who specializes in continuity of care, translated it into Chinese based on the English version of NCQ with the help of healthcare professionals and linguists in China. Then a native English-speaking translator performed the process of back-translation. After a pilot study among 30 participants and discussion in the research group, the consensus version was developed. After adaptation, NCQ-C are applicable in China. The instrument consists of 28 items that distributes into three subscales:

  • Personal continuity: care provider knows me (5 items each for general practitioner in primary care setting and specialist in hospital).

  • Personal continuity: care provider shows commitment (3 items each for general practitioner in primary care setting and specialist in hospital).

  • Team/cross-boundary continuity (4 items each for collaboration between care providers within primary care setting, within the hospital/outpatient department and between the primary and hospital care providers).

Patients were instructed to fill the questionnaire selectively according to their doctoring behavior in the past 12 months. The items on continuity were rated according to a five-point Likert scale ranging from 1 (strongly disagree) to 5 (strongly agree), with an additional option to choose “?” (“I do not know”). Principally, the model had three subscales, but the subscale of “personal continuity-healthcare provider knows me” and “personal continuity- healthcare provider shows commitment” were used for both general practitioner and hospital specialist, and the team/cross boundary subscale was applied to three team contexts: in primary care setting, in hospital, and between primary care setting and hospital, giving a seven-factor model, which had been tested by the Norwegian version of NCQ [30]. Compared to the three-factor model, we believed that the seven-factor model addressing different levels of care settings were more suitable to be extensively used under the hierarchal treatment system in China.

Participants and data collection

A multi-center study was conducted in three tertiary hospitals in Tianjin, China. The three hospitals distributed in different geographical regions of Tianjin and covered large parts of this City with abundant outpatients. Between September 2017 and February 2018, 448 patients with hypertension were recruited into our research, and these patients were referred from nearby community healthcare centers to hypertension outpatients to undergo routine physical examination or further treatment. Patients were eligible if they met the following criteria: (1) being clearly diagnosed with primary hypertension for at least 1 years, according to the Chinese guideline for the management of hypertension in 2010: average clinical systolic blood pressure (SBP) more than 140 mmHg or (and) diastolic blood pressure (DBP) more than 90 mmHg [31]; (2) receiving anti-hypertensive therapies for at least 3 months; (3) aging more than 18 years old; (4) able to understand and write Chinese; (5) willing to participate the research and accept the examination of ambulatory blood pressure monitoring (ABPM). Exclusion criteria included active and severe infection, impaired cognitive abilities. This study was approved by the Research Ethics Committees of Tianjin Medical University.

Procedure: First off, all participants were told the purpose of the research and provided with a written informed consent. After receiving their consent, they were asked to complete a package of measures: demographic and clinical information, NCQ-C, Duke Activity Status Index (DASI), Self-rating Depression Scale (SDS) and visual analog scale (VAS) of European Quality of Life-5 Dimensions (EQ-5D). The self-made demographic and clinical questionnaire included the items of age, gender, marital status (married or other), income, education level (senior high school or lower, college or higher), employment (employed and unemployed), medical insurance, comorbidities and duration of hypertension, body mass index (BMI) and the frequency of family visits. The income was categorized into 4 classes, < 4000, 4001–6000, > 6000 RMB according to the consumption expenditure and income per capita announced by Tianjin Bureau of Statistics. Based on the guideline of prevention and treatment of hypertension in primary care, primary care providers must carry out family visit at least once every 3 months, so the frequency of family visit was set as dichotomous variable with the option of less than 4 times per year or more. Patients’ comorbidities were tested by Charlson comorbidity index [32], which was broadly used in experimental and clinical researches.

DASI is a 12-item scale with acceptable reliability and validity, and the Cronbach’s α is 0.704 [33]. Each item has two response options (‘yes’ or ‘no’), and the total scores range from 0 to 58.2, with higher scores indicating better physical functional capacity.

SDS is a widely-used scale with 20 items. Each item is rated from 1 to 4. The total score range from 1 to 80, wherein the higher scores reflect more severe depression status. The Chinese version of SDS is confirmed to be valid [34].

VAS of EQ-5D allowed the participants to rate their current health status on a range from 0 (worst imaginable health status) to 100 (best imaginable health status). It has been extensively used for its convenience and brevity and the Cronbach’s α is 0.75 [35].

After finishing those questionnaires, non-invasive ABPM was performed with automatic device (Welch Allyn. Inc. ABPM 6100) which measured BP on the upper left arm [36]. The monitoring lasted for 1 day from 10:00 am to 10:00 am the following day. With fixed time of the inflation and deflation of the cuff, the readings about corresponding parameters were recorded every 30 min during the diurnal period (07:00 to 23:00) and every 60 min during the nocturnal period (23:00 to 08:00). During the monitoring period, the patients kept their daily activities with unchanged lifestyles, but they should keep still and put their right upper limbs in the proper position when the cuff started to inflate. Each subject needed to provide at least 32 readings. Patients’ blood pressure level was dichotomized as normal or abnormal based on both their 24-h systolic and diastolic blood pressure. Their blood pressure pattern was judged by nocturnal reduction of SBP. In this research, the patterns of BP would be divided into 2 groups: normal pattern: dipper (≥10%, but < 20%), abnormal pattern: non-dipper (> 0%,but < 10%), reverse-dipper (no decline at night, that is < 0%) and super-dipper (> = 20%) [31]. In addition, 35 patients were randomly selected to complete the questionnaires 2 weeks later through interviewing by telephone, and the test-retest reliability was examined.

Statistical analysis

Data management and analysis was performed using SPSS20.0 software. Continuous variables with normal distribution were expressed as mean ± standard deviation (x ± s), non-normal variables were presented as median (interquartile range) and categorical variables were presented as number and percentage.

Reliability

Test-retest reliability was calculated by two-way random effects of average measure intraclass correlation coefficient (ICC) for absolute agreement between two tests [37] and ICC > 0.75 indicates acceptable reproducibility [38]. Internal consistency of the scale was examined by calculating the Cronbach’s alpha of every parts, which was considered satisfactory between 0.70 and 0.95 [39].

Validity

The content validity and construct validity was adopted to evaluate whether the questionnaire had proper validity. We invited 3 experts who majored in continuity of care, chronic diseases care and primary care, respectively and two doctors, two nurses from different community healthcare centers and hospitals to perform the evaluation of content validity index (CVI). A four-point ordinal rating scale was used, where 4 = strong relevant, 3 = very relevant, 2 = weak relevant, and 1 = not relevant. Both item-content validity index (I-CVI) and scale-level content validity index /average agreement (S-CVI/Ave) were adopted to quantitative evaluate the scale-level content validity [40]. I-CVI was calculated as the number of experts giving a rating of either “strong relevant” or “very relevant”, divided by the number of experts. S-CVI/Ave was calculated by taking the average of the I- CVIs. A scale with an I-CVI value > 0.78 is considered perfect and an S-CVI/Ave is anticipated to achieve 0.90 [40, 41]. For construct validity, we performed confirmatory factor analysis (CFA) to detect seven-factor structure similarly to the original questionnaire. Factors were allowed to correlate with each other. The sufficiency of the construct was evaluated using goodness of-fit statistics [42] including χ2/df, Goodness of Fit Index (GFI), Comparative Fit Index (CFI), Tacker-Lewis Index (TLI) and Standardized Root Mean Square Residual (SRMR). The values of χ2/df ranging from 1 to 3, GFI > 0.90, CFI > 0.90, TLI > 0.95, SRMR < 0.05, RMSEA < 0.08 were regarded as acceptable model fit [43].

Influencing factors of COC

Mean score of COC was seen as a cut-off and binary logistic regression (“0” = upper the mean, “1” = below the mean) was performed to determine the influencing factors of COC. P values < 0.05 was considered statistically significant.

Results

Demographic and clinical characteristics of participants

Participants’ characteristics: Totaling 448 participants were recruited into the research, all of whom performed doctoring behaviors both in primary care centers and hospital. The sociodemographic and clinical information about participants were presented in Table 1. A large proportion of participants were female with an average age of 61.7 years old. Over half (75.0%) of participants were with medical insurance and most of them (72.8%) were unemployed.

Table 1 Demographic and clinical characteristics of participants (N = 448)
Full size table

Reliability

The ICC presented as the correlation between pretest and post-test of NCQ-C was 0.855 (CI: 0.736–0.933). The internal consistency of seven dimensions ranged from 0.907 to 0.944.

Validity

With regard to the validity analysis, the I-CVC of the NCQ-C ranged from 0.71 to 1.00 and the S-CVI/Ave was 0.96. Except the item 5 (This care provider always remembers what he/she did during my last visit(s)), other items of this scale had I-CVI values more than 0.78. For item 5, the experts suggested to change “what I did” into explicit disease-related behaviors. Table 2 depicted experts’ ratings and CVI calculation. The results of construct validity revealed the same items distribution as the original questionnaire. Based on the analysis of CFA (Table 3), items loaded on seven factors with all factor loadings ranged from 0.946 to 0.999, and the correlations between seven factors ranged from 0.237–0.781. All the fit indices reached acceptable level.

Table 2 Experts’ Ratings and CVI Calculation (N = 7)
Full size table
Table 3 Results of confirmatory factor analysis of the NCQ-C
Full size table

Influencing factors of COC

The current status of COC among hypertensive patients was depicted in Table 4. In general, the scores of seven pacts of COC were at middle level. As showed in Table 5, when variables were tested by binary logistic regression analysis, gender, medical insurance, education level, the frequency of family visits, blood pressure level and depression status as well as general health perception of patients were proved to be influencing factors of COC. The specific tendency presented as: participants who were male (OR:1.513,CI:2.87–7.19), without medical insurance (OR:16.63,CI:6.25–44.21), with lower education level (OR:9.78,CI:3.44–27.91), underwent family visits less than 3 times per year (OR:14.09,CI:8.18–24.29), presented with abnormal blood pressure (OR:3.29,CI:2.21–4.89), with severe depression status (OR:1.15,CI:1.03–1.06) had high odds to have poor COC, but patients’ good general health perception (OR:0.908,CI:0.36–0.94) could increase their odds to get high level of COC.

Table 4 The score of seven components of NCQ-C (N = 448)
Full size table
Table 5 Results of logistic analysis of continuity of care
Full size table

Discussion

COC is an important aspect of patient care, which comprises continued and consistent care coupled with effective information exchange [44, 45]. Hypertension is a kind of chronic disease that threatens people by target organ damage and comorbidities in the long term [46]. In China, with the treatment concept shifting from solely lowing blood pressure to comprehensive prevention and treatment [21, 47], hypertensive patients were more likely to undergo transferring between different care settings and be treated under the collaboration among care providers. A robust and convenient instrument about COC for patients with hypertension is crucial to learn the current context and find potential factors for further intervention.

The results of reliability and validity were comparable to the previous studies using NCQ, which indicated that the instrument can be used to provide reliable results in other research in the future. The ICC of NCQ-C was 0.855, reflecting it had an excellent test-retest reliability and the internal consistency of NCQ-C was acceptable as well with the Cronbach’s alpha coefficient ranged from 0.907 to 0.944 for seven dimensions. In terms of content validity, 0.78 was regarded as cut-off value for either removing or retaining an item. Item 5 had I-CVI values less than 0.78, which suggested that further modification is needed in the future research. According to the results of CFA, the seven-factor structure of previous questionnaire was also suitable for NCQ-C with all fit indices reached an acceptable level.

In our research, we found several influencing factors of COC for hypertensive patients, and these factors can be divided into three groups: patients’ demographic factors, health status and factors related to care providers. Of the demographic factors examined, hypertensive patients who were female, with higher education level and medical insurance were inclined to get higher score of COC. The results were consistent to the previous research and can be reasonable interpreted. Compared to their counterparts, female patients showed high adherence to the treatment suggestion, which could boost the enthusiasm of their care providers in return [48]. Besides, high health literacy, as an advantage of well-educated patients [49, 50] could assist them to make most of medical resources [51, 52]. As for hypertensive patients with medical insurance in China, except for less burden of medical fee, these patients were registered in the primary care setting under the background of medical combination [53, 54], through which patients were more likely to contact with fixed care providers and care providers could achieve intimate collaboration from each other to ensure the same treatment target for the same hypertensive patients. Of factors related to patients’ health status, blood pressure level, depression status as well as patients’ general health perception were associated to COC, which was supported by the evidence that psychiatric comorbidities [55] as well as prior hospitalizations increased patients’ risk for poor COC [56]. In addition, health status was the fundamental index for patients to judge providers’ rating. Patients with good health state tended to show great appreciation and confidence in their health care providers, further leading to high level of continuity [57, 58]. It is noteworthy that hypertensive patients’ COC was more closely related to their mental disorders than physical liability, which hinted health care providers to emphasize both physical, psychological aspects in the treatment of hypertension. For factors related to care providers, the frequency of family visit played a crucial role for COC. The result indicated that care providers can perform increased frequency of family visit to achieve high level of COC for all patients. The assessment in family visit could serve as a media to achieve information sharing among care providers in different settings by case management system.

Limitation

There were still some limitations for the research. Firstly, this was a cross-sectional study and a longitudinal research will contribute to test the sensitivity of the NCQ-C in the future. Second, in this research, all the participants were solely recruited from hospital care settings. On the basis of existed research, the questionnaire also applied to hypertensive patients recruited from primary care settings. Further study is needed in the future. Third, the participants were considered to be representative of Chinese patients with hypertension who live in Tianjin city and they may not be generalized to the overall population in China; a future study should recruit more participants from different regions in China.

Conclusion

The Chinese version of NCQ has shown acceptable level of reliability and validity and can be used in the future research. Given the significant role of gender, education level, medical insurance and frequency of family visits for COC, care providers should emphasize the spectacular characteristics of patients and provide individual intervention in order to achieve optimal BP level.

Abbreviations

ABPM:

Ambulatory blood pressure monitoring

CFA:

Confirmatory factor analysis

CFI:

Comparative Fit Index

COC:

Continuity of care

CVI:

Content validity index

DASI:

Duke Activity Status Index

DBP:

Diastolic blood pressure

EQ-5D:

European Quality of Life-5 Dimensions

GFI:

Goodness of Fit Index

ICC:

Intraclass correlation coefficient

I-CVI:

Item-content validity index

NCQ:

Nijmegen continuity questionnaire

SBP:

Systolic blood pressure

SCN:

Sequential continuity index

S-CVI/Ave:

Scale-level content validity index /average agreement

SDS:

Self-rating Depression Scale

SRMR:

Standardized Root Mean Square Residual

TLI:

Tacker-Lewis Index

UPC:

Usual Provider of Continuity

VAS:

Visual Analog Scale

References

  1. Bauer UE, Briss PA, Goodman RA, Bowman BA. Prevention of chronic disease in the 21st century: elimination of the leading preventable causes of premature death and disability in the USA. Lancet. 2014;384(9937):45–52.

    Article  Google Scholar 

  2. Barnett K, Mercer SW, Norbury M, Watt G, Wyke S, Guthrie B. Epidemiology of multimorbidity and implications for health care, research, and medical education: a cross-sectional study. Lancet. 2012;380(9836):37–43.

    Article  Google Scholar 

  3. Stange KC, Ferrer RL. The paradox of primary care. Ann Fam Med. 2009;7(4):293–9.

    Article  Google Scholar 

  4. Freeman GK, Olesen F, Hjortdahl P. Continuity of care: an essential element of modern general practice? Fam Pract. 2003;20(6):623–7.

    Article  Google Scholar 

  5. Adair CE, McDougall GM, Mitton CR, Joyce AS, Wild TC, Gordon A, Costigan N, Kowalsky L, Pasmeny G, Beckie A. Continuity of care and health outcomes among persons with severe mental illness. Psychiatr Serv. 2005;56(9):1061–9.

    Article  Google Scholar 

  6. Nam YS, Cho KH, Kang HC, Lee KS, Park EC. Greater continuity of care reduces hospital admissions in patients with hypertension: an analysis of nationwide health insurance data in Korea, 2011-2013. Health Policy. 2016;120(6):604–11.

    Article  Google Scholar 

  7. Ye T, Sun X, Tang W, Miao Y, Zhang Y, Zhang L. Effect of continuity of care on health-related quality of life in adult patients with hypertension: a cohort study in China. BMC Health Serv Res. 2016;16(1):674.

    Article  Google Scholar 

  8. Hjortdahl P, Laerum E. Continuity of care in general practice: effect on patient satisfaction. BMJ. 1992;304(6837):1287–90.

    Article  CAS  Google Scholar 

  9. FARRISEY RM. Continuity of nursing care and referral systems. Am J Public Health Nations Health. 1954;44(4):449–54.

    Article  CAS  Google Scholar 

  10. Uijen AA, Schers HJ, Schellevis FG, van den Bosch WJ. How unique is continuity of care? A review of continuity and related concepts. Fam Pract. 2012;29(3):264–71.

    Article  Google Scholar 

  11. HARPER S. Continuity of care. Am J Nurs. 1958;58(6):871–2.

    CAS  PubMed  Google Scholar 

  12. McWhinney IR. Continuity of care in family practice. Part 2: implications of continuity. J Fam Pract. 1975;2(5):373–4.

    CAS  PubMed  Google Scholar 

  13. Rogers J, Curtis P. The concept and measurement of continuity in primary care. Am J Public Health. 1980;70(2):122–7.

    Article  CAS  Google Scholar 

  14. Shear CL, Gipe BT, Mattheis JK, Levy MR. Provider continuity and quality of medical care. A retrospective analysis of prenatal and perinatal outcome. Med Care. 1983;21(12):1204–10.

    Article  CAS  Google Scholar 

  15. Hill KM, Twiddy M, Hewison J, House AO. Measuring patient-perceived continuity of care for patients with long-term conditions in primary care. BMC Fam Pract. 2014;15:191.

    Article  Google Scholar 

  16. Uijen AA, Schers HJ, van Weel C. Continuity of care preferably measured from the patients' perspective. J Clin Epidemiol. 2010;63(9):998–9.

    Article  Google Scholar 

  17. Alazri MH, Neal RD, Heywood P, Leese B. Patients' experiences of continuity in the care of type 2 diabetes: a focus group study in primary care. Br J Gen Pract. 2006;56(528):488–95.

    PubMed  PubMed Central  Google Scholar 

  18. Haggerty JL, Reid RJ, Freeman GK, Starfield BH, Adair CE, McKendry R. Continuity of care: a multidisciplinary review. BMJ. 2003;327(7425):1219–21.

    Article  Google Scholar 

  19. Uijen AA, Schellevis FG, van den Bosch WJ, Mokkink HG, van Weel C, Schers HJ. Nijmegen continuity questionnaire: development and testing of a questionnaire that measures continuity of care. J Clin Epidemiol. 2011;64(12):1391–9.

    Article  Google Scholar 

  20. Li-ping W, Ai-jun XU. Development of Hierarchical Treatment for Hypertension in China: a Study Based on the Analysis of Hypertension Treatment Pathways. Chinese General Practice. 2018;21(10):1183–7 1192.

    Google Scholar 

  21. Wang Z, Zhao T. Comprehenive Prevention and Treatment of Hypertension of Primary Care In China. Chinese Journal of the Frontiers of Medical Science ( Electronic Version ). 2013;11:25–9.

    Google Scholar 

  22. Xu D, Wang G, Zhang M, Zhang Y, Peng Y. Present situation and strategies of collaboration-division between public hospitals and basic medical and health institutions. Chinese Hospital Management. 2013;04:11–3.

    Google Scholar 

  23. Shan-shan L, Min GE, Ping J, Min-jie Z, Hong L, Jiao-ling H, Shuai F, De-yu Z, Yi-min Z. Effects of contractual services from family doctors on the healthcare-seeking behavior among community residents. Chinese General Pratice. 2018;21(4):407–10.

    Google Scholar 

  24. Feng-juan G, Xue-feng DU, Yu-hui S, Pei-yu W, Zheng-zheng H, Qian GAO. Evaluation of the effect of contracted service mode of the general practitioner on the hierarchical diagnosis and treatment of patients with primary Hypertension in the Desheng Community of Beijing City. Chinese General Practice. 2018;21(9):1070–4.

    Google Scholar 

  25. Hypertension P. National Guideline for prevention and treatment of Hypertension in primary care. Chinese Circulation Journal. 2017;11:1041–8.

    Google Scholar 

  26. Baker R, Mainous AR, Gray DP, Love MM. Exploration of the relationship between continuity, trust in regular doctors and patient satisfaction with consultations with family doctors. Scand J Prim Health Care. 2003;21(1):27–32.

    Article  Google Scholar 

  27. Uijen AA, Schers HJ, Schellevis FG, Mokkink HG, van Weel C, van den Bosch WJ. Measuring continuity of care: psychometric properties of the Nijmegen continuity questionnaire. Br J Gen Pract. 2012;62(600):e949–57.

    Article  Google Scholar 

  28. Uijen AA, Heinst CW, Schellevis FG, van den Bosch WJ, van de Laar FA, Terwee CB, Schers HJ. Measurement properties of questionnaires measuring continuity of care: a systematic review. PLoS One. 2012;7(7):e42256.

    Article  CAS  Google Scholar 

  29. Beaton DE, Bombardier C, Guillemin F, Ferraz MB. Guidelines for the process of cross-cultural adaptation of self-report measures. Spine (Phila Pa 1976). 2000;25(24):3186–91.

    Article  CAS  Google Scholar 

  30. Hetlevik O, Hustoft M, Uijen A, Assmus J, Gjesdal S. Patient perspectives on continuity of care: adaption and preliminary psychometric assessment of a Norwegian version of the Nijmegen continuity questionnaire (NCQ-N). BMC Health Serv Res. 2017;17(1):760.

    Article  Google Scholar 

  31. Lisheng L. 2010 Chinese guidelines for the management of hypertension. Chinese Journal of Hypertension. 2011;19(08):701–43.

    Google Scholar 

  32. Ofer-Shiber S, Molad Y. Association of the Charlson comorbidity index with renal outcome and all-cause mortality in antineutrophil cytoplasmatic antibody-associated vasculitis. Medicine (Baltimore). 2014;93(25):e152.

    Article  Google Scholar 

  33. Fan X, Lee KS, Frazier SK, Lennie TA, Moser DK. Psychometric testing of the Duke activity status index in patients with heart failure. Eur J Cardiovasc Nurs. 2015;14(3):214–21.

    Article  Google Scholar 

  34. Quan-Quan D, Li S. Differential validity of SAS and SDS among psychiatric non-psychotic outpatients and their partners. Chin Ment Health J. 2012;26(9):676–9.

    Google Scholar 

  35. Wang H, Kindig DA, Mullahy J. Variation in Chinese population health related quality of life: results from a EuroQol study in Beijing, China. Qual Life Res. 2005;14(1):119–32.

    Article  Google Scholar 

  36. O'Brien E, Parati G, Stergiou G, Asmar R, Beilin L, Bilo G, Clement D, de la Sierra A, de Leeuw P, Dolan E, et al. European Society of Hypertension position paper on ambulatory blood pressure monitoring. J Hypertens. 2013;31(9):1731–68.

    Article  CAS  Google Scholar 

  37. Shrout PE, Fleiss JL. Intraclass correlations: uses in assessing rater reliability. Psychol Bull. 1979;86(2):420–8.

    Article  CAS  Google Scholar 

  38. Marx RG, Menezes A, Horovitz L, Jones EC, Warren RF. A comparison of two time intervals for test-retest reliability of health status instruments. J Clin Epidemiol. 2003;56(8):730–5.

    Article  Google Scholar 

  39. Wang SY, Zang XY, Liu JD, Gao M, Cheng M, Zhao Y. Psychometric properties of the functional assessment of chronic illness therapy-fatigue (FACIT-fatigue) in Chinese patients receiving maintenance dialysis. J Pain Symptom Manag. 2015;49(1):135–43.

    Article  Google Scholar 

  40. Lynn MR. Determination and quantification of content validity. Nurs Res. 1986;35(6):382–5.

    Article  CAS  Google Scholar 

  41. Polit DF, Beck CT, Owen SV. Is the CVI an acceptable indicator of content validity? Appraisal and recommendations. Res Nurs Health. 2007;30(4):459–67.

    Article  Google Scholar 

  42. Cole DA. Utility of confirmatory factor analysis in test validation research. J Consult Clin Psychol. 1987;55(4):584–94.

    Article  Google Scholar 

  43. Dwinger S, Kriston L, Harter M, Dirmaier J. Translation and validation of a multidimensional instrument to assess health literacy. Health Expect. 2015;18(6):2776–86.

    Article  Google Scholar 

  44. Boockvar K, Vladeck BC. Improving the quality of transitional care for persons with complex care needs. J Am Geriatr Soc. 2004;52(5):855–6 856.

    Article  Google Scholar 

  45. Boston-Fleischhauer C, Rose R, Hartwig L. Cross-continuum care continuity: achieving seamless care and managing comorbidities. J Nurs Adm. 2017;47(7–8):399–403.

    Article  Google Scholar 

  46. Kjeldsen S, Feldman RD, Lisheng L, Mourad JJ, Chiang CE, Zhang W, Wu Z, Li W, Williams B. Updated national and international hypertension guidelines: a review of current recommendations. Drugs. 2014;74(17):2033–51.

    Article  Google Scholar 

  47. Chen F, Zhang L, Yang W, Xu J, Luo D. Status analysis of the basic health service system. Chinese Hospital Management. 2013;03:26–7.

    Google Scholar 

  48. Rahman M, Williams G, Al MA. Gender differences in hypertension awareness, antihypertensive use and blood pressure control in Bangladeshi adults: findings from a national cross-sectional survey. J Health Popul Nutr. 2017;36(1):23.

    Article  Google Scholar 

  49. Yin HS, Jay M, Maness L, Zabar S, Kalet A. Health literacy: an educationally sensitive patient outcome. J Gen Intern Med. 2015;30(9):1363–8.

    Article  Google Scholar 

  50. Bo A, Friis K, Osborne RH, Maindal HT. National indicators of health literacy: ability to understand health information and to engage actively with healthcare providers - a population-based survey among Danish adults. BMC Public Health. 2014;14:1095.

    Article  Google Scholar 

  51. Paasche-Orlow MK, Wolf MS. The causal pathways linking health literacy to health outcomes. Am J Health Behav. 2007;31(Suppl 1):S19–26.

    Article  Google Scholar 

  52. Wang C, Kane RL, Xu D, Meng Q. Health literacy as a moderator of health-related quality of life responses to chronic disease among Chinese rural women. BMC Womens Health. 2015;15:34.

    Article  CAS  Google Scholar 

  53. Wang J. “Four stops” rehabilitation service mode based on the medical union. Chinese General Practice. 2018;05:555–8.

    Google Scholar 

  54. Xie Y, Li Y. Studying on the status of medical services alliance combining tertiary hospitals with county hospitals sampled with Neijiang City. The Chinese Health Service Management. 2016;07:505–7.

    Google Scholar 

  55. Fontanella CA, Guada J, Phillips G, Ranbom L, Fortney JC. Individual and contextual-level factors associated with continuity of care for adults with schizophrenia. Admin Pol Ment Health. 2014;41(5):572–87.

    Article  Google Scholar 

  56. Napolitano F, Napolitano P, Garofalo L, Recupito M, Angelillo IF. Assessment of continuity of care among patients with multiple chronic conditions in Italy. PLoS One. 2016;11(5):e154940.

    Article  Google Scholar 

  57. Christakis DA, Kazak AE, Wright JA, Zimmerman FJ, Bassett AL, Connell FA. What factors are associated with achieving high continuity of care? Fam Med. 2004;36(1):55–60.

    PubMed  Google Scholar 

  58. Nyweide DJ. Concordance between continuity of care reported by patients and measured from administrative data. Med Care Res Rev. 2014;71(2):138–55.

    Article  Google Scholar 

Download references

Acknowledgements

The authors express their appreciation to the staff and patients of three hospitals for their support in data collection.

Funding

The research was funded by Tianjin Research Program of Application Foundation and Advanced Technology (15JCQNJC12000); The Science &Technology Development Fund of Tianjin Education Commission for Higher Education (2017SK097). The National Natural Science Fund (71673199). All the funding body funded for data collection, experts consultation as well as personnel service fees in the research.

Availability of data and materials

The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.

Author information

Authors and Affiliations

  1. School of Nursing, Tianjin Medical University, Qixiangtai Road, Heping District, Tianjin, China

    Chen Qiu, Shixiang Chen, Yue Zhao & Xiaoying Zang

  2. Department of Emergency, Tianjin Medical University General Hospital, Tianjin, China

    Ying Yao

  3. Department of Cardiology, Second Affiliated Hospital of Tianjin University of Traditional Chinese Medicine, Tianjin, China

    Yi Xin

Authors
  1. Chen Qiu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Shixiang Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Ying Yao
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Yue Zhao
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Yi Xin
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Xiaoying Zang
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

C Q, XY Z developed the project idea, worked on the translation of the NCQ-C. C Q, SX C and Y Y collected the data and performed the statistical analyses. XY Z and Y Z contributed to modify the paper. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Xiaoying Zang.

Ethics declarations

Ethics approval and consent to participate

This study was approved by the Research Ethics Committees of Tianjin Medical University. Written consent from all participants was also obtained.

Consent for publication

Not applicable

Competing interests

The authors declare that they have no competing interests.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and Permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Qiu, C., Chen, S., Yao, Y. et al. Adaption and validation of Nijmegen continuity questionnaire to recognize the influencing factors of continuity of care for hypertensive patients in China. BMC Health Serv Res 19, 79 (2019). https://doi.org/10.1186/s12913-019-3915-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12913-019-3915-6

Keywords

  • Continuity of care
  • Hypertension
  • Chronic diseases
  • Reliability
  • Validity

BMC Health Services Research

ISSN: 1472-6963

Contact us