Skip to main content

Assessing cancer patients’ quality of life and supportive care needs: Translation-revalidation of the CARES in Flemish and exhaustive evaluation of concurrent validity



The prevalence of cancer increases every year, leading to a growing population of patients and survivors in need for care. To achieve good quality care, a patient-centered approach is essential. Correct and timely detection of needs throughout the different stages of the care trajectory is crucial and can be supported by the use of screening and assessment in a stepped-care approach. The Cancer Rehabilitation Evaluation System (CARES) is a valuable and comprehensive quality of life and needs assessment instrument. For use in Flemish research and clinical practice, the CARES tool was translated for the Dutch-speaking part of Belgium (Flanders) from its original English format. This protocol paper describes the translation and revalidation of this Flemish CARES version.


After forward-backward translation of the CARES into Flemish we aim to recruit 150 adult cancer patients with a primary cancer diagnosis (stage I, II or III) for validation. In this study with a combination of qualitative and a quantitative approach, qualitative data will be collected through focus groups and supplemented by two phases of quantitative data collection: i) an initial patient survey containing questions on socio-demographic and medical data, the CARES and seven concurrent instruments; and ii) a second survey administered after 1 week containing the CARES and supplementary questions to explore their impressions on the content and the feasibility of the CARES.


With this extensive data collection process, psychometric validity of the Flemish CARES can be tested thoroughly using classical test theory. Internal consistency of summary scales, test-retest reliability, content validity, construct validity, concurrent validity and feasibility of the instrument will be examined. If the Flemish CARES version is found reliable, valid and feasible, it will be used in future research and clinical practice. Comprehensive assessment with the CARES in a stepped-care approach can facilitate timely identification of cancer patients’ psychosocial concerns and care needs so it can contribute to efficient provision of patient-centered quality care.

Trial registration NCT02282696 (July 16, 2014).

Peer Review reports


The diagnosis of cancer has an enormous impact on people’s lives. In additional to the threat on one’s physical health, cancer patients are confronted with psychosocial problems and care needs [113]. Timely and accurate detection of those psychosocial problems and care needs is of great importance to offer more patient-centered care, efficient referral and to prevent comorbid psychopathology [1418].Simple quality of life (QOL) measurement and distress-screening are popular methods to explore people’s psychosocial well-being [9, 1922]. In contrast, needs assessment is a strategy that focuses on identifying the unresolved concerns that patients are experiencing and determines if they desire further assistance throughout the continuum of care [23]. Indeed, not all patients experiencing distress or reduced QOL and need professional support from the care system [24]. Needs assessment can provide important input from the patients’ perspective and guide appropriate intervention in the multidisciplinary process of care. As a result of patient-report data, health care resources can be allocated in the most appropriate way. The use of needs assessment can therefore contribute to patient-centered quality cancer care [14, 2527].

To our knowledge there are no validated Flemish needs assessment tools available. Therefore, this study will be dedicated to the validation of a needs assessment tool for use in Belgian research and clinical practice. To provide a good understanding of psychosocial healthcare needs, the content of a needs assessment tool should be comprehensive enough to benefit multidisciplinary stakeholders involved in cancer care i.e. medical specialists, nursing, psychologists, social welfare workers, general practitioners, health insurance agencies. In the search for an appropriate needs assessment tool, the following criteria were used: 1) the instrument should be generic across tumor type and staging, i.e. suitable in all cancer patients; 2) the assessment should encompass the bio-psychosocial impact of the disease and treatment on patients’ overall well-being i.e. physical, emotional, cognitive, social, relational, sexual and financial, their daily functioning and the potential resulting care needs; and, 3) the tool should have a proven psychometric robustness, demonstrating good reliability and validity, and be feasible for patients.

Several review studies describing needs assessment tools for adult cancer patients are available [2830]. From the tools discussed 24 instruments are patient-reported outcomes (PRO) for adult patients with any type of cancer. These needs assessment tools and associated psychometric properties are presented in brief in Table 1 (and in full in Additional file 1).

Table 1 Summary of needs assessment tools and psychometric properties

Among other tools, the Cancer Rehabilitation Evaluation System (CARES) was positively evaluated [2830]. The CARES is a QOL and needs assessment instrument, developed to provide an efficient way of gathering specific information about the day-to-day problems and rehabilitation needs of cancer patients. The instrument can be used for research or clinical objectives and has been applied across cancer type and stage [3144]. The 139 items of the CARES are placed under 31 subscales and represented according to six summary scales, as shown in Table 2. A copy of the original CARES questionnaire and patient score profile can be found in Additional files 2 and 3.

Table 2 CARES Summary scales and subscales

The psychometric robustness of the CARES and its earlier development versions (the Cancer Inventory of Problem Situations) are well documented [33, 34, 36, 45]. The results demonstrate that the CARES and its summary scales have excellent internal consistency (α = 0.87–0.94) and high test-retest correlations (r = 0.84–0.95). The instrument has moderate to high correlations with the Symptom Checklist-90 (SCL-90) [46], Dyadic Adjustment Scale (DAS) [47], Karnofsky Performance status Scale (KPS) [48, 49] and a visual analogue scale [50] for QOL before and after cancer, that were used to investigate concurrent validity. The content validity was supported with the results from post-administration interviews [35, 45].

Considering the CARES is reported as a valid and feasible tool that can be used for all cancer patients to assess a comprehensive range of bio-psychosocial aspects of well-being, this instrument was chosen to be translated and validated for further use in Flemish cancer care facilities and research.

The psychometric robustness of the Flemish CARES version will be tested thoroughly. We plan to evaluate the internal consistency of the CARES and its summary scales, the test-retest reliability will be considered, the construct validity will be explored, and the concurrent validity of the CARES and its summary scales will be checked with several comparative instruments. This paper describes the study protocol of this multi-stepped process.


Translation of the CARES

Belgium is a trilingual country with Dutch, French and German as official state languages. The Dutch language in Belgium, called Flemish, is slightly different from the Dutch language in the Netherlands in terms of vocabulary. Since current CARES translation is made for the Dutch-speaking part of Belgium, this paper refers to the Flemish CARES version only. We have no knowledge of a CARES translation appropriate for The Netherlands. However, there is a translation of the CARES-Short Form (CARES-SF) [51]. If one would like to use the full version of the CARES in The Netherlands, a revision of the translation would be needed.

The Flemish CARES version resulted from a forward-backward translation process with sworn translators and an expert group, following the guidelines for translating questionnaires described by Beaton et al. [52]. First, sworn translators translated the original US English CARES into Flemish. Two independent researchers revised the resulting texts for content fidelity and an expert group, comprised of professionals from the field of care management, oncology, primary care and psychology, agreed on the final Flemish version. The questionnaire was again translated back into English by sworn translators and the original CARES and English back-translation were compared by a native speaker, concluding the content of the questionnaire was maintained.

Design of the study

A mix of qualitative and quantitative methods will be used for the validation study of the Flemish CARES.

Qualitative data collection, that will be used to evaluate content validity and feasibility of the instrument, will consist of conducting focus group discussions until data saturation is reached. We estimate that it will be necessary to arrange four or five focus group discussions with six to ten participants. The discussions will be facilitated with several key questions and transcribed afterwards for thematic content analysis. Further detailed description of this qualitative research activities will be part of another publication, since we prefer to focus on a detailed description of the quantitative research in this paper.

For the quantitative data collection, questionnaires containing the CARES and different complementary instruments (see further) will be used to evaluate reliability, construct validity and concurrent validity. This quantitative part of the validation study is described in further detail in this protocol.

Sample size

There are no general criteria for the sample size in a validation study, but a sample size of at least 50–100 is generally recommended [53]. Sample sizes in the validation research of the original CARES varied for each psychometric quality (Table 3) [35]. Two large sample sizes of 479 and 1047 were used for the investigation of construct validity. Other aspects of reliability and validity were tested with sample sizes of 22 to 120 participants. Given the available time and resources, setting the goal to include 150 participants for this validation study of the Flemish CARES version is feasible. Considering the response rates of 40–60 % that are usually reached in the research domain of psycho-oncology, inviting at least 250 eligible patients is a conservative approach to guarantee the minimal amount of 150 participants.

Table 3 Sample sizes validation research original CARES

Study population and recruitment

The CARES was constructed to detect rehabilitation needs and QOL, with a secondary intent to stimulate patients’ competences and patient empowerment for increased involvement in their own rehabilitation. Therefore, only patients with a primary cancer diagnosis treated with a curative intent will be recruited for this validation study. Details on the in- and exclusion criteria are listed in Table 4.

Table 4 Inclusion and exclusion criteria for eligible patients

Participants will be recruited from four Flemish hospitals (two public and two private, with a range from 340 to 1015 beds). In order to generate a representative research sample, several medical departments will conduct patient recruitment and include medical oncology, radiotherapy, gynecology, urology, and gastroenterology services.

Study procedure

Eligible patients will be selected by the medical team according to the inclusion and exclusion criteria. Given the complexity of the clinical field and variable structures of the participating departments, two alternative procedures to invite patients to participate in the study will be used. On the basis of team organization and availability of time, the physician of the medical unit will choose to recruit patients with either the ‘face-to-face procedure’ or the ‘post procedure’. In the ‘face-to-face procedure’, a member of the medical team will explain the study briefly and invite the patient to participate. If the patient agrees to participate, he/she will immediately receive a study package with the informed consent form, a ‘what to do’-scheme, the first questionnaire and a stamped and addressed envelope to return the questionnaire. In the ‘post procedure’, eligible patients will be sent an identical study package by post, containing a short letter explaining the study, the informed consent form, a ‘what to do’-scheme, the first questionnaire and a stamped and addressed envelope to return the questionnaire. One week later participants have to fill in the second questionnaire, containing the CARES for test-retest reliability, and send it back in another stamped and addressed envelope provided. If the questionnaire is not sent back, the participants recruited via the ‘face-to-face procedures will be contacted by a team member and asked if they still want to participate and asked to return a completed questionnaire. Participants invited through post-procedure will be sent a reminder and second questionnaire package after 1 month. This study procedure is visualized in Fig. 1.

Fig. 1
figure 1

Study procedure

Participants will be contacted by phone or by e-mail when returned questionnaires have a large number of missing responses or if the second questionnaire is not received in the expected timespan. Ethical standards limit the number of participant contacts, there is a maximum of two attempts to contact a participant.


Data collected with the first questionnaire includes socio-demographic characteristics, medical characteristics, the CARES and several concurrent instruments measuring the same concepts as the CARES or its subscales. These seven independent, but complementary, instruments are all considered to be international ‘gold standards’ or are frequently used instruments. These instruments were selected as they represent domains similar to the summary scales and global score of the CARES. All of them have been previously used in Belgian research. The concurrent validity of the original CARES was evaluated in comparison with the SCL-90, DAS and the KPS [34]. However, these instruments do not match the content of the CARES as completely as the set of concurrent measures in current study does. The concept equivalence and expected correlation with the CARES, to evaluate concurrent validity, is shown in Table 5.

Table 5 Expected correlations of concurrent measures with CARES summary scales and global score

CARES [3137]

The original CARES contains 139 items; however, not all 139 items apply to all patients and therefore patients complete a minimum of 93 items or a maximum of 132 items. Patients can rate each item, formulated as problem statement, on a 5-point Likert scale with zero representing “not at all” (no problem) and four representing “very much” (severe problem). The clinical form of the instrument that will be used in this study allows a patient to indicate which problems they believe require help, ticking ‘yes’ or ‘no’ on the question ‘Do you want help?’. Scores for the five summary scales can be computed as well as a CARES global score and an average severity score.

Karnofsky Performance status Scale (KPS) [48, 54, 55]

The KPS is an 11-point scale to judge the physical and daily functioning of a patient and ranges from 0 (completely dependent, not able to care for oneself) to 100 (fully active, not dependent and capable of normal activity without limitations). This measure is currently used worldwide in research and practice and has been administered for many years. The KPS has got good psychometric properties (interrater reliability: r = .97; concurrent validity: p < .001; predictive validity: r = .30).

The Hospital Anxiety and Depression Scale (HADS) [5658]

The HADS was developed to identify symptoms of anxiety and depression in medically ill patients, and is used extensively in cancer patients and had excellent psychometric qualities. The questionnaire contains 14 items with four possible answers with scores ranging from 0 to 3. Higher scores on the two subscales (each consisting of seven items) indicate a higher level of anxiety or depression and the total score of the HADS (score-ranges from 0 to 42) can be used as a global measure of psychological distress. The HADS has got good psychometric properties (internal consistency: α = .67–.93; PCA: two factor solution; concurrent validity: r = .49–.83; subscale inter-correlations: r = .40–.74).

The Social Support List – Interactions and Discrepancies (SSL-I and –D) [5961]

The SSL is a questionnaire with 75 items, 41 on experienced social interaction and 34 on experienced social discrepancies. In the first part of the questionnaire participants indicate how frequently certain social interactions occur on a 4-point Likert scale from 1 (‘seldom or never’) to 4 (‘very often’), with higher scores representing higher levels of social support. A second part of the SLL indicates the social discrepancies participants experience ranging from 1 (‘I would like it to happen more often’) to 4 (‘it happens too often’). Higher scores on the SSL-D indicate a greater lack of social support. The psychometric properties of the SSL are positively evaluated (internal consistency: α = .53–.93, test-retest reliability: r = .62–.85).

The Maudsley Marital Questionnaire (MMQ) [6265]

The MMQ contains three scales exploring Marital (10 items), Sexual (five items) and General Life (five items) adjustment. The respondent is asked to indicate an answer from a series of possible answers, on a scale ranging from 0 to 8. The wording of response categories differ for each item depending on nature of the question. The MMQ has good psychometric properties (internal consistency: α = ..66–.90; PCA: three factor solution; subscale inter-correlations: r = .33–.60).

The European Organisation of Research and Treatment for Cancer Quality of Life Questionnaire Core 30 (EORTC-QLQ-C30) [66]

The EORTC QLQ-C30 is an internationally validated and widely used cancer-targeted QOL instrument, incorporating five functional scales (physical, role, cognitive, emotional and social) and three symptom scales (fatigue, pain and nausea, and vomiting). Items are answered on a 4-point Likert scale from 1 (‘not at all’) to 4 (‘very much’). The last two items on global health and QOL have 8-point answering scales ranging from 1 (‘very poor’) to 7 (‘excellent’). The EORTC QLQ -C30 is subject of a many validation studies worldwide, generally concluding the questionnaire is a QOL instrument with good psychometric properties relevant to different cancer-patient populations (internal consistency: α = .52–.92; test-retest reliability: r = .72–.84; scale inter-correlations: r = -.69–.85; responsive to change of health status).

The Distress Thermometer (DT) together with a Problem List (PL) [6769]

Patients are asked to rate their overall distress on a visual analogue scale (presented as a thermometer) from 0 (‘no distress’) to 10 (‘extreme distress’). The DT is accompanied by the PL, which includes 35 items that address five life domains (practical, family/social, emotional, spiritual, and physical problems). Participants indicate if the topics of the items poses problems for them. At the end of the survey people are asked if they want to talk to a professional about their problems. The DT is frequently used in clinical practice and research all over the globe, in combination with the PL. This has proved to have good internal consistency (α = .80–.90).

Care Needs questionnaire [70]

The Care Needs questionnaire was developed to assess the care needs of cancer survivors regarding relevant themes during reintegration: physical functioning, psychological functioning, self and body image, sexuality, relationship with partner, relationship with others and work and social security related aspects. For each theme, participants are asked whether they wish to receive information or support, in what way, when they prefer to receive information and support, and to what extent this need already has been met. Each of the questions are answered on 3- and 4-point Likert scales with different wording.

The second questionnaire contains a second CARES survey and specific supplementary questions to get data on participants’ experiences with the CARES. This second study component will be completed to assess test-retest and a patient-acceptability of the measure. Table 6 gives a detailed summary on the composition of both questionnaires and the measured concepts.

Table 6 Composition of questionnaires for quantitative data collection

Ethical considerations

All local ethical committees of the participating hospitals (Ethical Review Commission Jessaziekenhuis; Committee Medical Ethics Ziekenhuis Oost-Limburg; Ethical Committee AZ Vesalius; Ethical Committee Mariaziekenhuis Noord-Limburg) and the university (Medical Ethical Committee Hasselt University) reviewed all study materials including: the recruitment materials and procedure, informed consent form, the questionnaires and the overall study protocol. The leading ethical committee (ERC Jessaziekenhuis) coordinated the process, collected feedback and granted approval on 26th of February 2014 (BE24320149544). The leading ethical committee also reviewed and approved study protocol amendments.

Data analysis

The Statistical Package for Social Sciences (SPSS; Chicago, IL) version 22.0 will be used for statistical analyses of the quantitative data. A range of analyses are required to report the reliability and validity of the translated CARES version.


The reliability of the CARES will be evaluated by computing the internal consistency of summary scales, with the aim to find a Cohen’s Alpha of at least .70 [71, 72]. Test-retest reliability will be investigated by computing the intra-class correlations between the summary scale scores and total-CARES scores of the first and second CARES administration, requiring a correlation ≥ .70 [71, 73].

Construct validity

The five factor structure as found in previous CARES-research will be examined with principal component analysis to evaluate construct validity. Following previous validation techniques applied in the original CARES development process, items and subscales with a factor loading higher as .30 are seen as loading on a factor [34, 35]. Confirmatory factor analysis will not be applied since sample size will be limited. As well inter-correlations of summary scales and the CARES Total will be explored. Moderate correlations between the subscales (r = |.30|-|.70|) and moderate to high correlations with the CARES Total (r ≥ .30) would support construct validity, since this would indicate that the subscales indeed measure distinct, but related concepts that contribute to the larger concept of QOL.

Concurrent validity

Spearmans rank correlations will be computed to evaluate concurrent validity of the CARES global score and the summary scales with the seven concurrent instruments (Table 5). Correlations will be judged low, moderate and high, when their absolute values are respectively < .30, from .30 to .50 and ≥ .50 [74].

If the psychometric qualities do not show as expected, these will be studied in more detail with qualitative research data on CARES content and feasibility to search for explanations.


To achieve good quality care it is important to provide it as efficiently as possible, and adapted to the individual needs of every patient. A stepped care approach according to patients’ level of need could serve to tailor care efficiently and appropriately, however this necessitates reliable and valid screening and assessment tools to support clinicians in the identification of psychosocial concerns and care needs of their patients. The current English CARES is such an instrument. This paper describes a comprehensive protocol for translating and validating a Flemish CARES version. This addresses a critical gap in current clinical screening, and adds a tool to assess and improve the delivery of patient-centered care.

Unique in this study is the use of a wide range of comparative instruments to examine the concurrent validity of the CARES. Many other validation studies use only a few dimensions, not reflecting the whole concept of the specific instrument [28, 29, 75]. In contrast, this study will include an instrument to examine concurrent validity almost for each summary scale and the CARES global score. While our study is set up to examine the psychometric quality of the Flemish CARES, an additional advantage is that the use of several concurrent instruments will provide us with a wealth of data. The use of the KPS, HADS, SSL, MMQ, EORTC QLQ-C30, DT, PL and the Care needs questionnaire of Pauwels et. al. provides data on psychological, social, marital and sexual wellbeing, QOL, distress and care needs of patients treated for cancer. These can be used to explore potential relationships between mutual care-domains and with socio-demographic and medical characteristics. The recruitment for this study has begun (March 2014) and will continue until the end of 2014 or until the desired sample size is reached.

As in all studies, this study has some limitations. Firstly, the completeness of the CARES content to assess QOL and supportive care needs should be considered. In comparison to other psychometric positively evaluated needs assessment tools for cancer patients, like the Supportive Care Needs Survey (SCNS) [76], the CARES does not include items on spiritual and existential well-being [29]. However, on other domains of well-being, we can judge in favor of the CARES content. The content of the CARES matches with our thoughts about the bio-psychosocial impact of cancer on patients’ lives and possibly resulting care needs. Furthermore, the content validity, completeness and feasibility of the CARES for Flemish cancer patients will be explored in the qualitative part of the larger study combining qualitative and quantitative methods. If the results of the study described in this research protocol result in a negative evaluation of the CARES’ psychometric properties, or it appears from the focus group discussions that there are deficits in the CARES content, formulation of items, or feasibility, adjustments for an improved Flemish version will be made. We plan to use this ‘final’ Flemish version in a pilot study where it will support the routine assessment and management of patients’ psychosocial concerns and needs in a clinical pathway with medical and psychosocial components. In the future, the instrument will also be made available for use in clinical practice.

Secondly, the use of two procedures to invite patients to participate in the study can introduce bias. An invitation to participate in research from a member of the medical team or by post could result in different response rates in both subgroups. This is a demanding study for patients and therefore also for professionals to convince patients to participate. Hence, some flexibility in the process of patient recruitment is needed. Some departments prefer a personal approach and want to invite their patients for the research personally, while others do not find the time in the clinical appointment to do this. Both procedures have been previously used in other validation research [66, 75, 7780]. To assess any recruitment or consent bias, we will compare the data from the group of patients invited to participate in the hospital to the group invited by post.

Thirdly, the questionnaire package composed with the CARES and several concurrent instruments asks for a time-investment of approximately an hour. This could present a burden to participants, resulting in discontinuation of participation. However, preliminary study results report approximately 58 % of the questionnaires distributed were returned completed. Eighty-four percent of the 153 participants who returned the first questionnaire also returned the second questionnaire completed.

Fourthly, the time between completing of the first and the second CARES survey could pose some problems. To examine test-retest reliability of an instrument the time period between two completions should be short enough to ensure that clinical change has not occurred, though long enough to prevent recall. While 1 or 2 weeks are recommended in literature [53], we ask participants to fill out the second questionnaire 1 week after the first. Preliminary results have shown some participants forget to fill in the second questionnaire or do not do so in a timely manner. They are reminded with a phone call by the researcher when de second questionnaire is not received in the recommended period of time. When data collection is completed, the time span between the two CARES-completions will be evaluated.

Fifthly, in earlier research the CARES was validated and used as a research tool for participants with various types of cancers, various cancer stages, at different phases of the care process, and often without age restrictions [3144]. Because of the strict inclusion criteria we applied in our study, we have to state that the validation evidence from this study will not apply to patients above 60 years of age, and those with metastatic disease or in palliative care.”


In summary, this study protocol describes a unique and thorough examination of the psychometric robustness of a QOL and needs assessment tool. Internal consistency of summary scales, test-retest reliability, content validity, feasibility, construct validity and concurrent validity of the Flemish CARES are explored. Likewise, the use of several concurrent instruments will provide insight in the QOL, physical, emotional, social, relational and sexual functioning and well-being, distress and care needs of the research population. We expect to find positive results on the reliability and validity of the Flemish CARES version. Comprehensive assessment with the CARES throughout the care trajectory can contribute to timely identification of cancer patients psychosocial concerns and care needs to refer them to tailored care and improve the quality of psychosocial cancer care.



Cancer Rehabilitation Evaluation System


Cancer Rehabilitation Evaluation System-Short Form


Dyadic Adjustment Scale


Distress Thermometer


European Organisation of Research and Treatment for Cancer Quality of Life Questionnaire Core 30


Hospital Anxiety and Depression Scale


Karnofsky Performance status Scale


Maudsley Marital Questionnaire


Problem List


Patient-Reported Outcome


Quality Of Life


Symptom Checklist-90


Supportive Care Needs Survey


Statistical Package for Social Sciences


Social Support List – Interactions


Social Support List – Discrepancies


  1. Allen JD, Savadatti S, Levy AG. The transition from breast cancer 'patient' to 'survivor'. Psychooncology. 2009;18(1):71–8.

    Article  PubMed  Google Scholar 

  2. Armes J, Crowe M, Colbourne L, Morgan H, Murrells T, Oakley C, Palmer N, Ream E, Young A, Richardson A. Patients' supportive care needs beyond the end of cancer treatment: a prospective, longitudinal survey. J Clin Oncol. 2009;27(36):6172–9.

    Article  PubMed  Google Scholar 

  3. Boyes AW, Girgis A, D'Este C, Zucca AC. Prevalence and correlates of cancer survivors' supportive care needs 6 months after diagnosis: a population-based cross-sectional study. BMC Cancer. 2012;12:150.

    Article  PubMed  PubMed Central  Google Scholar 

  4. Parry C, Lomax JB, Morningstar EA, Fairclough DL. Identification and correlates of unmet service needs in adult leukemia and lymphoma survivors after treatment. J Oncol Pract. 2012;8(5):e135–41.

    Article  PubMed  PubMed Central  Google Scholar 

  5. Knobf MT, Ferrucci LM, Cartmel B, Jones BA, Stevens D, Smith M, Salner A, Mowad L. Needs assessment of cancer survivors in Connecticut. J Cancer Surviv. 2012;6(1):1–10.

    Article  PubMed  Google Scholar 

  6. Brix C, Schleussner C, Fuller J, Roehrig B, Wendt TG, Strauss B. The need for psychosocial support and its determinants in a sample of patients undergoing radiooncological treatment of cancer. J Psychosom Res. 2008;65(6):541–8.

    Article  PubMed  Google Scholar 

  7. Browne S, Dowie A, Mitchell L, Wyke S, Ziebland S, Campbell N, Macleod U. Patients' needs following colorectal cancer diagnosis: where does primary care fit in? Br J Gen Pract. 2011;61(592):e692–9.

    Article  PubMed  PubMed Central  Google Scholar 

  8. Mikkelsen T, Sondergaard J, Jensen AB, Olesen F. Cancer rehabilitation: Psychosocial rehabilitation needs after discharge from hospital? Scand J Prim Health Care. 2008;26(4):216–21.

    Article  PubMed  PubMed Central  Google Scholar 

  9. Carlson LE, Bultz BD. Cancer distress screening. Needs, models, and methods. J Psychosom Res. 2003;55(5):403–9.

    Article  PubMed  Google Scholar 

  10. Carlson LE, Groff SL, Maciejewski O, Bultz BD. Screening for Distress in Lung and Breast Cancer Outpatients: A Randomized Controlled Trial. J Clin Oncol. 2010;28(33):4884–91.

    Article  PubMed  Google Scholar 

  11. Zabora J, BrintzenhofeSzoc K, Curbow B, Hooker C, Piantadosi S. The prevalence of psychological distress by cancer site. Psychooncology. 2001;10(1):19–28.

    Article  CAS  PubMed  Google Scholar 

  12. Maurer J, Schafer C, Maurer O, Kolbl O. Anxiety and depression in cancer patients during the course of radiotherapy treatment. Strahlenther Onkol. 2012;188(10):940–5.

    Article  CAS  PubMed  Google Scholar 

  13. Jacobsen PB, Donovan KA, Trask PC, Fleishman SB, Zabora J, Baker F, Holland JC. Screening for psychologic distress in ambulatory cancer patients. Cancer. 2005;103(7):1494–502.

    Article  PubMed  Google Scholar 

  14. Io M. Cancer Care for the Whole Patient: Meeting Psychosocial Health Needs. Washington, DC: The National Academies Press; 2008.

    Google Scholar 

  15. Braeken AP, Kempen GI, Eekers DB, Houben RM, van Gils FC, Ambergen T, Lechner L. Psychosocial screening effects on health-related outcomes in patients receiving radiotherapy. A cluster randomised controlled trial. Psychooncology. 2013;22(12):2736–46.

    Article  PubMed  Google Scholar 

  16. Mitchell AJ. Screening for cancer-related distress: when is implementation successful and when is it unsuccessful? Acta Oncol. 2013;52(2):216–24.

    Article  PubMed  Google Scholar 

  17. Zabora JR, Macmurray L. The history of psychosocial screening among cancer patients. J Psychosoc Oncol. 2012;30(6):625–35.

    Article  PubMed  Google Scholar 

  18. Bauwens S, Baillon C, Distelmans W, Theuns P. Systematic screening for distress in oncology practice using the Distress Barometer: the impact on referrals to psychosocial care. Psychooncology. 2014;23(7):8004–844.

    Article  Google Scholar 

  19. Aaronson NK, Sprangers MA. Measuring quality of life in every oncological patient. Ned Tijdschr Geneeskd. 2011;155(45):A3749.

    PubMed  Google Scholar 

  20. Donovan KA, Grassi L, McGinty HL, Jacobsen PB. Validation of the Distress Thermometer worldwide: state of the science. Psychooncology. 2014;23(3):241–50.

    Article  PubMed  Google Scholar 

  21. Mitchell AJ, Vahabzadeh A, Magruder K. Screening for distress and depression in cancer settings: 10 lessons from 40 years of primary-care research. Psychooncology. 2011;20(6):572–84.

    Article  PubMed  Google Scholar 

  22. Bidstrup PE, Johansen C, Mitchell AJ. Screening for cancer-related distress: Summary of evidence from tools to programmes. Acta Oncol. 2011;50(2):194–204.

    Article  PubMed  Google Scholar 

  23. Sanson-Fisher R, Girgis A, Boyes A, Bonevski B, Burton L, Cook P. The unmet supportive care needs of patients with cancer. Supportive Care Review Group. Cancer. 2000;88(1):226–37.

    Article  CAS  PubMed  Google Scholar 

  24. Merckaert I, Libert Y, Messin S, Milani M, Slachmuylder JL, Razavi D. Cancer patients' desire for psychological support: prevalence and implications for screening patients' psychological needs. Psychooncology. 2010;19(2):141–9.

    Article  PubMed  Google Scholar 

  25. Institute of Medicine CoHCiA. Crossing the quality chasm: a New health system for the 21th century. Washington, DC: National Acadamy Press; 2001.

    Google Scholar 

  26. Breitbart W, Bultz BD, Dunn J, Grassi L, Watson M. 2012 President's Plenary International Psycho-Oncology Society: future directions in psycho-oncology. Psychooncology. 2013;22(7):1439–43.

    Article  CAS  PubMed  Google Scholar 

  27. European Union. Council conclusions on reducing the burden of cancer. Luxembourg, 10 June 2008 [].

  28. Wen KY, Gustafson DH. Needs assessment for cancer patients and their families. Health Qual Life Outcomes. 2004;2:11.

    Article  PubMed  PubMed Central  Google Scholar 

  29. Richardson A, Medina J, Brown V, Sitzia J. Patients' needs assessment in cancer care: a review of assessment tools. Support Care Cancer. 2007;15(10):1125–44.

    Article  PubMed  Google Scholar 

  30. Carlson LE, Waller A, Mitchell AJ. Screening for Distress and Unmet Needs in Patients With Cancer: Review and Recommendations. J Clin Oncol. 2012;30(11):1160–77.

    Article  PubMed  Google Scholar 

  31. Ganz PA, Schag CC, Heinrich RL. The psychosocial impact of cancer on the elderly: a comparison with younger patients. J Am Geriatr Soc. 1985;33(6):429–35.

    Article  CAS  PubMed  Google Scholar 

  32. Ganz PA, Schag CA, Cheng HL. Assessing the quality of life--a study in newly-diagnosed breast cancer patients. J Clin Epidemiol. 1990;43(1):75–86.

    Article  CAS  PubMed  Google Scholar 

  33. Heinrich RL, Schag CC, Ganz PA. Living with cancer: the Cancer Inventory of Problem Situations. J Clin Psychol. 1984;40(4):972–80.

    Article  CAS  PubMed  Google Scholar 

  34. Schag CA, Heinrich RL, Aadland RL, Ganz PA. Assessing problems of cancer patients: psychometric properties of the cancer inventory of problem situations. Health Psychol. 1990;9(1):83–102.

    Article  CAS  PubMed  Google Scholar 

  35. Schag CA, Heinrich RL. Cancer Rehabilitation Evaluation System (CARES) Manual, ed. 1. CARES Consultants: Los Angeles; 1989.

    Google Scholar 

  36. Schag CA, Heinrich RL. Development of a comprehensive quality of life measurement tool: CARES. Oncology (Williston Park). 1990;4(5):135–8. discussion 147.

    CAS  Google Scholar 

  37. Meyerowitz BE, Heinrich RL, Schag CC. A competency- based approach to coping with cancer. In: Bradley L, Burish TG, editors. Coping with Chronic Disease: Research and Applications. New York: Academic; 1983.

    Google Scholar 

  38. Saevarsdottir T, Fridriksdottir N, Gunnarsdottir S. Quality of life and symptoms of anxiety and depression of patients receiving cancer chemotherapy: longitudinal study. Cancer Nurs. 2010;33(1):E1–10.

    Article  PubMed  Google Scholar 

  39. Parker PA, Alba F, Fellman B, Urbauer DL, Li Y, Karam JA, Tannir N, Jonasch E, Wood CG, Matin SF. Illness uncertainty and quality of life of patients with small renal tumors undergoing watchful waiting: a 2-year prospective study. Eur Urol. 2013;63(6):1122–7.

    Article  PubMed  Google Scholar 

  40. Libert Y, Merckaert I, Slachmuylder JL, Razavi D. The ability of informal primary caregivers to accurately report cancer patients' difficulties. Psychooncology. 2013;22(12):2840–7.

    Article  PubMed  Google Scholar 

  41. Khan F, Amatya B. Factors associated with long-term functional outcomes, psychological sequelae and quality of life in persons after primary brain tumour. J Neurooncol. 2013;111(3):355–66.

    Article  PubMed  Google Scholar 

  42. Zimmermann C, Swami N, Krzyzanowska M, Hannon B, Leighl N, Oza A, Moore M, Rydall A, Rodin G, Tannock I, et al. Early palliative care for patients with advanced cancer: a cluster-randomised controlled trial. Lancet. 2014;383(9930):1721–30.

    Article  PubMed  Google Scholar 

  43. Rosenberg SM, Tamimi RM, Gelber S, Ruddy KJ, Bober SL, Kereakoglow S, Borges VF, Come SE, Schapira L, Partridge AH. Treatment-related amenorrhea and sexual functioning in young breast cancer survivors. Cancer. 2014;120(15):2264–71.

    Article  PubMed  PubMed Central  Google Scholar 

  44. Borstelmann NA, Rosenberg SM, Ruddy KJ, Tamimi RM, Gelber S, Schapira L, Come S, Borges V, Morgan E, Partridge AH. Partner support and anxiety in young women with breast cancer. Psychooncology. Psychooncology. 2015;24(12):1679–85. doi: 10.1002/pon.3780. Epub 2015 Mar 13.

    Article  PubMed  Google Scholar 

  45. Schag CC, Heinrich RL, Ganz PA. The Cancer Inventory of Problem Situations: An instrument for assessing cancer patients' rehabilitation needs. J Psychosoc Oncol. 1983;1(4):11–24.

  46. Deragotis LR. SCL-90-R. Manual-I. Baltimore: MD: John Hopkins University School of Medicine; 1977.

    Google Scholar 

  47. Spanier GB. Measuring dyadic adjustment. New scales for assessing the quality of marriage and similar dyads. J Marriage Fam. 1976;38:15–28.

  48. Schag CC, Heinrich RL, Ganz PA. Karnofsky performance status revisited: reliability, validity, and guidelines. J Clin Oncol. 1984;2(3):187–93.

    Article  CAS  PubMed  Google Scholar 

  49. Karnofsky DA, Burchenal JH. The clinical evaluation of chemotherapeutic agents in cancer. In: Macleod CM, editor. Evaluation of Chemotherapeutic. Agentsth ed. New York: Columbia University Press; 1949.

    Google Scholar 

  50. Gough IR, Furnival CM, Schilder L, Grove W. Assessment of the quality of life of patients with advanced cancer. Eur J Cancer Clin Oncol. 1983;19(8):1161–5.

    Article  CAS  PubMed  Google Scholar 

  51. te Velde A, Sprangers MA, Aaronson NK. Feasibility, psychometric performance, and stability across modes of administration of the CARES-SF. Ann Oncol. 1996;7(4):381–90.

    Article  Google Scholar 

  52. Beaton DE, Bombardier C, Guillemin F, Ferraz MB. Guidelines for the process of cross-cultural adaptation of self-report measures. Spine (Phila Pa 1976). 2000;25(24):3186–91.

    Article  CAS  Google Scholar 

  53. Terwee CB, Bot SD, de Boer MR, van der Windt DA, Knol DL, Dekker J, Bouter LM, de Vet HC. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60(1):34–42.

    Article  PubMed  Google Scholar 

  54. Mor V, Laliberte L, Morris JN, Wiemann M. The Karnofsky Performance Status Scale. An examination of its reliability and validity in a research setting. Cancer. 1984;53(9):2002–7.

    Article  CAS  PubMed  Google Scholar 

  55. Karnofsky DA, Burchenal JH. The clinical evaluation of chemotherapeutic agents in cancer. In: Macleod CM, editor. Evaluation ofchemotherapeutic agents. New York: Columbia University Press; 1949. p. 191–205.

    Google Scholar 

  56. Spinhoven P, Ormel J, Sloekers PP, Kempen GI, Speckens AE, Van Hemert AM. A validation study of the Hospital Anxiety and Depression Scale (HADS) in different groups of Dutch subjects. Psychol Med. 1997;27(2):363–70.

    Article  CAS  PubMed  Google Scholar 

  57. Zigmond AS, Snaith RP. The hospital anxiety and depression scale. Acta Psychiatr Scand. 1983;67(6):361–70.

    Article  CAS  PubMed  Google Scholar 

  58. Bjelland I, Dahl AA, Haug TT, Neckelmann D. The validity of the Hospital Anxiety and Depression Scale. An updated literature review. J Psychosom Res. 2002;52(2):69–77.

    Article  PubMed  Google Scholar 

  59. van Sonderen E. The measurement of social support with the Social Support List-Interactions (SSL-I) and the Social Support List-Discrepancies (SSL –D). Dutch manual. Groningen, the Netherlands: Noordelijk Centrum voor Gezondheidsvraagstukken; 1993.

    Google Scholar 

  60. Bridges KR, Sanderman R, van Sonderen E. An English language version of the social support list: preliminary reliability. Psychol Rep. 2002;90(3 Pt 1):1055–8.

    Article  PubMed  Google Scholar 

  61. van Sonderen E. Het meten van sociale steun met de Sociale Steun Lijst - Interacties (SSL-I) en Sociale Steun Lijst - Discrepanties (SSL-D): een handleiding. Tweede herziene druk. Groningen, The Netherlands: UMCG/Rijksuniversiteit Groningen, Research Institute SHARE; 2012.

    Google Scholar 

  62. Arrindell WA, Boelens W, Lambert H. On the psychometric properties of the Maudsley Marital Questionnaire (MMQ): Evaluation of self-ratings in distressed and ‘normal’ volunteer couples based on the Dutch version. Pers Individ Dif. 1983;4(3):293–306.

    Article  Google Scholar 

  63. Arrindell WA, Schaap C. The Maudsley Marital Questionnaire (MMQ): an extension of its construct validity. Br J Psychiatry. 1985;147:295–9.

    Article  CAS  PubMed  Google Scholar 

  64. Orathinkal J, Vansteenwegen A, Enright RD, Stroobants R. Further validation of the Dutch version of the Enright Forgiveness Inventory. Community Ment Health J. 2007;43(2):109–28.

    Article  PubMed  Google Scholar 

  65. Joseph O, Alfons V, Rob S. Further validation of the Maudsley Marital Questionnaire (MMQ). Psychol Health Med. 2007;12(3):346–52.

    Article  PubMed  Google Scholar 

  66. Aaronson NK, Ahmedzai S, Bergman B, Bullinger M, Cull A, Duez NJ, Filiberti A, Flechtner H, Fleishman SB, de Haes JC, et al. The European Organization for Research and Treatment of Cancer QLQ-C30: a quality-of-life instrument for use in international clinical trials in oncology. J Natl Cancer Inst. 1993;85(5):365–76.

    Article  CAS  PubMed  Google Scholar 

  67. Tuinman MA, Gazendam-Donofrio SM, Hoekstra-Weebers JE. Screening and referral for psychosocial distress in oncologic practice: use of the Distress Thermometer. Cancer. 2008;113(4):870–8.

    Article  PubMed  Google Scholar 

  68. Holland JC, Andersen B, Breitbart WS, Dabrowski M, Dudley MM, Fleishman S, Foley GV, Fulcher C, Greenberg DB, Greiner CB, et al. Distress management. J Natl Compr Canc Netw. 2007;5(1):66–98.

    Article  PubMed  Google Scholar 

  69. Bauwens S, Baillon C, Distelmans W, Theuns P. The 'Distress Barometer': validation of method of combining the Distress Thermometer with a rated complaint scale. Psychooncology. 2009;18(5):534–42.

    Article  CAS  PubMed  Google Scholar 

  70. Pauwels EE, Charlier C, De Bourdeaudhuij I, Lechner L, Van Hoof E. Care needs after primary breast cancer treatment. Survivors' associated sociodemographic and medical characteristics. Psychooncology. 2013;22(1):125–32.

    Article  PubMed  Google Scholar 

  71. Nunnally JC, Bernstein IH. Psychometric theory. 3rd ed. New York: McGraw-Hill; 1994.

    Google Scholar 

  72. Terwee CB, Dekker FW, Wiersinga WM, Prummel MF, Bossuyt PM. On assessing responsiveness of health-related quality of life instruments: guidelines for instrument evaluation. Qual Life Res. 2003;12(4):349–62.

    Article  CAS  PubMed  Google Scholar 

  73. Bartko JJ. The intraclass correlation coefficient as a measure of reliability. Psychol Rep. 1966;19(1):3–11.

    Article  CAS  PubMed  Google Scholar 

  74. Burns N, Grove SK. The practice of nursing research. 4th ed. US: WB. Saunders Philadelphia; 2001.

    Google Scholar 

  75. Boyes A, Girgis A, Lecathelinais C. Brief assessment of adult cancer patients' perceived needs: development and validation of the 34-item Supportive Care Needs Survey (SCNS-SF34). J Eval Clin Pract. 2009;15(4):602–6.

    Article  PubMed  Google Scholar 

  76. Bonevski B, Sanson-Fisher R, Girgis A, Burton L, Cook P, Boyes A. Evaluation of an instrument to assess the needs of patients with cancer. Supportive Care Review Group. Cancer. 2000;88(1):217–25.

    Article  CAS  PubMed  Google Scholar 

  77. Hulbert-Williams NJ, Hulbert-Williams L, Morrison V, Neal RD, Wilkinson C. The mini-mental adjustment to cancer scale: re-analysis of its psychometric properties in a sample of 160 mixed cancer patients. Psychooncology. 2012;21(7):792–7.

    Article  PubMed  Google Scholar 

  78. Lowery AE, Greenberg MA, Foster SL, Clark K, Casden DR, Loscalzo M, Bardwell WA. Validation of a needs-based biopsychosocial distress instrument for cancer patients. Psychooncology. 2012;21(10):1099–106.

    Article  PubMed  Google Scholar 

  79. Aaronson NK, Muller M, Cohen PD, Essink-Bot ML, Fekkes M, Sanderman R, Sprangers MA, te Velde A, Verrips E. Translation, validation, and norming of the Dutch language version of the SF-36 Health Survey in community and chronic disease populations. J Clin Epidemiol. 1998;51(11):1055–68.

    Article  CAS  PubMed  Google Scholar 

  80. Braeken AP, Kempen GI, Watson M, Houben RM, Gils FC, Lechner L. Psychometric properties of the Dutch version of the Mental Adjustment to Cancer scale in Dutch cancer patients. Psychooncology. 2010;19(7):742–9.

    Article  PubMed  Google Scholar 

Download references


This study is not commercially funded and the study protocol has not undergone peer-review by a funding body. We want to thank the hospitals and caregivers who want to work with us for the recruitment of participants. Many thanks go out to Limburg Sterk Merk (LSM) and to the native speaker Elizabeth Fradgley, for editing the manuscript for language.

Author information

Authors and Affiliations


Corresponding author

Correspondence to Bojoura Schouten.

Additional information

Competing interests

The authors declare they have no competing interests.

Authors’ contributions

BS is responsible for study conceptualization and design, data collection, study coordination, data analysis and drafting the protocol. JH participated in study conceptualization and design and in drafting the protocol. EVH and PV contributed to the design of the study and revised the protocol. WS was involved in refining plans for data analysis and revising the protocol. PB, FB, JM, DV and IC provided critical revisions to the protocol. All authors read and approved the final manuscript.

Aditional files

Additional file 1:

Summary of needs assessment tools and psychometric properties. The table in this file displays a summary of 24 needs assessment tools and their psychometric properties. Items, domains, validity (content validity and other types of validity), reliability (internal consistency and reproducibility), responsiveness and feasibility are discussed. (DOCX 44 kb)

Additional file 2:

CARES Questionnaire. (PDF 7917 kb)

Additional file 3:

CARES Patient profile. (PDF 173 kb)

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (, which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver ( applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Schouten, B., Van Hoof, E., Vankrunkelsven, P. et al. Assessing cancer patients’ quality of life and supportive care needs: Translation-revalidation of the CARES in Flemish and exhaustive evaluation of concurrent validity. BMC Health Serv Res 16, 86 (2016).

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: