Skip to main content

Patients’ perspectives on the quality of care of a new complex psycho-oncological care programme in Germany – external mixed methods evaluation results

Abstract

Background

Guideline-compliant provision of psycho-oncological (PO) care is still challenging in Germany. Hence, a new care programme, called integrated cross-sectoral psycho-oncology (isPO), was implemented to improve the integration of needs-oriented PO care. Quality of care (QoC) was externally evaluated from the patient’s perspective. We aim to gain insight into patients’ experiences with isPO and how their assessment affects relevant patient-reported outcomes (anxiety and depression, health status, and work ability).

Methods

An explanatory, sequential mixed-methods design was applied. Patients were surveyed twice during their 1-year care trajectory: after 3 (T1) and 12 (T2) months. Data sets were matched using pseudonyms. Care documentation data, including sociodemographic characteristics and the primary outcome variable (anxiety and depression), were matched. In the survey, patients rated their satisfaction with respective isPO service providers and the programme in general (QoC). Health status (EORTC-QLQ-C30) and work ability (WAS) were measured. Descriptive analyses and t-tests for dependent samples were conducted to assess changes in outcome variables over time. Linear regression analyses were conducted to assess whether care satisfaction predicted outcome variables. Patients who completed their isPO care trajectory were asked to participate in semi-structured telephone interviews to share their experiences. Purposeful sampling was applied. All 23 interviews were audiotaped, transcribed, and analysed via content-structuring method.

Results

Patients reported medium-to-high satisfaction with their isPO care. All patient-related outcomes significantly improved over time and QoC measures predicted those outcomes. Needs orientation (e.g., care intensity or mode of delivery) was perceived as essential for high QoC, and outpatient care with fixed contact persons as highly important for care continuity. Furthermore, patients identified programme optimisation needs, such as period of care or extension of care to relatives.

Conclusions

Patients assessed the isPO programme’s QoC positively. They identified facilitators for QoC and optimisation needs. Therefore, data on QoC can function as an indicator for a programme’s feasibility and maturity within care reality. As patients’ care satisfaction positively influences important patient-related outcomes, it may be routinely considered for quality management. Based on patients’ perspectives, isPO seems to be recommendable for routine psycho-oncological care in Germany, if ongoing programme optimisation within structured quality management is guaranteed.

Trial registration

The study was registered in the German Clinical Trials Register (No. DRKS00015326) on 30.10.2018.

Peer Review reports

Background

Many cancer patients suffer from distress, fatigue, anxiety, depression or posttraumatic stress [1,2,3]. Emotional distress is recognised as ‘The 6th Vital Sign’ in cancer care [4] and has led to the implementation of screening instruments and evidence-based psycho-oncological interventions worldwide [5]. Psycho-oncological care includes a multidisciplinary approach, entailing psychological, social, behavioural, and ethical aspects [6, 7]. Although many psycho-oncological interventions have been developed, implementing them into practice still remains a challenge [8]. Hence, research is needed that considers clinical, social and cultural context of cancer, including research on the dissemination and evaluation of interventions in different countries [5].

Psycho-oncological care in Germany

In Germany, only a fraction of cancer patients receives adequate psycho-oncological (PO) care [9, 10], despite one in two cancer patients experiencing significant distress [11]. Guideline-compliant provision and implementation of PO care is still considered challenging [12]. First, there is currently no legal basis for uniform, area- and cost-covering financing [13, 14]. Furthermore, psycho-oncology is not offered nationwide in Germany; rural areas are especially underserved [15]. Moreover, there is a strong sectoral separation of PO care structures between and within health and social services [7, 16,17,18,19]. There is a lack of nationwide expansion of cancer counselling centres regarding psychosocial area coverage, qualified counsellors, and equally secure funding [15, 20]. For these reasons, the national cancer plan [21] calls for cross-sectoral and needs-oriented integration of PO care into oncological care. The new form of care, named ‘integrated cross-sectoral psycho-oncology’ (isPO), aims to follow the national cancer plan’s call by integrating such structures to reduce the described challenges in the future [22].

The isPO intervention programme and its evaluation

The isPO intervention programme was developed, implemented, and externally evaluated between 2018 and 2022 [22, 23]. At a patient level, the programme aims to reduce anxiety and depression in newly diagnosed cancer patients based on their individual needs within a 1-year care period (stepped-care approach). At the health-system level, the isPO project aims to develop a high-quality PO programme that may be available as an integrated, cross-sectoral form of care for cancer patients for possible adoption into standard nationwide care. For this, multiple programme components (Table 1) were developed that relate to different aspects of care (structural, processual, clinical, and legal): a stepped care concept, including new care pathways; newly established PO care networks and care process organisation; a newly developed information technology-supported care documentation and assistance system called ‘CAPSYS2020’, which supports PO service providers with billing, care coordination, and documentation; and isPO-specific quality assurance and improvement structures [22, 23].

Table 1 The isPO programme’s components

According to definitions on complex interventions [24], isPO can be considered a complex care programme. The two components ‘care concept’ and ‘care pathways’ represent the clinical care aspects, whereas the other components represent formal administrative aspects of PO care that aim to meet legal requirements for care in the German healthcare system [22].

In 2019, programme implementation began in four newly established PO care networks in North Rhine-Westphalia. They each consisted of a cooperation between at least one certified oncological cancer centre hospital and local oncological practices (see Table 1). Physicians referred patients who received their cancer diagnosis in the care networks to the isPO programme. During programme enrolment, patients’ degree of distress in terms of anxiety, depression, and psychosocial risk factors were screened to allocate them to a care level that was designed to meet their individual needs [22, 23]. Dependent on the assigned care level, various professions were involved in isPO care provision: licensed psychotherapists, psychosocial professionals, case managers, and specially trained cancer survivors called ‘isPO onco-guides’. Figure 1 illustrates core isPO care pathways of the care concept.

Fig. 1
figure 1

The isPO programme’s stepped care concept. Adapted from Kusch et al. [22] and Salm and Cecon et al. [31]

The isPO programme was externally evaluated [23]. The evaluation process is based on the Medical Research Council framework for the analysis and assessment of complex interventions [32]. A comprehensive study was interlinked with the programme to evaluate its effectiveness and quality of care. Quality of care is defined as the extent to which care is provided to patients in a matter that achieves the desired health-related outcomes and is consistent with current knowledge [33]. In this regard, quality of care may be divided into structural, processual, and outcome quality [34]. Quality of care can be assessed with a mixed-methods design [23, 35,36,37].

Objective

In this article, we report on the assessment of the quality of care of the isPO programme from patients’ perspectives, which is part of the external evaluation of isPO. We aimed to gain deeper insight into patients’ individual isPO programme experiences, how they assessed the programme, and whether assessment affected relevant patient-reported outcomes.

Methods

An explanatory sequential mixed methods design [38] with qualitative and quantitative methods was applied to assess patients’ perspectives on quality of care in isPO (Fig. 2).

Fig. 2
figure 2

Mixed-methods design to assess patients’ perspectives on the integrated cross-sectoral psycho-oncology (isPO) programme

During enrolment, patients could consent: (1) to participate in the isPO programme, (2) to share their data (e.g. documentation data or statutory health data) with the interlinked evaluation study as well as (3) to be contacted for evaluation surveys or interviews. Patients who enrolled in the programme, were allocated to a care level based on their individual needs, which were assessed with screening instruments. Screening results and any care documentation were saved in CAPSYS2020 by the isPO service providers. Using multiple pseudonyms, CAPSYS2020 data were linked with primary quantitative data collected via external evaluation whilst conforming to German data protection laws [23]. Primary data collection included a patient survey with two measurement times. Furthermore, a sample of patients who finished their 1-year care in the isPO programme were interviewed about their individual care experiences. To gain differentiated insight in the care experiences, we aimed to consider the different periods of implementation, e.g. first year of implementation, after programme optimisations have been made or after supposedly a routinisation has occurred in care delivery. Additionally, the coronavirus disease 2019 (COVID-19) pandemic occurred in the beginning of the second year of implementation, which we also considered in the evaluation. For this, three patient interview waves were conducted. The study procedure was approved by the ethics committee of the Medical Faculty of the University of Cologne.

Patient survey

isPO patients who enrolled and consented to being contacted for a survey or an interview were contacted by the isPO Trust Center. They were questioned twice during their 12 month-long care: 3 months into their care and at the end of their care (12 months). The isPO Trust Center contacted 1599 enrolled patients with a consent form and questionnaire by post 3 months after enrolment. Patients who wished to participate could return their completed questionnaire and consent form in two pre-stamped envelopes. Dillman’s Total Design Method [39] was applied to achieve the highest possible response rate. For this, patients were contacted twice after initial send-out of the questionnaire. This means, that after 2 weeks, patients received a postcard with a survey reminder, and 3 weeks after the postcard, they received a reminder with a new questionnaire and consent form. The Trust Center allocated a survey pseudonym (SP) to each patient so that patients who participated in the first survey could be contacted for the second one. The survey data were imported into SPSS [40] for data analysis.

Measurements

To measure quality of care, we considered variables regarding patients’ satisfaction with the different isPO service providers (case management, isPO onco-guides, psychosocial professionals, and psychotherapists) and general assessment of patient care in isPO (subjective effectiveness, satisfaction and needs orientation, frequency and duration of appointments). Furthermore, patient-reported outcomes (global health status, work ability, anxiety and depression) and sociodemographic variables were reported. Table 2 provides an overview of the used measurements. For sample characteristics, the following variables were linked from the CAPSYS2020 data set: age, sex, ISCED index, care network (pseudonymised via number 1 to 4), and anxiety and depression.

Table 2 Overview and specifics on the scales and items used to assess quality of care and outcomes from the isPO patients’ perspective

Statistical analysis

Descriptive data analysis (frequencies, mean, standard deviation, minimum and maximum) was first conducted for patients’ satisfaction with their respective isPO service providers and the scales concerning their care in isPO in general. Next, to determine the differences in global health status, anxiety and depression, and work ability between the survey time points, t-tests for dependent samples were calculated. Finally, linear regression analyses were conducted to assess whether quality of care predicted or was associated with global health status, anxiety, depression, and work ability. Items concerning frequency and duration of appointments were initially categorical; however, the third category ‘too often’ and ‘too long’ was empty or only chosen by one person. Therefore, it was possible to dummy code it to 1’suitable’ and 0 ‘not suitable’.

Patient interviews

Data collection

Due to the different stages of implementation and the COVID-19 pandemic, three interview waves were established. The first interview wave was conducted between April and July 2020 to consider care experiences made in the first year of programme implementation, during which programme optimisations were conducted. The second interview wave was conducted between November 2020 and March 2021 to consider the second year of implementation, which showed more routinisation in care delivery. Lastly, the third interview wave was conducted from April to June 2021 to consider care experiences made under pandemic conditions (COVID-19 pandemic). In all, we conducted 23 telephone interviews, of which 9 were in the first, 10 in the second, and 4 in the third interview wave. Because the pandemic started around March 2020 in Germany, all semi-structured interviews needed to be conducted via telephone.

Purposeful sampling [49] was applied. Patients were recruited from all care networks, with different cancer entities and according to gender, age, and intensity of isPO care (e.g. number of appointments or isPO care stage). Patients were first approached by their care service provider, e.g. psychotherapist, during a face-to-face or telephonic appointment and asked, if they wanted to share their care experiences with the external evaluation team. It was explained to them that the isPO programme is being evaluated on its quality of care and that the interviews are part of this evaluation process. If patients agreed, the isPO Trust Center organised a date for a telephone interview. Before the interview, the interviewer did not meet the interviewee. No other persons were present during the interviews. To begin the interview, an initial narrative question was asked: ‘Could you describe how you perceived the moment of receiving the diagnosis?’. After that, impulse giving guiding questions concerning quality of care were asked and if necessary, also deepening questions. See Additional File 1 for the overarching guiding questions (e.g. ‘To what extent has isPO met your individual needs?’) that were included in the interview guidelines to gain insight into patients’ care experiences. The interview guideline was developed by the external evaluation team. It was piloted with three cancer survivors from the project partner, House of the Cancer Patient Support Associations of Germany (HKSH-BV).

Data collection was conducted by the entire female evaluation team whose professional backgrounds included experiences and qualification from the areas of sociology, psychology, psychotherapy, nursing, public health, and health services research. Two team members hold a PHD degree, whereas the other two have a Master of Science degree and were in the process of obtaining their doctorate. Interviews were audio recorded and transcribed. Notes were taken during the interviews.

Qualitative analysis

Two members of the evaluation team were involved in data analysis using the software programme MAXQDA 2018 [50]. Qualitative content analysis was applied, which is a research question oriented and stepped systematic approach [51,52,53]. In the first interview wave, a coding system with core and sub-categories was developed deductively based on the interview lead questions. The two analysers then coded the transcripts independently using MAXQDA. In addition, inductive categories were derived from the material. The new categories were discussed to achieve a profound understanding of patients’ experiences, and the final category system was agreed upon. Then, new coding was carried out using the final category system. The content of the statements belonging to a category was condensed. For the second interview wave, the coding system of the first wave was used to analyse the material. In addition, inductive categories were derived. Again, categories were discussed, and a consensus was reached on a final category system, which was used for final coding. The same procedure was applied for the third interview wave. Data collection was conducted until rich data on patient’ experiences was obtained. As we focus on subjective meaning in data analysis, we refrained from quantifying the results [54]. However, we use phrasings like ‘some’, ‘all’, or ‘one patient’ to differentiate individual opinions and experiences from opinions of several or all interviewed patients.

Results

Quantitative results

In total, we contacted 1599 isPO patients from all four isPO care networks to participate in the first patient survey (T1), of which 62.2% (n = 994) completed and returned their questionnaire. All patients who finished their isPO care until the end of April 2021 and participated in the first survey (n = 867) were contacted for the second survey; 59.3% (n = 514) of patients participated in the second survey (T2).

Patients’ age ranged between 18 and 93 years (T1), with an average age of 56.88 years (T1). There were more female than male patients in the samples (T1: 64.7%, n = 637; T2: 67.8%, n = 345). Most patients were employed in the first survey sample (54.4%, n = 526), whereas slightly more patients were unemployed or retired in the second survey (50.8%, n = 248). Most patients were married or in a relationship (T1: 74.0%, n = 741; T2: 72.9%, n = 373). In the T1 sample, 58.05% of patients received care in Care Network 1 (n = 577), while patients from the other three care networks were represented with a rate of 10.16% (n = 100) up to 17.76% (n = 176). In the second survey (T2), 53.50% of patients (n = 275) received care in Care Network 1. Table 2 presents descriptive results on the predictors and outcome variables (please see Additional File 2 for frequencies of single items regarding satisfaction with care).

On average, patients rated their satisfaction with the different isPO service providers positively (Table 3). Satisfaction with care and orientation to needs was also rated positively, whereas rating of subjective effectiveness was slightly less positive (neutral to less satisfied). On average, frequency and duration of appointments were perceived as suitable.

Table 3 Descriptive analysis of variables

For 423 isPO participants, data on global health status were available for both survey points. The mean value of the global health status is higher at T2 than at T1. Paired difference is significant according to the t-test for dependent samples: t(1422) = -7.353, p < 0.001, 95% CI [-9.36, -5.41]. Linear regression analyses show that, except for therapeutic alliance and items regarding temporal framework of care, all other predictors significantly and positively predict or associate with global health status (Table 4). Higher satisfaction with case management (regarding health literacy-sensitive communication), with isPO onco-guides and psychosocial professionals is associated with higher global health status at the end of care (T2). Furthermore, higher satisfaction with the scales 'subjective effectiveness' and 'satisfaction and orientation to needs' is associated with higher global health status (T2).

Table 4 Results of the regression analyses

For 403 patients, data on work ability were available for both survey points. The mean value of work ability is higher at T2 than at T1. Paired differences is significant according to the t-test for dependent samples: t(402) = -8.11, p < 0.001, 95% CI [-1.48, -0.90]. Linear regression analyses show that, except for satisfaction with the psychosocial professionals, therapeutic alliance, and duration of appointments, all other predictors significantly and positively influence work ability (Table 4). Higher satisfaction with case management (regarding health literacy-sensitive communication) and with isPO onco-guides is associated with higher work ability at the end of care (T2). Furthermore, higher satisfaction with 'subjective effectiveness', 'satisfaction and orientation to needs', and frequency of appointments is associated with higher work ability (T2).

For 722 patients, data on anxiety and depression were available for all survey points. The mean value of HADS significantly decreased across all survey points over time (T0 to T1: t(681) = 6.96, p < 0.001; T1 to T2: t(681) = 2.83, p = 0.005; T0 to T2: t(721) = 8.37, p < 0.001). Linear regression analyses show that, except for satisfaction with therapeutic alliance, subjective effectiveness, and duration of appointments, all other predictors significantly and negatively influence anxiety and depression (Table 4). Higher satisfaction with case management (regarding health literacy-sensitive communication), with isPO onco-guides and psychosocial professionals is associated with lower anxiety and depression at the end of care (T2). Furthermore, higher satisfaction with 'satisfaction and orientation to needs' and frequency of appointments is associated with lower anxiety and depression (T2).

Qualitative results

Thirty-eight patients were approached for data collection, from which twenty-three agreed to participate. Reasons for not participating included feelings of emotional instability, ongoing cancer treatment or suffering from physical strains. Sixteen patients identified as female and seven male, and age ranged between 32 and 65 years. Seventeen patients were employed. The number and type of isPO care ranged between low-intensity to high-intensity care (see Additional File 3 for more details). All four isPO care networks and thirteen different cancer entities are represented in the data. The interviews took between 31 and 85 min. In all, the interview material comprises 21 h and 40 min. The final coding system consists of four levels. The head codings (first two levels) concerning quality of care are presented in Fig. 3.

Fig. 3
figure 3

Head codings (first two levels) of the final coding system regarding quality of care in the isPO programme

Condensed results are first presented according to positive experiences and perceptions of the isPO programme, followed by negative perceptions and optimisation needs. Finally, patients’ attitudes towards isPO in routine care are described (see Additional File 4 for quotes).

Positive experiences and perceptions of the isPO programme

All interviewed patients perceived the isPO programme as useful for their individual recovery. Receiving PO care as a fixed care component parallel to medical oncological therapy appeared to be meaningful to them. The main goals of the isPO programme were identified by the patients as ‘professional support’ and the patients being ‘closely supported’ which was considered important.

Patients’ access to the programme facilitated their programme acceptance. They found that ‘being approached’ was especially promising for enrolment. Most found it crucial that their treating physician (e.g. oncologist) approached and recommended programme enrolment and that isPO was offered in the same institution where the medical treatment took place (e.g. hospital). Timely access to care was considered necessary because it gave patients a feeling of security. Moreover, it had a supportive effect, as they had an obvious contact person for potential stressful experiences. However, it was argued that deciding to participate in the programme later should be ‘handled flexibly’.

Offering information and education on the programme at different levels (e.g. flyers, posters, in conversation with the case manager) with visual aids was considered motivating and necessary because ‘a new programme like isPO is not self-explanatory’ and PO is ‘unknown to many patients and possibly has negative connotations’.

Overall, patients felt that isPO supported them individually and that the content of the counselling, type of support, and the interprofessional work of the isPO service providers were valuable. The opportunity for outpatient care especially was perceived as crucial for securing their PO care. The timeframe of care (up to 12 months) and the flexible intensity of care, which is oriented towards the programme’s stepped care concept, was perceived as needs-oriented. It was perceived as valuable that sudden support needs could be flexibly addressed individually. Furthermore, some patients rated positively ‘that there were hardly any waiting times’ and that appointments were ‘possible at short notice’. They described the cross-sectoral continuity of care as a ‘safety anchor’. Fears often only arose after discharge from the hospital. Therefore, the continuity of care experienced in isPO from inpatient to outpatient setting and having a fixed contact person were considered helpful. This implied that patients knew that the isPO service providers were familiar with their individual case and that therefore, there was no information gap.

Within professional PO support, the formation of a good therapeutic alliance was essential, leading to a feeling of being ‘understood, supported and cared for’. The provision of information by the psycho-oncologists on further support options and the involvement of relatives was also positively received. Overall, patients described flexible handling of the care setting as helpful. Over the course of the project, the way in which the appointments were conducted became more flexible and adapted to the respective patient’s contextual circumstances. isPO was offered in different ways: (1) face-to-face in the rooms of the hospital itself, which was in line with the basic isPO idea, but also increasingly (2) by telephone, (3) online, or (4) via e-mail due to pandemic-related contact restrictions. However, it was emphasised that the first conversation should take place face-to-face, where possible.

Patients who utilised the low-threshold support offered by the isPO onco-guides, perceived it as ‘very helpful’ and complementary to their professional care in isPO (e.g. psychosocial or psychotherapeutical support). They appreciated that the programme enabled ‘an encounter on a peer level’ at a time when patients ‘would most likely not have sought contact with self-help’. Often, it was remarked that it ‘felt good’ to talk to a person who had ‘gone through the same things’. The interaction and communication on ‘equal footing’ felt ‘liberating’ and provided ‘confidence and courage’. Young patients especially found it helpful to be able to exchange experiences ‘authentically’.isPO service providers (e.g. isPO case management or psychologists) were perceived as very professional. Furthermore, the organisational professionalism (e.g. enrolment process with the health insurance companies, communication with the general practitioner at discharge) was highlighted. Here, isPO providers’ reachability was an important aspect, especially during the COVID-19 pandemic. The patients considered it reassuring that ‘if there was a need to talk, you could always call, and someone would answer’.

Negative perceptions of the isPO programme and optimisation needs

Patients articulated that the implementation of isPO was inhibited by the stigma attached to PO care in Germany. In their opinion, there has not yet been a sufficient cultural change in society, and this is especially true for the older population. Directly related to this is the obstacle of explaining the programme coherently. As the isPO programme is complex, most patients find it difficult to understand it in detail, which may lead to programme rejection. This was especially noticeable in the interview data of the first two interview waves (early implementation phase). It improved with the programme’s progress, presumably when the care networks began to use optimised patient information materials (PIMs). In the third wave of interviews, after the optimised PIMs were utilised in all networks, patients no longer described any obstacles in this regard.

Similarly challenging was the comprehensibility of the isPO onco-guide concept. Especially at the beginning of the implementation (first wave data), it was noticeable that patients expressed little need to make use of the isPO onco-guides. It became clear that this was mostly because the isPO service providers did not provide accurate information about the onco-guides' duty and role, which in turn led to misunderstanding. Furthermore, some patients were reluctant to meet with a onco-guide out of ‘fear of being overloaded with other bad stories’ or a ‘desire for peace’. However, some patients developed an openness to meet with an isPO onco-guide later in the course of their trajectory. During the pandemic, some patients refused the offer due to fears of infection with COVID-19 through face-to-face contact. Furthermore, the resource structure of the isPO onco-guides was perceived as partially hindering. In some settings, rooms for a ‘sensitive conversation’ were not available and they unfortunately ‘had to move to the cafeteria’. At the time of the COVID-19 pandemic, there were also ‘bottlenecks in terms of staff’, as isPO onco-guides also feared infection.

Patients experienced that staff (e.g. physicians, nurses) in the oncological wards only knew little about the isPO care programme. Furthermore, the external marketing for the isPO programme was described by some patients as ‘insufficient’ and ‘hardly available’.

Overall, many of the interviewed patients perceived the care period as not flexible enough. The abrupt end after 12 months was seen by some patients as ‘questionable’ because many patients were still undergoing medical therapy at this time; therefore, many might still have needed the support. They desired structured PO aftercare.

Some patients had difficulty differentiating between the care options provided by isPO and other outpatient psychotherapeutic treatment services. This may have led to different expectations of patients and service providers in relation to the content of care. In addition, some patients confused the programme and study contents, which is probably due to the interconnection of programme and study during the project period. Some described this as ‘frustration’ because the meaning of the different questionnaires was not clear to them. With the new PIMs (e.g., timeline), this perception was minimised and was no longer described in the final interviews.

Further programme optimisation included the desire for the expansion of psychosocial and family support because ‘cancer is a “we” disease’.

isPO in routine care

All interviewed patients expressed a desire for the ‘availability of isPO after the end’ of the project phase and the expansion of the programme ‘for all cancer patients’. They emphasised that this would require a cultural change in the perception of psycho-oncology in Germany. Lack of knowledge and stigma might lead to aversion towards PO care. One patient described it as a ‘rethinking in society’ that needs to take place. For this aim, ‘comprehensive and continuous education’ and marketing (e.g. through display walls, posters, radio, or advertisements) could be used.

From the patients' point of view, local and nationwide implementation of PO care is only possible with a constant expansion of personnel resources, sufficient qualification opportunities for staff, and balanced financial resources. It is therefore important that sufficiently qualified psycho-oncologists are available for needs-based PO care (i.e. that staff positions are created). One patient understood the problem like this: ‘It's no use, if I offer this and don't have the staff to take care of it in peace. […] and you only have one contact person. So he is hopelessly overworked and that doesn't help either.

Patients emphasised that long-term and continuous PO support provided stability and was therefore highly relevant. An ‘abrupt end’ to PO counselling after inpatient medical treatment should be avoided, and continuation of needs-oriented care, such as in isPO for 12 months, is desirable. Several of the interviewed patients identified the need for sustainable structures to achieve this purpose. They expressed the need for ‘every hospital that treats oncological patients’ to offer PO services in a way that is financed and can therefore be expanded and/or maintained. Furthermore, some patients called for a good interdisciplinary cooperation between oncology and psycho-oncology to enable comprehensive cancer treatment.

A few patients expressed the need for better visibility and knowledge about PO care within the health system, for example, among general practitioners. In their opinion, communication about available support programmes should be enhanced through professional articles in journals and through presentations of the study results of programmes like isPO.

The interviewed patients showed awareness that the described aspects are a societal and cultural task that can only be implemented through recognition at the political and societal levels and through measures (implementation of guidelines) and the commitment of all those involved. From the patients’ point of view, different but focused actions (e.g. information week for psycho-oncology, advertisements) might be necessary.

Discussion

Quality of care in isPO

Within both methodological approaches (quantitative and qualitative), patients reported medium-to-high satisfaction with the care they received in isPO. Furthermore, we found significant improvements in patient-related outcomes (health status, work ability, and anxiety and depression) over time, and regression analyses indicate that satisfaction with quality of care influenced those outcomes. Already, low-threshold care provision (e.g. via isPO case management, isPO onco-guides, and/or psychosocial care) significantly and positively impacts these patient outcomes, which is in line with guidelines that recommend stepped and needs-oriented PO care [55]. However, in our analyses, it is noticeable that therapeutic alliance (regarding psychotherapeutic care) does not show significant association with the outcome variables. We presume an indirect effect, with therapeutic alliance significantly affecting general care satisfaction (subjective effectiveness and needs orientation) [56], which in turn affects important patient related outcomes. Furthermore, satisfaction with the frequency of appointments positively affected patients’ work ability, anxiety, and depression. This underscores the importance of care continuity and outpatient care and might be of interest for health insurance companies for economic reasons. Patients who return to work earlier might financially relieve health insurance companies in the long term. Research based on German health insurance claims data revealed that psychotherapy significantly reduced care costs and days of incapacity to work (i.e. sick days) [57,58,59]. Wittmann et al. [60] even suggested that ‘every euro invested in outpatient psychotherapy’ pays off threefold for society under the premise that the therapy effect lasts for 1 year after the end of treatment. In addition, patients have reported that returning to work is an important aspect for a full recovery [61, 62]; it positively affects quality of life [62, 63] and provides financial security [62, 64] and a sense of control [65, 66]. Therefore, needs-oriented, continuous outpatient PO care may help patients reach a level of functioning that enables them to return to work and improve their quality of life.

The qualitative results allowed us to gain deep insights into patient experiences with isPO. Moreover, they represent the specific enablers and barriers to programme implementation and therefore also quality of care. Patients found outpatient care with a fixed contact person crucial for care continuity; this was also promoted by Fann et al. [67]. The patients’ experiences highlight that needs-oriented care was not just achieved by allocating patients to the ‘right’ care level based on sole occurrence of symptoms; it was also connected to increased flexibility in care that took patients’ individual needs into consideration [55, 68, 69]. For example, this was achieved by flexibly choosing the care delivery mode (e.g. phone, face-to-face, or virtual) and the appointment frequency. Our findings on satisfaction with appointment frequency aligns with further external isPO evaluation results, indicating that the number of appointments with psychotherapists (utilised by patients with higher care needs) significantly influence changes in anxiety and depression over time [70]. Therefore, needs-orientation seems to be a key component in PO care.

Patients identified other aspects that could be handled more flexibly in the care programme: time of programme enrolment, period of care, and extension of care to relatives. The patients’ relatives’ need for care is often neglected [71], even though they may also suffer from emotional and social impairments [72, 73]. Therefore, from a patient’s perspective, it may be recommendable to augment isPO with a component that aims to flexibly address their relatives’ support needs.

Implications for quality of care in psycho-oncology

Measuring patient-reported outcomes may enhance patient-centred care and be beneficial for clinical outcomes [74,75,76]. The isPO programme endeavoured not only to close the healthcare gap of needs-oriented cross-sectoral PO care, but also to establish a structured, sustainable healthcare programme that includes an adequate quality management. Through external evaluation of the isPO programme, it became evident that it is crucial to include patients’ perspectives on quality of care. Investing in gathering patients’ perspectives offered the opportunity to gain specific and practice-relevant feedback on important optimisation needs and implementation enablers and barriers that were also experienced by other researchers [77]. Patients provided feedback specific to the implementation site (e.g. medical personnel not knowing about the isPO intervention programme) in addition to general feedback (e.g. that the care period needs to be handled flexibly according to the patients’ needs). Therefore, structured quality management at each care site and site-overarching (e.g. benchmarking or quality workshops) should be implemented and maintained to facilitate patient engagement in their care reality.

Perceiving and considering patients’ perspectives should be acknowledged as an important quality indicator for needs-oriented interventions [78, 79]. For the daily routine of quality management, specific PO quality indicators are required to sufficiently assess, monitor, and improve quality of care [55, 80]. Breidenbach et al. [81] came to a similar conclusion; they exploratorily analysed audit data of cancer centres regarding the challenges of providing PO care and found diverse care barriers on both the patient and organisational level. They called for the identification and integration of processual measures that especially promote integrated PO care in routine oncological care [81]. This aligns with Rubin et al.’s [79] reported advantages of integrating process measures of quality. They highlighted that implementation of such quality indicators may empower service providers and clinicians to proactively influence patient-reported outcomes.

Based on patients’ experiences in isPO, we formulated recommendations for the programme, especially regarding an adaptability to routine care (Table 5). Furthermore, patients expressed diverse attitudes and recommendations that apply to PO care in general.

Table 5 Recommendations for the isPO programme and psycho-oncological care in Germany based on cancer patients’ care experiences

Methodological strengths and limitations

Applying a mixed methods design is characterised as key to contextualising patient experiences in health care [83]. It allowed us to use the strengths of both, quantitative and qualitative methodologies and offset their respective weaknesses [84, 85] Further, it provided a deep understanding of patients’ perspective on the complex isPO intervention programme and helped to include their perspectives early and continuously in the programme’s optimisation loops [82, 86]. Participative elements in a programme’s development have been considered helpful by other researcher also [32, 87,88,89]. Programme designers in isPO predominantly used a top-down approach during the development phase [31]. However, by feedbacking our results (‘acute’ results were immediately articulated) at least once a year to the programme designers, programme optimisations could be initiated by the designers according to the end-user’s needs [35, 37]. This may make the programme more adaptable and tailored for routine care [89]. Therefore, formative evaluation data on quality of care may function as an indicator for the maturity level of a complex intervention and may aid in early identification of strengths and weaknesses that are specific to the implementation setting [90]. In addition, it is important to consider though that a comprehensive mixed methods design needs sufficient resources and adequate funding.

Even though an exploratory sequential design might have been helpful for a broader generalisation of the results [91], the explanatory design allowed us to explain the quantitative results and gather in-depth information on quality of care. Moreover, the qualitative approach may address some of the limitations of patient-reported experiences, such as confounding by health outcomes or measuring expectations rather than actual experiences [92].

Our quantitative data suggest that processual quality of care measurements affect patient-reported outcomes, also the primary outcome of isPO (anxiety and depression). Therefore, we promote that, during evaluation of a new complex interventions, quality of care should be considered an important study outcome, which was also pronounced by others [93, 94]. Furthermore, when assessing patient-reported outcomes, there is a risk for biases, such as social desirability, common method, or recall. However, at the same time, patient-reported outcomes are valuable indicators of quality of care. Given the absence of a control group, conclusions regarding causality may not be drawn. The synthesis of results on quality of care together with the results on a programmes’ effectiveness is therefore important when considering the complexity of a new form of care, like isPO (effectiveness results will be published elsewhere).

Interviewing patients after they finished 1 year of care in isPO was additionally helpful as they were able to reflect on the entire isPO care trajectory. Considering different moments (e.g. early implementation) within the implementation process allowed us to observe the programme normalisation process in the different care networks, which was also promoted by May and colleagues [95]. However, as the patient recruitment process for the interviews was initiated by service providers, this should be considered when interpreting the results. We might have an underrepresentation of patients who were (1) not satisfied with isPO, (2) timid, or (3) critically affected by oncological treatment. However, most patients we interviewed did not refrain from giving feedback on possibilities for optimisation. Finally, only patients who were mostly fluent in German were recruited for the interviews. Further studies exploring the needs of patients with limited language proficiency are indicated.

Conclusions

Patients assess the isPO programme’s quality of care positively. Likewise, patients’ perspectives were crucial for identifying implementation enablers and barriers of this new form of PO care, reflecting the programme’s feasibility and possible fit for routine care. Our results suggest a positive relationship between patients’ satisfaction with quality of care and important patient-related outcomes (health status, work ability, anxiety, and depression). Therefore, investing in gathering data on patients’ perspectives while using a mixed methods design can be helpful for conducting comprehensive evaluation of complex interventions to assess their quality of care and thereby maturity. For designers, this data may support necessary programme optimisations, especially if participative elements were not considered in the project’s design phase [96]. Even though the isPO programme is highly complex, with its various interacting programme components [22], patients’ experiences with the stepped and needs-centred care approach indicate that it is recommendable for routine care. However, the persistent programme optimisation should be conducted and integrated within structured quality management.

Availability of data and materials

The datasets generated and analysed during the current study are not publicly available due to participants’ consent restricting data use to the research team, but are available from the authors (corresponding author and/ or holger.pfaff@uk-koeln.de) on reasonable request. Due to German data protection law, only de-identified data may be shared.

References

  1. Künzler A, Zindel A, Znoj HJ, Bargetzi M. Psychische Belastungen bei Krebspatienten und ihren Partnern im ersten Jahr nach Diagnosestellung. Praxis (Bern 1994). 2010;99:593–9. https://doi.org/10.1024/1661-8157/a000122.

  2. Andritsch E, Traun-Vogt G. Existenzielle und psychische Belastungen als Folge einer Krebserkrankung im Bereich Rehabilitation und Nachsorge. In: Crevenna R, editor. Onkologische Rehabilitation. Berlin, Heidelberg: Springer Berlin Heidelberg; 2020. p. 175–183. https://doi.org/10.1007/978-3-662-57982-4_9.

  3. Götze H. Psychische Spät- und Langzeitfolgen einer Krebserkrankung. Onkologe. 2021. https://doi.org/10.1007/s00761-021-00924-9.

    Article  Google Scholar 

  4. Bultz BD. Lessons learned from the science of caring: Extending the reach of psychosocial oncology: The International Psycho-Oncology Society 2016 Sutherland Award Lecture. Psychooncology. 2017;26:721–3. https://doi.org/10.1002/pon.4398.

    Article  PubMed  Google Scholar 

  5. Carlson LE, Kelly B. Journal of Psychosocial Oncology Research and Practice welcome editorial. Journal of Psychosocial Oncology Research & Practice. 2019;1:e1. https://doi.org/10.1097/OR9.0000000000000001.

  6. Holland JC, editor. Psycho-oncology. Oxford, New York: Oxford University Press; 2015.

    Google Scholar 

  7. Kusch M, Labouvie H, Hein-Nau B. Klinische Psychoonkologie. Berlin/Heidelberg: Springer; 2013.

    Book  Google Scholar 

  8. Jacobsen PB. New Challenges in Psycho-Oncology Research II: A health care delivery, dissemination, and implementation research model to promote psychosocial care in routine cancer care. Psychooncology. 2017;26:419–23. https://doi.org/10.1002/pon.4428.

    Article  PubMed  Google Scholar 

  9. Singer S, Hohlfeld S, Müller-Briel D, Dietz A, Brähler E, Schröter K, Lehmann-Laue A. Psychosoziale Versorgung von Krebspatienten. Psychotherapeut. 2011;56:386–93. https://doi.org/10.1007/s00278-011-0859-7.

    Article  Google Scholar 

  10. Singer S, Dieng S, Wesselmann S. Psycho-oncological care in certified cancer centres–a nationwide analysis in Germany. Psychooncology. 2013;22:1435–7. https://doi.org/10.1002/pon.3145.

    Article  PubMed  Google Scholar 

  11. Mehnert A, Hartung TJ, Friedrich M, Vehling S, Brähler E, Härter M, et al. One in two cancer patients is significantly distressed: Prevalence and indicators of distress. Psychooncology. 2018;27:75–82. https://doi.org/10.1002/pon.4464.

    Article  CAS  PubMed  Google Scholar 

  12. Mehnert A, Koranyi S. Psychoonkologische Versorgung: eine Herausforderung. [Psychooncological Care: A Challenge]. Dtsch Med Wochenschr. 2018;143:316–23. https://doi.org/10.1055/s-0043-107631.

  13. Herschbach P. Psychoonkologie. Onkologe. 2019;25:96–101.https://doi.org/10.1007/s00761-019-0597-y

  14. Lehmann-Laue A. (Un)sicherheiten in der Psychoonkologie. Onkologe. 2019;25:1009–13. https://doi.org/10.1007/s00761-019-0643-9.

    Article  Google Scholar 

  15. Bühring P. Psychoonkologische Versorgung–Ambulant große Defizite. Deutsches Ärzteblatt. 2014;111(10):401.

  16. Deutsche Krebshilfe (DKH), Deutsche Krebsgesellschaft. Positionspapier der Deutschen Krebshilfe und der Deutschen Krebsgesellschaft zur Sicherstellung einer bedarfsgerechten ambulanten psychosozialen Versorgung in Krebsberatungsstellen in Deutschland. 2015. Bonn/Berlin. https://bak-ev.org/downloads/KBS_Positionspapier_2015.pdf.

  17. Singer S, Hornemann B, Bruns G, Petermann-Meyer A. Organisation der psychoonkologischen Versorgung. Forum. 2016;31:124–9. https://doi.org/10.1007/s12312-015-0032-2.

    Article  Google Scholar 

  18. Weis J, Giesler JM. Standards in der psychosozialen Versorgung von Krebspatienten. Onkologe. 2016;22:198–205. https://doi.org/10.1007/s00761-015-2938-9.

    Article  Google Scholar 

  19. Weis J, Brähler E, editors. Psychoonkologie in Forschung und Praxis. Stuttgart: Schattauer; 2013.

    Google Scholar 

  20. Haun MW, Sklenarova H, Zimmermann-Schlegel V, Herzog W, Hartmann M. Psychoonkologische Versorgung im ländlichen Raum : Ergebnisse einer Querschnittsbefragung zur Inanspruchnahme ambulanter Unterstützungsangebote. [Psycho-oncology care in rural areas : Results from a cross-sectional survey on the utilisation of community-based psychosocial support services]. Bundesgesundheitsblatt Gesundheitsforschung Gesundheitsschutz. 2018;61:89–97. https://doi.org/10.1007/s00103-017-2656-0.

  21. Bundesministerium für Gesundheit (BMG). Ziele des Nationalen Krebsplan - NKP. 2020. https://www.bundesgesundheitsministerium.de/fileadmin/Dateien/3_Downloads/N/Nationaler_Krebsplan/UEbersicht_Ziele_des_Nationalen_Krebsplans_2020.pdf. Accessed 15 Mar 2022.

  22. Kusch M, Labouvie H, Schiewer V, Talalaev N, Cwik JC, Bussmann S, et al. Integrated, cross-sectoral psycho-oncology (isPO): a new form of care for newly diagnosed cancer patients in Germany. BMC Health Serv Res. 2022. https://doi.org/10.1186/s12913-022-07782-0.

    Article  PubMed  PubMed Central  Google Scholar 

  23. Jenniches I, Lemmen C, Cwik JC, Kusch M, Labouvie H, Scholten N, et al. Evaluation of a complex integrated, cross-sectoral psycho-oncological care program (isPO): a mixed-methods study protocol. BMJ Open. 2020;10:e034141. https://doi.org/10.1136/bmjopen-2019-034141.

  24. Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M. Developing and evaluating complex interventions: the new Medical Research Council guidance. BMJ. 2008;337:a1655. https://doi.org/10.1136/bmj.a1655.

  25. Issel LM, Wells R. Health program planning and evaluation: a practical, systematic approach for community health. 4th ed. Sudbury: Jones & Bartlett Learning LLC; 2017.

  26. Butow P, Price MA, Shaw JM, Turner J, Clayton JM, Grimison P, et al. Clinical pathway for the screening, assessment and management of anxiety and depression in adult cancer patients: Australian guidelines. Psychooncology. 2015;24:987–1001. https://doi.org/10.1002/pon.3920.

    Article  PubMed  Google Scholar 

  27. Katon W, von Korff M, Lin E, Unützer J, Simon G, Walker E, et al. Population-based care of depression: effective disease management strategies to decrease prevalence. Gen Hosp Psychiatry. 1997;19:169–78. https://doi.org/10.1016/s0163-8343(97)00016-9.

    Article  CAS  PubMed  Google Scholar 

  28. Bower P, Gilbody S. Stepped care in psychological therapies: Access, effectiveness and efficiency. Narrative literature review Br J Psychiatry. 2005;186:11–7. https://doi.org/10.1192/bjp.186.1.11.

    Article  PubMed  Google Scholar 

  29. Herrmann-Lingen C, Buss U, Snaith RP. Hospital Anxiety and Depression Scale - Deutsche Version (HADS-D). 3rd ed. Bern: Verlag für Psychotherapie; 2011.

    Google Scholar 

  30. Bussmann S, Vaganian L, Gerlach AL, Kusch M, Labouvie H, Cwik JC. Screening and assessment for cancer patients' psychosocial support needs: Development and validation of the psychosocial risk questionnaire. Eur J Oncol Nurs. 2023;63:102240. https://doi.org/10.1016/j.ejon.2022.102240.

  31. Salm S, Cecon N, Jenniches I, Pfaff H, Scholten N, Dresen A, Krieger T. Conducting a prospective evaluation of the development of a complex psycho-oncological care programme (isPO) in Germany. BMC Health Serv Res. 2022;22:531. https://doi.org/10.1186/s12913-022-07951-1.

    Article  PubMed  PubMed Central  Google Scholar 

  32. Moore GF, Audrey S, Barker M, Bond L, Bonell C, Hardeman W, et al. Process evaluation of complex interventions: Medical Research Council guidance. BMJ. 2015;350:h1258. https://doi.org/10.1136/bmj.h1258.

  33. Institute of Medicine (IOM). Cancer care for the whole patient: meeting psychosocial health needs. Washington, DC: National Academies Press; 2008.

  34. Donabedian A. Evaluating the Quality of Medical Care. Milbank Mem Fund Q. 1966;44:166. https://doi.org/10.2307/3348969.

    Article  Google Scholar 

  35. Krieger T, Salm S, Cecon N, Pfaff H, Dresen A. Ergebnisbericht der externen formativen Evaluation des Projekts isPO. Köln; 2020.

  36. Krieger T, Salm S, Cecon N, Pfaff H, Dresen A. Vorläufige summative Evaluation des Projekts isPO (SE 1.0): Forschungsbericht 3–2021. Köln; 2021.

  37. Krieger T, Salm S, Cecon N, Pfaff H, Dresen A. Ergebnisbericht der zweiten externen formativen evaluation des Projekts isPO (FE 2.0). Köln; 2021.

  38. Curry L, Nunez-Smith M. Mixed methods in health sciences research: A practical primer. Los Angeles: Sage; 2015.

    Book  Google Scholar 

  39. Dillman DA. Mail and telephone surveys: the total design method. New York: Wiley & Sons; 1978.

    Google Scholar 

  40. IBM Corp. IBM SPSS Statistic for Windows. Armonk, NY: IBM Corp.; 2017.

  41. Ernstmann N, Halbach S, Kowalski C, Pfaff H, Ansmann L. Measuring attributes of health literate health care organizations from the patients’ perspective: Development and validation of a questionnaire to assess health literacy-sensitive communication (HL-COM). Z Evid Fortbild Qual Gesundhwes. 2017;121:58–63. https://doi.org/10.1016/j.zefq.2016.12.008.

    Article  PubMed  Google Scholar 

  42. Neumann M, Wirtz M, Bollschweiler E, Warm M, Wolf J, Pfaff H. Psychometrische Evaluation der deutschen Version des Messinstruments “Consultation and Relational Empathy” (CARE) am Beispiel von Krebspatienten. Psychother Psychosom Med Psychol. 2008;58:5–15. https://doi.org/10.1055/s−2007−970791.

    Article  PubMed  Google Scholar 

  43. Wilmers F, Munder T, Leonhart R, Herzog T, Linster HW. Die deutschsprachige version des Working Alliance Inventory - short revised (WAI-SR) - Ein schulenübergreifendes, ökonomisches und empirisch validiertes Instrument zur Erfassung der therapeutischen Allianz. Klinische Diagnostik und Evaluation. 2008;1(3):343–58.

  44. Hatcher RL, Gillaspy JA. Development and validation of a revised short version of the working alliance inventory. Psychother Res. 2006;16:12–25. https://doi.org/10.1080/10503300500352500.

    Article  Google Scholar 

  45. Bordin ES. The generalizability of the psychoanalytic concept of the working alliance. Psychotherapy: Theory, Research & Practice. 1979;16:252–60. https://doi.org/10.1037/h0085885.

  46. Aaronson NK, Ahmedzai S, Bergman B, Bullinger M, Cull A, Duez NJ, et al. The European Organization for Research and Treatment of Cancer QLQ-C30: a quality-of-life instrument for use in international clinical trials in oncology. J Natl Cancer Inst. 1993;85:365–76. https://doi.org/10.1093/jnci/85.5.365.

    Article  CAS  PubMed  Google Scholar 

  47. El Fassi M, Bocquet V, Majery N, Lair ML, Couffignal S, Mairiaux P. Work ability assessment in a worker population: comparison and determinants of Work Ability Index and Work Ability score. BMC Public Health. 2013;13:305. https://doi.org/10.1186/1471-2458-13-305.

    Article  PubMed  PubMed Central  Google Scholar 

  48. Gould R, Ilmarinen J, Järvisalo, J., Koskinen S. Dimensions of work ability: results of the health 2000 survey. Helsinki: Finnish Centre for Pension; 2008.

  49. Patton MQ. Qualitative research and evaluation methods. 3rd ed. Thousand Oaks: Sage; 2002.

    Google Scholar 

  50. VERBI Software. MAXQDA 2022. Berlin; 2021.

  51. Mayring P, Fenzl T. Qualitative Inhaltsanalyse. In: Baur N, Blasius J, editors. Handbuch Methoden der empirischen Sozialforschung. Wiesbaden: Springer Fachmedien Wiesbaden; 2014. p. 543–56.

    Chapter  Google Scholar 

  52. Mayring P. Qualitative Inhaltsanalyse: Grundlagen und Techniken. 12th ed. Weinheim: Beltz; 2015.

    Google Scholar 

  53. Mayring P. Qualitative Inhaltsanalyse – Abgrenzungen, Spielarten. Weiterentwicklungen. 2019. https://doi.org/10.17169/fqs-20.3.3343.

    Article  Google Scholar 

  54. Pope C, Ziebland S, Mays N. Counting and Qualitative Data. In: Pope C, Mays N, editors. Qualitative research in health care. Hoboken, NJ: Wiley Blackwell; 2020. p. 114.

    Chapter  Google Scholar 

  55. Leitlinienprogramm Onkologie (DKG, DKH, AWMF). Psychoonkologische diagnostik, Beratung und Behandlung von erwachsenen Krebspatienten: Langfassung Version 1.1; 2014.

  56. Omairat M, Krieger T, Salm S, Hagemeier A, Dresen A, Cecon-Stabel N. Does the mode of care delivery affect therapeutic alliance, patient care satisfaction or patient reported outcomes? Quantitative evaluation data of a new psycho-oncological form of care implemented during the COVID-19 pandemic. currently submitted for publication. 2023.

  57. Kraft S, Puschner B, Lambert MJ, Kordy H. Medical utilization and treatment outcome in mid- and long-term outpatient psychotherapy. Psychother Res. 2006;16:241–9. https://doi.org/10.1080/10503300500485458.

    Article  Google Scholar 

  58. Beutel ME, Rasting M, Stuhr U, Rüger B, Leuzinger-Bohleber M. Assessing the impact of psychoanalyses and long-term psychoanalytic therapies on health care utilization and costs. Psychother Res. 2004;14:146–60. https://doi.org/10.1093/ptr/kph014.

    Article  Google Scholar 

  59. Keller W, Westhoff G, Dilg R, Rohner R, Studt HH. Wirksamkeit und Inanspruchnahme von Krankenkassenleistungen bei Langzeitanalysen: Ergebnisse einer empirischen Follow-up-Studie zur Effektivität der (Jungianischen) Psychoanalyse und Psychotherapie. Anal Psychol. 2001;32:202–29. https://doi.org/10.1159/000046781.

    Article  Google Scholar 

  60. Wittmann WW, Lutz W, Steffanowski A, Kriz D, Glahn EM, Völkle MC. Qualitätsmonitoring in der ambulanten Psychotherapie: Modellprojekt der Techniker Krankenkasse - Abschlussbericht. Hamburg; 2011.

  61. Blinder VS, Murphy MM, Vahdat LT, Gold HT, de Melo-Martin I, Hayes MK, et al. Employment after a breast cancer diagnosis: a qualitative study of ethnically diverse urban women. J Community Health. 2012;37:763–72. https://doi.org/10.1007/s10900-011-9509-9.

    Article  CAS  PubMed  Google Scholar 

  62. Kennedy F, Haslam C, Munir F, Pryce J. Returning to work following cancer: a qualitative exploratory study into the experience of returning to work following cancer. Eur J Cancer Care. 2007;16:17–25. https://doi.org/10.1111/j.1365-2354.2007.00729.x.

    Article  CAS  Google Scholar 

  63. Timperi AW, Ergas IJ, Rehkopf DH, Roh JM, Kwan ML, Kushi LH. Employment status and quality of life in recently diagnosed breast cancer survivors. Psychooncology. 2013;22:1411–20. https://doi.org/10.1002/pon.3157.

    Article  PubMed  Google Scholar 

  64. Chirikos TN, Russell-Jacobs A, Cantor AB. Indirect economic effects of long-term breast cancer survival. Cancer Pract. 2002;10:248–55. https://doi.org/10.1046/j.1523-5394.2002.105004.x.

    Article  PubMed  Google Scholar 

  65. Raque-Bogdan TL, Hoffman MA, Ginter AC, Piontkowski S, Schexnayder K, White R. The work life and career development of young breast cancer survivors. J Couns Psychol. 2015;62:655–69. https://doi.org/10.1037/cou0000068.

    Article  PubMed  Google Scholar 

  66. Islam T, Dahlui M, Majid HA, Nahar AM, Mohd Taib NA, Su TT. Factors associated with return to work of breast cancer survivors: a systematic review. BMC Public Health. 2014;14(Suppl 3):S8. https://doi.org/10.1186/1471-2458-14-S3-S8.

    Article  PubMed  PubMed Central  Google Scholar 

  67. Fann JR, Ell K, Sharpe M. Integrating psychosocial care into cancer services. J Clin Oncol. 2012;30:1178–86. https://doi.org/10.1200/JCO.2011.39.7398.

    Article  PubMed  Google Scholar 

  68. Ernst J, Faller H, Koch U, Brähler E, Härter M, Schulz H, et al. Doctor's recommendations for psychosocial care: Frequency and predictors of recommendations and referrals. PLoS ONE. 2018;13:e0205160. https://doi.org/10.1371/journal.pone.0205160.

  69. Ernstmann N, Neumann M, Ommen O, Galushko M, Wirtz M, Voltz R, et al. Determinants and implications of cancer patients’ psychosocial needs. Support Care Cancer. 2009;17:1417–23. https://doi.org/10.1007/s00520-009-0605-7.

    Article  CAS  PubMed  Google Scholar 

  70. Krieger T, Salm S, Cecon N, Pfaff H, Dresen A. Summative Evaluation des Projekts isPO (SE 2.0). Endbericht. Köln; 2022.

  71. Rosenberger C, Höcker A, Cartus M, Schulz-Kindermann F, Härter M, Mehnert A. Angehörige und Patienten in der ambulanten psychoonkologischen Versorgung: Zugangswege, psychische Belastungen und Unterstützungsbedürfnisse. [Outpatient psycho-oncological care for family members and patients: access, psychological distress and supportive care needs]. Psychother Psychosom Med Psychol. 2012;62:185–94. https://doi.org/10.1055/s-0032-1304994.

  72. Stenberg U, Ruland CM, Miaskowski C. Review of the literature on the effects of caring for a patient with cancer. Psychooncology. 2010;19:1013–25. https://doi.org/10.1002/pon.1670.

    Article  PubMed  Google Scholar 

  73. Goren A, Gilloteau I, Lees M, DaCosta DM. Quantifying the burden of informal caregiving for patients with cancer in Europe. Support Care Cancer. 2014;22:1637–46. https://doi.org/10.1007/s00520-014-2122-6.

    Article  PubMed  Google Scholar 

  74. Snyder CF, Aaronson NK, Choucair AK, Elliott TE, Greenhalgh J, Halyard MY, et al. Implementing patient-reported outcomes assessment in clinical practice: a review of the options and considerations. Qual Life Res. 2012;21:1305–14. https://doi.org/10.1007/s11136-011-0054-x.

    Article  PubMed  Google Scholar 

  75. Basch E, Deal AM, Kris MG, Scher HI, Hudis CA, Sabbatini P, et al. Symptom Monitoring With Patient-Reported Outcomes During Routine Cancer Treatment: A Randomized Controlled Trial. J Clin Oncol. 2016;34:557–65. https://doi.org/10.1200/JCO.2015.63.0830.

    Article  CAS  PubMed  Google Scholar 

  76. Schrage T, Görlach M, Schulz H, Bleich C. Identification and Determination of Dimensions of Health-Related Quality of Life for Cancer Patients in Routine Care - A Qualitative Study. Front Psychol. 2022;13:824099. https://doi.org/10.3389/fpsyg.2022.824099.

  77. Schuit AS, Holtmaat K, van Zwieten V, Aukema EJ, Gransier L, Cuijpers P, Verdonck-de Leeuw IM. Organizing Psycho-Oncological Care for Cancer Patients: The Patient's Perspective. Front Psychol. 2021;12:625117. https://doi.org/10.3389/fpsyg.2021.625117.

  78. Ingersoll LT, Saeed F, Ladwig S, Norton SA, Anderson W, Alexander SC, Gramling R. Feeling Heard and Understood in the Hospital Environment: Benchmarking Communication Quality Among Patients With Advanced Cancer Before and After Palliative Care Consultation. J Pain Symptom Manage. 2018;56:239–44. https://doi.org/10.1016/j.jpainsymman.2018.04.013.

    Article  PubMed  Google Scholar 

  79. Rubin HR, Pronovost P, Diette GB. The advantages and disadvantages of process-based measures of health care quality. Int J Qual Health Care. 2001;13:469–74. https://doi.org/10.1093/intqhc/13.6.469.

    Article  CAS  PubMed  Google Scholar 

  80. Hensen P. Qualitätsmanagement im Gesundheitswesen: Grundlagen für Studium und Praxis. 2nd ed. Wiesbaden, Heidelberg: Springer Gabler; 2019.

  81. Breidenbach C, Kowalski C, Ansmann L, Schult S, Sibert NT, Neupert I, et al. Incorporating psychosocial care into routine oncological care: insights into challenges and strategies from certified cancer centers’ audit data. Psychooncology. 2022. https://doi.org/10.1002/pon.5933.

    Article  PubMed  Google Scholar 

  82. Krieger T, Salm S, Dresen A, Arning A, Schwickerath K, Göttel A, et al. Optimizing Patient Information Material for a New Psycho-Oncological Care Program Using a Participatory Health Research Approach in Germany. Int J Environ Res Public Health. 2022. https://doi.org/10.3390/ijerph19031518.

    Article  PubMed  PubMed Central  Google Scholar 

  83. Regnault A, Willgoss T, Barbic S. Towards the use of mixed methods inquiry as best practice in health outcomes research. J Patient Rep Outcomes. 2017;2:19. https://doi.org/10.1186/s41687-018-0043-8.

    Article  PubMed  Google Scholar 

  84. Bryman A. Integrating quantitative and qualitative research: how is it done? Qual Res. 2006;6:97–113. https://doi.org/10.1177/1468794106058877.

    Article  Google Scholar 

  85. Almeida F. Strategies to perfom a mixed methods study. European Journal of Education Studis. 2018:137–51. https://doi.org/10.5281/zenodo1406214.

  86. Rackerseder J, Hornbach C, Dicks P, Kerek-Bodden H, Krieger T. Designing a Patient-Friendly Website for Newly Diagnosed Cancer Patients with the Participatory Health Research Approach. Int J Environ Res Public Health. 2022. https://doi.org/10.3390/ijerph19041969.

    Article  PubMed  PubMed Central  Google Scholar 

  87. Bleijenberg N, Man-van Ginkel JM de, Trappenburg JCA, Ettema RGA, Sino CG, Heim N, et al. Increasing value and reducing waste by optimizing the development of complex interventions: Enriching the development phase of the Medical Research Council (MRC) Framework. Int J Nurs Stud. 2018;79:86–93https://doi.org/10.1016/j.ijnurstu.2017.12.001

  88. Abraham C, Denford S, Smith J, Dean S, Greaves C, Lloyd J, et al. Designing Interventions to Change Health-related Behaviour. In: Richards DA, Rahm Hallberg I, editors., et al., Complex interventions in health: An overview of methods. London, New York: Routledge; 2015. p. 103–10.

    Google Scholar 

  89. Elwy AR, Wasan AD, Gillman AG, Johnston KL, Dodds N, McFarland C, Greco CM. Using formative evaluation methods to improve clinical implementation efforts: Description and an example. Psychiatry Res. 2020;283:112532. https://doi.org/10.1016/j.psychres.2019.112532.

  90. Dogherty EJ, Estabrooks CA. Why do Barriers and Facilitators Matter? In: Richards DA, Rahm Hallberg I, editors. Complex interventions in health: An overview of methods. London, New York: Routledge; 2015. p. 273–81.

    Google Scholar 

  91. Schoonenboom J, Johnson RB. How to Construct a Mixed Methods Research Design. Kolner Z Soz Sozpsychol. 2017;69:107–31. https://doi.org/10.1007/s11577-017-0454-1.

    Article  PubMed  PubMed Central  Google Scholar 

  92. Bull C, Byrnes J, Hettiarachchi R, Downes M. A systematic review of the validity and reliability of patient-reported experience measures. Health Serv Res. 2019;54:1023–35. https://doi.org/10.1111/1475-6773.13187.

    Article  PubMed  PubMed Central  Google Scholar 

  93. Skivington K, Matthews L, Simpson SA, Craig P, Baird J, Blazeby JM, et al. A new framework for developing and evaluating complex interventions: update of Medical Research Council guidance. BMJ. 2021;374:n2061. https://doi.org/10.1136/bmj.n2061.

  94. Campbell NC, Murray E, Darbyshire J, Emery J, Farmer A, Griffiths F, et al. Designing and evaluating complex interventions to improve health care. BMJ. 2007;334:455–9. https://doi.org/10.1136/bmj.39108.379965.BE.

    Article  PubMed  PubMed Central  Google Scholar 

  95. May CR, Mair F, Finch T, MacFarlane A, Dowrick C, Treweek S, et al. Development of a theory of implementation and integration: Normalization Process Theory. Implement Sci. 2009;4:29. https://doi.org/10.1186/1748-5908-4-29.

    Article  PubMed  PubMed Central  Google Scholar 

  96. Jones N, Jones H, Steer L, Datta A. Improving impact evaluation production and use. London: Overseas development institute (ODI); 2009.

    Google Scholar 

Download references

Acknowledgements

We are grateful to all the cancer patients sharing their experiences in the interviews. Likewise, we appreciate the isPO service providers in the clinics involved in the isPO project for supporting the recruitment process. We thank Carolin Hornbach, Svea Fischer, Judith Mollenhauer, and Juliane Rackerseder for their support in data collection.

Funding

Open Access funding enabled and organized by Projekt DEAL. This study was funded by the Innovation Fund of the Federal Joint Committee, the G-BA (01NVF17022).

Author information

Authors and Affiliations

Authors

Contributions

NC contributed to the acquisition, analysis, and interpretation of both quantitative and qualitative data. NC also drafted and revised the manuscript. SaS was involved in data acquisition of both methodological approaches and focused on the analysis and interpretation of quantitative data. Furthermore, SaS was involved in revising the manuscript. HP contributed to the conception and study design, interpretation of results, and revision of the manuscript. AD contributed to the conception and design of the work. Moreover, AD helped in the acquisition of qualitative data and the interpretation of the results of both methodological approaches. AD was involved in revising the manuscript. TK made substantial contributions to the conception and design of the work, the acquisition of the qualitative data, interpretation of the data, and revision of the manuscript.

Corresponding author

Correspondence to Natalia Cecon-Stabel.

Ethics declarations

Ethical approval and consent to participate

The study was approved by the ethics committee of the Medical Faculty of the University of Cologne (No. 18–092). All methods were carried out in accordance with relevant guidelines and regulations. Informed consent was obtained from all patients.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1: Table A.

Impulse giving guiding questions of the interview guidelines concerning quality of care.

Additional file 2: Table B.

Frequencies of variables assessing patients’ satisfaction with their respective service providers and the isPO care in general

Additional file 3: Table C.

Characteristics of interviewed patients (table content first published in Krieger et al. 2022).

Additional file 4: Table D.

Exemplary quotations for the coding system.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Cecon-Stabel, N., Salm, S., Pfaff, H. et al. Patients’ perspectives on the quality of care of a new complex psycho-oncological care programme in Germany – external mixed methods evaluation results. BMC Health Serv Res 23, 759 (2023). https://doi.org/10.1186/s12913-023-09714-y

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12913-023-09714-y

Keywords