A quasi-experimental study of the effects of an integrated care intervention for the frail elderly on informal caregivers’ satisfaction with care and support
© Janse et al.; licensee BioMed Central Ltd. 2014
Received: 22 November 2013
Accepted: 25 March 2014
Published: 29 March 2014
This study explored the effects of an integrated care model for the frail elderly on informal caregivers’ satisfaction with care and support services.
A 62-item instrument was developed and deployed in an evaluative before/after study using a quasi-experimental design and enrolling a control group. The definitive study population (n = 63) consisted mainly of female informal caregivers who did not live with the care recipient. Analysis of separate items involved group comparisons, using paired and unpaired tests, and regression analyses, with baseline measurements, control variables (sex, age and living together with care recipient) and the intervention as independent variables. Subsequently, the underlying factor structure of the theoretical dimensions was investigated using primary component analysis. Group comparisons and regression analyses were performed on the resulting scales.
Satisfaction with the degree to which care was provided according to the need for care of the recipients increased, while satisfaction with the degree to which professionals provided help with administrative tasks, the understandability of the information provided and the degree to which informal caregivers knew which professionals to call, decreased. Primary component analysis yielded 6 scales for satisfaction with care and 5 scales for satisfaction with caregiver support, with sufficient reliability.
The results suggest that expectations regarding the effects of integrated care on informal caregiver satisfaction may not be realistic. However, the results must be seen in light of the small sample size and should therefore be considered as preliminary. Nonetheless, this study provides guidance for further research and integrated care interventions involving informal caregivers.
Current Controlled Trials ISRCTN05748494. Date of registration: 14/03/2013.
KeywordsIntegrated care Frail elderly Informal caregivers Satisfaction Care and support Services
Informal caregivers of frail elderly people often perform a substantial number of care tasks over a prolonged period of time . By definition, informal care is non-professional and unpaid and is provided by family members, partners or close friends . Frail elderly people suffer from age-related problems in different domains of daily functioning, such as physical, psychological, and social problems . Their informal caregivers must frequently interact with the healthcare system to obtain the information, services, and equipment needed to counter such problems . However, many informal caregivers experience the healthcare system as fragmented, rigid and difficult to access . In addition, while it is evident that providing informal care can lead to substantial deteriorations in health and quality of life [6–8], support services for informal caregivers are still often inadequate [9, 10]. This lack of explicit attention to informal caregivers denotes a serious gap in healthcare . Consequently, many authors have called for more consideration of informal caregivers’ needs for attention and support [7, 11–13], as well as greater insight into their perceptions and satisfaction with such services .
As a result, increased attention has been paid to the involvement and support of informal caregivers of frail elderly patients [15–17]. In this context, particular interest has been given to including informal caregivers in integrated care arrangements [10, 18]. Integrated care is defined here as a ‘coherent set of methods and models on the funding and on the administrative, organizational, service delivery and clinical levels designed to create connectivity, alignment, and collaboration within and between the cure and care sectors’ . Integrated care has been proposed to increase the coherence, continuity and quality of elderly care [19, 20] and to provide more adequate and effective support for informal caregivers . The proactive nature of integrated care is assumed to increase the likelihood of a timely recognition of unmet needs of both the care recipient and informal caregiver . In addition, as it includes coordination mechanisms, such as case management, integrated care is believed to benefit informal caregivers by linking them to adequate formal services . Such characteristics are assumed to increase the satisfaction of informal caregivers with the care provided to the care recipients, as well as with the way these services support themselves as caregivers [18, 23].
Although the call for greater attention to the informal caregiver dates back as far as 1990 (e.g., ), little is known regarding caregivers’ satisfaction with services . Moreover, despite the substantial number of studies produced in recent years regarding integrated care arrangements, the role of informal caregivers therein has largely been neglected . Consequently, a gap exists in the literature regarding the effects of integrated care on informal caregivers’ satisfaction . Some studies have reported outcomes regarding this subject and have confirmed that integrated care indeed increases informal caregivers’ satisfaction with services [15, 18, 24]. However, the interventions and their subsequent evaluations were aimed primarily at improving care for elderly patients. Although these interventions acknowledged informal caregivers by involving them to some degree in the care process, they were regarded more as partners in care than as potential individuals in need of care and support. Satisfaction assessment in these studies was therefore related only to the care provided to the care recipients and was not related to the care and support provided to the informal caregivers themselves. To our knowledge, there have been no studies that have investigated the effects of integrated care on informal caregiver satisfaction with the care received by the care recipient in combination with their satisfaction with the care and support they personally received. This study therefore describes the construction of a caregiver satisfaction instrument and its use in the evaluation of informal caregiver satisfaction with a specific integrated care intervention.
The aim of the current study was to investigate the effects of integrated care on informal caregivers’ satisfaction with the care received by care recipients and on the satisfaction with the care and support the caregivers’ themselves received. To this end, a specific integrated care intervention aimed at frail elderly patients was evaluated. This intervention, the Walcheren Integrated Care Model (WICM), has been implemented in the Walcheren region in the southwest of the Netherlands. The research question guiding this study was: What are the effects of the Walcheren Integrated Care Model on the satisfaction of informal caregivers with care and support services?
Usual care for frail elderly patients in the Netherlands can be described as reactive and mono-disciplinary. General practitioners (GPs) are generally only consulted on the initiative of their patients. Patients have access to a number of care and curative services through referral of their GP, while other services, such as home-care and personal care services are arranged by municipalities . Complex care services (e.g., injections, decubitus care) are available after formal approval by an assessment agency. Care as usual does not include multidisciplinary coordination or cooperation between these professionals, organizations and professionals. In contrast, the WICM has an outspoken proactive and multidisciplinary character, with the GP and primary care practice (PCP) functioning as a single-entry point for all care requests. This proactive character of the model adds a strong preventive element to the process.
The involvement of informal caregivers begins after screening and needs assessment of the care recipient during a visit by the case manager (step 1 in Figure 1). During this phase, the informal caregiver’s needs for support and guidance are identified. Available services for informal caregivers normally include respite care or other forms of relief, as well as psychosocial interventions such as education and training or (group) counseling. In the WICM, the case manager provides the informal caregiver with relevant information, advice and suggestions regarding these services. If needed, the informal caregiver is brought into contact with relevant organizations or professionals. In addition, case managers may also provide practical advice (e.g., how to make care tasks less burdensome) or emotional support, depending on the informal caregiver’s needs.
The case manager draws up care goals containing proposals for needed assistance and support in consultation with the care recipient and informal caregiver, ensuring the explicitly involved of the informal caregiver in the planning and subsequent provision of care (step 2 in Figure 1). The care plan is then discussed in a multidisciplinary meeting, which is attended by the general practitioner (GP), the case manager and any other care professionals relevant to the care process of the patient. During this meeting, tasks are assigned to the relevant professional based on multidisciplinary protocols. After final approval by professionals, the patient and the informal caregiver (step 3 in Figure 1), the care plan is incorporated into an Integrated Information System accessible to all relevant professionals. The case manager coordinates all care provision and periodically evaluates the care plan with the care recipient and informal caregiver (visits/telephone) to ensure adequate monitoring of their needs (step 4 in Figure 1). The frequency of periodic evaluations ranges from once a month to once a year, depending on the specific situation and needs of the care recipient and informal caregiver. In addition, patients and informal caregivers can contact their case manager at any time in between evaluations (step 5 in Figure 1).
Rather than being a global construct, satisfaction with care is generally regarded as a multidimensional construct . Therefore, the literature on informal caregiver satisfaction with various types of care and support services was reviewed to determine the potential dimensions.
The first dimension of satisfaction with care is information provision. Informal caregivers greatly value clearly formulated care arrangements, adherence to these arrangements by professionals and adequate coordination [27–29]. In a study on satisfaction with case management, informal caregivers indicated that such clarity should extend to all information that is provided , including information regarding when, how and by whom care is provided, as well as information regarding the care recipient’s disease trajectory and available care and support services [15, 27–29]. Informal caregivers also need information to address patients’ care and treatment demands themselves. Such information must be relevant, clear and understandable . Furthermore, information provision should be directed toward relieving informal caregivers’ uncertainties and managing their expectations [30, 31]. Informal caregivers appreciate timely and ongoing communication, especially when changes have been made in care provision arrangements [27, 32, 33]. Care professionals should take sufficient time to convey such information adequately . In addition, it is appreciated when communication occurs through one central source (e.g., the case manager or GP) .
A second dimension is associated with the feelings of control and involvement of informal caregivers. Satisfaction of informal caregivers depends on the degree of control over when, how and by whom care is delivered . Several studies have emphasized that it is necessary to involve informal caregivers actively in all aspects of care provision and care planning [28, 29, 34]. To foster informal caregiver satisfaction, care professionals should therefore collaborate with both the care recipient and his or her caregiver in the development and implementation of care plans [27, 35]. Feeling part of a team and being treated as an equal by care professionals can contribute to informal caregiver satisfaction . This sense of control also applies to informal caregivers knowing what is expected from them in terms of their roles and care responsibilities . In this context, satisfaction can increase by discussing and determining the appropriate tasks of care professionals and informal caregivers .
A third dimension is best described as client-centeredness and professionalism. Client-centeredness is expressed by attentiveness to the needs, abilities and specific circumstances of care recipients and their informal caregivers . It also involves care professionals being informed about the likes, dislikes and routines of the care recipients [5, 27]. Professionalism is the manner in which care professionals approach and treat informal caregivers and care recipients. Empathy, supportiveness, compassion [5, 34] and sensitivity  have been reported to be vital characteristics of care professionals that contribute to informal caregiver satisfaction. Informal caregivers want to be treated with respect and their care recipients to be treated with dignity .
The fourth and final dimension involves the quality and amount of care. Care and support services that are flexible and compatible with the needs of both the care recipient and informal caregiver have been reported to contribute to informal caregiver satisfaction [5, 15, 27–29, 38]. Informal caregivers see the monitoring of the quality of care as an important part of their role . Therefore, dissatisfaction can occur when there is a lack of adequate services, if the quality of services is perceived as insufficient or if there are considerable limitations to accessibility (e.g., long waiting lists) [27, 34, 40]. Dissatisfaction can also occur if many different care professionals are involved, especially when their composition is constantly changing . In terms of support services for informal caregivers, it has been noted that the provision of assurance, advice and emotional support is important [15, 35]. In addition, the provision of one-on-one professional guidance and ongoing case coordination is highly valued [5, 15].
Study design and participants
The design of this study was quasi-experimental and included before and after measurements and a control group. Baseline measurements (T0) were obtained prior to the intervention. Follow-up measurements (T1) were obtained 12 months after T0. The study protocol (protocol number MEC-2013-058) was reviewed by the medical ethics committee of the Erasmus Medical Centre Rotterdam in the Netherlands. The committee waived further examination, as the Medical Research Involving Subjects Act did not apply. The study subjects were informal caregivers of frail elderly patients in 8 primary care practices (PCPs) in the Walcheren region. Prior to the intervention, these patients were asked whether they received informal care, and if so from whom. Inclusion of informal caregivers as subjects in the current study was only possible if the patients received a type of formal care. This criterion was required as informal caregivers would have to be able to assess formal care services. Written informed consent was obtained from all of the participating elderly patients and their informal caregivers.
Three PCPs (6 GPs) provided care according to the WICM and constituted the experimental group. The control group consisted of 5 PCPs (6 GPs) delivering care as usual. As patients (and their informal caregivers) that participated in the WICM were approached by the researchers, control practices were blind regarding the participation of patients and informal caregivers as control subjects. Thus, the possibility of patients being treated differently was ruled out.
Trained interviewers visited the participating frail patients at home. All of the interviewers lived in the region and had a background in elderly care. If the informal caregiver was present, data were collected using the questionnaire by face-to-face interview. If not, contact information was obtained from the elderly patient and the informal caregiver was approached by mail or telephone.
A literature search yielded no validated instrument to measure informal caregiver satisfaction applicable to the specific context of the current study. Other studies have used the Client Satisfaction Questionnaire (CSQ-8), a validated instrument to measure global patient satisfaction with services , and have adapted it for informal caregivers [15, 18, 42]. However, the SCQ-8 was not deemed appropriate for the current study because of its global character. The authors decided that this global character would lack the sensitivity to the different components of (integrated) care services. Other instruments for assessing informal caregiver satisfaction exist, but they have only been validated for other types of care, such as hospital stroke care (e.g., [43, 44]).
A questionnaire was thus constructed by the researchers based on the main dimensions derived from the literature. From these dimensions and from existing questionnaires [44, 45], operationalizations were made (see Additional files 1 and 2 for the original questionnaire in Dutch and an English translation). One particular instrument that has been widely used in the Netherlands for the assessment of patient satisfaction, the Dutch Consumer Quality Index [45, 46], served as the questionnaire’s framework (e.g., form of questions, response categories). The final questionnaire consisted of 62 items: 29 regarding satisfaction with the care services provided to care recipients; and 33 regarding informal caregiver support services. The majority of items were designed using a Likert scale ranging from 1 (never) to 5 (always). Some of the items could only be answered with yes/no. Other questions demanded additional response categories: ‘I do not know/No experience with that’, ‘not applicable’, and ‘not applicable/not necessary’. Items regarding age, sex and whether the informal caregiver lived with the care recipient were included as control variables . In addition, the questionnaire contained several blank lines to allow subjects to note any additional comments. Filling out the questionnaire took an average of 20 minutes.
Analysis of the data occurred at the item level as well as at the dimension level. Before the analysis, all items containing more than 10% missing values were excluded. The Consumer Quality Index dictated that some items had to be recoded . For items containing 2 response categories (no/yes), ‘no’ was recoded as 1 = never and ‘yes’ as 4 = always. Items 27, 33, 38, 45, 57 and 58 were coded in this manner. For items containing 3 response categories (never, once a year, several times a year), ‘never’ remained the same, and the 2 remaining categories were recoded as 4 = always. Items 14 and 43 were coded in this manner. Items 28 and 61 were contra-indicatively formulated. These items were re-coded in reverse order, allowing a low score to indicate low satisfaction.
Analysis at item level
Within-group changes in item scores between T0 and T1 were determined using paired t-tests, McNemar’s test or Wilcoxon’s signed ranked test. For between-groups comparison, independent t-tests and the Chi-square tests (or Fisher’s exact test) were used. The effect of the WICM was evaluated with linear regression or logistic analyses for each item. To assess the individual influences of variables, regression analysis was performed using 3 consecutive models. Model 1 contained the baseline measurement of the relevant item, Model 2 contained the control variables (age, sex, living together with the care recipient), and Model 3 contained the intervention as a variable. The significance of each model was assessed (<0.05). Individual effects were then assessed using a significance level of p < 0.05. However, in light of the relatively small sample, effects within the range of p < 0.10 have been reported as well.
Using factor analysis, it was investigated whether the items of each theoretical dimension indeed constituted an underlying dimension. Primary component analysis (PCA) with oblimin rotation was used to evaluate and extract the factors of each dimension. These analyses were based on T0 scores, as there were no differences in the care delivery models at baseline. The dimensions served as a starting point for the PCA, and the items that were considered to operationalize the same dimension were therefore initially assessed for an underlying factor. Some dimensions lacked a 1-factor structure and therefore could not be made into a scale using their intended items. The subsequent process entailed the iterative inclusion and exclusion of remaining items in other scales to determine their potential fit. An important aspect of this iterative process was the alternation between quantitative and qualitative interpretation of the resulting scales. The contribution of adding and deleting items to the strength and reliability of the scales was assessed. After this quantitative assessment, the content of the items of the resulting scale was interpreted, thereby ensuring the qualitative consistency of the items. This iterative process of interpretation continued until the resulting items optimally represented their dimensions, both quantitatively and qualitatively. Items that could not be included in any scale were grouped together and assessed for underlying factors, to determine the existence of a potential new scale. Factor structures were checked by obtaining eigenvalues (>1) and scree plots. To assess the fit and significance, the KMO-Bartlett test (>0.6) and Bartlett’s test of sphericity (p < 0.05) were performed . Factor loadings of >0.4 were considered sufficiently high. After the factor analysis, scales were constructed. Scales with a Cronbach’s alpha of >0.60 were considered to be reliable.
Analysis of scales
Scores for the resulting scales were calculated by computing the mean score for each respondent. The maximum for the missing values was one third of the items of a particular scale (half of the items for scales containing 4 items) . The absence of a response constituted a missing value (not in case of ‘not applicable’). As with the analyses of the items, the outcomes per scale were analyzed with t-tests, McNemar’s test or Wilcoxon’s signed ranked test, independent t-tests and Chi-square tests (or Fisher’s exact test) and linear and logistic analyses. The regression models contained Model 1 (baseline score of scale), Model 2 (control variables) and Model 3 (the intervention).
Response and study population
Response, loss to follow-up and description of study population
Informal caregivers approached
Response at T0
Loss to follow-up
Definitive study population
58 (sd = 9.5)
62 (sd = 9.5)
Living together (yes)
Analysis at item level
The item regarding the rating of support for informal caregivers in general (0-10) was excluded from further analysis due to a large number of missing values. The groups showed differences on several separate items at both T0 and T1. In addition, a number of within and between-group differences were observed for both the experimental and control group. See Additional file 3 for an overview of scores on all items at T0 and T1 and the analysis of within and between-group differences.
Adjusted R2, β and p-values of dependent variables in regression analysis of item scores
Satisfaction with care
Care provided according to wishes
Sufficient help with administrative tasks
Satisfaction with support
Know who to call
Principal component analysis
The principal component analysis indicated that the resulting scales only partly overlapped with the dimensions derived from literature. The Kaiser-Meyer-Olkin measurement verified the sampling adequacy, which ranged from 0.66 to 0.86. Bartlett’s test of sphericity indicated that the correlations between the items of each scale were sufficiently strong (p < 0.05).
Factor loadings of items on the scales for satisfaction of informal caregivers with the care provided to care recipients
Professionals use care plan
Professionals coordinate visits
Professionals adhere to arrangements
Time of visits is suitable
Professionals involve care recipient in decisions
Professionals provide sufficient information
Care recipient understands information
Professionals evaluate care process frequently
Professionals coordinate care tasks
Professionals respond adequately to questions
Professionals are attentive to needs
Professionals are polite
Professionals have sufficient time
Professionals know needs of care recipient
Professionals are careful with belongings
Professionals collaborate well with others
Professionals provide good quality of care
Professionals are attentive to changes in health
Professionals are attentive to overall well-being
Professionals take functional ability into account
Professionals provide care according to wishes
Professionals help sufficiently with administrative affairs
Professionals pay sufficient attention to safety
Professionals help sufficiently with finding activities
Professionals provide sufficient (emotional) support
The care recipient receives sufficient care
Bartlett’s Chi-square test
Factor loadings of items on the scales for satisfaction of informal caregivers with their support
Attention to health/support
Professionals provide sufficient information: care
Professionals provide sufficient information: services
Professionals provide sufficient information: expectations
Professionals provide sufficient information: how to care
Arrangements for emergency situations
Professionals discusses tasks with caregiver
Sufficiently involved in care decisions
Availability of professionals in case of problems
Professionals make arrangements if care changes
Professionals react adequately to questions/suggestions
Feel safe in proximity of professionals
Professionals take me seriously
Professionals have sufficient time
Professionals listen carefully
Professionals are attentive to needs
Professionals are polite
Professionals are easily accessible by phone
One professional/contact point
Know where to go/whom to go to with complaints
Information is provided about waiting time
Professionals keep each other informed
Professionals take needs into account
Sufficient assistance and support are provided
Professionals pay attention to changes in health
Professionals pay sufficient attention to well-being
Professionals provide sufficient emotional support
Professionals take functional abilities into account
Bartlett’s Chi-square test
Analysis at scale level
Within-group and between-groups analysis
Within and between-group analysis of scale mean scores at T0 and T1
Satisfaction with care
Satisfaction with support
Attention to health/support
Regression analysis for scales
Adjusted R2, β and p -values for all scales
Attention to health/support
This study explored the effects of the Walcheren Integrated Care Model on the satisfaction of informal caregivers with the care provided to elderly care recipients and with the support the caregivers received themselves. The WICM had no substantial effect on informal caregiver satisfaction with care and support services. At the item level, an increase was observed in the satisfaction with the degree to which care was provided according to the needs of care recipients. In addition, the WICM resulted in decreased satisfaction with the degree to which professionals provided sufficient help with administrative tasks, the understandability of the information provided and the degree to which informal caregivers knew which professional to call in cases of problems, complaints or emergencies.
The positive effects that were found suggest that from the informal caregiver’s perspective, integrated care has the potential to provide care according to the needs of the care recipient. This finding provides some confirmation of one of the major objectives of integrated care . The negative results were rather surprising, as the WICM explicitly aimed to address issues of transparency and information provision. In addition, the observed adverse effects were not in agreement with other studies, which reported increased caregiver satisfaction as a result of integrated care interventions similar to the WICM [15, 18]. Both studies reported on the same intervention (SIPA), which included patient screening, care plan development, case management, a multidisciplinary team, protocols and a single entry point . However, the SIPA intervention did not include the explicit involvement of informal caregivers in the planning and provision of care, while the WICM did. Moreover, the WICM paid substantial attention to the optimization of information provision to informal caregivers regarding available services and how to obtain these services. This difference between the WICM and SIPA intervention might also provide some explanation for the negative effects observed in the current study. Perhaps the additional efforts with the WICM to maximize information provision to informal caregivers regarding available services and how to obtain these services, as well as advice regarding how to perform certain care tasks adequately, were experienced by informal caregivers as interference. Potentially, the sum of such well-intentioned efforts might have actually been counterproductive, resulting in information overload, thus reducing the understandability of the information provided and increasing the uncertainty and confusion of informal caregivers. Such counterproductive effects were described by Winslow , who noted that information overload by formal services is often experienced by informal caregivers as a major ‘hassle’. Similarly, it is conceivable that the introduction of a case manager reduced clarity for informal caregivers regarding which professional would be the most appropriate to call in cases of problems, complaints and emergencies. While case management in the WICM aimed to provide a central source of information, one-on-one professional guidance and ongoing case coordination, such counterproductive mechanisms could not be ruled out. Indeed, Fabbricotti  noted that the introduction of coordinating roles, such as a case manager, could actually decrease clarity for care recipients and their informal caregivers, as they would need to interact with yet another professional.
Another explanation for our results might be provided by our instrument. While the SIPA studies [15, 18] used a measurement of general satisfaction , the current study constructed an instrument that was thought to be more sensitive to various service elements, specifically those associated with integrated care. In addition, our approach incurred the risk of assessing satisfaction on a range that might have been too broad. Perhaps our instrument contained items regarding services that respondents simply had no experience with, in which case it would have been difficult to find effects. Another study regarding the effects of integrated care on informal caregiver satisfaction also used a self-constructed instrument . However, those authors did not provide a description of the process of questionnaire construction or of the content of the questionnaire, making interpretation of their results difficult. Another issue related to the measurement of satisfaction is the fact that studies of satisfaction tend to produce high scores, making it difficult to detect changes (e.g., ). In addition, satisfaction scores are often robust over time, evidenced in the current study by T0 scores being the best predictor of T1 scores. However, as the range of scores in this study provided sufficient room for variance, any occurrence of improvements would have been detected.
A final explanation might be provided by the unequal distribution of co-residing and non-co-residing informal caregivers in the study population. The majority of our population did not live with care recipients, perhaps reducing the likelihood of interaction occurring between caregivers and formal services and professionals. In such cases, informal caregivers would have lacked experience with important characteristics of services, such as client-centeredness, professionalism and the manner and content of communication. Without such experiences, informal caregivers would not have been able to adequately assess these services, making it difficult to validly assess their satisfaction. In addition, it has been noted that spousal informal caregivers, i.e., those who co-reside with the care recipient, assess services differently than those who do not co-reside . However, whether this difference affected our results remains unclear, as the relatively small sample of this study did not allow for subgroup analyses .
Some secondary results were observed, such as a reduction in satisfaction with the degree to which the care recipient’s needs were taken into account for female informal caregivers and better knowledge of which professional to call in cases of emergency, problems or complaints for older informal caregivers. Co-residing informal caregivers showed greater satisfaction on the scale of being involved by professionals, and older informal caregivers showed greater satisfaction on the scale of client-centeredness.
Constructing an instrument for a specific study context inherently entails a trade-off with the validity of the instrument, which constituted a limitation of the current study. However, while the benefits of validated instruments, such as the SCQ-8 , are evident, its use would require adaptations for informal caregivers (e.g., [15, 18, 42]), thereby substantially undermining the instrument’s validity. The relatively small variance that was explained by the regression models indicated the existence of other control variables. Indeed, other variables have been shown to be associated with informal caregiver satisfaction with care services, such as increased level of impairment or more frequent disruptive behavior of the care recipient, the informal caregiver being part of a cultural minority in a country , education, marital status, social status  and employment status . The relatively small sample size was another limitation as it substantially reduced the statistical power. The observed trend in increased satisfaction with attention to needs and health suggests that an effect might have been found with a larger sample . Differences between groups may constitute a final limitation. Besides the observed age difference, it seemed that there was some overall difference in satisfaction at baseline. This makes it more challenging to show effects of the intervention.
Are the expectations justified?
This study raises the question of whether the existing expectations of the effects of integrated care on informal caregiver satisfaction are justified. Specifically, the lack of substantial positive effects, in addition to some negative effects, found in this study suggests that the assumption that integrated care increases informal caregiver satisfaction might not necessarily be true. While there is some evidence for positive effects, studies have simply been too scarce to draw any decisive conclusions. Moreover, this scarcity of evidence is in stark contrast with the substantial body of literature regarding integrated care. In the absence of evidence, the possibly inflated expectation of the beneficial effects of integrated care on informal caregiver satisfaction will continue to exist without being contested. In this sense, the debate on integrated care and informal caregiver satisfaction could benefit if the academic community would be more attentive to adverse effects. To this end, studies yielding no or negative results should be equally eligible for publication as those yielding positive results. As both integrated care and informal care have become major priorities in research and policy agendas, this need is even more urgent. Researchers and policymakers might need to consider the possibility that under some conditions, including informal caregivers in integrated care arrangements may have a downside. In other words, we should not readily assume that more informal caregiver involvement is always better, as the opposite might be true: perhaps less is more.
We recommend the development and validation of a comprehensive instrument to assess informal caregiver satisfaction with services. The resulting scales in the current study might provide guidance in this process. Future studies should also consider including a broader range of control variables. We also propose that in the design and implementation of integrated care arrangements, the possibility of adverse effects on informal caregiver satisfaction is considered. In addition, future studies of integrated care should investigate the assumption that co-residing informal caregivers react differently to interventions than caregivers who do not co-reside. This goal might be achieved by including a study population that is sufficiently large to allow for adequate subgroup analyses. Furthermore, it is recommended that the issue of co-residence also be taken into account in future integrated care interventions. This goal could be met by mapping the specific needs of co-residing informal caregivers qualitatively prior to designing the intervention.
The WICM did not substantially affect informal caregivers’ satisfaction with the care for the care recipient or their satisfaction with the support the caregivers received themselves. The question can be raised whether the expectations regarding the beneficial effect of integrated care on informal caregiver satisfaction are justified.
Walcheren Integrated Care Model
Primary care practice
Client Satisfaction Questionnaire
Primary component analysis
Système de services intégrés pour personnes âgées en perte d’antonomie.
The project was funded by a grant from the Netherlands Organization for Health Research and Development (ZonMW; project number 313030201) as part of the National Care for the Elderly Program in the Netherlands (NPO).
- Smale B, Epp T, Dupuis SL: Caregivers of persons with dementia: roles, experiences, supports and coping. A literature review. 2004, Waterloo, ON: Murray Alzheimer Research and Education Program, University of WaterlooGoogle Scholar
- Carretero S, Garcés J, Ródenas F, Sanjosé V: The informal caregiver’s burden of dependent people: theory and empirical review. Arch Gerontol Geriatr. 2009, 49 (1): 74-79.View ArticlePubMedGoogle Scholar
- Gobbens RJ, Luijkx KG, Wijnen-Sponselee MTH, Schols JMGA: Towards a conceptual definition of frail community-dwelling older people. Nurs Outlook. 2010, 58 (2): 76-86.View ArticlePubMedGoogle Scholar
- Reinhard SC, Given B, Petlick NH, Bemis A: Supporting family caregivers in providing care. Patient safety and quality: an evidence-based handbook for nurses. Edited by: Hughes RG. 2008, Rockville: Agency for Healthcare Research and Quality, 1.Google Scholar
- Sussman T: The influence of service factors on spousal caregivers’ perceptions of community services. J Gerontol Soc Work. 2009, 52 (4): 406-422.View ArticlePubMedGoogle Scholar
- Stone RI, Farley P: The competing demands of employment and informal caregiving to disabled. Med Care. 1990, 28 (6): 513-526.View ArticlePubMedGoogle Scholar
- Schulz R, Beach SR: Caregiving as a risk factor for mortality: the caregiver health effects study. JAMA. 1999, 282: 2215-2219.View ArticlePubMedGoogle Scholar
- Deeken JF, Taylor KL, Mangan P, Yabroff KR, Ingham JM: A review of self-report instruments developed to measure burden, needs, and quality of life of informal caregivers. J Pain Symptom Manage. 2003, 26 (4): 922-953.View ArticlePubMedGoogle Scholar
- Lopez-Hartmann M, Wens J, Verhoeven V, Remmen R: The effect of caregiver support interventions for caregivers of community-dwelling frail elderly: a systematic review. Int J Integrated Care. 2012, 12 (5): e133.View ArticleGoogle Scholar
- Hallberg IR, Kristensson J: Preventive home care of frail older people: a review of recent case management studies. J Clin Nurs. 2004, 13: 112-120.View ArticlePubMedGoogle Scholar
- Brotman SL, Yaffe MJ: Are physicians meeting the needs of family caregivers of the frail elderly?. Can Fam Physician. 1994, 40: 679-685.PubMedPubMed CentralGoogle Scholar
- Brown LJ, Potter JF, Foster BG: Caregiver burden should be evaluated during geriatric assessment. J Am Geriatr Soc. 1990, 38: 455-460.View ArticlePubMedGoogle Scholar
- Ducharme F, Lebel P, Bergman H: Vieillissement et soins, l’urgence d’offrir des services de santé intégrés aux familles du XXIe siècle [Aging and care: urgency to offer integrated health services to families of 21st century]. Ruptures: Revue Transdisciplinaire en Santé. 2001, 8 (2): 110-121.Google Scholar
- Rosenthal GE, Shannon SE: The use of patient perceptions in the evaluation of health-care delivery systems. Med Care. 1997, 35 (11): NS58-NS68.PubMedGoogle Scholar
- Savard J, Leduc N, Lebel P, Béland F, Bergman H: Caregiver satisfaction with support services: influence of different types of services. J Aging Health. 2006, 18 (10): 3-27.View ArticlePubMedGoogle Scholar
- McAdam M: Frameworks of integrated care for the elderly: A systematic review. 2008, Ontario: Canadian Policy Research Networks, research reportGoogle Scholar
- Genet N, Boerma WG, Kringos DS, Bouman A, Francke AL, Fagerström C, Melchiorre MG, Greco C, Devillé W: Home care in Europe: a systematic literature review. BMC Health Serv Res. 2011, 11 (1): 207.View ArticlePubMedPubMed CentralGoogle Scholar
- Béland F, Bergman H, Lebel P, Clarfield AM, Tousignant P, Contandriopoulos AP, Dallaire L: A system of integrated care for older persons with disabilities in Canada: results from a randomized controlled trial. J Gerontol A Biol Sci Med Sci. 2006, 61 (4): 367-373.View ArticlePubMedGoogle Scholar
- Kodner D, Spreeuwenberg C: Integrated care: meaning, logic, applications and implications – a discussion paper. Int J Integrated Care. 2003, 2 (3): e12.Google Scholar
- Kodner D: All together now: a conceptual exploration of integrated care. Healthc Q. 2009, 13 (Sp): 6-15.View ArticlePubMedGoogle Scholar
- Fabbricotti IN, Janse B, Looman WM, de Kuijper R, van Wijngaarden JDH, Reiffers A: Integrated care for frail elderly compared to usual care: a study protocol of a quasi-experiment on the effects on the frail elderly, their caregivers, health professionals and health care costs. BMC Geriatr. 2013, 13: 31.View ArticlePubMedPubMed CentralGoogle Scholar
- Braun K, Rose C: Testing the impact of a case management program on caregiver appraisal. J Gerontol Soc Work. 1994, 21 (3/4): 51-69.View ArticleGoogle Scholar
- Eklund K: Outcomes of coordinated and integrated interventions targeting frail elderly people: a systematic review of randomized controlled trials. Health Soc Care Community. 2009, 17 (5): 447-458.View ArticlePubMedGoogle Scholar
- Montgomery PR, Fallis WM: South Winnipeg Integrated Geriatric Program (SWING): a rapid community-response program for the frail elderly. Can J Aging. 2003, 22: 275-281.View ArticleGoogle Scholar
- Boot JMD: Organisatie van de gezondheidszorg [In Dutch]. 2010, Assen: Uitgeverij van GorcumGoogle Scholar
- Kane RL, Maciejewski M, Finch M: The relationship of patient satisfaction with care and clinical outcomes. Med Care. 1997, 35 (7): 714-730.View ArticlePubMedGoogle Scholar
- Malone-Beach E, Zarit S, Spore D: Caregiver’s perceptions of case management and community-based services: barriers to service use. J Appl Gerontol. 1992, 11: 146-159.View ArticleGoogle Scholar
- Bull MJ, Hansen HE, Gross CR: Differences in family caregiver outcomes by their level of involvement in discharge planning. Appl Nurs Res. 2000, 13 (2): 76-82.View ArticlePubMedGoogle Scholar
- Cox C: Discharge planning for dementia patients: factors influencing caregiver decisions and satisfaction. Health Soc Work. 1996, 21: 97-104.PubMedGoogle Scholar
- Zwygart-Stauffacher M, Lindquist R, Savik K: Developments of health care delivery systems that are sensitive to the needs of stroke survivors and their caregivers. Nurs Adm Q. 2000, 24 (3): 33-42.View ArticlePubMedGoogle Scholar
- Given B, Given C: Family caregiver burden from cancer care. Cancer nursing: a comprehensive textbook. 1996, New York: Harcourt Brace, 93-104. 2Google Scholar
- Congdon JG: Managing the incongruities: the hospital discharge experience for elderly patients, their families, and nurses. Appl Nurs Res. 1994, 7: 125-131.View ArticlePubMedGoogle Scholar
- Jewell S: Elderly patients’ participation in discharge decision-making. Br J Nurs. 1996, 5: 1065-1071.View ArticlePubMedGoogle Scholar
- Wiles J: Informal caregivers’ experiences of formal support in a changing context. Health Soc Care Community. 2003, 11 (3): 189-207.View ArticlePubMedGoogle Scholar
- Haug MR: Elderly patients, caregivers, and physicians: theory and research on health care triads. J Health Soc Behav. 1994, 35: 1-12.View ArticlePubMedGoogle Scholar
- Levy-Storms L, Miller-Martinez D: Family caregiver involvement and satisfaction with institutional care during the 1st year after admission. J Appl Gerontol. 2005, 24 (2): 160-174.View ArticleGoogle Scholar
- Grant G, Ramcharan P, McGrath M, Nolan M, Keady J: Rewards and gratifications among family caregivers: towards a refined model of caring and coping. J Intellect Disabil Res. 1998, 42: 58-71.View ArticlePubMedGoogle Scholar
- Schulz R, Martire LM: Family caregiving of persons with dementia: prevalence, health effects, and support strategies. Am J Geriatr Psychiatry. 2004, 12 (3): 240-249.View ArticlePubMedGoogle Scholar
- Seddon D, Jones K, Boyle M: Carer experiences after a relative goes into nursing or residential care. Qual Ageing–Pol Res Pract. 2002, 3 (3): 16-26.View ArticleGoogle Scholar
- Bass DM, Noelker LS, McCarthy CA: The influence of formal and informal helpers on primary caregivers’ perceptions of quality of care. J Appl Gerontol. 1999, 18 (2): 177-199.View ArticleGoogle Scholar
- Larsen DL, Attkisson CC, Hargreaves WA, Nguyen TD: Assessment of client/patient satisfaction: development of a general scale. Eval Program Plann. 1979, 2: 197-207.View ArticlePubMedGoogle Scholar
- Challis D, Clarkson P, Williamson J, Hughes J, Venables D, Burns A, Weinberg A: The value of specialist clinical assessment of older people prior to entry to care homes. Age Ageing. 2004, 33 (1): 25-34.View ArticlePubMedGoogle Scholar
- Cramm JM, Strating MM, Nieboer AP: Validation of the caregivers’ Satisfaction with Stroke Care Questionnaire: C-SASC hospital scale. J Neurol. 2011, 258 (6): 1008-1012.View ArticlePubMedGoogle Scholar
- Boter H, de Haan RJ, Rinkel GJ: Clinimetric evaluation of a Satisfaction-with-Stroke-Care questionnaire. J Neurol. 2003, 250 (5): 534-541.View ArticlePubMedGoogle Scholar
- Instrument for informal caregivers of patients with Dementia. http://www.invoorzorg.nl/ivzweb/Overzichten-In-Voor-Zorg!/map-tools/Toolkit-mantelzorg.html?highlight=toolkit%2c%20mantelzorg.
- Triemstra M, Winters S, Kool RB, Wiegers TA: Measuring client experiences in long-term care in the Netherlands: a pilot study with the Consumer Quality Index Long-term Care. BMC Health Serv Res. 2010, 10 (1): 95.View ArticlePubMedPubMed CentralGoogle Scholar
- Wiegers TA, Stubbe JH, Triemstra M: Development of the CQ-index Nursing Homes and Homecare: quality of life for residents, representatives and clients. 2007, Utrecht: Nivel, 2007-Research reportGoogle Scholar
- Tabachnick BG, Fidell LS, Osterlind SJ: Using multivariate statistics. 2007, Boston: Pearson/Allyn & Bacon, 5Google Scholar
- Bergman H, Béland F, Lebel P, Contandriopoulos AP, Tousignant P, Brunelle Y, Kaufman T, Leibovich E, Rodriguez R, Clarfield M: Care for Canada's frail elderly population: fragmentation or integration?. Can Med Assoc J. 1997, 157 (8): 1116-1121.Google Scholar
- Winslow BW: Family caregivers’ experiences with community services: a qualitative analysis. Public Health Nurs. 2003, 20 (5): 341-348.View ArticlePubMedGoogle Scholar
- Fabbricotti IN: Taking care of integrated care: integration and fragmentation in the development of integrated care arrangements. PhD thesis. 2007, Erasmus University Rotterdam, Institute of Health Policy and ManagementGoogle Scholar
- Lagakos SW: The challenge of subgroup analyses – reporting without distorting. N Engl J Med. 2006, 354 (16): 1667-1669.View ArticlePubMedGoogle Scholar
- Durand PJ, Krueger PD, Chambers LW, Grek A, Charles C: Predictors of caregivers’ dissatisfaction with community long-term care services for seniors: results from the Canadian Study of Health and Aging. Can J Public Health. 1995, 86: 325-332.PubMedGoogle Scholar
- Weissert WG, Elston JM, Bolda EJ, Zelman WN, Mutran E, Magnum AB: Adult day care: findings from a national survey. 1990, Baltimore: John Hopkins University PressGoogle Scholar
- Fields A: Discovering statistics using SPSS. 2009, London: SAGE Publications, 3Google Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1472-6963/14/140/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.