Skip to main content

Development and preliminary validation of a questionnaire to measure satisfaction with home care in Greece: an exploratory factor analysis of polychoric correlations

Abstract

Background

The primary aim of this study was to develop and psychometrically test a Greek-language instrument for measuring satisfaction with home care. The first empirical evidence about the level of satisfaction with these services in Greece is also provided.

Methods

The questionnaire resulted from literature search, on-site observation and cognitive interviews. It was applied in 2006 to a sample of 201 enrollees of five home care programs in the city of Thessaloniki and contains 31 items that measure satisfaction with individual service attributes and are expressed on a 5-point Likert scale. The latter has been usually considered in practice as an interval scale, although it is in principle ordinal. We thus treated the variable as an ordinal one, but also employed the traditional approach in order to compare the findings. Our analysis was therefore based on ordinal measures such as the polychoric correlation, Kendall's Tau b coefficient and ordinal Cronbach's alpha. Exploratory factor analysis was followed by an assessment of internal consistency reliability, test-retest reliability, construct validity and sensitivity.

Results

Analyses with ordinal and interval scale measures produced in essence very similar results and identified four multi-item scales. Three of these were found to be reliable and valid: socioeconomic change, staff skills and attitudes and service appropriateness. A fourth dimension -service planning- had lower internal consistency reliability and yet very satisfactory test-retest reliability, construct validity and floor and ceiling effects. The global satisfaction scale created was also quite reliable. Overall, participants were satisfied -yet not very satisfied- with home care services. More room for improvement seems to exist for the socio-economic and planning aspects of care and less for staff skills and attitudes and appropriateness of provided services.

Conclusions

The methods developed seem to be a promising tool for the measurement of home care satisfaction in Greece.

Peer Review reports

Background

The elderly in the European Union constitute a significant segment of the society, which is expected to rise in the future [1]. In 2005 there were 79 million individuals over the age of 65 in Western and Central Europe. This figure will increase to 107 million in 2025 (+ 35%) and to 133 million in 2050 (+ 68%). The largest growth in this age group will be observed for those over 80 years (+ 180%). By 2030, in contrast, all other adult age groups will be declining in size. There is therefore a gradual shift from a society dominated by young individuals to a society in which the elderly will become the majority. The need for the provision of social services is exacerbated by the observed social exclusion, financial difficulties and health problems related to this particular age group. The World Health Organization has thus placed "good aging" fifth among its targets for the 21st century.

This has led to the adoption of practices which aimed at the promotion of the well-being of the elderly on a social as well as on a physical level. Home care programs have been evolving in European countries for many decades based on the aforementioned and comprise the most important attempt to support the vulnerable social group of the elderly [2]. As one of the few social initiatives of local government in Greece ten years ago, legislation was enacted in the majority of municipalities for the elderly and people with disabilities. The program aimed at improving the quality of life of the enrollees. Its effectiveness nevertheless has never been formally assessed. This is not surprising since research on patient satisfaction by means of validated questionnaires is in fact very scarce in Greece [3, 4].

The program of providing home care services to the elderly and disabled begun in 1996 and quickly spread to most municipalities in Greece [5]. Seventy five percent of the necessary funds have been provided by the European Union and the rest through national financing [6]. By the beginning of 2005 there were 1084 home care units established serving 40,060 enrollees [7]. The general purpose of the program was to confront the social exclusion and institutionalization as well as to improve the quality of life of the elderly and the disabled. Priority has been given to individuals with an inability for self-care, who lived alone and had limited financial resources to improve their living standards and become independent.

In order to achieve these goals, social work, nursing care and life assistance services have been used [8]. The social worker is responsible, at an initial stage, for the needs assessment of the applicants, the scheduling of home visits and the determination of the range of provided services. Moreover, this employee is assigned with the task of co-operating with local parties, welfare services, voluntary organizations and the linking of the home care program with the participants and the local community. His/her role also includes provision of counseling and emotional support to the enrollees and their caregivers as well as admission to various institutions (e.g. hospitals, welfare, mental health units) when necessary. Nursing care is prevention-oriented. Information is provided regarding the illnesses and diseases enrollees are facing or are likely to face in the future. Nursing also addresses the enrollees' nutrition. Blood tests (including blood glucose tests), examination of vital signs and medication compliance are targeted towards the preservation of health, the self-care of enrollees and the establishment of a safe environment. Information is provided and the family and other caregivers are trained, so that they can handle problems more effectively. The aide workers' assistance includes help with personal hygiene, light housework, grocery shopping or other small purchases, payment of bills, meal preparation and other life-assisting activities. The interaction of all team members is often essential, especially for activities such as companionship, social mobilization of enrollees, emotional and psychological support and co-operation with caregivers.

In this study we developed and tested a questionnaire for measuring home care satisfaction in Greece. Although other questionnaires were available on an international level, there are significant differences in the various national settings that made the development of a customized instrument necessary. First, in several countries the specific home care services enjoyed by the participants depend on private payments or a person's contribution to a health insurance fund, whereas in Greece all services are provided free of charge by the municipalities. They are therefore determined solely by assessing relative needs. Second, in Greece the team which offers the home care services comprises mainly of a social worker, a nurse and two aide workers, whereas other specialties (medical doctors, psychologists, physiotherapists) encountered in other countries might or might not be included, depending on the specific municipality's policy. In addition, other services, such as meal preparation, might be available to all upon request abroad, yet only in certain programs and individuals in Greece. In general, there are important differences in the structure and mode of provision of home care services between countries, related to the methods of financing, as well as the cultural and social factors.

The aim of this study was to measure home care satisfaction by developing an appropriate questionnaire that covers the Greek home care provision. The tool devised was psychometrically tested and subsequently the level of satisfaction with home care services was measured. A novel concept in this work is the use of polychoric correlations in the factorial analysis and psychometric testing, which acknowledges the ordinal nature of the data, typically ignored in relevant prior research.

Methods

A questionnaire in Greek was developed to measure the satisfaction of enrollees with home care services. Items were phrased using a typical 5-point Likert scale with 1 indicating "strongly disagree" and 5 corresponding to "strongly agree". Positively and negatively worded items were interchanged to avoid positive biases [9]. Negative worded questions were therefore subsequently re-coded so that higher values would indicate higher levels of enrollee satisfaction, and vice versa.

Items were carefully selected after an extensive literature search and cognitive interviews with 15 program enrollees (of various ages, levels of education and incomes) and 15 employees (an equal number of social workers, nurses and aide workers) that were not included in the main study. Items were phrased so as to avoid vagueness and biases, double negatives, double-barreled questions and protests.

Satisfaction items reflect all the important aspects of the home care program, namely effectiveness, safety, respect, attention, participation in planning, correctness of planning, access, socialization and technical abilities of staff. The literature sought included theoretical papers, questionnaire validations and qualitative analyses [10–29]. Two questions included referred to general satisfaction from the provided home care services. Regarding socioeconomic and demographic variables, we recorded gender, age, educational level, income, family status, enrolment duration, visit frequency and informal caregivers [10]. Two more items were incorporated in order to exclude individuals that gave inconsistent responses. These had the same meaning as other questions but were differently phrased.

An important subsequent step in instrument development was pretesting, which took the form of cognitive interviews with elderly and disabled participating in the programs [30]. There were 10 such subjects from each group. These identified problems with the content and understanding of the questions, as well as additional causes of (dis)satisfaction, not captured by the instrument, thus enhancing reliability and content validity. Towards the same end, individuals pinpointed questions identified by the literature search that had to be removed from the instrument as being unimportant. The same persons were approached after a revision of the questionnaire and no additional issues were identified. Moreover, expert panel judgment was also exploited to ensure content validity and item clarity.

We initially screened the data by assessing (Spearman's) correlation coefficients between the items capturing satisfaction from specific characteristics of home care and the two items measuring overall satisfaction. Theory suggests that there might be a relationship apparent between overall satisfaction and satisfaction from individual services [9, 31]. Specifically, overall satisfaction emerges from customer's evaluations of service encounters, which in turn are evaluated on the basis of service attributes (e.g. response time of the nurse). The latter are evaluated on the basis of positive and negative events that occur during the encounter with the provider. In this sense, the overall evaluation of the provider might be a weighted average of all evaluations of service attributes, the weights being the importance assigned by the customer to each attribute.

In our context, however, one needs additional justification for excluding items from the survey, than simply observing insignificant correlations, for two reasons. First, we employed in this research two questions that have been used most frequently in practice for measuring overall satisfaction. It is nevertheless theoretically possible that they do not fully cover all the aspects of satisfaction from the service encounter, as perceived by customers. Second, a single item might have to move a great deal in order to have a significant effect on overall quality and there might be additional effects of the particular item when combined with other related questions. For these reasons, statistically insignificant correlations observed in this study only served as triggers for further investigation of specific items.

The questionnaire was administered to enrollees of home care programs, who were elderly and disabled in the age group of 65 to 90 years. An inclusion criterion to the study entailed that the subjects should have been participating in the program for at least two months, following Westra et al. [15]. The sample was approached from March 7 to April 3, 2006 with face-to-face interviews by trained interviewers. The study was approved by the Review Board of the Hellenic Open University. Subjects were told that their anonymity would be assured in the study. We excluded those who faced health disorders/problems that affected their mental state (e.g. Alzheimer's disease, severe stroke). Subsequently, five home care programs in Thessaloniki were randomly selected from a total of 36 programs that existed in municipalities of the city having more than 10,000 residents: Municipality of Stavroupoli (two home care programs), Municipality of Thermaikos, Municipality of Menemeni and Pefka Village. Although a consensus is lacking, samples with at least 200 persons and an observation-to-item ratio higher than 5:1 are generally acceptable in this type of research [32]. The interviewers visited the houses of all 319 enrollees in these programs that matched the inclusion criteria at the time of the study.

Summated scales were formed by exploratory factor analysis [33]. The Kaiser-Meyer-Olkin measure of sampling adequacy and Bartlett's test of sphericity were used to check whether the data were suitable for factor analysis. Values of KMO greater than 0.70 have been characterized as "middling" (and greater than 0.90 as "marvelous"). Bartlett's test of sphericity tests the null hypothesis that the correlation matrix is an identity matrix (i.e. that there is no relationship between the items) [34].

Although in many instances they yield similar results, factor analysis was preferred to principal components analysis, since the purpose of the study was to develop a theoretical construct, rather than merely perform data reduction [35]. The specific factor analyses employed unweighted least squares and varimax rotation. The unweighted least squares method was chosen because it is robust, can be used with small samples and also when the correlation matrix is non-positive definite. Factors whose eigenvalues exceeded unity were retained [36]. Following other researchers, we assigned an item to a factor - summated scale if its factor loading was greater than 0.50 and its differences with other factor loadings of the same item were greater than 0.20 [37, 38].

The main factor analysis carried out in this study acknowledges the fact that the 5-point Likert scale is in fact ordinal [39]. It was hence based on polychoric correlations. The polychoric correlation coefficient assumes that pairs of ordinal scores are in fact generated by latent bivariate normally distributed random variables. Measuring the association between ordinal variables entails the estimation of the product moment correlation between the corresponding normally distributed variables. Interestingly, a recent study that utilized a generalized polychoric coefficient found that it does not outperform the typical polychoric measure in cases where the sample size is smaller than 400 observations and the number of ordinal categories in the response scale is greater than three [40]. The polychoric correlation matrix was estimated using the two-stage procedure described in Jöreskog [41] and implemented in PRELIS v.2.8 [42]. Note that since the matrix was estimated in a pairwise fashion it was possible to be non-positive definite. An exploratory factor analysis was then performed entering the estimated polychoric correlation matrix into SPSS v.15.

Since prior research has mainly assumed that the Likert scale can be treated as an interval or ratio scale, we also performed, for comparative purposes, typical factor analyses based on Pearson correlations. In addition to unweighted least squares, we also extracted factors with principal axis factoring to account for the skewness observed in the data [43, 44].

Internal consistency reliability measures the extent to which all items within a scale are indeed capturing the same construct. Cronbach's alpha coefficients greater than 0.80 indicate high levels of internal consistency, whereas values less than 0.70 suggest that the researcher should attempt deleting individual items from the scales to examine whether consistency improves [45]. Due to the ordinal nature of the data, an ordinal standardised item alpha coefficient was also derived by inserting polychoric correlations into the simplified formula of the alpha coefficient [46, 47]. Note that prior research has examined the potential effect of skewness to this form of reliability coefficients and has found no impact of square root and log transformations on Cronbach's alpha coefficients [48]. A further criterion used to assess internal consistency reliability was inter-item correlations. Prior research has argued that items within a scale with lower correlations than 0.30 might not be sufficiently related to be used as measures of the same phenomenon, whereas items with correlations higher than 0.70 might be redundant [49]. We calculated Spearman's coefficients, thus taking into account potential skewness.

The degree to which scales are sensitive to external factors in successive measurements was assessed by examining test-retest reliability. The second administration occurred two weeks after the initial measurement. In this study, intraclass correlations were preferred to Pearson product moments coefficients because the test and retest variables originated from the same group of individuals and the former coefficients could detect systematic errors [50, 51]. There is no consensus regarding the appropriate standards for the value of the coefficients [52]. Nevertheless, a value of 0.70 is considered satisfactory in practice [53]. In addition, to account for possible skewness in the data, we also employed Kendall's Tau b, which is a distribution-free correlation measure.

Multi-trait analysis was then performed to assess internal consistency reliability, construct validity and within-scale item additivity. It is a psychometric technique applied when a questionnaire is hypothesized to capture several distinct theoretical constructs - concepts, each measured by several individual items (questions). The criteria assessed are [54]:

  • Each item should have a high correlation with all other items in the summated scale in which it is assumed to belong (item internal consistency). 0.40 represents the lowest acceptable correlation reflecting consistency.

  • The correlation of an item with the sum of all other items in its scale should be higher than its respective correlations with all other summated scale scores (item discriminant validity).

  • For items within a summated scale, the correlation between one item and the sum of the other items should be of roughly the same magnitude for all items (equal item-own scale correlation).

  • Items in the same summated scale should have roughly equal variances.

If criteria 1 and 2 are not met, the groupings should be reconsidered and if criteria 3 and 4 are not met, weighting of items while forming summated scales should be pursued.

In the multi-trait analysis conducted we acknowledged the ordinal nature of the data as well as the potential skewness of individual item scores. We therefore compared Pearson, Spearman, polychoric and polyserial correlation results, following prior research [55]. In the first case, we used a t-statistic for testing the significance of the difference between two dependent correlations [56]. Spearman's Rho is suitable for ordinal data since it is based on ranks of data. Note also that wherever a variable (multi-item scale) had more than 15 categories, it was treated as continuous. Therefore, a polyserial correlation was used for its association with other ordinal variables.

Construct validity was further assessed by examining inter-scale correlations. These had to be statistically significant and greater than 0.40 [57]. Furthermore, we looked at the correlations of the global satisfaction measure with the other scales, as well as the correlations of the latter with specific participant characteristics. To account for data ordinality and skewness we computed polychoric, polyserial, Spearman and Kendall's Tau b coefficients.

Ceiling and floor effects for the created multi-item scales were examined by assessing the percentage of responses falling into the highest and lowest possible satisfaction scores (i.e. strongly agree and strongly disagree). These are measures of the sensitivity of the tool. Finally, we computed the means and medians of the created scales in order to measure satisfaction with various aspects of home care as well as overall enrollee satisfaction. In fact, we linearly converted the scores into a 0-100 point scale.

Results

Initially, the questionnaire created included 33 items measuring satisfaction with individual aspects of home care. For most items, Spearman correlation coefficients between items and the two questions of overall satisfaction were statistically different from zero (p < 0.05). In contrast, two questions meant to capture satisfaction with individual attributes of home care had correlations with overall measures that were insignificant. These were "I believe there should be more staff (e.g. nurses, social workers) involved in the program" and "The home care program is in need of additional specialties (e.g. physicians, physiotherapists)". The reason why we eventually decided to exclude these two items was that they seem to refer to somehow technical aspects of care that the enrollees might not be to an extent able to answer correctly. Content validity does not seem to be sacrificed from this exclusion due to the existence of items 11 and 13, which ask enrollees whether they believe they should be visited more frequently and whether their needs are met. The items measuring individual aspects of enrollee satisfaction we used in the statistical analyses were therefore 31. Two more questions reflected overall satisfaction with home care programs. These are shown in Table 1 (Additional file 1 contains the original questionnaire).

Table 1 Description of items measuring satisfaction with home care

From the 319 home care enrollees visited, 17 were absent at the time of the visit and 91 refused to participate in the study, yielding an initial sample of 211 face-to-face interviews. Among the participants, 93 were living in Stavroupoli (44.1%), 46 in Thermaikos (21.8%), 41 in Menemeni (19.4%) and 31 in Pefka (14.7%). Six respondents were excluded failing the validity test by providing different replies in the two control questions. Four more did not respond to the majority of items. The final sample consisted of 201 usable interviews, yielding a response rate of 63% and an observation-to-item ratio of 6.48:1. There were no missing values in the remaining questionnaires. This entails clarity of the constructed items. The majority of enrollees in the final sample was women and had little or no education. Most participants were being visited 1-3 times each week by workers of the home care program and were getting additional help in their lives from their children. Their net monthly income was less than €700 (Table 2).

Table 2 Characteristics and descriptive statistics of the final sample

The KMO measure was 0.942 and Bartlett's test was statistically significant (p < 0.01). As can be seen in Table 3, factor analysis based on polychoric correlations and performed with unweighted least squares and varimax rotation yielded five factors, which explain 61.16% of the variance in the original 31 variables. One factor contained only one item and thus could not form a summated scale by itself. Items 2, 4, 10 and 24 made up the scale "socio-economic change", questions 3, 5, 23, 28 and 29 constituted the scale "staff skills and attitudes", items 15 and 20 the scale "service appropriateness" and questions 11 and 30 formed the scale "service planning". Note that item 20 in the "service appropriateness" scale had in fact a high factor loading also with the one-item factor mentioned above. Since that factor has been disregarded for having only one item, we decided to retain item 20 and its two-item scale, despite the fact that the difference in factor loadings was less than 0.20.

Table 3 Factor analysis with polychoric correlations†

The factor analysis was repeated with Pearson correlations. The variance explained was similarly high (62.97%) and - although there were some differences in the actual correlations used- the factors obtained with this approach were identical to those obtained with polychoric correlations. Hence these results are not presented here. Furthermore, given the skewed nature of the data documented in Table 1, analysis was also carried out with principal axis factoring. Results (not shown here) indicated that the factors identified were identical to those derived by unweighted least squares.

On inspection of Table 4, it is evident that Cronbach's alpha coefficients were high for the first two scales, acceptable for the "service appropriateness" scale and low for the multi-item scale that relates to service planning. The same conclusion was reached when we employed the ordinal standardised item alpha coefficient (Table 4). Note that this latter measure also implied that the overall satisfaction scale was more reliable than initially suggested. Scale data were skewed for the first three scales (skewness statistic values were -1.082, -1.921 and -1.728 with a std. error of 0.172, respectively). Only the service planning scale was found to be symmetrical (skewness statistic 0.344, st. error 0.172). We thus also examined the Spearman correlation coefficient between the items and the scale (corrected for overlap) in which factor analysis showed they belonged. Internal consistency was hence further documented for the skewed data since the non parametric correlation statistic exceeded 0.40 in all cases (Table 5). In contrast, the scale "service planning" failed this reliability criterion. In line with these findings, the values of inter-item Spearman's correlations for the first three scales ranged from 0.359 to 0.624. However, the two items we assigned to the "service planning" dimension had a correlation coefficient of only 0.280.

Table 4 Internal consistency reliability and satisfaction scores
Table 5 Multi-trait analysis with Pearson, Spearman, polychoric and polyserial correlations †

Table 6 reports test-retest correlations. 52 enrollees were approached and 36 had agreed to complete the questionnaire for a second time, a response rate of 69.23%. The values of the statistics are considered to be satisfactory for all scales.

Table 6 Test-retest reliability coefficients

Multitrait scaling yielded satisfactory results. Table 5 shows that the first criterion of item internal consistency was met for three scales, since the Pearson, Spearman and polychoric correlations took values above 0.40. It was not satisfied, however, for the service planning scale. The second criterion of divergent validity was fully met for all scales. Regardless of which correlation coefficient we employed, in all cases the correlation of an item with its own scale was higher than its correlation with other summated scales. Differences were in fact significant (p < 0.05). With respect to the third criterion, for the two scales that contained more than two items, the ranges of the various correlation coefficient values were quite narrow. Similar values were also evident for the variances in the four summated scales, suggesting that the last criterion of the multitrait analysis was also satisfied.

Inter-scale correlations are reported in Table 7. For the scales "socio-economic change", "staff skills & attitudes" and "service appropriateness" spearman, polychoric and polyserial correlations were all higher than the suggested literature value of 0.40 and significant (p < 0.05), whereas Kendall Tau coefficients in some cases fell a little short of this and yet were still statistically significant. Furthermore, as expected, summated scale scores were positively related to overall satisfaction. Regarding "service planning", the criterion for the inter-scale correlations was not met and the relationship with overall satisfaction was weaker than that of other scales with the same global measure.

Table 7 Correlations between scale scores and respondents' characteristics †

Finally, Spearman's and Kendall's Tau correlations suggest some significant relationships of scales with respondents' characteristics that conform to our prior beliefs. As expected, net monthly income was negatively related to satisfaction with socio-economic change, staff skills & attitudes and service appropriateness. It was unrelated to service planning satisfaction. In addition, the duration of enrolment might be positively related to satisfaction with service appropriateness. These results however should be interpreted with some caution since polychoric and polyserial correlations lacked statistical significance (p > 0.05). These latter correlations also revealed an expected significant positive relation between visit frequency and satisfaction with service planning.

The percentages of observations falling into the highest satisfaction score category for the four summated scales were 7%, 15.4%, 35.3% and 3.5%, respectively. The respective floor effects were very limited and equal to 0.5%, 0.5%, 2% and 2.5%. Note that high ceiling effects are not uncommon in the literature [58], although some studies do find such effects to be more limited, that is lower than 10-12% [59].

Median (mean) satisfaction from socio-economic aspects of care, staff skills and attitudes, appropriateness of provided services and planning was 75.00 (72.17), 85.00 (81.27), 87.5 (81.03) and 60.00 (59.60), respectively. Overall satisfaction was 75.00 (74.63). This means that most enrollees were satisfied yet not very satisfied overall with provided services. In fact, 81.6% of all participants were to some extent satisfied with the home care programs, whilst 9% expressed some level of dissatisfaction. A point of concern, nevertheless, relates to the lower satisfaction with service planning documented.

Discussion

A preliminary validation of a new psychometric tool for measuring satisfaction with home care was conducted with a sample of 201 individuals enrolled in five home care programs operating in the City of Thessaloniki. The questionnaire had 31 items and was expressed on a Likert scale. Although this scale has been typically considered in practice as interval it is in principle ordinal. We have therefore extended the usual research design to comparatively include ordinal methods, such as polychoric correlations.

Results from this exploratory analysis suggested that four multi-item factors are associated with home care satisfaction: socioeconomic change (4 items), staff skills and attitudes (5 items), appropriateness of provided services (2 items), and planning of services (2 items). An additional two-item scale was formed reflecting overall satisfaction with the programs. The first three multi-item scales had satisfactory internal consistency reliability, test-retest reliability and construct validity. An additional dimension suggested by factor analysis was "service planning" which has been found to have lower internal consistency reliability. Future research should further investigate whether the specific summated scale can be improved or legitimately ignored without sacrificing content validity.

There are differences as well as similarities between our scale dimensions and those found in other international studies. For instance, Reeder & Chen's confirmatory factor analysis lumped together three previously documented scales -namely professional/technical, interpersonal/trust and educational- into one unique dimension [13]. Using the same instrument, Laferriere found four dimensions of client satisfaction with home nursing care: technical quality of care, communication, personal relationships between client and provider, and service delivery [11]. Bear et al. instead reported two factors: service delivery and service sufficiency [20]. Netten et al. and Jones et al. mentioned carer quality - opinions towards carer, service quality and outcomes [27, 60]. Finally, Geron et al. classified items into the categories homemaker/health aide, care management service, home-delivered meal service and grocery service [22]. The reasons for the observed differences between the number and content of scales in the home care satisfaction literature have not been studied. In our research some dissimilarity with other findings was expected due to the differences in the Greek home care service provision outlined previously.

There is some evidence to suggest that satisfaction ratings with home care are influenced by monthly income and duration of enrolment in the program. Individuals with fewer own financial resources were in most need of home care services and hence reported higher satisfaction, and vice versa. Further, the more years an enrollee had been participating in the home care program, the more he trusted staff to carry out tasks for him and presumably did not allow aides to force him do things he disliked. Yet one should be cautious in uncritically adopting these associations and explanations since some correlation measures lacked statistical significance.

It is important to note that the results of this study were not influenced by the approach employed. That is, whether one assumed that the 5-point Likert scale was an interval scale or an ordinal one had in essence no significant effect in the study findings. Similar findings from ordinal and Pearsonian exploratory factor analyses have also been documented for the Big Five Questionnaire [39].

Finally, overall enrollees were satisfied with the home care programs. Higher levels of satisfaction were associated with the skills and attitudes of the staff and the suitability of services. Whereas lower levels were associated with the social and economic aspects of provided help and service planning. There are no existing studies in the Greek setting with which to compare the current findings. Although home care services in other countries differ, have been evaluated with other tools and refer to different populations, we simply note that findings such as ours are not uncommon. For instance, the mean satisfaction in this study was 74.63, whereas in a US study a mean of 74.1 was reported [22].

This study has certain limitations related both to the measurement of satisfaction and the validation of the questionnaire. Since the provision of home care programs in Greece is decentralized and information on the characteristics of the population of enrollees is not gathered by the central government, we were unable to investigate whether our sample was representative. The sample was in fact geographically restricted to the city of Thessaloniki. Moreover, there were no other studies in the Greek setting with which we could compare our findings. The summated scales "service planning" and "overall satisfaction" had low reliability values and "service appropriateness" a marginally acceptable Cronbach's alpha coefficient. The fact that these were all two-item scales might partly account for that. Nevertheless, we note that scales comprising of only two questions have often been found highly reliable in the Greek setting [4]. Finally, the measurement of satisfaction has been criticized for its weak conceptual foundation and potential biases due to acquiescent response set [61, 62].

Conclusions

Summing up, exploratory ordinal and traditional factor analyses alongside reliability and validity tests revealed three reliable and valid multi-item scales: socioeconomic change, staff skills and attitudes and appropriateness of services. A fourth dimension -service planning- had lower internal consistency reliability. Overall, enrollees were satisfied with the home care program. Future research should further validate the questionnaire with the use of confirmatory factor analysis and larger samples from other home care programs. Moreover, the role of service planning in the determination of home care satisfaction should be further assessed.

References

  1. Muenz R: Aging and demographic change in European Societies: main trends and alternative policy options. Social Protection Discussion Paper No. 0703. 2007, The World Bank

    Google Scholar 

  2. World Health Organization: Home Care in Europe: The Solid Facts. 2008, Bocconi University, Milan

    Google Scholar 

  3. Merkouris A, Yfantopoulos J, Lanara V, Lemonidou C: Developing an instrument to measure patient satisfaction with nursing care in Greece. J Nurs Manag. 1999, 7: 91-100. 10.1046/j.1365-2834.1999.00104.x.

    Article  CAS  PubMed  Google Scholar 

  4. Aletras VH, Papadopoulos EA, Niakas DA: Development and preliminary validation of a Greek-language outpatient satisfaction questionnaire with principal components and multi-trait analyses. BMC Health Serv Res. 2006, 6: 66-10.1186/1472-6963-6-66.

    Article  PubMed  PubMed Central  Google Scholar 

  5. Ministry of Economy & Finance and Ministry of Health & Welfare: Implementation of a Pilot Home Care Program in the Municipality of Peristeri. 1996, Common Ministerial Decree No.4514/12-8-96, Athens;. [In Greek]

    Google Scholar 

  6. Ministry of the Interior Public Administration and Decentralisation Ministry of Employment & Social Protection and Ministry of Health & Welfare: Project Management System - Implementation Process for the Action "Home Care and Day Care Centers for the Elderly", co-Financed by the European Social Fund in the Context of Regional Planning of the 3rd Community Support Framework. 2001, Common Ministerial Decree No.4035/30-8-01, Athens [In Greek]

    Google Scholar 

  7. Ministry of Employment & Social Protection: National Action Plan on Social Inclusion. 2005, Athens; 2005. [In Greek]

    Google Scholar 

  8. Ministry of Health and Social Solidarity: Description of the "Home Care" Action in the Context of Regional Planning of the 3rd Community Support Framework. 2001, Project Management Team for the initiation and management of programs related to the family child, elderly disabled and vulnerable groups, [In Greek]

    Google Scholar 

  9. Krowinski WJ, Steiber SR: Measuring and Managing Patient Satisfaction. 1996, Chicago: American Hospital Publishing, 2

    Google Scholar 

  10. Wilson A, Hewitt G, Matthews R, Richards S, Shepperd S: Hospital at home: assessing patients' and carers' views. Report to the NHS Executive. 2004, University of Leicester Department of Health Sciences

    Google Scholar 

  11. Laferriere R: Client satisfaction with home health care nursing. J Community Health Nurs. 1993, 10: 67-76. 10.1207/s15327655jchn1002_1.

    Article  CAS  PubMed  Google Scholar 

  12. Dansky KH, Brannon D, Wangsness S: Human resources management practices and patient satisfaction in home health care. Home Health Care Serv Q. 1994, 15: 43-56. 10.1300/J027v15n01_04.

    Article  CAS  PubMed  Google Scholar 

  13. Reeder PJ, Chen S-PC: Determining client satisfaction with home health care. Home Health Care Manag Pract. 1994, 6: 8-16. 10.1177/108482239400600406.

    Article  Google Scholar 

  14. Edebalk PG, Samuelsson G, Ingvad B: How elderly people rank-order the quality characteristics of home services. Ageing Soc. 1995, 15: 83-102. 10.1017/S0144686X00002130.

    Article  Google Scholar 

  15. Westra BL, Cullen L, Brody D, Jump P, Geanon L, Milad E: Development of the Home Care Client Satisfaction Instrument. Public Health Nurs. 1995, 12: 393-399. 10.1111/j.1525-1446.1995.tb00168.x.

    Article  CAS  PubMed  Google Scholar 

  16. Forbes DA: Clarification of the constructs of satisfaction and dissatisfaction with home care. Public Health Nurs. 1996, 13: 377-385. 10.1111/j.1525-1446.1996.tb00265.x.

    Article  CAS  PubMed  Google Scholar 

  17. Woodruff L, Applebaum R: Assuring the quality of in-home supportive services: a consumer perspective. J Aging Stud. 1996, 10: 157-169. 10.1016/S0890-4065(96)90011-0.

    Article  Google Scholar 

  18. Capitman J, Abrahams R, Ritter G: Measuring the adequacy of home care for frail elders. Gerontologist. 1997, 37: 303-313.

    Article  CAS  PubMed  Google Scholar 

  19. Geron SM: Assessing the satisfaction of older adults with long-term care services: measurement and design challenges for social work. Res Soc Work Pract. 1998, 8: 103-119. 10.1177/104973159800800108.

    Article  Google Scholar 

  20. Bear M, Sauer M, Norton A: Client satisfaction with service coordinators' provision of home-based long-term care services. Home Health Care Serv Q. 1999, 18: 47-60. 10.1300/J027v18n01_03.

    Article  CAS  PubMed  Google Scholar 

  21. Long CO: Patient satisfaction in home healthcare: what are the essentials?. Home Healthc Nurse Manag. 1999, 3: 9-13.

    CAS  PubMed  Google Scholar 

  22. Geron SM, Smith K, Tennstedt S, Jette A, Chassler D, Kasten L: The home care satisfaction measure: a client - centred approach to assessing the satisfaction of frail older adults with home care services. J Gerontol. 2000, 55B: S259-S270.

    Article  Google Scholar 

  23. Mylod DE, Kaldenberg DO: Data mining techniques for patient satisfaction data in home care settings. Home Health Care Manag Pract. 2000, 12: 18-29. 10.1177/108482230001200607.

    Article  Google Scholar 

  24. Samuelsson G, Wister A: Client expectations and satisfaction of quality in home care services: a consumer perspective. Home Care Provid. 2000, 5: 223-230. 10.1067/mhc.2000.111864.

    Article  CAS  PubMed  Google Scholar 

  25. Barrett VW, Gurland BJ: A method for advancing quality of life in home care. Home Health Care Manag Pract. 2001, 13: 312-321. 10.1177/108482230101300415.

    Article  Google Scholar 

  26. Francis J, Netten A: Raising the quality of home care: a study of service users' views. Soc Policy Adm. 2004, 38: 290-305. 10.1111/j.1467-9515.2004.00391.x.

    Article  Google Scholar 

  27. Netten A, Francis J, Jones K, Bebbington A: Performance and quality: user experiences of home care services. Discussion Paper 2104/3. 2004, Personal Social Services Research Unit University of Kent. Canterbury

    Google Scholar 

  28. Porter EJ: Sources of systematic error in instruments measuring satisfaction with home care. Home Health Care Serv Q. 2004, 23: 19-39. 10.1300/J027v23n03_02.

    Article  PubMed  Google Scholar 

  29. Woodward CA, Abelson J, Tedford S, Hutchison B: What is important to continuity in home care? Perspectives of key stakeholders. Soc Sci Med. 2004, 58: 177-192. 10.1016/S0277-9536(03)00161-8.

    Article  PubMed  Google Scholar 

  30. Willis G: Cognitive Interviewing: A Tool for Improving Questionnaire Design. 2004, Thousand Oaks: Sage Publications

    Google Scholar 

  31. Fiebelkorn SL: Retail Service Encounter: Model and Measurement. The Service Encounter: Managing Employee/Customer Interaction in Service Businesses. Edited by: Czepiel JA, Solomon MR, Surprenant CF. 1985, Lexington MA: Lexington Books, 181-194.

    Google Scholar 

  32. Raftopoulos V, Theodosopoulou T: Scale validation methodology. Archives of Hellenic Medicine. 2002, 19: 577-589. [In Greek]

    Google Scholar 

  33. Kline P: An Easy Guide to Factor Analysis. 1994, London: Routledge

    Google Scholar 

  34. Pett MA, Lackey NR, Sullivan JJ: Making Sense of Factor Analysis: The Use of Factor Analysis for Instrument Development in Health Care Research. 2003, Thousand Oaks: Sage Publications

    Chapter  Google Scholar 

  35. Costello AB, Osborne JW: Best practices in exploratory factor analysis: four recommendations for getting the most from your analysis. Practical Assessment, Research & Evaluation. 2005, 10: 1-9.

    Google Scholar 

  36. Birhanu Z, Assefa T, Woldie M, Morankar S: Determinants of satisfaction with health care provider interactions at health centres in central Ethiopia: a cross sectional study. BMC Health Serv Res. 2010, 10: 78-10.1186/1472-6963-10-78.

    Article  PubMed  PubMed Central  Google Scholar 

  37. Labarere J, Francois P, Bertrand D, Peyrin JC, Robert C, Fourny M: Outpatient satisfaction: validation of a French-language questionnaire: data quality and identification of associated factors. Clin Perform Qual Health Care. 1999, 7: 63-69.

    CAS  PubMed  Google Scholar 

  38. Westaway M, Rheeder P, van Zyl D, Seager J: Interpersonal and organizational dimensions of patient satisfaction: the moderating effects of health status. Int J Qual Health. 2003, 15: 337-344. 10.1093/intqhc/mzg042.

    Article  Google Scholar 

  39. Holgado FP, Carrasco MA, del Barrio MV, Moscoso S: Factor analysis of the Big Five Questionnaire using polychoric correlations in children. Qual Quant. 2009, 43: 75-85. 10.1007/s11135-007-9085-3.

    Article  Google Scholar 

  40. Roscino A, Pollice A: A generalization of the polychoric correlation coefficient. Data analysis classification and the forward search: proceedings of the meeting of the classification and data analysis group (CLADAG) of the Italian Statistical Society. Edited by: Zani S, Cerioli A, Riani M, Vichi M. 2005, Berlin: Springer, 135-142.

    Google Scholar 

  41. Jöreskog KG: New developments in LISREL: analysis of ordinal variables using polychoric correlations and weighted least squares. Qual Quant. 1990, 24: 387-404. 10.1007/BF00152012.

    Article  Google Scholar 

  42. Jöreskog KG, Sorbom D: PRELIS 2: User's reference guide. 1996, Chicago: SSI

    Google Scholar 

  43. Fabrigar LR, Wegener DT, MacCallum RC, Strahan EJ: Evaluating the use of exploratory factor analysis in psychological research. Psychol Methods. 1999, 4: 272-299. 10.1037/1082-989X.4.3.272.

    Article  Google Scholar 

  44. Wouters E, Heunis C, van Rensburg D, Meulemans H: Patient satisfaction with antiretroviral services at primary health-care facilities in the Free State South Africa - a two year study using four waves of cross-sectional data. BMC Health Serv Res. 2008, 8: 210-10.1186/1472-6963-8-210.

    Article  PubMed  PubMed Central  Google Scholar 

  45. Cronbach LJ: Coefficient alpha and the internal structure of tests. Psychometrika. 1951, 16: 297-334. 10.1007/BF02310555.

    Article  Google Scholar 

  46. Nunnally JC, Bernstein ICH: Psychometric Theory. 1994, New York: McGraw-Hill, 3

    Google Scholar 

  47. Zumbo BD, Gadermann AM, Zeisser C: Ordinal versions of coefficients alpha and theta for Likert rating scales. J Mod Appl Stat Methods. 2007, 6: 21-29.

    Google Scholar 

  48. Norris AE, Aroian KJ: To transform or not transform skewed data for psychometric analysis: that is the question!. Nurs Res. 2004, 53: 67-71. 10.1097/00006199-200401000-00011.

    Article  PubMed  Google Scholar 

  49. Ferketich S: Focus on psychometrics: aspects of item analysis. Res Nurs Health. 1991, 14: 165-168. 10.1002/nur.4770140211.

    Article  CAS  PubMed  Google Scholar 

  50. McGraw KO, Wong SP: Forming inferences about some intraclass correlation coefficients. Psychol Methods. 1996, 1: 30-46. 10.1037/1082-989X.1.1.30.

    Article  Google Scholar 

  51. Yen M, Lo LH: Examining test - retest reliability: an intraclass correlation approach. Nursing Res. 2002, 51: 59-62. 10.1097/00006199-200201000-00009.

    Article  Google Scholar 

  52. Streiner DL, Norman GR: Health Measurement Scales: A Practical Guide to their Development and Use. 2003, New York: Oxford University Press

    Google Scholar 

  53. Nedjat S, Montazeri A, Holakouie K, Mohammad K, Majdzadeh R: Psychometric properties of the Iranian interview-administered version of the World Health Organization's Quality of Life Questionnaire (WHOQOL-BREF): a population-based study. BMC Health Serv Res. 2008, 8: 61-10.1186/1472-6963-8-61.

    Article  PubMed  PubMed Central  Google Scholar 

  54. Ware JE, Gandek B: Methods for testing data quality scaling assumptions and reliability the IQOLA project approach. J Clin Epidemiol. 1998, 51: 945-952. 10.1016/S0895-4356(98)00085-7.

    Article  PubMed  Google Scholar 

  55. Bjorner JB, Damsgaard MT, Watt T, Groenvold M: Tests of data quality scaling assumptions and reliability of the Danish SF-36. J Clin Epidemiol. 1998, 51: 1001-1011. 10.1016/S0895-4356(98)00092-4.

    Article  CAS  PubMed  Google Scholar 

  56. Steiger JH: Tests for comparing elements of a correlation matrix. Psychol Bull. 1980, 87: 245-251. 10.1037/0033-2909.87.2.245.

    Article  Google Scholar 

  57. Jayasekara H, Rajapaksa L, Bredart A: Psychometric evaluation of the European Organization for Research and Treatment of Cancer in-patient satisfaction with care questionnaire ("Sinhala" version) for use in a South-Asian setting. Int J Qual Health Care. 2008, 20: 221-226. 10.1093/intqhc/mzn006.

    Article  PubMed  Google Scholar 

  58. Labarere J, Francois P, Auquier P, Robert C, Fourny M: Development of a French inpatient satisfaction questionnaire. Int J Qual Health Care. 2001, 13: 99-108. 10.1093/intqhc/13.2.99.

    Article  CAS  PubMed  Google Scholar 

  59. Hendriks A, Vrielink M, Van Es S, De Haes H, Smets E: Assessing inpatients' satisfaction with hospital care: should we prefer evaluation or satisfaction ratings?. Patient Educ Couns. 2004, 55: 142-146. 10.1016/j.pec.2003.11.006.

    Article  PubMed  Google Scholar 

  60. Jones K, Netten A, Francis J, Bebbington A: Using older home care user experiences in performance monitoring. Health Soc Care Community. 2007, 15: 322-332.

    Article  PubMed  Google Scholar 

  61. Scott A, Smith RD: Keeping the customer satisfied: issues in the interpretation and use of patient satisfaction surveys. Int J Qual Health Care. 1994, 6: 353-359. 10.1093/intqhc/6.4.353.

    Article  CAS  PubMed  Google Scholar 

  62. Rapkin B, Weiss E, Chhabra R, Ryniker L, Patel S, Carness J, Adsuar R, Kahalas W, Delemarter C, Feldman I, Delorenzo J, Tanner E: Beyond satisfaction: using the dynamics of care assessment to better understand patients' experiences in care. Health Qual Life Outcomes. 2008, 6: 20-10.1186/1477-7525-6-20.

    Article  PubMed  PubMed Central  Google Scholar 

Pre-publication history

Download references

Acknowledgements

No funding was provided for this research.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Vassilis H Aletras.

Additional information

Competing interests

The authors declare that they have no competing interests.

Authors' contributions

VHA conceived and designed the study, helped to finalize the tool, carried out data analysis and interpretation, and drafted the manuscript. AK and MT reviewed the literature, drafted the questionnaire and carried out the study administration. DN designed and supervised the study. AN contributed to all the statistical analyses. All authors read and approved the final manuscript.

Electronic supplementary material

12913_2010_1326_MOESM1_ESM.PDF

Additional file 1: Home Care Satisfaction Questionnaire. A questionnaire in Greek that measures satisfaction with home care services. (PDF 262 KB)

Rights and permissions

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and permissions

About this article

Cite this article

Aletras, V.H., Kostarelis, A., Tsitouridou, M. et al. Development and preliminary validation of a questionnaire to measure satisfaction with home care in Greece: an exploratory factor analysis of polychoric correlations. BMC Health Serv Res 10, 189 (2010). https://doi.org/10.1186/1472-6963-10-189

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/1472-6963-10-189

Keywords