- Research article
- Open access
- Published:
Is the Job Satisfaction Survey a good tool to measure job satisfaction amongst health workers in Nepal? Results of a validation analysis
BMC Health Services Research volume 16, Article number: 308 (2016)
Abstract
Background
Job satisfaction is an important predictor of an individual’s intention to leave the workplace. It is increasingly being used to consider the retention of health workers in low-income countries. However, the determinants of job satisfaction vary in different contexts, and it is important to use measurement methods that are contextually appropriate. We identified a measurement tool developed by Paul Spector, and used mixed methods to assess its validity and reliability in measuring job satisfaction among maternal and newborn health workers (MNHWs) in government facilities in rural Nepal.
Methods
We administered the tool to 137 MNHWs and collected qualitative data from 78 MNHWs, and district and central level stakeholders to explore definitions of job satisfaction and factors that affected it. We calculated a job satisfaction index for all MNHWs using quantitative data and tested for validity, reliability and sensitivity. We conducted qualitative content analysis and compared the job satisfaction indices with qualitative data.
Results
Results from the internal consistency tests offer encouraging evidence of the validity, reliability and sensitivity of the tool. Overall, the job satisfaction indices reflected the qualitative data. The tool was able to distinguish levels of job satisfaction among MNHWs. However, the work environment and promotion dimensions of the tool did not adequately reflect local conditions. Further, community fit was found to impact job satisfaction but was not captured by the tool. The relatively high incidence of missing responses may suggest that responding to some statements was perceived as risky.
Conclusion
Our findings indicate that the adapted job satisfaction survey was able to measure job satisfaction in Nepal. However, it did not include key contextual factors affecting job satisfaction of MNHWs, and as such may have been less sensitive than a more inclusive measure. The findings suggest that this tool can be used in similar settings and populations, with the addition of statements reflecting the nature of the work environment and structure of the local health system. Qualitative data on job satisfaction should be collected before using the tool in a new context, to highlight any locally relevant dimensions of job satisfaction not already captured in the standard survey.
Background
The insufficiency of the health workforce is a significant challenge to effective health service provision in most low- and middle-income countries [1]. This insufficiency is commonly related to the number of health workers, the quality of available staff or the distribution of the workforce within a system [1]. Health workers are often concentrated in urban areas and in private practice. However, retention in rural areas and in the public sector is challenged by a range of well-described push and pull factors [2]. Interventions that aim at improving retention of health workers need to be developed, implemented and rigorously evaluated. Job satisfaction among health workers is a good predictor of staff retention [3] and therefore, often used to measure the impact of interventions [4, 5]. Job satisfaction also affects productivity among retained workers [6, 7], and therefore, could be used to measure the impact of vacant posts and absenteeism in rural areas [8].
Several job satisfaction measurement tools have been developed for use in high-income countries [9–12]. These commonly measure an individual’s satisfaction with different aspects of their job, as well as overall job satisfaction [13]. However, they have not been validated for use in low- income countries, where the value of work, interactions between religion and class, and social organisations may be substantially different from those in high- and middle- income settings [1].
One of the most widely used definitions of job satisfaction is “a pleasurable or positive emotional state resulting from the appraisal of one's job or job experiences” [14]. An individual’s satisfaction is derived from a process of comparing an aspect of the current job with a frame of reference [11]. Satisfaction is derived in three possible ways: from differences between what the job offers and what the individual expects; from the degree to which a job fulfills individual needs; and from the degree to which individual values are fulfilled [14]. Some of the factors affecting job satisfaction among health workers are salaries, working conditions, scope for promotion, supervision structures, and the division of work [1, 15–17]). Additionally, the health work force has been facing rising levels of stress due to an increasing disease burden and work force shortage [16]. These factors have a synergistic impact on job satisfaction.
The job satisfaction survey (JSS) was developed by Paul Spector to measure job satisfaction in organisations in human service, public and non-profit sectors [18]. The JSS measures nine dimensions of satisfaction, chosen after reviewing the literature. These dimensions are; pay, promotion, supervision, benefits, contingent rewards, operating procedures, co-workers, nature of work and communication [18]. The JSS asks respondents the extent to which they agree with 36 statements within these nine dimensions [19]. The JSS has been used to measure employee job satisfaction in several high- and middle-income countries including the USA, Singapore, Turkey, Pakistan, Taiwan and Iran [18, 20–24]. As the JSS was developed to measure job satisfaction amongst public sector employees, it is potentially suitable for health service personnel working in government-run facilities. However, given that these contexts are very different from our study area in Nepal, the tool needed to be validated and have its reliability tested in the Nepali context.
Study setting
Nepal has the second lowest score on the Human Development Index (HDI) among the South Asian Association for Regional Cooperation countries at 0.458. It also has low life expectancy at 68 years. [25]. There are wide and persistent inequalities between rural and urban areas, further compounded by caste discrimination. Those belonging to lower castes (dalit) and minority ethnic groups (janajati) are poorer and have lower levels of access to political power than higher castes [25].
In Nepal, health services are provided through a hierarchy of tertiary hospitals in urban areas; zonal and district hospitals; and primary health care centres (PHCs), health posts (HPs) and sub-health posts [26]. Districts are divided over geopolitical areas of Village Development Committees (VDCs), and each VDC has a health facility. Quality and access to health services in rural areas is affected by the difficult terrain in many districts, as well as infrastructure, equipment and drug supply issues, and the availability of teams of adequately skilled and supported health workers. Nepal has 0.25 nurses and 0.042 doctors per 1000 population working in public sector health services. This is significantly below the World Health Organisation’s recommended 2.3 health workers per 1000 population. Human resource planning has not kept pace with population growth in Nepal, and there are insufficient public sector positions available in some cadres to meet the needs of the population. There are sufficient health workers being produced and trained, but insufficient posts available for them in the public sector and a glut of health workers in urban areas [27].
Nursing care in rural areas is provided by three cadres of maternal and new born health workers (MNHWs)- upgraded Maternal Child Health Workers (MCHWs), Auxiliary Nurse Midwives (ANMs) and Staff Nurses. MCHWs are local women, who have received 15 weeks training and have been providing counseling and supporting basic service provision in sub- health posts. This post has now been discontinued, and eligible MCHWs are expected to receive ANM training. Only some MCHWs have received this training, but many have been upgraded. ANMs receive an 18 month training course accredited by the Council for Technical Education and Vocational Training, and Staff Nurses study for 3 years to gain a proficiency level certificate in nursing. Sanctioned posts for Staff Nurses only exist at PHC level and above, and these positions are often vacant in rural areas. A survey in 2013 found that only 38 % of Staff Nurse posts in PHCs and 53 % of Staff Nurses posts in district hospitals were filled [28]. Promotion and performance rewards are provided according to the Health Service Act 1997, and are only available to MNHWs employed on permanent contracts. MNHWs continue to play a key role in Nepal’s efforts to increase institutional deliveries and reduce maternal mortality [28–30].
While maternal health indicators have been improving in Nepal, the maternal mortality ratio remains high at 281 per 100,000 live births, and the neonatal mortality rate at 33 per 100 live births [31]. Most women deliver at home [32]. The Government of Nepal has put forward long- and short-term strategies to increase access to maternal health care in rural areas. It is implementing a Skilled Birth Attendant training course to improve the ability of MNHWs to provide safe delivery care in rural areas, encouraging rural health facilities to become birthing centres and provide 24-h delivery services [33]. This encouragement to provide delivery services has not been accompanied by an increase in the number of government posts for MNHWs in birthing centres to provide maternity services. The government is also promoting recruitment of MNHWs on short-term contracts at remote health facilities that are either upgrading to birthing centres, experiencing significant absenteeism among current staff, or have a high number of unfilled posts [34]. The main types of short-term contract MNHWs are those recruited by the district health office (DHO MNHWs) through allocated budgets, and those recruited by the local health facility management committee (HFMC MNHWs) through VDC and health facility funds. Little is known about the effect of this contracting on MNHWs, health systems performance and care provision [35] but there are indications that contracting is improving recruitment and retention of ANMs at the PHC level, where it was reported that 70 % and 75 % of ANM sanctioned posts were filled in PHCs and HPs [28].
This paper reports the findings of a mixed methods study to explore the effect of contracting on MNHWs in western Nepal [36]. The study used a convergent study design, with qualitative and quantitative data collected at the same time point [37]. The aim of the study was to validate established tools for the measurement of job satisfaction and motivation. In this paper, we focus only on validating the survey-tool to measure job satisfaction. It complements another study by Morrison et al. [38] that reports on the validation of a survey-tool to measure motivation in this context.
This paper first describes the sampling process and data collection. We then describe the methods used to validate the tool, and we present our results. Finally, we discuss the findings and recommendations for the use of the JSS to measure job satisfaction among government-employed, facility-based MNHWs in a context such as Nepal.
Methods
Sampling and data collection
Our sampling was driven by practical and theoretical concerns. We used a case study design, with the health facility as the case, and sought to compare health facilities and districts with more and less contract MNHWs. Therefore we used data from the Family Health Division of the Department of Health Services to sample two districts with high numbers of contract MNHWs, and one with low numbers of contract MNHWs. We only sampled districts in western Nepal so that we could compare MNHWs on different types of contracts, and compare health facilities in a relatively similar geopolitical environment. One district with high levels of contracting was a remote hill district (Dailekh) with an HDI score of 0.422. The other two districts (Banke and Kailali) were in the plains. Banke has an HDI of 0.475, and Kailali an HDI of 0.467 [39].
We attempted to collect data from all MNHWs present at the time of interview in participating PHCs and HPs that had been providing delivery services for at least 1 year. These facilities have sanctioned posts for ANMs and Staff Nurses. We also sampled sub- HPs that had ANMs or Staff Nurses and had been providing delivery services for at least a year. Across all three districts we collected data in 13 sub-HPs, 29 HPs, 10 PHCs, three District Hospitals and one Zonal Hospital. District and central level stakeholders (12) involved with nursing policy were also purposively sampled. The distribution of sampled institutions across the three districts is summarized in Table 1.
Data was collected at the health facility in a private room with only the researcher and respondent present. We collected data during the monsoon season and had to adapt our data collection plans because of limited access to some facilities. This has resulted in an imbalance in the sample across the three districts, an acknowledged limitation of the study design.
Qualitative data collection and management
In Dailekh and Banke districts, semi-structured one-off interviews were conducted with with 78 MNHWs. One ANM in the Zonal hospital in Banke refused to participate because she felt tired of giving interviews to researchers. We asked open-ended questions about what they liked/disliked about their job, what made it easy or difficult to work in that facility, and what would affect their intention to stay or leave. We probed for specific aspects of job satisfaction based on the literature including; community support and utilisation, access to training and leave, colleagues and supervision/management [16, 40]. We also conducted 25 interviews with the health facility in-charges’, 31 focus group discussion (FGDs) with local women and 30 FGDs with the HFMC. One in-charge refused to participate, citing time constraints.. In addition, in each district, semi-structured interviews with the Public Health Nurse (PHN) and the District Health Officer (DO) were also conducted. The objectives of these interviews were two-fold: one, to gain their impressions of how satisfied the MNHWs were; and two, to understand the factors that may affect job satisfaction and retention of MNHWs. The duration of FGDs and interviews was usually between one and two hours.
Two female Nepalese researchers (RT and RB) who were trained and experienced in qualitative techniques were employed to translate the survey from English into Nepali and conduct the pilots. They also collected, entered and translated the qualitative data in the respondents’ home language. Most of the interviews were conducted in Nepali, using Hindi when necessary. In Banke, one interview with the chairperson of the HFMC at a PHC was conducted in Abadhi with a nurse translating to Nepali. Two FGDs with women at PHCs were also conducted in a combination of Abadhi and Hindi and were translated by Female Community Health Volunteers (FCHVs).
Data were digitally recorded, and two additional researchers translated data verbatim into English. Full transcripts were completed for 107 interviews and 46 FGDs. Data from the remaining 15 FGDs and 8 interviews were extracted directly from the audio recordings. Field notes on context and data collection process were also taken and added to the transcripts. Participants did not provide feedback on the findings.
To check the quality of translation, a researcher back-translated three pages of four randomly selected interviews into Nepali and compared these with the recordings. There were few discrepancies. JM observed a sample of quantitative and qualitative data collection in every district (22 MNHWs, 1 PHN, 2 DHO, 3 in-charge, 2 women’s groups, 3 HFMCs). Verbal and written informed consent was obtained from all participants, and the study was granted ethical approval from the Nepal Health Research Council.
Tool development, quantitative data collection and management
The JSS statements were organised into the following dimensions: Pay/Benefits, Co-workers and Supervisors, Promotion, Work environment and General Job Satisfaction. The JSS was translated and tested on two colleagues not connected with the study, before piloting it on two MNHWs in a nearby health post. One statement “There are few rewards for those who work here” was changed to “there are no rewards for those who work here” as researchers felt their was little difference in these statements in Nepali and the adapted statement was easier to express in Nepali. No other changes were made to the tool.
The adapted JSS was administered in Nepali to 137 MNHWs in three districts as part of a larger survey that also collected demographic data, employment history and motivation [41]. Data were collected on paper forms and entered into SPSS v20. There were a number of missing responses to the items on the JSS (8 %). Dropping records for those MNHWs with at least one missing response would have significantly reduced the sample to 64 % in a non-random manner, resulting in biased findings. Missing values were therefore imputed using regression modelling [42–44]. All quantitative data were analysed using STATA version 13.
Validation methodology
Several complementary methods may be used to validate a survey instrument administered in a context different from the one for which it was intended [45]. The Trinitarian ideology advocates the three Cs:
-
1.
Content validity: the extent to which the measure includes the most relevant and important aspects of a concept in the context of a given application;
-
2.
Construct validity: the degree to which scores on a measure relate to other measures, in a manner consistent with theoretically derived a-priori hypotheses about the concepts being measured; and
-
3.
Criterion validity: the degree to which the scores of a measure adequately reflect a gold standard.
In this study, we test for content and construct validity. As there is no gold standard for measuring job satisfaction, we do not test for criterion validity. Finally, we also test for reliability and sensitivity as described below.
JM coded the qualitative data from all participants according to the dimensions in the adapted JSS tool, and any additional dimensions that emerged from the data. To consider construct validity and internal consistency, we selected a sub-sample of the qualitative interviews, stratified by whether the respondent appeared to be satisfied or unsatisfied. This sub-sample was selected to saturation, which was achieved within ten qualitative interviews from MNHWs who appeared satisfied with their jobs, and five qualitative interviews with MNHWs who appeared dissatisfied. Finally, job satisfaction scores were compared with the qualitative data to check the reliability of the tool.
The adapted JSS comprises five dimensions of five to nine items each. Respondents were asked whether they strongly agreed, agreed, disagreed or strongly disagreed with each item. The responses were coded to assign a higher value to those who said that they were more satisfied with their jobs and a lower value to those less satisfied. After the missing responses were imputed, a job satisfaction index (JSI) was calculated for each respondent, using principal component analysis.
The first test for content validity was conducted by calculating the degree to which the items in each of the dimensions of the JSS were related to each other. If two items in the same dimension are highly correlated, then one will add little additional information about individual motivation. However, if the items are uncorrelated, they measure different traits or dimensions of motivation. Correlation was measured using the Spearman’s rank correlation coefficient for all items in each dimension. Finally, we explored the missing response patterns to understand the degree of acceptability of questions.
We quantitatively measured the reliability of the JSI by calculating the Cronbach’s alpha (α) coefficient of internal consistency [46, 47]. Cronbach’s alpha assesses the degree to which a set of items measures a single latent dimension. The α values for the JSI and each of its components were calculated and compared against acceptability thresholds [48–51]. We also calculate the theta (θ) coefficient that was developed as a special case of Cronbach’s alpha to specifically account for multidimensionality in an item set [52].
We conducted exploratory descriptive analysis of the data to test for construct validity and sensitivity. Using the JSI, we were able to distinguish between MNHWs who were satisfied with their job and those who were not. We categorised those MNHWs with a JSI less than the median JSI as dissatisfied and those with a JSI higher than the median as satisfied. In addition, we created quartiles of the JSI to distinguish between different degrees of job satisfaction. We then tabulated the average JSI by socio-demographic characteristics of the MNHWs to see how this average score varied, for example, between different MNHWs who belonged to different age groups, ethnicities or salary groups. Table 2 presents an overview of the analytical approaches and data used for establishing the validity of the JSS in Nepal.
Results
Qualitative validation: definitions and concepts of job satisfaction in Nepal
This section uses the qualitative data to describe how Nepali MNHWs define job satisfaction, and thus considers the content and construct validity of the JSS.
The initial pilots revealed that participants had difficulty understanding and responding to negatively phrased items. Researchers were therefore trained to probe after asking negatively phrased questions to check participant understanding and if necessary, to ask the question again.
Content validity
Pay and benefits
Many MNHWs commented on their pay and benefits: “My dissatisfaction is about the money. It is too little to pay for the education of our children. The salary is not enough even to pay for small things.” (ANM) 1022) “There is not an adequate return compared to the services we provide in this job, so I think am satisfied, but not fully.” (ANM 1040) Some MNHWs also complained about their salary not coming on time, causing dissatisfaction: “the negative part is that we should work 24 h a day and there is a delay in being paid” (ANM 1005).
Incentives and work-related benefits also affects satisfaction. Incentives included access to training, leave, incentives for overnight working and conducting deliveries, food allowances, health insurance, scholarships for children, hazard allowances, staff quarters and help with furnishings, work uniform allowances, and investment into their provident fund, and pension. One ANM told us how satisfied she was with work-related benefits: “As we get delivery cases quite often, we receive incentives frequently and that is one advantage. Since I am staying in the staff quarters here, I don’t have to pay rent. There is electricity too.” (ANM 1009).
Co-workers and supervision
Relationships with co-workers and supervisors greatly affected job satisfaction. One Senior ANM explained: “There are many close friends of mine here…When there are misunderstandings between staff and talking behind people’s backs, then people do not like to work in a place.” (Senior ANM 2007). Co-workers and supervision also affected satisfaction through links with leave, training, and shift work: “We co-ordinate. She comes in the morning and I come in the evening, it’s easy as there is no fixed schedule, it’s flexible so it’s easier.” (ANM 2014).
Absenteeism, unfilled posts, and staff shortages affects how MNHWs feel about their jobs: “there is a lack of manpower as there are not many staff here. One person has to do everything. For example if one person was looking after family planning and one was looking after antenatal care then the patients would get quality services. Also, when I come to work through the night, the following days’ work is affected” (Staff Nurse 2030).
Another satisfying aspect of the job for younger MNHWs was the opportunity to learn from colleagues: “the other ANM sister is also very supportive. She often teaches me.” (ANM 2013) Inadequate monitoring and evaluation however, was a source of dissatisfaction: “the district should supervise according to our work. If the work is good then there should be provision of something or they should praise the staff or the facility…there has been no proper evaluation.” (Senior ANM 2012).
Promotion and training
Many MNHWs in our study felt they had no chance for promotion because of their short-term contracts. For their career to progress they needed to study further, or apply for a permanent government job: “I don’t see any future working as temporary staff in this institution, I have to upgrade my qualifications” (ANM 1021). Relatively few permanent MNHWs discussed promotion opportunities or the lack thereof.
Training was linked to promotion, with many MNHWs interested in further training. One ANM explained: “If I had got the chance to study I could have upgraded to Senior ANM, and would have been able to provide better quality services. If I was able to go to the district hospital it would be less remote and I would also get the chance to learn under the supervision of doctors.” (ANM 1018) Many MNHWs said that increased access to training would affect their job satisfaction: “if we got training about things we don’t know, that would affect our job satisfaction.” (ANM 1037).
Work environment
Insufficient equipment or inadequate infrastructure appears to negatively affect satisfaction: “If there were proper arrangements for delivery like if they increased the equipment, and beds. And if there were proper walls constructed, and water was made available then it is possible for me to keep working here.” (ANM 2022) MNHWs were dissatisfied by a lack of management support for equipment supply: “They don’t send the delivery sets that we order. It is difficult to manage many patients in a single bed.” (ANM 2011).
MNHWs who had received skilled birth attendant training particularly noted the lack of equipment, which meant they were unable to manage complications: “It’s a good place to work if there was equipment, in some things we haven’t been able to apply our skills even though we have received training. I had training 4 years ago, and the vacuum set was made available just the day before yesterday. Now I have forgotten everything. So its very difficult” (Senior ANM 1033).
Community support and job security
Community support and appreciation affect satisfaction: “the people who deliver here make me feel good because of their good nature…I enjoy it a lot when people here support me and agree with my thoughts.” (ANM 1036). MNHWs also felt good about communities using available services and being aware of what is good for their health: “…they have started taking iron tablets and coming for checkups. Now, women directly come here if they have any health problem or difficulties, and that make me feel happy.” (ANM 1038).
Job security also affects satisfaction. Permanent MNHWs complained about the possibility of being transferred: “Its difficult to leave this place and go somewhere else and work. You have to arrange the environment (build community support) all over again.” (ANM 2036). Some contract MNHWs were unsure if their contract would be renewed: “We are always frightened about our job security… temporary staff are always scared they may lose their job.” (ANM 1006).
Contextual ‘non-work’ factors
The wider literature, and our own research, suggest that work and non-work factors interact to affect satisfaction. Our data show the importance of ‘community fit’, living environment (including access to fresh foods, and good housing), and family support. ‘Community fit’ refers to many aspects of belonging in a community such as a relative who can support them and provide a community connection: “I am local to this place. I know everybody. I have so many friends and relatives in the community, so I never feel insecure. This would be a problem if I worked in other places”. (upgraded Maternal Child Health Worker (MCHW) 1019) Being of the same ethnicity, religion or language group as community members also contributed to job satisfaction in the workplace: “I have my own ethnic community here. I know that other staff can’t make them understand to the extent that I can. (Patients) cannot open up and talk to others like they can talk to me. They talk about all their problems and difficulties with me.” (Upgraded MCHW 2020).
Some MNHWs also mentioned road access and access to referral centres as factors affecting confidence to conduct deliveries “We are not able to provide the services that we wanted to…It’s difficult here. We might have a serious bleeding case here but we don’t have any transportation” (ANM 2011). Sleeping quarters when doing night duties, personal security and distance to home also affected satisfaction: “I feel secure because my home is not so far from here but for nurses who are not from here, they should be provided with separate rooms.” (Upgraded MCHW 1013). A supportive family environment enabled MNHWs to work the long hours required of them: “its difficult to stay here alone…. When a delivery case comes sometimes I don’t even have time to cook for my son…sometimes I have to deal with the delivery case with an empty stomach for 24 h.” (ANM 1040).
This analysis suggests that the dimensions of the JSS tool concur with the main factors affecting job satisfaction, but that some adaption would improve several dimensions. Statements on equipment, infrastructure and facilities should replace statements about administration. Statements about access to training should replace statements about promotion, along with statements about job security. Finally, statements are needed that capture how MNHWs feel working with the local community.
Construct validity
To examine construct validity, we compared the qualitative interview data of 5 dissatisfied MNHWs and 10 satisfied MNHWs with their job satisfaction scores. Self-scoring and qualitative interviews were consistent in 11 out of 15 cases, and selected examples are in Table 3. Four MNHWs appeared satisfied in their qualitative interview, yet had low JSI values. They belonged to the Senior ANM and Staff Nurse cadres (Table 4). These MNHWs were quite dissatisfied with some aspects of their job: for example MNHW 2007 complained about the low salary, lack of equipment, electricity and water, and the lack of appraisal of her work. But she enjoyed working with her colleagues, and was content to live in a community where she was familiar with the culture and had family connections, and she had access to public transport. MNHWs whose scores were inconsistent with qualitative interviews tended to place more emphasis on the positive aspects of their environment, of which few are captured by the JSS. Because JSI values and qualitative data were usually consistent, we can say that the tool has an acceptable level of construct validity, but would be further strengthened by adding a social environmental dimension.
Quantitative validation: validity, reliability and internal consistency
This section uses survey data and accepted statistical tests described earlier, to measure the content validity, construct validity and internal consistency of the survey.
As shown in Table 5, more MNHWs were from Kailali district (43 %) and most were aged 20–29 years (44 %). Over two-thirds belonged to an upper caste group, while approximately 25 % belonged to Dalit or disadvantaged groups. MNHWs worked in a variety of posts, with most being ANMs (65 %). More MNHWs worked in health posts (47 %) and few in district or zonal hospitals (9.5 % each). Over half of the sampled MNHWs had worked in their current health facility for more than 2 years (54 %) and only 9 % had worked in their current post for less than one month. Over half of respondents (53 %) earned between 10,000 and 14,999 Nepali Rupees per month.
To evaluate content validity we calculated the inter-item correlation coefficients for each dimension. For the tool to be internally consistent, the items in the tool should be moderately correlated with each other [49, 53]. Tables 6, 7, 8, 9, and 10 present the matrixes of the correlation coefficients for the five dimensions in the JSS.
Overall, within each dimension, most items are positively and moderately correlated with each other. There are exceptions where items have low correlation coefficients or are negatively correlated. However, these low levels of correlation are not surprising given the nature of the statements. Further, these are not numerous enough to cause concern [53]. For example, in the pay and promotions dimension, the first item (I feel that I am being paid a fair amount for the work I do) and the third item (Raises are too few and far between) have a correlation coefficient of −0.03. While a negative relationship between these two items is expected, the magnitude of the coefficient is small. Perhaps this captures the feeling that few people feel that they are fairly compensated for the quantum of work that they do. In the co-workers and supervisors dimension, the fifth item (I like the people I work with) and the sixth item (I find I have to work harder at my job because of the incompetence of people I work with) have a correlation coefficient of 0.04. It is not surprising that these items are not strongly correlated, as these require the health worker to reflect on two different aspects of their interactions with their supervisors or co-workers. One may like a co-worker but need not also feel that they are competent at their job. In the work environment dimension, the first item (Many of our rules and procedures make doing a good job difficult) and the seventh item (There is too much bickering and fighting at work) have a correlation coefficient of −0.01. Again it is not surprising that these two items are not very strongly correlated. The first item captures organizational structure while the seventh item captures inter-personal relationships.
We compared responses to each item, with responses to other items in the same domain to see whether they moved in the same direction. This is true for all items in the five domains except for item PB8 in the Pay and Benefits dimension, which moved in the opposite direction. This item was dropped before constructing the JSS.
The Cronbach’s Alpha (α) coefficient of internal consistency was then used to measure the reliability of the JSI constructed from the survey data. The calculated α values for the overall JSI and for each dimension are presented in Table 11. These values are also compared to the acceptability threshold values. The tool is considered to be internally consistent if α is equal to or bigger than 0.7. Four dimensions had an α value greater than 0.65 while two dimension had α values of 0.52 and 0.42. However, the α value for the overall JSI is 0.78, which is above the 0.7 threshold value. Keeping in mind that the greater the number of items for which we calculate α, the higher the value α, these values are indicative of the internally consistency and reliability of the tool. Further, the calculated θ value was 0.82, which is higher than the overall α [52]. The results from the inter-item co-relation, comparison of responses of items within each dimension, the α and θ tests indicate that the calculated JSI is reliable and internally consistent.
The response rates for the items on the JSS were lower than those for the motivation survey administered to this sample of MNHWs [38]. Most of the MNHWs (n = 106, 77.4 %) did not respond to one or more items in the JSS. The Promotions dimension had the highest proportion of missing responses (8.8 %), followed by Work Environment (3.8 %), General (2.8 %), Co-workers and Supervisors (1.7 %). The Pay and Benefits dimension had the smallest proportion of missing responses (0.05 %). These results may indicate lower acceptability and/or comprehensibility of some of the questions on the JSS among respondents. The findings from the qualitative data show that these sections were the least relevant for MNHWs. Thus, it is unsurprising that response rates were lower for these dimensions. Many MNHWs were not eligible for promotion because they were on temporary contracts, or because they had not completed requisite years of experience, and many statements in the work environment dimension were irrelevant for MNHWs.
To assess construct validity and sensitivity, we explored variations in the JSI by socio-demographic and worker characteristics. The principal component calculates a JSI ranging between −7.37 and 8.35. The lower the JSI, the less satisfied the MNHW. The mean JSI was 9.52e-10 (SD = 2.23). The median JSI was 0.26. We also constructed quartiles of the JSI, that allowed us to distinguish between most satisfied, more satisfied, less satisfied and least satisfied MNHWs. Table 12 presents these quartiles with mean JSI for each quartile.
Examining the mean JSI by demographic characteristics (Table 5), we find that, on average, the highest JSIs were observed for MNHWs from Dailekh (1.02, SD 2.34), MNHWs, aged 18–19 years (1.41, SD 2.99), MNHWs belonging to the Dalit Terai ethnic group (1.4, SD -)Footnote 1 and the relatively advantaged Janajati group (1.4, SD 2.9). We also observed highest JSIs for upgraded MCHWs (1.44, SD 1.63), MNHWs working in a sub-health post (0.44, SD 1.82) and MNHWs who had spent less than 1 month working at their current health facility (2.52, SD 2.12). Finally, MNHWs who earned 15,000 and 19,999 Nepali rupees had the highest JSIs of (0.21,SD 2.84). These MNHWs were also found to have the highest levels of motivation [35]. One MNHW who earned more than NPR 20,000 had a JSI of 2.29. The examination of the mean JSI by different demographic and socio-economic characteristics offered evidence that the index was able to differentiate between levels of job satisfaction amongst the MNHWs (Table 5).
Discussion
In this paper we sought to establish the validity and reliability of an existing survey for the measurement of health worker satisfaction in Nepal. Qualitative and quantitative methods were used to test for construct and content validity of the tool as well as its reliability and sensitivity in the rural Nepalese context.
The qualitative validation process indicates that the dimensions of job satisfaction measured in the JSS are consistent with factors affecting job satisfaction mentioned by respondents, with one important exception: context. Community ‘fit’, is an important determinant of retention of rural health workers [54]. MNHWs’ interactions with the community, place within the community and sense of support and security, affect their ability to do their job. The importance of considering context was also illustrated when we compared qualitative data with JSS scores. We found that inconsistencies of satisfied interviews and low JSS scores were related to contextual factors not included in the standard JSS.
The findings from the qualitative data suggest that adapting the work environment dimension to the local context, and adding training and job security to the promotion and general satisfaction dimensions of the tool. In our context, red tape, or administrative barriers were not relevant for MNHWs. Another example from our context was that promotion opportunities were rare in our population. However, opportunities to participate in training sessions to improve knowledge and skills were discussed as a means for progression, and access to such opportunities positively affected MNHWs’ job satisfaction. Findings from the qualitative interviews revealed that several MNHWs felt that they were job insecure, which affected their job satisfaction. However, this was not captured in the standard JSS.
The quantitative process found that the tool was within acceptable limits in reliability and validity statistical testing, and was able to capture variation in scores between MNHWs of different socio-demographic and workplace related characteristics. There were a relatively high number of missing responses, which may indicate that some respondents found it difficult to answer some questions. It is also note worthy that MNHWs who were paid a low salary for one-two years, with no job security found it difficult to answer questions about their pay and benefits Perhaps, this was because these respondents felt that these questions may have appeared to be ‘high risk’ or ‘unacceptable’ questions to answer. These respondents had also expressed feelings of job insecurity in qualitative interviews, and this may help explain some of their reluctance to respond. Researchers may also not have adequately encouraged MNHWs to respond. To reduce the risk of this problem in future studies, we recommend that the JSS is administered by trained researchers, sensitised to the possibility that respondents will feel anxious about sharing this information and that all efforts should be made to protect respondents anonymity and privacy while responding.
We dropped one statement from our analysis from the pay and benefits section (There are benefits we do not have which we should have) because it was performing inconsistently and not moving in the same direction as other variables. Recordings of a random sample of seven MNHWs from two districts were analysed to explore the reasons for this inconsistency. We believe that when considering ‘benefits’ MNHWs in this context also referred to environmental factors such as electricity, water, and access to public transport. We recommend that researchers clarify the type of benefit meant when asking this question.
A known limitation of this paper is that we were unable to test for criterion validity of the JSS as there is no ‘gold standard’ against which to measure job satisfaction. In such a scenario it is recommended that one test for convergent validity, which measures the degree to which two measures that theoretically should be related are in fact related [45]. This was not possible within the constraints of this study but future work may consider using the Job Description Index developed by Bowling Green State University for this purpose. An additional limitation of this research is that, for logistical reasons, we only conducted the qualitative validation process with MNHWs who were present in the health facility. Those MNHWs experiencing very high levels of job dissatisfaction might have been absent from the health facility. Therefore, there might be a small risk of positive bias in the data collected. Further, some data may have been lost in translation in having FCHVs and nurses translate some of the interviews and respondents may not have felt that they were able to speak freely through these translators.
Conclusion
The global crisis in human resources for health requires that researchers develop and test interventions to increase the retention and productivity of health workers, particularly in rural areas. The intention to stay or leave employment is generally difficult to measure within the short time span of a trial, and therefore predictors of intent to leave, such as job satisfaction, are required.
We have tested the validity, reliability and sensitivity of the JSS among MNHWs in rural Nepal, using qualitative and quantitative methodologies. Our findings suggest that the JSS can be used in the Nepalese setting and possibly also in other low- and middle-income country settings. However, there is some locally relevant information that the tool is not able to capture. Thus we recommend minor adaptions to reflect local contexts. The work environment dimension of the tool should be adapted to reflect particular systemic characteristics for example lack of equipment and infrastructure. The general satisfaction dimension should also capture perceptions of job security, and the promotion section should include statements regarding training. Finally, we recommend a careful translation of the tool from English into another language, so that key terms (such as benefit in our case) are clearly defined and understood by respondents and researchers alike.
Our findings indicate that the JSS is able to measure job satisfaction in our population to some extent but omitted the key factor of context. Incorporating this missing dimension and appropriately adapting the tool would create a more comprehensive and possibly more sensitive measurement tool. This would provide researchers and decision-makers, working in the public health sectors in low- and middle-income countries, with a way to measure the effect of systemic changes and policies aiming to improve health worker retention and productivity.
Abbreviations
ANM, auxiliary nurse midwife; DHO, District Health Office; DO, District Health Officer; FCHV, female community health volunteers; FGD, focus group discussion; HDI, human development index; HFMC, health facility management committee; HP, health post; JSI, job satisfaction index; JSS, job satisfaction survey; MCHW, maternal child health workers; MNHW, maternal and newborn health workers; PHC, primary health care centre; PHN, public health nurse; VDC, village development committee
Notes
Only one MNHW belonged to the Dailt Terai ethnic group; hence, no standard deviation is reported.
References
Faye A, Fournier P, Diop I, Philibert A, Morestin F, et al. Developing a tool to measure satisfaction among health professionals in sub-Saharan Africa. Hum Resources Health. 2013; doi:10.1186/1478-4491-11-30.
Lehmann U, Dielemann M, Martineau, T. Staffing remote rural areas in middle- and low-income countries: a literature review of attraction and retention. BMC Health Serv Res. 2008; doi:10.1186/1472-6963-8-19.
Shields MA, Ward M. Improving nurse retention in the National Health Service in England: the impact of job satisfaction on intentions to quit. J Health Econ. 2001;20:677–701.
Coomber B, Barriball L. Impact of job satisfaction components on intent to leave and turnover for hospital-based nurses: a review of the research literature. Int J Nurs Stud. 2007;44:297–314.
Dolea C, Stormont L, Braichet JM. Evaluated strategies to increase attraction and retention of health workers in remote and rural areas. B World Health Organ. 2010;88:379–85.
Siu OL. Predictors of job satisfaction and absenteeism in two samples of Hong Kong nurses. J Adv Nurs. 2002;40:218–29.
Rouleau D, Fournier P, Philibert A, Mbengue B, Dumont A. The effects of midwives’ job satisfaction on burnout, intention to quit and turnover: a longitudinal study in Senegal. Hum Resour Health. 2012; doi:10.1186/1478-4491-10-9.
Hackett RD, Guion RM. A re-evaluation of the absenteeism-job satisfaction relationship. Organ Behav Hum Dec. 1985;35:340–81.
Brayfield AH, Rothe HF. An index of job satisfaction. J Appl Psychol. 1951;35:307–11.
Weiss DJ, Dawis RV, England, GW, Lofquist LH. Manual for the Minnesota Satisfaction Questionnaire Minnesota Studies in Vocational Rehabilitation. 1967; 22.
Smith PC, Kendall LM, Hulin CL. The measurement of satisfaction in work and retirement. Chicago: Rand McNally; 1969.
Judge TA, Erez A, Bono JE, Thoresen CJ. The core self-evaluations scale: Development of a measure. Pers Psychol. 2003;56:303–31.
Bruck CS, Allen TD, Spector PE. The relation between work–family conflict and job satisfaction: A finer-grained analysis. J Vocat Behav. 2002;60:336–53.
Locke EA. The Nature and Causes of Job Satisfaction. In: Dunette MD, editor. Handbook of industrial and organizational psychology. Chicago: Rand McNally; 1976. p. 1295–349.
Bodur S. Job satisfaction of health care staff employed at health centres in Turkey. Occup Med. 2002;52:353–5.
Lu H, While AE, Louise BK. Job satisfaction among nurses: a literature review. Int J Nurs Stud. 2002;42:211–27.
Jayasuriya R, Whittaker M, Halim G, Matineau T. Rural health workers and their work environment: the role of inter-personal factors on job satisfaction of nurses in rural Papua New Guinea. BMC Health Serv Res. 2012; doi:10.1186/1472-6963-12-156.
Spector PE. Measurement of human service staff satisfaction: Development of the Job Satisfaction Survey. Am J Community Psychol. 1985;13:693–713.
Spector P. Job Satisfaction Survey: Department of Psychology, University of South Florida. 1984. http://shell.cas.usf.edu/~pspector/scales/jssovr.html. Accessed 15 Apr 2014.
Akbaritabar AA, Mokarami H, Nazifi M, Rahi A, Hosseinpouri M. Psychometric properties of Spector’s job satisfaction survey in the Iranian population. Koomesh. 2013;14:335–41.
Chou YC, FuL KT, Ru-yan C. Job satisfaction and quality of life among home care workers: a comparison of home care workers who are and who are not informal carers. Int Psychogeriatr. 2011;23:814–25.
Franĕk M, Večeřa J. Personal characteristics and job satisfaction. Ekonomika A Management. 2008;4:63–76.
Spector PE, Wimalasiri J. A cross-cultural comparison of job satisfaction dimensions in the United States and Singapore. Appl Psychol. 1986;35:147–58.
Yelboga A, Gokalp CZ. Validity and reliability of the Turkish version of the job satisfaction survey (JSS). World Appl Sci J. 2009;6:1066–72.
UNDP, Government of Nepal. Nepal Human Development Report, mimeo. Government of Nepal, National Planning Commission: Kathmandu; 2014.
Department of Health Services Ministry of Health and Population. Department of Health Services - about us; 2014. http://dohs.gov.np/about-us/department-of-health-services/. Accessed 30 Mar 2015
Ministry of Health and Population. Human Resources for Health Strategic Plan 2011–2015. Kathmandu: Ministry of Health and Population and Nepal Health Sector Support Programme; 2012.
Ministry of Health and Population, Health Research and Social Development Forum, Nepal Health Sector Support Programme. Service Tracking Survey 2013, mimeo. Kathmandu: MoHP, HERD, NHSSP; 2014.
Morgan A, Jimenez Soto E, Bhandari G, Kermode M. Provider perspectives on the enabling environment required for skilled birth attendance: a qualitative study in western Nepal. Trop Med Int Health. 2014;19:1457–65.
Nick Simons Institute, Government of Nepal. Skilled Birth Attendant Follow-up Enhancement Programme 2011–13. Kathmandu: Nick Simons Institute, National health training centre, Government of Nepal; 2013.
Ministry of Health and Population (MOHP) [Nepal], New ERA, and ICF International Inc. Nepal Demographic and Health Survey 2011, mimeo. Kathmandu: Ministry of Health and Population, New ERA, and ICF International, Calverton, Maryland; 2012.
Ministry of Health and Population. Nepal Demographic and Health Survey, mimeo. Kathmandu: Population Division, Ministry of Health and Population, Government of Nepal, New Era and ICF International; 2011.
Family Health Division. National Policy on Skilled Birth Attendants, mimeo. Kathmandu: Department of Health Services, Ministry of Health and Population, Government of Nepal; 2006.
Ministry of Health and Population. Guidelines for safe motherhood services in remote areas: Options for improving maternal outcomes. Kathmandu: Ministry of Health and Population, Government of Nepal; 2009.
Martineau T, Subedi HN. Human resources for health: draft capacity assessment for health systems strengthening. Liverpool: Nepal Health Sector Support Programme, Liverpool Associates in Tropical Health; 2010. http://www.nhssp.org.np/human_resources/Human%20Resources%20Capacity%20Assessment.pdf. Accessed 23 May 2014.
Nick Simons Institute. Retention of nurses in rural Nepal: how can health sector decentralisation help?. Kathmandu: Nepal, 2012. http://www.nsi.edu.np/web-images/file/InformationSheet_English.pdf. Accessed 31 March 2015.
Creswell JW. Research Design: Qualitative, Quantitative, and Mixed Methods Approaches Vol. Second Edition. California: Sage; 2003.
Morrison J, Batura N, Thapa R, Basnyat R, Skordis-Worrall J. Validating a tool to measure auxiliary nurse midwife and nurse motivation in rural Nepal. Human Res for Health. 2015; doi:10.1186/s12960-015-0021-7
Government of Nepal. Nepal Human Development Report. Kathmandu: Government of Nepal, National Planning Commission and UNDP; 2014.
Razee H, Whittaker M, Jayasuriya R, Yap L, Brentnall L. Listening to the rural health workers in Papua New Guinea–The social factors that influence their motivation to work. Soc Sci Med. 2012;75:828–35.
Mbindyo PM, Blaauw D, Gilson L, English M. Developing a tool to measure health worker motivation in district hospitals in Kenya. Hum Resources Health. 2009; doi:10.1186/1478-4491-7-40.
Raghunathan TE, Lepkowski JM, Van Hoewyk J, Solenberger P. A multivariate technique for multiply imputing missing values using a sequence of regression models. Surv Methodol. 2001;27:85–96.
Schafer JL, Olsen MK. Multiple imputation for multivariate missing-data problems: A data analyst's perspective. Multivariate Behav Res. 1998;33:545–71.
Skordis-Worrall J, Hanson K, Mills A. Estimating the demand for health services in four poor districts of Cape Town South Africa. Int Health. 2011;3:44–9.
Landy FJ. Stamp collecting versus science: Validation as hypothesis testing. Am Psychol. 1986;41:1183–92.
Allen MJ, Yen WM. Introduction to Measurement Theory. Long Grove: Waveland Press; 2002.
Bland JM. Altman DG. Statistics notes: Cronbach's alpha. Br Med J. 1997; doi: http://dx.doi.org/10.1136/bmj.314.7080.572
Baggaley RF, Ganaba R, Filippi V, Kere M, Marshall T, et al. Detecting depression after pregnancy: the validity of the 10 and K6 in Burkina Faso. Trop Med Intl Health. 2007;12:1225–9.
Colbourn T. Investigating the benefits of women's groups in Malawi: adapted quality of life measurement, best-worst scaling choice experiments, and contingent valuations. Doctoral Thesis. London: University College London; 2012. http://discovery.ucl.ac.uk/1366631/. Accessed 21 Dec 2013.
Iacobucci D, Duhachek A. Advancing alpha: Measuring reliability with confidence. J Consum Psychol. 2003;13:478–87.
Nunnally JC, Bernstein IH. Psychometric theory. 3rd ed. New York: McGraw-Hill; 1994.
Ferketich S. Internal consistency estimates of reliability. Res Nurs Health. 1990;13:437–40.
Greco G. Assessing Women's Quality of Life in Rural Malawi: a Capabilities Index. Doctoral Thesis, London School of Hygiene and Tropical Medicine, mimeo; 2013.
Zhang M, Fried DD, Griffeth RW. Review of job embeddedness: Conceptual, measurement issues, and directions for future research. Hum Resour Manage. 2012;R 22:220–31.
Acknowledgements
We would like to thank the study participants for taking the time to speak with us.
Funding
This study was funded by a small grant from the Nick Simon’s Institute, Nepal.
Availability of data and materials
Third party requests for data could be made directly to the principal investigator of the study, Dr Joanna Morrison (jmorrison@nsi.edu.np).
Authors’ contributions
NB performed the quantitative analysis, interpreted the results and drafted the manuscript. JSW guided quantitative analysis and result interpretation and helped draft the manuscript provided. RB, and RT performed the qualitative data collection and supported qualitative analysis. JM conceived of the study, participated in its design and co-ordination, led the qualitative analysis, interpreted results and helped draft the manuscript. All authors read and approved the final manuscript.
Competing interests
The author(s) declare that they have no competing interests.
Consent for publication
Not applicable
Ethics approval and consent to participate
This study was granted ethical approval from the Nepal Health Research Council. Verbal and written informed consent was obtained from all participants.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
About this article
Cite this article
Batura, N., Skordis-Worrall, J., Thapa, R. et al. Is the Job Satisfaction Survey a good tool to measure job satisfaction amongst health workers in Nepal? Results of a validation analysis. BMC Health Serv Res 16, 308 (2016). https://doi.org/10.1186/s12913-016-1558-4
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s12913-016-1558-4