Adapting developing country epidemiological assessment techniques to improve the quality of health needs assessments in developed countries
BMC Health Services Research volume 5, Article number: 32 (2005)
We were commissioned to carry out three health assessments in urban areas of Dublin in Ireland. We required an epidemiologically robust method that could collect data rapidly and inexpensively. We were dealing with inadequate health information systems, weak planning data and a history of inadequate recipient involvement in health service planning. These problems had also been identified by researchers carrying out health assessments in developing countries. This paper reports our experience of adapting a cluster survey model originally developed by international organisations to assess community health needs and service coverage in developing countries and applying our adapted model to three urban areas in Dublin, Ireland
We adapted the model to control for socio-economic heterogeneity, to take account of the inadequate population list, to ensure a representative sample and to account for a higher prevalence of degenerative and chronic diseases. We employed formal as well as informal communication methods and adjusted data collection times to maximise participation.
The model we adapted had the capacity to ascertain both health needs and health care delivery needs. The community participated throughout the process and members were trained and employed as data collectors. The assessments have been used by local health boards and non-governmental agencies to plan and deliver better or additional services.
We were able to carry out high quality health needs assessments in urban areas by adapting and applying a developing country health assessment method. Issues arose relating to health needs assessment as part of the planning cycle and the role of participants in the process.
In 2001, the Department of Public Health and Primary Care in Trinity College Dublin was commissioned to carry out three health assessments in urban areas in Dublin. We aimed to carry out health assessments that would represent the needs of the whole population and not just more vocal minorities.
We were aware that we were dealing with inadequate health information systems, weak planning data and a history of inadequate recipient involvement in health service planning. International health planners have reported similar issues in developing countries and as a result, have developed appropriate health assessment survey methods. The methods for such surveys must be robust, epidemiologically sound and have the potential to collect data rapidly, inexpensively and simply [1, 2]. The survey design must provide information at local level and overcome unreliable population lists. If local health care providers and communities can participate in data collection this has the potential advantage of facilitating the meeting of such needs in the local context in due course .
To address these issues, a thirty-cluster survey method was designed to carry out health assessments in communities in developing countries [1, 4, 5]. We adapted the thirty-cluster survey method and applied it in an urban setting in a developed country. The results of these three health needs assessments have been previously published [6–8] and a summary is provided in Table 1 with reference to online links to the full reports. This paper reports the adaptations made to the thirty-cluster survey method and its implementation to establish the health needs of three urban communities in Dublin, Ireland.
Design and setting
The first two health assessments were commissioned by charitable foundations seeking to support the development of health services in two separate urban areas in Dublin [6, 7]. The third assessment  was commissioned by a local health board in another area, following the publication of the preliminary results of the first assessment. Each area contained a diverse population though there were higher deprivation levels in the area covered by the first assessment and more elderly people living in the second and third areas studied [6–8].
Adaptations to the original model
The model was originally designed for use in homogenous populations in developing countries (Figure 1). However, the lack of socioeconomic homogeneity in urban areas in developed countries had to be considered in the selection of the study population. Detailed descriptions of the areas covered, including maps, and the slight variation in demographic characteristics in participants in each area are presented in the individual reports [6–8]. The Small Area Health Research Unit has calculated deprivation scores for all of the electoral divisions in Ireland, including the three areas surveyed (full details provided in section 2.1 of the Tallaght report ). These deprivation scores, based on data from the 1996 census, range from one to five depending on the level of deprivation. For each of the three areas surveyed, the deprivation scores were aggregated to form less deprived and more deprived groupings and separate samples were selected from each grouping . The adaptations we made are summarized in Figure 2.
In developing countries, people are informed about surveys through community leaders and by word of mouth. We also used more formal methods, such as mailshots, posters at health and social care facilities, and advertisements in the local paper and on radio. Early on in the first survey, when many of the survey letters were returned unopened due to the high turnover of households in urban areas, we changed the addressee on survey envelopes to 'householder', giving us a response rate of at least 76% for each survey. In the second assessment, in a docklands regeneration area, access to households was difficult due to high security gates in apartment complexes, which was not considered prior to designing the survey.
Health needs versus health service needs
The model we adapted had the capacity to incorporate health needs in the broadest sense as well as identify health service needs, and demonstrated the importance of community-based approaches to public health. The international shift to evidence based medicine has been criticised as removing the focus from the social and environmental determinants of health . Some of our survey findings related to the broad determinants of health, such as the need for social outlets for teenagers and security systems for the elderly. This emphasizes the need for a multi-sectoral approach to the health of communities and stresses the importance of collecting truly representative views that reflect the social components of health. The fears expressed about personal safety led to an increased police presence on the street in one of the areas. The second assessment , was used by community activists to lobby the funding charity involved, to provide a bus service to transport older residents to the day centre. This focus on the broader determinants of health has also been reported in other health assessments with the development of new bus routes following such a survey in Edinburgh .
The reports highlight the potential discrepancy between communities' expectations of services and actual service provided as there was in fact quite high prevalence of use of hospital services. These discrepancies could be further explored using a qualitative approach. The addition of a parallel qualitative analysis of the health service providers' perspective in the second two surveys [7, 8] provided more in-depth analysis of the health care services and indicated that the health service providers have a vast knowledge of the areas in which they work. Additional qualitative research involving community representatives would provide a greater depth of understanding of the inter-relationship between health needs and health care delivery needs and enable an exploration of the relationship between expectations and actual service provision.
The communities were consulted and encouraged to participate throughout the process. For two to three months prior to each survey, the lead researcher informed key individuals, community groups and service providers about the proposed survey and elicited their perceived needs. In each area, several health and social services needs were identified and included in the final survey questionnaires. In addition, local community members were trained and used as data collectors.
It is argued that community participation is an essential component of health needs assessment and that it should be a cyclical and iterative process in order to ensure sustainability . However, sustainability is difficult as participating community data collectors are upskilled and may move on into regular paid employment. Those remaining in community work reported improved insights into local problems thus benefiting their communities.
The importance of feeding results back to the community has been previously emphasized . The assessment reports were launched in public venues. We invited elected public and health board representatives, local service providers, community members and representatives of the charitable foundations involved. The community data collectors played an important role in ensuring that the wider community was aware of the launch. They actively participated in the launch by presenting their perspective on the assessments. Following the second and third assessments, summary posters were designed and placed in public areas throughout each community.
The time required to conduct each study and the cost in Euro (2001) are presented in Table 2. The cost shown for the first survey is an under-estimate as the funding did not cover the full salary costs of the lead researcher. The subsequent surveys were fully funded and allowed for a more comprehensive needs assessment including qualitative interviews with local service providers. The additional resources also allowed for wider dissemination of results, with the production of the summary posters. When compared with the cost of surveillance systems, these surveys represent good value for money. However, the addition of a qualitative component to the second and third surveys incurred an additional time and monetary cost.
Impact of reports on services
The reports have been used by local healthcare providers, to lobby the health boards for more services, such as community antenatal clinics and a community paediatrician. The charitable foundation that commissioned the second assessment is now working with the local health board to provide a new primary healthcare centre. While it is not possible to prove conclusively that these service developments occurred solely as a result of the assessments, in each area the reports formed part of a process that directed changes in service delivery.
Health assessment must be practical  and the model we have adapted was feasible and had the advantage of encouraging community involvement. The sampling method ensured genuine representation of all community members and minimized the potential bias inherent in focusing on the priorities of more vocal minorities.
Health needs assessment as part of the planning cycle
A favourable political environment has been described as a key component of successful health needs assessment . For the two initial assessments [6, 7], while the local health board approved the exercise, they had no direct role and consequently no ownership of the process. However, the first report led to another health board in Dublin commissioning the third assessment , which is being used to develop new services in this area. While local politicians and health board managers were briefly interested at the launch of the first report, they have not engaged further on the issues identified, which included lack of services and high levels of morbidity. By the time the third assessment was underway the environment had developed sufficiently to permit local health board involvement. As a result, the final assessment is genuinely part of the planning cycle  within that health board area, which has the statutory responsibility and capacity to deliver on the needs identified.
Roles of participants in the process
Local general practitioners and other healthcare providers were involved in all three assessments although previous reports have indicated that they do not see it as part of their core activities .
The role of charities in identifying need is worthy, but can raise expectations which they may have no remit to address. However, the commitment of the charity involved in the second report to building a new health centre in partnership with the local health board indicates that addressing needs identified can be part of the process even for non-governmental agencies without statutory responsibility to deliver services.
The role of academic departments in the health needs assessment process might also be questioned. The charities involved perceived the department in Trinity College to be objective and unaligned with service planners and providers. Academic departments possess the expertise and capacity to carry out assessments, but might better serve the process and the communities themselves by passing on these skills. Although this would lengthen the process and increase costs initially, it would be cost efficient in the future. Issues relating to sustainability and ownership of the process arise in health services research in general and the need for linkage and exchange between planners and researchers has been highlighted .
Our experience of using and adapting this health assessment methodology indicates the significant benefits for those seeking to carry out high quality health needs assessments in developed countries if they are prepared to learn from the experiences of developing country researchers. The adaptation of this methodology has provided more robust assessments that can be used by community members and service providers.
Lemeshow S, Robinson D: Surveys to measure programme coverage and impact: a review of the methodology used by the expanded programme on immunization. World Health Stat Q. 1985, 38: 65-75.
Anker M: Epidemiological and statistical methods for rapid health assessment: introduction. World Health Stat Q. 1991, 44: 94-106.
Murray SA: Experiences with rapid appraisal in primary care: involving the public in assessing health needs, orienting staff and educating medical students. BMJ. 1999, 318: 440-444.
Rothenberg RB, Lobanov A, Singh KB, Stroh G: Observations on the application of EPI cluster survey methods for estimating disease incidence. Bull World Health Organ. 1985, 63 (1): 93-99.
Primary Healthcare Management Advancement Programme: Assessing Community Health Needs and Coverage. 1993, Geneva: Aga Khan Foundation
Department of Community Health and General Practice*: People living in Tallaght and their Health, A community based cross-sectional survey. 2002, Dublin: Trinity College, [*The Department of Community Health and General Practice in Trinity College Dublin has since been renamed as the Department of Public Health and Primary Care], [http://www.tcd.ie/Community_Health/Tallaght.pdf]
Department of Community Health and General Practice*: People living in the Dublin Docklands and their Health. 2002, Dublin: Trinity College, [*The Department of Community Health and General Practice in Trinity College Dublin has since been renamed as the Department of Public Health and Primary Care], [http://www.tcd.ie/Community_Health/Docklands.pdf]
Department of Community Health and General Practice*: People living in Finglas and their Health. 2003, Dublin: Trinity College, [*The Department of Community Health and General Practice in Trinity College Dublin has since been renamed as the Department of Public Health and Primary Care], [http://www.tcd.ie/Community_Health/Finglas.pdf]
Lwanga SK, Lemeshow S: Sample Size Determination in Health Studies: A Practical Manual. 1991, Geneva: World Health Organization
Israel B, Schulz A, Parker E, Becker B: Review of community-based research: Assessing partnership approaches to improve public health. Annu Rev Public Health. 1998, 19: 173-202. 10.1146/annurev.publhealth.19.1.173.
Stevens A, Gillam S: Needs assessment: from theory to practice. BMJ. 1998, 316: 1448-1452.
McCaulay A, Commanda L, Freeman W, Gibson N, McCabe M, Robbins C, Twohig P: Participatory research maximises community and lay involvement. BMJ. 1999, 319: 774-778.
Wilkinson J, Murray SA: Assessment in primary care: practical issues and possible approaches. BMJ. 1998, 316: 1524-1528.
Jordan J, Wright J, Ayres P, Hawkings M, Thomson R, Wilkinson J, Williams R: Health needs assessment and needs-led health service change: a survey of projects involving public health doctors. J Health Serv Res Policy. 2002, 7 (2): 71-80. 10.1258/1355819021927719.
Wright J, Williams R, Wilkinson JR: Development and importance of health needs assessment. BMJ. 1998, 316 (7140): 1310-3.
Hanlon P, Murie J, Gregan J, McEwen J, Moir D, Russell E: A study to determine how needs assessment is being used to improve health. Public Health. 1998, 112 (5): 343-6. 10.1016/S0033-3506(98)00267-4.
Dash P, Gowman N, Traynor M: Increasing the impact of health services research. BMJ. 2003, 327: 1339-1341. 10.1136/bmj.327.7427.1339.
The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1472-6963/5/32/prepub
The author(s) declare that they have no competing interests.
SS, JL, TOD, JD and DH conceived of this paper. SS wrote the initial draft and co-ordinated the production of the paper with the other authors. JL conceived the methods for the needs assessment and performed the additional statistical analysis for this paper. JL, JD, FO'K, DH and TO'D contributed to the three reports on which this paper is based. All authors contributed to the drafting of this manuscript and read and approved the final paper.
About this article
Cite this article
Smith, S.M., Long, J., Deady, J. et al. Adapting developing country epidemiological assessment techniques to improve the quality of health needs assessments in developed countries. BMC Health Serv Res 5, 32 (2005). https://doi.org/10.1186/1472-6963-5-32