Adapting developing country epidemiological assessment techniques to improve the quality of health needs assessments in developed countries
© Smith et al; licensee BioMed Central Ltd. 2005
Received: 08 September 2004
Accepted: 29 April 2005
Published: 29 April 2005
We were commissioned to carry out three health assessments in urban areas of Dublin in Ireland. We required an epidemiologically robust method that could collect data rapidly and inexpensively. We were dealing with inadequate health information systems, weak planning data and a history of inadequate recipient involvement in health service planning. These problems had also been identified by researchers carrying out health assessments in developing countries. This paper reports our experience of adapting a cluster survey model originally developed by international organisations to assess community health needs and service coverage in developing countries and applying our adapted model to three urban areas in Dublin, Ireland
We adapted the model to control for socio-economic heterogeneity, to take account of the inadequate population list, to ensure a representative sample and to account for a higher prevalence of degenerative and chronic diseases. We employed formal as well as informal communication methods and adjusted data collection times to maximise participation.
The model we adapted had the capacity to ascertain both health needs and health care delivery needs. The community participated throughout the process and members were trained and employed as data collectors. The assessments have been used by local health boards and non-governmental agencies to plan and deliver better or additional services.
We were able to carry out high quality health needs assessments in urban areas by adapting and applying a developing country health assessment method. Issues arose relating to health needs assessment as part of the planning cycle and the role of participants in the process.
In 2001, the Department of Public Health and Primary Care in Trinity College Dublin was commissioned to carry out three health assessments in urban areas in Dublin. We aimed to carry out health assessments that would represent the needs of the whole population and not just more vocal minorities.
We were aware that we were dealing with inadequate health information systems, weak planning data and a history of inadequate recipient involvement in health service planning. International health planners have reported similar issues in developing countries and as a result, have developed appropriate health assessment survey methods. The methods for such surveys must be robust, epidemiologically sound and have the potential to collect data rapidly, inexpensively and simply [1, 2]. The survey design must provide information at local level and overcome unreliable population lists. If local health care providers and communities can participate in data collection this has the potential advantage of facilitating the meeting of such needs in the local context in due course .
Summary of aims and main results of the Health Needs Assessments carried out. Full reports can be downloaded from: http://www.tcd.ie/Community_Health [see reference list for individual report links]
% (95% CI*)
to assess the health needs of households and their individual members residing in each of the three areas surveyed
Proportion with a chronic illness (cardiovascular and respiratory disease and arthritis most common) at the time of the survey
Proportion with disability at the time of the survey
Experienced 'stress' in the 12 months prior to the survey
Experienced violence in the 12 months prior to the survey
Anxiety re: teenagers in household
Problem with drugs/ alcohol
Current smokers at the time of the survey
Using family planning method at the time of the survey
Cervical smear in the 5 years prior to the survey
Breast examination in the 5 years prior to the survey
Used hospital service in the 12 months prior to the survey
Attended their GP in the 12 months prior to the survey
Visited dentist in the 12 months prior to the survey
On waiting list for health care at the time of the survey
Identification of services needed†
Improve out of hours GP care
Improve services for elderly
Social work services
Services for teenagers
Local maternity service
Health promotion clinics
Design and setting
The first two health assessments were commissioned by charitable foundations seeking to support the development of health services in two separate urban areas in Dublin [6, 7]. The third assessment  was commissioned by a local health board in another area, following the publication of the preliminary results of the first assessment. Each area contained a diverse population though there were higher deprivation levels in the area covered by the first assessment and more elderly people living in the second and third areas studied [6–8].
Adaptations to the original model
In developing countries, people are informed about surveys through community leaders and by word of mouth. We also used more formal methods, such as mailshots, posters at health and social care facilities, and advertisements in the local paper and on radio. Early on in the first survey, when many of the survey letters were returned unopened due to the high turnover of households in urban areas, we changed the addressee on survey envelopes to 'householder', giving us a response rate of at least 76% for each survey. In the second assessment, in a docklands regeneration area, access to households was difficult due to high security gates in apartment complexes, which was not considered prior to designing the survey.
Health needs versus health service needs
The model we adapted had the capacity to incorporate health needs in the broadest sense as well as identify health service needs, and demonstrated the importance of community-based approaches to public health. The international shift to evidence based medicine has been criticised as removing the focus from the social and environmental determinants of health . Some of our survey findings related to the broad determinants of health, such as the need for social outlets for teenagers and security systems for the elderly. This emphasizes the need for a multi-sectoral approach to the health of communities and stresses the importance of collecting truly representative views that reflect the social components of health. The fears expressed about personal safety led to an increased police presence on the street in one of the areas. The second assessment , was used by community activists to lobby the funding charity involved, to provide a bus service to transport older residents to the day centre. This focus on the broader determinants of health has also been reported in other health assessments with the development of new bus routes following such a survey in Edinburgh .
The reports highlight the potential discrepancy between communities' expectations of services and actual service provided as there was in fact quite high prevalence of use of hospital services. These discrepancies could be further explored using a qualitative approach. The addition of a parallel qualitative analysis of the health service providers' perspective in the second two surveys [7, 8] provided more in-depth analysis of the health care services and indicated that the health service providers have a vast knowledge of the areas in which they work. Additional qualitative research involving community representatives would provide a greater depth of understanding of the inter-relationship between health needs and health care delivery needs and enable an exploration of the relationship between expectations and actual service provision.
The communities were consulted and encouraged to participate throughout the process. For two to three months prior to each survey, the lead researcher informed key individuals, community groups and service providers about the proposed survey and elicited their perceived needs. In each area, several health and social services needs were identified and included in the final survey questionnaires. In addition, local community members were trained and used as data collectors.
It is argued that community participation is an essential component of health needs assessment and that it should be a cyclical and iterative process in order to ensure sustainability . However, sustainability is difficult as participating community data collectors are upskilled and may move on into regular paid employment. Those remaining in community work reported improved insights into local problems thus benefiting their communities.
The importance of feeding results back to the community has been previously emphasized . The assessment reports were launched in public venues. We invited elected public and health board representatives, local service providers, community members and representatives of the charitable foundations involved. The community data collectors played an important role in ensuring that the wider community was aware of the launch. They actively participated in the launch by presenting their perspective on the assessments. Following the second and third assessments, summary posters were designed and placed in public areas throughout each community.
Time required to conduct surveys, and costs in Euro
Time from design to publication
April 2001 to March
June 2001 to September
Nov 2001 to February
Total expenditure in Euro
Impact of reports on services
The reports have been used by local healthcare providers, to lobby the health boards for more services, such as community antenatal clinics and a community paediatrician. The charitable foundation that commissioned the second assessment is now working with the local health board to provide a new primary healthcare centre. While it is not possible to prove conclusively that these service developments occurred solely as a result of the assessments, in each area the reports formed part of a process that directed changes in service delivery.
Health assessment must be practical  and the model we have adapted was feasible and had the advantage of encouraging community involvement. The sampling method ensured genuine representation of all community members and minimized the potential bias inherent in focusing on the priorities of more vocal minorities.
Health needs assessment as part of the planning cycle
A favourable political environment has been described as a key component of successful health needs assessment . For the two initial assessments [6, 7], while the local health board approved the exercise, they had no direct role and consequently no ownership of the process. However, the first report led to another health board in Dublin commissioning the third assessment , which is being used to develop new services in this area. While local politicians and health board managers were briefly interested at the launch of the first report, they have not engaged further on the issues identified, which included lack of services and high levels of morbidity. By the time the third assessment was underway the environment had developed sufficiently to permit local health board involvement. As a result, the final assessment is genuinely part of the planning cycle  within that health board area, which has the statutory responsibility and capacity to deliver on the needs identified.
Roles of participants in the process
Local general practitioners and other healthcare providers were involved in all three assessments although previous reports have indicated that they do not see it as part of their core activities .
The role of charities in identifying need is worthy, but can raise expectations which they may have no remit to address. However, the commitment of the charity involved in the second report to building a new health centre in partnership with the local health board indicates that addressing needs identified can be part of the process even for non-governmental agencies without statutory responsibility to deliver services.
The role of academic departments in the health needs assessment process might also be questioned. The charities involved perceived the department in Trinity College to be objective and unaligned with service planners and providers. Academic departments possess the expertise and capacity to carry out assessments, but might better serve the process and the communities themselves by passing on these skills. Although this would lengthen the process and increase costs initially, it would be cost efficient in the future. Issues relating to sustainability and ownership of the process arise in health services research in general and the need for linkage and exchange between planners and researchers has been highlighted .
Our experience of using and adapting this health assessment methodology indicates the significant benefits for those seeking to carry out high quality health needs assessments in developed countries if they are prepared to learn from the experiences of developing country researchers. The adaptation of this methodology has provided more robust assessments that can be used by community members and service providers.
- Lemeshow S, Robinson D: Surveys to measure programme coverage and impact: a review of the methodology used by the expanded programme on immunization. World Health Stat Q. 1985, 38: 65-75.PubMedGoogle Scholar
- Anker M: Epidemiological and statistical methods for rapid health assessment: introduction. World Health Stat Q. 1991, 44: 94-106.PubMedGoogle Scholar
- Murray SA: Experiences with rapid appraisal in primary care: involving the public in assessing health needs, orienting staff and educating medical students. BMJ. 1999, 318: 440-444.View ArticlePubMedPubMed CentralGoogle Scholar
- Rothenberg RB, Lobanov A, Singh KB, Stroh G: Observations on the application of EPI cluster survey methods for estimating disease incidence. Bull World Health Organ. 1985, 63 (1): 93-99.PubMedPubMed CentralGoogle Scholar
- Primary Healthcare Management Advancement Programme: Assessing Community Health Needs and Coverage. 1993, Geneva: Aga Khan FoundationGoogle Scholar
- Department of Community Health and General Practice*: People living in Tallaght and their Health, A community based cross-sectional survey. 2002, Dublin: Trinity College, [*The Department of Community Health and General Practice in Trinity College Dublin has since been renamed as the Department of Public Health and Primary Care], [http://www.tcd.ie/Community_Health/Tallaght.pdf]Google Scholar
- Department of Community Health and General Practice*: People living in the Dublin Docklands and their Health. 2002, Dublin: Trinity College, [*The Department of Community Health and General Practice in Trinity College Dublin has since been renamed as the Department of Public Health and Primary Care], [http://www.tcd.ie/Community_Health/Docklands.pdf]Google Scholar
- Department of Community Health and General Practice*: People living in Finglas and their Health. 2003, Dublin: Trinity College, [*The Department of Community Health and General Practice in Trinity College Dublin has since been renamed as the Department of Public Health and Primary Care], [http://www.tcd.ie/Community_Health/Finglas.pdf]Google Scholar
- Lwanga SK, Lemeshow S: Sample Size Determination in Health Studies: A Practical Manual. 1991, Geneva: World Health OrganizationGoogle Scholar
- Israel B, Schulz A, Parker E, Becker B: Review of community-based research: Assessing partnership approaches to improve public health. Annu Rev Public Health. 1998, 19: 173-202. 10.1146/annurev.publhealth.19.1.173.View ArticlePubMedGoogle Scholar
- Stevens A, Gillam S: Needs assessment: from theory to practice. BMJ. 1998, 316: 1448-1452.View ArticlePubMedPubMed CentralGoogle Scholar
- McCaulay A, Commanda L, Freeman W, Gibson N, McCabe M, Robbins C, Twohig P: Participatory research maximises community and lay involvement. BMJ. 1999, 319: 774-778.View ArticleGoogle Scholar
- Wilkinson J, Murray SA: Assessment in primary care: practical issues and possible approaches. BMJ. 1998, 316: 1524-1528.View ArticlePubMedPubMed CentralGoogle Scholar
- Jordan J, Wright J, Ayres P, Hawkings M, Thomson R, Wilkinson J, Williams R: Health needs assessment and needs-led health service change: a survey of projects involving public health doctors. J Health Serv Res Policy. 2002, 7 (2): 71-80. 10.1258/1355819021927719.View ArticlePubMedGoogle Scholar
- Wright J, Williams R, Wilkinson JR: Development and importance of health needs assessment. BMJ. 1998, 316 (7140): 1310-3.View ArticlePubMedPubMed CentralGoogle Scholar
- Hanlon P, Murie J, Gregan J, McEwen J, Moir D, Russell E: A study to determine how needs assessment is being used to improve health. Public Health. 1998, 112 (5): 343-6. 10.1016/S0033-3506(98)00267-4.View ArticlePubMedGoogle Scholar
- Dash P, Gowman N, Traynor M: Increasing the impact of health services research. BMJ. 2003, 327: 1339-1341. 10.1136/bmj.327.7427.1339.View ArticlePubMedPubMed CentralGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1472-6963/5/32/prepub