The effect of a monetary incentive on return of a postal health and development questionnaire: a randomised trial [ISRCTN53994660]
© Kenyon et al; licensee BioMed Central Ltd. 2005
Received: 16 March 2005
Accepted: 18 August 2005
Published: 18 August 2005
Postal questionnaires are widely used to collect data in healthcare research but a poor response rate may reduce the validity and reliability of results. There was a lack of evidence available relating to use of a monetary incentive to improve the response rate in the healthcare setting.
The MRC ORACLE Children Study is assessing the health and development of nearly 9000 seven year old children whose mothers' joined the MRC ORACLE Trial. We carried out a randomised controlled trial of inclusion of monetary incentive (five pound voucher redeemable at many high street stores) with the reminder questionnaire to parents. This trial took place between April 2002 and November 2003. When the parents were sent the reminder questionnaire about their child's health and development they were randomly assigned by concealed computer-generated allocation stratified by week of birthday to receive a five pound voucher or no incentive. The population were 722 non-responders to the initial mailing of a 12-page questionnaire. Main outcome measures: Difference in response rate between the two groups.
Inclusion of the voucher with the reminder questionnaire resulted in a 11.7%(95% CI 4.7% to 18.6%) improvement in the response rate between the two groups.
This improvement in response rate and hence the validity and reliability of results obtained appears to be justified ethically and financially.
Postal questionnaires are widely used to collect data in health research, but a poor response rate may reduce the validity and reliability of results. In a systematic review of randomised controlled trials of strategies to improve the response rate to postal questionnaires, a monetary reward had a significant effect on response. However, caution was attached to the interpretation of the findings in this review . On further examination of the updated review 20% of the participants included in the analysis of the effect of inclusion of a monetary incentive in the final response came from healthcare settings  and none of the studies evaluated the use of monetary incentives for a postal questionnaire to collect data from a follow-up of a clinical trial. To evaluate the impact of such an intervention on response rate in such a setting we undertook a randomised trial.
The MRC ORACLE Children Study (MOCS) is following up nearly 9000 seven-year-old children whose mothers joined the MRC ORACLE Trial [4, 5] which evaluated the use of antibiotics to improve neonatal outcome after preterm labour or preterm rupture of the membranes. This trial of a monetary reward to enhance response to a postal questionnaire was undertaken between April 2002 – November 2003. Research Ethics Committee approval was obtained from the West Midlands Multicentre Research Ethics Committee
The questionnaire itself is 12 pages long and A4 in size. It contains questions relating to the child's health and development using a mixture of validated tools and questions pertinent to the study. In designing the study we implemented many of the strategies believed to influence response rates to postal questionnaires [1, 3]. The questionnaire itself is set out in a user friendly way and we have used coloured ink in its design. The letters accompanying the questionnaire are individualised to the child concerned and the parents are warned the questionnaire will be sent to them. The University in which MOCS is housed franks the envelope, the return envelope is stamped, and reminder letters include a questionnaire.
The sample size was predefined by the numbers not responding at this stage of the Study (i.e. approx 700). This yielded 80% power to detect an increased response from 10% to 18% or from 15% to 24% (at the 5% significance level).
Results of random allocation of voucher or not on response rate
Questionnaire not returned
Inclusion of the voucher with the second questionnaire resulted in a 11.7% (95% CI 4.7% to 18.6%) improvement in the response rate between the two groups (χ2 = 10.6, P = 0.001).
The inclusion of a five-pound voucher improved the proportion of questionnaires returned. MOCS will be completed in 2008 and a voucher is being sent to all parents with the reminder questionnaire. It is estimated that this will improve the response rate by 3% over the whole study, at a cost of £67 per additional questionnaire returned. This was calculated on the basis that vouchers will be sent to approximately 40% of parents (2842) and an additional 3% will return the questionnaire
This improvement in response rate, and hence of the validity and the reliability of results appears to be justified ethically and financially. This is particularly relevant in the follow up of children as there is some evidence  of raised levels of adverse outcomes in difficult to follow-up children.
SK and PB designed the trial. DJ and KP carried out the analysis. NM, AS, DT contributed to conception, design and interpretation. All authors read and approved the trial manuscript.
Ann Blackburn, Kate Taylor, Gill Grummitt.
Funding: UK Medical Research Council. Grant number 53994660
- Edwards P, Roberts I, Clarke M, Di Guiseppi C, Pratap S, Wentz R, et al: Increasing response rates to postal questionnaire: systemic review. BMJ. 2002, 324: 1183-1185. 10.1136/bmj.324.7347.1183.View ArticlePubMedPubMed CentralGoogle Scholar
- Smeeth L, Fletcher AE, Editorial: Improving response rates to questionnaires. BMJ. 2002, 324: 1168-1169. 10.1136/bmj.324.7347.1168.
- Edwards P, Roberts I, Clarke M, DiGuiseppi C, Pratap S, Wentz R, Kwan I, Cooper R: Methods to increase response rates to postal questionnaires. The Cochrane Database of Methodology Reviews. 2003, Issue 4.Art No.:MR000008.pub2.DOI: 10.1002/14651858.MR000008.pub2Google Scholar
- Kenyon SL, Taylor DJ, Tarnow-Mordi W, ORACLE Collaborative Group: Broad-spectrum antibiotics for preterm, prelabour rupture of fetal membranes: the ORACLE I randomised trial. Lancet. 2001, 357: 979-988. 10.1016/S0140-6736(00)04233-1.View ArticlePubMedGoogle Scholar
- Kenyon SL, Taylor DJ, Tarnow-Mordi W, ORACLE Collaborative Group: Broad-spectrum antibiotics for spontaneous preterm labour: the ORACLE II randomised trial. Lancet. 2001, 357: 989-994. 10.1016/S0140-6736(00)04234-3.View ArticlePubMedGoogle Scholar
- Tin W, Fritz S, Wariyar U, Hey E: Outcome of very preterm birth children reviewed with ease at 2 years differ from those followed up with difficulty. Arch Dis Child Fetal Neonatal Ed. 1998, 79: F83-87.View ArticlePubMedPubMed CentralGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1472-6963/5/55/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.