- Research article
- Open Access
Long term follow-up of a randomised controlled trial of services for urinary symptoms
BMC Health Services Research volume 11, Article number: 58 (2011)
Given the extent and priority of urinary symptoms there is little evidence available to inform service provision in relation to the long term effects of interventions. This study aims to determine the long term (6 year) clinical effectiveness and costs of a new continence nurse led service compared to standard care for urinary symptoms.
A long term follow-up study of a 2-arm, non-blinded randomised controlled trial that recruited from a community based population between 1998-2000 in Leicestershire and Rutland UK was undertaken. 3746 men and women aged 40 years and over were followed up from the original trial. The continence nurse practitioner (CNP) intervention comprised a continence service provided by specially trained nurses delivering evidence-based interventions using pre-determined care pathways. The standard care (SC) arm comprised access to existing primary care including General Practitioner and continence advisory services in the area. Primary outcome: Improvement in one or more symptom. Secondary outcomes included: a) Leicester Impact scale; b) patient perception of problem; c) number of symptoms alleviated and cost-effectiveness; all were recorded at long term follow-up (average 6 years) post-randomisation.
Overall at long-term follow-up (average 6 years) significantly more individuals in the CNP group (72%) had improved (i.e had fewer symptoms) compared to those in the SC group (67%) (difference of 5% 95% (CI = 0.6 to 9;p = 0.02)).
The differences in outcome between the two randomised groups shown immediately post treatment had decreased by half in terms of symptom improvement at long term follow-up. Although the difference was statistically significant, the clinical significance may not be, although the direction of the difference favoured the new CNP service.
Urinary symptoms pose a considerable health care burden with 200 million people suffering from incontinence worldwide . In the largest comprehensive study of urinary symptoms in a UK general population, the Leicestershire MRC incontinence study reported that 29% of men and 34% of women aged 40 years or over experience clinically significant storage symptoms with considerable impact on quality of life. This represents a financial burden to the NHS of 1% of its annual budget. Overall prevalence and service needs will continue to grow as the population ages. Consequently it is crucial that effective service interventions with lasting effect that are acceptable to patients are identified.
Given the extent and high priority of this condition there is little evidence available to inform service provision in relation to the long term effects of interventions. The only available evidence to date is a study by O'Brien et al 1991, 1995 [4, 5] that assessed the long-term effectiveness of nursing interventions for women with urinary incontinence. This study found that 69% (n = 158) of women who had received treatment by a nurse in the original trial maintained their improvement at 2 year follow-up.
The Leicestershire MRC incontinence programme 'A population laboratory approach to the epidemiology and evaluation of care' undertook a randomised controlled trial (RCT) of a new continence nurse practitioner (CNP)-led service for urinary symptoms , with outcomes at 3 months (immediately post-treatment) and 6 months. The new CNP led service proved to be the most effective with a 10% higher cure rate than standard care (SC) with statistically and clinically significant reductions in urgency, frequency and nocturia as well as incontinence. In addition, quality of life improvements were greater in users of the CNP led service and higher levels of patient satisfaction were achieved. This was the first study to show the effectiveness of nursing services on urinary storage symptoms (rather than simply incontinence) and associated QOL. This follow-up study determines the long-term outcomes from this RCT. It is crucial to establish whether the identified differences in outcomes between the standard care (SC) service and the new continence nurse practitioner (CNP) led service were maintained.
This study is a follow-up study of a 2-arm, non-blinded randomised controlled trial that recruited from a community based population in Leicestershire and Rutland between 1998-2000. Follow-up was undertaken in 2006.
All individuals were recruited to the original trial with one or more of the following symptoms: incontinence several times per month or more, or several times a year plus reported impact; frequency, hourly or more, or two hourly plus impact; nocturia, three times per night, or twice a night plus impact; or urgency, very strong or overwhelming, or strong with impact.
Randomisation to the original trial was undertaken by household following informed consent at a ratio of 4:1 (CNP:GP). This allocation was necessary in order to ensure sufficient numbers in the nested trials (reported elsewhere) for detrusor overactivity and urodynamic stress incontinence. The statistical programme SAS was used to generate the random allocation sequence and was implemented using sealed envelopes, numbered sequentially.
The participants were randomised to receive either: (i) a continence service provided by specially trained nurses delivering evidence-based interventions using pre-determined care pathways or (ii) standard care which comprised usual access to GP and existing continence services. The duration of the intervention was eight weeks. Full details of study methods, interventions and 3 and 6 month outcomes have been reported previously.
We followed-up the original participants using a postal questionnaire (with two reminders) between 5-7 years later (participants had been recruited over a 3 year period, mean time to follow-up was 6 years).
The primary outcome was improvement in one or more symptoms of which cure (no symptoms) is a subset. This was assessed using validated symptom severity questions, comprising the symptoms of incontinence, urgency, frequency and nocturia, obtained by postal questionnaire. The questions were originally validated for use in an interviewer assisted questionnaire. In order to assess their use in a postal questionnaire we undertook a validation study in a sample of 85 participants stratified by age and gender. Kappa statistic was used to compare the interview and postal questionnaire responses for each question. Overall agreement was good. Most kappa statistics were over the threshold value of 0.5 indicating 'moderate' agreement (the majority were 0.7). The secondary outcome measures are divided into two groups: original secondary outcomes, i.e. those which were recorded at 3 and 6 months and again at long term follow-up, and additional secondary outcomes, i.e. those that were collected in order to supplement the original data and take account of important changes e.g. with regard to symptom sub groups. Original secondary outcome measures included:, a) Leicester impact scale, a validated instrument measuring impact on quality of life (a scale developed for the study - with a range of 0 to 42 (there were 21 items with a maximum score of 2 on each item); b) patient perception of problem (Question: How much of a problem would you say you have with your urinary symptoms?) and satisfaction with current symptoms (Question: If you had to spend the rest of your life with urinary symptoms as they are now, how would you feel? Would you be....); and c) costs. Additional secondary outcomes included: d) outcomes according to symptom subgroups; e) predictors of long term improvement; and f) health related quality of life measured using the EQ5 D at follow-up. These outcomes were identified to determine whether there were any specific predictors of improvement, for example symptom subgroups that would enable service providers to target services of the future to specific groups.
Effectiveness of the intervention at long term follow-up was analysed by 'intention to treat'. Results were expressed as absolute differences between observed proportion of individuals with each symptom in the two groups and proportions of individuals who improved (together with corresponding 95% confidence interval [CI]). Satisfaction with services was reported descriptively. A χ2 test was used to test the difference in proportions and a t-test on the absolute difference in impact score from baseline was used for analysing impact score. In order to identify whether there were any identifiable baseline predictors of improvement at follow-up (in terms of number of symptoms), multivariate logistic regression was used to both simultaneously assess the predictive effect of a variety of factors and also to explore the evidence of any treatment-covariate interactions. The 2728 patients with follow-up data at 6 years gave the power to detect a minimum clinically significant difference of 10% (from 50-60%) at the 1% significance level with over 95% power as the original trial had been designed specifically to adequately power a number of small embedded trials.
The original trial estimated the cost-effectiveness of the nurse led service in terms of cost per symptom alleviated and cost per 'case cured'. To examine how resource usage and hence costs have changed we included questions for resource use in the long-term follow up survey using similar methodology to the original trial. These covered: padding, aids and appliances, contacts with healthcare professionals, and use of hospital services. These questions asked specifically about resource use and expenditure in the last six months. We were unable to ask about the whole 5-7 year period due to unreliable recall. The costs used in the original trial were based on 2000/1 UK£s. As these would not reflect current costs we updated the costs in this analysis to the cost year 2006/7 using relevant recent sources of unit costs [9–11]. Where costs had been calculated from data obtained from the earlier trial we updated using the retail price index. Analysis of missing data indicated that cases with missing data were statistically significantly different, and worse, in terms of health and urinary symptoms (the extent of missing data in the symptom and QOL data was minimal). For this reason we imputed missing data using regression-based multiple imputation implemented via the ICE macro in STATA version 10 .
Ethical Approval for this study was given by Leicestershire Local Research Ethics Committee Two (LREC reference:05/Q2502/9).
Of the 3746 individuals who took part in the original trial and therefore comprised our sample, 332 had died, 107 requested no further contact on completion of the original trial and 190 had migrated out of county, of the 3117 remaining a response rate of 87% (n = 2728) was achieved following 3 mailings (Figure 1. flow chart). There were no significant baseline differences in those originally recruited (n = 3746) and those who were followed up (n = 2728) in terms of age, gender, ethnicity, long term health or urinary symptoms (Table 1). The randomised groups were also similar. In addition we looked at baseline differences between responders at follow-up, non-responders at follow-up (n = 389), those who had died since the original trial (n = 332), those who had migrated out of county (n = 190) and those who requested after the original trial that they did not wish to be mailed again (n = 107). Table 1 shows that each of the groups were broadly similar at baseline in terms of demographics and urinary symptoms with the exception of those who died, these individuals were older and more likely to be male than other responders/non-responders recorded. The mean length of follow-up from baseline was 6 years.
Improvement/cure in urinary symptoms
Overall, at long-term follow-up significantly more individuals in the CNP group (72%) had improved (had fewer symptoms) compared with 67% in the SC group (difference of 5% (95% CI = 0.6 to 9;p = 0.02)). At 6 years the proportion reporting no symptoms or 'cured' was 31% in the intervention group and 27% in the SC group (difference of 4%, (95% CI -0.4 to 8 p = 0.08)). Changes in individual urinary symptoms (leakage, frequency, urgency and nocturia) were not significantly different between the two groups at follow-up (see table 2) despite a significant difference having been observed at 3 and 6 month follow-ups.
Original Secondary Outcomes
a) Impact on activities and feelings (QoL)
Absolute change from baseline on the overall quality of life scale was calculated at follow-up to be 4 (Inter Quartile Range IQR 1-9) in the CNP group and 4 (IQR 1 to 10) in the SC group. The mean difference (between CNP and SC) in change from baseline was 0.31 (95% CI: -0.46 to 1.08), P = 0.4
b) Perception of problem and satisfaction with symptoms
By long term follow up differences between the CNP and SC groups in terms of reported 'no problem' or 'mild problem' and satisfaction with current symptoms had diminished. Although in each case the CNP arm gave more positive responses there was no significant differences between the groups (Table 3).
c) Results of the costing study
The results of the costing study from the follow up survey are presented in Table 4. We had complete cost data for 2217 out of 2728 cases.
There were no statistically significant differences in costs between the CNP and the GP groups. NHS costs for both men and women were higher in the CNP group. However, NHS costs for both groups were similar for men and women. Costs borne by respondents themselves were higher for women (due to much higher spending on pads). Total costs were substantially higher for the CNP group, due to higher NHS costs in both males and females.
Additional Secondary Outcomes
d)Outcomes according to symptom sub group
Sub -group analysis was undertaken to determine whether outcomes were different for specific symptom sub groups. Those identified were the International Continence Society (ICS) defined symptom sub-groups of Urodynamic Stress Incontinence (USI), Overactive bladder (OAB) & Mixed symptoms . Table 5 displays results at long-term follow-up in terms of improvement (i.e. reduction in the number of symptoms present compared to baseline) and 'cure' (i.e. no symptoms present at follow-up) between the CNP and standard care arms of the trial stratified by ICS classification (USI, OAB and Mixed) at baseline (i.e. randomisation). Only for those patients who received an initial classification of Mixed did the use of a CNP appear to be statistically significantly better than standard care (P = 0.01). The category 'other' comprises those without an ICS classification and included those with individual symptoms of nocturia, frequency or continuous leakage.
e)Predictors of Long-term Improvement
Those patients randomised into the CNP arm had a 26% (95% CI: 4% to 54%) increased relative odds of improving compared to the SC arm [Odds Ratio 1.26, 95% CI: 1.04 to 1.54; P = 0.02]. After adjustment for age, gender and baseline ICS classification there was little change in terms of the estimate of effect of CNP compared to SC [OR 1.25, 95% CI: 1.02 to 1.53, P = 0.03]. Of the other factors considered only the presence of an initial classification of Mixed appeared to have any statistically significant relationship with outcome (i.e. improvement) though there was little evidence of an interaction between treatment and ICS classification (P = 0.05). Odds ratios for improvement were as follows; Mixed cf. OAB 1.07 (95% CI 0.81 to 1.42; p = 0.6), Mixed cf. USI 1.41 (95% CI 1.07 to 1.85; p = 0.02) and OAB cf. USI 1.31 (95% CI 0.91 to 1.88; p = 0.1) the 'mixed' effect is likely to be due to OAB improvement.
f)EQ-5 D at Follow-up
Table 6 shows the results of the trial in terms of the health related quality of life instrument EQ-5 D  (Euroqol) at follow-up split according to treatment arm and whether patients improved, remained the same or worsened at follow-up compared to baseline. There were no overall differences in EQ-5 D between the two treatment arms. Although there were no overall differences in terms of EQ-5 D between the two treatment arms, those patients who improved, i.e. had fewer or no symptoms at follow-up compared to baseline, had statistically higher EQ-5 D scores than those who did not, and this was seen in both treatment arms, although there was between patients who had improved or worsened -0.0036 (-0.06-0.012, 0005) regardless of trial group.
Summary of main findings
In the original trial we had sufficient power to detect a clinically significant minimum difference in the proportion of individuals who improved their symptoms of 10% to be detected at the 1% significance level with 99% power. At 6 month follow-up we detected a difference in improvement of 11% which met the criteria for clinical significance. By long term follow up we detected a 5% difference which whilst a statistically significant improvement did not reach our threshold for clinical significance. So, at 6 years, whilst the probability of SC being superior is less than 1%, so too is the probability of the difference being greater than 10% (compared with 67% at 6 months (Figure 2).
The improvements in the CNP group shown immediately post treatment (at 3 and 6 months) had decreased (by half) at long term follow up. The follow-up took place at 6 years therefore the annual 'drop off' of effect between the groups was approximately 1% each year.
Comparison with existing literature
Although this trial has shown no clinically significant difference between treatment groups at 6 years, the statistically significant difference of 5% is an improvement on previous comparable trials which have shown no difference at all at 6 years. Maintenance of effect is rarely seen in long term follow-up studies of conservative interventions for incontinence . Glazener et al 2005  in their 6 year follow-up of a randomised controlled trial of conservative management of postnatal urinary and faecal incontinence found no differences between their intervention and standard care groups at 6 years following a 1 year difference of 9%. Similarly Agur et al (2008)  in their eight year follow-up of an RCT of antenatal pelvic floor muscle training found no difference between the groups at follow-up.
Strengths and limitations of the study
This study gained a response rate of 87%, this was a high response rate compared to similar follow-ups at six years .
Secondary outcomes of improvement in impact, perception of their problem and satisfaction with quality of life seen at 3 and 6 months were not maintained at long term follow-up.
For costs at follow-up our most notable finding was that NHS costs in the CNP arm were higher than those in the SC arm, though not significantly so. This finding was surprising given the lack of differences found in the other variables examined in the course of this study. However, this may be due to the fact that those in the CNP arm were familiar with seeking and obtaining specialist help with their urinary symptoms. A higher propensity to seek primary care contacts may in turn lead to more referrals to secondary care and more inpatient care and surgeries. There were no differences in individuals own borne costs suggesting that measures taken by individuals to manage their own symptoms were similar in the two groups. We found that NHS costs were similar for men and women. We were able to exclude many prostate related costs from our calculations as we could identify prostate related inpatient stays and drug usage from our estimates (including these would increase NHS costs from £92 to £123). Some of the costs related to male urinary symptoms would still be related to prostate conditions however as the reasons for services such as contact with GP may not be related to the underlying condition.
Since the 2002 publication of the ICS standardisation document  the symptom subgroups of USI, OAB and mixed have become more established and we wanted to explore whether long term outcomes varied according to these subgroups. If certain subgroups of individuals did better at long term follow-up than others, future services could specifically identify and target these groups for services in the future. We only found that those individuals initially classified with 'mixed' incontinence did statistically better in the CNP arm. This may be due to the nature of the service which was better able to provide more complex care tackling more than one problem and following up outcomes to amend treatment interventions in a way that standard care is less able to do. In addition mixed symptoms tend to be more severe and may have responded well to the comprehensive CNP service.
At long term follow-up there is the potential risk of contamination between treatment arms once a trial is finished. This was not the case in this study as the CNP service was specifically set up for study purposes and funding of the service was not possible following completion of the research programme. The availability of generic continence services post trial for each group was identical. Whilst these services would draw on the education and experience of nurses trained within the trial programme, there was no possibility that those from standard care would have access to the successful service and could be contaminated.
Although the study was not explicitly designed as a cluster randomised trial, 220 (8%) patients were in the same household, i.e. 110 household pairs. The reduction in power due to this cluster was minimal - the study was designed to have over 95% power in order to adequately power a number of small embedded trials. In order to assess any impact on the results, a logistic regression model for the primary outcome (improvement compared to baseline) and which allowed for the effect of clustering was used. This gave identical results to those presented.
We were also interested to know whether there were any specific predictors of improvement, that again would enable service providers to target services of the future to specific groups, however there were no clear predictors of improvement.
This is the first study to examine the long term effectiveness of a nurse led service on storage symptoms. The modest effects shown at long term follow up indicate a drop-off of effect with time which is likely to be related to the fact that the interventions taught at the initial intervention needed to be continued or periodically reinforced e.g. pelvic floor exercises and bladder training. By implementing the initial interventions and then offering periodic 'top-ups' in the form of nurse contacts with patients to reinforce teaching on bladder training, fluid and diet advice and pelvic floor exercises, a lasting effect may be achieved. Such suggestions would need to be rigorously tested as part of a RCT with a full economic evaluation, following exploratory work on the potential components of the proposed 'top-ups'.
Abrams P, Cardozo L, Khoury S, Wein A: Incontinence: 3rd International Consultation on Incontinence, 2004 Volume 1; Basics and Evaluation. 2005. 2005, France: Health Publication Ltd
McGrother CW, Donaldson MMK, Shaw C, Matthews RJ, Hayward TA, Dallosso HM, et al: Storage Symptoms of the Bladder: Prevalence, Incidence and Need for Services in the Uk. BJU International. 2004, 93 (6): 763-769. 10.1111/j.1464-410X.2003.04721.x.
Turner DA, Shaw C, McGrother CW, Dallosso HM, Cooper NJ: The Cost of Clinically Significant Urinary Storage Symptoms for Community Dwelling Adults in the Uk. BJU International. 2004, 93 (9): 1246-1252. 10.1111/j.1464-410x.2004.04806.x.
O'Brien J, Austin M, Sethi P, O'Boyle P: Urinary-incontinence - prevalence, need for treatment, and effectiveness of intervention by nurse. British Medical Journal. 1991, 303 (6813): 1308-1312.
O'Brien J, Long H: Urinary incontinence - long-term effectiveness of nursing intervention in primary care. British Medical Journal. 1995, 311 (7014): 1208..
Williams KS, Assassa RP, Cooper NJ, Turner DA, Shaw C, Abrams KR, et al: Clinical and cost-effectiveness of a new nurse-led continence service: A randomised controlled trial. British Journal of General Practice. 2005, 55 (518): 696-703.
Shaw C, Matthews RJ, Perry SI, Assassa RP, Williams K, McGrother C, et al: Validity and reliability of an interviewer-administered questionnaire to measure the severity of lower urinary tract symptoms of storage abnormality: the Leicester Urinary Symptom Questionnaire. BJU International. 2002, 90 (3): 205-215. 10.1046/j.1464-410X.2002.02893.x.
Shaw C, Matthews RJ, Perry SI, Williams K, Spiers N, Assassa RP, et al: Validity and Reliability of a Questionnaire to Measure the Impact of Lower Urinary Tract Symptoms on Quality of Life: the Leicester Impact Scale. Neurourology and Urodynamics. 2004, 23 (3): 229-236. 10.1002/nau.20017.
Curtis L: Unit costs of health and social care. 2007, Canterbury: PSSRU, University of Kent
NHS Reference costs 2006/7. Department of Health 2008 cited 2008 Nov. 26]. [http://www.dh.gov.uk/en/Publicationsandstatistics/Publications/PublicationsPolicyAndGuidance/DH_082571]
British National Formulary 52. 2006, BMJ publishing group and RPS Publishing, London
Retail Price Index. NationalStatistics. 2008, [http://www.statistics.gov.uk/cci/nugget.asp?ID=21]
Royston P: Multiple imputation of missing values: further update of ice, with an emphasis on interval censoring. Stata Journal. 2007, 7 (4): 445-464.
Abrams P, Cardozo L, Fall M, Griffiths D, Rosier P, Ulmsten U, et al: The standardisation of terminology of lower urinary tract function: report from the Standardisation Sub-committee of the International Continence Society. Neurourol Urodyn. 2002, 21: 167-178. 10.1002/nau.10052.
Brooks R: EuroQol: the current state of play. Health Policy. 1996, 37 (1): 53-72. 10.1016/0168-8510(96)00822-6.
Emmett CLMA, Peters TJ, Fahey T: Three-year follow-up of a factorial ramdomised controlled trial of two decision aids for newly diagnosed hypertensive patients. British Journal General Practice. 2005, 55: 551-553.
Glazener CMA, Herbison GP, MacArthur C, Grant A, Wilson PD: Randomised controlled trial of conservative management of postnatal urinary and faecal incontinence: six year follow up. BMJ. 2005, 330 (7487): 337-10.1136/bmj.38320.613461.82.
Agur WI, Steggles P, Waterfield M, Freeman RM: The long-term effectiveness of antenatal pelvic floor muscle training: Eight-year follow up of a randomised controlled trial. BJOG: An International Journal of Obstetrics and Gynaecology. 2008, 115 (8): 985-990. 10.1111/j.1471-0528.2008.01742.x. Date of Publication: July 2008
The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1472-6963/11/58/prepub
This study was funded by the Medical Research Council G0300835. KRA is partially supported as a NIHR Senior Investigator (NI-SI-0508-10061).
Study Sponsor: University of Leicester
The authors declare that they have no competing interests.
KSW, KA, CMcG, RPA, DT, NC, and CS contributed to the design of the study, and KSW supervised the execution of the study and data collection. DC co-ordinated and undertook data collection and data entry. KRA, NC, DC, KSW, DAT, analysed the data. All authors were actively involved in checking the data and critical revisions to the manuscript, which was drafted by all authors.
About this article
Cite this article
Williams, K.S., Coleby, D., Abrams, K.R. et al. Long term follow-up of a randomised controlled trial of services for urinary symptoms. BMC Health Serv Res 11, 58 (2011). https://doi.org/10.1186/1472-6963-11-58
- Standard Care
- Urinary Symptom
- Pelvic Floor Muscle Training
- Urodynamic Stress Incontinence
- Original Trial