Study protocol: The Intensive Care Outcome Network ('ICON') study
BMC Health Services Research volume 8, Article number: 132 (2008)
Extended follow-up of survivors of ICU treatment has shown many patients suffer long-term physical and psychological consequences that affect their health-related quality of life. The current lack of rigorous longitudinal studies means that the true prevalence of these physical and psychological problems remains undetermined.
The ICON (Intensive Care Outcome Network) study is a multi-centre, longitudinal study of survivors of critical illness. Patients will be recruited prior to hospital discharge from 20–30 ICUs in the UK and will be assessed at 3, 6, and 12 months following ICU discharge for health-related quality of life as measured by the Short Form-36 (SF-36) and the EuroQoL (EQ-5D); anxiety and depression as measured by the Hospital Anxiety and Depression Scale (HADS); and post traumatic stress disorder (PTSD) symptoms as measured by the PTSD Civilian Checklist (PCL-C). Postal questionnaires will be used.
The ICON study will create a valuable UK database detailing the prevalence of physical and psychological morbidity experienced by patients as they recover from critical illness. Knowledge of the prevalence of physical and psychological morbidity in ICU survivors is important because research to generate models of causality, prognosis and treatment effects is dependent on accurate determination of prevalence. The results will also inform economic modelling of the long-term burden of critical illness.
Research on the effectiveness of intensive care treatment has traditionally focused on mortality [1–3]. The cumulative 12 month mortality of survivors of ICU treatment in the UK varies between 35% and 43% [4, 5]. Over the five years after an ICU admission these patients also have an excess risk of death when compared to an age and sex matched population 
However, apart from this excess mortality, recent research has confirmed that survivors of ICU treatment continue to experience both physical , and psychological problems [4, 8, 9] for some time after discharge from ICU [7, 10]. The reported prevalence of anxiety and depressive problems in ICU survivors ranges from 12% to 43% (for anxiety) [4, 11], and 10% to 30% (for depression) [4, 11]. Two recent reviews estimate that 5% to 64% of intensive care patients may develop either post traumatic stress disorder (PTSD) or its associated symptoms that may endure for a number of years [12, 13]. However, the studies reporting on the rates of PTSD and PTSD symptoms in ICU survivors vary considerably in their case mix, demographic variables, and method and timing of PTSD assessment [12, 13]. All these factors complicate comparisons between studies and limit quantitative synthesis of their findings. As a result, the extent to which the consequences of critical illness or treatments received in the ICU contribute to the prevalence of PTSD symptoms during recovery is currently poorly understood. Thus, well-designed studies are needed to determine accurate prevalence rates of PTSD in survivors of ICU treatment.
The extended physical and psychological morbidity seen after critical illness has the potential to affect a patient's quality of life. Quality of life is determined by several factors including health status, social relationships, employment status and the well being of others. Health status measurements assess physical, physiologic and psychological states or function, and where these measurements overlap with components of quality of life is defined as 'Health-Related Quality of Life' (HRQoL) . Studies assessing HRQoL after intensive care suggest that this improves over time [15, 16], but is worse than before admission to ICU , and worse than general population norms [4, 15, 17]. However, the current literature assessing HRQoL among ICU survivors [1, 3, 14, 18] has limitations. First existing UK studies tend to be small and from single centres. The two largest studies collected data on only 173 patients 12 months post-discharge  and 143 patients 3 months post-discharge . Both these studies were conducted in single centres. Second, the existing studies reporting on HRQoL in ICU survivors have employed a wide number of different outcome measures, making synthesis of the results impossible. Third, the majority of the studies lack sufficient rigour. Heyland et al evaluated 64 studies assessing HRQoL in ICU survivors (January 1992 – July 1995). Only three studies (5%) met their pre-set methodological standards . A major shortcoming was the lack of validation of the HRQoL measures. Hayes et al reached a similar conclusion in their systematic review . The SF-36 and EQ-5D appear to be the strongest of the existing generic measures because they have been validated extensively in other patient populations and are straightforward to administer [1, 3, 18]. Both the SF-36 and the EQ-5D also have the advantage that utilities can be obtained which can be used to calculate quality-adjusted life years in conjunction with survival data [3, 19, 20]. Despite these recommendations the SF-36 and EQ-5D measures have yet to be used (or extensively validated) in a large, representative sample of survivors of adult, general intensive care in the UK [1, 3]. Therefore, a UK multicentre study applying these outcome measures to assess longer-term HRQoL in survivors of ICU treatment is long overdue.
Aims and objectives of the study
The ICON study aims to:
Define the longer-term outcomes of a large, representative sample of survivors of adult, general ICU care in the UK quantitatively in terms of their survival, HRQoL and psychological morbidity 3, 6 and 12 months after ICU discharge.
Compare the mortality of survivors of adult, general ICU care with age-, sex- and condition-matched populations of people who have not experienced ICU care.
This is a multi-centre, longitudinal study.
Ethics approval was granted from Oxfordshire Research Ethics Committee B (Ref:06/Q1605/17).
Participants meeting the inclusion criteria will be recruited from 20–30 intensive care units in the UK.
To be eligible for enrolment in the ICON study, participants must have experienced at least 24 hours of level three dependency care (ICU) at any time during their hospital stay and who survive until the time of hospital discharge.
Patients will be excluded if they are: aged under 16 years; unable to complete questionnaires; foreign nationals; in residential care; unable or unwilling to consent; or if their life status cannot be traced (i.e. have no GP or NHS numbers).
Outcomes assessed in the ICON study include mortality, functional status, HRQoL and psychological outcomes. Relevant outcomes are assessed at 3, 12 and 24 months after ICU discharge (Table 1).
Outcomes are assessed with standardised instruments, most of which are used widely in critical care research. HRQoL will be measured by the SF-36 [21, 24] and the EQ-5D . The SF-36 is a comprehensive, generic 36-item questionnaire [26, 27] that appears to be an acceptable, reliable and valid tool for use in the ICU population and its use for quality of life assessment following critical illness has been recommended [23, 15]. The SF-36 contains 36 items to measure 8 domains: physical functioning, role limitations due to physical problems, bodily pain, general health perceptions, energy/vitality, social functioning, role limitations due to emotional problems, and mental health .
The EQ-5D (EuroQoL) has been proved to be a useful tool in a mixed critical care population . The EQ-5D comprises two parts: the EQ-5D self-classifier and the EQ-VAS. The self-classifier is self-reported description of health problems according to a 5 dimensional classification i.e. mobility, self-care, usual activities, pain/discomfort and anxiety/depression. The EQ-VAS is a self-rated health status using a visual analogue scale (VAS). The EQ-VAS is similar to a thermometer and records perceptions of participants own current overall health. The VAS scale is graduated from 0 (the worst imaginable health state) to 100 (the best imaginable state) . Two EQ-VAS will be included in the three month questionnaire pack. The first scale one will ask patients to rate their health immediately prior to their hospital admission that resulted in the ICU admission. The second scale will be used to rate their health current health status.
Anxiety and depression will be assessed by the HADS (Hospital Anxiety and Depression Scale) . The HADS has been validated in the critical care population [4, 9, 11, 26]. The HADS questionnaire contains 14 statements and scoring results in scales of 0–21 for anxiety and depression respectively. Scores of 8–10 indicate the possibility of anxiety or depression, and 11 and above indicate that these are likely to be present.
PTSD should ideally be diagnosed using consistent criteria and reliable instruments that exhibit high inter-rater reliability, are stable over time and are able to assess individual patients presenting with wide symptom variance . Currently, the PTSD diagnostic gold standard remains a structured clinical interview to predefined criteria (e.g. DSM-IV). For obvious reasons, standardised interview is not always practically possible at ICU follow-up, and the administration of self-report inventories allows the identification of PTSD symptomatology. The ICON study will assess PTSD symptomatology using the PTSD checklist (civilian) (PCL-C). The PCL-C is a 17-item self-report measure of the 17 DSM-IV symptoms of PTSD assessing all core symptoms of PTSD i.e. intrusion, avoidance and hyperarousal. It takes minutes to complete and is a reliable and validated tool with excellent psychometric properties. A correlation of 0.93 between the total PCL score and structured interview with the Clinician-Administered PTSD Scale (CAPS) has been demonstrated (Blanchard et al), with a diagnostic efficiency of 0.9 versus the CAPS. A score of 45 or greater on the PCL-C has been recommended as a cut off point for high PTSD symptom load. A total PCL-C cut-off score of 50 has a sensitivity of 0.6 and a specificity of 0.99 of diagnosing PTSD when compared to Structured Clinical Interview for DSM-IV [28, 29].
In the event of a patient scoring 45 or greater on the PCL-C and or 11–14 (moderate risk) or 15–21 (severe risk) on either aspect of the HADS, a standard letter will be sent to the patient's GP to highlight that they have demonstrated significant risk of PTSD and or anxiety or depression on the relevant screening tools. However, the exact inventory scores will not be given to the GP. If the patient did not consent for a warning letter to be sent to the GP in the event of a high inventory score, a standard letter will be sent to the patient instead. This letter will inform the patient that their questionnaire results were inconclusive and they are recommended to visit their GP to discuss their psychological health.
Lists of patients meeting the study inclusion criteria will be sent from the participating hospitals to the trial office, which then submits this list to the Office of National Statistics (ONS). The ONS then performs two checks on the data. The first check cleans the list to maximise the identification of individual patients on the ONS databases; the second check identifies the patients that have died since hospital discharge. From the list of surviving patients generated by the ONS, contact with the patient's GP is made to act as a further check to confirm that the patient is still alive. Adopting this approach will hopefully prevent a questionnaire pack being mailed to a deceased patient and unnecessary distress being caused to their relative.
The three-month mailing pack consists of an introductory letter to the study, a patient information sheet, consent form, questionnaire set and a FREEPOST envelope. If the questionnaire pack is not returned, a reminder mailing is posted four weeks later. Once a patient is enrolled into the study, they will receive further study packs at 12 and 24 months post ICU discharge as long as they are not subsequently identified as deceased by the pre-mailing ONS check. The 12 and 24 month mailing packs comprise a reminder letter of the study, the relevant questionnaire packs and a FREEPOST envelope.
Again, if the patient has not returned either pack 4 weeks after the initial mailing, a second pack will be sent. If the questionnaire packs are not returned after the second mailing, no further attempts will be made to contact the patient.
Trial recruitment and baseline measurements
All patients discharged from all participating units will be given a generic discharge letter introducing the study to them and the possibility that they may receive a mailing from the ICON study team in the coming months. Data will be collected on patient demographics, ICU diagnosis, ICU stay, severity of illness using the Acute Physiology, and Chronic Health Evaluation (APACHE II) system  and APACHE II co-morbidity score.
The minimum target total survivor recruitment for the study would be at least 1000 survivors per year in the first year returning all questionnaires. With this sample size, the ICON study would be the largest existing prospective cohort study of long-term outcomes in ICU survivors.
Participating ICUs will submit monthly lists of patient names, hospital numbers, CMP numbers, dates of birth, addresses, and both hospital/ICU admission and discharge dates to the trial office. Just prior to a patient reaching the 3 months post-ICU discharge date, the trial office will contact the patient's GP to check the patient status on the relevant patient administration system and ensure eligibility for trial entry. Once it is confirmed that the patient was successfully discharged from hospital and is still alive, a three month study pack is mailed. ICNARC (Intensive Care National Research and Education Centre) will download clinical data to the study office quarterly. Unique database numbers will link these data with the ICON database, allowing record linkage studies with ICNARC. The study office will also snapshot each participating ICU every six months for staff and unit demographics.
Data protection and PIAG approval
The data collection, storage and access rights will conform to the standards set out in the Data Protection Act 1998. In addition, an application will be made to PIAG (Patient Information Advisory Group) for "Section 60 exemption" class support to provide a basis in law for holding patient identifiable data. This is a requirement in UK law (Health and Social Care Act 2001) for all disease registries. Although the ICON study needs to hold patient identifiable data to allow checking with the ONS, any second parties wishing to use the data will only have access to anonymised information.
The data from ICNARC databases, the ONS returns, the SF-36, EQ-5D, HADS and PCL-C responses will be stored in a series of linked databases. The data imported as electronic files (ICU databases and ONS records) will undergo filtering, validity and range checks before being included. Data from the paper returns will be scanned and error checked. The data will be held in off-line storage with two-tier backup.
Participating units will receive electronic mailings from the study office giving the number of patients that are currently being followed-up and the average questionnaire results of those patients who have consented to take part in the study.
Using ICU admission as the event defining the start of follow-up, Kaplan-Meier curves will be constructed to illustrate survival. Age and sex matched control data will be requested from ONS in a 1:1 ratio with the patients in the study, and a control group Kaplan-Meier curve calculated from these data. A log-rank test will be used to determine the statistical significance of any differences noted.
It is almost certain that the ICU survivors will show a decreased longevity compared with the general population, so this initial testing will only be used to validate the study by showing similar results to previous investigations. However, as this is a non-randomised study, there are many potential sources for bias. To minimise the possibility that a difference in survival is due to confounders and not a real effect of the either illness or the ICU care, further covariate analysis will be undertaken. To determine the effects of covariates on survival, the Cox proportional hazards method will be used. The covariates included in the model will be age, sex, APACHE II predicted mortality, socio-economic status (from postcodes), geographical area (4 zones north to south based on hospital location), month of discharge, and 12 broad diagnostic categories based of the organ system involved in the acute illness. These results will be presented as a table showing the relative effects of ICU care and the covariates on survival.
The data on psychological illness (anxiety, depression and PTSD symptomatology), and quality of life will be largely descriptive and will be presented in tabular form.
Utility analysis will be performed by estimating Quality Adjusted Life Years (QALYs) from the survival and EQ-5D data at 3, 12 and 24 months using standard techniques. A simple average of QALYs with measures of dispersion will be calculated. Assuming the data prove to be normally distributed, standard parametric testing will be used to compare the mean QALYs in ICU survivors with the age and sex matched controls held in other databases.
The ICON study is a longitudinal study that seeks to provide rigorous data on the long-term outcome from ICU treatment in the UK, with a particular emphasis on psychological outcomes. Strengths of the study include comprehensive measurement of relevant outcomes and a relatively large projected sample size. Results from the ICON study should help inform policy and guide future research into the care and long-term outcomes of ICU patients.
Case Mix Programme
Hospital Anxiety and Depression Scale
Health-related Quality of Life
Intensive Care National Audit and Research Centre
Intensive Care Unit
National Health Service
Office of National Statistics
PTSD checklist (civilian)
Posttraumatic Stress Disorder
Patient Information Advisory Group
Quality-adjusted life years
Hayes JA, Black NA, Jenkinson C, Young JD, Rowan KM, Daly K, Ridley S: Outcome measures for adult critical care: a systematic review. Health Technol Assess. 2000, 4 (24): 1-111.
ATS: Fair allocation of intensive care unit resources. American Journal of Respiratory and Critical Care Medicine. 1997, 156: 1282-1301.
Angus DC, Carlet J: Surviving intensive care: a report from the 2002 Brussels Roundtable. Intensive Care Med. 2003, 29 (3): 368-377.
Eddleston JM, White P, Guthrie E: Survival, morbidity, and quality of life after discharge from intensive care. Crit Care Med. 2000, 28 (7): 2293-2299. 10.1097/00003246-200007000-00018.
Ridley S, Plenderleith L: Survival after intensive care. Anaesthesia. 1994, 49: 933-935. 10.1111/j.1365-2044.1994.tb04306.x.
Wright JC, Plenderleith L, Ridley SA: Long-term survival following intensive care: subgroup analysis and comparison with the general population. Anaesthesia. 2003, 58 (7): 637-642. 10.1046/j.1365-2044.2003.03205.x.
Broomhead LR, Brett SJ: Clinical review: Intensive care follow-up-what has it told us?. Crit Care. 2002, 6 (5): 411-417. 10.1186/cc1532.
Rattray JE, Johnston M, Wildsmith JA: Predictors of emotional outcomes of intensive care. Anaesthesia. 2005, 60 (11): 1085-1092. 10.1111/j.1365-2044.2005.04336.x.
Jones C, Griffiths RD, Humphris G, Skirrow PM: Memory, delusions, and the development of acute posttraumatic stress disorder-related symptoms after intensive care. Crit Care Med. 2001, 29 (3): 573-580. 10.1097/00003246-200103000-00019.
Griffiths RD, Jones C: Intensive care aftercare. 2002, Oxford , Butterworth Heinemann, 170.
Scragg P, Jones A, Fauvel N: Psychological problems following ICU treatment. Anaesthesia. 2001, 56 (1): 9-14. 10.1046/j.1365-2044.2001.01714.x.
Griffiths J, Fortune G, Barber V, Young JD: The prevalence of post traumatic stress disorder in survivors of ICU treatment: a systematic review. Intensive Care Med. 2007, 33 (9): 1506-1518. 10.1007/s00134-007-0730-z.
Jackson JC, Hart RP, Gordon SM, Hopkins RO, Girard TD, Ely EW: Post-traumatic stress disorder and post-traumatic stress symptoms following critical illness in medical intensive care unit patients: assessing the magnitude of the problem. Crit Care. 2007, 11 (1): R27-10.1186/cc5707.
Heyland DK, Guyatt G, Cook DJ, Meade M, Juniper E, Cronin L, Gafni A: Frequency and methodologic rigor of quality-of-life assessments in the critical care literature. Crit Care Med. 1998, 26 (3): 591-598. 10.1097/00003246-199803000-00037.
Ridley SA, Chrispin PS, Scotton H, Rogers J, Lloyd D: Changes in quality of life after intensive care: comparison with normal data. Anaesthesia. 1997, 52 (3): 195-202. 10.1111/j.1365-2044.1997.073-az0068.x.
Brooks R, Kerridge R, Hillman K, Bauman A, Daffurn K: Quality of life outcomes after intensive care. Comparison with a community group. Intensive Care Med. 1997, 23 (5): 581-586. 10.1007/s001340050376.
Niskanen M, Ruokonen E, Takala J, Rissanen P, Kari A: Quality of life after prolonged intensive care. Crit Care Med. 1999, 27 (6): 1132-1139. 10.1097/00003246-199906000-00035.
Dowdy D, Eid M, Sedrakyan A, Mendez-Tellez P, Pronovost P, Herrudge M, Needam D: Quality of life in adult survivors of critical illness: a systematic review of the literature. Intensive Care Medicine. 2005, 31: 611-620. 10.1007/s00134-005-2592-6.
Cuthbertson B, Scott J, Strachan M, Kilonzo M, Vale L: Quality of life before and after intensive care. Anaesthesia. 2005, 60: 332-339. 10.1111/j.1365-2044.2004.04109.x.
Brazier J, Roberts J, Deverill M: The estimation of a preference-based measure of health from the SF-36. Journal of Health Economics. 2002, 21: 271-292. 10.1016/S0167-6296(01)00130-8.
Ware JE, Snow KK, Kosinski M, Gandek B: SF-36 health survey: Manual and interpretation guide. 1993, Boston , The Health Institute
Badia X, Diaz-Prieto A, Gorriz MT, Herdman M, Torrado H, Farrero E, Cavanilles JM: Using the EuroQol-5D to measure changes in quality of life 12 months after discharge from an intensive care unit. Intensive Care Med. 2001, 27 (12): 1901-1907. 10.1007/s00134-001-1137-x.
Chrispin PS, Scotton H, Rogers J, Lloyd D, Ridley SA: Short Form 36 in the intensive care unit: assessment of acceptability, reliability and validity of the questionnaire. Anaesthesia. 1997, 52 (1): 15-23. 10.1111/j.1365-2044.1997.015-az014.x.
EuroQol--a new facility for the measurement of health-related quality of life. The EuroQol Group. Health Policy. 1990, 16 (3): 199-208. 10.1016/0168-8510(90)90421-9.
Zigmond AS, Snaith RP: The hospital anxiety and depression scale. Acta Psychiatrica Scandinavica. 1983, 67 (6): 361-370. 10.1111/j.1600-0447.1983.tb09716.x.
Cuthbertson BH, Hull A, Strachan M, Scott J: Post-traumatic stress disorder after critical illness requiring general intensive care. Intensive Care Med. 2004, 30 (3): 450-455. 10.1007/s00134-003-2004-8.
Blake DD, Weathers FW, Nagy LM, Kaloupek DG, Gusman FD, Charney DS, Keane TM: The development of a Clinician-Administered PTSD Scale. J Trauma Stress. 1995, 8 (1): 75-90.
Andrykowski MA, Cordova MJ, Studts JL, Miller TW: Posttraumatic stress disorder after treatment for breast cancer: prevalence of diagnosis and use of the PTSD Checklist-Civilian Version (PCL-C) as a screening instrument. J Consult Clin Psychol. 1998, 66 (3): 586-590. 10.1037/0022-006X.66.3.586.
Ruggiero KJ, Del Ben K, Scotti JR, Rabalais AE: Psychometric properties of the PTSD Checklist-Civilian Version. J Trauma Stress. 2003, 16 (5): 495-502. 10.1023/A:1025714729117.
Knaus WA, Draper EA, Wagner DP, Zimmerman JE: APACHE II: a severity of disease classification system. Crit Care Med. 1985, 13 (10): 818-829. 10.1097/00003246-198510000-00009.
The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1472-6963/8/132/prepub
Funding: This project is funded by the Intensive Care Society and the University of Oxford. The funding bodies had no role in the study design, manuscript writing or decision to submit the manuscript for publication.
The authors acknowledge the steering committee of the ICON study for their input into the initial drafting and development of the study protocol. The steering committee comprises Dr Brian Cuthbertson, Dr Saxon Ridley, Dr Judith Wright, Prof Nicholas Mayes, Dr Gillian Fortune, Dr David Harrison and Mr Barry Williams. The authors acknowledge Robert Hatch for the creation and on-going maintenance of the ICON database. The authors also acknowledge Danielle Fidge in her role as the original study coordinator.
The authors declare that they have no competing interests.
JAG, VSB and JDY contributed to the writing of the study protocol. The study was initiated by JDY.
John A Griffiths, Kayleigh Morgan, Vicki S Barber contributed equally to this work.
About this article
Cite this article
Griffiths, J.A., Morgan, K., Barber, V.S. et al. Study protocol: The Intensive Care Outcome Network ('ICON') study. BMC Health Serv Res 8, 132 (2008). https://doi.org/10.1186/1472-6963-8-132