Validation and comparison of instruments to identify frail patientes in primary care settings: Study protocol
BMC Health Services Research volume 16, Article number: 354 (2016)
In the last few years several indices and tools, aimed at identifying frail subjects in various care settings have been developed. However, to date none of them has been incorporated into usual practice in the primary care setting. The purposes of this study are: 1) to evaluate the predictive capacity of the Tilburg Frailty Indicator (TFI), the Gérontopôle Frailty Screening Tool (GFST) and the KoS model together with two biomarker levels (SOX2 and p16INK4a) for adverse events related to frailty; 2) to determine differences in the use of healthcare services according to frailty.
Prospective multicentre cohort study with a 2-year follow-up. The study will be performed in primary care centres of Gipuzkoa and Costa del Sol, both located in Spain. Autonomous, non-institutionalized individuals aged 70 and over that agree to participate in this study will constitute the study population. A total of 900 individuals will be randomly selected from the healthcare administrative data bases of the participating health services. Data will be collected at baseline and at 1 and 2 years. The main independent variables assessed at baseline will be TFI outcomes, GFST and the KoS model, together with the expression of SOX2 and p16INK4a levels. During follow-up, loss of autonomy, the occurrence of death and consumption of healthcare resources will be assessed.
The main focus of this work is the identification and evaluation of several instruments constructed under different rationales to identify frail subjects in primary care settings. The resulting outcomes have potential for direct application to the primary care practice. Early identification of the onset of functional impairment of elderly is an essential, still unresolved aspect in the prevention of dependence in the scope of primary care.
Ageing is accompanied by a series of physiological changes which lead to a gradual loss of adaptation to the demands of the environment and increased vulnerability. The most severe expression of ageing is the clinical condition of frailty . This is defined by the gradual reduction in resilience and reserve capacities leading to an overall deterioration in health. This deterioration can subsequently progress to dependence, intensive use of healthcare resources, and death [2, 3]. Frailty is a powerful indicator of the state of health of the elderly  but progress needs to be made to understand the process of frailty, its onset, its determining factors and consequences .
In the last few years several indices and tools aimed at identifying frail subjects in various care settings have been developed. However, to date none of them has been incorporated into usual practice in a primary care setting.
Instruments based on rules: their construction is based on multiple regression analysis models. This group includes, among others: a) The frailty phenotype model proposed by Fried in 2001, that evaluates the presence of five criteria: slow walking speed, reduced grip strength, low physical activity, exhaustion and unintentional weight loss , b) The Tilburg Frailty Indicator (TFI), that has been considered [5, 8] as the most suitable to be used in primary care due to its simplicity and psychometric characteristics , and c) The KoS model, a new model developed by this investigation group, which considers the age of the subject, the presence of polipharmacy and the Timed Up and Go (TUG) test results .
Instruments based on clinical judgement: these instruments are designed to classify individuals based on the clinical history and the clinician’s knowledge and assessment. Two instruments are included in this group: a) the Clinical Frailty Scale (CFS) , from the Canadian Study of Health and Ageing (CSHA) group, and b) the Gérontopôle Frailty Screening Tool (GFST) .
Frailty biomarkers: a total of 63 different possible frailty biomarkers (genes) have been suggested. Most of these genes are involved in oxidative stress, inflammation and metabolism although there is no clear consensus on their validity [13, 14]. Interleukin 6 (IL-6) is probably the most standardised marker for this purpose . However, it is of major interest to explore new frailty markers. It is well-known that ageing is associated with a reduction in the regenerative tissue properties. Given that the regenerative capacity of tissues relies on stem cells, ageing and frailty may be at least partially, a consequence of a disorder in stem cell regulation . The transcription factor SOX2 (denominated from Sex determining region Y-related HMG box2) is very important in the biology of stem cells. Also it is one of the 4 factors necessary to re-programme differentiated cells in induced pluripotent stem cells , to ensure capacity for self-renovation of this cell population [16–20] and regulate their de-differentiated state [16–18]. Surprisingly, its function in tissue and in the ageing body still needs to be investigated. Interestingly, it is known that its expression reduces in different brain areas with ageing . These results indicate that reduced SOX2 levels may be a marker of the ageing process and is suggested as a possible biomarker of frailty. Additionally, the tumour suppressor p16INK4a, which is an inhibitor of the cell cycle progression and an important mediator of cellular senescence has been postulated as a biomarker of ageing [21, 22] and could also represent an indicator of frailty.
Frail subjects present a high rate of adverse events such as dependence, institutionalisation or death. In the Fried 2001 study the prevalence of hospitalisation of frail patients was 59 % in the first year compared to 33 % in the non-frail population . These data lead to the hypothesis that, in our setting, frailty may be associated with a different pattern of health resources consumption. Frail individuals are expected to do a more frequent and intensive use of the available healthcare resources.
The goal of this project is to evaluate the predictive capacity of the TFI, GFST, KoS model, as well as of the SOX2 and p16INK4a levels for adverse events related to frailty. An additional objective is to describe the existing differences in the pattern of healthcare services use according to frailty status.
Prospective multicentre cohort study with a two-year follow-up of autonomous and community dwelling subjects aged 70 and over.
The study will be performed in the primary care areas of Gipuzkoa and Costa del Sol, in the north and south shores of Spain. At these locations, primary care services provide care to 384,683 and 473,478 users of whom 11 % are aged 70 and over.
Autonomous (Barthel test >90 points), not institutionalised individuals (living at their home or with a family member) aged 70 and over, who agree to participate in the study. Subjects in a terminal situation defined according to the guidelines of the Spanish Society of Palliative Care , those who reside more than 6 months per year in a different area and those with difficulty communicating in Spanish or Basque (in Gipuzkoa area only), will be excluded from the study. Patients will be randomly selected from the administrative databases of the participating healthcare services. The sample will be representative of the populations of interest in terms of age and sex.
Essential socio-demographic information related to all patients who comply with the selection criteria will be collected with the purpose of comparing subjects who finally participate to those who refuse or abandon. A detailed overview of the planned flow of participants is provided in Fig. 1.
The variables collected throughout the study are presented in Table 1.
The occurrence of adverse events related to frailty, mainly loss of autonomy, defined as Barthel ≤90 . Death is considered to be an adverse event associated with frailty, but it is not planned to be studied as a single outcome as its expected frequency would not allow it (details in sample size section). Loss of autonomy and death will be studied jointly during a secondary analysis phase.
The consumption of healthcare resources considering the number of primary care consultations by medical and nursing staff, the number of visits to the emergency department, number of specialised consultations, number of hospital admissions and days of stay, number of admissions in short stay departments.
Main independent variables
The Tilburg Frailty Index (TFI) is a self-administered questionnaire that takes 14 min to fill in. It contains 15 items split into three components: physical, psychological and social. It collects information on the degree of autonomy, cognitive capacity, mood, physical functionality and social network support. Its total score ranges from 0 to 15 points. This questionnaire is being translated and validated in Spanish by the present investigation group.
The Gérontopôle Frailty Screening Tool (GFST) is designed to be administered to people aged 65 and over, autonomous, without concurrent acute clinical pathology. It is comprised of an initial questionnaire guiding the doctor to assess some general signs or symptoms that could suggest the presence of an unidentified frailty situation. In a second section the professional is asked to express their clinical opinion on the existence of frailty. The final GFST tool result is based on this very clinical opinion.
The KoS model is comprised of the individual’s age at the time of the interview, the presence of polipharmacy, considered as the consumption of four or more prescribed medicines and the result of the TUG test . The KoS model (publication under review) presents an area under the curve (AUC) of 0.822.
The expression of SOX2 and p16INK4a will be measured in a blood obtained from a subsample of patients. First, these samples will undergo an RNA purification by means of the RNeasy Kit (Qiagen). The RNA will be retro transcribed using the reverse transcription cDNA High Capacity kit of Applied Biosystems. Then, the expressions of SOX2 and p16INK4a will be determined by means of quantitative PCR (qPCR) using specific primers or probes and the equipment ABI Prism® SDS 7300 Real Time PCR System from Applied Biosystems. Expression levels will be standardised with those for expression of the enzyme Glyceraldehyde-3-Phosphate Dehydrogenase (GAPDH) and compared to the IL-6 levels which will be studied in parallel.
Secondary independent variables
Socio-demographic data: Date of birth, sex, level of studies, income level and place of residence.
Healthcare-related lifestyle: 1) Physical activity measured with the Short Physical Performance Battery (SPPB), which includes evaluation of balance, gait speed and getting up and sitting in a chair . 2) Tobacco consumption: three items have been included to establish smoking habits according to the WHO . 3) Screening for malnutrition, evaluated with the Mini Nutritional Assessment test .
State of health: 1) Self-perceived health measured with a single item: “Overall, you would say your health is…” with five response options: excellent, very good, good, fair, and poor, 2) Health-related quality of life evaluated using the EQ-5D questionnaire (EuroQuol Group) , 3) Cognitive status with the Mini Mental State Examination (MMSE) , 4) Existence of geriatric syndromes: visual and auditory deficits, the occurrence of falls during the year prior to inclusion, 5) Comorbidity measured by the Cumulative Illness Rating Scale  and the Charlson Comorbidity Index  and 6) Prescription drugs. This information will be collected by means of personal interviews and from the clinical records.
Functional autonomy and capacity: reflects the capacity to perform basic and instrumental activities of daily living. The Barthel Index will be used to evaluate basic activities and the Lawton and Brody scale will be used to assess instrumental ones .
The experience of this investigation group with similar data, leads to the hypothesis that at the end of follow-up 15 to 20 % of the recruited subjects will have become dependent according to the defined criteria. Thus, for a total of 650 subjects it is calculated that 100 to 130 will present this event. Following the rule of 10 events per variable for the logistic regression models, the expected distribution in the two outcome groups (the one presenting adverse events related to frailty and the group not presenting them), will allow to construct logistic regression models considering several indices at the same time, in case a simultaneous effect is suggested when predicting the adverse event. It will also enable studying the predictive capacity of categorised indices which generally increase the requirements of the total N. This N should also allow for possible subgroup analyses if so indicated by the data.
It is estimated that death will occur in a much lower percentage, not more than 5 %. Because of its expected low-frequency, this result will not be studied individually. In addition, it is expected that approximately 20 % of the recruited subjects will not attend the arranged appointment with the study personnel or will not provide informed consent, and therefore will have to be excluded from the study. Similarly, another 20 %, will not provide data at the end of the study for various other reasons. Considering these follow-up losses the initial sample size has to be increased by 40 %, recruiting a total of 900 subjects (450 in each setting).
Genetic analyses will be performed in a subsample of 100 subjects (50 in each setting) randomly selected considering their frailty status measured by the TFI. This approach is used to ensure the feasibility of the project given the level of resources required to perform the genetic expression analyses proposed.
All selected subjects will be contacted by letter and phone and will receive information about the project. Those interested in participating will undergo the Barthel test. Subjects with a Barthel ≤90 will be excluded. Basic socio-demographic data of subjects who decline participation will be collected and analysed with the purpose of identifying possible selection or participation bias.
Those interested will be informed in detail about the study; will sign an informed consent and will undertake a baseline assessment performed by a trained nurse. Blood samples will be extracted in the selected subsample. Information on current clinical diagnoses and consumption of medicines will be obtained from the clinical records.
The variables related to the use of healthcare resources will be obtained from the electronic clinical records and the administrative databases of the healthcare services. Autonomy status will be assessed with the Barthel test at 1 and 2 years through a telephone interview. The event of death will be checked on clinical records.
Statistical analysis plan
The study unit is the patient. Categorical variables will be described with frequencies and percentages and continuous variables with means and standard deviations (SD) or medians and interquartile ranges (Q1, Q3), according to their degree of symmetry. Categorical variables will be compared with the chi-square or Fisher’s exact test. Continuous variables with a Normal distribution will be compared with the Student’s t-test and the non-parametric Wilcoxon rank-sum test will be implemented for variables with distributions other than Normal. The following statistical analysis plan will be performed:
Association between different indices: The relationship between the scores of different indices as well as with biomarkers’ levels will be examined with the Pearson’s and Spearman’s correlation coefficients. Point estimates of these correlations and their 95 % confidence intervals (95 % CI) will be provided. Concordance between the tests after categorising patients according to cut-off points established in the scientific literature will also be examined. This concordance will be studied with the Kappa coefficient.
Outcome of dependence during follow-up: The relationship of all implemented indices with dependence (yes/no) at the end of the study will be verified. This relationship will be studied by means of binary logistic regression models. In any case, the predictive capacity of the indices will be verified considering them both as continuous and as categorical variables, according to published references when available. In case there are no publications (e.g. SOX2) possible cut-off points will suggested by means of ROC curves. During this analysis phase the external validation of the KoS model, applied to this cohort of subjects, will also be examined. The predictive effect of each index, both univariate and multivariate will be studied. The aim is to study whether the simultaneous consideration of more than one of the included indices can improve the prediction of this adverse event and also quantify this improvement in terms of AUC, sensitivity and specificity of the derived probabilities.
Differences in terms of resources consumption by frail and non-frail subjects: Frequency of consumption as well as duration of possible hospital admissions will be compared between the two groups. These data usually follow skewed distributions therefore comparisons will most likely be performed by means of median differences. Confidence intervals will be estimated and non-parametric statistics will be used in these cases.
All statistical analyses will be performed with the SAS 9.3 and the R 3.1.0 software.
The priority of frailty in the context of research in healthcare services is highlighted, among others, by the European Commission report on ageing (2012) which specifies that “the reduction of disability and dependence by means of appropriate measures in the frailty process should be at the forefront of innovation in all healthcare policies” .
This project is aimed to increase the evidence of suitable instruments able to identify frail subjects in primary care settings and to study the use of healthcare services of these subjects. The identification of frail subjects is highly relevant because it can help to design interventions adapted to their needs, which in turn could help stopping or at least delaying the natural advance towards dependence. Primary care is the most appropriate setting to identify frail individuals because of its proximity and accessibility . In this healthcare setting, the identification of frailty should be simple and require little time .
The main limitation of this work is related to the possibility of having a representative sample of the non-dependent elderly population in our setting given the tendency of subjects with better heath to be more likely to participate. This can limit the incidence of adverse events sought during follow-up. For this reason, a sample of advance age was selected in which the likelihood of occurrence of these events is greater.
Another limitation is the expected rate of losses to follow-up. To reduce these losses, contact data will be verified and additional contacts (carer, spouse or descendants) will be requested in order to maintain close contact with the participants.
The main focus of this study is the evaluation of instruments and strategies for identifying frail subjects, a goal that has major potential for direct application on primary care settings. Early identification of the onset of functional impairment in elderly subjects is an essential but still unresolved aspect in the prevention of dependence. The final goal of this study is to offer to the scientific community a suitable instrument to identify frail individuals in the primary care setting.
CFS, Clinical Frailty Scale; CSHA, Canadian Study of health and Aging; EuroQuol Group, EQ-5D questionnaire; GFST, Gérontopôle Frailty Screening Tool; IL-6, Interleukin 6; MMSE, Mini Mental State Examination; SD, standard deviations; SOX2, (denominated from Sex determining region Y-related HMG box2); SPPB, the Short Physical Performance Battery; TFI, Tilburg Frailty Indicator; TUG, Timed Up and Go test; WHO, World Health Organization
Clegg A, Young J, Iliffe S, Rikkert MO, Rockwood K. Frailty in elderly people. Lancet. 2013;381(9868):752–62.
Fried LP, Tangen CM, Walston J, Newman AB, Hirsch C, Gottdiener J, et al. Frailty in older adults: evidence for a phenotype. J Gerontol A Biol Sci Med Sci. 2001;56(3):M146–56.
Strandberg TE, Pitkälä KH. Frailty in elderly people. Lancet. 2007;369(9570):1328–9.
Santos-Eggimann B, Karmaniola A, Seematter-Bagnoud L, Spagnoli J, Büla C, Cornuz J, et al. The Lausanne cohort Lc65+: a population-based prospective study of the manifestations, determinants and outcomes of frailty. BMC Geriatr. 2008;8:20.
Pialoux T, Goyard J, Lesourd B. Screening tools for frailty in primary health care: a systematic review. Geriatr Gerontol Int. 2012;12(2):189–97.
Polidoro A, Dornbusch T, Vestri A, Di Bona S, Alessandri C. Frailty and disability in the elderly: a diagnostic dilemma. Arch Gerontol Geriatr. 2011;52(2):e75–8.
Rodríguez-Mañas L, Féart C, Mann G, Viña J, Chatterji S, Chodzko-Zajko W, et al. Searching for an operational definition of frailty: a Delphi method based consensus statement: the frailty operative definition-consensus conference project. J Gerontol A Biol Sci Med Sci. 2013;68(1):62–7.
Hoogendijk EO, van der Horst HE, Deeg DJ, Frijters DH, Prins BA, Jansen AP, et al. The identification of frail older adults in primary care: comparing the accuracy of five simple instruments. Age Ageing. 2013;42(2):262–5.
Gobbens RJ, van Assen MA, Luijkx KG, Wijnen-Sponselee MT, Schols JM. The Tilburg Frailty Indicator: psychometric properties. J Am Med Dir Assoc. 2010;11(5):344–55.
Vergara I, Machón M, Vrotsou K, Egües N, Bueno A, Nuñez J, Martín-Lesende I, Martín A, Carrasco E, Díez A. Concordance between tools for the detection of community dwelling frail adults: Study protocol. Healthy Aging Res. 2015;4:7.
Rockwood K, Song X, MacKnight C, Bergman H, Hogan DB, McDowell I, et al. A global clinical measure of fitness and frailty in elderly people. CMAJ. 2005;173(5):489–95.
Vellas B, Balardy L, Gillette-Guyonnet S, Abellan Van Kan G, Ghisolfi-Marque A, Subra J, et al. Looking for frailty in community-dwelling older persons: the Gérontopôle Frailty Screening Tool (GFST). J Nutr Health Aging. 2013;17(7):629–31.
López-Otín C, Blasco MA, Partridge L, Serrano M, Kroemer G. The hallmarks of aging. Cell. 2013;153(6):1194–217.
Leng S, Chaves P, Koenig K, Walston J. Serum interleukin-6 and hemoglobin as physiological correlates in the geriatric syndrome of frailty: a pilot study. J Am Geriatr Soc. 2002;50(7):1268–71.
Sarkar A, Hochedlinger K. The sox family of transcription factors: versatile regulators of stem and progenitor cell fate. Cell Stem Cell. 2013;12(1):15–30.
Takahashi K, Yamanaka S. Induction of pluripotent stem cells from mouse embryonic and adult fibroblast cultures by defined factors. Cell. 2006;126(4):663–76.
Arnold K, Sarkar A, Yram MA, Polo JM, Bronson R, Sengupta S, et al. Sox2(+) adult stem and progenitor cells are important for tissue regeneration and survival of mice. Cell Stem Cell. 2011;9(4):317–29.
Favaro R, Valotta M, Ferri AL, Latorre E, Mariani J, Giachino C, et al. Hippocampal development and neural stem cell maintenance require Sox2-dependent regulation of Shh. Nat Neurosci. 2009;12(10):1248–56.
Brazel CY, Limke TL, Osborne JK, Miura T, Cai J, Pevny L, et al. Sox2 expression defines a heterogeneous population of neurosphere-forming cells in the adult murine brain. Aging Cell. 2005;4(4):197–207.
Crome P, Lally F. Frailty: joining the giants. CMAJ. 2011;183(8):889–90.
Krishnamurthy J, Torrice C, Ramsey MR, Kovalev GI, Al-Regaiey K, Su L, et al. Ink4a/Arf expression is a biomarker of aging. J Clin Invest. 2004;114(9):1299–307.
Molofsky AV, Slutsky SG, Joseph NM, He S, Pardal R, Krishnamurthy J, et al. Increasing p16INK4a expression decreases forebrain progenitors and neurogenesis during ageing. Nature. 2006;443(7110):448–52.
Guía de la Sociedad Española de Cuidados Paliativos. Sociedad Española de Cuidados Paliativos. http://www.secpal.com/%5C%5CDocumentos%5CPaginas%5Cguiacp.pdf.
Baztán JJ, Pérez del Molino J, Alarcón T, San Cristóbal E, Izquierdo G, Manzabeitia I. Índice de Barthel: Instrumento válido para la valoración funcional de pacientes con enfermedad cerebrovascular. Rev Esp Geriatr Gerontol. 1993;28:32–40.
Mathias S, Nayak US, Isaacs B. Balance in elderly patients: the “get-up and go” test. Arch Phys Med Rehabil. 1986;67(6):387–9.
Cabrero-García J, Muñoz-Mendoza CL, Cabañero-Martínez MJ, González-Llopís L, Ramos-Pichardo JD, Reig-Ferrer A. [Short physical performance battery reference values for patients 70 years-old and over in primary health care]. Aten Primaria. 2012;44(9):540–8.
Preguntas sobre tabaco destinadas a encuestas. Serie de preguntas básicas de la Encuesta Mundial de Tabaquismo en Adultos (internationally known as Global Adult Tobacco Survey - GATS). 2ª Edición. Organización Mundial de la Salud. http://www.who.int/tobacco/publications/surveillance/tqs_es_final.pdf.
Vellas B, Villars H, Abellan G, Soto ME, Rolland Y, Guigoz Y, et al. Overview of the MNA--its history and challenges. J Nutr Health Aging. 2006;10(6):456–63. discussion 463–5.
Badia X, Roset M, Montserrat S, Herdman M, Segura A. [The Spanish version of EuroQol: a description and its applications. European Quality of Life scale]. Med Clin (Barc). 1999;112 Suppl 1:79–85.
Lobo A, Saz P, Marcos G, Día JL, de la Cámara C, Ventura T, et al. Revalidation and standardization of the cognition mini-exam (first Spanish version of the Mini-Mental Status Examination) in the general geriatric population. Med Clin (Barc). 1999;112(20):767–74.
Parmelee PA, Thuras PD, Katz IR, Lawton MP. Validation of the Cumulative Illness Rating Scale in a geriatric residential population. J Am Geriatr Soc. 1995;43(2):130–7.
Charlson M, Szatrowski TP, Peterson J, Gold J. Validation of a combined comorbidity index. J Clin Epidemiol. 1994;47(11):1245–51.
Vergara I, Bilbao A, Orive M, Garcia-Gutierrez S, Navarro G, Quintana JM. Validation of the Spanish version of the Lawton IADL Scale for its application in elderly people. Health Qual Life Outcomes. 2012;10:130.
Rodríguez-Artalejo F, Rodríguez-Mañas L. The frailty syndrome in the public health agenda. J Epidemiol Community Health. 2014;68(8):703–4.
Lacas A, Rockwood K. Frailty in primary care: a review of its conceptualization and implications for practice. BMC Med. 2012;10:4.
De Lepeleire J, Degryse J, Illiffe S, Mann E, Buntinx F. Family physicians need easy instruments for frailty. Age Ageing. 2008;37(4):484.
The authors want to thank the language edition services provided by INC.
This study was supported by grants from the Instituto de Salud Carlos III jointly funded by the European Fund for Regional Development - FEDER; files PI14/01905 and PI14/01003.
Availability of data and material
The data of this study is stored in the server of our organization. Whoever wishes to have access to it, can contact the first author.
We hereby declare that all listed authors have made substantial contributions to the research design and to drafting the paper or revising it critically; all authors approved the submitted version. IV, FRR, MM, ECF, and EC designed the study, KV designed the statistical analysis proposal, TTS, YMB, AB; JN, AML, ANV, RQL and ADR defined the clinical assessment. IV, FRR, MM and KV wrote the initial draft of the manuscript and ECF, EC, TTS, YMB, AB; JN, AML, ANV, RQL, ADR, CSF and GA participated in the writing of the final version.
The investigators in the research group declare that they have no competing interests in connection with this study.
Consent for publication
Ethics approval and consent to participate
The project has been approved by the respective Clinical Research Ethics Committees and Research Committees for each site with the following record: (CEIC Euskadi 01/2015) and (CEI Costa del Sol n° exp. 11Nov2014 PR Fragilidad).
This study will comply with the Declaration of Helsinki and Spanish law on patient rights’ protection (Law 15/2002). No clinical data outside the scope of those mentioned above will be collected. All available data will be recorded anonymously and in strict compliance with prevailing Spanish data protection laws (Spanish Law 41/2000 of 14 November; Spanish Law 15/1990 of 15 December).
All participants, after receiving comprehensive information about the project, will sign an informed consent form already approved by the Ethics Committees of Euskadi and Costa del Sol.
About this article
Cite this article
Vergara, I., Rivas-Ruiz, F., Vrotsou, K. et al. Validation and comparison of instruments to identify frail patientes in primary care settings: Study protocol. BMC Health Serv Res 16, 354 (2016). https://doi.org/10.1186/s12913-016-1540-1