Self-reported social class in adolescents: validity and relationship with gradients in self-reported health
BMC Health Services Research volume 7, Article number: 151 (2007)
Analyzing social differences in the health of adolescents is a challenge. The accuracy of adolescent's report on familial socio-economic position is unknown. The aims of the study were to examine the validity of measuring occupational social class and family level of education reported by adolescents aged 12 to 18, and the relationship between social position and self-reported health.
A sample of 1453 Spanish adolescents 12 to 18 years old from urban and rural areas completed a self-administered questionnaire including the Child Health and Illness Profile-Adolescent Edition (CHIP-AE), and data on parental occupational social class (OSC) and level of education (LE). The responsible person for a sub-sample of teenagers (n = 91) were interviewed by phone. Kappa coefficients were estimated to analyze agreement between adolescents and proxy-respondents, and logistic regression models were adjusted to analyze factors associated with missing answers and disagreements. Effect size (ES) was calculated to analyze the relationship between OSC, LE and the CHIP-AE domain scores.
Missing answers were higher for father's (24.2%) and mother's (45.7%) occupational status than for parental education (8.4%, and 8.1% respectively), and belonging to a non-standard family was associated with more incomplete reporting of social position (OR = 4,98; 95%CI = 1,3–18,8) as was agreement between a parent and the adolescent. There were significant social class gradients, most notably for aspects of health related to resilience to threats to illness.
Adolescents can acceptably self-report on family occupation and level of education. Social class gradients are present in important aspects of health in adolescents.
Measurement of social difference in health of adolescents presents challenges not present in the study of social gradients in health among adults. Reports of socio-economic position by adults are assumed to be accurate but the accuracy of child reports is unknown [1, 2]. Indicators based on occupation, education or income have been used to assess socio-economic position [3, 4]. With the mass entry of women into the labor market and with the emergence of new family structures, determining the socio-economic status of children and adolescents on the basis of the father's occupation may no longer be an adequate representation of family socioeconomic position. In self-administered adolescent questionnaires, up to 40% or responses on paternal occupation are invalid or missing, which has prompted the development of other measures of material well-being that are easier to elicit [5–7].
The accuracy of responses has been positively associated with age and the nearness in time and space with the parental characteristics being investigated . The level of agreement between adolescents and proxy-respondents reporting education and occupation has been shown as moderate [9, 10] improving with age, and worsening when the adolescent does not live with the parent about whom information is being asked. No gender differences were found.
In terms of analyzing social differences in health, the measurement of adolescent health is a challenge. In the last decade a number of questionnaires have been developed which attempt to measure self-perceived health and health-related quality of life, which have proved to be sensitive to social inequalities. The Child Health and Illness Profile – Adolescent Edition (CHIP-AE)  is a generic self-administered questionnaire developed in the United States and which has been adapted in Spain, with acceptable reliability and validity [12, 13].
The objectives of this study were to examine the validity of measuring occupational social class (OSC) and family level of education (LE), reported by adolescents aged 12 to 18, and the relationship between social position and self-reported health.
Study design and sample selection
This study was carried out during the academic year 1999–2000 with ethical approval of the Research Committee of the School of Public Health of Catalonia. Before administering the questionnaires, consent to participate was asked to all selected schools. Letters were sent to parents with information about the study and to request their consent for their children to participate in the study. A sample of adolescents aged 12–18 was selected in secondary schools in an urban area (Barcelona) and a rural area (Piera) during the academic year 1999–2000 (n = 1774). The urban sample was selected using a two-stage sampling design. The schools were categorized in public or private/subsidized, and according to the Family Economic Capacity Index (ICEF) . This aggregate index categorizes the socio-economic level of schools according to their neighborhood and was stratified in three levels (high, medium and low). In the following stage, school classes were chosen to include all educational levels in each stratum, and all students in each of the selected classes. The rural sample was chosen by systematic sampling of all adolescents of 12–18 enrolled at the two secondary schools in the village (one public and one private).
The instrument (CHIP-AE) was self-administered, and the research team and school staff organized the session to minimize disturbance of the school's educational program. Data was collected by a research team member (VSS) while the teacher was in the classroom most of the times.
The sub-sample for the study of agreement between adolescents and parents was selected from one public secondary school of a medium ICEF area in the urban area. Parents of the interviewed students (n = 160) were selected to take part in a telephone interview about socio-demographic data, including some questions from CHIP-AE. The interview was conducted during the same academic term as the adolescents' self-questionnaire. A minimum of 5 calls were made, at different times of day, to try to contact the parent primarily responsible for each adolescent.
The socio-demographic variables analyzed were: age (12–15 and 16–18); sex; area (rural or urban), and the type of school (public and private/subsidized). Family type was analyzed on the basis of the number of people living in the house and relationship with the adolescent, in three groups: "standard"(the adolescent lived with both parents only); "single-parent" (living with one parent only), and "other" (other adults present). This characteristic was subsequently recoded into two: "standard family" as before, and "non-standard family" which includes the categories of "single-parent" and "other".
Information on the occupation of both parents was collected using an open question. One of the researchers (VSS) classified the responses into 9 categories according to the National Spanish Classification of Occupations, and after that occupational social class (OSC) was assessed by categorizing occupations according to the 5 categories (I–V) set out by the Spanish Society of Epidemiology  and later combined into three groups: classes I–II representing management staff in commerce and public administration and professions with university degrees; class III representing technical and support staff; and classes IV–V representing qualified and unqualified manual workers. The variables analyzed on OSC are: paternal, maternal and highest OSC, which reflects the highest social class within the family. The working situation of the father and mother separately were classified under 9 categories: full-time work, part-time work, unemployed, retired, receiving sickness benefit, student, deceased, not known and, in the case of women, the additional category of housewife. Family level of education (LE) was determined on the basis of the highest level completed by either the father or mother, in 6 categories subsequently reduced to 3: primary school or lower; secondary level (baccalaureate or technical training) and university qualifications. In accordance with recommendations to broaden the concept of socioeconomic position measurement, we also ascertained receipt of unemployment benefit, free school meals and other benefits was gathered through a yes/no question.
The variables collected in phone interviews with the parents included: highest maternal/paternal OSC; working situation of the father and mother; highest maternal/paternal LE; whether in receipt of free meals and other benefits. These variables were categorized in the same manner as for the sample of the adolescents.
Health status measurement
The CHIP-AE questionnaire contains 183 questions divided in 6 domains and 20 sub-domains. Satisfaction covers satisfaction with health and self-esteem (12 items); Discomfort covers physical and emotional discomfort and limitations of activity (45 items); Resilience covers family involvement, social problem-solving, physical activity and home safety and health (31 items); Risks covers individual risks, threats to achievement and peer influence (38 items); Achievement covers academic and work performance (11 items); and Disorders contains a list of illnesses, injuries and impairments (45 items). The score of each sub-domain is obtained from the mean of the responses using a Likert type scale between 1 and 5; and each domain score is obtained from the mean score of its subdomains. In order to facilitate interpretation of the scoring, the domains have been standardized to an arbitrary mean of 50 and a standard deviation (SD) of 10, based on the individual score and the mean of the reference group. Mean scores for the Barcelona adolescents have been taken as the standard population . Higher scores indicate better health in all domains.
1. Completeness and validity of responses
The responses "no answer" and "don't know" to the question about parent's working situation were analyzed together as the percentage of "don't know" was very low and there were no differences in terms of age, gender, type of family, ICEF, type of school area, nor in family level of education or reception of benefits, between adolescents who answered "don't know" and adolescents with missing values. The missing responses (no answer or don't know) in all variables of socio-economic level were analyzed in terms of age, sex, family type, LE, OSC, location, type of school and ICEF in the urban area. The factors associated with no-responses on OSC and LE were analyzed using multivariate logistic regression, controlling for the effect of socio-demographic variables. Response/no-response was considered as a dependent variable of different socio-economic variables (0 response, 1 missing or "don't know") and as a predictive variable for LE (in social class), OSC (in LE) and the domains Satisfaction, Discomfort, Resilience, Risks and Academic achievement of CHIP-AE categorized in 2 (0: score > percentile 25; 1: score ≤ p25).
The association between self-reported OSC and LE, and the type of school (public and private/subsidized), or ICEF (only in the urban sample) were analyzed by means of Chi Square.
The percentages of agreement and kappa coefficients  were estimated between the responses of the adolescents and those of the proxy-respondents to questions about OSC, education, and receipt of benefits (unemployment benefit, support or scholarships). The analysis of agreement was also stratified by age, sex and family type. Logistic regression models were adjusted taking as a dependent variable the agreement/disagreement of the responses of the adolescents and the informants about paternal, maternal and highest OSC, and paternal, maternal and highest LE, and as predictive variables age, sex and family type, as well as the domains of the CHIP-AE
2. Health Status and socioeconomic position
The mean scores for the CHIP-AE domains in each category of OSC and LE were calculated, from which was obtained the effect size (ES) between groups as a standard measure of the relative size of the difference between the groups compared in pairs . Following convention, values above 0.8 represent a high size effect, 0.5 – 0.8 a moderate effect, and between 0.2 and 0.49 low.
A total of 1453 adolescents was included in the final analysis (response rate = 82%, average age 14.9). 259 adolescents were absent on the day of questionnaire administration and in 62 cases, parents refused permission for their children to participate in the study. 60% were aged less than 16; 51.2% were boys; 60.1% came from the urban sample of which 17.3% lived in a neighborhood with a low ICEF (table 1). Eighty percent lived in a standard family with both parents. In 50.7% the highest level of education in the family was primary, and 54.5% belonged to the least privileged social class (IV–V).
Responses were received from 91 of the 160 proxy-respondents (response rate = 56%). Mothers were the principal informants (83/91). Distribution of socio-demographic variables for the sub-sample of adolescents whose proxy-respondents were interviewed and the rest of the adolescents were similar, except that there were a higher proportion of families with a secondary level of education and with paternal OSC IV–V in the sub-sample of adolescents whose parents participated in the study. No differences were found in adolescents' health status between participants and non-participants.
1. Completeness and validity of responses
Paternal and maternal OSC was missing in 24.2% and 45.7% of adolescent reports (table 1). Table 2 shows the logistic regression models of the non-responses on socio-economic variables adjusted by age, sex, location and family type. The probability of a non-response on paternal LE was higher when the adolescent was younger (OR = 4.28, 95%CI = 2.46 – 7.45). Factors associated with non-response on maternal LE were age less than 16 (OR = 6.95, 95%CI = 3.61 – 13.36), and male gender (OR = 1.63, 95%CI = 1.07 – 2.47). Non-response on paternal OSC was associated with belonging to a non-standard family (OR=2.48; 95%IC 1.85-3.32). In contrast, non-response on maternal OSC was associated with being over 16 (OR = 0.74; 95%CI = 0.59 – 0.94), masculine gender (OR = 1.41; 95%CI = 1.12 – 1.74), and living in the rural area (OR = 1.46; 95%CI = 1.16 – 1.84). Non-response on the highest OSC was associated with being a boy (OR = 1.41; 95%CI = 1.02 – 1.95), belonging to a non-standard family (OR = 1.89; 95%CI = 1.32 – 2.72), and living in the rural area (OR = 1.57; 95%CI = 1.13 – 2.19).
Figure 1 shows the distribution of parental occupational social class and level of education by the type of school. Adolescents in private schools reported higher percentage of paternal and maternal occupational social class I–II than adolescents in public schools (35% vs 12%, p < 0.05 for paternal OSC). Adolescents in private schools also reported higher percentage of paternal and maternal university degree than adolescents in public schools (15% vs 5%, p < 0.05 for maternal LE). Similar results were found in the urban sample comparing OSC and LE by ICEF (data not shown).
The percentages of agreement between adolescents and their parents in the urban sample ranged from 87.7% for paternal OSC to 63.6% for highest LE (table 3). The kappa values were lower for LE (kappa range = 0.39 – 0.51) than for OSC (kappa range = 0.52 – 0.77). No differences in agreement was found after stratifying by age, sex and family type. Disagreement on paternal OSC was greater in non-standard families (OR = 4.9; 95%CI = 1.3 – 18.8), a finding similar to that of the highest OSC (OR = 4.63; 95%CI = 1.11 – 19.3) (table 4).
2. Relationship between socio-economic status and health
Higher scores in the domains of Satisfaction and Discomfort were found among boys and in adolescents with 2-parent standard families with a low effect size (table 5). No differences were found between the score in these domains and the LE and OSC. Differences were observed in the Resilience domain according to the LE (paternal, maternal and highest), with low effect size between the extremes (primary level vs. university degree). A similar finding was observed with the OSC, with the highest scores in the more advantaged social classes (I–II), and low effect size between the extremes (I–II vs. IV – V), for paternal OSC (effect size = 0.3), maternal OSC (effect size = 0.44). In the case of maternal OSC, a difference between social classes I – II and III was also observed. In the Risk domain, significant differences were noted according to the age of the adolescent, with lower scores in older respondents, and a high ES (0.87). Adolescents from non-standard families presented worse scores in the Risk domain, with a low effect size. Children of parents with secondary LE presented a lower (worse) score in Risks (ES = 0.23) compared to children of parents with university qualifications. For adolescents over 15, the score in the sub-domain of academic achievement was lower than that of those under 15, with an effect size = 0.47. Differences were also noted in academic achievement, with highest scores in those from families with a high LE (whether paternal, maternal or highest) and where the maternal OSC was I – II, in both cases with a low effect size.
The present study has attempted to help researchers to decide on which indicator of socioeconomic position could be used in adolescents, and to analyze the influence of socioeconomic position on self-perceived health. Occupational social class is an indicator widely used in adults while adolescents are in general excluded from this analysis.
Although one in seven adolescents didn't allow to assign the family's occupational social class, overall, adolescents' reports provide valid information about their family socioeconomic status. The response to the question about the LE of both parents was more exhaustive, but with a low level of agreement between adolescents and their mothers, when compared with the OSC.
The percentage of missing responses about parental OSC and LE are similar to those of other studies [9, 10]. Girls answered more exhaustively than boys, although for those over 15 this only happened in relation to questions covering LE. As a consequence, younger adolescents could answer questions about OSC in an acceptable manner. Questions about OSC presented more missing responses, although the calculation of the variable on family OSC could still be determined in 86% of cases. Non-standard families were associated with a higher frequency of missing response about paternal OSC and LE, which indicates the importance of living with the parent about whom information is being collected.
In this study, contrary to the finding of Wardle , there was no relation between the economic level of the urban area where the school was located, as measured by the ICEF, and missing answers to the questions on OSC and LE. The kappa values found in this study were above 0.50 except for the question about paternal and highest education in the family. These values were similar to those found by Lien  and somewhat lower than those of Ensminger . In the present study the agreement between adolescents and mothers was not influenced by the age or sex of the adolescent, although the type of family influenced the agreement on the paternal OSC. Overall, the percentage of agreement about occupation were higher than that about other family characteristics such as the presence of smokers in the family, the presence of physical or emotional problems, or the declaration about lifestyle and diet (data not shown). From this it may be concluded that adolescents are better informants about OSC than about other characteristics of family life.
Adolescents under-estimated the parental LE (for the adolescents 70.3% of mothers had only primary education, vs. 52.7% for proxy-respondents; and 69.2% of fathers against 53.8%, respectively), which in part explains the low level of agreement compared with that of occupation. This finding would tend to support the theory of Looker that adolescents respond better about parental characteristics that are near in time, such as occupation, than about more distant ones. Changes in administrative structure, and academic reforms that have occurred in Spain in the past could also influence the lower validity of the answers about LE.
The most valid indicator of socio-economic position collected in this study seems to be paternal OSC, which presents high kappa values and is little influenced by socio-demographic factors which affect the adolescents' answers. However, due to the completeness of responses and a moderate kappa value, maternal LE could be a good indicator of those aspects of socio-economic position that also influence the self-perceived health of adolescents. For the purpose of collecting information about socio-economic position in adolescents it could be recommended to use father's occupational social class as a first choice and maternal level of education as the second.
The moderate social gradient of some aspects of self-perceived health among adolescents was found. This finding is consistent with the studies of others[10, 18] although the US studies found a clear gradient in the Satisfaction and Discomfort domains.
Family type was remarkably important in terms of the relation between socio-economic status and self-perceived health, in addition to the known differences by gender and age. Those from standard families presented better scores in all the CHIP-AE domains and sub-domains, similar results to the USA studies [10, 18]. The absence of gradient in Satisfaction and Discomfort domains might be due to the difference in the percentage of adolescents in the Spanish sample living with both parents (80% in the present study vs. 47% in the Ensminger study). Furthermore, single-parent families showed a significantly higher percentage of mothers with university studies, living in urban areas with a high ICEF, which differs from the American sample. The Resilience domain was the most sensitive to differences in OSC and LE, with a significant gradient in the majority of the sub-domains. In the Risks domain, differences were observed between adolescents from families with university qualifications (maternal, paternal or highest) and the rest, although the worst scores were for families with secondary education. Adolescents from families with a better socio-economic position, especially those with a high LE, generally presented more protective factors and lower level of risks than for other families. A social gradient was also noted in academic performance. Better academic achievement in high socio-economic position adolescents indicates the high likelihood of inter-generational transmission of social position. Paternal, maternal and highest LE showed a statistically significant relationship in more domains than the OSC gradient. These results support the theory that social and human capital are both important factors in developing a healthy life.
The main limitation of this study is the small sample size in the sub-sample of adolescents and proxies, although it has been possible to establish comparisons between the indicators reported on by adolescents and their mothers. No statistically significant differences were found comparing data of adolescents whose parents did not participate with that of those who took part in the study, except for a higher participation by families with maternal secondary LE. We were not able to analyze criterion validity, as it would have been necessary to collect information on self-reported OSC and LE of both parents to obtain a gold-standard with which to compare the answers from the adolescents. Furthermore, in the current study the kappa values may have been influenced by the high prevalence of the level of primary education in the sub-sample . Most cross-sectional studies are conducted in school settings, and adolescents are the only source of information, while parents are rarely involved the opportunity to study. Therefore, socioeconomic gradients in health and health services would be lost in these studies unless we rely on self-reported data by adolescents. Nevertheless, it is worth noting that information from both adolescents and their parents should be collected whenever this would be possible. The present analysis does not allow us to know to what extent missing answers could be from adolescents who avoid answering what they might consider embarrassing replies . Nevertheless, this factor may have little influence on the results, given that other sections of the questionnaire with less percentage of missing answers can be considered more embarrassing than the socioeconomic status (e.g. risky and sexual behaviours).
The absence of significant differences in the domains of Satisfaction and Discomfort could be related to specific characteristics of the sample, particularly the small number of individuals in some cells means. That is, gradients were observed but the number of observations could have been too small to achieve significance. Finally, it should be noted that ethnic and family composition was more homogenous when the questionnaire was administered than currently in Spain. This is due to the fact that in recent years the percentage of immigration in Europe in general and Spain in particular has increased, as the percentage of different types of family. It may be that more recent administration of the survey would result in different findings.
Adolescents seem to be acceptable informants on family OSC and LE. Social gradient in health also exists among adolescents. Health policy measures should take into account social class inequalities in health during adolescence.
West P, Sweeting H: Evidence on equalisation in health in youth from the West of Scotland. Soc Sci Med. 2004, 59: 13-27. 10.1016/j.socscimed.2003.12.004.
MacIntyre S, West P: Lack of class variation in health in adolescence: an artefact of an occupational measure of social class?. Soc Sci Med. 1991, 32 (4): 395-402. 10.1016/0277-9536(91)90340-I.
Krieger N, Williams DR, Moss NE: Measuring social class in US Public Health research: concepts, methodologies and guidelines. Annu Rev Public Health. 1997, 18: 341-78. 10.1146/annurev.publhealth.18.1.341.
Grupo de trabajo de la Sociedad Española de Epidemiología y de la Sociedad Española de Medicina Familiar y Comunitaria: Una propuesta de medida de la clase social. Aten Primaria. 2000, 25 (5): 350-63.
Currie CA, Elton RA, Todd J, Platt S: Indicators of socioeconomic status for adolescents: the WHO health behaviour in school-aged children survey. Health Education Research. 1997, 12 (3): 385-97. 10.1093/her/12.3.385.
Goodman E, Adler NE, Kawachi I, Lindsay Frazier A, Bin Huang, Colditz GA: Adolescents' perception of Social Status: development and evaluation of a new indicator. Pediatrics. 2001, 108 (2): e31-10.1542/peds.108.2.e31.
Wardle J, Robb K, Johnson F: Assessing socioeconomic status in adolescents: the validity of a Home Affluence Scale. J Epidemiol Community Health. 2002, 56 (8): 595-9. 10.1136/jech.56.8.595.
Looker ED: Accuracy of proxy reports of parental characteristics. Sociology Education. 1989, 62: 257-76. 10.2307/2112830.
Lien N, Friestad C, Klepp KI: Adolescents' proxy reports of parents' socioeconomic status: How valid are they?. J Epidemiol Community Health. 2001, 55: 731-7. 10.1136/jech.55.10.731.
Ensminger ME, Forrest CB, Riley AW, Kang M, Green BF, Starfield B, Ryan SA: The validity of measures of socioeconomic status of adolescents. J Adolesc Res. 2000, 15 (3): 392-419. 10.1177/0743558400153005.
Starfield B, Riley AW, Green BF, Ensminger ME, Ryan SA, Kelleher K, Kin-Harris S, Johnston D, Vogel K: The Adolescent child health and illness profile. A population-based measure of health. Med Care. 1995, 33: 553-66. 10.1097/00005650-199505000-00008.
Rajmil L, Serra-Sutton V, Alonso J, Starfield B, Riley A, Vázquez JR: The Spanish version of the Child Health and Illness Profile – Adolescent Edition. Qual Life Res. 2003, 12: 303-13. 10.1023/A:1023220912211.
Rajmil L, Serra-Sutton V, Alonso J, Herdman M, Riley AW, Starfield B: Validity of the Spanish version of CHIP-AE. Med Care. 2003, 41: 1153-63. 10.1097/01.MLR.0000088460.42155.65.
Aluja T: Índex de capacitat econòmica familiar a la ciutat de Barcelona. 1991, Barcelona: Ajuntament de Barcelona i Caixa d'Estalvis i Pensions de Barcelona
Serra-Sutton V, Rajmil L, Alonso J, Riley A, Starfield B: Valores poblacionales de referencia del perfil de salud CHIP-AE a partir de una muestra representativa de adolescentes escolarizados. Gac Sanit. 2003, 17 (3): 181-9. 10.1157/13049278.
Cohen JA: A coefficient of agreement for nominal scales. Edu Psychol Meas. 1960, 20: 37-46. 10.1177/001316446002000104.
Cohen J: Statistical power analysis for behavioral sciences. 1988, Hillsdale: Lawrence Erlbaum Associates
Starfield B, Riley AW, Witt WP, Robertson J: Social class gradients in health during adolescence. J Epidemiol Community Health. 2002, 56: 354-61. 10.1136/jech.56.5.354.
Feinstein AR, Cicchetti DV: High agreement but low kappa: I. the problem of two paradoxes. J Clin Epidemiol. 1990, 43: 543-49. 10.1016/0895-4356(90)90158-L.
The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1472-6963/7/151/prepub
The authors acknowledge partial funding and support to this research from the CIBER en Epidemiología y Salud Pública (CIBERESP) in Spain, and the Spanish Ministry of Health (FIS contract N° PI042504).
The author(s) declare that they have no competing interests.
LR, VSS, BS and JA conceived the study, and participated in its design and coordination. MJP, VSS and LR participated in the protocol development and analysis of data. MJP wrote the first draft of the manuscript, and the rest of authors made substantial contributions to the interpretation of data, revised critically all the previous versions of the manuscript, and approved its final version.
Authors’ original submitted files for images
Below are the links to the authors’ original submitted files for images.
About this article
Cite this article
Pueyo, MJ., Serra-Sutton, V., Alonso, J. et al. Self-reported social class in adolescents: validity and relationship with gradients in self-reported health. BMC Health Serv Res 7, 151 (2007). https://doi.org/10.1186/1472-6963-7-151