- Research article
- Open Access
Use of the Theory of Planned Behaviour to assess factors influencing the identification of students at clinical high-risk for psychosis in 16+ Education
BMC Health Services Research volume 15, Article number: 411 (2015)
The longer psychotic disorders are untreated the worse their prognosis. Increasing the awareness of early psychosis by professionals who come into regular contact with young people is one strategy that could reduce treatment delay. As teachers engage with students on a daily basis, their role could be exploited to increase awareness of the early signs of psychosis. This study employed the Theory of Planned Behaviour (TPB) to identify and measure factors that influence identification of students at high-risk (HR) of developing psychosis in 16+ educational institutions.
An elicitation phase revealed beliefs underlying teachers’ motivations to detect HR students and informed the construction of a preliminary 114-item questionnaire incorporating all constructs outlined in the TPB. To define the determinants of teachers’ intention to identify HR students, 75 teachers from secondary and further education institutions in 12 counties surrounding Cambridgeshire completed the questionnaire. A psychometric model of item response theory was used to identify redundant items and produce a reduced questionnaire that would be acceptable to teachers.
The final instrument comprised 73 items and showed acceptable reliability (α = 0.69-0.81) for all direct measures. Teacher’s confidence and control over identification of HR students was low. Although identification of HR students was considered worthwhile, teachers believed that their peers, students and particularly their managers might not approve. Path analysis revealed that direct measures of attitude and PBC significantly predicted intention, but subjective norm did not. PBC was the strongest predictor of intention. Collectively, the direct measures explained 37 % of the variance of intention to identify HR for psychosis.
This research demonstrated how the TPB can be used to identify and measure factors that influence identification of students at HR of developing psychosis in 16+ educational institutions and confirmed the feasibility, reliability and acceptability of a TPB-based questionnaire for teachers. Consideration of the key determinants of identification in schools will facilitate the design of successful educational intervention strategies with the potential to reduce treatment delays for HR students.
The longer psychotic disorders are untreated the worse their prognosis [1–3], with some individuals remaining untreated for up to 2 years . This finding has led to efforts to detect psychotic disorders early to minimise the developmental , social  and biological  deterioration that can occur after a prolonged duration of untreated psychosis (DUP). Increasing the awareness of signs and symptoms of early psychosis by professionals who come into regular contact with young people is one strategy that has been investigated to reduce treatment delay. Indeed, this approach has been recommended by the UK Department of Health . Thus, if we could identify people who might be at clinical high-risk for psychosis (HR), we could also increase opportunities to reduce DUP. The importance of this is corroborated by the finding that the risk of developing psychosis is several hundred times higher in individuals that meet the high risk criteria when compared to the general population .
Initial psychotic symptoms typically have their onset and maximum impact in late adolescence and early adulthood . It has been reported that adolescents (up to the age of 18) have a longer DUP than adults (over 18) . Although it has been claimed that general practitioners (GPs) are most frequently the first contact when a young person is developing psychosis , it is of concern that other findings indicate adolescents rarely seek help from GPs concerning their emotional well-being and those with mental health problems do not visit the GP more frequently than those without them . In light of the fact that teachers come into contact with students on a daily basis, sometimes for several hours at a time, their role could be exploited to increase awareness of the early signs of psychosis and speed up the referral of these potentially at risk students to Early Intervention Services (EIS).
Two intensive health promotion and information campaigns have included components that provided knowledge about early symptoms of psychosis to teachers [14, 15]. Both studies claimed to increase referrals to early detection teams and to significantly reduce DUP. However, the number of referrals specifically from the teachers was not reported. Mental health literacy training programmes for teachers have resulted in increased knowledge of the early signs of psychosis  and earlier, more appropriate referrals of pupils to mental health services [17, 18]. Indeed, a recent systematic review recommended the development of initiatives targeting non-health service professionals, such as teachers, to enhance help-seeking behaviour and therefore reduce service delays .
To date, only two studies have evaluated teacher’s knowledge concerning psychotic symptoms and how to access help for these individuals [20, 21]. Although teachers may be in a fundamental position to identify possible signs of psychosis and the majority are able to recognise these symptoms in their students, they are less likely to be aware of the mental health services available for young people or know how to access the appropriate help and services [20, 21]. The additional finding that teachers are willing to engage in further training in this area and cooperate with specialist teams to obtain support [20, 21] suggests an educational intervention to raise awareness and increase referrals of students at HR for psychosis in this group of professionals will be fruitful. However, unlike the more discernable symptoms of psychosis, identifying young people who might be in the prodromal phase of a psychotic illness is more challenging. The earliest signs of a psychotic disorder are multifaceted, non-specific and have common characteristics with the initial stages of other disorders . This indicates the need for in-depth training to help teachers correctly identify the symptoms and those most at risk.
Before attempting to design an educational programme to help teachers detect students who may be at HR of developing psychosis, it is necessary to explore the factors that are currently influencing their identification. To our knowledge, no research to date has attempted to identify factors that influence the detection of students at risk of developing psychosis in schools. If it is assumed that teacher’s identification of HR students is a form of human behaviour, it can be described in terms of general theories relating to human behaviour. This provides a theoretical framework to help identify key determinants of that behaviour and propose options for its modification.
Interventions to change professional practice are often limited by the lack of an explicit theoretical and empirical basis . The use of theory advances behavioural science  because it provides a generalisable framework for predicting and interpreting behaviour, informs the design of interventions and enables the evaluation of potential causal mechanisms .
The Theory of Planned Behaviour [TPB; 25, 26] (Fig. 1) was selected because it provides clear definitions of constructs and is supported by a comprehensive body of correlational evidence . The TPB provides a simple and efficient framework for use in the investigation of an individual’s intent to perform context-specific actions. The TPB assumes that the majority of human behaviour is goal-directed, socially influenced , and that individuals are logical and rational in their decision making . It is a deliberative processing model that implies individuals make behavioural decisions based on careful consideration of available information . In addition, it recognises the necessity of estimating the extent to which the individual is capable of exercising control over the behaviour in question . The model’s ability to consider internal (e.g. abilities; knowledge) and external (e.g. opportunity; cooperation of others) control factors in relation to performing a behavior  is important in professional contexts such as educational institutions, where both factors may influence teacher’s behaviour.
The TPB proposes that the act of identifying students at HR for psychosis during the school day is predicted by the strength of a teacher’s intention to identify these students. This intention is guided by three considerations: the teacher’s personal evaluation of engaging in the identification of HR students (attitude); the intensity of social pressure from salient referents that the teacher perceives regarding the adoption of this behaviour (subjective norm) and the perceived ease or difficulty of identifying HR students based on both past experience and anticipated barriers (perceived behavioural control; PBC) .
The TPB has also been used to explain teachers’ intentions and behavior in the classroom [e.g.32, 33]. However, only one study has used the TPB to predict teachers’ intentions to refer students to mental health professionals . Intentions were predicted by all the TPB variables; which accounted for 58 % of the variance associated with predicting their intention to refer.
This study describes the design and testing of items for a self-completion questionnaire to be used within 16+ educational institutions to identify and measure the factors that influence the identification of students at HR for psychosis using TPB. Results from this phase would inform the subsequent design of educational programs to evaluate the most effective way to help teachers identify these students.
We followed the guidelines outlined by the co-author of the TPB  and reviews of current standard practice for its application . We were also guided by recommendations from other researchers in this field . The behaviour under investigation was defined as “identifying students at HR for psychosis during the school day”.
Phase 1: Questionnaire development
Observing the theory, the three predictors of intention were measured by two methods. Firstly, 'directly', by asking teachers to summarise their overall i) evaluative reaction to the identification of students at HR for psychosis (attitudes), ii) perceptions of whether important others would approve of or be likely to engage in the identification of students at HR (subjective norms) and iii) perception of having, or not having control over the identification of students at HR for psychosis (PBC). Secondly, ‘indirectly’, by asking teachers about their specific beliefs associated with forming attitudes, subjective norms and PBC related to the identification of students at HR. These indirect measures are presumed to determine the more global reactions of the direct measures .
Development of ‘indirect’ measures
The objective of this phase was to elicit commonly held beliefs about identifying HR students from teachers. This enabled the development of questionnaire items based on these salient beliefs. Beliefs are central to the TPB; they provide the cognitive and affective foundations for attitudes, subjective norms, and PBC . An accurate understanding of the specific beliefs associated with identifying students at HR for psychosis provides insight into why teachers may execute particular behaviours . Therefore, this information can be important in the design of effective educational interventions.
Two teachers working outside of the study boundaries were recruited to complete an elicitation questionnaire to help identify salient beliefs underlying motivations to identify students at HR for psychosis during the school day. Each was emailed a series of 12 questions to determine:
Behavioural Beliefs: most frequently perceived advantages and disadvantages associated with identification
Normative Beliefs: most important people or groups who would disapprove or approve of identification
Control Beliefs: perceived barriers or facilitating factors associated with identification
To represent a variety of experiences within the final questionnaire the respondents were instructed to discuss these issues with colleagues so that the answers reflected both personal experience and also that of other teachers.
Two researchers independently analysed the content of the responses to identify the beliefs for each of the three predictor variables. These are are summarised below:
Facilitates help with their particular problems
Avoids friends and peers withdrawing due to negative interpretation of symptoms
Avoids staff misinterpreting student’s symptoms as lack of interest
Increases awareness and understanding
Avoids disruption to other students in class
Being able to help and counsel appropriately
Having a positive attitude to mental health
There are positive outcomes for those identified at risk
Students at HR should not be at school/college
I am wary of students with mental health problems
Labelling associated with identification
Identified students will be treated differently - stigma
Students wrongly diagnosed by a teacher
Lack of knowledge in how to cope with young people with psychosis
Negative preconceived ideas about how a student will react to identification
Belief that it is not their responsibility to identify someone at risk
Impact from student’s family has to be considered
Parents/carers may disapprove
Students may disapprove
Educational system does not encourage identification students at risk (e.g. LEA/school/college/staff union/departmental policies, government guidance)
Senior management teams at school/college are unwilling to accept that students at risk are an issue
Difficulties in coping when dealing with students with psychosis.
Lack of understanding about early psychosis.
Fear of getting it wrong.
Fear of repercussions from student/family
Expressing concern is only effective if there is a school-wide procedure for investigating those concerns.
Not knowing where to go for advice and help if they suspect a student is suffering
Feeling pressurised in their job
Not being able to recognise the at risk symptoms
Access to information, knowledge and resources
Having a designated member of staff to coordinate the care of students who may demonstrate signs of being at risk
Following this stage, a questionnaire item was constructed to assess the strength of each behavioural, normative and control belief. Additionally, a corresponding item was developed to assess the impact each belief might have on identifying HR student (Table 1). These indirect items and their format were then agreed by the entire research team, to ensure that each belief was represented in the questionnaire.
Development of ‘direct’ measures
Direct measures are a summary estimate of a teacher’s global attitude, subjective norm and PBC towards identifying students at HR for psychosis; and predictors of intention to perform such identification . Intention captures the motivational factors that influence behaviours  and signifies a teacher’s decision to exert effort to attempt identification .
According to the TPB guidelines, the direct measures were tailored to specific behaviours and samples . This process should not be guided by an arbitrary selection of questions or adopted items from previous studies . Therefore, appropriate items for the target population (teachers of 16+ students) and specific context (during the teaching day) were agreed by the research team to reflect each direct construct (Table 2).
Phase 2: Questionnaire construction
A 114-item preliminary version of the questionnaire was constructed including indirect and direct measures for attitude, subjective norm, PBC and intention. The questionnaire included instructions regarding its completion and an introduction about how an individual at HR for psychosis might present in consultation. Feedback questions concerning ambiguity, content, missing factors and format guided any necessary subsequent refinements. Finally, socio-demographic questions were added to describe the sample.
Phase 3: Questionnaire evaluation and refinement
The aim of this phase was to evaluate the acceptability and feasibility of administering the questionnaire within a representative sample of teaching staff in 16+ educational institutions, in addition to evaluating its reliability.
Questionnaires and information sheets were posted to 790 teachers working at secondary schools with a sixth form (N = 13), sixth form colleges (N = 2) and further education colleges (N = 4) across 12 counties in the UK between November 2009 and May 2010. These educational institutions were selected via a Google® search for ‘Secondary and Further Education institutions in the counties surrounding Cambridgeshire’. Selection criteria included 1) institutions with high quality prospectuses 2) websites that provided contact names for the various courses on offer. The information sheet outlined all ethical issues and contained sufficient information to allow teachers to decide whether they consented to take part in the study or not. A postal reminder was sent to non-respondents three weeks later.
Ethical approval was granted by the Cambridgeshire East Research Ethics Committee as part of the NIHR research programme RP-PG-0606-1335.
A psychometric evaluation of the questionnaire was conducted to confirm that information obtained using a reduced-item final tool would still provide a sound basis for decision making.
A modern approach, in the form of a psychometric item response model – the polytomous graded response model  was used to examine the validity of each item within direct and indirect measures and to inform decisions regarding the removal of items. The internal consistency of the direct measures of attitude, subjective norm and PBC was assessed using Cronbach’s Alpha coefficient on both the original and reduced-item questionnaires. An internal consistency criterion is inappropriate for the evaluation of reliability of indirect measures , because they are formative rather than reflective indicators of the underlying construct . Alternatively, correlations between direct and indirect measures of the same construct were calculated to confirm the convergent validity of the indirect measures. Confirmatory factor analysis  was conducted on all measures to assess the relative importance of each item on the total construct; thus confirming the structural conformity of the final questionnaire with the TPB. The relationship between intention and the indirect and direct measures were investigated using path analysis, with “intention” specified as the dependent variable. Path analysis was used to reveal the degree of fit between the TPB and actual data, in addition to providing an estimation of multiple regression equations linking the TPB variables .
Data were analysed using the statistical software package NCSS Version 7.1  for descriptive statistics; item analysis for the purpose of identifying redundant items for removal from the questionnaire was conducted using MULTILOG and confirmatory factor analysis and path analysis was performed with Mplus Version 6.1 .
Descriptive statistics of the respondents
Seventy five (9.5 %) teachers returned questionnaires. The mean time taken to complete the questionnaire was reported as 20.1 (SD = 9.6) minutes. The mean age of participating teachers was 44.3 (SD = 10.9). More female teachers (N = 50; 67 %) than male teachers (N = 25; 33 %) completed and returned the questionnaire. The mean number of years teachers had been teaching was 13.7 (SD = 10.6). The majority of the sample (N = 62; 83 %) reported never attending any kind of mental health training during their careers. Teachers reported average class sizes of 17 (SD = 6.3) students and estimated that the mean number of students they taught with a mental health problem was 5 (SD = 7.6).
Psychometric properties of the questionnaire
The polytomous graded response model  was used to study the validity of items within specific constructs. Also, distribution of responses for each item was assessed. This allowed the identification of items that required rewording, and those that were redundant because they added little information or offered similar response patterns. For the indirect measures, items were eliminated because of their ambiguity or similarity to other items. Final decisions on item exclusion were based on extensive discussions within the research team to avoid invalidation of the questionnaire due to exclusion of essential items that had emerged during the elicitation procedure. Forty-three items were excluded, resulting in a 73-item final questionnaire. Subsequent analyses were conducted on this reduced scale.
Pearson’s correlations between the indirect and direct measures of the corresponding construct indicate whether indirect measures are well constructed and adequately cover the breadth of the measured construct . With the exception of PBC, each set of indirect beliefs was highly correlated with their direct predictor of intentions: behavioural beliefs with attitudes (r = 0.43; p < 0.001); normative beliefs with subjective norms (r = 0.61; p < 0.001); and control beliefs with PBC (r = 0.28; p < 0.023).
Factor analysis was used to assess the structural conformity of the final questionnaire with the TPB. The resulting standardized coefficients can be interpreted as correlations between the measured construct and corresponding item. Higher coefficients indicate higher factor validity. Therefore, these items are superior at discriminating between teachers with low and high levels of the corresponding latent construct.
Table 3 shows the items with the highest factor validity within direct and indirect measures. Only one item within (each) direct subjective norms, direct PBC, indirect attitude and two items within indirect subjective norms showed a factor validity lower than 0.5. However, indirect PBC was less coherent. All items within this construct showed low intercorrelations, in accordance with Azjen’s  premise that internal consistency is not a necessary feature of indirect measures. Therefore, the use of factor analysis is questionable for this construct. The factor validity is reported mainly for completeness and should be interpreted with caution.
The lower bound estimates of reliability assessed by Cronbach’s alpha for the original and reduced questionnaires are shown in Table 4. An acceptable level of α was set at >0.60 . The values confirmed improvement for subjective norms and PBC in the reduced version. However, measurement precision for intention and attitude was slightly reduced but still large enough to be interpreted as acceptable. As a greater number of items in the questionnaire can artificially inflate the value of alpha  it was decided that a shorter questionnaire would be more acceptable to teachers and therefore a slightly reduced alpha was an acceptable compromise.
Distribution of teachers’ scores for all TPB constructs
For the direct measures, including intention, the mean of the item scores was calculated to provide an overall construct score (See Table 3 for item scoring ranges). Beliefs are structured according to an expectancy-value framework. Individuals hold expectancies about the outcomes they anticipate if they behave in a particular way. Simultaneously, they also hold beliefs about the value of that outcome . Therefore, indirect measures are calculated by multiplying individual belief components and then summing the products. For example, indirect attitude is calculated by multiplying the perceived likelihood of a particular outcome of the behaviour (behavioural belief strength) by the evaluation of that outcome (outcome evaluation) The resulting products are summed across all beliefs to create an overall attitude score (See Table 3 for the corresponding subjective norm and PBC belief components)
Table 5 summarises data obtained from the questionnaires. Higher scores indicate that a teacher intends to, is in favour of, experiences social pressure to, and feels in control of identifying students who may be at HR for psychosis.
For indirect measures, mean scores reflected overall weakly positive attitudes towards identification, almost no favourable pressure to perform identification and very low control over the identification of students at HR for psychosis. Subjective norm was the lowest (3.1), which indicates a very weak level of positive control. Attitude was the highest, but still a low score (123.9).
Mean scores for direct measures were just above the mid-scale score for intention and attitude, and just below the mid-scale score for subjective norm and PBC. This suggests that teachers considered identifying students at HR for psychosis a worthwhile behaviour and would attempt identification during the school day. However, they believed that their peers or superiors might not approve this. Moreover, their confidence and control over identification was low.
Prediction of ‘intention’
Path analysis revealed that only direct measures of attitude and PBC significantly predicted intention. Subjective norm did not predict intention. PBC was the strongest predictor of intention (regression coeff. = 0.46, p < 0.01), followed by attitude (0.39, p < 0.01).
Collectively, the direct measures explained 37 % of the variance of intention to identify HR for psychosis.
The purpose of this research was to design a questionnaire to expose and measure factors that might contribute to a teacher’s decision to attempt identification of students that may be at clinical HR of developing psychosis. This study was conducted because there was no evidence in the literature of the influence of the motivations and barriers teachers experience when making this decision.
Results from the analysis of the indirect measures revealed that increasing awareness and understanding of mental health issues was a source of personal positive beliefs, as demonstrated by the item with the highest factor validity within the indirect attitude construct. Notably, all normative beliefs were negative. The perception was that students, student’s family, professional colleagues and the educational system would not encourage the identification of students at HR for psychosis. The item with the highest factor validity indicated that a key source of social pressure came from the senior management team within school. The proposal that control beliefs should comprise separate measurement of controllability and self-efficacy  was supported by our study. However, control factors were the primary influence for control beliefs. The item with the highest factor validity indicated that knowledge of the student’s personal and family mental health history was an important facilitator of PBC. Facilitators of self-efficacy included access to support and the provision of a designated member of staff to co-ordinate the care of students. Lack of understanding and knowledge were the main barriers to self-efficacy. These findings replicated previous work revealing factors that might prevent teachers’ identifying psychotic symptoms in students [20, 21], thus demonstrating the validity of our questionnaire.
These results suggest a reoccurring theme of beliefs underlying a teacher’s decision to attempt identification of a student that might be at HR of developing psychosis: lack of access to information, knowlege and resources will all hinder teacher’s ientification behaviour. Identifying these particular beliefs reveals why teachers hold certain attitudes, subjective norms, and perceptions of behavioral control in relation to identifying students at risk of developing psychosis. This demostrates the value of using the TPB for designing effective programs to change teacher’s behavior. Equipped with this information, effective strategies can be designed to target these facilitators and barriers towards identification of at risk students.
Results from the analysis of the direct measures revealed that most teachers had positive intentions and attitudes towards identifying students at HR for psychosis. However, mean scores for each direct construct were around the mid-scale score, indicating scope for modification and improvement. The mean PBC score indicated a degree of negativity about control, suggesting that identifying students at HR was somewhat difficult for teachers, both in terms of self-efficacy and perceived control concerns. Intentions to identify HR students were most strongly predicted by PBC. This implies teachers’ perceptions of how confident they are that they are capable of identification and how much control they have over identification, are prominent motivational factors. This influence of PBC was also found in Lee’s work  with teachers and is consistent with previous research that reports teachers with lower self-efficacy referred fewer students to a student support team . Accordingly, effective interventions would need to prioritise the development of strategies that targeted this potential causal mechanism to prompt behavioural changes in this population.
Our questionnaire proved to be reliable, with the analysis supporting the predictive power of the TPB with regards to intention. The combination of attitude, subjective norm and PBC explained 37 % of the variance of intention to identify students at HR for psychosis. This is almost equivalent to the average percentage (39 %) of explained variance in intention reported for a variety of behaviors in the latest meta-analytic review of the TPB . Interestingly, subjective norm was the only direct measure not to perdict intention, supporting previous studies that proposed that subjective norm was the weakest explanatory variable of intention .
It appears the control factors identified in the elicitation exercise did not capture adequately all the important considerations related to PBC. We suspect that the low correlation between direct and indirect PBC was due to the lack of reliability for indirect PBC. There are several possible explanations for this result. Firstly, items within indirect measures are not expected to correlate strongly with each other as they reflect a dynamic latent construct . Secondly, teachers’ PBC beliefs toward identifying students at HR of developing psychosis could be ambivalent if they believe that it is likely to produce positive as well as negative outcomes . Thirdly, the PBC construct generated beliefs with the greatest diversity, therefore, fewer items were removed during validity analysis, with the aim of retaining important beliefs that influence teachers' perceptions of control. However, to create a questionnaire of acceptable length, valid items might have been excluded. Finally, the way in which teachers conceptualise the notion of control and difficulty  could have contributed to the discrepancy. For example, teachers may believe that identification of students at HR for psychosis is under their control, whilst also considering identification difficult to carry out. Consequently, the inclusion of numerous different aspects of control within the constructs could be a major contributory factor to the low correlation.
These propositions imply that the identification of HR students is intrinsically challenging for teachers, especially when considering identification is not straightforward for clinicians and researchers in the field with specialist training. However, if interventions to educate teachers focus on the providing skills and strategies for the identification of symptoms rather than an actual ‘diagnosis’ of HR, referral of HR students could be achieved. Additionally, the use of a dedicated liaison practitioner to provide ongoing support and augment training with this potentially challenging task would be advantageous.
The major strengths of this study were the thorough psychometric evaluation of our TPB questionnaire and the explicit theoretical framework. Since the majority of TPB questionnaires are used only once with a specific population and behaviour, a thorough psychometric evaluation is usually considered non-feasible and therefore omitted . Our research provides an empirically-supported theoretical basis for the design of interventions in 16+ educational institutions to improve the identification of students at HR for psychosis.
Despite strenuous efforts, the response rate to our questionnaire was poor. The low response rate (9.5 %) from the invited sample (N = 790) was the most important limitation of the study, and potential risk of bias for the findings. External validity could have been undermined if respondents differed systematically from non-respondents, e.g. more positive attitude towards identification. However, the respondents were from a variety of locations with varying years of teaching experience, in a diverse selection of subjects and positions which arguably provides a representative sample of the target population and increases the generalisability of the results. It was not possible to conduct a detailed analysis of non-responses as the necessary sociodemographic information was not accessible. Nevertheless, future work should aim to increase the response rate.
It is not possible to fully understand why teachers chose not to respond to the questionnaire. However, research has revealed strategies that may help future studies to increase their sample. The majority of strategies outlined in a recent review  of methods to influence responses to postal questionnaires were applied in the present study. However, sending questions by recorded delivery, providing non-respondents with a second copy of the questionnaire and contacting participants before sending questionnaires all increased response rates and should also be considered by future research. Furthermore, the most effective strategy, if funds allow, is a monetary incentive, as response rates can be more than doubled when payment is offered . Nevertheless, questionnaire length would remain the limiting factor as the TPB requires the inclusion of many items if it is to be used effectively to provide important insights into the issues that could be targeted to motivate behaviour change. The questionnaire in the present study was five pages long and it has been suggested that the optimum length is four pages ; hence efforts should be made to achieve this without compromising the theoretical content.
Our findings may have been limited by the use of self-reports as measures of beliefs and intention. As a result, the respondents might have unintentionally (‘social desirability’) or intentionally (‘faking good’)  expressed themselves more positively toward the identifying at risk students than they really were. However, inclusion of further questions in the questionnaire to assess this was not feasible. The questionnaires were already long enough to discourage some teachers from responding. Also, previous studies suggested that social desirability had a minimal impact on TPB models . Moreover, returned questionnaires were anonymous, with no incrimination or benefits from participating. Also, current behaviours were not measured. Future research should not only rely on self-reports but include objective measures of behaviour.
This research demonstrated how the Theory of Planned Behaviour can be used to identify and measure factors that influence identification of students at HR of developing psychosis in 16+ educational institutions. We have confirmed the feasibility, reliability and acceptability of a TPB-based questionnaire to identify teachers’ beliefs and intentions concerning the identification of students at clinical HR for psychosis. Detection of the key determinants of identification will suggest avenues for modification and facilitate the design of successful educational intervention strategies.
The questionnaire is available from the authors.
Duration of untreated psychosis
Early intervention services
Clinical high-risk for psychosis
Perceived behavioural control
Theory of planned behaviour
Perkins D, Gu H, Boteva K, Lieberman J. Relationship between duration of untreated psychosis and outcome in first episode schizophrenia: a critical review and meta-analysis. Am J Psychiatry. 2005;162:1785–804.
Marshall M, Lewis S, Lockwood A, Drake R, Jones P, Croudace T. Association between duration of untreated psychosis and outcome in cohorts of first episode patients. Arch Gen Psychiatry. 2005;62:975–83.
Norman RM, Lewis SW, Marshall M. Duration of untreated psychosis and its relationship to clinical outcome. Br J Psychiatry. 2005;187(Suppl):19–23.
Skeate A, Jackson C, Birchwood M, Jones C. Duration of untreated psychosisand pathways to care in first-episode psychosis. Investigation of help-seekingbehaviour in primary care. Br J Psychiatry Suppl. 2002;43:s73–7.
Lieberman JA, Perkins D, Belger A, Chakos M, Jarskog F, Boteva K, et al. The early stages of schizophrenia: speculations on pathogenesis, pathophysiology, and therapeutic approaches. Biol Psychiatry. 2001;50:884–97.
Häfner H, Nowotny B, Löffler W, an der Heiden W, Maurer K. When and how does schizophrenia produce social deficits? Eur Arch Psychiatry Clin Neurosci. 1995;246:17–28.
Pantelis C, Velakoulis D, McGorry PD, Wood SJ, Suckling J, Phillips LJ, et al. Neuroanatomical abnormalities before and after onset of psychosis: a cross-sectional and longitudinal MRI comparison. Lancet. 2003;25(361):281–8.
Department of Health. Mental Health Policy Implementation Guide. Department of Health, 2001. http://webarchive.nationalarchives.gov.uk/+/www.dh.gov.uk/en/publicationsandstatistics/publications/publicationspolicyandguidance/dh_4009350.
Lin A, Nelson B, Yung AR. Editorial: ‘At-risk’ for psychosis research: where are we heading? Epidemiol Psychiatr Sci. 2012;21(4):329–34.
McGorry PD, Killackey E, Yung A. Early intervention in psychosis: concepts, evidence and future directions. World Psychiatry. 2008;7(3):148–56.
Joa I, Johannessen JO, Langeveld J, Friis S, Melle I, Opjordsmoen S, et al. Baseline profiles of adolescent vs. adult-onset first-episode psychosis in an early detection program. Acta Psychiatr Scand. 2009;119(6):494–500.
Simon A, Lester HE, Tait L, Stip E, Roy P, Conrad G, et al. The International Study on General Practitioners and Early Psychosis (IGPS). Schizophr Res. 2009;108:182–90.
Potts Y, Gillies ML, Wood SF. Lack of mental well-being in 15 year-olds: an undisclosed iceberg? Fam Pract. 2001;18:95–100.
Joa I, Johannessen JO, Auestad B, Friis S, McGlashan T, Melle I, et al. The key to reducing duration of untreated first psychosis: Information campaigns. Schizophr Bull. 2008;34:466–72.
Johannessen JO, McGlashan TH, Larsen TK, Horneland M, Joa I, Mardal S, et al. Early detection strategies for untreated first episode psychosis. Schizophr Res. 2001;51(1):39–46.
Langeveld J, Joa I, Larsen TK, Rennan AJ, Cosmovici EM, Johannessen JO. Teachers’ awareness for psychotic symptoms in secondary school: The effects of an early detection programme and information campaign. Early Interv Psychiatry. 2011;5:115–21.
Askell-Williams H, Lawson MJ, Murray-Harvey R. Teaching and learning about mental illnesses: an Australian perspective. Int J Ment Health Promot. 2007;9:26–36.
Peterson FL, Cooper R, Laird J. Enhancing teachers health literacy in school health promotion: a vision for the new millennium. J Sch Health. 2001;71:138–44.
Lloyd-Evans B, Crosby M, Stockton S, Pilling S, Hobbs L, Hinton M, et al. Initiatives to shorten duration of untreated psychosis: systematic review. Br J Psychiatry. 2011;198(4):256–63.
Collins A, Holmshaw J. Early detection - A survey of secondary school teachers knowledge about psychosis. Early Interv Psychiatry. 2008;2(2):90–7.
Masillo A, Monducci E, Pucci D, Telesforo L, Battaglia C, Carlotto A, et al. Evaluation of secondary school teachers’ knowledge about psychosis: a contribution to early detection. Early Interv Psychiatry. 2012;6:76–82.
Foy R, Francis JJ, Johnston M, Eccles MP, Lecouturier J, Bamford C, et al. The development of a theory-based intervention to promote appropriate disclosure of a diagnosis of dementia. BioMed Central Health Services Research. 2007;7:207. doi:10.1186/1472-6963-7-207.
Michie S, Prestwich A. Are interventions theory-based? Development of a theory coding scheme. Health Psychol. 2010;29:1–8.
Eccles M. The Improved Clinical Effectiveness through Behavioral Research Group (ICEBeRG). Designing theoretically-informed implementation interventions Implementation Science. 2006;1:4. doi:10.1186/1748-5908-1-4.
Ajzen I. From intentions to action: A theory of planned behavior. In: Kuhl J, Beckman J, editors. In Action control: From cognitions to behaviors. New York: Springer; 1985. p. 11–39.
Ajzen I. The theory of planned behavior. Organ Behav Hum Dec. 1991;50:179–211.
Skår S, Sniehotta FF, Araujo-Soares V, Molloy GJ. Prediction of behaviour vs. prediction of behaviour change: The role of motivational moderators in the theory of planned behaviour. Appl Psychol-Int Rev. 2008;57:609–27.
Sandberg T, Conner M. Anticipated regret as an additional predictor in the theory of planned behaviour: A meta-analysis. Br J Soc Psychol. 2008;47(4):589–606.
Conner M, Sparks P: Theory of Planned Behaviour and Health Behaviour. In Predicting health behaviour: Research and practice with social cognition models. 2nd edition. Edited by Conner M, Sparks P. Mainhead: Open University Press; 2005:170–222.
Ajzen I, Madden TJ. Prediction of goal-directed behavior: Attitudes, intentions, and perceived behavioral control. JESP. 1986;22:453–74.
Armitage CJ, Conner M. Efficacy of the theory of planned behavior: a meta-analytic review. Br J Soc Psychol. 2001;40:471–99.
Martin JJ, Kulinna PH. Self-Efficacy Theory and theTheory of Planned Behavior: Teaching Physically Active Physical Education Classes. Res Q Exerc Sport. 2004;75(3):288–97.
Jeong M, Block ME. Physical education teachers' beliefs and intentions toward teaching students with disabilities. Initiatives to shorten duration of untreated psychosis: systematic review. Res Q Exerc Sport. 2011;82(2):239–46.
Lee, J.-y: Predictors of Teachers’ Intention to Refer Students With ADHD to Mental Health Professionals: Comparison of U.S. and South Korea. School Psychol Quart 2013, Advance online publication. doi: 10.1037/spq0000046.
Ajzen I: Constructing a TpB Questionnaire: Conceptual and Methodological Considerations [http://www.uni-bielefeld.de/ikg/zick/ajzen%20construction%20a%20tpb%20questionnaire.pdf].
Francis JJ, Eccles MP, Johnston M, Walker A, Grimshaw J, Foy R, Kaner EFS, Smith L, Bonetti D: Constructing questionnaires based on the theory of planned behaviour. A manual for health services researchers [http://openaccess.city.ac.uk/1735/].
Samejima F. Estimation of latent ability using a response pattern of graded scores. Psychometrika Monograph Supplement. 1969;34:100–14.
Conner M, Kirk S, Cade J, Barrett J. Why do women use dietary supplements? The use of the theory of planned behavior to explore beliefs about their use. Soc Sci Med. 2001;52:621–33.
Brown TA. Confirmatory factor analysis for applied research. New York: Guilford Press; 2006.
Wolfle LM. The introduction of path analysis to the social sciences, and some emergent themes: An annotated bibliography. Struct Equ Model. 2003;10(1):1–34.
Hintze J. NCSS (version 7.1). Kaysville, UT: CSS, LLC; 2008.
Muthén LK, Muthén BO. Mplus: Statistical Analysis With Latent Variables (Version 6.1). Los Angeles, CA, 1998–2010. https://www.statmodel.com/download/usersguide/Mplus%20Users%20Guide%20v6.pdf.
Francis J, Eccles M, Johnston M, Whitty P, Grimshaw JM, Kaner EF, et al. Explaining the effects of an intervention designed to promote evidence-based diabetes care: a theory-based process evaluation of a pragmatic cluster randomised controlled trial. Implement Sci. 2008;3:50. doi:10.1186/1748-5908-3-50.
Cortina JM. What is coefficient alpha? An examination of theory and applications. J Appl Psychol. 1993;78:98–104.
Ajzen I. Perceived behavioral control, self-efficacy, locus of control, and the theory of planned behavior. J Appl Soc Psychol. 2002;32:665–83.
Pas ET, Bradshaw CP, Hershfeldt PA, Leaf PJ. A multilevel exploration of the influence of teacher efficacy and burnout on response to student problem behavior and schoolbased service use. School Psychol Quart. 2010;25:13–27. doi:10.1037/a0018576.
Sparks P, Guthrie CA, Shepherd R. The dimensional structure of the perceived behavioral control construct. J Appl Psychol. 1997;27:418–38.
French DP, Cooke R, McLean N, Williams M, Sutton S. What do people think about when they answer theory of planned behaviour questionnaires? A “think aloud” study. J Health Psychol. 2007;12:672–68.
Edwards P, Roberts I, Clarke M, DiGuiseppi C, Pratap S, Wentz R, et al. Increasing response rates to postal questionnaires: systematic review. BMJ. 2002;324:1183.
Crowne DP, Marlowe D. A new scale of social desirability independent of pschopathology. J Consult Psychol. 1960;24:349–54.
Armitage CJ, Conner M. Predictive validity of the theory of planned behavior: The role of questionnaire format and social desirability. J Community Appl Socl Psychol. 1999;9:261–72.
The authors acknowledge funding support from NIHR programme grant RP-PG-0606-1335 'Understanding Causes and Developing Effective Interventions for Schizophrenia and Other Psychoses'. They thank the LEGS study team (Erica Jackson, Chris McAlinden and Carolyn Crane) and all members of CAMEO services for their help and support in the elaboration of this trial.
The authors declare that they have no competing interests.
PBJ is the chief investigator for this study. JP and MP are principal investigator and project manager, respectively. All authors participated in the design of the study. DAR elaborated the theoretical basis of the project and was responsible for the data collection. GS participated in the implementation of the study. Statistical analyses were carried out by JS. JP and DAR drafted the manuscript. All authors provided a critical review and final approval of the manuscript.
Availability of data and materials
About this article
Cite this article
Russo, D.A., Stochl, J., Painter, M. et al. Use of the Theory of Planned Behaviour to assess factors influencing the identification of students at clinical high-risk for psychosis in 16+ Education. BMC Health Serv Res 15, 411 (2015). https://doi.org/10.1186/s12913-015-1074-y
- Early intervention
- High risk
- TPB questionnaire