Skip to main content

Patient involvement in patient safety: Protocol for developing an intervention using patient reports of organisational safety and patient incident reporting



Patients have the potential to provide a rich source of information on both organisational aspects of safety and patient safety incidents. This project aims to develop two patient safety interventions to promote organisational learning about safety - a patient measure of organisational safety (PMOS), and a patient incident reporting tool (PIRT) - to help the NHS prevent patient safety incidents by learning more about when and why they occur.


To develop the PMOS 1) literature will be reviewed to identify similar measures and key contributory factors to error; 2) four patient focus groups will ascertain practicality and feasibility; 3) 25 patient interviews will elicit approximately 60 items across 10 domains; 4) 10 patient and clinician interviews will test acceptability and understanding. Qualitative data will be analysed using thematic content analysis.

To develop the PIRT 1) individual and then combined patient and clinician focus groups will provide guidance for the development of three potential reporting tools; 2) nine wards across three hospital directorates will pilot each of the tools for three months. The best performing tool will be identified from the frequency, volume and quality of reports.

The validity of both measures will be tested. 300 patients will be asked to complete the PMOS and PIRT during their stay in hospital. A sub-sample (N = 50) will complete the PMOS again one week later. Health professionals in participating wards will also be asked to complete the AHRQ safety culture questionnaire. Case notes for all patients will be reviewed. The psychometric properties of the PMOS will be assessed and a final valid and reliable version developed. Concurrent validity for the PIRT will be assessed by comparing reported incidents with those identified from case note review and the existing staff reporting scheme. In a subsequent study these tools will be used to provide information to wards/units about their priorities for patient safety. A patient panel will provide steering to the research.


The PMOS and PIRT aim to provide a reliable means of eliciting patient views about patient safety. Both interventions are likely to have relevance and practical utility for all NHS hospital trusts.

Peer Review reports

1. Background

The public expect safety to be a priority within health services. However, estimates show that as many as one in 10 patients are harmed while receiving hospital care [14]. Strategies to improve safety have focused on developing incident reporting systems, and changing systems of care and professional behaviour. However, there has recently been a growing interest in involving patients in safety initiatives. Indeed, patient involvement in safety orientated activities very much reflects recent UK government policy aims for people to be generally more involved in their care [5, 6]. Internationally, patient involvement is also a key priority with the World Health Organisation's World Alliance for Patient Safety (WHO, WAPS) citing mobilisation and empowerment of patients as one of six action areas that will be taken forward in its 'Patients for Patient Safety' programme [7]. This approach advances the development and use of interventions to promote and support patients' (and their representatives) roles in securing their own safety in health care contexts. Patients are in a unique position to contribute to both learning about safety and improvements to the safety of health care systems, by feeding information about safety issues they have identified or experienced, into local and national safety reporting systems.

Despite international emphasis on patient involvement in safety there is a dearth of research evidence on the acceptability to patients and equivocal evidence to date that such involvement leads to improvements in safety. The evidence that exists indicates that patients are willing and able to participate in error prevention strategies [8] and have the potential to improve safety [912]. However, many factors hinder patient participation including acceptance of the new patient role, lack of medical knowledge, lack of confidence, co-morbidity and sociodemographic factors [13]. Thus, there is clearly a need to understand further how patients can best be involved and how they can act to improve safety of care.

Reason's well known model of organisational safety [14] states that organisational accidents are a result of a number of factors including active failures on the part of the individual (for example, attentional slips, or mistakes in decision making), and 'systems failures' encompassing latent failures (for example, budgeting or rostering descisions) and local working conditions (for example, equipment unavailable, ward or unit understaffed). These failures are often referred to as 'contributory factors'. Based on these ideas, measurement tools have been developed in high-risk industries to monitor organisations' 'safety health' [15, 16]. However, currently no general means of assessing organisational safety or 'systems' failures exists within the NHS [although see a recent paper exploring this in relation to operating rooms and intensive care units: [17]]. Furthermore, no specific measures of organisational safety exist that ask for the views of customers or patients, despite patients being well placed to observe the organisation of their care and the practices around them. Scales measuring patients' perceptions of healthcare are available, for example measures of patient satisfaction [1820] but these have been criticised for being subjective, unreliable and with little validity [21, 22]. Therefore, there is a need for reliable and valid tools that allow patients the opportunity to provide feedback on the safety of their care environment to inform local and organisational changes to improve patient safety.

Learning from error is a key element of patient safety [23], and one way to learn is through the reporting and analysis of patient safety incidents. A patient safety incident (PSI) has been defined as "any unintended or unexpected incident which could have or did lead to harm for one or more patients receiving NHS care" [24]. This definition usefully encompasses a variety of situations relating to patient safety, across both adverse events themselves (e.g. medical, surgical or diagnostic error), and near misses (e.g. situations or processes which could have resulted in preventable harm to a patient, but were averted). Historically, efforts to learn from incident reports have been focused on staff-led reporting systems [25], with little attention paid to the potential of the patient as a valuable source of information about patient safety [11, 2629]. Indeed, it has been argued by some authors that the patient is uniquely placed to contribute to the quality and safety of their own care [30], with recent empirical work demonstrating the feasibility and value of patient reporting [for review: [31]; also [3234]]. However, no study to date has attempted to systematically develop and evaluate the most effective method of patient reporting. In addition, no study has attempted to link reporting of patient safety incidents to mainstream quality improvement mechanisms.

The aim of the current study is to develop and test a patient measure of organisational safety and patient incident reporting tool which will be used separately, or in combination, to help the NHS respond and learn quickly from failures in organisational systems as well as patient safety incidents. Specific objectives related to the development of the two tools are as follows:

Developing the Patient Measure of Organisational Safety (PMOS)

  1. 1.

    To determine the most appropriate way of assessing patients perceptions of organisational safety (study 1)

  2. 2.

    To develop a draft PMOS using previous literature and additional qualitative interviews with patients (study 2)

  3. 3.

    To explore acceptability and understanding of the draft PMOS using semi-structured interviews with patients and health professionals (study 3).

Development of the Patient Incident Reporting Tool (PIRT)

  1. 4.

    Based on views of patients and health professionals, to develop 3 different mechanisms for capturing patient reports of patient safety incidents experienced whilst receiving treatment in hospital (study 4).

  2. 5.

    To identify which of the 3 mechanisms is a) most effective in generating reports and b) most acceptable to patients and health professionals (study 5).

Testing the PMOS and PIRT

  1. 6.

    To explore the effectiveness and reliability of the PMOS in detecting patient perceptions of organisational safety (study 6).

  2. 7.

    To compare the error incidence and quality of reports from the PIRT with other standard methods used in practice (case note review and the trust staff-led incident reporting system) (study 6).

2. Methods

There are four phases to the project. The preparation of the protocols for each phase was done in collaboration with a variety of patients and health professionals at Bradford Teaching Hospitals NHS Foundation Trust. This was to ensure that the study aims and methods represented the views of both of these key stakeholder groups. In the first instance the development of the PMOS and PIRT will run in parallel, before the final versions of the tools are combined in a large quantitative study. The study protocol is summarised in Figure 1 has been approved by the Bradford Local Research Ethics Committee and Bradford Teaching Hospitals NHS Foundation Trust Research and Development department.

Figure 1
figure 1

Summary of research protocol.

Due to the exploratory and developmental nature of the project, both qualitative and quantitative methods will be employed. Study participants will be patients (or parents and other carers of patients) and/or health professionals based at Bradford Teaching Hospitals NHS Foundation Trust, a large organisation encompassing two urban hospitals located in Bradford, United Kingdom. Bradford has an ethnically diverse ethnic community with approximately 19% of the population having South Asian origins, mainly from Pakistan [35].

2.1 Phase One: Developing a draft PMOS measure

2.1.1. Objective 1: To determine the most appropriate way of assessing patients' perceptions of organisational safety Background

The first stage in developing the PMOS is to assess the feasibility of this novel measurement concept, with particular reference to the acceptability of patient identification of organisational safety issues. Method

Focus groups with patients will explore issues around the assessment of patients' perceptions of organisational safety. Sample and procedure

Four focus groups of 4-8 patients, relatives or carers will explore the following issues: a) the most viable method (e.g. questionnaire, structured diary) and medium (e.g. paper, web-based) for collecting patients' perceptions of organisational safety; b) when during the patient stay it would be best to collect these perceptions (e.g. during/at discharge); and c) face validity of a staff measure of organisational safety developed previously by the research team [36], modified to make appropriate for patients. Patients, and their relatives or carers, will be recruited in-situ from a variety of clinical settings. Analysis

Focus groups will be transcribed and analysed using content analysis [37].

2.1.2 Objective 2: To develop a draft PMOS using previous literature and additional qualitative interviews with patients Background

Following assessment of the feasibility of the PMOS concept, a draft version of the measure will be constructed. Although no tools such as the PMOS currently exist, literature will be reviewed to identify any similar tools used in healthcare or other industries which may inform the development of the PMOS (e.g. the Consumer Assessment of Healthcare Providers and Systems Hospital Survey [19]; Hospital Survey on Patient Safety Culture [38]). Items will also be extracted from tools used in other high-hazard industries (e.g. Shell Tripod, Review: the Railtrack proactive error management tool). A systematic research review will identify key domains of systems' failures within hospital settings to ensure all appropriate contributory factors are measured within the tool. In addition a set of semi-structured interviews with patients will be used to construct additional items for inclusion within the measure. Method

Semi-structured interviews with patients will explore their experiences of safety within hospital, and what they might be in a position to identify. Sample and procedure

Interviews will be conducted using purposive sampling to include a broad population (e.g. across a range of ages, length of stay in hospital, degree of expertise in their condition, and ethnic groups). Interviews will proceed using an interview schedule until saturation of data is achieved (e.g. no new items are elicited) or 25 interviews are conducted. Following advice from an external steering group of patient safety researchers, policy makers and patient representatives, a decision was made to use two types of interviews to help identify items. Interviews will be conducted in either a 'bottom up' or 'top down' manner. In the former, patients/carers will be asked to describe a typical day of their most recent hospital experience. The interviewer will then identify possible systems failures, and probe to ascertain why the patient felt these occurred. In order to assist patients' focus on more organisational factors of care, the Systems Engineering Initiative for Patient Safety (SEIPS) model of work system and patient safety [39] will be presented. In the latter interviews the key domains of contributory factors identified from the systematic review will be used as a framework. Patients/carers will be asked how these factors may manifest themselves at a ward level. Analysis

All interviews will be transcribed. The first set of interviews will be analysed using thematic content analysis [40] to identify contributory factors that patients can spontaneously report. The second set of interviews using the contributory factor framework will be analysed using content analysis to explore a) what types of contributory factors patients feel they can identify, and b) how the contributory factors manifest themselves at a ward level. At this stage the authors envisage a pool in excess of 60 items for inclusion in version 1 of the measure.

2.1.3 Objective 3: To explore the acceptability and understanding of the draft PMOS using semi-structured interviews with patients and health professionals Background

Having constructed the draft PMOS measure, it will be important to explore its acceptability and face validity. As the tool will ultimately be delivered at a ward/unit level, it is vital to ensure that it is acceptable to health professionals as well as patients. Method

Semi-structured interviews with patients and health professionals will explore the acceptability and understanding of the draft PMOS. Sample and procedure

Ten interviews will be conducted with health professionals and patients, purposively sampled from different care environments. These interviews will explore the face validity of the items, and to explore comprehension and interpretation. The interviews will also explore appropriate response options, for example whether participants find it easier to identify the presence or absence of a problem (answered with yes or no), or to have a scaled response (answered using a likert-type scale). Participants will use the 'think aloud' protocol [41] whilst completing the draft PMOS. The think aloud technique is a form of cognitive interviewing where participants are asked to verbalise all thoughts they have whilst completing a task (in this case completing the PMOS). Respondents are asked to 'talk aloud constantly' and to try not to plan or explain what they say. This process has been used successfully to understand comprehension of questionnaires in other domains [42]. Analysis

A coding frame will be developed from inspection of two interviews. Responses to all questions will be coded by two independent reviewers to ascertain whether significant problems are apparent in the understanding or interpretation of the items. Disagreements will be discussed and resolved. Items which are problematic will be eliminated on the basis of these responses.

2.2 Phase two: Developing a patient incident reporting tool (PIRT)

2.2.1 Objective 4: Based on views of patients and health professionals, to develop 3 different mechanisms for capturing patient reports of patient safety incidents experienced whilst receiving treatment in hospital Background

In order to ensure that any patient incident reporting tool we develop meets the perceived needs and expectations of both patients and health professionals, it will be important to work with both groups to generate possible mechanisms for capturing patient reports of patient safety incidents. This will also ensure that the final tool developed during the course of the research both reflects, and is embedded, in practice. Method

Three focus groups of 8-10 individuals will be conducted to discuss the feasibility and acceptability of patients reporting patient safety incidents within a hospital setting. Sample and procedure

The first focus group will comprise patients - or their relatives/carers - from across a range of recent health services experiences (e.g. acute through to chronic conditions; across the range of hospital specialties), with an appropriate demographic composition (e.g. age, gender, ethnic group). The feasibility of eliciting patient safety reports and acceptable methods for capturing such reports will be explored. The second focus group will be conducted with health professionals and managers from across a range of disciplines and medical specialties. Discussion will focus on the feasibility of the identified methods for eliciting patient reports in practice. The final focus group will bring together the patients and health professionals involved in groups 1 and 2, to further develop the suggested mechanisms and facilitate reaching a collective agreement in line with the study objective. Analysis

Outline ideas for three mechanisms will be agreed at the final focus group, by asking participants to identify their preferred three options from the suggestions presented at the earlier focus groups. In addition, a pragmatic qualitative analysis [43] will be undertaken on the transcripts of the focus groups, to explore the practice and patient context, and inform the subsequent development and implementation of the three mechanisms.

2.2.2 Objective 5: To explore the efficacy of the 3 potential PIRT mechanisms Background

Having identified three mechanisms for capturing patient reports of patient safety incidents, we will then pilot these mechanisms to explore the quality of information they provide and their usage by patients. Method

Pilot study with randomisation of PIRT mechanisms at a ward/unit level. Sample and procedure

Nine wards across three directorates within the trust will act as hosts for the trial. Directorates selected to host the trial will represent different clinical specialties to ensure that the final mechanism is not context dependent, and can generalise across the hospital setting. Selection of the three wards within each host directorate will be done to minimise differences in terms of the type and demographics of the patients treated, to reduce threats to internal validity. Within each directorate, each of the three wards will trial one of the three draft incident reporting mechanisms, for a three month period, with the mechanisms randomly assigned to the three wards to reduce threats to external validity and recruitment bias [44]. During the study period, patients on each of the wards will be recruited and asked to provide reports of patient safety incidents via their designated mechanism. Recruitment will continue for three months with a view to collecting 90 patient safety reports - 30 for each of the three mechanisms. A similar study found 27.2 patient safety incidents were reported for every 100 patients [34]. Therefore it is anticipated we will need to recruit approximately 330 patients to this study to gain the required number of reports.

Where the mechanism requires non-written forms of report, these will be digitally recorded for transcription, or recorded using field notes, depending on patient preference. All reports received via each of the three draft reporting mechanisms will be reviewed regularly through the study period, to identify those that represent a PSI. Only reports agreed by the research team as fitting with this definition will be counted as a PSI report, and included as part of the ultimate PSI report total. In order to meet our duty of care to participants, health professionals and the Trust, we will collaborate with health professionals to develop a mechanism for timely identification of PSIs that require urgent action. Clinical members of the research team will then review PSI reports to assess whether there is a need for urgent action, and if so, will refer the incident to the Risk Management Team. Analysis

Volume of reports: The number of patients required to generate 30 reports will be used as a measure of the capacity of each mechanism to identify a PSI.

Quality of reports: Using a coding frame developed from a sample of 10% of received PSI reports, three independent raters (including health professionals and patient representatives) will independently code the data for PSI type, causation and potential outcome [43]. This will allow calculation of inter-rater reliability and will also assess the feasibility of the reporting and analysis process for practitioners. Following an assessment of the volume of reports generated, and quality of information achieved by each of the mechanisms, the best 'performing' mechanism will be chosen to be developed further.

2.3 Phase 3: To test the reliability and validity of the PMOS and to compare the error incidence and quality of patient elicited information from the PIRT to case note review and current incident reporting data

At this point the PMOS and PIRT projects will merge and will cover the following two objectives in study 6.

2.3.1 Objectives 6 & 7: To explore the reliability and validity of the PMOS in detecting patients' perceptions of organisational safety; To compare the error incidence and quality of reports from the PIRT with other standard methods of error detection Background

Following the development of draft PMOS and PIRT measurement tools, a large scale study will undertake to establish the psychometric properties of both tools. In addition, consideration will be given to the nature of the data elicited from each tool, and any relationships between them. In doing so, we will begin to understand how these tools might work together as part of a wider patient safety intervention. Method

Validation study. Sample

Part A: 300 patients, or parents/carers of patients from a variety of units/wards will be recruited over a two month period. Allowing for 30% participation we will initially invite 900 patients to participant to provide sufficient responses to test the factor structure of the PMOS (minimum of 5 respondents per item [45]). For analysis pertaining to the PIRT, a sample size of 228 has been used successfully elsewhere to compare patient-reported events to those reported in the case notes and hospital reporting scheme [34].

Part B: Health professionals from participating wards (approximately N = 250) will complete the Hospital survey on patient safety culture (AHRQ) [38] adapted for UK hospitals. Procedure

Part A: Consenting patients will be asked to complete the PIRT and PMOS at some point in their stay (informed by earlier developmental work) and will have their medical notes reviewed after discharge. The exact timing of recruitment and when they will be asked to complete the PIRT and PMOS will be subject to the results from the earlier studies (for example, whether they should complete the PMOS/PIRT during their stay or at discharge, whether it is viable for patients to complete either tool retrospectively). One week after completion, a sub-sample of 50 respondents will be asked to complete the PMOS again to allow calculation of test-retest reliability. Responses to the PMOS and PIRT will be matched using an anonymous code. Upon discharge the case notes of the patient will be reviewed by a multidisciplinary team of health professionals and researchers using an explicit review method to detect adverse events [13, 46].

Part B: Prior to the commencement of the study in all participating units, health professionals will be asked to complete the AHRQ hospital survey on patient safety culture [38]. No personally identifiable information will be collected although they will be asked to indicate the unit/department where they are employed. Health professionals will be asked to mail these questionnaires back to the research team via the internal mail system. Analysis

PMOS: To analyse the reliability and validity of the PMOS a number of statistical procedures will be conducted. First, item analysis and sub-scale analysis will assess the reliability of the scales. Test-retest reliability will also be assessed by correlations between PMOS scores at the two time points. Factor analysis will explore the dimensionality of the measure to assess whether clear distinctions between the different contributory factor domains can be identified. To measure concurrent validity the ability of the PMOS to differentiate different units/wards based on differences in the AHRQ hospital survey on patient safety will be assessed. Finally to assess predictive validity correlations between the PMOS scores and safety incident data (as identified from the PIRT) will be explored.

PIRT: Three main outcome measures will be explored: a) the frequency and volume of PSI reports; b) the quality of PSI reports; and c) the comparability of PSI reports with other review methods, to establish concurrent validity.

  1. a)

    Frequency and volume of PSI reports

The frequency (number of reports) and volume (number of reports per participant) of PSIs will be compared with the frequency and volume of PSIs identified through case note review and from the hospitals standard incident reporting scheme, for those patients participating in the study. The case note review will adapt the explicit review method to detect adverse events [3] and incorporate methods used elsewhere to compare patient-reported adverse events to those identified in case note review [47, 48].

In stage 1 of the review method, case notes will be screened by two nurses to identify potential incidents using 18 established and predefined criteria [3] modified to take account of what patients perceive as safety incidents [34]. In stage 2, two clinicians will review any records in which a PSI was identified in stage 1. A structured form will be used to determine a) whether the incident had potential for harm (either adverse event or near miss), b) impact, c) domain, d) cause and e) prevention, following guidelines from existing taxonomies [49]. In addition a standardised 6-point scale will be used to determine the role of clinical management rather than the disease process in occurrence of the patient safety incident. 10% of case notes will be reviewed by a second clinician to gather data on inter-rater reliability [50, 51].

Staff incident reporting databases at the Trust allow identification by patient name. Thus any PSI reports pertaining to the sample of 300 patients in the study will also be collected. These reports will be anonymised and linked to patients' reports and case notes using a unique code. The frequency and volume of incidents recorded through the three channels (patient incident reporting, staff incident reporting and case note review) will be compared.

  1. b)

    Quality of PSI reports

In order to assess the quality and richness of information contained within the reported incidents (e.g. to provide adequate information for organisational learning) two independent reviewers will rate the quality of the text from a random sample of 10% of incidents from all channels using previously validated techniques [43].

  1. c)

    Comparability of the PSI reports with other review methods

To explore the concurrent validity of the PIRT data (e.g. is it picking up the same reports made by health professionals in case notes?), 40 case notes and patient safety reports will be coded together by two clinicians. Disagreements will be resolved by consensus.

2.4 Phase 4: Developing an Intervention

Once the PMOS and PIRT have been finalised we will explore ways of using the information obtained through these measures to develop an intervention aimed at fostering feedback and promoting organisational learning. The process will be facilitated by stakeholder feedback and involvement, for example through patient and health professionals' panels. At the end of this process we will apply for further approval to pilot the intervention in one trust, and then roll out to five other NHS trusts.

2.5 Patient Panel

A panel of patient representatives will provide direction and steering to the research throughout the course of the project via regular attendance at project meetings with the research, and at special bi-annual patient panel meetings.

3. Discussion

This paper has presented details of a large-scale applied research project, aimed at systematically developing a patient-centred patient safety intervention. The focus of this work is to create tools which can be used alone, or in combination, to shed light on the 'patients' view' of patient safety, and to allow health service organisations to make improvements using this important perspective on patient safety. The authors very much acknowledge the need to create tools which are usable by patients and health professionals, yet have utility in delivering meaningful information regarding patient safety outcomes across the range of clinical specialties that make up a hospital setting. Indeed, one of the key strengths of the design is the central role of patients/carers and health professionals across all stages of the research project, not just as participants, but as real collaborators in the development of the intervention. The authors firmly believe that using this partnership approach will ensure that the tools we develop reflect the realities of the patient and health professionals' experience, which is crucial if, going forward, the tools are to become embedded in practice.

Clearly, as with all patient safety research there are challenges as well as opportunities. It is anticipated that the main issues facing this research project fall into two main categories: engaging patients and engaging health professionals.

Engaging patients

Although it has been demonstrated that patients are concerned about their safety whilst receiving treatment [33, 34], it is unclear that this concern represents a willingness to engage in patient safety related activities [29]. Indeed, the willingness of patients to engage in patient safety research varies across a number of indices [52, 53], and with most patient safety campaigns seemingly based on the assumption that patients will uniformly engage in safety activities, this presents researchers with a challenge: how to engage patients in organisation-level initiatives when their success may depend on individual-level factors? We also need to be mindful of the risk of patients feeling that we are shifting the weight of responsibility onto them, with the commensurate concern of receiving substandard or reduced care if they do not get involved [9]. In the light of all of the above issues, recruitment into the studies probably represents the most significant challenge to the success of the project.

Furthermore, effort needs to be directed at recruiting and engaging patients from all ethnicities and cultures. This is particularly important given the diverse nature of the local population in which the current project is located (Bradford, UK), with over-representation of certain ethnic groups in some units within the Trust hospitals. There is also an empirical imperative given the emerging evidence suggesting that non-native speaking patients may experience increased adverse events [54] but be less likely to report problems with their care [55]. Indeed, it has recently been suggested that "if patient safety engagement/partnership programs are to perform well in cross-cultural health care contexts, they need to be....appropriately informed by the perspectives and experiences of patients and families/nominated carers from minority cultural and language backgrounds" (p.1: [56]).

Engaging health professionals

Two recent reviews of patient involvement in patient safety initiatives have concluded that health professionals have an important role in engaging patients in such initiatives [13, 29]. Patients have been found to be far more willing to ask health professionals challenging questions if instructed by medical staff [52], and where health professionals consistently engage patients in discussions about their care as part of a trusting patient-professional relationship [53]. This underlines the importance of gaining the support of health professionals when introducing patient safety initiatives or interventions. Indeed, if patient engagement in safety is to succeed it is vital for health professionals to move beyond recognising the benefits of patient involvement, towards actively encouraging safety related behaviours in patients [28, 53]. Our challenge therefore, is to ensure that our research proceeds in a collaborative way with health professionals as well as patients, to represent and integrate their views and concerns as much as possible into the design of the patient safety intervention. Looking ahead to the possible uptake of the tools across health services, it will be important to more fully understand the nature of health professionals' concerns about patient involvement [53], and ensure that interventions remain a collaboration between patients, health professionals and researchers, if they are to prove an effective means of proactively managing patient safety in the future.

Involving patients in their own safety is both a promising and policy-driven area for study, with the potential for delivering real changes to patient safety outcomes in the short- and longer-term. Development of the tools described here, using a partnership model encouraging real collaboration between patients, health professionals and researchers will help to ensure that the final intervention reflects the realities of the environment in which it will ultimately exist, increasing the likelihood of acceptance and use by patients in the future. The authors hope ultimately to demonstrate that these tools can provide a basis for services to understand more about patient safety in their areas, allowing them to achieve substantive improvement to patient safety outcomes.

6. Authors' information

All authors are based within the Yorkshire Quality and Safety Research Group, which represents a multi-disciplinary collaboration across the Bradford health care economy, other regional NHS trusts and the universities of Leeds, Bradford, York and Newcastle. The group leads a number of large applied health service research projects, and currently holds two NIHR programme grants in patient safety. Our research brings together health professionals, patients, managers and researchers, to develop evidence-based improvements to the quality and safety of health care.


  1. Leape LL, Brennan TA, Laird N, Lawthers AG, Localio AR, Barnes BA, Hebert L, Newhouse JP, Weiler PC, Hiatt H: The nature of adverse events in hospitalised patients. Results of the Harvard Medical Practice Study ll. New England Journal of Medicine. 1991, 324: 377-384. 10.1056/NEJM199102073240605.

    Article  CAS  PubMed  Google Scholar 

  2. Brennan TA, Leape LL, Laird NM, Hebert L, Localio AR, Lawthers AG, Newhouse JP, Weiler PC, Hiatt HH: Incidence of adverse events and negligence in hospitalised patients: Results of the Harvard medical practice study I. New England Journal of Medicine. 1991, 324: 370-376. 10.1056/NEJM199102073240604.

    Article  CAS  PubMed  Google Scholar 

  3. Vincent C, Neale G, Woloshynowych M: Adverse events in British hospitals: preliminary retrospective record review. British Medical Journal. 2001, 322: 517-519. 10.1136/bmj.322.7285.517.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  4. de Vries EN, Ramrattan MA, Smorenburg SM, Gouma DJ, Boermeester MA: The incidence and nature of in-hospital adverse events: A systematic review. Quality and Safety in Health Care. 2008, 17: 216-223. 10.1136/qshc.2007.023622.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  5. Department of Health: Equity and excellence: Liberating the NHS. 2010, London: The Stationary Office

    Google Scholar 

  6. The Lord Professor A.Darzi: High Quality Care for All: NHS Next Stage Review; Final Report. 2008, London: Department of Health

    Google Scholar 

  7. World Health Organisation: World Alliance for Patient Safety. 2004, Geneva: World Health Organisation

    Google Scholar 

  8. Waterman AD, Gallagher TH, Garbutt J, Waterman BM, Fraser V, Burroughs TE: Brief report: Hospitalized patients' attitudes about and participation in error prevention. Journal of General Internal Medicine. 2006, 21: 367-370. 10.1111/j.1525-1497.2005.00385.x.

    Article  PubMed  PubMed Central  Google Scholar 

  9. Entwistle VA, Mello MM, Brennan TA: Advising patients about patient safety: Current initiatives risk shifting responsibility. Joint Commission Journal on Quality & Patient Safety. 2005, 31: 483-494.

    Google Scholar 

  10. Hall J, Peat M, Birks Y, Golder S, on behalf of the PIPS Group, Entwistle V, Gilbody S, Mansell P, McCaughan D, Sheldon T, Watt I, Williams B, Wright J: Effectiveness of interventions designed to promote patient involvement to enhance safety: A systematic review. Quality and Safety in Health Care. 2010, 19: 1-7. originally published online April 27, 2010

    Article  Google Scholar 

  11. Vincent CA, Coulter A: Patient safety: What about the patient?. Quality and Safety in Health Care. 2002, 11: 76-80. 10.1136/qhc.11.1.76.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  12. Davis RE, Jacklin R, Sevladis N, Vincent CA: Patient involvement in patient safety: What factors influence patient participation and engagement?. Health Expectations. 2007, 10: 259-267. 10.1111/j.1369-7625.2007.00450.x.

    Article  PubMed  Google Scholar 

  13. Longtin Y, Sax H, Leape LL, Sheridan SE, Donaldson L, Pittet D: Patient participation: Current knowledge and applicability to patient safety. Mayo Clinic Proceedings. 2010, 85: 53-62. 10.4065/mcp.2009.0248.

    Article  PubMed  PubMed Central  Google Scholar 

  14. Reason J: Managing the risk of organisational accidents. 1997, Farnham: Ashgate Press

    Google Scholar 

  15. Hudson PTW, Groeneweg J, Reason JT, Wagenaar WA, van der Meeren RJW, Visser JP: Application of TRIPOD to measure latent errors in North Sea gas platforms: Validity of Failure State Profiles. Proceedings from the First International Conference on Health, Safety and Environment: November 1991; The Hague, The Netherlands. 1991, Texas: Society of Petroleum Engineers

    Google Scholar 

  16. Wagenaar WA, Groeneweg J, Hudson PTW, Reason JT: Promoting Safety in the Oil Industry. Ergonomics. 1994, 37: 1999-2013. 10.1080/00140139408964963.

    Article  Google Scholar 

  17. van Beuzekom M, Akerboom SP, Boer F: Assessing system failures in operating rooms and intensive care units. Quality and Safety in Health Care. 2007, 16: 45-50. 10.1136/qshc.2005.015446.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  18. Castle NG, Brown J, Hepner KA, Hays RD: Review of the literature on survey instruments used to collect data on hospital patients perceptions of care. Health Services Research. 2005, 40: 1996-2017. 10.1111/j.1475-6773.2005.00475.x.

    Article  PubMed  PubMed Central  Google Scholar 

  19. Goldstein E, Farquar M, Crofton C, Darby C, Garfinkel S: Measuring hospital care from the patients' perspective: An overview of the CAHPS hospital survey development process. Health Services Research. 2005, 40: 1977-1995. 10.1111/j.1475-6773.2005.00477.x.

    Article  PubMed  PubMed Central  Google Scholar 

  20. Sofaer S, Crofton C, Goldstein E, Hoy E, Crabb J: What do consumers want to know about the quality of care in hospitals?. Health Services Research. 2005, 40: 2018-2036. 10.1111/j.1475-6773.2005.00473.x.

    Article  PubMed  PubMed Central  Google Scholar 

  21. Hankins M, Fraser A, Hodson A, Hooley C, Smith H: Measuring patient satisfaction for the Quality and Outcomes Framework. The British Journal of General Practice. 2007, 57: 737-740.

    Article  PubMed  PubMed Central  Google Scholar 

  22. Hendriks AA, Oort FJ, Vrielink MR, Smets EM: Reliability and validity of the satisfaction with Hospital Care Questionnaire. International Journal for Quality in Health Care. 2002, 14: 471-482. 10.1093/intqhc/14.6.471.

    Article  CAS  PubMed  Google Scholar 

  23. Department of Health: An Organisation With A Memory. Report of an expert group on learning from adverse events in the NHS. 2000, London: The Stationery Office

    Google Scholar 

  24. NPSA: []

  25. Armitage G, Chapman J: Incident reporting: A curate's egg?. Journal of Integrated Care Pathways. 2007, 10: 92-96.

    Article  Google Scholar 

  26. Coulter A: Patient safety: What role can patients play?. Health Expectations. 2006, 9: 205-206. 10.1111/j.1369-7625.2006.00405.x.

    Article  PubMed  Google Scholar 

  27. Jorm CM, Dunbar N, Sudano L, Travaglia JF: Should patient safety be more patient centred?. Quality and Safety Policy. 2009, 33: 390-399.

    Google Scholar 

  28. Koutantji M, Davis RE, Vincent CA, Coulter A: The patient's role in patient safety: Engaging patients, their representatives, and health professionals. Clinical Risk. 2005, 11: 99-104.

    Google Scholar 

  29. Schwappach DLB: Engaging patients as vigilant partners in safety. A systematic review. Medical Care Research and Review. 2010, 67: 119-148. 10.1177/1077558709342254.

    Article  PubMed  Google Scholar 

  30. Unruh KT, Pratt W: Patients as actors: The patient's role in detecting, preventing and recovering from medical errors. International Journal of Medical Informatics. 2006, 76 (Suppl 1): S236-S244.

    PubMed  Google Scholar 

  31. King A, Daniels J, Lim J, Cochrane DD, Taylor A, Ansermino JM: Time to listen: A review of methods to solicit patient reports of adverse events. Quality and Safety in Health Care. 2010, 19: 148-157. 10.1136/qshc.2008.030114.

    Article  CAS  PubMed  Google Scholar 

  32. Weissman JS, Schneider EC, Weingart SN, Epstein AM, David-Kasdan J, Feibelmann S, Annas CL, Ridley N, Kirle L: Comparing patient-reported hospital adverse events with medical record review: Do patients know something that hospitals do not?. Annals of Internal Medicine. 2008, 149: 100-108.

    Article  PubMed  Google Scholar 

  33. Weingart SN, Price J, Duncombe D, Connor M, Sommer K, Conley KA, Bierer BE, Reid Ponte P: Patient-reported safety and quality of care in outpatient oncology. Joint Commission Journal on Quality and Patient Safety. 2007, 33: 83-94.

    PubMed  Google Scholar 

  34. Weingart SN, Pagovich O, Sands DZ, Li JM, Aronson MD, Davis RG, Bates DW, Phillips RS: What can hospitalized patients tell us about adverse events? Learning from patient-reported incidents. Journal of General Internal Medicine. 2005, 20: 830-836. 10.1111/j.1525-1497.2005.0180.x.

    Article  PubMed  PubMed Central  Google Scholar 

  35. National Statistics Database: [;jsessionid=ac1f930d30d556d5947d6b2f40e2b01df66a2ca25e45?a=3&b=276807&c=bradford&d=13&e=13&g=379385&i=1001x1003x1004&m=0&r=1&s=1288612098425&enc=1&dsFamilyId=47&nsjs=true&nsck=true&nssvg=false&nswid=1260]

  36. Carruthers S: Latent preconditions of medication administration errors: Development of a proactive error-management tool. PhD Thesis. 2009, University of Leeds, Institute of Psychological Sciences

    Google Scholar 

  37. Millward L: Focus Groups. Research methods in psychology. Edited by: Breakwell GM, Hammond S, Fife-Schaw C. 2000, London: Sage Publications Ltd, 303-325. 2

    Google Scholar 

  38. Agency for Healthcare Research & Quality: []

  39. Carayon P, Hundt AS, Karsh BT, Gurses AP, Alvarado CJ, Smith M, Brennan PF: Work system design for patient safety: The SEIPS model. Quality & Safety in Health Care. 2006, 15: i50-i58. 10.1136/qshc.2005.015842.

    Article  Google Scholar 

  40. Braun V, Clarke V: Using thematic analysis in psychology. Qualitative Research in Psychology. 2006, 3: 77-101.

    Article  Google Scholar 

  41. Green C, Gilhooly K: Protocol analysis: Practical Implementation. Handbook of qualitative research methods for psychology. Edited by: Richardson JTE. 1996, Leicester: BPS Books, 55-74.

    Google Scholar 

  42. French DP, Cooke R, McLean N, Williams M, Sutton S: What do people think about when they answer theory of planned behaviour questionnaires: A think aloud study. Journal of Health Psychology. 2007, 12: 672-687. 10.1177/1359105307078174.

    Article  PubMed  Google Scholar 

  43. Armitage G, Newell RJ, Wright J: Improving the quality of drug error reporting. Journal of Evaluation in Clinical Practice. 2010, 16: 1189-1197. 10.1111/j.1365-2753.2009.01293.x.

    Article  PubMed  Google Scholar 

  44. Puffer S, Torgerson D, Watson J: Cluster randomized controlled trials. Journal of Evaluation in Clinical Practice. 2005, 11: 479-483. 10.1111/j.1365-2753.2005.00568.x.

    Article  PubMed  Google Scholar 

  45. Tabachnick BG, Fidell LS: Using Multivariate Statistics. 2006, Needham Heights, MA: Allyn & Bacon, 5

    Google Scholar 

  46. Hutchinson A, Coster JE, Cooper KL, McIntosh A, Walters SJ, Bath PA, Pearson M, Rantell K, Campbell MJ, Nicholl J, Irwin P: Assessing quality of care from hospital case notes: Comparison of reliability of two methods. Quality and Safety in Health Care. 2010

    Google Scholar 

  47. Baba-Akbari Sari A, Sheldon TA, Cracknell A, Turnbull A: Sensitivity of routine system for reporting patient safety incidents in an NHS hospital: Retrospective patient case note review. British Medical Journal. 2007, 334: 79-10.1136/bmj.39031.507153.AE.

    Article  Google Scholar 

  48. Franklin BD, Birch S, Savage I, Wong I, Woloshynowych M, Jacklin A, Barber N: Methodological variability in detecting prescribing errors and consequences for the evaluation of interventions. Pharmacoepidemiology and Drug Safety. 2009, 18: 992-999. 10.1002/pds.1811.

    Article  PubMed  Google Scholar 

  49. Runciman WB, Helps SC, Sexton EJ, Malpass A: A classification for incidents and accidents in the health-care system. Journal of Quality in Clinical Practice. 1998, 19: 199-211.

    Google Scholar 

  50. Bates DW, Boyle DL, Vander Vliet MB, Schneider J, Leape L: Relationship between medication errors and adverse drug events. Journal of General Internal Medicine. 1995, 10: 199-205. 10.1007/BF02600255.

    Article  CAS  PubMed  Google Scholar 

  51. Kaushal R, Bates DW, Landrigan C, McKenna KJ, Clapp MD, Federico F, Goldmann DA: Medication errors and adverse drug events in paediatric inpatients. Journal of the American Medical Association. 2001, 285: 2114-2120. 10.1001/jama.285.16.2114.

    Article  CAS  PubMed  Google Scholar 

  52. Davis RE, Koutantji M, Vincent CA: How willing are patients to question healthcare staff on issues related to the quality and safety of their healthcare? An exploratory study. Quality and Safety in Health Care. 2008, 17: 90-96. 10.1136/qshc.2007.023754.

    Article  CAS  PubMed  Google Scholar 

  53. Entwistle VA, McCaughan D, Watt IS, Birks Y, Hall J, Peat M, Williams B, Wright J, for the PIPS (Patient Involvement in Patient Safety) group: Speaking up about safety concerns: multi-setting qualitative study of patients' views and experiences. Quality and Safety in Health Care. 2010, 19: 1-7.

    Article  Google Scholar 

  54. Divi C, Koss R, Schmaltz S, Loeb J: Language Proficiency and adverse events in US hospitals: A pilot study. International Journal for Quality in Health Care. 2007, 19: 60-67. 10.1093/intqhc/mzl069.

    Article  PubMed  Google Scholar 

  55. Garrett PW, Dickson HG, Young L, Whelan AK: "The happy migrant effect". Perceptions of negative experiences of healthcare by patients with little or no English: A qualitative study across seven languages. Quality and Safety in Health Care. 2008, 17: 101-103. 10.1136/qshc.2007.022426.

    Article  CAS  PubMed  Google Scholar 

  56. Johnstone MJ, Kanitsaki O: Engaging patients as safety partners: Some considerations for ensuring a culturally and linguistically appropriate approach. Health Policy. 2009, 90: 1-7. 10.1016/j.healthpol.2008.08.007.

    Article  PubMed  Google Scholar 

Pre-publication history

Download references

7. Acknowledgements

This article presents independent research kindly commissioned by the National Institute for Health Research (NIHR) under the Health Services Research programme. The views expressed in this publication are those of the authors and not necessarily those of the NHS, the NIHR or the Department of Health. We acknowledge the support of the Yorkshire Quality and Safety Research Group in the development of this proposal and the unique contribution of the patient panel at both the Bradford Institute for Health Research and Newcastle University.

Author information

Authors and Affiliations



Corresponding author

Correspondence to Jane K Ward.

Additional information

4. Competing interests

The authors declare that they have no competing interests.

5. Authors' contributions

JKW and RRCM prepared the manuscript and manage the two projects described in this protocol. RL and GA are the project leads and creators of the original protocol outline. JW and IW are the chief investigators on the two projects. All authors read and approved the final manuscript.

Authors’ original submitted files for images

Below are the links to the authors’ original submitted files for images.

Authors’ original file for figure 1

Rights and permissions

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and permissions

About this article

Cite this article

Ward, J.K., McEachan, R.R., Lawton, R. et al. Patient involvement in patient safety: Protocol for developing an intervention using patient reports of organisational safety and patient incident reporting. BMC Health Serv Res 11, 130 (2011).

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: