Patient safety in out-of-hours primary care: a review of patient records
© Smits et al; licensee BioMed Central Ltd. 2010
Received: 9 September 2010
Accepted: 10 December 2010
Published: 10 December 2010
Most patients receive healthcare in primary care settings, but relatively little is known about patient safety. Out-of-hours contacts are of particular importance to patient safety. Our aim was to examine the incidence, types, causes, and consequences of patient safety incidents at general practice cooperatives for out-of-hours primary care and to examine which factors were associated with the occurrence of patient safety incidents.
A retrospective study of 1,145 medical records concerning patient contacts with four general practice cooperatives. Reviewers identified records with evidence of a potential patient safety incident; a physician panel determined whether a patient safety incident had indeed occurred. In addition, the panel determined the type, causes, and consequences of the incidents. Factors associated with incidents were examined in a random coefficient logistic regression analysis.
In 1,145 patient records, 27 patient safety incidents were identified, an incident rate of 2.4% (95% CI: 1.5% to 3.2%). The most frequent incident type was treatment (56%). All incidents had at least partly been caused by failures in clinical reasoning. The majority of incidents did not result in patient harm (70%). Eight incidents had consequences for the patient, such as additional interventions or hospitalisation. The panel assessed that most incidents were unlikely to result in patient harm in the long term (89%). Logistic regression analysis showed that age was significantly related to incident occurrence: the likelihood of an incident increased with 1.03 for each year increase in age (95% CI: 1.01 to 1.04).
Patient safety incidents occur in out-of-hours primary care, but most do not result in harm to patients. As clinical reasoning played an important part in these incidents, a better understanding of clinical reasoning and guideline adherence at GP cooperatives could contribute to patient safety.
Patient safety has become a priority in the past decade, and many Western countries have examined the rate of adverse events in hospital care [1–8]. A systematic review reported that in 9.2% of all hospital admissions one or more adverse events (incidents with patient harm) occurred, while nearly half (43.5%) of these could have been prevented and 7.4% contributed to death .
Up to now, the focus in patient safety has mainly been on hospital care. Most patients, however, receive their healthcare in primary care settings, particularly in countries with a strong primary care system [10, 11]. Relatively little is known about patient safety in these settings. In a previous review, the rate of incidents in primary care has been estimated as ranging between 5 and 80 in 100,000 consultations . However, the majority of the included studies used event reporting by professionals as their research method. Reporting systems considerably under-report patient safety events and are not appropriate for estimating incidence rates [13, 14]. A recent study found evidence to suggest that the rate is much higher. This record review study reported that an incident with harm occurred every 48 consultations .
Features of GP cooperatives in the Netherlands 161718.
Out-of-hours is defined as daily from 5 pm to 8 am and the entire weekend
Population of 100,000 to 500,000 patients
Distances up to 30 km
GP cooperative usually situated near a hospital
Access through a single regional telephone number
Telephone triage by nurses
50-250 GPs, on call 4 hours a week on average
GP shift of 6 to 8 hours
Per shift, GPs have different roles: home visits, centre consultations, and supervising telephone triage
Drivers in identifiable GP cars that are fully equipped (e.g., O2, i.v. drip equipment, automated external defibrillator, medication)
Information and communication technology (ICT) support, including electronic patient files and online connection to the GP car
The aim of our study was to gain an understanding of the incidence, types, causes, and consequences of patient safety incidents in out-of-hours GP cooperatives. A secondary aim was to examine factors that are associated with the occurrence of patient safety incidents.
Study design and setting
In 2009, a retrospective patient record review study was performed to examine patient safety incidents in GP cooperatives providing out-of-hours primary care in the Netherlands. Data were collected in a sample of general practices associated with selected GP cooperatives, as general practices keep complete documentation of the healthcare their patients received, including their contacts with GP cooperatives and subsequent healthcare use.
Four GP cooperatives were selected. In this selection, we aimed to provide a good reflection of the national situation by taking into account location in the country, degree of urbanisation, and size of the cooperatives. A convenience sample of seventeen general practices linked to these GP cooperatives were invited to participate in the study, sixteen of which agreed to participate.
For each of the four GP cooperatives, we selected a sample of at least 250 patients who had contacted the GP cooperative in April or May 2009. For each GP cooperative, the first 250 contacts that were eligible for review were included in the study (consecutive sampling). A 'contact' was a patient who visited the GP cooperative, received telephone advice from the cooperative, or received a home visit from a GP working for the cooperative. For patients with multiple contacts with a GP cooperative within the study period, only the first contact was included in the sample as the index contact. We excluded administrative reports without a patient contact with the GP cooperative (for example, a note from a hospital reporting a patient's demise).
Several measures were taken to ensure the confidentiality of the information we collected. No patient or physician names were included in the database, and reviewers and researchers (study staff) signed a confidentiality agreement to maintain the confidentiality of the information. The Arnhem-Nijmegen ethical committee waived approval for this study.
Patient record review procedure
The reviewers assessed the patient contacts in the general practices. The general practices supplied the reviewers with the electronic medical records of sampled patients, including information about the contact with the GP cooperative, test results, and specialists' letters. Reviewers assessed whether one or more potential patient safety incidents had occurred during the patient's contact with the GP cooperative. A patient safety incident was defined as an unintended event during the care process that resulted, could have resulted or still might result in harm to the patient .
Firstly, the reviewers registered some basic patient characteristics: age, gender, whether the patient had contacted his GP about the same health problem within one week before contacting the GP cooperative, and whether the patient was a high-risk patient. Patients with cardiac and vascular disease, diabetes mellitus, asthma/COPD, polypharmacy (> 5 medications), immune system disease, malignancy (active), pregnancy, or a combination of these conditions, were defined as high-risk patients.
Secondly, the reviewers registered measures concerning the patients' contact with the GP cooperative: contact type, contact time, documented degree of urgency, reason for contact, diagnosis, and medical treatment. For a period of at least four months after the contact, moreover, reviewers registered whether patients had follow-up contacts (with a GP, GP cooperative, or hospital casualty department) relating to the index health problem, whether patients were admitted to a hospital, or whether patients died. Finally, the reviewers assessed whether the healthcare provided at the GP cooperative was potentially unsafe . If the reviewers had doubts about a particular case, the patient's GP was interviewed to clarify what had happened. If the reviewers signalled potentially unsafe healthcare, the patient's medical record proceeded to phase two.
In phase two, the medical records of patients who had received potentially unsafe healthcare were discussed by a panel of physicians to determine if a patient safety incident had indeed occurred. This panel discussed the potential incidents until consensus was achieved. Besides the two reviewers, the panel consisted of two experienced physicians.
Overview of classifications
Type of patient safety incidents 
Technical (Design; Construction; Materials; External)
Organisational (Transfer of knowledge; Protocols; Management priorities; Culture; External)
Human (Clinical reasoning/Knowledge-based behaviour; Qualifications; Coordination; Verification; Intervention; Monitoring; Slips; Tripping; External)
Harm to the patient 
Error, but no harm
Error resulting in harm to the patient (Emotional harm; Temporary harm; Initial/prolonged hospitalisation; Permanent harm; Intervention to sustain a patient's life)
Error resulting in death
Error, but harm indeterminate
Probability of severe harm or death
The consequences of the incidents were classified, using the 'severity of outcome' dimension of the International Taxonomy of Medical Errors in Primary Care . In addition, the probability of (severe) harm in the future was assessed (very likely, likely, not likely).
The first ten patient records from five general practices (N = 50) were independently assessed by the two reviewers to determine their agreement on the presence or absence of potentially unsafe healthcare.
Study results were first described using descriptive statistics and frequency tables. To test which patient and contact factors predicted the occurrence of patient safety incidents, univariate multilevel logistic regression analyses and a forward stepwise multilevel logistic regression analysis were performed, using GP cooperative as random factor in the model (PROC GLIMMIX). Results were considered statistically significant at p < 0.05. Data were analysed using SPSS 15.0 and SAS 9.2.
Description of patient safety incidents
Incidence and types
A total of 1,145 patient records were reviewed (for practical reasons, 248, 328, and 319 records were reviewed in three GP cooperatives and 250 records in the fourth cooperative). Agreement between the two reviewers was 98.0% and Cohen's kappa was 0.79 (95% CI: 0.39 to 1.00). The quality of the patient records was predominantly judged as good (94%). In 1,145 patient records, reviewers identified 56 potential patient safety incidents. The physician panel judged 27 of these to be patient safety incidents, which is an incident rate of 2.4% (95% CI: 1.5% to 3.2%).
Examples of patient safety incidents
A patient visited the GP cooperative with a metal foreign body in his eye. GP removed splinter and sent patient home. After four hours, the patient called the GP cooperative because of increasing pain in the eye. At patient's initial visit, no eye antibiotic had been prescribed nor had a bandage been applied.
Patient visited GP cooperative with dog bite in hand. No antibiotics were administered.
Patient called GP cooperative with pain in left side of abdomen. Patient had had diverticulitis before and asked for antibiotics. Patient received this medication prescription by telephone.
Patient called GP cooperative with acute loss of hearing in one ear. Assistant told patient over the telephone that it was a cerumen impaction. Later, the patient got an urgent referral to an ear, nose, and throat specialist, and it turned out to be sudden deafness.
A 22-year-old patient presented herself at the GP cooperative with acute pain in the left thorax without fever. The GP heard chest crepitations and diagnosed the patient with pneumonia. The patient was treated with antibiotics. After six days, the patient visited her own GP because of persisting pain. The GP sent the patient out for an X-ray. The chest X-ray showed a pneumothorax, which could have been treated conservatively.
A four-year-old patient visited the GP cooperative with a foot injury after being jammed between the spokes of her mother's bicycle. Her foot was blue, and she could not walk or stand on it. The GP did not perform a physical examination. Diagnosis: no fracture. Wait-and-see policy. Later the patient turned out to have epiphysiolysis.
For 27 patient safety incidents, a total of 30 causes could be identified. The causal factors fell into three different categories: clinical reasoning, protocols, and patient-related factors. All incidents had at least partly been caused by failures in clinical reasoning: the inability of individuals to apply their existing knowledge to a novel situation. In two cases, a patient-related factor was relevant, that is, a failure related to patient characteristics or conditions that are beyond the control of staff. In one case, the absence of an adequate protocol contributed to the incident. No technical causal factors were identified.
Actual and potential consequences
The majority of patient safety incidents did not result in actual patient harm (N = 19; 70%). Eight incidents had consequences for patients: an extra intervention was needed in six cases, and two patients had to be admitted to a hospital. No incidents resulted in permanent harm or death. Most incidents were not likely to result in patient harm in the long term (N = 24; 89%). In three cases (11%), future consequences were possible but not likely.
Factors associated with the occurrence of patient safety incidents
Overview of patient and contact characteristics and incident rate in each category
Number of contacts (%)
N = 1145
Number of incidents (%)
N = 27
Incident rate (per 100 contacts)3
High-risk patient 1
Earlier contact with their own GP 2
Type of contact
Consultation at GP cooperative
Time of contact
Day (8 am - 5 pm)
Evening (5 - 11 pm)
Night (11 pm - 8 am)
Degree of urgency
U1 (life-threatening, immediate care)
U2 (acute, evaluation within one hour)
U3 (urgent, evaluation within a few hours)
U4 (routine, no time pressure)
The mean age in the total sample was 36.6 years (SD = 24.8). The mean age was 52.2 years (SD = 23.5) for patients with incidents, compared to 36.2 years (SD = 24.8) for patients without incidents. Multilevel analyses showed that the likelihood of an incident increased with 1.03 for each year of advancing age (95% CI: 1.01 to 1.04). The likelihood of an incident was 3.05 times higher for high-risk patients than for normal-risk patients (95% CI: 1.42 to 6.58). In the stepwise multilevel logistic regression, only the effect of age was significant.
Patient safety incidents occurred in 2.4% of all patient contacts with GP cooperatives (95% CI: 1.5% to 3.2%). The incidents identified in our study were related to triage, diagnosis, or treatment. They were all (at least partly) caused by failures in clinical reasoning. The majority of the incidents did not result in (permanent) harm to patients, but a few incidents were associated with temporary harm. With increasing patient age, an incident's probability of occurrence increased significantly.
Strengths and limitations
Our study was based on a large sample of patient contacts. We performed our study in four GP cooperatives that were spread across the Netherlands and varied in size and degree of urbanisation because we pursued a nationally representative study. GP practices were a convenience sample. Although our unit of analysis was patient contacts with multiple GPs taking shifts at four GP cooperatives, we cannot exclude a risk of selection bias.
Data were collected in general practices associated with the GP cooperatives. This enabled reviewers to study not only the contact information of the GP cooperative, but also the medical records of the patients' own GPs, which include information about patients' healthcare use after they contacted the GP cooperative.
Descriptive retrospective analyses depend on data quality. Some details of patient contacts are not written down, especially in case of telephone contacts [28, 29]. The patient record reviewing method was carefully developed and tested, and proved to have high inter-rater reliability. However, no method for identifying incidents is perfect,[13, 14] and a combination of methods has been recommended [30, 31]. The study design we used will likely have enabled us to discover severe incidents but might have led us to underestimate the number of minor incidents without consequences and incidents in particular domains, such as accessibility issues.
The number of causes identified per incident was small. It was difficult to obtain information on all contributing factors just by reading patient records. Interviewing people who were involved in the incidents would have produced a more complete view of the causal factors involved. However, confidentiality clauses made it impossible for us to do so in our study.
Furthermore, the majority of causes were human. Healthcare providers may be less inclined to note down technical or organisational factors in the medical records of individual patients, which might explain the small numbers of technical and organisational factors identified.
Finally, the study period was two months (April and May 2009). As the quantity and variety of health problems presented by patients vary with time of year, a study covering an entire year might have provided a different perspective.
Interpretation of the results
The results show that patient safety incidents do occur in out-of-hours primary care but that most do not result in harm to patients. However, as there are large numbers of patient contacts, the accumulated effect of the incidents could be significant.
No earlier studies have examined incidents in GP cooperatives or similar out-of-hours healthcare settings. In a review of patient safety in daytime primary care, the incidence rate was estimated between 0.005% and 0.8% , which is much lower than the rate found in our study (2.4%). The research methods used may have contributed to this discrepancy: most studies in the review used event reporting, whereas we used patient record review. Furthermore, our definition of patient safety incidents was broad and included more than just events that resulted in patient harm. Our findings are comparable to patient record review studies into incidents in daytime primary care reporting incidence rates of 2.1%  and 2.5% (Gaal, personal communication, 2010). These findings suggest that patient safety in out-of-hours primary care is comparable to that in daytime primary care, even though the symptoms presented and medical treatments provided differ substantially between those settings.
Failures in clinical reasoning played a part in all incidents in our study. These failures might be related to the fact that GPs in GP cooperatives do not know patients and must decide on medical treatment without having full knowledge of patients' medical history. In addition, they have virtually no possibilities for diagnostic examinations such as X-rays and laboratory tests without referral to a specialist.
We found that the probability of experiencing an incident was higher for older patients (OR = 1.03) but that this did not apply to high-risk patients. This result was unexpected because co-morbidity was believed to be the explanation for higher age-related probability. Deafness or cognitive disorders in older patients might impede communication, which makes clinical reasoning, diagnosis, and treatment more difficult for GPs. A study by Sari et al. (2008) in an NHS hospital also found that, with increasing age, there was a raised risk of experiencing an adverse event (OR = 1.03) .
Finally, nurse telephone triage has been adopted to reduce GP workload, but its safety is under debate [33–36]. Our study did not find an increased risk of incidents in patients that received telephone advice as compared to consultation at the clinic or home visits.
Recommendations for practice
Information about incidents can be used to develop interventions to improve patient safety. It is recommended for out-of-hours healthcare services to examine incidents by way of periodic patient contact audits, including follow-up information from the patients' own GPs, and to combine these with incident reporting by professionals. Incidents should be discussed with professionals to improve clinical reasoning and to reduce the likelihood of reoccurrence. GPs should adhere to guidelines and document their reasons for deviating from these guidelines.
Moreover, system-wide interventions are suggested to enhance patient safety in primary care, such as developing leadership and culture supporting safety behaviour; constructing barriers in systems to prevent human error; and using sensible technology, such as meaningful warnings, communication, and knowledge coupling .
Finally, existing national clinical guidelines may be less applicable to out-of-hours primary care. Relevant topics related to acute medical problems need to be elaborated .
Recommendations for future research
We need to improve our understanding of the reasons why GPs in out-of-hours healthcare make errors in clinical reasoning, as these are the most frequent causes of patient safety incidents. Lack of information on patients' medical history, insufficient medical knowledge, and high workload could all play a part. Further research into the underlying mechanisms of failures in clinical reasoning is recommended.
Because the number of patients actually suffering harm from incidents is small, actual harm is not a good outcome measure for evaluating the effectiveness of patient safety interventions, such as evaluating the implementation effectiveness of clinical guidelines. Outcome measures such as unnecessary prolongation or aggravation of symptoms will be more valuable for evaluating prevention strategies. We recommend, therefore, that future research should include this broader view of patient safety.
In this study, we found that patient safety incidents occurred in 2.4% of all patient contacts with GP cooperatives. The incidents identified were related to triage, diagnosis, or treatment and were all (at least partly) caused by failures in clinical reasoning. Most incidents did not result in harm to patients. With increasing patient age, an incident's probability of occurrence increased significantly.
Our findings report a relatively low incident rate at GP cooperatives in the Netherlands. As there are large numbers of contacts and patients, however, the accumulated effect of the incidents on patient well-being and the healthcare delivery system could be significant. Moreover, as clinical reasoning played an important part in these incidents, further understanding of clinical reasoning and guideline adherence at GP cooperatives could contribute to healthcare safety.
The study presented in this paper was part of a large study on patient safety in primary care in the Netherlands. The Dutch Ministry of Health, Welfare and Sport (VWS) initiated and funded the project (without restrictions on the scientific work; grant number 313741).
The authors would like to thank all participating primary care practices and their staff for providing data. We confirm that all patient/personal identifiers have been removed or disguised, so the patients/person(s) described are not identifiable and cannot be identified through the details of the story. We thank our co-workers Vera Renaud and Maaike Gieben for their contribution to data collection. We thank Mirjam Harmsen for coordinating the larger project and Reinier Akkermans for his support in the multilevel analyses.
- Brennan TA, Leape LL, Laird NM, Hebert L, Localio AR, Lawthers AG, Newhouse JP, Weiler PC, Hiatt HH: Incidence of adverse events and negligence in hospitalized patients. Results of the Harvard Medical Practice Study. I N Engl J Med. 1991, 324: 370-376. 10.1056/NEJM199102073240604.View ArticlePubMedGoogle Scholar
- Wilson RM, Runciman WB, Gibberd RW, Harrison BT, Newby L, Hamilton JD: The Quality in Australian Health Care Study. MedJAust. 1995, 163: 458-471.Google Scholar
- Thomas EJ, Studdert DM, Burstin HR, Orav EJ, Zeena T, Williams EJ, Howard KM, Weiler PC, Brennan TA: Incidence and types of adverse events and negligent care in Utah and Colorado. Med Care. 2000, 38: 261-271. 10.1097/00005650-200003000-00003.View ArticlePubMedGoogle Scholar
- Schioler T, Lipczak H, Pedersen BL, Mogensen TS, Bech KB, Stockmarr A, Svenning AR, Frølich A: Incidence of adverse events in hospitals. A retrospective study of medical records (in Danish). Ugeskr Laeger. 2001, 163: 5370-5378.PubMedGoogle Scholar
- Vincent C, Neale G, Woloshynowych M: Adverse events in British hospitals: preliminary retrospective record review. BMJ. 2001, 322: 517-519. 10.1136/bmj.322.7285.517.View ArticlePubMedPubMed CentralGoogle Scholar
- Davis P, Lay-Yee R, Briant R, Ali W, Scott A, Schug S: Adverse events in New Zealand public hospitals 1: occurrence and impact. N Z Med J. 2002, 115: U271.PubMedGoogle Scholar
- Baker GR, Norton PG, Flintoft V, Blais R, Brown A, Cox J, Etchells E, Ghali WA, Hébert P, Majumdar SR, O'Beirne M, Palacios-Derflingher L, Reid RJ, Sheps S, Tamblyn R: The Canadian Adverse Events Study: the incidence of adverse events among hospital patients in Canada. CMAJ. 2004, 170: 1678-1686.View ArticlePubMedPubMed CentralGoogle Scholar
- Zegers M, de Bruijne MC, Wagner C, Hoonhout LHF, Waaijman R, Smits M, Hout FAG, Zwaan L, Christiaans-Dingelhoff I, Timmermans DRM, Groenewegen PP, van der Wal G: Adverse events and potentially preventable deaths in Dutch hospitals. Results of a retrospective patient record review study. Qual Saf Health Care. 2009, 18: 297-302. 10.1136/qshc.2007.025924.View ArticlePubMedGoogle Scholar
- de Vries EN, Ramrattan MA, Smorenburg SM, Gouma DJ, Boermeester MA: The incidence and nature of in/hospital adverse events: a systematic review. Qual Saf Health Care. 2008, 17: 216-223. 10.1136/qshc.2007.023622.View ArticlePubMedPubMed CentralGoogle Scholar
- Starfield B, Shi L, Macinko J: Contribution of primary care to health systems and health. Milbank Q. 2005, 83: 457-502. 10.1111/j.1468-0009.2005.00409.x.View ArticlePubMedPubMed CentralGoogle Scholar
- Green LA, Fryer GE, Yawn BP, Lanier D, Dovey SM: The ecology of medical care revisited. N Engl J Med. 2001, 344: 2021-2025. 10.1056/NEJM200106283442611.View ArticlePubMedGoogle Scholar
- Sandars J, Esmail A: The frequency and nature of medical error in primary care: understanding the diversity across studies. Fam Pract. 2003, 20: 231-236. 10.1093/fampra/cmg301.View ArticlePubMedGoogle Scholar
- Michel P, Quenon JL, de Sarasqueta AM, Scemama O: Comparison of three methods for estimating rates of adverse events and rates of preventable adverse events in acute care hospitals. BMJ. 2004, 328: 199-10.1136/bmj.328.7433.199.View ArticlePubMedPubMed CentralGoogle Scholar
- Sari ABA, Sheldon TA, Cracknell A, Turnbull A: Sensitivity of routine systems for reporting patient safety incidents in an NHS hospital: retrospective patient case note review. BMJ. 2007, 334: 79-10.1136/bmj.39031.507153.AE.View ArticlePubMedGoogle Scholar
- de Wet C, Bowie P: The preliminary development and testing of a global trigger tool to detect error and patient harm in primary-care records. Postgrad Med J. 2009, 85: 176-180. 10.1136/pgmj.2008.075788.View ArticlePubMedGoogle Scholar
- Giesen P, Ferwerda R, Tijsen R, Mokkink H, Drijver R, van den Bosch W, Grol R: Safety of telephone triage in general practitioner cooperatives: do triage nurses correctly estimate urgency?. Qual Saf Health Care. 2007, 16: 181-184. 10.1136/qshc.2006.018846.View ArticlePubMedPubMed CentralGoogle Scholar
- Giesen P: Quality of out-of-hours primary care in the Netherlands. PhD thesis. 2007, Radboud University Medical Centre, Centre for Quality of Care ResearchGoogle Scholar
- Derkx H: 'For your ears only'. Quality of telephone triage at out-of-hours centres in the Netherlands. PhD thesis. 2008, University of Maastricht, Department of General PracticeGoogle Scholar
- National Patient Safety Agency: What is a Patient Safety Incident?. 2010, Accessed 2 November 2010, [http://www.npsa.nhs.uk/nrls/reporting/what-is-a-patient-safety-incident/]Google Scholar
- Harmsen M, Gaal S, van Dulmen S, de Feijter E, Giesen P, Jacobs A, Martijn L, Mettes T, Verstappen W, van der Nijhuis-Sanden R, Wensing M: Patient safety in Dutch primary care: Study protocol. Implement Sci. 2010, 5: 50-10.1186/1748-5908-5-50.View ArticlePubMedPubMed CentralGoogle Scholar
- Wilson T, Sheikh A: Enhancing public safety in primary care. BMJ. 2002, 324: 584-587. 10.1136/bmj.324.7337.584.View ArticlePubMedPubMed CentralGoogle Scholar
- van Vuuren W, Shea CE, van der Schaaf TW: The development of an incident analysis tool for the medical field. PhD thesis. 1997, Eindhoven University of Technology, Faculty of Technology Management, Patient Safety SystemsGoogle Scholar
- van der Schaaf TW, Habraken MMP: PRISMA-Medical a brief description. 2005, Eindhoven: Eindhoven University of Technology, Faculty of Technology Management, Patient Safety Systems, (accessed 4 November 2010), [http://www.who.int/patientsafety/taxonomy/PRISMA_Medical.pdf]Google Scholar
- Smits M, Janssen JCJA, de Vet HCW, Zwaan L, Timmermans DRM, Groenewegen PP, Wagner C: Analysis of unintended events in hospitals: inter-rater reliability of constructing causal trees and classifying root causes. Int J Qual Health Care. 2009, 21: 292-300. 10.1093/intqhc/mzp023.View ArticlePubMedGoogle Scholar
- Runciman W, Hibbert P, Thomson R, van der Schaaf T, Sherman H, Lewalle P: Towards an International Classification for Patient Safety: key concepts and terms. Int J Qual Health Care. 2009, 21: 18-26. 10.1093/intqhc/mzn057.View ArticlePubMedPubMed CentralGoogle Scholar
- Sherman H, Castro G, Fletcher M: Towards an International Classification for Patient Safety: The conceptual framework. Int J Qual Health Care. 2009, 21: 2-8. 10.1093/intqhc/mzn054.View ArticlePubMedPubMed CentralGoogle Scholar
- The Linnaeus-PC Collaboration: International taxonomy of medical errors in primary care - version 2. 2002, Washington DC, The Robert Graham CenterGoogle Scholar
- den Boer-Wolters D, Knol M, Smulders K, de Wit N: Frequent attendance of primary care out-of-hours services in The Netherlands: characteristics of patients and presented morbidity. Fam Pract. 2010, 27: 129-134. 10.1093/fampra/cmp103.View ArticlePubMedGoogle Scholar
- Derkx H, Rethans J, Muijtjens A, Maiburg B, Winkens R, Van Rooij H, Knottnerus A: 'Quod scripsi, scripsi.' The quality of the report of telephone consultations at Dutch out-of-hours centres. Qual Saf Health Care. 2010, 19: 1-4. 10.1136/qshc.2008.027920.View ArticleGoogle Scholar
- Wetzels R, Wolters R, van Weel C, Wensing M: Mix of methods is needed to identify adverse events in general practice: a prospective observational study. BMC Fam Pract. 2008, 9: 35-10.1186/1471-2296-9-35.View ArticlePubMedPubMed CentralGoogle Scholar
- Olsen S, Neale G, Schwab K, Psaila B, Patel T, Chapman EJ, Vincent C: Hospital staff should use more than one method to detect adverse events and potential adverse events: incident reporting, pharmacist surveillance and local real-time record review may all have place. Qual Saf Health Care. 2007, 16: 40-44. 10.1136/qshc.2005.017616.View ArticlePubMedPubMed CentralGoogle Scholar
- Sari AB, Cracknell A, Sheldon T: Incidence, preventability and consequences of adverse events in older people: results of a retrospective case-note review. Age Ageing. 2008, 37: 265-269. 10.1093/ageing/afn043.View ArticlePubMedGoogle Scholar
- Lattimer V, George S, Thompson F, Thomas E, Mullee M, Turnbull J, Smith H, Moore M, Bond H, Glasper A: Safety and effectiveness of nurse telephone consultation in out of hours primary care: randomised controlled trial. BMJ. 1998, The South Wiltshire Out of Hours Project (SWOOP) Group, 317: 1054-1059.Google Scholar
- Bunn F, Byrne G, Kendall S: The effects of telephone consultation and triage on healthcare use and patient satisfaction: a systematic review. Br J Gen Pract. 2005, 55: 956-961.PubMedPubMed CentralGoogle Scholar
- Giesen P, Ferwerda R, Tijssen R, Mokkink H, Drijver R, van den Bosch W, Grol R: Safety of telephone triage in general practitioner cooperatives: do triage nurses correctly estimate urgency?. Qual Saf Health Care. 2007, 16: 181-184. 10.1136/qshc.2006.018846.View ArticlePubMedPubMed CentralGoogle Scholar
- McKinstry B, Hammersley V, Burton C, Pinnock H, Elton R, Dowell J, Sawdon N, Heaney D, Elwyn G, Sheikh A: The quality, safety and content of telephone and face-to-face consultations: a comparative study. Qual Saf Health Care. 2010, 19: 298-303. 10.1136/qshc.2008.027763.View ArticlePubMedGoogle Scholar
- Wilson T, Sheikh A: Enhancing public safety in primary care. BMJ. 2002, 324: 584-587. 10.1136/bmj.324.7337.584.View ArticlePubMedPubMed CentralGoogle Scholar
- Giesen P, Willekens M, Mokkink H, Braspenning J, van den Bosch W, Grol R: Quality of out-of-hours primary care: development and testing of indicators for prescribing and referring. Int J Qual Health Care. 2007, 19: 289-295. 10.1093/intqhc/mzm027.View ArticlePubMedGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1472-6963/10/335/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (<url>http://creativecommons.org/licenses/by/2.0</url>), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.