- Research article
- Open Access
- Open Peer Review
Comparing routine administrative data with registry data for assessing quality of hospital care in patients with myocardial infarction using deterministic record linkage
BMC Health Services Research volume 16, Article number: 605 (2016)
Assessment of quality of care in patients with myocardial infarction (MI) should be based on data that effectively enable determination of quality. With the need to simplify measurement techniques, the question arises whether routine data can be used for this purpose. We therefore compared data from a German sickness fund (AOK) with data from the Berlin Myocardial Infarction Registry (BMIR).
We included patients hospitalised for treatment of MI in Berlin from 2009-2011. We matched 2305 patients from AOK and BMIR by using deterministic record linkage with indirect identifiers. For matched patients we compared the frequency in documentation between AOK and BMIR for quality assurance variables and calculated the kappa coefficient (KC) as a measure of agreement.
There was almost perfect agreement in documentation between AOK and BMIR data for matched patients for: catheter laboratory (KC: 0.874), ST elevation MI (KC: 0.826), diabetes (KC: 0.818), percutaneous coronary intervention (KC: 0.860) and hospital mortality (KC: 0.952). The remaining variables compared showed moderate or less than moderate agreement (KC < 0.6), and were grouped in Category II with less frequent documentation in AOK for risk factors and aspects of patients’ history; in Category III with more frequent documentation in AOK for comorbidities; and in Category IV for medication at and after hospital discharge.
Routine data are primarily collected and defined for reimbursement purposes. Quality assurance represents merely a secondary use. This explains why only a limited number of variables showed almost perfect agreement in documentation between AOK and BMIR. If routine data are to be used for quality assessment, they must be constantly monitored and further developed for this new application. Furthermore, routine data should be complemented with registry data by well-established methods of record linkage to realistically reflect the situation – also for those quality-associated variables not collected in routine data.
Collecting primary clinical data is still considered the gold standard for assessing health-care quality . It is, however, an elaborate and expensive approach, especially if reliable and valid answers must be provided for various groups of patients with various diseases over relatively long periods of time. In recent discussions, it has consequently been argued that routine administrative data (e.g., claims data) may be used for quality assurance purposes if certain methodological standards are followed [2–4]. This could reduce costs and increase the reliability of data collected.
However, claims data show certain drawbacks implicit in the system if quality of care is to be assessed: i.e., they are primarily collected for reimbursement purposes and are only secondarily applied to assess quality of care [2, 5–7]. This situation gives rise to various consequences: e.g., administrative data lack essential quality assessment parameters . They lack information essential for the patient's prognosis, i.e., whether a disease is present on admission (POA) or acquired in the hospital: indicators important in adjusting for differences between patients [8–10]. They also often show underestimation of comorbidities and risk factors unimportant for reimbursement [11–13].
In the German context there is, from a medical perspective, a lack of independent systematic analysis and controlled trials on the quality of coding in hospitals [5, 14]. It is argued that routine data should be used cautiously for quality assurance , and that misclassifications and non-standardized endpoints are common: a problem found not only in the German context [14–20]. Quentin et al. suggested for MI coding among 11 European countries  that reimbursement triggers ICD coding.
Despite these drawbacks, the use of administrative data for assessing quality of care in Germany is becoming more popular, quality of data is improving and various projects assessing quality of care on the basis of administrative data have evolved in the last years [22–24].
But the following questions remain: whether German claims data provide valid information on the quality of care provided, under which circumstances this is feasible and which data should be used . These questions provided the basis of our study. As carried out previously in a French group that compared routine data on stroke with registry data , we used the data of a clinical quality assurance database (Berlin Myocardial Infarction Registry) to validate the administrative data of a large German sickness fund (AOK Nordost).
We chose acute myocardial infarction (MI) as disease entity, because MI is a substantial public health burden  with acknowledged guideline-based treatment strategies, extensive coverage by public reporting  and a uniform clinical data standard on acute coronary syndromes .
The Berlin Myocardial Infarction Registry
Our study was based on the long-term experience of the Berlin Myocardial Infarction Registry (BMIR), which works to improve the quality of hospital care for MI patients and has continuously collected data on the treatment of patients with MI since 1999 [29, 30].
All MI patients enter the registry who reach a hospital within 24 hours after symptom onset with Type I MI, according to the universal MI definition . Specially trained physicians collect data by using a questionnaire that includes patient baseline characteristics, diagnostic and therapeutic measures taken during in-hospital course of events and discharge medication. After discharge, the questionnaires are forwarded to the BMIR Scientific Office at the Technische Universität Berlin, where entries are double-checked for errors and inconsistencies. To become a member of the BMIR the hospitals have to formally agree to include all MI patients Type I in the registry. Regular monitoring and peer review take place, and site audits are performed to ensure that patients are consecutively included in the registry. Patients are also selected randomly from every institution, with source-data verification for an average of 7.5 % of patients.
Patients’ data are collected pseudonymously. The registry was approved by the Berlin Board for Data Privacy Monitoring. The study protocol confirms to the ethical guidelines of the 1975 Declaration of Helsinki.
The BMIR is a self-organised institution run by cardiologists. Its structure promotes the internal validity of data collected, since those interested in participating in a voluntary registry do so out of self-interest and not out of fear of negative consequences  – and it provides clinicians a forum to communicate with each other regularly and to discuss problems jointly. This approach - as Bradley et al. were able to show - may reduce 30-day mortality rates in MI .
In Germany, health insurance is mandatory for all citizens and permanent residents. It is provided mainly by competing, not-for-profit, nongovernmental health insurance funds (sickness funds) in the statutory health insurance scheme with a uniform benefit package – and by substitutive private health insurance for employees above an income threshold, civil servants and self-employed . In 2011, 86 % of the population were covered by sickness funds and 13 % by private health insurance . In 2011, 156 statutory sickness funds were registered in Germany. Since 1996, patients may choose which sickness fund they want to join. Large discrepancies exist among the sickness funds in regard to their structure and to the health care risks of their members. The AOK Nordost, one of the largest German sickness funds, insured 35 % of all MI patients treated in Berlin in 2009 – 2011 . For historic reasons, patients insured with AOK are older, predominantly female, and are afflicted by more comorbidities than among the average German population.
German sickness funds collect data for reimbursement purposes through a system of diagnosis-related groups (DRG) . Introduction of the DRG system in the German health care sector in 2004 – 2005 enabled for the first time the possibility of using routine data not only for reimbursement purposes, but also for assessing quality of care.
For claims purposes, physicians in German hospitals are legally obligated to code a principal diagnosis and an unlimited number of additional comorbidities or complications, in accordance with the German Modification of the International Classification of Diseases (10th revision). This enabled us to use ICD-10 I21 for defining patients with MI from the insurance data set, which reflects a diagnosis collected reliably in hospital settings as others were able to show [6, 36, 37]. We used the subcategories with a fourth character in I21.0 through I21.3. for defining patients with ST-segment elevation myocardial infarction (STEMI), and the remaining subcategories I21.4 and I21.9 for defining patients without persistent ST-segment elevation myocardial infarction (NSTEMI). This coding responsibility also enabled us to define patients’ risk factors and comorbidities using the following codes: hypertension I10, I11, I12, I13 or I15; smoking F17; hypercholesterolemia E78; diabetes E10, E11, E12, E13, or E14; renal failure N17, N18 or N19; congestive heart failure I50; atrial fibrillation I48.1; cardiogenic shock R57.0; stroke I60, I61, I62, I63, I64 or G45.
Physicians must likewise code operations and interventions according to the German Code for Operations and Procedures (OPS), adapted from the WHO International Classification of Procedures in Medicine. Percutaneous coronary intervention (PCI) as a procedure was operationalized with OPS 8-837 in our study.
No data on in-hospital medication are collected in the German system. Data on medication are routinely collected only in the outpatient setting. Pharmacies are reimbursed for the prescriptions handed out to patients. These data are coded according to the internationally accepted Anatomical Therapeutic Chemical Classification System (ATC). We used the following ATC codes for our analysis: beta-blockers as C07; ACE inhibitors and/or sartans as C09A, C09B, C09C, C09D or C09X; CSE inhibitors as C10AA, C10BA or C10BX; and antithrombotics as B01AC, B01AC06, B01AC04 or B01AC.
For our study we chose only those variables from the AOK data set that we assumed to be comparable to the variables collected in the BMIR, and that have been used by Freisinger et al. as well . Other variables important for quality assessment in treatment of MI patients – i.e., time to intervention, guideline-recommended in-hospital medication, or smoking cessation counselling – were not available from the AOK data set.
For the purpose of our study, AOK patients’ data were processed pseudonymously. The Data Privacy Board of AOK Nordost as well as the Berlin Board for Data Privacy Monitoring agreed to the study and its design.
In our study we included all MI patients aged ≥ 20 years who were treated in a hospital in Berlin between 2009 and 2011. The BMIR included 9297 patients from 19 participating hospitals, of which 17 were equipped with a cath lab. From the AOK data, patients coded with the main diagnosis of ICD-10 code I21 were selected; they were 8909 patients from 37 hospitals, including 20 hospitals with a cath lab.
Developing a data set for comparing documentation from AOK and BMIR
To compare data from AOK and BMIR, we performed various methodological steps, which are summarized in a flow chart in Fig. 1.
1st Step: Harmonisation of case definition
In comparison of data, case definition used in both data sets should be the same. In our first step, therefore, we harmonised case definitions from AOK and BMIR, with the BMIR definition as basis. The AOK system counts as one single case a transaction for which the hospital is remunerated, whereas the BMIR defines one patient according to a complete illness episode, including referral, transfer and readmission within 28 days . AOK cases belonging to the same patient with the same illness episode were combined to represent one patient by joining them according to the point in time of treatment during the same illness episode. We applied this procedure to 13 % of AOK cases. We were left with 7738 AOK patients for further analysis, and with the problem of how to deal with differences in secondary coding among the various “single-case AOK patients”. We resolved this difficulty as follows: a “multiple-case AOK patient” was considered as suffering from hypertension, hypercholesterolemia, diabetes or stroke if any one of the single cases was coded with the respective disease; as suffering from ST-elevation MI or from a disease that could also be considered a complication of MI (atrial fibrillation, CHF, cardiogenic shock, or renal failure) if the chronologically initial case had the information for the respective disease coded; and as receiving PCI as first-line treatment if PCI treatment was coded in the chronologically initial case or in the direct-transfer case.
2nd Step: Extrapolated overlap
Inclusion criteria differed for BMIR and AOK patients, which is a common phenomenon among different data sets, as also described by others [16, 17, 39]. To be able to compare both data sets, we had to define a possible overlap of patients from both data sets. Only patients with the classic spontaneous Type I MI based on atherosclerotic plaque rupture were entered in the BMIR. AOK included patients with all types of MI, since ICD-10 coding does not correspond to the typology proposed in the universal MI definition . Type I MI, being the classic MI, is of primary interest with reference to consideration of treatment and outcome. Type II MI is considered a secondary MI with an imbalance between myocardial oxygen supply and/or demand, independent even of atherosclerosis. Treatment and prognosis of both types of MI differ, and recent publications show that patients with Type II MI comprise about one-fourth of MI patients and differ in clinical outcome [40, 41]. We therefore had to restrict our comparison to patients with Type I MI.
Since AOK included only patients insured by AOK (35 % of all MI patients), and since BMIR included all patients insured by any sickness fund or private health insurance plan, we had to restrict our analysis again to patients insured by AOK. Based on figures available for Berlin  and on the published distribution of MI types, we extrapolated a hypothetical overlap between the BMIR and AOK data to include 3254 patients (calculations not presented here).
3rd Step: Record linkage
In a third step, we identified by record linkage those patients from the hypothetical overlap between the two data sets that were identical. Since data from both data sets were pseudonymized, we applied deterministic record linkage with 4 indirect identifiers for the linkage process [42, 43]: date (1) and time of admission in minutes (2), gender (3) and age (4) as key matching variables. Our aim in linkage was to provide a data set in which documentation for identical patients in both data sets could be compared, irrespective of the representativeness of the data and of the percentage of patients successfully linked. The record linkage process is described elsewhere . We were able to successfully link 2557 patients, from which we had to subtract 252 patients. These were patients for whom the registry lacked outcome data because they were directly transferred to hospitals not participating in the Registry. We were left with 2305 matched patients as the basis for our comparison.
We compared frequencies in documentation for linked patients from both data sets as percentages and calculated the kappa coefficient (KC) as a measure of agreement. A kappa coefficient < 0 was considered as no agreement, 0–0.20 as slight, 0.21 – 0.40 as fair, 0.41 – 0.60 as moderate, 0.61 – 0.80 as substantial and 0.81-0.99 as almost perfect agreement [36, 45].
After case harmonisation and record linkage, we arrived at a data set of 3205 linked patients for whom we compared documentation between the AOK and the BMIR data set.
The results showed that the relative frequencies of documentation between the two data sets varied. Documentation for some variables was comparable: e.g., 82 % treatment with PCI or 9.2 % in-hospital death. Certain risk factors – e.g., hypertension with 79.9 % in BMIR and 67.8 % in AOK, or smoking with 39.9 % in BMIR and 14.8 % in AOK and hypercholesterolemia with 49.5 % in BMIR and 41.8 % in AOK – were coded more often in the BMIR data. Other comorbidities – e.g., CHF with 39.3 % in AOK and 16.7 % in BMIR, renal failure with 23.8 % in AOK and 20.8 % in BMIR and atrial fibrillation with 15.5 % in AOK and 11.3 % in BMIR – were coded more often in AOK data.
The results also showed that the measure of agreement in documentation between AOK and BMIR ranged from almost perfect to hardly any agreement, depending on the variables compared: for example, 96 % of patients were treated in a hospital with a cath lab, according to both data sets, with a kappa coefficient of 0.902. On the other hand, the kappa coefficient was only 0.209 for documentation of CHF (for results see Tables 1, 2 and 3).
Since we observed such patterns of differences in reporting, we developed four categories to group the various variables studied (see also Tables 1, 2 and 3): one category for similar documentation in both data sets, a second category for less frequent documentation in AOK, a third category for more frequent documentation in AOK and a final category for different chronological documentation between the two data sets. Since mere frequencies are a poor measure of agreement, we extended our analysis to include the magnitude of the kappa coefficients in our categories. Using this approach, we arrived at the following categories:
Category I was defined as the category with data reported at the same frequency in both data sets and with almost perfect agreement between the two datasets (KC > 0.80). STEMI and diabetes as patient characteristics, treatment in a hospital with a catheter laboratory as a structural variable, treatment with PCI as a process variable, length of stay in the hospital and hospital mortality as outcome parameters were variables that fell into this category (Tables 1 and 2) and were considered valid and reliable data for assessing quality of care.
Category II was defined as the category with data reported less frequently in the AOK compared to the BMIR data set. This category was divided into two subgroups with subcategory IIa describing fair to moderate agreement between registry and sickness fund data (KC: 0.21 - 0.60). We found classic MI risk factors: e.g., hypertension, hypercholesterolemia and smoking in this category (Table 1). AOK data from this category were considered to be requiring caution in assessing quality of care. Subcategory IIb described hardly any agreement between BMIR and AOK data (KC: ≤ 0.20) and included previous diseases: e.g., previous stroke, previous MI and previous PCI. AOK data which fell into this subcategory were considered unusable for assessing quality of care.
Category III was defined as the category with data reported more often in the AOK compared with the BMIR data set. It was not necessary to form subgroups in this category, because all variables showed fair to moderate agreement between BMIR and AOK data (KC: 0.21 – 0.60). This category included classic MI comorbidities: e.g., renal failure, atrial fibrillation, congestive heart failure and cardiogenic shock. AOK data that fell into this subcategory were considered as requiring caution in assessing quality of care.
Category IV formed a special category on medication, because information on medication was collected at a different point in time in the two data sets. Category IV showed data reported less frequently in the AOK compared to the BMIR data set with in general documentation of a high number of patients receiving guideline-recommended medication in both data sets, but with a low kappa coefficient.
Assessing quality of health care should be based on the most accurate measures available, since consequences of incorrect measurements can be enormous . If we consider, for example, pay-for-performance schemes that depend on quality of care delivered, or on hospital rankings with public reporting, accurate data and analysis are essential. Quality measures should also be accurate to increase trust in the data. It is physicians and other health personnel that must change their behaviour if quality of care is to be improved. If data on quality of care does not reflect the situation accurately and realistically, then health personnel will mistrust the data, which in turn will counteract any quality assessment initiatives . When using routine data to analyse quality of care delivered, we therefore must be sure that these data provide a reliable, valid and trustworthy picture of the situation.
Using routine data for assessing quality of care is not new in the German context. What is new in our study, to our knowledge, is our approach: We have directly compared data from one of the largest German sickness funds with data from a quality registry by linking individual patients and comparing documentation in both data sets for exactly the same patient. This is a unique approach with individual record linkage, which enabled us to show that shortcomings assumed for routine data from various settings [5–21] were confirmed in a direct comparison for the German context.
Validity of AOK data for quality assurance
Only a limited number of variables showed a high degree of agreement. If our results from Category I were more generalized, one could argue that structural factors (e.g., availability of a catheter laboratory), process indicators as indicated by procedures reimbursed by the sickness funds and coded according to the OPS classification (i.e. PCI), and hard outcome parameters (e.g., hospital mortality and length of stay in the hospital) are routine data comparable to data collected in the setting of a registry primary aimed to improve quality of care in the German setting.
Apart from these variables, two other variables also showed almost perfect agreement: STEMI (respective NSTEMI) and diabetes. For diabetes, others have also revealed that agreement between different data sources was high . This has important implications for risk adjustment, since patients with STEMI or diabetes are acutely and more severely ill and have a higher in-hospital death rate than those without these diseases. The almost perfect agreement in STEMI documentation also showed that codes I21.0 through I21.3 may be used as an indirect measure to approximate the number of cases with STEMI in the absence of direct measure of STEMI in routine data. This aspect requires further study, since it may suggest a more homogenous subgroup of MI patients that could be more easily compared among different routine data sets .
Variables on classic risk factors disclosed underreporting and only a fair measure of agreement in the AOK data. Since risk factors per se do not influence reimbursement for acute hospital treatment of MI, the results of our analysis were as expected and showed unreliable coding in the sickness fund data. This is in line with the publication by Lujic et al. and makes routine data an unreliable tool for consideration of risk factors .
Variables on patients’ history with hardly any degree of agreement pose a special problem, possibly specific for the German context. AOK data were collected on a case basis. To enable analysis of a patient’s medical history, various cases from the past must be linked to constitute one patient. This is a difficult task, since initial DRG coding was introduced only in 2004/2005, and historical analysis cannot extend back beyond this date. Second, joining cases to constitute one patient over a long period of time involves a data privacy issue not welcomed by data privacy authorities in and outside the sickness funds. Third, sickness funds do not have an internal information system based on patients rather than cases, which also creates a technical problem for the sickness funds to unite various internal sickness fund data bases. Only limited data on patients’ history are therefore available from routine data – the farther back in time, the more difficult it becomes to obtain reliable information on patients’ medical history.
Variables on classic MI comorbidities that worsen patients’ prognosis and that – coded as a secondary diagnosis – increase the reimbursement received for the patient were more frequently reported in the AOK data set, which is in line with expected results. This is because, if a diagnosis is relevant to reimbursement, it is assumed that this increases the reliability of coding [46, 47]. At the same time, the measure of agreement on classic MI comorbidities between both data sets was only fair to moderate, which can be explained by the difference in data collection. AOK data show all secondary diagnoses regardless of whether they were present on admission or had developed as a complication during hospital stay. BMIR data reflect only comorbidities POA necessary for adjusting for differences in patients’ mix. Without being able to differentiate between POA, sickness fund data have only a limited ability to adjust for differences in patient mix [8–10] to assess of quality of care.
Since in-hospital medication is not documented in the sickness fund data, we had designed our study to compare discharge medication with medication in the outpatient setting two quarters after discharge – and we had expected results to be similar. But, as our results showed, there was a discrepancy between hospital discharge medication and medication after discharge, which may be attributed to the different points in time of data collection. This also may reflect an actual discrepancy between hospital discharge medication and medication after discharge – as others have also shown [48, 49]. It may also lie, however, in the fact that sickness funds have only those data on out-patient medication that are submitted for reimbursement by a pharmacist. Medications taken by the patients but not reimbursed do not appear in the sickness fund data set. The kappa coefficient may have been low (even though levels of agreement were high), because it depends on marginal frequencies [45, 50].
Since routine German data lack variables on quality of care other than those described, our results prompt us to argue that German routine data should either be broadened to include POA indicators, time indicators and drugs given in hospital – or should be regularly linked with registry data to reliably assess care of MI patients in the future.
The reliability of the AOK data depended on the export of data carried out within the sickness fund. Although we carried out plausibility checks on the data and compared them with other similar data, we cannot exclude the possibility that problems in data export could have arisen within the sickness fund. Our study design also did not allow verification of the ICD diagnosis of I21 by AOK data. As others have shown, however, the coding of I21 in the hospital setting is quite reliable [6, 36, 37].
Our study was based on registry data, which have their own drawbacks [51, 52]. Since the emphasis of our study lay on the analysis of data after linkage, possible drawbacks of BMIR data were of minor importance. The emphasis of our study was on comparison of documentation in AOK and BMIR data. With this approach, variables not available in routine data, but important for assessing quality of care, were not considered for our analysis (e.g., intervention time in STEMI patients).
Our study referred to the German context and was based on German legal aspects of diagnosis coding and procedures that may not be applicable to other national settings.
Administrative data are collected for reimbursement purposes. If used for quality assessment at all, they are applied for this purpose only secondarily, which explains a number of their drawbacks. We have grouped the data in four categories to represent the various types of agreement or disagreement between two data sets. From these categories only those variables grouped in Category I had an almost perfect degree of agreement between both data sets. All other variables, especially those necessary for risk adjustment, showed only moderate to less than moderate agreement in documentation between the two data sets. They are therefore not considered as reliable tools for assessing quality of care. If routine data are to be used for quality assessment, they must be constantly monitored and further developed for this new application [20, 53]: e.g., by introduction of POA indicators, time indicators and drugs given in hospital. Furthermore, routine data should be complemented with registry data by well-established methods of record linkage to realistically reflect the situation – also for those quality-associated variables not collected in routine data.
Allgemeine Ortskrankenkasse (name of the sickness fund)
Anatomical Therapeutic Chemical (Classification System)
Berlin Myocardial Infarction Registry
Congestive heart failure
without persistent ST-segment elevation Myocardial Infarction
Operation- und Prozedurenschlüssel (Code for Operations and Procedures)
Percutaneous coronary intervention
Present on Admission (indicators)
ST-segment elevation Myocardial Infarction
Bufalino V, Peterson ED, Burke GL, LaBresh KA, Jones DW, Faxon DP, et al. Payment for quality: Guiding principles and recommendations from the AHA’s reimbursement, coverage, and access policy development group. Circulation. 2006;113:1151–4.
Krumholz HM, Brindis RG, Brush JE, Cohen DJ, Epstein AJ, Furie K, et al. Standards for statistical models used for public reporting of health outcomes. Circulation. 2006;113:456–62.
Hendel R, Bozkurt B, Fonarow GC, Jacobs JP, Lichtman JH, Smith EE, et al. ACC/AHA 2013 Methodology for developing clinical data standards. Circulation. 2014;129:2346–57.
Couralet M, Leleu H, Capuano F, Marcotte L, Nitenberg G, Sicotte C, Minvielle E. Method for developing national quality indicators based on manual data extraction from medical records. BMJ Qual Saf. 2013;22:155–62.
Heller G. Administrative data from German statutory health insurances for social, economic and medical research. Working Paper No. 122 of the German Council for Social and Economic Data. German Council for Social and Economic Data. Berlin.
McCormick N, Lacaille D, Bhole V, Avina-Zubieta JA. Validity of myocardial infarction diagnoses in administrative databases: A sytematic review. PLoS One. 2014;9:e92286.
Powell AE, Davies HTO, Thomson RG. Using routine comparative data to assess the quality of health care: understanding and avoiding common pitfalls. Qual Saf Health Care. 2003;12:122–8.
Pine M, Jordan HS, Elixhauser A, Fry DE, Haoglin DC, Jones B, et al. Enhancement of claims data to improve risk adjustment of hospital mortality. JAMA. 2007;297:71–6.
Rangachari P. Coding for quality measurement: the relationship between hospital structural characteristics and coding accuracy from the perspective of quality measurement. Perspect Health Inf Manag. 2007;4:3.
Goldman LE, Chu PW, Osmond D, Bindman A. The accuracy of present-on-admission reporting in administrative data. HSR. 2011;46:1946–62.
Powell H, Lim LL-Y, Heller R. Accuracy of administrative data to assess comorbidities in patients with heart disease: an Australian perspective. J Clin Epidemiol. 2001;54:687–93.
Lujic S, Watson DE, Randall DA, Simpson JM, Jorm LR. Variation in the recording of common health conditions in routine hospital data: study using linked survey and administrative data in New South Wales, Australia. BMJ Open. 2014;4, e005768.
Austin PC, Tu JV. Comparing clinical data with administrative data for producing acute myocardial infarction report cards. J R Stat Soc. 2006;169:115–26.
Stausberg J. Die Kodierqualität in der stationären Versorgung. Bundesgesundheitsblatt - Gesundheitsforschung - Gesundheitsschutz. 2007;50:1039–46.
Maass C, Kuske S, Lessing C, Schrappe M. Are administrative data valid when measuring patient safety in hospitals? A comparison of data collection methods using a chart review and administrative data. Int J Qual Health Care. 2015;27:305–13.
Grobe TG, Gerhardus A, Walelu OA, Meisinger C, Krauth C. Hospitalisations for Acute Myocardial Infarction – Comparing data from three different sources. Gesundheitswesen. 2008;70:e37–46.
Herrett E, Shah AD, Boggon R, Denaxas S, Smeeth L, van Staa T, et al. Completeness and diagnostic validity of recording acute myocardial infarction events in primary care, hospital care, disease registry, and national mortality records. BMJ. 2013. doi:10.1136/bmj.f2350.
Payne RA, Abel GA, Simpson CR. A retrospective cohort study assessing patient characteristics and the incidence of cardiovascular disease using linked routine primary and secondary care data. BMJ Open. 2012. doi:10.1136/bmjopen-2011-000723.
Stausberg J, Halim A, Färber R. Concordance and robustness of quality indicator sets for hospitals: an analysis of routine data. BMC Health Serv Res. 2011;11:106.
Aelvoet W, Terryn N, Molenberghs G, De Backer G, Vrints C, van Sprundel M. Do inter-hospital comparisons of in-hospital, acute myocardial infarction case-fatality rates serve the purpose of fostering quality improvement? BMC Health Serv Res. 2010. doi:10.1186/1472-6963-10-334.
Quentin W, Rätto H, Peltona M, Busse R, Häkkinen U, on behalf of the EuroDRG group. Acute myocardial infarction and diagnosis-related groups: patient classification and hospital reimbursement in 11 European countries. Eur Heart J. 2013;34:1972–81.
Jeschke E, Baberg H, Dirschedl P, Heyde K, Levenson B, Malzahn J, et al. Complication rates and secondary interventions after coronary procedures in clinical routine: 1-year follow-up based on routine data of a German health insurance company. Dtsch Med Wochenschr. 2013;138:570–5.
Nimptsch U, Mansky T. Quality measurement combined with peer review improved German in-hospital mortality rates for four disease. Health Aff. 2012;32:1616–23.
Burns EM, Rigby E, Mamidanna R, Bottle A, Aylin P, Ziprin P, Faiz OD. Systematic review of discharge coding accuracy. J Public Health. 2012;34:138–48.
Westaby S, Archer N, Manning N, Adwani S, Grebenik C, Ormerod O, et al. Comparison of hospital episode statistics and central cardiac audit database in public reporting of congenital heart surgery mortality. BMJ. 2007;335:759–64.
Aboa-Eboulé C, Mengue D, Benzenine E, Hommel M, Giroud M, Béjot Y, Quantin C. How accurate is the reporting of stroke in hospital discharge data? A pilot validation study using a population-based stroke registry as a control. J Neurol. 2013;260:605–13.
Senatsverwaltung für Gesundheit und Soziales Land Berlin. Basisbericht 2012/2013: Daten des Gesundheits- und Sozialwesens (Official Health Report of Berlin 2012/13). Senatsverwaltung für Gesundheit und Soziales des Land Berlin: Berlin; 2012.
Cannon CP for the writing committee members. ACCF/AHA key data elements and definitions for measuring the clinical management and outcomes of patients with acute coronary syndromes and coronary artery disease. Circulation. 2013;127:1052–89.
Maier B, Thimme W, Schoeller R, Fried A, Behrens S, Theres H. Improved therapy and outcome for patients with acute myocardial infarction: Data of the BMIR from 1999 to 2004. Int J Cardiol. 2008;130:211–9.
Maier B, Behrens S, Graf-Bothe C, Kuckuck H, Röhnisch J-U, Schoeller R, Schühlen H, Theres H. Time of admission, quality of PCI care, and outcome of patients with ST-elevation myocardial infarction. Clin Res Cardiol. 2010;99:565–72.
Thygesen K, Alpert JS, White HD, on behalf of ESC/ACC/AHA/WHF Task force for the redefinition of myocardial infarction. Universal definition of myocardial infarction. Eur Heart J. 2007;28:2525–38.
Porter ME, Teisberg EO. How physicians can change the future of health care. JAMA. 2007;297:1103–11.
Bradley EH, Curry LA, Spatz ES, Herrin J, Cherlin EJ, Curtis JP, et al. Hospital strategies for reducing risk-standardized mortality rates in acute myocardial infarction. Ann Intern Med. 2012;156:618–26.
Busse R, Blümel M. Health systems review-Germany. Health Systems in Transition. 2014;16:1–196.
Statistisches Bundesamt. Sozialleistungen 2011: Angaben zur Krankenversicherung, Fachserie 13 Reihe 1.1. Statistisches Bundesamt: Wiesbaden; 2012.
Heckbert SR, Kooperberg C, Safford MM, Psaty BM, Hsia J, McTiernan A, et al. Comparison of self-report, hospital discharge codes, and adjudication of cardiovascular events in women's health initiative. Am J Epidemiol. 2004;160:1152–8.
Metcalfe A, Neudam A, Forde S, Liu M, Drosler S, Quan H, Jetté N. Case definitions for acute myocardial infarction in administrative databases and their impact on in-hospital mortality rates. Health Serv Res. 2013;48:290–318.
Freisinger E, Fuerstenberg T, Malyar NM, Wellmann J, Keil U, Breithardt G, Reinecke H. German nationwide data on current trends and management of acute myocardial infarction: discrepancies between trials and real-life. Eur Heart J. 2014;35:979–88.
Aspberg S, Stenestrand U, Köster M, Kahan T. Large differences between patients with acute myocardial infarction included in two Swedish registers. Scandinavian Journal of Public Health. 2013;41:637–43.
Saaby L, Poulsen TS, Hosbond S, Larsen TB, Diederichsen ACP, Hallas J, Thygesen K, Mickley H. Classification of myocardial infarction: frequency and features of type 2 myocardial infarction. Am J Cardiol. 2013;126:789–97.
Saaby L, Poulsen TS, Diederichsen ACP, Hosbond S, Larsen TB, Schmidt H, Gerke O, Hallas J, Thygesen K, Mickley H. Mortality rate in type 2 myocardial infarction: observations from an unselected hospital cohort. Am J Med. 2014;127:295–302.
Fosbol EL, Granger CB, Peterson ED, Lin L, Lytle BL, Shofer FS, et al. Prehospital system delay in ST-segment elevation myocardial infarction care: a novel linkage of emergency medicine services and in-hospital registry data. Am Heart J. 2013;165:363–70.
Brennan JM, Peterson ED, Messenger JC, Rumsfeld JS, Weintraub WS, Anstrom KJ, et al. Linking the national cardiovascular data registry CathPCI Registry with Medicare claims data. Circ Cardiovasc Qual Outcomes. 2012;5:134–40.
Maier B, Wagner K, Behrens S, Bruch L, Busse R, Schmidt D, Schühlen H, et al. Deterministic record linkage with indirect identifiers: Data of the Berlin Myocardial Infarction Registry and the AOK Nordost for patients with myocardial infarction. Gesundheitswesen. 2015;77:e15–9.
Viera AJ, Garrett JM. Understanding interobserver agreement: the Kappa Statistics. Fam Med. 2005;37:360–3.
Wenke A, Gaber A, Hertle L, Roeder N, Puehse G. Complexity level simulation in the German DRG system: the financial effect of coding of comorbidity diagnostic in urology. Der Urologe. 2012;51:975–81.
Hjerpe P, Boström KB, Lindblad U, Merlo J. Increased registration of hypertension and cancer diagnoses after the introduction of a new reimbursement system. Scand J Prim Health Care. 2012;30:222–8.
Kuepper-Nybelen J, Hellmich M, Abbas S, Ihle P, Griebenow R, Schubert I. Association of long-term adherence to evidence-based combination drug therapy after acute myocardial infarction with all-cause mortality. A prospective cohort study based on claims data. Eur J Clin Pharmacol. 2012;68:1451–60.
Mangiapane S, Busse R. Prescription prevalence and continuing medication use for secondary prevention after myocardial infarction. Dtsch Ärztebl Int. 2011;108:856–62.
Chen G, Faris P, Hemmelgarn B, Walker RL, Quan H. Measuring agreement of administrative data with chart data using prevalence unadjusted and adjusted kappa. BMC Med Res Methodol. 2009. doi:10.1186/1471-2288-9-5.
Rosvall M, Ohlsson H, Hansen O, Chaix B, Merlo J. Auditing patient registration in the Swedish quality register for acute coronary syndromes. Scand J Public Health. 2010;38:533–40.
McCabe JM, Kennedy KF, Eisenhauer AC, Waldman HM, Mort EA, Pomerantsev E, et al. Reporting trends and outcomes in ST-segment-elevation myocardial infarction national hospital quality assessment programs. Circulation. 2014;129:194–202.
Coory M, Cornes S. Interstate comparisons of public hospital outputs using DRGs: are they fair? Aust N Z J Public Health. 2005;29:143–8.
The BMIR is grateful to all the hospitals that participated in the study: Charité Universitätsmedizin Berlin (Campus Mitte and Campus Virchow), Caritas Kliniken Pankow, DRK Kliniken Berlin | Köpenick, DRK Kliniken Berlin | Westend, Gemeinschaftskrankenhaus Havelhöhe, Helios Klinikum Emil von Behring, Juedisches Krankenhaus, Krankenhaus Lichtenberg, Martin-Luther Krankenhaus, St. Gertrauden-Krankenhaus, Unfallkrankenhaus Berlin, Vivantes Auguste-Viktoria-Klinikum, Vivantes-Humboldt-Klinikum, Vivantes Klinikum am Urban, Vivantes Klinikum Hellersdorf, Vivantes Klinikum im Friedrichshain, Vivantes Klinikum Neukölln, Vivantes Klinikum Spandau, and Vivantes Wenckebach Klinikum. Their effort and support is very much appreciated.
We are also grateful to AOK Nordost for providing data.
The study was supported by an unrestricted grant from the German Federal Ministry for Education and Research (BMBF), with project no. 01GY1112. The sole responsibility for the contents lies with the authors.
Availability of data and materials
The datasets generated and analysed during the current study are not publicly available due to special German data privacy laws allowing analysis with sickness fund data only with a special permit, which specifies the question to be addressed with the analysis, the persons to handle the data and the method of analysis.
BM and KW participated in the design of the study and performed the statistical analysis. SB, LB, HS and RT have made substantial contributions to conception and design of the study from the hospital point of view and have discussed and interpreted the data extensively. RB incorporated the health management aspect into the study. DS made substantial contributions to conception and design of the study from the standpoint of the sickness fund and discussed and interpreted the data extensively. HT was accountable for all the work performed and ensured its unity. All authors have revised the manuscript and have read and approved its final version.
The authors declare that they have no competing interests.
Consent for publication
“Not applicable” in this section.
Ethics approval and consent to participate
The registry was approved by the Berlin Board for Data Privacy Monitoring. We have a “Declaration of no Objection” for our registry from the Berlin ethics committee of the Berlin Chamber of Physicians from 2004 (Ethikkommission der Ärztekammer Berlin). The study protocol confirms to the ethical guidelines of the 1975 Declaration of Helsinki. The Berlin law for hospitals (Landeskrankenhausgesetz) allows data to be collected without informed consent under two conditions (section 25.1 sentence 2 and 3), which both apply to our registry and were approved by the Berlin Board for Data Privacy Monitoring.
About this article
Cite this article
Maier, B., Wagner, K., Behrens, S. et al. Comparing routine administrative data with registry data for assessing quality of hospital care in patients with myocardial infarction using deterministic record linkage. BMC Health Serv Res 16, 605 (2016) doi:10.1186/s12913-016-1840-5
- Health services research
- Routine administrative data
- Quality of care
- Hospital performance
- Myocardial infarction