Is quality of colorectal cancer care good enough? Core measures development and its application for comparing hospitals in Taiwan
© Chung et al; licensee BioMed Central Ltd. 2010
Received: 14 August 2009
Accepted: 27 January 2010
Published: 27 January 2010
Although performance measurement for assessing care quality is an emerging area, a system for measuring the quality of cancer care at the hospital level has not been well developed. The purpose of this study was to develop organization-based core measures for colorectal cancer patient care and apply these measures to compare hospital performance.
The development of core measures for colorectal cancer has undergone three stages including a modified Delphi method. The study sample originated from 2004 data in the Taiwan Cancer Database, a national cancer data registry. Eighteen hospitals and 5585 newly diagnosed colorectal cancer patients were enrolled in this study. We used indicator-based and case-based approaches to examine adherences simultaneously.
The final core measure set included seventeen indicators (1 pre-treatment, 11 treatment-related and 5 monitoring-related). There were data available for ten indicators. Indicator-based adherence possesses more meaningful application than case-based adherence for hospital comparisons. Mean adherence was 85.8% (79.8% to 91%) for indicator-based and 82.8% (77.6% to 88.9%) for case-based approaches. Hospitals performed well (>90%) for five out of eleven indicators. Still, the performance across hospitals varied for many indicators. The best and poorest system performance was reflected in indicators T5-negative surgical margin (99.3%, 97.2% - 100.0%) and T7-lymph nodes harvest more than twelve(62.7%, 27.6% - 92.2%), both of which related to surgical specimens.
In this nationwide study, quality of colorectal cancer care still shows room for improvement. These preliminary results indicate that core measures for cancer can be developed systematically and applied for internal quality improvement.
Colorectal cancer ranks as the third cause of cancer deaths in the United States and the fourth cause worldwide [1, 2]. Thanks to improvements in diagnostic and surgical modalities as well as the advancement of chemotherapy and radiotherapy, many colorectal cancer patients do survive more than five years. The five-year relative survival rate rose from 51% two decades ago to 65% in recent years . Still there are concerns about the quality of clinical practice since evidence has shown discernible variations for patients with similar conditions [3–5]. Evidence suggests that underuse and overuse of care may occur for patients with cancer . Also, compared with the outcomes of patients in clinical trials, the outcomes of cancer patients in daily practice may be less favorable [6, 7]. Research on the quality of care throughout at least the last decade has demonstrated that increases in the knowledge of treatments with proven efficacy do not translate directly to the optimal delivery of such treatments to patients [6, 8].
Promoted by the Institute of Medicine, USA, the field of quality measurement has been growing rapidly along with accumulation of experience and knowledge in the cancer care quality area . Core measures, introduced by the Joint Commission on Accreditation of Healthcare Organizations, use standardized sets of valid, reliable and evidence-based "core" measures that have been incorporated in quality measurement and performance improvement systems as well as the accreditation process for several diseases [10, 11]. There are several groups who have previously developed measures for colorectal cancer . Yet, the studies regarding measurement of cancer quality of care based on a national database are scarce and we know of no published studies related to core measures for cancer. Having a single set of measures for the entire country is the only way to set national benchmarks and compare countries that have national programs . Our research team adopted the concept of core measures to assess the quality of care provided to patients with breast cancer, colorectal cancer, cervical cancer, lung cancer, oral cancer and hepatocellular carcinoma in Taiwan.
Health insurance in Taiwan is provided within a single payer system that has covered over 96% of the population since 1995 . Following the Cancer Prevention and Management Law, a revised cancer registry, the Taiwan Cancer Database (TCDB) was created in 2003 . The Bureau of Health Promotion (BHP) in the Department of Health financially supported 27 hospitals (initially 17 major hospitals) to join the TCDB program with the prerequisite that each hospital is required to provide cancer prevention, cancer screening, diagnosis and treatment of cancer, education and clinical audits, and cancer research as well as a quality assessment system . The TCDB is a nationwide oncology outcomes database that currently covers approximately 60% of six new invasive cancer diagnoses in Taiwan each year. Like its counterpart, the National Cancer Data Base (NCDB) in the USA, the TCDB is a large, powerful database providing multiple opportunities for clinical studies and can be used to benchmark hospitals on performance measures--an impetus for quality improvement initiatives at the hospital level . Each hospital that voluntarily participates must submit data twice a year for six types of cancers that mentioned above. The prevalence of each disease is increasing, motivating public interest in cancer care quality nationwide. The core cancer measures were developed in parallel with the TCDB program through a government grant as a national initiative for cancer care quality improvement . Although performance measurement for assessing care quality is booming, a system for measuring the quality of cancer care at the hospital level has not been well developed. The purpose of this study was to develop organization-based core measures for colorectal cancer patient care and apply these measures to compare hospital performance.
Patients and hospitals
The patients and hospitals registered in the TCDB program in Taiwan during 2004 were eligible for this study. Participation in the program is voluntary for each hospital but the number is increasing each year partly due to financial incentives. Some information is required in order to link each cancer registry record to insurance claims data. Due to problems with the timeliness and quality of data for nine of the hospitals, eighteen hospitals were selected as the main sources of data for this study (see Appendix).
Core measures development
The Delphi group, nominated by the Taiwan Clinical Oncology Group from the National Health Research Institute as well as related specialty societies, encompassed twenty clinical professionals who represented the organization of their specialty. Included were four gastro-intestinal physicians, three oncological physicians, three radiological oncologists, seven colorectal surgeons and three pathologists (see Appendix). The panel members met face-to-face during 2004. Indicators were anonymously rated on a 9-point scale (with 1 denoting not valid and 9 very valid) and only indicators with a median score of 7 or higher were selected as final candidate indicators. After initial analysis of the panel data, the expert panel and stakeholders from different hospitals met on March 27, 2006 to review and streamline the indicators.
Comparisons across hospitals
Currently, the emphasis on quality measurement in clinical, including cancer, care is on evaluating adherence to "evidence-based" process measures. This quantitative approach to quality improvement moves the field forward by ranking quality measures according to both quantitative assessment of under-performance across institutions and the measures' potential impact on outcomes . Reeves et al. recently summarized five methods for computing a composite quality score including "Indicator Average" and "Patient Average" , both of which we used in this study to derive adherence across hospitals and were designated as indicator-based and case-based adherence. Indicator-based adherence was derived from "all the care received in a given hospital for a specific indicator" divided by "all the care recommended in a given hospital for that indicator". Case-based adherence was computed as the percentage of indicators that were successfully met for each patient. These percentages were then averaged across all patients in a given hospital. To compare hospitals, three different scenarios were adopted. In the first scenario, each hospital was awarded one point for each indicator in which adherence to criteria was greater than the 50th percentile. These points were then added to form a hospital score. Similar procedures were followed for Scenarios 2 and 3 except the thresholds were set at the 75th and 90th percentiles respectively. This approach made hospital comparisons an easier task.
Patient and disease characteristics
Characteristics of colorectal cancer patients undergoing surgery in 2004 by cancer staging.
Core measure indicators for colorectal cancer
Evidence level or grade of recommendation
Proportion of colorectal patients who have pre-operative chest X-ray and abdominal ultrasound, CT scan or MRI18
Number of colorectal patients who have pre-operative chest x-ray and abdominal ultrasound, CT scan or MRI (including off-site)
Number of all colorectal patients
Comprehensive-ness of pre-operative evaluation
Proportion of colorectal patients who have undergone surgical resection for colon or rectal cancer have documentation that colonoscopy or barium enema with sigmoidoscopy was offered within 6 months before or after surgery19,20
Number of colorectal patients who have undergone surgical resection for colon or rectal cancer have documentation that colonoscopy or barium enema with sigmoidoscopy (including off-site) was offered within 6 months before or after surgery
Number of colorectal patients who have undergone surgical resection for colon or rectal cancer
Synchronous colon or rectal cancer
Proportion of colorectal patients who have undergone wide surgical resection for malignant polyp of colon or rectum within 6 weeks of pathological report (polypectomy) revealing incomplete or positive margin or venous or lymphatic invasion or poorly undifferentiated19
Proportion of colorectal patients who have undergone wide surgical resection for malignant polyp of colon or rectum within 6 weeks of pathological report (polypectomy) revealing incomplete or positive margin or venous or lymphatic invasion or poorly undifferentiated
Number of colorectal patients who pathological report for malignant polyp of colon or rectum revealing incomplete or positive margin or venous or lymphatic invasion or poorly undifferentiated
Level II-2, III
Proportion of patients who are diagnosed with colon cancer and do not have metastatic disease were offered a curative resection within 6 weeks of diagnosis. (For patient with diagnosis and treatment of care in the same hospital)19,23
Number of patients who are diagnosed with colon cancer and do not have metastatic disease were offered a curative resection within 6 weeks of diagnosis. (For patient with diagnosis and treatment of care in the same hospital)
Number of patients who are diagnosed with colon cancer and do not have metastatic disease. (For patient with diagnosis and treatment of care in the same hospital)
Level II-2, III
Proportion of patients who are diagnosed with colon cancer and do not have metastatic disease were offered a curative resection within 6 weeks of diagnosis19,23
Number of patients who are diagnosed with colon cancer and do not have metastatic disease were offered a curative resection within 6 weeks of diagnosis
Number of patients who are diagnosed with colon cancer and do not have metastatic disease
Level II-2, III
Proportion of stage I to III colorectal patients who have histopathology reports which give the degree of involvement of surgical margins, including circumferential margins, the number of lymph nodes examined and the number involved21, 22
Number of stage I to III colorectal patients who have histopathology reports which give the degree of involvement of surgical margins, including circumferential margins, the number of lymph nodes examined and the number involved
Number of stage I to III colorectal patients excluding patients undergo polypectomy
Provide information for subsequent intervention, which related to tumor recurrence
Proportion of stage I to III colorectal patients who undergo a wide surgical resection that have documented to be "negative margins"19,23
Number of stage I to III colorectal patients who undergo a wide surgical resection that have documented to be "negative margins"
Number of stage I to III colorectal patients excluding no pathological report regarding status of margin
Level II-2, III
Proportion of colorectal patients who undergo a surgery that have a pathology report with the information on tumor size and node differentiation22,24
Number of colorectal patients who undergo a surgery that have a pathology report with the information on tumor size and node differentiation
Number of colorectal patients who undergo a surgery
Provide information for subsequent intervention and follow-up
Proportion of I to III stage colorectal cancer patients with twelve or more lymph nodes on pathology report25
Number of I to III stage colorectal cancer patients with twelve or more lymph nodes on pathology report
Number of I to III stage colorectal cancer patients excluding polypectomy, or neo-radiotherapy
Level III or IV
Radical excision and pathological accountability
Proportion of pathological report according to CAP checklist or similar one21,26
Number of pathological report according to CAP checklist or similar one
Number of colorectal patients
Pathological report comprehensiveness
Proportion of stage III colon cancer patients who was offered chemotherapy within 6 weeks after surgery19,27,28
Number of stage III colon cancer patients who was offered chemotherapy within 6 weeks after surgery
Number of stage III colon cancer patients who was offered chemotherapy after surgery (in the same hospital)
Level I, II-2, III
Proportion of patients who are diagnosed with Stage II or III rectal cancer, was offered treatment including surgery, radiotherapy, or CCRT treatment within 6 weeks of diagnosis19,24
Number of patients who are diagnosed with Stage II or III rectal cancer, was offered treatment including surgery, radiotherapy, or CCRT treatment within 6 weeks of diagnosis
Number of patients who are diagnosed with Stage II or III rectal cancer, was offered treatment in the same hospital
Level II-2, III
Avoid treatment delay
Proportion of patients who are diagnosed with rectal cancer that appears clinically to be Stage II or III, and was offered surgical resections within 16 weeks after beginning of CCRT19,23
Number of patients who are diagnosed with rectal cancer that appears clinically to be Stage II or III, and was offered surgical resections within 16 weeks after beginning of CCRT
Number of patients who are diagnosed with rectal cancer that appears clinically to be Stage II or III, and was offered CCRT before surgery
Level II-2, III
Provide treatment for cure intent
Proportion of patients who had completed all courses of therapy for Stage I to III lesions had medical check-up again within 6 months of completion19,29
Number of patients who had completed all courses of therapy for Stage I to III lesions had medical check-up again within 6 months of completion
Number of patients who had completed all courses of therapy for Stage I to III lesions
Level II-2, III
Proportion of patients who had completed surgery for Stage I to III lesions had medical check-up again including colonoscopy or LGI series within 2 years period and subsequent 3 years interval19
Number of patients who had completed surgery for Stage I to III lesions had medical check-up again including colonoscopy or LGI series within 2 years period and subsequent 3 years interval
Number of patients who had Stage I to III lesions
Level II-2, III
Proportion of patients who are treated by polypectomy procedure for malignant polyp was offered colonoscopy within 12 months of procedure19,30
Number of patients who are treated by polypectomy procedure for malignant polyp was offered colonoscopy within 12 months of procedure
Number of patients who are treated by polypectomy procedure for malignant polyp
Five-year over-all survival rate, stage specific (Stage I to IV)28
Number of patients who survive at five-year period, stage specific (Stage I to IV)
Number of patients, stage specific (Stage I to IV)
Five-year local recurrence rate, stage specific (Stage I to III)18
Number of patients who had recurrence at five-year period, stage specific (Stage I to III)
Number of patients, stage specific (Stage I to III)
Hospital performances and comparisons
Results of organizational performance of colorectal cancer care by core measure indicators
The core measures for colorectal cancer discussed in this study are one of the six cancer-specific sets of indicators developed in a government-sponsored program with scoring technique improvements, larger expert participation. Refinement of core measures development from our prior study of breast cancer included: 1. expand the number of Delphi panelists from seven to twenty; 2. adopt the RAND Appropriateness technique (scale 1 to 9) to select indicators from previously developed technique (scale 1 to 5, median equal or greater than four and 86% agreement threshold) ; 3. change threshold for selecting indicators to a score of seven or higher. More stakeholders' participation and discussion during stakeholder feedback symposium suggest enthusiasm and the commitment of healthcare professionals in the development of methods for quality improvement in colorectal cancer care. However, the level of evidence for indicators could not match those of the pilot study we developed previously for breast cancer, which included six level I, four level II and five level III recommendations. Nevertheless, it is our belief that these measures represent a valuable contribution to the growing library of clinical cancer measures which can be used for public awareness, potential improvement and accreditation standards for cancer care centers or specialty groups.
Any new performance measure set, including the current cancer core measure sets, frequently encounter a major hurdle, i.e. data resources. It would be easier if the information needed to construct measures came from ICD-9 codes of a billing system. But actually for cancer care research, requirements include the stage, tumor size, node numbers, and status of section margins, none of which are captured in claim-based systems. Although these data are available in medical records, such detailed review of charts on a national scale would be cumbersome and expensive . The TCDB program solved this dilemma; its establishment was the result of the increasing demands for research that would help inform reporting and pay for performance systems. Breast cancer was the first disease entity undertaken by the TCDB program. The number of newly diagnosed breast cancers represented 81.4% of all new cases in 2004, partly due to greater efforts in reporting. Reports of colorectal cancer didn't catch up this pace, but finally we identified 5585 patients newly diagnosed in 2004 within the TCDB. This sample accounted for 58.6% (5585/9535) of all newly diagnosed patients with cancer that occurred in Taiwan that year. We consider this sample representative of the population who has been and is being treated for colorectal malignancy in this country. The scope of the TCDB program will hopefully extend to all types of cancer in the future and will continue to provide feedback to participating hospitals.
Our results suggest that patients with colorectal cancer receive 86% (indicator-based adherence) and 83% (case-based adherence) of recommended care. Adherence to four indicators approached 100%, indicating that excellent quality of care is accomplishable. Yet, we observed four indicators with less than 85% adherence, and for these indicators, there was substantial variability in quality across hospitals. The adherence to twelve core measures for breast cancer in our prior report was inferior (65.8%, indicator-based).
Our results can be compared with a growing literature that describes the quality of cancer care, as well as studies that describe care quality of chronic conditions. For example, results of the National Initiative for Cancer Care Quality (NICCQ) showed that patients with breast cancer receive 86% of recommended care, whereas patients with colorectal cancer receive 78% of recommended care . Using a methodology similar to that of NICCQ, two national studies suggest that the quality of care for cancer may be similar or better than that observed for other chronic medical conditions. Jencks et al. reported 73% of Medicare beneficiaries received health care services specified by one of 24 quality measures addressing heart disease, stroke, and pneumonia . Another study by McGlynn et al. concluded that participants in 12 metropolitan areas of the USA received approximately 55% of recommended care for thirty acute and chronic conditions according to the results from a nation-wide telephone survey . But in that study, they reported 53.9% (95% CI, 45.7-60.4) adherence to twelve quality indicators for colorectal cancer.
Indicator-based adherence is another issue that must be discussed. Since the quality measurement of cancer care is emerging, few studies have reported results of hospital adherence for each indicator. Adherence measured by four indicators in our results (T1-diagnostic evaluation, T3b-surgery, T7-pathological reporting, T9-adjuvant therapy) were less than 85%. In contrast, all diagnostic evaluation, adjuvant therapy (but not surgery), and pathological reporting in the NICCQ showed adherence less than 85% . Another unexpected finding is the adherence to indicator T9, the only indicator with Level I evidence support, was less than 85% (77.4%). Of note, we explored the best (T5) and poorest (T7) adherence for system performance, which might suggest that surgeons did well to achieve safety margins for cancer specimens but failed to remove more than twelve lymph nodes as recommended. But actually there are three major influences on the total number of nodes harvested: the surgeon, with regards to technique and philosophy; the pathologist, with regard to specimen evaluation technique (fat clearing or cherry-picking) and philosophy; and patient characteristics, with regard to tumor site, T stage, immune response, and age . A study by Bilimoria et al. lamented that more than 60% of US institutions failed to achieve a compliance benchmark for the 12-node measure and called for efforts aimed at improvement in colon cancer nodal evaluation . According to their benchmark (examination of ≥12 nodes in ≥75% of patients), we had as much as 72% (13/18) of institutions that failed such a benchmark and actually this percentage might be under-estimated for the daily practice for all cancer care in Taiwan. Improvement should be encouraged for these controllable factors.
Two different types (indicator-based and case-based) of adherence have been presented in this organizational level study. Results of case-based adherence and indicator-based adherence were similar (usually slightly smaller for case-based). But it seems there may be more practical applications for indicator-based adherence since as shown in Table 3, indicator-based adherence can provide more details in terms of potential improvements to be considered than case-based adherence. The box-plot in Figure 2 was also created according to the indicator-based adherence methodology. For quality comparisons at the organizational level, we would suggest indicator-based adherence measures, which provide more needed information on quality improvement than case-based adherence.
Individual quality measures have significant limitations for assessing performance. Despite growing interest in composite measures, methods for combining multiple domains of surgical quality are not well established . Composite scores are an aggregation of underlying performance indicators into a single index and have been used widely in the public sector to create one more easily understood number or rating [38, 39]. But in combining quality indicators to rank hospitals, how one aggregates quality measures for easy understanding is still disputable. Following the criterion-referenced method, we arbitrarily used three different thresholds to rank performance of participating hospitals. Composites are bedeviled by questions of weighting . All weighting systems are arbitrary, and equal weighting is transparent even if it is indefensible at the margins . In the current study, every opportunity to deliver recommended care is weighted equally. However, with equal weighting, quality measured by a composite could seem high even if rare but critical processes were lethally unsafe. Given the increasing use of composites, research is needed to define which indicators can legitimately be made into composites, to develop and test clear rationales for weighting schemes, and to build understanding of how changing weights alters conclusions about performance .
As quality measures are gaining momentum in the healthcare industry, our findings have important implications for health policy. The core measures can be used for internal improvement of cancer care in the near future. Also, core measures may provide accountability for the basis of pay-for-performance systems and public reporting, as well as for accreditation.
Several limitations of this study should be discussed. First, the database of this study was secondary data. Although the personnel of the cancer registry for each organization have undergone accreditation and continuous education, we cannot overlook the possibilities of mistyping or underreporting. Second, only hospitals participating in the project reported to the TCDB. These hospitals may exhibit a higher level of specialization than hospitals that are not in the project. If we combined reporting and non-reporting hospitals, the differences in adherence would likely be increased. Third, we focused more on the effectiveness aspect of quality, while other aims for improvement such as safety and patient-centered care were not considered simultaneously . Finally, as we mentioned earlier, the evidence level for colorectal cancer doesn't parallel that available for breast cancer which limits the study's generalizability. Research studies such as randomized clinical trials of cancer care should be encouraged in the future to enhance the evidence level of research on colorectal cancer care.
Standardized performance measurement is an emerging methodology for comparing health care quality among different facilities. To the best of our knowledge, this is the first study on colorectal cancer care quality based on core measures with a nationwide database. Developing core measures for cancer care is the first step to achieving standardized measures for external monitoring, as well as for providing feedback and serving as benchmarks for cancer care quality improvement. By applying a core measures approach more comprehensively in this fashion, hopefully we can expect to standardize clinicians' daily practice as well as reduce care disparities and improve outcomes for the general population. Future research may capture opportunities to improve cancer care quality by including perspectives from patients, physicians and systems as well as the relationships between core measures and outcomes.
Expert panel members and affiliations:
MD, PhD, Professor, Department of Medicine, National Taiwan University Hospital;
MD, PhD, Associate Professor, Department of Surgery, National Taiwan University Hospital;
MD, PhD, Department of Radiation Oncology, National Taiwan University Hospital;
MD, PhD, Professor, Department of Colorectal Surgery, Taipei Veteran General Hospital;
MD, Department of Radiation Oncology, Taipei Veteran General Hospital;
MD, Director, Department of Colorectal Surgery, Taichung Veteran General Hospital;
MD, Professor, Director, Department of General Surgery, Tri- Service General Hospital;
MD, Associate Professor, Director, Department of Radiology, Tri- Service General Hospital;
MD, Director, Department of Oncology, Taipei Mackay Memorial Hospital;
MD, PhD, Associate Professor, Director, Department of Oncology, Far Eastern Memorial Hospital;
MD, Director, Department of Internal Medicine, Taipei Cathy General Hospital;
MD, Director, Department of Pathology, Taipei Cathy General Hospital;
MD, PhD, Department of oncology, Chung-Gung Memorial Hospital;
MD, PhD, Professor, Director, Department of Colorectal Surgery, Chung-Gung Memorial Hospital;
MD, PhD, Professor, Director, Department of Medicine, Chung-Gung Memorial Hospital;
MD, PhD, Associate Professor, Director, Department of Oncology, Chung-Gung Memorial Hospital;
MD, PhD, Professor, Director, Department of Surgery, National Chen-Gung University Hospital;
MD, PhD, Professor, Director, Department of Pathology, National Chen-Gung University Hospital;
MD, Director, Department of Internal Medicine, Kaohsiung Medical University Hospital;
MD, PhD, Director, Department of Oncology, Chung-Gung Memorial Hospital.
Hospital enrolled in the context including:
National Taiwan University Hospital;
National Chen-Gung University Hospital;
Taipei Veteran General Hospital;
Taichung Veteran General Hospital;
Kaohsiung Veteran General Hospital;
Taipei Mackay Memorial Hospital;
Tri- Service General Hospital;
Koo Foundation Sun Yet-Sen Cancer Center;
Buddhist Tzu Chi General Hospital, Da-Lin Branch;
Taipei Cathy General Hospital;
Shin Kong Wu Ho-Su Memorial Hospital;
Chung-Gung Memorial Hospital;
Chung-Gung Memorial Hospital, Kaohsiung Branch;
China Medical University Hospital, Taiwan;
Changhua Christian Hospital;
Chia-Yi Christian Hospital;
Chi Mei Medical Center;
Kaohsiung Medical University Hospital.
National Cancer Data Base
Taiwan Cancer Database
Research and Development.
The authors thank Dr Laura Morlock (Department of Health Policy and Management, Johns Hopkins University) for her thoughtful comments of this article. This study was sponsored by a grant (DOH93-HP-1057) and approved by Review Board of Data from the Bureau of Health Promotion, Department of Health, Executive Yuan, Taiwan. We are indebted to all of the hospitals, experts and professionals for their contributions to this work.
- World Health Organizations: Global Burden of Disease Estimates. [http://www.who.int/healthinfo/global_burden_disease/GBD_report_2004update_part2.pdf]
- Jemal A, Siegel R, Ward E, Hao YP, Xu JQ, Murray T, Thun MJ: Cancer statistics, 2008. Ca-a Cancer Journal for Clinicians. 2008, 58: 71-96. 10.3322/CA.2007.0010.View ArticlePubMedGoogle Scholar
- Malin JL, Schneider EC, Epstein AM, Adams J, Emanuel EJ, Kahn KL: Results of the national initiative for cancer care quality: How can we improve the quality of cancer care in the United States?. J Clin Oncol. 2006, 626-634. 10.1200/JCO.2005.03.3365.Google Scholar
- Oliveria SA, Yood MU, Campbell UB, Yood SM, Stang P: Treatment and referral patterns for colorectal cancer. Med Care. 2004, 42: 901-906. 10.1097/01.mlr.0000135820.44720.89.View ArticlePubMedGoogle Scholar
- McGlynn EA, Asch SM, Adams J, Keesey J, Hicks J, DeCristofaro A, Kerr EA: The quality of health care delivered to adults in the United States. N Engl J Med. 2003, 348: 2635-2645. 10.1056/NEJMsa022615.View ArticlePubMedGoogle Scholar
- Schneider EC, Epstein AM, Malin JL, Kahn KL, Emanuel EJ: Developing a system to assess the quality of cancer care: ASCO's national initiative on cancer care quality. J Clin Oncol. 2004, 22: 2985-2991. 10.1200/JCO.2004.09.087.View ArticlePubMedGoogle Scholar
- Krzyzanowska MK, Weeks JC, Earle CC: Treatment of locally advanced pancreatic cancer in the real world: Population-based practices and effectiveness. J Clin Oncol. 2003, 21: 3409-3414. 10.1200/JCO.2003.03.007.View ArticlePubMedGoogle Scholar
- Jha AK, Li ZH, Orav EJ, Epstein AM: Care in US hospitals - the hospital quality alliance program. N Engl J Med. 2005, 353: 265-274. 10.1056/NEJMsa051249.View ArticlePubMedGoogle Scholar
- National Cancer Policy Board: Health Care Delivery and Quality of Cancer Care. Ensuring Quality Cancer Care. Edited by: Hewitt M, Simone JV. 1999, Washington, IOM Books, 116-143.Google Scholar
- Epstein AM: Rolling down the runway - The challenges ahead for quality report cards. JAMA. 1998, 279: 1691-1696. 10.1001/jama.279.21.1691.View ArticlePubMedGoogle Scholar
- Joint Commission on Accreditation of Healthcare Organizations (JACHO): Facts about ORYX for Hospitals (National Hospital Quality Measures). [http://www.jointcommission.org/AboutUs/Fact_Sheets/oryx_facts.htm]
- Leonardi MJ, McGory ML, Ko CY: Quality of care issues in colorectal cancer. Clin Cancer Res. 2007, 13: 6897S-6900S. 10.1158/1078-0432.CCR-07-1123.View ArticlePubMedGoogle Scholar
- Eddy DM: Performance measurement: problems and solutions. Health Aff (Millwood). 1998, 17: 7-25. 10.1377/hlthaff.17.4.7.View ArticleGoogle Scholar
- Cheng TM: Taiwan's new national health insurance program: Genesis and experience so far. Health Affairs. 2003, 22: 61-76. 10.1377/hlthaff.22.3.61.View ArticlePubMedGoogle Scholar
- Chien CR, Tsai CM, Tang ST, Chung KP, Chiu CH, Lai MS: Quality of care for lung cancer in Taiwan: A pattern of care based on core measures in the Taiwan Cancer Database registry. J Formos Med Assoc. 2008, 107: 635-643. 10.1016/S0929-6646(08)60181-3.View ArticlePubMedGoogle Scholar
- Chung KP, Lai MS, Cheng SH, Tang ST, Huang CC, Cheng AL, Hsieh PC: Organization-based performance measures of cancer care quality: core measure development for breast cancer in Taiwan. Eur J Cancer Care. 2008, 17: 5-18.Google Scholar
- Bilimoria KY, Stewart AK, Winchester DP, Ko CY: The National Cancer Data Base: A powerful initiative to improve cancer care in the United States. Ann Surg Oncol. 2008, 15: 683-690. 10.1245/s10434-007-9747-3.View ArticlePubMedPubMed CentralGoogle Scholar
- Clinical Guidelines Committee, Royal College of Surgeons in Ireland (RCSI): Colorectal Cancer Management Clinical Guidelines. 2002Google Scholar
- Asch MS, Kerr AE, Hamilton GE Reifel, McGlynn LJ, A Elizabeth: Quality of care for oncologic conditions and HIV: a review of the literature and quality indicators. 2000, RAND BooksGoogle Scholar
- Isler JT, Brown PC, Lewis FG, Billingham RP: The role of preoperative colonoscopy in colorectal cancer. Dis Colon Rectum. 1987, 30: 435-439. 10.1007/BF02556492.View ArticlePubMedGoogle Scholar
- Guidance on Cancer Services: Improving outcomes in colorectal cancer: Updated Manual. NHS. 2003Google Scholar
- Scottish Intercollegiate Guidelines Network (SIGN): Management of colorectal cancer. A national clinical guideline. 2003Google Scholar
- Nogueras JJ, Jagelman DG: Principles of surgical resection. Influence of surgical technique on treatment outcome. Surg Clin North Am. 1993, 73: 103-116.PubMedGoogle Scholar
- The Society of Surgery of the Alimentary Tract (SSAT): Surgical treatment of cancer of the colon or rectum. J Gastrointest Surg. 1999, 3: 210-211. 10.1016/S1091-255X(99)80036-5.View ArticleGoogle Scholar
- The American Joint Committee on Cancer: AJCC Cancer Staging Manual, New York;. 2002, 6Google Scholar
- American College of Surgeons: Cancer Program Standards 2004. Commission on Cancer; Chicago. 2004Google Scholar
- Moertel CG: Chemotherapy for colorectal cancer. N Engl J Med. 1994, 330: 1136-1142. 10.1056/NEJM199404213301608.View ArticlePubMedGoogle Scholar
- The Association of Coloproctology of Great Britation and Ireland: Guidelines for the management of Colorectal Cancer. London;. 2001Google Scholar
- Desch CE, Benson AB, Smith TJ, Flynn PJ, Krause C, Loprinzi CL, Minsky BD, Petrelli NJ, Pfister DG, Somerfield MR: Recommended colorectal cancer surveillance guidelines by the American Society of Clinical Oncology. J Clin Oncol. 1999, 17: 1312.PubMedGoogle Scholar
- Bond JH: Polyp guideline: diagnosis, treatment, and surveillance for patients with nonfamilial colorectal polyps. The Practice Parameters Committee of the American College of Gastroenterology. Ann Intern Med. 1993, 119: 836-843.View ArticlePubMedGoogle Scholar
- Mandelblatt JS, Potosky AL: On the road to improving the quality of breast cancer care: A distance still to travel. Med Care. 2008, 46: 759-761. 10.1097/MLR.0b013e3181844867.View ArticlePubMedGoogle Scholar
- Schneider EC, Riehl V, Courte-Wienecke S, Eddy DM, Sennett C: Enhancing performance measurement - NCQA's road map for a health information framework. JAMA. 1999, 282: 1184-1190. 10.1001/jama.282.12.1184.View ArticlePubMedGoogle Scholar
- Reeves D, Campbell SM, Adams J, Shekelle PG, Kontopantelis E, Roland MO: Combining multiple indicators of clinical quality - An evaluation of different analytic approaches. Med Care. 2007, 45: 489-496. 10.1097/MLR.0b013e31803bb479.View ArticlePubMedGoogle Scholar
- Jencks SF, Huff ED, Cuerdon T: Change in the quality of care delivered to Medicare beneficiaries, 1998-1999 to 2000-2001. JAMA. 2003, 289: 305-312. 10.1001/jama.289.3.305.View ArticlePubMedGoogle Scholar
- Wang JP, Kulaylat M, Rockette H, Hassett J, Rajput A, Bullai-Dunn K, Dayton M: Should total number of lymph nodes be used as a quality of care measure for stage III colon cancer?. Ann Surg. 2009, 249: 559-563. 10.1097/SLA.0b013e318197f2c8.View ArticlePubMedGoogle Scholar
- Bilimoria KY, Bentrem DJ, Stewart AK, Talamonti MS, Winchester DP, Russell TR, Ko CY: Lymph node evaluation as a colon cancer quality measure: A national hospital report card. J Natl Cancer Inst. 2008, 100: 1310-1317. 10.1093/jnci/djn293.View ArticlePubMedPubMed CentralGoogle Scholar
- Staiger DO, Dimick JB, Baser O, Fan Z, Birkmeyer JD: Empirically derived composite measures of surgical performance. Med Care. 2009, 47: 226-233. 10.1097/MLR.0b013e3181847574.View ArticlePubMedGoogle Scholar
- Peters E, Dieckmann N, Dixon A, Hibbard JH, Mertz CK: Less is more in presenting quality information to consumers. Med Care Res Rev. 2007, 64: 169-190. 10.1177/10775587070640020301.View ArticlePubMedGoogle Scholar
- Jacobs R, Goddard M: How do performance indicators add up? An examination of composite indicators in public services. Public Money & Management. 2007, 27: 103-110. 10.1111/j.1467-9302.2007.00565.x.View ArticleGoogle Scholar
- Guthrie B: Measuring the quality of healthcare systems using composites. Br Med J. 2008, 337: a639-10.1136/bmj.a639.View ArticleGoogle Scholar
- Steel N, Bachmann M, Maisey S, Shekelle P, Breeze E, Marmot M, Melzer D: Self reported receipt of care consistent with 32 quality indicators: national population survey of adults aged 50 or more in England. Br Med J. 2008, 337: a957-10.1136/bmj.a957.View ArticleGoogle Scholar
- Institute of Medicine: Improving the 21st century health care system. Crossing the Quality Chasm: a New Health System for the 21st century. 2002, Washington, IOM Books, 39-60.Google Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1472-6963/10/27/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.