- Research article
- Open Access
- Open Peer Review
Relationship between risk information on total colonoscopy and patient preferences for colorectal cancer screening options: Analysis using the Analytic Hierarchy Process
BMC Health Services Research volume 8, Article number: 106 (2008)
Although the fecal occult blood test (FOBT) is the preferred program for colorectal cancer screening in Japan, many medical institutions have recently begun to provide total colonoscopy (TCS) as an initial screening program. However, there are a number of severe risks associated with TCS, such as colorectal bleeding and perforation. The justification for performing such a procedure on healthy patients remains unclear. We used the analytic hierarchy process (AHP) to investigate whether risk information on TCS affects patient preferences for colorectal cancer screening.
We performed a questionnaire survey using an AHP decision-making model, targeting 285 people aged 40–59 years. We randomly assigned the subjects into Groups A (n = 146) and B (n = 139). Both groups were provided with information on the effectiveness, cost and disadvantages of the two screening programs. Group A was provided with additional information regarding the risks of TCS. Individual priorities were calculated with pair-wise comparisons between the two alternatives in each selection criteria. The influence of the risk information was analyzed using a logistic regression analysis.
The aggregated priorities in Group A for 'effectiveness', 'costs', and 'risks' were 0.603, 0.147, and 0.250, respectively, while those in Group B were 0.652, 0.149, and 0.199, respectively. A logistic regression analysis showed that the provision of risk information significantly reduced the subjects' priorities for TCS (p = 0.036).
The lack of risk information was related to the differences in priorities assigned to effectiveness and risks of the two procedures. Patients must be well informed before making decisions concerning their preferred colorectal cancer screening procedure.
In Japan, colorectal cancer is on the increase as a cause of death . Cancer screening is considered one of the most promising approaches in the prevention of cancer deaths.
The fecal occult blood test (FOBT) is the preferred program for colorectal cancer screening in Japan, being a non-invasive, low-cost procedure. Subjects with positive FOBT results are recommended to undergo total colonoscopy (TCS), which is relatively invasive and costly; however, FOBT has a number of limitations, including false negative and false positive results. Many hospitals in Japan provide TCS to healthy individuals as an initial screening program; however, there are a number of severe risks associated with TCS, such as colorectal bleeding and perforation. The justification for performing such a procedure on healthy patients remains unclear.
It is necessary to provide the general population with appropriate information on cancer screening. The information should focus on the risks as well as the effectiveness and costs associated with various procedures. People can then select their preferred service on the basis of all the necessary information.
Although previous studies have examined patient preferences concerning colorectal cancer screening [2–6], there is little agreement as to which test is more preferred. Pignone et al. reported that patient preferences for colorectal cancer screening were sensitive to information regarding test performance and cost information ; however, to our knowledge, the actual impact of risk information on patient preferences remains unknown.
In the present study, we used the analytic hierarchy process (AHP) to analyse peoples' preferences for colorectal cancer screening. AHP is a flexible decision-making method developed by Saaty in the 1970s  to help people establish priorities and make the best decision, when both the qualitative and quantitative aspects of a decision need to be considered.
With regard to healthcare services, it appears to be somewhat difficult for physicians to communicate fair and sufficient information to patients due to physician-specific biases , limited diagnosis and treatment time , and the limitations of physicians' interviewing skills .
AHP not only helps patients arrive at the best decision;, it also provides a clear rationale by reducing complex decisions to a series of one-on-one comparisons, thereafter synthesizing the results. In the AHP model, the alternative selection problem is structured into a hierarchy, with the overall goal placed at the top, with lower-level selection criteria below. Alternatives are then assigned weights at each level of the hierarchy, and overall global weights and priorities are obtained.
Several studies have considered the application of AHP in medical decision-making [2, 11–13]. The present study aimed to use the AHP method to investigate whether risk information affects people's preferences for colorectal cancer screening procedures.
Construction of the AHP model
From the patient point of view, we constructed an AHP decision model that helps people to make a dichotomous choice between FOBT and TCS as an initial colorectal screening program. We decomposed the decision problem into a hierarchy of more easily comprehended sub-problems (Fig. 1). We focused on the following three criteria related to decision-making in colorectal cancer screening: 'effectiveness', 'costs', and 'disadvantages.'
The 'effectiveness' of the service is further divided into two sub-criteria: 'mortality reduction rate' and 'cancer detection rate'.
The 'costs' are separated into two sub-criteria: 'out-of-pocket payment' and 'time cost'. 'Time cost' represents the indirect cost of the examination time at the expense of working hours.
'Disadvantages' include 'false positives/negatives' and 'risks'. A false positive result can cause anxiety for the subject, whereas a false negative result can lead to delays in diagnosis and treatment. The FOBT presents almost no risk, while TCS can lead to complications such as bleeding and perforation.
This research was based on an Internet-based self-administered questionnaire. We enlisted the services of an Internet research company with approximately 261,000 registered Internet users. We chose 640 males and females via stratified random sampling from a total of approximately 79,000 persons aged 40–59 years.
The cover letter of the questionnaire clearly informed the subjects that 1) data collection and analysis was completely anonymous, ensuring that their private details would remain confidential; 2) all the answers would be kept confidential, processed statistically, and used only for scientific study; and 3) they had a choice whether to participate or not.
Our offer to the subjects to participate in our study was sent by email on 19 December 2006. We obtained replies from 353 people within one week: a response rate of 55.2%.
We designed the FOBT and TCS information based on the following evidence-based objective facts. In the present study, FOBT means immunohistochemical test rather than guaiac test.
(i) Mortality reduction rates
While several randomized controlled trials have evaluated the mortality reduction rates of FOBT in Western nations, there have been none in Japan. Data from case-control studies are available for Japanese people: Saito et al. reported that the estimated relative risk of mortality for the screened population was 0.48 for FOBT .
To our knowledge, no data about mortality reduction rates of TCS are available for Japanese people. Instead, we referred to a foreign data based on a case-control study: the estimated relative risk of mortality for the screened population was 0.41 for TCS .
(ii) Cancer detection rates
In Japan, the cancer detection rate of FOBT is reportedly 27 per 10,000 persons, while that of TCS is 61 per 10,000 .
(iii) Out-of-pocket payment
The actual price of FOBT is less than ¥1,000 (about US$9) or free, while that of TCS is ¥15,000–25,000 (US$130–220).(unpublished data)
(iv) Time spent for TCS
Generally, in TCS, the use of a laxative in pre-treatment requires approximately 2 hours; the actual examination takes 10–15 minutes. Most colonoscopies in Japan are done without sedation. In the present study, travel or waiting time was not presented.
(v) False negatives/false positives
The risk of severe complications with TCS, including perforation and bleeding, has been reported to be approximately 8 per 10,000 colonoscopies without biopsy or polypectomy ; FOBT poses almost no risk to the patient.
The additional file 1 shows the "Information Sheet (originally in Japanese)" which was actually presented to the participants. Two types of Information Sheets were prepared, Sheets A and B. Sheet A included items (i)-(vi) above, whereas Sheet B referred only to items (i)-(v), excluding the risk information.
Sheet A was presented randomly to 176 respondents (Group A) and Sheet B to 177 respondents (Group B). Participants then answered a questionnaire based on the AHP model, selecting one item from seven grades for a pair-wise comparison of the factors and alternatives. That is, for their judgement of relative importance between X and Y variables, subjects were asked the following questions: "Which do you think is important, X or Y?" The detailed illustrations with elements substituted for the X and Y variables were as follows:
Q1. Which do you think is important, 'effectiveness' or 'costs' from the point of choosing colorectal cancer screening?
Q2. Which do you think is important, 'effectiveness' or 'avoiding disadvantages' from the point of choosing colorectal cancer screening?
Q3. Which do you think is important, 'costs' or 'avoiding disadvantages' from the point of choosing colorectal cancer screening?
Q4. Which do you think is important, 'mortality reduction' or 'detection rate' from the point of effectiveness?
Q5. Which according to you is important 'co-payment' or 'time cost' from the point of costs?
Q6. Which do you think is important 'complications' or 'false-positives/false-negatives' from the point of avoiding disadvantages?
Q7. Which do you think is important 'false-negatives' or 'false-positives' from the point of avoiding false-positives/negatives?
The participants were requested to choose one answer to each question from the following seven options:
1 X is extremely important.
2 X is strongly important.
3 X is moderately important.
5 Y is moderately important.
6 Y is strongly important.
7 Y is extremely important.
Questions were also included on age, gender, concern about their own health (3 grades: concerned a lot, concerned a little, and not concerned), household annual income, history of hospital admission and personal experience of FOBT and TCS.
A consistency index (C.I.) was calculated for each respondent, reflecting the consistency of qualitative judgments of the importance of different criteria and the impact of the importance on all comparisons . If the C.I. was less than 0.15, we assumed the comparison is consistent . In the present study, respondents with a C.I. greater than or equal to 0.15 were excluded.
Individual priorities were calculated via pair-wise comparisons between the two alternatives in each selection criteria. In the present study, we used geometric mean method (GMM) to estimate individuals' relative weights of each element. Aggregated weights of individual priorities were calculated with GMM for synthesizing individual decisions into a group decision . To derive the group weights for each element, we calculated geometric mean from each individual pair-wise comparison matrix. For all these calculations, we used a programmed spreadsheet established with Microsoft Excel™ software.
We analysed the influence of the risk information on the subjects' decisions using a logistic regression analysis; the results of the dichotomous choice between FOBT and TCS were regressed against a variety of independent variables including the type of information presented and the subjects' backgrounds.
We used the statistical software JMP version 6.0.3 (SAS Institute Inc., Cary, NC, USA) for all statistical analyses. A p value less than 0.05 was considered to be statistically significant.
Sixty-eight respondents with a C.I. greater than or equal to 0.15 were excluded, leaving a total of 285 respondents to be analysed. The proportion of inconsistent respondents was 19% (= 68/353). The participants' characteristics of both consistent and inconsistent subjects are shown in Table 1. In the consistent subjects, the average (± SD) of consistency index values were 0.058 ± 0.052 in Group A (n = 146) and 0.063 ± 0.051 in Group B (n = 139).
Aggregated weights and priorities
Table 2 shows the global and local priorities and weights of each subcriteria, as well as overall priorities. The aggregated priorities in Group A for 'effectiveness', 'costs', and 'avoiding disadvantages' were 0.603, 0.147 and 0.250, respectively, while those in Group B were 0.652, 0.149, and 0.199, respectively. That is, Group A represented a higher priority to 'avoiding disadvantage' and a lower priority to 'effectiveness' compared to Group B. Overall priorities of TCS were 0.620 and 0.652 in Group A and Group B, respectively.
Individual weights and priorities
In Group B, 124 (89.2%) of the 146 respondents gave a higher priority to TCS than to FOBT; in Group A, 118 (80.8%)/139 preferred TCS to FOBT. These two figures differ significantly. (p < 0.01)
In the logistic regression analysis, 'type of information' was a significant factor affecting choice between FOBT and TCS (Table 3): those presented with the risk information concerning TCS were more likely to choose FOBT.
People's preferences for colorectal cancer screening
Cancer screening exists to save lives. In order to reduce overall morbidity and mortality of cancer, it would be important to increase the participation rate of screening program. Several previous studies indicated that use of "decision-aid" significantly increased the participation rate of colorectal cancer screening [26, 27]. AHP can be utilized as a tool for decision aid.
In the present study, we found that fewer subjects expressed a preference for FOBT than for TCS. The subjects placed the greatest weighting on 'effectiveness'. This result indicates that their greatest concern about cancer screening is the life-saving effect.
The relative weight of avoiding the risks of TCS was much smaller than that of its effectiveness. In other words, many people seemed to consider the risks associated with TCS to be small, and did not attach much importance to them: instead, subjects focused on the life-saving aspect of TCS.
Subjects had relatively little concern about the costs of screening. Possibly, the costs of TCS were inconsiderable and affordable to them.
Necessity of informed consent
Priority of 'effectiveness' was higher in Group B (0.652) than in Group A (0.603), while priority of 'avoid disadvantage' was lower in Group B (0.250) than in Group A (0.199). That is, lack of risk information regarding perforation and bleeding increased weight of 'effectiveness' and decreased weight of 'avoid disadvantages'.
It is necessary to provide the general population with sufficient information on colorectal cancer screening. Such information should include not only the effectiveness but also the risks of screening.
Davey et al. reported that most women wanted information about the possibility of false results and side effects; although such information would make them anxious, they wanted it anyway . However, it is thought that many healthcare professionals and the media tend only to focus on the effectiveness of the screening. Ideally, people should be well informed before making decisions affecting their health; unfortunately, most are ill-informed with regard to screening.
In the present study, the provision of the risk information changed the preferred screening method for 8.4% of the subjects. The priority for TCS in Group B can be regarded as an overestimation due to a lack of information. However, >80% of the subjects in Group A still preferred TCS in spite of the provision of risk information. These results suggest that many people can balance the concerns of disadvantages against the effectiveness of saving lives.
Limitations of the present study
In the present study, several limitations should be acknowledged.
First, we chose our subjects from Internet users in Japan. Although approximately 80% of Japanese homes now have access to the Internet, Internet users as a group may be biased toward those with higher levels of education and higher annual incomes. The second limitation is the self-selection bias. Third, the model we used did not consider effect of polyp detection. One of the objectives of colorectal cancer screening programs is to identify and remove potentially pre-cancerous polyps. Fourth, several data presented were only estimates with broad ranges. It is possible that use of different estimates could have affected the study results. Fifth, the subjects' reactions to the information, especially disadvantages, could have been affected by the way the information was formatted. Sixth, excluding the inconsistent subjects could be a limitation because of unequal characteristics between the consistent and inconsistent groups. Although statistically insignificant, the male ratio was substantially high in the inconsistent group. Seventh, the local priorities of the 'effectiveness' sub-criterion differed between Group A and B, although they should be similar because there was no difference in the information presented. This disparity may have been caused by the inequality of the distribution of participants' characteristics, particularly the difference of concerns about their own health.
In the present study, we investigated whether risk information affects people's preferences to colorectal cancer screening using AHP. The results suggest that there is a relationship between the lack of risk information and the differences in priorities assigned to effectiveness and risks of the two procedures. Patients should be well informed of both the risks and benefits before making decisions on selecting colorectal cancer screening options.
Statistics and Information Department, Minister's Secretariat, Ministry of Health and Welfare: Vital Statistics. Tokyo. 2007, (in Japanese)
Dolan J: Patient priorities in colorectal cancer screening decisions. Health Expect. 2005, 8 (4): 334-344. 10.1111/j.1369-7625.2005.00348.x.
Sheikh R, Kapre S, Calof O, Ward C, Raina A: Screening preferences for colorectal cancer: a patient demographic study. South Med J. 2004, 97 (3): 224-230. 10.1097/01.SMJ.0000078619.39604.3D.
Nelson R, Schwartz A: A survey of individual preference for colorectal cancer screening technique. BMC Cancer. 2004, 4: 76-10.1186/1471-2407-4-76.
Ling B, Moskowitz M, Wachs D, Pearson B, Schroy P: Attitudes toward colorectal cancer screening tests. J Gen Intern Med. 2001, 16 (12): 822-830. 10.1046/j.1525-1497.2001.10337.x.
Pignone M, Bucholtz D, Harris R: Patient preferences for colon cancer screening. J Gen Intern Med. 1999, 14 (7): 432-437. 10.1046/j.1525-1497.1999.00018.x.
Saaty TL: The analytic hierarchy process: scenarios, priorities and cost/benefits for the Sudan Transport Plan. Operational Research '81. Proceedings of the Ninth IFORS International Conference: 1981; Hamburg, West Germany. North-Holland. 1981, 161-175.
Patel H, Mirsadraee S, Emberton M: The patient's dilemma: prostate cancer treatment choices. J Urol. 2003, 169 (3): 828-833. 10.1097/01.ju.0000052056.27609.8a.
Stange K, Flocke S, Goodwin M: Opportunistic preventive services delivery. Are time limitations and patient satisfaction barriers?. J Fam Pract. 1998, 46 (5): 419-424.
Kaplan S, Greenfield S, Gandek B, Rogers W, Ware JJ: Characteristics of physicians with participatory decision-making styles. Ann Intern Med. 1996, 124 (5): 497-504.
Richman M, Forman E, Bayazit Y, Einstein D, Resnick M, Stovsky M: A novel computer based expert decision making model for prostate cancer disease management. J Urol. 2005, 174 (6): 2310-2318. 10.1097/01.ju.0000181829.07078.22.
Dolan J, Bordley D, Miller H: Diagnostic strategies in the management of acute upper gastrointestinal bleeding: patient and physician preferences. J Gen Intern Med. 1993, 8 (10): 525-529. 10.1007/BF02599632.
Hariharan S, Dey P, Chen D, Moseley H, Kumar A: Application of analytic hierarchy process for measuring and comparing the global performance of intensive care units. J Crit Care. 2005, 20 (2): 117-124. 10.1016/j.jcrc.2005.04.002. discussion 124-115
Saito H, Soma Y, Koeda J, Wada T, Kawaguchi H, Sobue T, Aisawa T, Yoshida Y: Reduction in risk of mortality from colorectal cancer by fecal occult blood screening with immunochemical hemagglutination test. A case-control study. Int J Cancer. 1995, 61: 465-469. 10.1002/ijc.2910610406.
Müller A, Sonnenberg A: Protection by endoscopy against death from colorectal cancer. A case-control study among veterans. Arch Intern Med. 1995, 155 (16): 1741-1748. 10.1001/archinte.155.16.1741.
Takahashi H, Toyoda T, Tamura T, Ogawa H, Shiraishi F, Hiratsuka N, Hiratsuka S, Hiratsuka H: Problem in the screening of colorectal cancers. J Colon Exam. 2004, 21 (1): 25-29. (in Japanese).
Iwase T: Evaluation of an immunochemical fecal occult blood test by reversed passive hemagglutination compared with Hemoccult II screening for colorectal cancer. Fecal occult blood tests: Current issues and new tests. Edited by: Young GP, Saito H. 1992, San Joe: Smith Kline Diagnostics Inc, 90-95.
Nakama H, Yamamoto M, Kamijo N, Li T, Wei N, Fattah A, Zhang B: Colonoscopic evaluation of immunochemical fecal occult blood test for detection of colorectal neoplasia. Hepatogastroenterology. 1999, 46 (25): 228-231.
Rex D, Rahmani E, Haseman J, Lemmel G, Kaster S, Buckley J: Relative sensitivity of colonoscopy and barium enema for detection of colorectal cancer in clinical practice. Gastroenterology. 1997, 112 (1): 17-23. 10.1016/S0016-5085(97)70213-0.
Smith GA, O'Dwyer PJ: Sensitivity of double contrast barium enema and colonoscopy for the detection of colorectal neoplasms. Surg Endosc. 2001, 15 (7): 649-652. 10.1007/s004640000372.
Sofue T, Hamashima T, Saito H, Shimada T, Matsuda K, Nishida H: Development of guideline for colorectal cancer mass screening. Gan To Kagaku Ryoho. 2005, 32: 901-915. (in Japanese).
Levin T, Zhao W, Conell C, Seeff L, Manninen D, Shapiro J, Schulman J: Complications of colonoscopy in an integrated health care delivery system. Ann Intern Med. 2006, 145 (12): 880-886.
Saaty TL: A scaling method for priorities in hierarchical structures. Journal of Mathematical Psychology. 1977, 15 (3): 234-281. 10.1016/0022-2496(77)90033-5.
Sato J: Comparison between multiple-choice and analytic hierarchy process: measuring human perception. International Transactions in Operational Research. 2004, 11 (1): 77-86. 10.1111/j.1475-3995.2004.00441.x.
Davey H, Barratt A, Davey E, Butow P, Redman S, Houssami N, Salkeld G: Medical tests: women's reported and preferred decision-making roles and preferences for information on benefits, side-effects and false results. Health Expect. 2002, 5 (4): 330-340. 10.1046/j.1369-6513.2002.00194.x.
Pignone M, Harris R, Kinsinger L: Videotape-Based Decision Aid for Colon Cancer Screening: A Randomized, Controlled Trial. Ann Intern Med. 2000, 133 (10): 761-769.
Dolan J, Frisina S: Randomized controlled trial of a patient decision aid for colorectal cancer screening. Med Decis Making. 2002, 22 (2): 125-139. 10.1177/02729890222063017.
The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1472-6963/8/106/prepub
This study was supported by a Grant-in-Aid for Scientific Research from Ministry of Health, Labour & Welfare, Japan.
The authors declare that they have no competing interests.
All authors jointly conceived of the idea for this study. YK and HY constructed the model, and TI, HO and KO validated the content. YK analysed the data, and all authors interpreted the results. YK and HY drafted the manuscript. All authors revised the paper and approved the final version. All authors take public responsibility for the content of the manuscript.
Yuichi Katsumura, Hideo Yasunaga, Tomoaki Imamura, Kazuhiko Ohe and Hiroshi Oyama contributed equally to this work.
Authors’ original submitted files for images
Below are the links to the authors’ original submitted files for images.