Patient attitudes toward using computers to improve health services delivery
© Sciamanna et al; licensee BioMed Central Ltd. 2002
Received: 5 June 2002
Accepted: 11 September 2002
Published: 11 September 2002
The aim of this study was to examine the acceptability of point of care computerized prompts to improve health services delivery among a sample of primary care patients.
Primary data collection. Cross-sectional survey. Patients were surveyed after their visit with a primary care provider. Data were obtained from patients of ten community-based primary care practices in the spring of 2001.
Almost all patients reported that they would support using a computer before each visit to prompt their doctor to: "do health screening tests" (92%), "counsel about health behaviors (like diet and exercise)" (92%) and "change treatments for health conditions" (86%). In multivariate testing, the only variable that was associated with acceptability of the point of care computerized prompts was patient's confidence in their ability to answer questions about their health using a computer (beta = 0.39, p = .001). Concerns about data security were expressed by 36.3% of subjects, but were not related to acceptability of the prompts.
Support for using computers to generate point of care prompts to improve quality-oriented processes of care was high in our sample, but may be contingent on patients feeling familiar with their personal medical history.
Keywordsreminders preventive services quality computer primary care
Improving health care quality remains an elusive goal as many barriers exist to changing: 1) health care systems, 2) physician behaviors and 3) patient behaviors [1, 2]. Prior studies have shown that computerized reminders and decision support systems consistently increase the delivery of preventive services and improve the quality of outpatient care [3–9]. For example, in a randomized trial of 39 primary care physicians, McPhee and colleagues found that computerized reminders led to significant increases in fecal occult blood testing, pap testing, smoking cessation counseling, and diet counseling . Although obstacles exist to incorporating reminder systems into routine care [10–12], to our knowledge, no study has examined patient acceptance of computerized reminders to improve routine health service delivery.
The goal of this study was to examine patient acceptability of point of care computerized prompts as a method of improving quality of care among a diverse group of primary care practices in Rhode Island. We hypothesized that patients would support the use of computerized reminders for health screening tests and behavioral counseling, but not for prompting physicians to make changes to their treatment plans. We also hypothesized that interest in using computerized reminders would be strongly related to an individual's general level of comfort with computers.
A series of four focus groups were held with primary care patients to understand the important issues in designing and implementing patient-centered computer systems in primary care settings. Focus groups included 7–11 subjects, recruited from posters placed in public areas of the hospital and via emails send over the hospital intranet. Subjects were paid $30 for participating in the focus groups, and one of the investigators (CNS) served as the facilitator. Attitudes and concerns about using computers to improve health care quality that resonated among group members were considered for inclusion in the survey instrument.
Instrument items that were analyzed for this paper, reflecting domains identified in the focus groups, included: 1) patient attitudes toward the possible uses of computer technology to improve health care quality ("to prompt your doctor to do health screening tests", "to prompt your doctor to counsel you about your health behaviors", and "to prompt your doctor to change your treatments for conditions like high blood pressure and diabetes") and 2) concerns about data security (".. would you be concerned that someone would be able to steal your personal information" from the computer"). Attitude questions were asked on a 5-point Likert-type scale from "definitely no" (1), to "definitely yes" (5).
Attitudes toward using computers to improve health services
Frequency % (n)
To prompt your doctor to do health screening tests (like cholesterol) when they are indicated.
To prompt your doctor to counsel you about your health behaviors (like diet and exercise)
To prompt your doctor to change your treatments for conditions like high blood pressure and diabetes?
Two other themes that emerged from the focus groups were 1) ability to use computers and 2) ability to answer questions about their health. Ability to use computers was assessed with the following item: How comfortable do you feel using computers, in general?" measured on a 6 point scale from "very comfortable" (6), "somewhat comfortable" (5), "neither comfortable nor uncomfortable" (4), "somewhat uncomfortable" (3), "very uncomfortable" (2) and "I have never used a computer" (1). Ability to answer questions about one's health was assessed using the following item "Do you think you could use a computer to answer questions about your health?" and was scored a 5-point Likert-type scale from "definitely no" (1), to "definitely yes" (5). The questionnaire item regarding computer acceptability was adapted from the Pew Internet Tracking Project .
Patient assessment included demographic information. Brief screening questions for age, gender, educational attainment, chronic health conditions (e.g., diabetes, depression) and health risk factors were adapted from the year 2000 Behavioral Risk Factor Surveillance Survey  and the 1995 National Health Interview Survey.
As part of a larger study to examine the feasibility of using a tailored message computer program to enhance physical activity and smoking cessation, one hundred and thirty letters were sent to a random sample of primary care providers in the Providence area. Eleven physicians expressed interest and were enrolled. After recruitment, one physician, a general internist, later dropped out of the study after moving his practice. The ten remaining community-based primary care practices enrolled in the study included family practice (4), internal medicine (5) and obstetrics (1).
From 3/1/2001 to 6/1/2001, two research assistants approached 148 consecutive adult outpatients (10–15 per office) to recruit 124 patients (83%) to complete the survey after their visit with their doctor, but before they had left the office. The introduction to the survey described the planned use for the computerized reminder system in which physician's offices would have computers installed and "each patient would spend 5–10 minutes answering questions on the computer before every visit with their doctor". The introduction specified that the computerized prompts would be based on data entered by patients, but did not specify whether or not additional data sources (e.g., electronic medical records) would be used to supplement or verify data entered by patients. The protocol was approved by Institutional Review Board of The Miriam Hospital.
Methods: data analysis
All data analysis were carried out using SPSS for Windows, version 10.1.0. Groups were compared using chi-square testing for categorical variables and analysis of variance testing for continuous variables. Due to the presence of some missing data, some row totals are less than 124. The Student's t-test (variables with 2 categories) and Analysis of Variance testing (variables with > 2 categories) was used to examine group differences among categorized variables. Variables significantly associated with acceptability of using computers to improve health services were included in a multiple linear regression model to test for an association between attitudes toward computers and acceptability of using computers to improve health services, while adjusting for potential confounders.
The average age of participants was 42.8 years and nearly 75% were female (see Table 1). Approximately half of participants reported using a computer at least weekly (49.2%) while 12.7% had never used a computer.
Background characteristics by interest in using computers in the doctor's office to improve health services
Frequency % (n)
Acceptability of using point of care computerized prompts*
Less than high school
College or Graduate school
White and non-Hispanic
Non-white or Hispanic
Chronic Illnesses (of 11 possible):
At least one
Would you be concerned that someone would be able to steal your personal information from the computer?
How comfortable do you feel using computers, in general?
Do you think you could use a computer to answer questions about your health?
In multivariate testing, the only variable associated with acceptability of using point of care computerized prompts to enhance the quality of care was a patient's comfort in their ability to answer questions about their health using a computer (beta = 0.39, p = .001).
The main findings in our study were 1) point of care computerized prompts to enhance the quality of care, specifically preventive services, health behavior counseling and chronic disease management, were highly acceptable to primary care patients, 2) patients' ability to answer questions about their health, but not patients' experience in using computers, was significantly associated with acceptance of the computerized prompts and 3) concerns over data security, while present, were not associated with acceptance of the computerized prompts.
As the use of medical informatics becomes more widespread, computerized reminders and decision support systems may play an important role in improving the delivery of preventative services and outpatient care. An important component of the success of these programs is patient acceptability, yet no study to our knowledge has examined this. Over 85% of patients answered "yes" (either "definitely yes" or "probably yes") when asked about their support for using computers to prompt their doctor to either do health screening tests (92.2%), do health behavior counseling (92.2%) or change patients' medical treatments if necessary (85.5%).
We suspect this support for computerized reminders systems reflects a general belief that computerized feedback is accurate, and possibly more accurate than the decisions made by their physicians. In their 1999 publication, "To Err Is Human", the Institute of Medicine concluded that as many as 98,000 patients die each year from medical errors . This book has received much press coverage and may have enhanced consumer awareness of the prevalence of errors and, therefore, the need for computer systems that help physicians make complex medical decisions.
In our study, acceptability was related to patients' confidence in their ability to answer questions about their health, even after adjusting for patients' self-reported experience in using computers. We feel that this is due mainly to patients' lack of knowledge about their health, specifically their knowledge of test results, as they would be required to enter these results into the computer to use the proposed system. Not being aware of one's medical history, such as blood pressure or cholesterol values, would prevent them from participating in such as system. This is consistent with the findings of Branch and colleagues, who noted that patients who were unaware of their test results, despite being tested, were less likely to report receiving other health promotion services . Among 4298 patients who reported being tested for hypertension and hyperlipidemia in the previous year, 449 (10.4%) did not know either test result, and a presumably greater percentage did now know at least one of the test results. The lack of knowledge of one's health history may be related to an individual's health literacy which, though not measured in the current study, has been associated with poorer health outcomes, such as hospitalization, and knowledge of one's chronic disease [17, 18].
Though the computer system described in the introduction to the survey was located in a doctor's office, more than a third (36.3%) of the patients in our sample had concerns that their personal information would be stolen from the computer. Though the Health Insurance Portability and Accountability Act (HIPAA) of 1996, which includes standards for privacy of individually identifiable health information, may allay these concerns over data security , the present study shows that these concerns were not related to acceptability of the computerized prompts. This is consistent with the history of internet commerce which has grown at an impressive rate, despite individual's concerns over the security of their credit card and other personal information .
The study has several noteworthy limits. First, the small sample size and geographical range limit the generalizability of the findings. However, the rates of health conditions including high cholesterol (23.5%) and high blood pressure (20.7%) are similar to other larger samples . These findings will need to be repeated in other populations and in larger sample sizes. Second, the brevity of the survey, due to concerns over subject burden in the primary care setting, leaves open the possibility that an unmeasured variable, such as health literacy  may be a source of residual confounding. Future studies should include measures of health literacy, such as the Test of Functional Health Literacy in Adults .
Computerized reminders and decision support systems have repeatedly been shown to improve the quality of outpatient care. Though the personal computer and the Internet have tremendous potential for changing the way that health care is delivered, both have failed, as yet, to facilitate the dissemination of computerized reminder systems. This study shows that acceptability of point of care computerized prompts to enhance the quality of care is high. To use such systems, however, patients will need to be more knowledgeable about their health, to enable them to feel comfortable answering questions that will be used to create the computerized prompts.
CNS participated in the collection of data, the statistical analysis and in the preparation of the manuscript.
JD participated in the interpretation of results and in the preparation of the manuscript.
PM participated in the design of the study and in the statistical analysis and interpretation of results.
List of abbreviations
Health Insurance Portability and Accountability Act
The authors would like to acknowledge Edward Fink for his copyediting and proofreading.
This work was supported through a grant from the National Cancer Institute.
- Cabana MD, Rand CS, Powe NR, Wu AW, Wilson MH, Abboud PA, Rubin HR: Why don't physicians follow clinical practice guidelines? A framework for improvement. Jama. 1999, 282: 1458-10.1001/jama.282.15.1458.View ArticlePubMedGoogle Scholar
- Cabana MD, Ebel BE, Cooper-Patrick L, Powe NR, Rubin HR, Rand CS: Barriers pediatricians face when using asthma practice guidelines. Arch Pediatr Adolesc Med. 2000, 154: 685.View ArticlePubMedGoogle Scholar
- Smith WR: Evidence for the effectiveness of techniques To change physician behavior. Chest. 2000, 118: 8S-10.1378/chest.118.2_suppl.8S.View ArticlePubMedGoogle Scholar
- Balas EA, Austin SM, Mitchell JA, Ewigman BG, Bopp KD, Brown GD: The clinical value of computerized information services. A review of 98 randomized clinical trials. Arch Fam Med. 1996, 5: 271-10.1001/archfami.5.5.271.View ArticlePubMedGoogle Scholar
- McPhee SJ, Bird JA, Jenkins CN, Fordham D: Promoting cancer screening. A randomized, controlled trial of three interventions. Arch Intern Med. 1989, 149: 1866-10.1001/archinte.149.8.1866.View ArticlePubMedGoogle Scholar
- McPhee SJ, Detmer WM: Office-based interventions to improve delivery of cancer prevention services by primary care physicians. Cancer. 1993, 72: 1100.View ArticlePubMedGoogle Scholar
- McPhee SJ, Bird JA, Fordham D, Rodnick JE, Osborn EH: Promoting cancer prevention activities by primary care physicians. Results of a randomized, controlled trial. JAMA. 1991, 266: 538-10.1001/jama.266.4.538.View ArticlePubMedGoogle Scholar
- Lobach DF, Hammond WE: Computerized decision support based on a clinical practice guideline improves compliance with care standards. Am J Med. 1997, 102: 89-10.1016/S0002-9343(96)00382-8.View ArticlePubMedGoogle Scholar
- Hunt DL, Haynes RB, Hanna SE, Smith K: Effects of computer-based clinical decision support systems on physician performance and patient outcomes: a systematic review [see comments]. Jama. 1998, 280: 1339-10.1001/jama.280.15.1339.View ArticlePubMedGoogle Scholar
- Grams RR, Morgan G: Medical record innovations that can improve physician productivity. J Med Syst. 1999, 23: 133-10.1023/A:1020593320198.View ArticlePubMedGoogle Scholar
- Ornstein SM, Garr DR, Jenkins RG: A comprehensive microcomputer-based medical records system with sophisticated preventive services features for the family physician [see comments]. Journal of the American Board of Family Practice. 1993, 6: 55.PubMedGoogle Scholar
- Spencer E, Swanson T, Hueston WJ, Edberg DL: Tools to improve documentation of smoking status. Continuous quality improvement and electronic medical records. Arch Fam Med. 1999, 8: 18-10.1001/archfami.8.1.18.View ArticlePubMedGoogle Scholar
- Raine L: Pew Internet Project: Tracking Report. Washington, DC, The Pew Internet & American Life Project. 2002, 1.Google Scholar
- Control CfD: Behavioral Risk Factor Surveillance System:. Prevalence Data. 2000, 2000.Google Scholar
- Kohn LT, Corrigan J, Richardson WC, Donaldson MS: To Err is Human: Building a Safer Health System,. in Medicine. Edited by: Io. 1999, Washington, DC, National Academy PressGoogle Scholar
- Branch LG, Rabiner DJ: Rediscovering the patient's role in receiving health promotion services. Med Care. 2000, 38: 70-10.1097/00005650-200001000-00008.View ArticlePubMedGoogle Scholar
- Baker DW, Parker RM, Williams MV, Clark WS: Health literacy and the risk of hospital admission [see comments]. Journal of General Internal Medicine. 1998, 13: 791-10.1046/j.1525-1497.1998.00242.x.View ArticlePubMedPubMed CentralGoogle Scholar
- Williams MV, Baker DW, Parker RM, Nurss JR: Relationship of functional health literacy to patients' knowledge of their chronic disease. A study of patients with hypertension and diabetes. Archives of Internal Medicine. 1998, 158: 166-10.1001/archinte.158.2.166.View ArticlePubMedGoogle Scholar
- Lumpkin JR: e-health, HIPAA, and beyond. Health Aff (Millwood). 2000, 19: 149-10.1377/hlthaff.19.6.149.View ArticleGoogle Scholar
- Fontana SA, Baumann LC, Helberg C, Love RR: The delivery of preventive services in primary care practices according to chronic disease status. Am J Public Health. 1997, 87: 1190.View ArticlePubMedPubMed CentralGoogle Scholar
- Parker RM, Baker DW, Williams MV, Nurss JR: The test of functional health literacy in adults: a new instrument for measuring patients' literacy skills. J Gen Intern Med. 1995, 10: 537.View ArticlePubMedGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1472-6963/2/19/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article: verbatim copying and redistribution of this article are permitted in all media for any purpose, provided this notice is preserved along with the article's original URL.