A web-based appointment system to reduce waiting for outpatients: A retrospective study
BMC Health Services Research volume 11, Article number: 318 (2011)
Long waiting times for registration to see a doctor is problematic in China, especially in tertiary hospitals. To address this issue, a web-based appointment system was developed for the Xijing hospital. The aim of this study was to investigate the efficacy of the web-based appointment system in the registration service for outpatients.
Data from the web-based appointment system in Xijing hospital from January to December 2010 were collected using a stratified random sampling method, from which participants were randomly selected for a telephone interview asking for detailed information on using the system. Patients who registered through registration windows were randomly selected as a comparison group, and completed a questionnaire on-site.
A total of 5641 patients using the online booking service were available for data analysis. Of them, 500 were randomly selected, and 369 (73.8%) completed a telephone interview. Of the 500 patients using the usual queuing method who were randomly selected for inclusion in the study, responses were obtained from 463, a response rate of 92.6%. Between the two registration methods, there were significant differences in age, degree of satisfaction, and total waiting time (P < 0.001). However, gender, urban residence, and valid waiting time showed no significant differences (P > 0.05). Being ignorant of online registration, not trusting the internet, and a lack of ability to use a computer were three main reasons given for not using the web-based appointment system. The overall proportion of non-attendance was 14.4% for those using the web-based appointment system, and the non-attendance rate was significantly different among different hospital departments, day of the week, and time of the day (P < 0.001).
Compared to the usual queuing method, the web-based appointment system could significantly increase patient's satisfaction with registration and reduce total waiting time effectively. However, further improvements are needed for broad use of the system.
Reducing outpatient waiting times has been the focus of a large number of studies [1–3] because waiting and treatment times are usually regarded as indicators of service quality . The Patient's Charter of the UK Government sets a series of standards which state that all patients must be seen within thirty minutes of their appointment time . Outpatient waiting time can be divided into two types: waiting before consultation, and waiting after consultation . Time spent waiting before consultation has attracted much research attention, and can be further separated into waiting time for registration, and waiting time for consultation . Because of China's limited medical resources, long waiting times for registration are common in the health care system, and the registration waiting time is generally much longer than the consultation waiting time. Long registration waiting times for outpatients have already become a long-festering healthcare problem in China . For this reason, our study focuses on registration waiting time only.
In recent years, China has been in the process of implementing health care system reform . The aim of the reform was to provide basic and convenient medical care. Easy access to a doctor is the first step for patients using health services. The traditional registration method (usual queuing method), had unacceptable waiting times, and placed great stress on clinic staff . With the rapid development of the internet over the previous 2-3 years, some hospitals trialed the use of web-based appointment systems (WAS) for outpatients . In 2009, supported by the Ministry of Health, all public tertiary hospitals began to use WAS. However, to date there are few studies about the efficacy of WAS in China. Thus, our study aims to evaluate the efficacy of WAS for outpatients, by comparing waiting times for the WAS and usual queue method, and investigating reasons for not using the WAS.
This work was approved by the ethics committee of Xijing hospital, Fourth Military Medical University. Informed consent was obtained from participants prior to the administration of study measures.
Study participants were recruited from outpatients of Xijing hospital, which is a tertiary hospital in Shaanxi province of China. A two-stage sampling method was adopted. First, from January to December 2010, 10% of all patients registering through the WAS were randomly selected for potential inclusion in the study, giving a total of 5641 patients. For each patient, detailed information including demographic characteristics, appointment, and contact data were obtained from the hospital statistics office. Then, from the selected patients, 500 were randomly selected for a telephone interview. The interview assessed satisfaction with the WAS and the time spent making appointments, and were performed by trained interviewers.
The comparison group completed a questionnaire and comprised 500 randomly selected patients who used the usual queuing method for registration. Interviewers distributed questionnaires to people queuing at registration windows, and supervisors were responsible for the collection of completed questionnaires after registration. The following questions were listed in the questionnaires:
What time did you join the queue?
What is your reason for not using the web-based registration system?
Are you satisfied with the usual queuing method?
What time did you register successfully?
The last question was confirmed by the registering nurses.
Main outcome measures
We evaluated the performance of two different approaches: the WAS, and the usual queuing method (Figure 1). Using the WAS, patients are given an appointment number. At the designated appointment time, patients arrive at the hospital and get the registration that is allotted to their appointment number. These patients need not queue at the registration window. The patients using the traditional queuing method waste much unnecessary waiting time standing in line at the registration window to ensure a successful registration with a certain physician. The main outcome variables were: invalid, valid, and total waiting time based on the usual queuing method, and appointment-making time based on the WAS. "Invalid waiting time" was defined as the duration of time spent queuing for registration; and "total waiting time" was the total time spent queuing and obtaining registration, and consists of valid and invalid waiting time. Appointment-making time based on the WAS was the duration of time the participant spent making an appointment through the WAS.
We used SPSS 17.0 for Windows (SPSS Inc, Chicago, Illinois) for all statistical analysis. Continuous variables are presented as means and standard deviations. Categorical variables are presented as frequencies and percentages. The t-test, analysis of variance (ANOVA), Mann-Whitney U test, and Kruskal-Wallis H test were used to compare continuous variables, and the Chi-square test was used to compare categorical variables between the two registration systems. A two-tailed P-value < 0.05 was considered statistically significant.
A total of 5641 people made an appointment using the WAS in the study period, from which 500 were randomly selected for a telephone interview. Responses were obtained from 369 (73.8%) participants. For the usual queuing method group, 463 participants completed a questionnaire while queuing for registration, corresponding to a response rate of 92.6% (463/500).
The demographic characteristics of participants
Participant gender and residence distributions did not differ between the two registration methods (P > 0.05). However, the age distribution was significantly different between the two methods, with the average age of participants being younger in the WAS group (Table 1).
Satisfaction and waiting time comparison between the two registration methods
Participants using the WAS reported a higher level of satisfaction with the registration method than those using the usual queuing method (71.7% vs. 49.0%, P < 0.001). In the usual queuing method, the average invalid waiting time was 86 minutes with a maximum of 13.5 hours; while the average valid waiting time was only 12 minutes (Figure 2). Although the total waiting time of the usual queuing method was significantly longer than that of the WAS method (98 vs. 7 minutes, P < 0.001) (Table 1), there were no significant differences in valid waiting time between the usual queuing method and the WAS method (12 vs. 7 minutes, P = 0.321).
Reasons for not using the WAS
The most common reason given by participants for not using the WAS was that they were unaware of its existence (52.9%) (Table 2). Other factors leading to the non-use of the WAS were that people did not trust the internet (28.1%), and/or lacked the ability to operate a computer (10.4%). Only 8.6% of participants had other reasons, such as that it was casual decision to see a doctor, or that certain physicians had no extra "passports" to be booked.
Non-attendance following use of the WAS
The overall proportion of non-attendance following making an appointment using the WAS was 14.4%. Non-attendance rates differed among the 30 hospital departments (Kruskal-Wallis H test, χ2 = 32.128, P < 0.001), and varied between 0.16% and15.7%. Neurosurgery, General surgery, Urology, Obstetrics and Gynecology, and Ophthalmology had the highest rates of non-attendance (Table 3). Non-attendance was higher on Mondays than on any other day (P < 0.001). During daytime, the non-attendance rate between 1 pm and 4 pm was higher than the rate between 8 am and 11 am (24.6% vs. 10.7%, P < 0.001) (Table 3).
One of the greatest complaints of the Chinese public is the amount of time it takes to queue for outpatient registration in China. From our investigation we noted that some participants even waited in line all night (13.5 hours) to ensure a registration with a certain physician. To effectively reduce registration waiting times in the usual queuing method is an urgent issue that needs to be resolved. This study demonstrates that that using a WAS could substantially increase patients' satisfaction with outpatient registration. Although some time is still needed to make appointments using the WAS, it can significantly reduce total waiting time, especially invalid waiting time.
Despite the benefits using of the WAS, many people still registered via the usual queuing method. One reason we identified for not using the WAS was that over half of the participants did not know that an appointment can be obtained through the internet. This indicates that more effort should be made by hospitals and health service providers to promote and encourage the use of the WAS. By using a WAS, hospitals and other health service providers can reduce their invalid waiting time and anxiety in queues. Another important finding was that registration demand varied according to day of the week and time of the day. After investigating patient's appointment time in the WAS, we found that 43.8% of patients (2471) wanted to see a doctor on Monday or Tuesday, and 71.0% of them preferred it to be in the morning. This makes it very difficult to obtain registration during these periods. By making patients aware of this, it would be possible to encourage them to register on days with a lower outpatient load. This will help distribute the registration demand evenly and improve the allocation of medical resources.
Non-attendance is one of the potential problems for hospitals using a WAS. In our study, the overall non-attendance rate was 14.4%. This is consistent with the non-attendance rates reported in related studies, which range from 12% to 27% [10, 11]. We found that the proportion of non-attendance was higher on Mondays than on other days, which differs from another study, which reported that non-attendance rates were higher on Sundays than on other days . The failure of patients to meet scheduled appointments disrupts the orderliness of medical care and wastes limited medical resources [12, 13]. Some measures had already been adopted to address this issue, such as preventing patients who failed to attend appointments three times in the preceding 12 months from making any new appointments on the web.
Many studies have focused on reasons for non-attendance, and some reliable suggestions for improvement have been provided (e.g., using a reminder system) [14–16]. To improve the management of outpatients, we assessed non-attendance related factors in our study. We found that hospital department, day of the week, and time of the day were significantly associated with non-attendance. The proportion of non-attendance was higher following registration with medical specialists (e.g. specialists in Neurosurgery) and most non-attendance occurred in the afternoon.
Our study has some potential limitations. First, we failed to collect data on the reasons for non-attendance from the participants using the WAS, because the majority of people who failed to attend their appointments declined to give an explanation. Second, because our study participants were from a large tertiary hospital, and different hospitals may have a different WAS, our findings may not reflect WAS use in other hospitals. Some relatively small hospitals may not need to use a WAS, because they do not experience high demand for registration. Despite these potential limitations, our study demonstrated that the WAS is an efficient and satisfactory means of obtaining registration, and identified factors that contribute to not using the booking system. By identifying these factors, we intend to develop intervention strategies to further improve the usability of the WAS and provide convenience for patients.
Our study showed that use of a WAS can effectively increase patient satisfaction with getting a registration and reduce waiting times. A lack of information about online appointments was the main reason for not using the system. Non-attendance is an inevitable problem in the development of a web-based registration system. To increase the efficiency of the registration system, and to reduce non-attendance rates, further studies on various interventions such as the promotion of online registration, and use of a reminder system should be considered.
Conflicts of interests
The authors declare that they have no competing interests.
Harper PR, Gamlin HM: Reduced outpatient waiting times with improved appointment scheduling: a simulation modeling approach. OR Spectrum. 2003, 25: 207-222. 10.1007/s00291-003-0122-x.
Zhu ZC, Heng BH, Teow KL: Analysis of factors causing long patient waiting time and clinic overtime in outpatient clinics. J Med Syst. 2010.
Najmuddin AF, Ibrahim IM, Ismail SR: Simulation modeling and analysis of multiphase patient flow in obstetrics and gynecology department (O&G Department) in specialist centre. ASM'10 Proceedings of the 4th international conference on Applied mathematics, simulation, modeling. 2010, 125-130.
Wijewickrama AK, Takakuwa S: Simulation analysis of an outpatient department of internal medicine in a university hospital. Proceedings of the 2006 Winter Simulation Conference. 2006, 425-432.
Chen BL, Li ED, Yamawuchi K, Kato K, Naganawa S, Miao WJ: Impact of adjustment measures on reducing outpatient waiting time in a community hospital: application of a computer simulation. Chin Med J. 2010, 123: 574-580.
Yu Q, Yang K: Hospital registration waiting time reduction through process redesign. International Journal of Six Sigma and Competitive Advantage. 2008, 4: 240-253. 10.1504/IJSSCA.2008.021838.
Private hospitals shoulder hopes of revamping China's ailing medical system. [http://english.peopledaily.com.cn/90001/90776/90882/6916485.html]
Ma J, Lu MS, Quan H: From a national, centrally planned health system to a system based on the Market: Lessons from China. Health Aff. 2008, 27: 937-948. 10.1377/hlthaff.27.4.937.
Wei XF, Huang YS: Modeling outpatient booking system based on UML [in Chinese]. Science Technology and Engineering. 2007, 7: 5600-5603.
Adams LA, Pawlik J, Forbes GM: Non-attendance at outpatient endoscopy. Endoscopy. 2004, 36: 402-404. 10.1055/s-2004-814329.
Raju G, Boening SK, Mielsch EJ, Jafri SF, Bhutani MS, Szauter K, Shabot JM, Synder N, Nath SK, Faruqi S, Pasricha PJ: Patient compliance is key to the success of an open-access colonoscopy program. Gastrointest Endosc. 2003, 57: AB112.
Goldbart AD, Dreiher J, Vardy DA, Alkrinawi S, Cohen AD: Non-attendance in pediatric pulmonary clinics: an ambulatory survey. BMC Pulm Med. 2009, 9: 12-10.1186/1471-2466-9-12.
Lee CS, McCormick PA: Telephone reminders to reduce non-attendance rate for endoscopy. J R Soc Med. 2003, 96: 547-548. 10.1258/jrsm.96.11.547.
Gurudu SR, Fry LC, Fleischer DE, Jones BH, Trunkenbolz MR, Leighton JA: Factors contributing to patient non-attendance at open-access endoscopy. Dig Dis Sci. 2006, 51: 1942-1945. 10.1007/s10620-006-9215-0.
Dickey W, Morrow JI: Can outpatient non-attendance be predicted from the referral letter? An audit of default at neurology clinics. J R Soc Med. 1991, 84: 662-663.
Downer SR, Meara JG, Da Costa AC: Use of SMS text messaging to improve outpatient attendance. Med J Aust. 2005, 183: 366-368.
The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1472-6963/11/318/prepub
Dr. YW was supported by the research program of Fourth Military Medical University. Prof. YX was supported by the National Science and Technology Support Project Grant (No. 2008BAI52B01) from the Ministry of Science and Technology and National Natural Science Foundation (No. 81072393) of China.
The initial idea was supplied by YW and YX. The protocol was drawn by YW and WC. Investigation was carried by DL, WC, HT, FS, ZT, CS and QY. Data extraction and analyses were performed by WC and YW. First draft was written by WC with contributions by YW. All authors commented and approved the final draft.
Wenjun Cao, Yi Wan, Haibo Tu, Fujun Shang, Danhong Liu contributed equally to this work.
About this article
Cite this article
Cao, W., Wan, Y., Tu, H. et al. A web-based appointment system to reduce waiting for outpatients: A retrospective study. BMC Health Serv Res 11, 318 (2011). https://doi.org/10.1186/1472-6963-11-318
- Web-based appointment system
- waiting time
- patient satisfaction