Skip to main content

Modelling vaccination capacity at mass vaccination hubs and general practice clinics: a simulation study

Abstract

Background

COVID-19 mass vaccination programs place an additional burden on healthcare services. We aim to model the queueing process at vaccination sites to inform service delivery.

Methods

We use stochastic queue network models to simulate queue dynamics in larger mass vaccination hubs and smaller general practice (GP) clinics. We estimate waiting times and daily capacity based on a range of assumptions about appointment schedules, service times and staffing and stress-test these models to assess the impact of increased demand and staff shortages. We also provide an interactive applet, allowing users to explore vaccine administration under their own assumptions.

Results

Based on our assumed service times, the daily throughput for an eight-hour clinic at a mass vaccination hub ranged from 500 doses for a small hub to 1400 doses for a large hub. For GP clinics, the estimated daily throughput ranged from about 100 doses for a small practice to almost 300 doses for a large practice. What-if scenario analysis showed that sites with higher staff numbers were more robust to system pressures and mass vaccination sites were more robust than GP clinics.

Conclusions

With the requirement for ongoing COVID-19 booster shots, mass vaccination is likely to be a continuing feature of healthcare delivery. Different vaccine sites are useful for reaching different populations and maximising coverage. Stochastic queue networks offer a flexible and computationally efficient approach to simulate vaccination queues and estimate waiting times and daily throughput to inform service delivery.

Peer Review reports

Background

Mass vaccination programs against the SARS-CoV-2 virus are in operation around the world. There is a clear imperative to vaccinate the global population as quickly as possible: high coverage results in less severe illness and fewer hospital admissions resulting from coronavirus disease (COVID-19) [1,2,3], minimises expensive and disruptive public health interventions [4,5,6,7,8,9,10], and limits opportunities for the virus to mutate, potentially resulting in more transmissible or deadly variants [11, 12]. As at February 2022, ten billion COVID-19 vaccinations have been administered globally, with over 20 million additional doses administered daily [13]. While many high-income countries have already achieved high levels of population coverage there is a large global inequity in vaccine distribution, and many highly populated low-income countries remain under-vaccinated [13]. Booster shots are already being rolled out in many countries and the potential requirement to provide annual shots matched to variants of concern is likely to make population-level COVID-19 vaccination programs a fixture of health care delivery for years to come [14,15,16].

Vaccines are routinely administered at a wide range of locations including hospitals, general practices, and pharmacies. To facilitate rapid rollout of the COVID-19 vaccine, many health departments also established improvised mass vaccination hubs in repurposed venues such as schools, churches, conference centres and sports arenas [17, 18]. The layout and potential capacity of these different venues have implications for how the vaccination process is organised and one of the many logistical challenges of mass vaccination is ensuring adequate staffing and vaccine stock to meet demand and keep overall queueing times to an acceptable level. Getting this balance right is essential to an efficient and successful rollout [19,20,21,22,23,24]. Too few staff or too few vaccines may result in onerous waiting times or shortages of doses. Having too many doses on site may be impractical for storage reasons, given cold-chain requirements and the necessity to only reconstitute doses that will be used to minimise wastage.

Regardless of where the vaccine is administered, the process involves a sequence of administrative and clinical tasks, that may include temperature checks on arrival, registration or booking confirmation, health assessment, recording consent, vaccine reconstitution and administration of the vaccine. Planning is essential to avoid bottlenecks resulting in long delays and a negative patient experience. In addition, vaccine demand fluctuates over time and it is important to be able to plan for surge capacity.

The application of computational operational research methods to health care delivery and capacity planning has a long history [25,26,27,28,29]. A recent umbrella review of systematic reviews [30] highlights the diverse range of healthcare applications, including obstetrics [31], radiotherapy [32], surgery [33,34,35], emergency departments [36,37,38], community health care [39] and distribution of blood products [40]. These methods have also previously been applied to challenges arising in the context of a pandemic. A simulation approach was used to model and optimise nurse allocation in an emergency department in the event of a hypothetical influenza outbreak [41]. Similar methods were used to inform the delivery of a drive-through mass vaccination clinic which successfully vaccinated almost 20,000 residents against the H1N1 virus over 1.5 days in 2009 [42].

Given this long history and array of applications, it is no surprise that the onset of Covid-19 saw the rapid uptake of simulation methods to inform various aspects of the pandemic response. A discrete event simulation was used to model the process of screening and testing for Covid-19 in India using FlexSim Healthcare software [43]. This analysis was used to identify a bottleneck in the testing facilty patient flow, and evaluate potential alternatives through simulation. In Canada, a hybrid discrete-event and agent based model was used to model thoughput at a drive-through mass vaccination clinic [22]. This model estimated total throughput and average processing and waiting times based on a range of assumptions including staff numbers, service times, vehicle occupancy and available drive-through lanes. Implemented using AnyLogic simulation software, the model includes a web-based user interface [44].

In the United Kingdom, an existing open source tool for modelling patient pathways using discrete-event simulation modelling [45, 46] was adapted to model a Covid-19 mass vaccination hub located in a sports stadium [23]. This model informed the organisation of the site by identifying bottlenecks and under-utilisation of resources in the proposed patient flow. The same model was also used to assess the impact of unplanned disruptions at a second vaccination clinic, including delayed arrivals and staff shortages early in the day [24]. The analysis highlighted that early disruptions resulted in significant congestion with undiserable conditions persisting throughout the day, leading the authors to advise fewer daily bookings so that the system could absorb unplanned shocks, or ensuring additional overflow space to safely accommodate patients during congested periods. The underlying simulation model is implemented in R and includes a user interface which can be downloaded and deployed locally [46].

In this study, we aimed to model the vaccination process using stochastic queue network models to help inform public health planning for the delivery of vaccinations. We developed separate models for larger mass vaccination hubs and smaller GP vaccination clinics and show how these models can be used to simulate the queueing process, plan staffing requirements to avoid bottlenecks and estimate daily throughput given constraints on staff capacity. Our analysis adds to the literature in two important ways. First, we incorporate the vaccine preparation process into the queue network, which is important to consider given guidelines to reconstitute vaccines shortly before administration and use within a fixed timeframe. Second, we provide a free and opensource web-based user interface to our simulation models, which allows others to use this modelling tool without needing any specialised software, installation or subscription.

Methods

Queueing theory

Queueing is a ubiquitous phenomenon which we encounter daily at shops, airports, train stations and call centres. Queueing theory is a statistical representation of this everyday process. The most basic queue can be characterised by three components: the rate of arrivals into the queue, the service time, and the number of servers [47]. If arrivals are infrequent, service times are fast, and servers are plentiful (e.g. an ATM on a quiet street) then the total waiting time will be short and the average queue length will be low. If arrivals are frequent, the service time is long or the number of servers too few (e.g. at an airport check-in desk on the first day of holidays) then the average queue length will increase as will waiting times.

Queueing theory offers a way to improve the experience for customers and for servers by modelling the queueing process and guiding the balance between these factors. Models of the queueing process represent arrival and service times as stochastic processes. For example, the number of new customers joining a queue in a given period can be modelled as a Poisson process or, alternatively, inter-arrival times can be modelled as an exponential distribution. The aim is to then estimate characteristics of the queue, such as average (median) waiting time and queue lengths given a fixed number of servers, or to estimate the number of servers required to keep average waiting times at a desired level given likely service times and arrivals. Complex queue networks can be formed by joining multiple simpler queues together, either as a tandem network with an ordered series of queues, or a parallel network, with multiple parallel queues [47, 48].

Other features of queue networks include fork/joins and lags. A fork arises when a single queue bisects into two subprocesses; a join arises when two parallel queues merge. Lags are waiting times that don’t involve a server but nonetheless can also be modelled as a stochastic process.

Modelling the vaccination process as a queue network

In this analysis we represented the vaccination process as a complex queueing network involving tandem queues, fork/joins and lags. We proposed two distinct queue networks—one for mass vaccination hubs and one for GP vaccination clinics—based on real-world examples of how these different delivery modes have delivered COVID-19 vaccines in Australia. For both queue networks, we specified three baseline models based on low, medium, and high staffing availability. We repeatedly simulated data from each model to estimate staff utilisation and service times and, by calibrating the appointment schedule to keep these two metrics within reasonable limits, we estimated baseline daily throughput for each delivery mode. Finally, we performed two what-if scenario analyses to explore how the different queue networks and staffing capabilities responded to two potential system pressures. The first what-if scenario was to incrementally increase the number of appointments, reflecting capability to scale up daily throughput with the same number of staff. The second what-if scenario was to incrementally decrease available staff, reflecting staff shortages due to illness or an increase in competing demands for staff time.

Proposed queue networks

Our proposed queue networks for the mass vaccination hub and GP vaccination clinic differ in the layout of stations and how essential tasks are distributed across these stations. Each stage of the process is serviced by one or more servers—staff who undertake the tasks required for that stage. Patients are serviced by the next available server on a first-come-first-served basis, before moving on to the next station in the network.

An overview of the two queue networks is presented in Fig. 1 and these are described in more detail below. The main difference is that the GP network—assuming a smaller physical space and fewer staff—distributes the necessary tasks to fewer stations. In this sense, our two proposed layouts are analogous to the ‘Separate’ and ‘Combined’ designs explored by Wood et al. (2021), where the combined design merged the clinical assessment and vaccination stations.

Fig. 1
figure 1

Queue networks for (A) mass vaccination hubs and (B) GP vaccination clinics

The proposed queue network for a mass vaccination hub was modelled on the Pfizer/BioNTech vaccination hub based at the Royal Prince Alfred (RPA) Hospital in Sydney, Australia. In this queue network, patients traversed five stations: Entrance, Registration, Assessment, Vaccination and Observation. The first four stations require the patient to wait for an available staff member, so these stations are modelled as tandem queueing processes, with new arrivals from the preceding station serviced by the next available staff member on a first-come-first-served basis. The observation station does not require patients to wait for an available staff member but to capture the constraint of observation area capacity this station is modelled as a queueing process where patients are ‘served’ by available seats. Because mass vaccination sites require a large premises, the queue network also incorporated a short walking time between stations. Vaccine doses must be prepared close to the time they are administered, and clearly delays to this process will result in delays at the vaccination stage. To capture this feature of the vaccination process, the queue network includes a parallel queue for vaccine preparation (Fig. 1A) which joins with the patient queue at the vaccination station. The exact steps for the preparation process will vary for the type of vaccine being administered. The assumed activities at each station in the mass vaccination hub queue network are provided in an additional file (Additional file 1 – Appendix A).

The proposed queue network for a local GP vaccination clinic is presented in Fig. 1B. In this queue network, patients traverse three distinct stations: Registration, Vaccination and Observation. To advance through the Registration and Vaccination stations, patients must wait for the next available staff member, so these stations are modelled as queueing processes with patients serviced by the next available staff member on a first-come-first-served basis. As with the mass vaccination model, the observation station is modelled as a queueing process where patients are ‘served’ by available seats and there is a parallel queue specified for vaccine preparation which joins at the vaccination station. Due to the implicit smaller venue size, the time taken to walk between stations at a GP clinic is assumed to be negligible and not included in the model. The distribution of assumed vaccination tasks across the GP queue network is summarised in an additional file (Additional file 1 – Appendix A).

Parameterising the models

To model queue dynamics based on a given queue networks, three inputs must be provided: (i) simulated services times for each station; (ii) simulated arrival times for each station; and (iii) the number of staff/servers (or open queues) at each station. We defined the service times at each node based on our experience at a mass vaccination hub at the RPA Hospital, Sydney and an exemplar GP clinic. We then calibrated the arrival frequency to ensure baseline models with comparable queue performance for the low, medium and high staffing capacity scenarios using two metrics of queue performance, median processing time and staff utilisation, as described in an additional file (Additional file 1 – Appendix B). The RPA Hospital hub, which had seating for up to 175 patients in the observation area, would constitute a high-capacity mass vaccination hub.

Service times

For both the mass vaccination hub and GP vaccination clinic models, the user must specify service time distributions for each station in the queue network. For each patient within the simulation, the time spent at each station is sampled from the corresponding user-specified distribution. In the simulations presented here, the station service times were sampled from exponential distributions with fixed minimum service times and rate parameters as summarised in Table 1. The choice of exponential distributions reflects the assumption that most patients take a relatively short time to process with a minority of patients taking longer.

Table 1 Assumed service time distributions for the mass vaccination hub and GP clinic stations

The exception is the observation station, which was modelled as bimodal distribution, assuming normally distributed observation times for the majority of patients who do not experience an adverse reaction and exponentially distributed observation times for a small random subset to reflect a low incidence of adverse reactions. In our simulations the probability of an adverse reaction was set to 2%. The assumed minimum service times and exponential rate parameters for each station are summarised in Table 1, together with the resulting distribution of service times. Our web-based applet allows users to choose from five parametric distributions when specifying service times: exponential, normal, log-normal, gamma and Weibull distributions.

Arrival times

Arrivals for both queue networks were generated based on a fixed appointment system for an eight-hour clinic. For mass vaccination hubs we assumed that appointment slots would be given on the hour, every hour. For GP clinics we assumed that appointment slots would be provided in ten-minute intervals. The number of appointments issued per appointment slot for the low, medium and high-capacity scenarios are summarised in Table 2. The number of available appointments was calibrated such that queue performance metrics for our baseline models were within reasonable limits and stable for the three staff capacity scenarios. In particular, the number of appointments was scaled so that the median processing time remained below 60 minutes, and the staff utiliation across all stations remained below 0.8. This calibration process is described in detail in the additional file.

Table 2 Assumed arrival frequency for the mass vaccination hubs and GP clinics

Stochastic arrival times were generated based on the number of appointments issued per appointment slot with the addition of some random noise, reflecting the assumption that most people arrive somewhat before their allotted time, while a smaller proportion arrive on or after their allotted time. Simulated arrival times also accounted for a small proportion of no-shows, set at 2% for both mass vaccination hubs and GP clinics.

Staffing levels

For each of the proposed queue networks we specified models with low, medium and high staffing availability, ranging from 21 to 63 healthcare staff for mass vaccination sites and from 4 to 12 healthcare staff for GP vaccination clinics (Table 3). The distribution of staff across the stations of the queue network was kept stable regardless of the total staffing capacity. For example, for the mass vaccination model there were three staff assigned to the Registration station for every one staff member assigned to the Preparation station, regardless of the assumed size of the hub. This proportionality allows us to compare hubs with different numbers of available staff because the distribution of staff across different stations is consistent.

Table 3 Assumed staff numbers by station for low, medium and high staffing availability scenarios

The implied size of the low, medium and high-capacity vaccination hubs and GP clinics is indicated by the corresponding observation area capacity and staff numbers presented above. For example, what we label a low-capacity hub has a total of 21 staff with five vaccinators and 25 seats in the waiting area. A high-capacity hub has 63 staff with fifteen vaccinators and 75 seats in the waiting area. Although the model is agnostic to the physical setting, the former would more closely reflect a local sports hall or community center while the latter would imply a larger venue with more space such as a hospital or stadium.

Queue performance

We use two metrics to quantify queue performance, processing time and staff utilisation. Processing time, measured here in minutes, is the total time from start to finish of the queue network or equivalently the total time from entrance to exit. Staff utilisation is the average proportion of staff that are serving a patient across the simulation run. An established property of queueing models is that queue performance rapidly degrades as staff utilisation exceeds 80% [49].

Simulations, software and code

The analysis was performed using R version 4.0.3 and associated packages [50, 51]. Queueing models were simulated using the queuecomputer package, which implements a computationally efficient algorithm that is up to three times faster than tradition discrete event simulation methods [48]. The number of repetitions for each simulated scenario was set to 20, which was adequate to achieve stable estimates of the two queue performance measures. The complete source code to reproduce this analysis is openly available and can be accessed at https://github.com/CBDRH/vaccineQueue.

Results

For our baseline models, the estimated median processing time at mass vaccination clinics was 52 minutes, and 95% of patients were processed within 67 minutes or less. For GP clinics, the estimated median processing time was 32 minutes, and 95% of patients were processed within 37 minutes or less (Fig. 2). Staff utilisation was kept under 80% for all stations (see Additional file 1 – Appendix B). By design, both measures of queue performance were stable across the low, medium and high staffing capacity for these baseline simulations.

Fig. 2
figure 2

Estimated processing times for (A) mass vaccination hubs and (B) GP clinics with low, medium and high staffing capacity using the baseline model specifications

The corresponding estimated daily throughput for an eight-hour clinic at a mass vaccination hub ranged from around 500 vaccinations for a low-capacity hub to 1400 vaccinations for a high-capacity hub. For GP clinics, the estimated daily throughput ranged from about 100 vaccinations a day for a low-capacity clinic to almost 300 a day for a high-capacity clinic (Fig. 3). These results show that, while holding queue performance metrics constant, the number of daily vaccinations scales linearly with increasing healthcare staff for both the mass vaccination hubs and GP vaccination clinics.

Fig. 3
figure 3

Estimated daily throughput from 20 simulations for (A) mass vaccination hubs and (B) GP clinics with low, medium and high staffing capacity using the baseline model specifications

What-if scenario analysis

In this section, we present the results of two what-if scenario analyses. Figure 4 presents the median processing time based on incrementing the arrival frequency from the levels set for the baseline models. The increment step was ten additional arrivals per hour for mass vaccination hubs and one additional arrival every 10 min for GP clinics. In both settings, increasing the number of arrivals resulted in increased processing times. The degree to which sites of different size were able to absorb increased patient numbers varied. For example, at low-capacity mass vaccination hubs (21 staff), an additional 30 arrivals per hour pushed the median processing time to almost 2 h (109 minutes, Fig. 4A), whereas high-capacity hubs (63 staff) were able to absorb this extra patient load while maintaining the median processing time to under an hour (55 minutes, Fig. 4A).

Fig. 4
figure 4

Estimated processing time with increasing arrivals by site size for (A) mass vaccination hubs and (B) GP vaccination clinics

Figure 5 presents the average processing time based on gradually decreasing the available staff for a given model. These results demonstrate that low-capacity vaccination sites with limited staff numbers are quickly affected by staff shortages, whereas large vaccination hubs with more staff can still maintain queue performance with the same number of staff shortages.

Fig. 5
figure 5

Estimated processing time with decreasing staff numbers by site size for (A) mass vaccination hubs and (B) GP vaccination clinics

Interactive web-based queue simulation applet

To accompany the analysis presented here, we have developed a free and open access interactive web-based queue simulation applet. This applet provides a graphical user interface to the mass vaccination and GP clinic queueing networks estimated with the R package queuecomputer [48]. On accessing the applet in a web browser, the results from two default models are presented. These models have been parameterised to reflect the medium-capacity baseline model presented here, i.e. the mass vaccination hub with 42 staff members and the GP clinic with eight staff members. The interactive interface allows users to adjust the appointment schedule, the arrival time and service times distributions and the available staff numbers to reflect their own situation or assumptions. Queue performance is summarised in terms of total throughput, processing times and staff utilisation. The applet can be accessed at https://cbdrh.shinyapps.io/queueSim. The underlying source code is openly available on GitHub at https://github.com/CBDRH/vaccineQueueNetworks.

Discussion

Summary and discussion of main results

We have used queueing simulation methods to model the vaccination process based on two proposed queue networks emulating delivery at a mass vaccination hub and a GP vaccination clinic. For each setting, we calibrated the number of arrivals that could be vaccinated over an eight-hour period while keeping two queue performance measures—total processing time and staff utilisation—constrained to reasonable levels. Our results provide estimates of potential daily throughput for these distinct vaccine delivery modes across a range of staffing levels. Under our assumed service times, a relatively small GP clinic could perform around 100 vaccinations over an eight-hour clinic, while a relatively large mass vaccination hub could perform around 1400 vaccinations over the same period. Put differently, one large mass vaccination hub can achieve the same throughput as 14 GP small vaccination clinics. GP capacity and feasibility of large-scale hubs may vary by country and geography. In Australia, where there is universal healthcare and thousands of GP clinics, 62% of all vaccine doses have been administered in primary care settings [52].

Our throughput estimates have reasonable face-validity. The mass vaccination hub trialled by New South Wales Health in a 2008 pandemic response field exercise administered 498 vaccines in 5 h using a mass vaccination process delivered through a local school [53]. The Sydney RPA Pfizer hub delivered between 1100 and 1400 daily vaccinations throughout its first month of operation in March 2021.

Our models suggest that daily vaccination capacity scales linearly with staffing capacity while keeping queue performance constant. However, there are several other facets of the vaccine delivery process that are likely to offer economies-of-scale. For example, given a low incidence of adverse events, a high-capacity post-vaccination area observation area could be overseen by a small number of staff members. Economies-of-scale are also likely to apply to vaccine transport, because it may be logistically more efficient and cost-effective to coordinate a single delivery to one centralised hub rather than multiple deliveries to numerous smaller clinics, especially given that the cold-chain must be rigorously maintained at all stages of vaccine transport and handling.

By testing our baseline models using two what-if scenario analyses, we have shown that mass vaccination hubs are better placed to scale up daily throughput with a fixed staff capacity while maintaining acceptable queue performance. We have also shown that mass vaccination hubs are also are more resilient to staff reductions due to absences or some staff being redirected to other urgent duties. Our queue simulation applet provides a simply interface for users to explore the interactions between arrivals, service times and staff capacity. This tool can be used to answer questions such as how many vaccinators would be needed to achieve target daily throughput or how many appointments should be issued given fixed constraints on staff availability and service times.

Policy implications

Mass vaccination hubs and GP clinics offer distinct advantages as modes of vaccine delivery. As we have shown, mass vaccination hubs are more robust to system pressures like increased arrivals and staff shortages. Smaller GP clinics are more likely to be vulnerable to concomitant, competing workplace demands, which fluctuate during the year and increase notably during the winter months. GP clinics have the advantage of existing infrastructure and existing relationships with patients. GP clinics are also highly flexible and can adapt to local circumstances and specific needs, as seen with carpark drive-through testing sites, which many practices helped set up during the COVID-19 pandemic [54].

The optimal vaccination site may vary for different population segments. Older people or clinically vulnerable patients may benefit from attending their local GP who will be familiar with their medical history. Working adults may benefit from extended hours or more flexible appointment scheduling that could be offered by a mass vaccination hub, as may younger adults—especially among marginalised populations—who are less likely to have a regular GP [55]. It may be easiest to reach university students, and younger children, through vaccination hubs set up in campuses and schools. A combination of larger mass vaccination hubs and smaller GP clinics is likely to achieve mass vaccination faster than either alone.

In practice, the capacity provided by a vaccination site needs to be scaled according to demand, which can vary considerably over time. In NSW, due to an epidemic which started at a time when vaccination rates were low, there was a surge in demand around August 2021, with waning demand as high vaccination rates were achieved. The queue network modelling approach presented here can assist policy makers to plan staffing needs to respond to fluctuating demand.

Limitations

Our queueing models assume sufficiently available vaccine doses and we have not attempted to model the process of vaccine procurement or the logistics of delivering vaccine doses to the venues where they will be administered. We have proposed two possible queue networks based on our practical experience, but many other configurations are possible. By providing open source code we hope to facilitate others to extend our approach and define their own queue networks. Our analysis does not account for essential staff who are not directly involved in the queueing process but do need to be considered when estimating staffing requirements. For example, the staff needed to oversee the observation station are not included because patients do not have to queue up to be “served” during the post-vaccination observation period. Also not included here are other essential support staff, such as supervisors, cleaners, marshals and caterers. The number and type of support staff required will vary depending on the size and setting of the vaccination hub and must also be considered when planning vaccine distribution. The assumed queue networks rely on subjective assumptions of the distribution of service times at each station. We specified service times distributions that had reasonable face-validity and produced realistic estimates of overall processing times based on our experience, however we did not have resources to formally validate the model results. This could be improved in the future through a time-use survey to empirically measure service times for each station to inform the model inputs as well as total processing time to compare against the model-estimated processing time. Our web-based queueing simulation applet allows queue performance to be explored under different sets of assumptions for service times, appointment schedules and staffing availability.

Conclusions

Stochastic queue networks can be used to simulate the vaccination process and inform vaccine rollout by exploring the interactions between arrival frequency, service times and staff numbers on queue performance. Different modes of vaccine distribution have different benefits and challenges. Mass vaccination hubs offer a higher daily throughput and are more resilient to increased arrivals and decreased staff availability, however they require larger premises and higher staffing numbers. GP clinics can perform vaccinations at a similar rate per staff member compared to mass vaccination hubs, however it may be difficult to sustain a high throughput given existing workloads. A diverse profile of vaccination sites, drawing on the benefits of both distribution modes, may help to optimise COVID-19 mass vaccination and booster delivery.

Availability of data and materials

The datasets generated and analysed during the current study are available in the CBDRH/vaccineQueue GitHub repository at https://github.com/CBDRH/vaccineQueue.

Abbreviations

COVID-19:

Coronavirus disease 2019

GP:

General Practice

NSW:

New South Wales

RPA:

Royal Prince Alfred

References

  1. Baden LR, El Sahly HM, Essink B, et al. COVE study group. Efficacy and safety of the mRNA-123 SARS-CoV-2 vaccine. N Engl J Med. 2021;384:403–16.

    Article  CAS  PubMed  Google Scholar 

  2. Thompson MG, Burgess JL, Naleway AL, et al. Interim estimates of vaccine effectiveness of BNT162b2 and mRNA-1273 COVID-19 vaccines in preventing SARS-CoV-2 infection among health care personnel, first responders, and other essential and frontline workers—eight US locations, December 2020–march 2021. MMWR Morb Mortal Wkly Rep. 2021;70(13):495–500.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  3. Bernal JL, Andrews N, Gower C, Robertson C, Stowe J, Tessier E, et al. Effectiveness of the Pfizer-BioNTech and Oxford-AstraZeneca vaccines on COVID-19 related symptoms, hospital admissions, and mortality in older adults in England: test negative case-control study. BMJ. 2021;373:n1088.

    Article  Google Scholar 

  4. Sandmann FG, Davies NG, Vassall A, et al. The potential health and economic value of SARS-CoV-2 vaccination alongside physical distancing in the UK: a transmission model-based future scenario analysis and economic evaluation. Lancet Infect Dis. 2021;21(7):962–74.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  5. MacIntyre CR, Costantino V, Trent MJ. Modelling of COVID-19 vaccination strategies and herd immunity, in scenarios of limited and full vaccine supply in NSW, Australia. Vaccine. 2021;40(17):2506–13.

  6. Hanly MJ, Churches T, Fitzgerald O, et al. The impact of re-opening the international border on COVID-19 hospitalisations in Australia: a modelling study. Med J Aust. 2022;216(1):39–42.

  7. McBryde ES, Meehan MT, Caldwell J, et al. Modelling direct and herd protection effects of vaccination against the SARS-CoV-2 Delta variant in Australia. Med J Aust. 2021;25(9):427–32.

    Article  Google Scholar 

  8. Scott N, Palmer A, Delport D, et al. Modelling the impact of relaxing COVID-19 control measures during a period of low viral transmission. Med J Aust. 2021;214:79–83.

    Article  PubMed  Google Scholar 

  9. Zachreson C, Chang SL, Cliff OM, et al. How will mass-vaccination change COVID-19 lockdown requirements in Australia? Lancet Reg Health West Pac. 2021;14:100224.

    Article  PubMed  PubMed Central  Google Scholar 

  10. Hyde Z, Parslow J, Grafton RQ, et al. What vaccination coverage is required before public health measures can be relaxed in Australia? [preprint]; version: 31 Aug 2021. OSF, 2021. https://osf.io/gs7zn (viewed Feb 2022).

  11. Yeh TY, Contreras GP. Full vaccination suppresses SARS-CoV-2 delta variant mutation frequency. MedRxiv. 2021. https://doi.org/10.1101/2021.08.08.21261768 viewed Feb 2020.

  12. Eaton L. Covid-19: WHO warns against “vaccine nationalism” or face further virus mutations. BMJ. 2021;372:n292.

    Article  PubMed  Google Scholar 

  13. Mathieu E, Ritchie H, Ortiz-Ospina E, et al. A global database of COVID-19 vaccinations. Nat Hum Behav. 2021;5:947–53.

    Article  PubMed  Google Scholar 

  14. Bar-On YM, Goldberg Y, Mandel M, et al. Protection of BNT162b2 vaccine booster against COVID-19 in Israel. NEJM. 2021;385(15):1393–400.

    Article  CAS  PubMed  Google Scholar 

  15. Mahase E. Covid-19 booster vaccines: what we know and who’s doing what. BMJ. 2021;374:n2082.

    Article  PubMed  Google Scholar 

  16. Krause PR, Fleming TR, Peto R, et al. Considerations in boosting COVID-19 vaccine immune response. Lancet. 2021;398(10308):1377–80.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  17. Baraniuk C. COVID-19: how the UK vaccine rollout delivered success, so far. BMJ. 2021;372:n421.

    Article  PubMed  Google Scholar 

  18. Goralnick E, Kaufmann C, Gawande AA. Mass-vaccination sites—an essential innovation to curb the COVID-19 pandemic. N Engl J Med. 2021;384(18):e67.

    Article  CAS  PubMed  Google Scholar 

  19. Smith IM, Smith DT. Mass production methods for mass vaccination: improving flow and operational performance in a COVID-19 mass vaccination centre using lean. BMJ Open Qual. 2021;10(3):e001525.

    Article  PubMed  PubMed Central  Google Scholar 

  20. Papini F, Grassi N, Guglielmi G, et al. Covid-19 vaccine management (Comirnaty and MRNA-1273 Moderna) in a teaching hospital in Italy: a short report on the vaccination campaign. Environ Health Prev Med. 2021;26(1):1–4.

    Article  CAS  Google Scholar 

  21. Casadonte TA, Dhanorker AS, Elsen SJ, et al. Incorporating health systems engineering into COVID-19 vaccine planning and administration. Manag Healthc. 2021;6(1):6–20.

    Google Scholar 

  22. Asgary A, Najafabadi MM, Karsseboom R, et al. A drive-through simulation tool for mass vaccination during COVID-19 pandemic. Healthcare. 2020;8(4):469.

    Article  PubMed Central  Google Scholar 

  23. Wood RM, Murch BJ, Moss SJ, et al. Operational research for the safe and effective design of COVID-19 mass vaccination centres. Vaccine. 2021;39(27):3537–40.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  24. Wood RM, Moss SJ, Murch BJ, et al. Improving COVID-19 vaccination centre operation through computer modelling and simulation. medRxiv. 2021. https://doi.org/10.1101/2021.03.24.21253517 Viewed Jun 2022.

  25. Fetter RB, Mills RE. HOSPSIM: a simulation modeling language for health care systems. Simulation. 1975;24(3):73–80.

    Article  Google Scholar 

  26. Woodside CM, Hunt RE. Medical facilities planning using general queueing network analysis. IEEE Tran Syst Man Cybernet. 1977;7(11):793–9.

    Article  Google Scholar 

  27. Hershey JC, Weiss EN, Cohen MA. A stochastic service network model with application to hospital facilities. Oper Res. 1981;29(1):1–22.

    Article  CAS  PubMed  Google Scholar 

  28. Albin SL, Barrett J, Ito D, et al. A queueing network analysis of a health center. Queueing Syst. 1990;7(1):51–61.

    Article  Google Scholar 

  29. Pierskalla WP, Brailer DJ. Applications of operations research in health care delivery. Handbooks Oper Res Manag Sci. 1994;1(6):469–505.

    Article  Google Scholar 

  30. Salleh S, Thokala P, Brennan A, et al. Simulation modelling in healthcare: an umbrella review of systematic literature reviews. PharmacoEconomics. 2017;35(9):937–49.

    Article  PubMed  Google Scholar 

  31. Takagi H, Kanai Y, Misue K. Queueing network model for obstetric patient flow in a hospital. Health Care Manag Sci. 2017;20(3):433–51.

    Article  PubMed  Google Scholar 

  32. Vieira B, Hans EW, van Vliet-Vroegindeweij C, et al. Operations research for resource planning and-use in radiotherapy: a literature review. BMC Med Inform Decis Mak. 2016;16(1):1–11.

    Article  Google Scholar 

  33. Guerriero F, Guido R. Operational research in the management of the operating theatre: a survey. Health Care Manag Sci. 2011;14(1):89–114.

    Article  PubMed  Google Scholar 

  34. M’Hallah R, Al-Roomi AH. The planning and scheduling of operating rooms: a simulation approach. Comput Ind Eng. 2014;78:235–48.

    Article  Google Scholar 

  35. Soh KW, Walker C, O’Sullivan M. A literature review on validated simulations of the surgical services. J Med Sys. 2017;41(4):1–11.

    Article  Google Scholar 

  36. Mohiuddin S, Busby J, Savović J, et al. Patient flow within UK emergency departments: a systematic review of the use of computer simulation modelling methods. BMJ Open. 2017;7(5):e015007.

    Article  PubMed  PubMed Central  Google Scholar 

  37. Gul M, Guneri AF. A comprehensive review of emergency department simulation applications for normal and disaster conditions. Comput Ind Eng. 2015;83:327–44.

    Article  Google Scholar 

  38. Elalouf A, Wachtel G. Queueing problems in emergency departments: a review of practical approaches and research methodologies. Oper Res Forum. 2022;3(1):1–46.

    Article  Google Scholar 

  39. Palmer R, Fulop NJ, Utley M. A systematic literature review of operational research methods for modelling patient flow and outcomes within community healthcare and other settings. Health Syst. 2018;7(1):29–50.

    Article  Google Scholar 

  40. Beliën J, Forcé H. Supply chain management of blood products: a literature review. Eur J Op Res. 2012;217(1):1–6.

    Article  Google Scholar 

  41. Rico F, Salari E, Centeno G. Emergency departments nurse allocation to face a pandemic influenza outbreak. In: Proceedings of the 2007 Winter Simulation Conference; 2007. p. 1292–8.

    Chapter  Google Scholar 

  42. van de Kracht T, Heragu SS. Lessons from modeling and running the world’s largest drive-through mass vaccination clinic. INFORMS J Appl Anal. 2021;51(2):91–105.

    Article  Google Scholar 

  43. Gowda NR, Khare A, Vikas H, et al. More from less: study on increasing throughput of COVID-19 screening and testing facility at an apex tertiary care hospital in New Delhi using discrete-event simulation software. Digit Health. 2021;7:1–8.

    Google Scholar 

  44. Asgary, A.; Najafabadi, M.M. Drive through mass vaccination sim for COVID-19. Available online: https://cloud.anylogic.com/model/583c2075-6a8b-41be-8a03-d692eba71683?mode=SETTINGS (Viewed Jun 2022).

  45. The Health Foundation. Developing a versatile tool for modelling pathway capacity in NHS organisations. https://www.health.org.uk/improvementprojects/ (Viewed Jun 2022).

  46. NHS BNSSG CCG Modelling and Analytics. PathSimR model code repository. https://github.com/nhs-bnssg-analytics/PathSimR (Viewed Jun 2022).

  47. Bhat UN. An introduction to queueing theory: modeling and analysis in applications. Boston: Birkhäuser; 2015.

    Book  Google Scholar 

  48. Ebert A, Wu P, Mengersen K, et al. Computationally efficient simulation of queues: the R package queuecomputer. J Stat Softw. 2020;95(5):1–29.

    Article  Google Scholar 

  49. Little JD. A proof for the queuing formula: L= λ w. Oper Res. 1961;9(3):383–7.

    Article  Google Scholar 

  50. R Core Team. R: A language and environment for statistical computing. R Foundation for statistical Computing; 2020. https://www.R-project.org/

    Google Scholar 

  51. Wickham H, Averick M, Bryan J, et al. Welcome to the Tidyverse. J Open Source Softw. 2019;4(43):1686.

    Article  Google Scholar 

  52. Australian Government. COVID-19 Vaccine Roll-out. 2022. https://www.health.gov.au/sites/default/files/documents/2022/06/covid-19-vaccine-rollout-update-22-june-2022.pdf (viewed Jun 2022).

    Google Scholar 

  53. Carr C, Durrheim D, Eastwood K, et al. Australia’s first pandemic influenza mass vaccination clinic exercise: hunter New England area health service, NSW, Australia. Aust J Emerg Manag. 2011;26(1):47–53.

    Google Scholar 

  54. Tanne JH, Hayasaki E, Zastrow M, et al. Covid-19: how doctors and healthcare systems are tackling coronavirus worldwide. BMJ. 2020;368:m1090.

    Article  PubMed  Google Scholar 

  55. Kang M, Robards F, Luscombe G, et al. The relationship between having a regular general practitioner (GP) and the experience of healthcare barriers: a cross-sectional study among young people in NSW, Australia, with oversampling from marginalised groups. BMC Fam Pract. 2020;21(220):1–9.

    Google Scholar 

Download references

Acknowledgements

Not Applicable.

Funding

This research was supported by the generous assistance of Ian Sharp, philanthropic supporter of UNSW research, and by a research seed grant provided by the Sydney Partnership for Health, Education, Research and Enterprise (SPHERE) Infectious diseases, Immunity and Inflammation (Triple-I) Clinical Academic Group. The funders had no role in the design of the study, the collection, analysis or interpretation of the data, or in writing the manuscript.

Author information

Authors and Affiliations

Authors

Contributions

MH, TC and LJ conceived the study; MH, OF and TC wrote the R code; MH drafted the manuscript; all authors reviewed and edited the manuscript. The author(s) read and approved the final manuscript.

Author’s information

IC is the Medical Lead at the Royal Prince Alfred Hospital COVID Vaccination Clinic, Sydney Local Health District, Sydney.

Corresponding author

Correspondence to Mark Hanly.

Ethics declarations

Ethics approval and consent to participate

Not applicable.

Consent for publication

Not applicable.

Competing interests

CRM has consulted for or been on advisory boards on COVID-19 vaccines for Seqirus, Janssen and Astrazeneca. No other authors have a competing interest to declare.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Hanly, M., Churches, T., Fitzgerald, O. et al. Modelling vaccination capacity at mass vaccination hubs and general practice clinics: a simulation study. BMC Health Serv Res 22, 1059 (2022). https://doi.org/10.1186/s12913-022-08447-8

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12913-022-08447-8

Keywords