- Open Access
Primary care virtual resource use prior and post COVID-19 pandemic onset
BMC Health Services Research volume 22, Article number: 1370 (2022)
The COVID-19 pandemic has been a catalyst for rapid uptake of virtual care through the use of virtual health resources (VHR). In the Department of Veterans Affairs (VA) Healthcare System, virtual care has been critical to maintaining healthcare access for patients during COVID-19. In the current study we describe primary care patient aligned care team (PACT) VHR use patterns within one VA medical center (i.e., hospital facility and five community-based outpatient clinics) pre- and post-COVID-19 onset.
VHR provider and patient use data from 106 individual PACTs were extracted monthly between September 2019 to September 2020. Data were extracted from VHA web-based project application and tracking databases. Using longitudinal data, mixed effect models were used to compare pre- and post-COVID onset slopes.
Findings highlight an increase in patient users of secure messaging (SM) and telehealth. The rate of utilization among these patients increased for SM but not for telehealth visits or online prescription refill (RxRefill) use. Finally, VetLink Kiosk check ins that are done at in person visits, diminished abruptly after COVID-19 onset.
These data provide a baseline of VHR use at the PACT level after the initial impact of the COVID-19 pandemic and can inform healthcare delivery changes within the VA systems over time. Moreover, this project produced a data extraction blueprint, that is the first of its kind to track VA VHR use leveraging secondary data sources.
What is already known on this topic?
VA has integrated a variety of VHR into daily practice.
Utilization of virtual health care resource uptake in VHA has varied over time, and efforts are needed to optimize uptake.
What this study adds?
The first VA study to evaluate trajectories of utilization of VHR changes pre-post COVID 19 onset.
VHA uptake increased, however rate of utilization among users largely has not changed, and efforts to optimize proactive integrated use are still needed.
Data extraction blueprint is shared for use to support monitoring virtual healthcare resource use over time.
The COVID-19 pandemic has been a catalyst for rapid uptake of virtual care, requiring virtual healthcare resources (VHR) (e.g., secure messaging, mobile health applications, telehealth) to provide safe, timely, and remotely accessible healthcare [1, 2]. In the Department of Veterans Affairs (VA) Healthcare System, virtual care has been critical to maintaining healthcare access for patients during COVID-19 . The VA is a leader in development of integrated VHR , however, the majority of outpatient primary and specialty care continued to be in-person through February 2020 . Furthermore, the emergence of the VA’s priorities in providing connected care, has pushed proactive integrated VHR use into the forefront. Proactive integrated VHR use is defined as a self-initiated approach to coordinated use of applicable VHR.
systems for the purposes of coordinating and delivering timely high-quality patient-centered care. We contend the proactive integrated use of VHR will maximize the capacity for using VHR to efficiently deliver remote, yet accessible healthcare.
In the VA, the patient-aligned care team (PACT) initiative was implemented between 2010 and 2014 to achieve team-based primary care, improve access, and provide comprehensive care management for more than 8 million veterans’ primary care needs . The PACT model delivers primary care through a team of professionals, typically comprised of a physician, nurse, and other clinical and clerical associates, referred to as a PACT teamlet. PACT providers most often used the telephone to communicate with their patients compared to other VHR (i.e., secure messaging, mobile health applications, and telehealth). The various VHR made available by the VA allow patients to meet with their PACT, upload their health data for review, co-develop treatment plans, and refill prescriptions, without having to be present in the same location as their PACT. PACT health care services have extended beyond in-person delivery since its inception . However, adoption and use of VHR such as telehealth has been slow, with far fewer patient visits conducted through telehealth than in person in early 2020 [3, 7, 8].
The VA Office of the Inspector General conducted a review of facility leaders’ assessments of healthcare operations affected by COVID-19 from March 11 through June 15, 2020. Facility leaders reported increases in use of VHR from pre-pandemic levels, such as telephone, VA Video Connect, or FaceTime, to provide care . Leveraging existing infrastructure and prior planning, rapid increases in telehealth use occurred after the onset of COVID-19 . While increases in VHR use within the VA have occurred due to public health restrictions implemented during the pandemic [3, 10], it is not clear exactly how use of VHR by PACTs has changed. We expect that recent changes would positively impact VHR use patterns; however, it is not clear that increased use has resulted in proactive integrated VHR use. The purpose of this study was to describe PACT VHR use patterns within one VA medical center (i.e., hospital facility and five community-based outpatient clinics) pre- and post-COVID-19 onset.
Methods and measures
This is a within-subjects study that examines changes in VHR use pre- and post-COVID-19 pandemic onset; that is, when mandatory restrictions on healthcare delivery were enacted, This study was conducted at a VA medical center in the southeastern part of the United States.
VHR use data from 106 individual PACTs were extracted monthly between September 2019 (baseline) and September 2020 (See Table 1). These timepoints correspond with 6 months prior to and 6 months after the onset of COVID-19-associated mandatory healthcare delivery changes. The 106 PACTs were selected based on their availability during the duration of this study, and does not reflect the current number of PACTs, or the total number of PACTs that were active at any given single timepoint. See Table 1 for a description of the PACT teamlets.
Assessed virtual resources
VA virtual care resources were made available through several online and telephonic tools. Specifically, Secure Messaging (SM) and Prescription Refills (Rx refills) were made available through a portal known as MyHealtheVet (MHV). The home telehealth platform enabled video care delivery. VetLink kiosks allowed no-person contact check-ins for in-person care delivery. Finally, telephonic encounters allowed patients to connect with their PACTs.
VHR use variables
Use was captured in three distinct ways: 1) percent unique users of any given tool detailed below relative to the patient pool size of the PACT, referred to as the panel size (presented as % of panel); 2) percent encounters or messages per panel size at the PACT level (presented as % of panel); 3) rate of encounters/messages per number of unique users of any given tool (presented as number of encounters/messages:1 patient).
MyHealtheVet Rx refills
The MHV portal allows patients to access a virtual pharmacy to reorder their prescriptions. This electronic tool is available to all patients who have a prescription written by a VA doctor that has been filled at a VA pharmacy. The MyHealtheVet online features allows for tracking of patients’ past and current prescriptions, and electronic notification of shipping of prescriptions to the patients’ homes. Assessment of this construct was performed using count data of the number Rx Refills completed at the PACT level.
MyHealtheVet secure messaging (SM)
The MHV portal allows patients to access this virtual messaging tool to communicate with their PACT. SM is available to all patients who registered, authenticated, and opted into SM. For the purpose of this study, we captured the percentage of each PACT panel at each of these steps. SM use was captured by incoming (patient initiated) and outgoing (provider initiated) secure messaging relative to panel size, as well as by number of patients in each PACT that opted in.
Home telehealth use
The VA Telehealth technology is a suite of technologies that allow you to meet with your care team, upload your health data for review, and develop treatment plans virtually. Telehealth technology also can be used to receive treatment and undergo exams with specialists outside of the providers in a patient’s PACT. Assessment of this construct was performed through count data of the number of telehealth visits performed at the PACT level and the number of unique patients in each PACT that utilized telehealth services.
VetLink kiosk use
The VetLink Kiosks are self-serve, touchscreen technological equipment that are available for use at the VA medical facility. Kiosks allow patients to electronically check-in to their appointments, review and update their personal information, and request medical records to be sent by mail. Assessment of this construct was performed through count data of the number of kiosk and clerk check-ins that were performed at the PACT level.
Telephone calls, in the form of healthcare interactions between providers and patients, represent a traditional method of VHR. Assessment of this construct was performed through both the number of PACT-level telephone visits and the number of unique patients at the PACT-level that engaged telephone visits.
Data were obtained from the VHA Support Service Center Capital Assets web-based project application and tracking database used for workflow and operations at the PACT level. Weekly, monthly, and annual reports provide timepoint screenshots. As approval to use SM fluctuates over time, the report generated closest to the first date of the month was used to calculate the month’s statistics. Panel size was captured from the same report. Telephone and telehealth visits, VetLink kiosk and clerk check-ins, and prescription refills were totaled for an entire month to calculate the month’s statistics. For details of data sources see data extraction blueprint in Additional file 1: Appendix 1.
We checked data distribution for our outcome variables for normal distribution. Square root transformations were applied to the following variables to correct for skewness: VetLink Kiosk check-ins and Clerk check-ins. We used a piece-wise random effect model that included separate pre- and post-intervention slopes with an assumed effect size of 0.5 standard deviations from the mean [11, 12]. A sample size of 106 PACTs, given a type 1 error rate of 0.01, after Bonferroni adjustment, gave greater than 80% power for our analysis. We used the rate of use for each virtual resource as our outcome variable. Data across PACTs were standardized by their panel size (i.e., number of patients assigned to a PACT). We analyzed data from 13 monthly time points for each virtual resource, from September 2019 through September 2020, to capture VHR use 6 months prior to and 6 months after the onset of mandatory COVID-19-associated changes to healthcare delivery at the VA (i.e., March 2020).
A piece-wise random effect model was used to test change in VHR use across time as outlined in the following steps: 1) first, a time spline was computed for the timepoint that corresponds with use during March 2020. A mixed effects model tested the effect of time (13 time points) and the effect of the time spline on VHR use; we expected that the slopes before and after COVID-19 onset would be different. Models were tested and presented for the three use measures: overall rate of use across time, rate of use within PACTs, and rate of use among registered users. Models were re-run controlling for location and panel size. Tables indicated below show findings for models without these control variables given that findings did not change with the inclusion of location and panel size. The intercept represents the mean level of each of the outcomes at baseline. Estimates presented in tables are unstandardized coefficients representing the slope of change in our outcomes over time. We present two slopes: pre-COVID-19 onset slope and the difference between pre- to post- COVID-19 onset slopes, which is our main measure of change. All model parameters were estimated using restricted maximum likelihood. All results were evaluated using alpha of .05.
During our study period (September 2019 – September 2020), we included 106 PACTs at the VA medical facility and affiliate sites; PACT panel sizes varied across teams and locations (see Table 1).
Rate of virtual resource users pre and post COVID-19 onset
First, we evaluated percentage of PACTs that used the identified virtual resources. We found that over the study period, on average, 66% of PACT patients were registered for SM, 49% were authenticated, and 22% opted in to use SM. Rx refills were used by 15% of PACT patients, and 10% of PACT patients utilized telehealth to communicate with their health care providers However, findings indicate that percentages of users varied across time: a comparison of the slope of rate of users before and after COVID-19 onset showed that the rate of registration increased, while the rate of authentication slightly decreased, and the rate of opting into SM remained stable. Similarly, rates of telehealth users increased after COVID-19 onset relative to the prior 6 months, while rates of Rx Refill users remained stable across time. See Table 2 and Fig. 1 a.
Rate of VHR use pre and post COVID-19 pandemic onset within PACTs
Next, we investigated rate of actual use at the panel level. Specifically, we evaluated the rates of inbound and outbound SM, number of telephone and telehealth visits, and Rx Refill requests. We found that the rate of inbound and outbound SM and telephone and telehealth visits increased, while Rx Refill requests remained stable after COVID-19 onset relative to the prior 6 months. See Table 3 and Fig. 1 b.
Rate of VHR use pre and post COVID-19 onset among users
Finally, we looked at rate of use among users only. The baseline rate of inbound SMs was .65 per 1 patient who had opted in (.65:1), and the baseline rate of outbound SMs was .49:1 (see Table 4). The baseline rate of telehealth visits among users was at 1.07:1 and Rx Refill requests among users was 4.73:1. With the exception of telehealth visits, both incoming and outgoing SM rates increased from the pre to post pandemic onset; while RxRefill requests among users showed a slight pre-post decrease for the same time period (See Table 4 and Fig. 1 c).
Aggregate counts of VetLink kiosk and clerk check-ins pre and post COVID-19 onset
VetLink Kiosk use was collected as an indicator of in-person care use in PACTs. Clinic check-ins both at VetLink Kiosk (Estimate = −.53, Standard Error (SE) = .02, t-value = − 26.24, p-value < .001, 95% Confidence Interval (CI) = −.57, −.49) and by clerk (Estimate = −.60, SE = .03, t-value = − 20.52, p-value < .001, 95% CI = −.66, −.55) abruptly diminished after COVID-19 onset relative to the prior 6 months. See Fig. 1 d.
Since the development of VHR in the healthcare setting, implementation efforts have focused on increasing the use of VHR to increase access through remote delivery of care. Understanding the impact of the COVID-19 pandemic on VHR use can inform opportunities for using VHR to deliver care remotely. In this study we described changes in primary care delivery via VHR pre- to post- COVID-19 onset at one VA medical center. We obtained monthly VHR use rates among PACTs using secondary data extracted for the period between September 2019 and September 2020. These data provide a baseline of VHR use at the PACT level after the initial impact of the COVID-19 pandemic and can inform healthcare delivery changes within the VA systems over time. Moreover, this project produced a data extraction blueprint, that is the first of its kind to track VA VHR use leveraging secondary data sources.
While SM registration rates increased from the pre- to post-COVID-19 onset period, authentication of users decreased, and opting into SM remained stable. This suggests that while more patients had ability to access this resource, these patients were not actively electing to use SM to communicate with their PACTs. Active use of SM, in both the number of inbound and outbound messages, however, increased over time. This was true both when evaluating SM communication rates at the PACT teamlet level, and among just those users that opted into using SM. This suggests that although there was not an increase in new SM users, existing users increased their communication with their providers via this tool during the study time period. The use of technology to communicate with providers during the onset of the COVID-19 pandemic may have required some patients to learn new technological skills. Alpert et al. found in their study of SM usage during the COVID-19 pandemic that the highest percentages of patients communicating electronically via SM were between 45 and 64 years old . Strategies to engage and educate older patients on the use of technology like SM may be needed to facilitate their participation in this communication tool.
A different pattern was observed for telehealth. The number of telehealth users steadily increased after the onset of the COVID-19 pandemic relative to the previous 6 months, and so did the number of telehealth encounters at the PACT teamlet level. Our findings are consistent with a scoping review on the use of telehealth during the COVID-19 pandemic which found an exponential increase in telehealth use for surveillance, triage and diagnosis, treatment including e-prescriptions, and follow-up and rehabilitation . However, encounter rates among users specifically remained relatively stable. This suggests that while there was an increase in overall number of telehealth users and the overall rate of telehealth encounters at the PACT teamlet level, there was not an increase in the rate of communication among users using this tool, unlike SM users.
As the numbers of telehealth users increased, and the rates of SM use and telephonic encounters increased among users, there was an abrupt decrease in measures associated with in person care, such as VetLink Kiosk or clerk check-ins. This is consistent with the changes to healthcare delivery via telehealth and telephone encounters that were implemented on an institutional level by the VA in the face of the COVID-19 pandemic .
Use of virtual RxRefill remained either stable or decreased across the various assessed constructs. Both the number of users and refill requests remained stable over the study period, and refill request rates among users showed a decreasing slope post COVID-19 onset after an initial spike, suggesting a temporary increase when COVID-19 changes to care were initially announced. Our data findings are consistent with a retrospective analysis from Jan 2014 to November 2020 found that medications that require face-to-face visits had decreased during COVID-19 . These findings provide a possible explanation as to why there were decreased refill rates over time.
Even prior to the COVID-19 pandemic, it appears that there has been a significant interest in healthcare delivery via virtual modalities. Findings indicate that registration for SM was high both before and after the COVID-19 pandemic, with nearly three fourths of patients being already registered for SM. This interest in using virtual modalities and opting into using virtual modalities is juxtaposed against actual use rates. SM use hovered just above 20% of PACT patients throughout the study period. However, among users, use of SM, telephone visits, and Rx Refills was stable or increased through the study period.
The virtual resource that saw the largest increase in use during the pandemic was telehealth. This finding is consistent with the suspension of all in-person encounters at the onset of the COVID-19 pandemic and the resulting changes to care that were implemented at the institutional level of the VA facility as well as globally . As telehealth encounters incorporate both video and audio communication, they act as substitutes for in-person encounters. Though data indicated an increase in use among specific VHR, there is no evidence of proactive integrated use of VHR. These data present a preliminary protocol for examining the continued use, and potential emergence of proactive integrated use as providers continue to deliver remote care in a COVID-19 climate.
Study limitations should be considered when interpreting data findings. First, it should be noted this was an ongoing study when the COVID-19 pandemic occurred, as such the aim of this analysis was post-hoc in nature. Second, we evaluated changes in virtual care at one VA facility and associated community-based outpatient clinics. Locality-based characteristics, including a variety of socio-economic factors, may impact the uptake of virtual modality care in dissimilar patient populations. However, these data were not available in the extracted datasets. Third, results from some virtual modalities, VetLink Kiosk use for example, used a different PACT naming system that did not allow us to control for panel size.
Moving forward, as the VA progresses towards optimizing and proactively fully integrating virtual healthcare delivery, future research could identify implementation strategies to support use and integration, such as, address workload credit, VHR education and imbedded support for providers as they navigate VHR use challenges. Further research on barriers towards opting-into virtual modalities is needed and may include a variety of factors, such as self-efficacy with utilizing these technological tools. However, our study found that in spite of existing barriers and constraints associated with the COVID-19 pandemic, users opt into using VHR resources and demonstrated robust use. These data provide insights into virtual resource use in the context of an unprecedented pandemic. Data findings and the data extraction blueprint can be used to inform subsequent studies using a national sample or evaluating trends at rural and non-rural healthcare facilities. Future research is also required to determine if VHR use trends persist or waver post-pandemic, and if PACT members – and patients – need additional interventions to increase both uptake and proactive integrated use of virtual resources.
Availability of data and materials
The datasets during and/or analyzed during the current study available from the corresponding author on reasonable request.
Smith AC, Thomas E, Snoswell CL, et al. Telehealth for global emergencies: Implications for coronavirus disease 2019 (COVID-19). J Telemed Telecare. 2020;26(5):309–13. https://doi.org/10.1177/1357633X20916567.
Wong A, Bhyat R, Srivastava S, Lomax L, Appireddy R, Wong A, et al. Patient Care During the COVID-19 Pandemic: Use of Virtual Care. J Med Internet Res. 2021;23(1):e20621. https://doi.org/10.2196/20621.
Heyworth L, Kirsh S, Zulman D, Ferguson JM, Kizer KW. Expanding access through virtual care: The VA’s early experience with Covid-19. NEJM Catal Innov Care Deliv. 2020;1(4).
Byrne CM, Mercincavage LM, Pan EC, Vincent AG, Johnston DS, Middleton B. The value from investments in health information technology at the US Department of veterans affairs. Health Aff (Millwood). 2010;29(4):629–38.
LaVela SL, Hill JN. Re-designing primary care: Implementation of patient-aligned care teams. Healthcare. 2014;2:268–74.
Rosen CS, Morland LA, Glassman LH, et al. Virtual mental health care in the veterans health Administration’s immediate response to coronavirus disease-19. Am Psychol. 2021;76(1):26.
Olayiwola JN, Magaña C, Harmon A, et al. Telehealth as a bright spot of the COVID-19 pandemic: recommendations from the virtual frontlines (“ Frontweb”). JMIR Public Health Surveill. 2020;6(2):e19045.
Robinson J, Borgo L, Fennell K, Funahashi TT. The Covid-19 Pandemic Accelerates the Transition to Virtual Care. NEJM Catal Innov Care Deliv. 2020;1(5).
VA OIG. Review of Veterans Health Administration’s COVID-19 Response and Continued Pandemic Readiness. REPORT NO. 20-03076-217; 2020. https://www.oversight.gov. Accessed 20 June 2021.
Department of Veterans Affairs. Protect Yourself from COVID-19 with VA Virtual Tools. Connected Care.va.gov. Published March 26, 2020. Accessed June 15, 2021. https://connectedcare.va.gov/whats-new/technology/protect-yourself-covid-19-va-virtual-tools
Liu G, Liang KY. Sample size calculations for studies with correlated observations. Biometrics. 1997;53(3):937–47.
Diggle P, Heagerty P, Liang K, Zeger S. Analysis of longitudinal data. Oxford: Oxford university press; 2002.
Alpert JM, Campbell-Salome G, Gao C, et al. Secure messaging and COVID-19: A content analysis of patient–clinician communication during the pandemic. Telemed E-Health. 2022;28(7):1028–34.
Doraiswamy S, Abraham A, Mamtani R, Cheema S. Use of telehealth during the COVID-19 pandemic: scoping review. J Med Internet Res. 2020;22(12):e24087.
Cornell PY, Celardo C, Chmelka G, et al. Social work and telehealth: how patient aligned care team (PACT) social workers in the veterans health administration responded to COVID-19. Soc Work Health Care. 2021;60(2):131–45.
Frazer JS, Frazer GR. Analysis of primary care prescription trends in England during the COVID-19 pandemic compared against a predictive model. Fam Med Community Health. 2021;9(3).
Whitelaw S, Mamas MA, Topol E, Van Spall HG. Applications of digital technology in COVID-19 pandemic planning and response. Lancet Digit Health. 2020;2(8):e435–40.
This study was also supported in part by the Center of Innovation for Disability and Rehabilitation Research at the James A. Haley Veterans Hospital. The views expressed in this article are those of the authors and do not necessarily represent the views of the Department of Veterans Affairs. The authors would like to express a special thank you to the PACT teams at James A. Haley Veterans Hospital for their interest and support. The corresponding author, as a US government employee, has the right to grant on behalf of all authors and does grant on behalf of all authors, a nonexclusive worldwide license to the publishers and its licensees in perpetuity, in all forms, formats, and media (whether known now or created in the future) to (1) publish, reproduce, distribute, display, and store the contribution, (2) translate the contribution into other languages, create adaptations, reprints, include within collections and create summaries, extracts and/or, abstracts of the contribution, (3) create any other derivative work(s) based on the contribution, (4) to exploit all subsidiary rights in the contribution, (5) the inclusion of electronic links from the contribution to third-party material wherever it may be located, and (6) licensee any third party to do any or all of the above. The authors read and approved the final manuscript.
The study was supported by the Department of Veterans Affairs, Veterans Health Administration, Office of Research and Development, Health Services Research and Development Service, (IIR 15–443 - Virtual Medical Modality Implementation Strategies for Patient Aligned Care Teams to Promote Veteran Centered Care) award number I01 HX002010.
Ethics approval and consent to participate
The study was performed in accordance with the Declaration of Helsinki ethical principles for medical research involving human subjects. This study was approved by the University of South Florida Institutional Review Board (Pro00028519). Informed consent to participate was obtained from all participants.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Haun, J.N., Panaite, V., Cotner, B.A. et al. Primary care virtual resource use prior and post COVID-19 pandemic onset. BMC Health Serv Res 22, 1370 (2022). https://doi.org/10.1186/s12913-022-08790-w
- Virtual care
- Primary care
- Data extraction