Concordance between 8-1-1 HealthLink BC Emergency iDoctor-in-assistance (HEiDi) virtual physician advice and subsequent health service utilization for callers to a nurse-managed provincial health information telephone service
BMC Health Services Research volume 23, Article number: 1031 (2023)
British Columbia 8–1-1 callers who are advised by a nurse to seek urgent medical care can be referred to virtual physicians (VPs) for supplemental assessment and advice. Prior research indicates callers’ subsequent health service use may diverge from VP advice. We sought to 1) estimate concordance between VP advice and subsequent health service use, and 2) identify factors associated with concordance to understand potential drivers of discordant cases.
We linked relevant provincial administrative databases to obtain inpatient, outpatient, and emergency service use by callers. We developed operational definitions of concordance collaboratively with researcher, patient, VP, and management perspectives. We used Kaplan–Meier curves to describe health service use post-VP consultation and Cox regression to estimate the association of caller factors (rurality, demography, attachment to primary care) and call factors (reason, triage level, time of day) with concordance as hazard ratios.
We analyzed 17,188 calls from November 16, 2020 to April 30, 2021. Callers advised to attend an emergency department (ED) immediately were the most concordant (73%) while concordance was lowest for those advised to seek Family Physician (FP) care either immediately (41%) or within 7 days (47%). Callers unattached to FPs were less likely to schedule an FP visit (hazard ratio = 0.76 [95%CI: 0.68–0.85]). Rural callers were less likely to attend an ED within 48 h when advised to go immediately (0.53 [95%CI:0.46–0.61]) compared to urban callers. Rural callers advised to see an FP, either immediately (1.28 [95%CI:1.01–1.62]) or within 7 days (1.23 [95%CI: 1.11–1.37]), were more likely to do so than urban callers.
Concordance between VP advice and subsequent caller health service use varies substantially by category of advice and caller rurality. Concordance with advice to “Go to ED” is high overall but to access primary care is below 50%, suggesting potential issues with timely access to FP care. Future research from a patient/caller centered perspective may reveal additional barriers and facilitators to concordance.
Many Canadian provinces have publicly funded, nurse-managed telephone services to support citizens with urgent health concerns. These services provide information on management and on whether, when, and where to seek appropriate care [1,2,3,4,5]. In British Columbia (BC), the nurse-managed telephone service involves an 8–1-1 phone line overseen by HealthLink BC (HLBC). The COVID-19 pandemic greatly increased both the volume and complexity of calls to 8–1-1, with many callers seeking to avoid the potential infection risk associated with in-person healthcare visits. This prompted HLBC to add a virtual physician (VP) consultation service, called HLBC Emergency iDoctors in-assistance (HEiDi) . Through the HEiDi service, callers identified by 8–1-1 nurses as requiring medical attention immediately or as soon as feasible can be referred for supplemental virtual assessment by telephone or video by off-site emergency physicians, with the potential to safely divert some callers away from emergency departments (EDs).
Nurse-led telephone triage and advice
Existing research suggests that concordance between advice given on nurse-managed telephone triage services and subsequent health service use ranges between 62 and 75%, [7, 8] with concordance with advice to see a family physician (FP) being particularly low . A 2010 study of a nurse-led 8–1-1 line in Calgary, Alberta, found high “follow-through” for individuals advised to monitor symptoms at home, but relatively low “follow-through” on advice to seek care in an ED immediately (52.3%) or to seek care in the community within 24-h (43.2%) . “Follow-through” also varied significantly by health concern . A systematic review by Veteran’s Affairs found little evidence that nurse-led remote triage reduced downstream service use . However, a more recent study found that patients who undergo initial remote triage using a validated algorithm are less likely to be given a low urgency triage when presenting to an ED , suggesting improvement in service provision.
The context of ED and FP care and potential drivers of concordance
When examining concordance, it is important to consider trends documented in the literature around the use of health services. Of particular interest are patterns around the “appropriate” use of emergency care among subpopulations we may see reflected in BC. Lower levels of education have been positively associated with likelihood of both high and low acuity visits, with income showing a similar pattern . Persons with a regular medical doctor have been found to be less likely to attend EDs . Those living in a rural area have been found to be more likely to do so, and but less likely to present with high acuity . Finally, a 2021 study found that patients living in areas with high scores for “deprivation” (Area Deprivation Index or ADI) or “stress” (neighborhood stress score or NSS) have a higher frequency of ED utilization .
A key concern for triage is that the ED often serves as a “safety net” for patients who lack access to appropriate primary care . Lavergne et al.’s 2022 analysis of primary care service use and neighbourhood income in BC also found evidence of inequity in access to care . From 1999/2000 through 2017/18, the number of primary care encounters declined in both urban and rural settings while ED visits increased . This raises concerns for equity generally, but particularly for Indigenous patients, as those living in urban areas were found to have less access to primary care and consistently higher “preventable hospital admissions”, with an age-standardized mortality rate 2–5 times higher compared to other residents that authors felt was likely attributable to “gaps in access to primary care services.” .
Physician assistance in telephone triage and advice
Research on the impact of the addition of VP consultation to nurse-managed telephone triage is extremely limited as few jurisdictions offer this service. Li et al. have published an evaluation of a similar program for veterans in the US which compares the clinical outcomes of telephone triage utilizing emergency physicians in addition to nurses versus nurses alone. However, the focus of this program was to better direct patients to in-network emergency departments rather than identify the most appropriate modality of care, precluding direct comparison to HEiDi . In a previously published description and process evaluation of the HEiDi service, VPs advised 72.1% of urgently triaged callers away from visiting EDs or urgent care clinics within 24 h, while advising 15.0% of callers whose concerns were deemed less urgent by the nurse to attend an ED immediately . Concordance between the VP’s recommendations and subsequent health service use has not been explored. Examining concordance with advice is an important step in understanding both the potential value of including VPs in nurse-led telephone services, and what shapes patients’ abilities and decisions to seek recommended follow-up care.
This exploratory, hypothesis-generating analysis uses population-based administrative data to examine concordance between virtual physician advice and subsequent health services use.
We sought to 1) estimate concordance between VP advice and subsequent health service use, and 2) identify factors associated with concordance to understand potential drivers of discordant cases.
We conducted a retrospective, time-to-event (survival) analysis of routinely collected administrative health data. This study was approved by the University of British Columbia’s Clinical Research Ethics Board (H21-02209).
The study was conducted in British Columbia, Canada. As of April 2021, BC had approximately 5.2 million residents  distributed across five health administration regions (locally referred to as “health authorities” or HAs)  with a total of 120 hospitals  and 103 emergency departments .
Data sources, linkage, and variables
We used BC Ministry of Health’s Health Data Platform BC (HDPBC) to access anonymized, linked administrative health data in a secure environment. Linkage between datasets was conducted using anonymized Personal Health Numbers (PHN).
HealthLink BC provided access to their 8–1-1 dataset to identify HEiDi callers during the study period. 8–1-1 data also included the level of nurse triage (“red-MD” or “yellow” indicating high and moderate urgency, respectively), health concern associated with call (e.g., “cardiovascular”, “pediatric”, “pharmaceutical (medications)”), time of call, and VP category of advice given (“disposition” – e.g. “Go To ED Now”). To mitigate potential confounding of concordance from multiple calls for the same or new issues, only the first call from each caller in a two-week period was used for this analysis. We used “cardiovascular” as the reference health concern for VP advice as this is widely understood as an urgent concern by both clinicians and the lay public. The most urban HA in BC, Vancouver Coastal, was used as the baseline for regional comparison. Finally, the 21–40 year-old age category was the most frequent and so used as the reference for comparisons across age.
We used the Discharge Abstract Database (DAD)  and National Ambulatory Care Reporting System (NACRS)  datasets to identify inpatient hospitalizations and ED visits up to seven days after the HEiDi call, and Medical Services Plan (MSP) billing information  to track use of outpatient services, particularly FP visits in the community for that same period. Both in-patient and remote (virtual/telehealth) services were tracked in MSP billings. This dataset also included a measure of “FP attachment”, based on a Ministry of Health algorithm that estimates whether a person has a consistent FP . For the purposes of this analysis FP refers to practitioners identified by a speciality code of “00″, “Family Medicine”, for purposes of MSP billing . Finally, demographic information (age, sex, rurality as per Statistics Canada’s definitions , and socioeconomics (SES) status via the "Canadian Index of Multiple Deprivation”  on callers was linked to the above using the “Client Roster” , and mortality was tracked by linking callers’ to Vital Events Deaths database .
The NACRS dataset, only includes data for approximately 29 EDs, typically at larger, urban hospitals constituting 70% of BC ED visits . We therefore supplemented these data with billings from the MSP and DAD databases, following a previously described algorithm to improve ED visit ascertainment .
HEiDi virtual physician advice and 8–1-1 “Disposition codes”:
We used consensus-derived operational definitions of existing HEiDi VP advice categories assigned by VPs at the end of each call, and the interpretation in Table 1 to describe the advice VPs gave to callers regarding seeking follow-up care.
We have previously reported details of the 8–1-1 and HEiDi service and call-flow . All of the “red-MD” or “yellow” callers interviewed by 8–1-1 nurses and referred for VP consultation between November 16, 2020 and April 30, 2021 – representing approximately 26% and 38% of 8–1-1 calls respectively – were included this analysis. We excluded any individuals with missing demographic data or whose PHN corresponded to a deceased individual at the time of call. We also excluded callers who received the “Other” disposition from the HEiDi physician, as this was insufficiently specific to allow assessment of concordance.
We used the following definitions of concordance, developed through consultation with HEiDi virtual physicians, health service researchers and a patient partner from the BC Emergency Medicine Network’s Patient Council. Virtual physicians strongly indicated that concordance could only reliably be assessed over a one-week (seven day) time-horizon, as over extended periods the likelihood that service use stems from issues unrelated to the reason for the index call increases (Table 2).
Concordance is considered achieved if the first service used by the caller subsequent to the call aligns with physician advice. Use of other services after this initial encounter is still considered concordant, but use of other services prior to the advised service does not. For example, for “Go to ED Now”: a caller who saw an FP or was hospitalized prior to their ED visit would not be counted as concordant. However, a caller who saw an FP and/or was hospitalized following their ED visit would be.
We conducted a time-to-event (TTE) analysis using a Cox proportional hazard model  for each HEiDi disposition. Each of the models included the same set of independent variables, described in “Data Sources, Linkage and Variables” above. This was a hypothesis-generating analysis to determine the hazard ratios for each independent variable and for each disposition (as opposed to optimizing a predictive model with fewer predictors). A TTE analysis allowed us to estimate the effect of multiple predictors over the range of hours or days for each disposition.
We used SQL Server Management Studio (version 18.5, Microsoft) to query and link records across databases. Eligible records were extracted and imported to R (version 4.1, R Core Team) for statistical analysis.
We also conducted sensitivity analysis with expanded definitions of concordance, incorporating broader health services use, for the three dispositions (Table 3).
VPs expressed concern that strictly “binary” definitions of concordance may be misleading as advice given to callers often includes conditional statements and may be layered “You should do X unless Y changes, then look into doing Z”. This means the patient-caller could be initially told to “Seek FP care now” unless a given symptom worsens, in which case “Go to ED now”. We can only observe the initial layer of advice, but this sensitivity analysis allows us to view patterns of callers’ behaviour with the allowance for conditional advice unobservable in the data.
In this exploratory analysis, we examined sensitivity analysis results for any significant, systematic difference from primary analyses.
From November 16, 2020 through April 30, 2021, the HEiDi service recorded 19,186 VP encounters with 8–1-1 callers. 1998 calls (10.4%) were excluded: 946 (4.9%) due to missing data, 24 (0.1%) corresponding to a deceased individual, 253 (1.3%) for being a repeat call within 14 days. The callers whose disposition was labeled as “Other” (n = 775, 4.0%) were also excluded, leaving 17,188 calls included in the analysis.
Caller and call characteristics
Most callers were women (64.3%) over age 21, with age 21–40 being the most frequent age group and median age of callers ranging from 35.6 to 42.1 years by disposition. Callers were disproportionately high SES as compared to the general population reported in BC census data, with 25.1% in the top quintile. Rurality varied slightly by disposition but was generally slightly higher than from provincial population estimates of ~ 13% . Approximately 84% of callers were “attached” to a FP (Table 4).
Seventeen percent of calls triaged to VPs were advised to seek immediate emergency care, 48% were advised to seek care in the community, and 36% were advised to self-manage (Table 4) Most calls were placed during daytime business hours (69.2%) on a weekday (~ 70%). These characteristics have been evaluated in previously published work .
Post-HEiDi health service utilizations
Callers assigned “Go to ED Now” were the most concordant at seven days (72.9%). Advice to “See FP now” was 49.6% and “Schedule FP Appointment” was 50.1%. Similarly, 48.9% of callers advised to “Self-Manage” did not use any additional services (Table 5). The “ED now” group was also 4 times more likely to be hospitalized than the others (8% vs 2%), suggesting high concern was justified. Specialist encounters and diagnostic testing appeared associated with the urgency of VP advice, with higher levels of concern seeing greater service use. FP visits were only slightly less frequent for “Go to ED Now” callers than FP-specific dispositions (45% vs 50%), and about 1/3 of those assigned to self manage saw an FP by week’s end (Table 5).
As with absolute values, the rate of concordance varied across the four dispositions (Fig. 1, see Additional File 1: Table S2). A key finding evident in Fig. 1 is that concordance was highest “Go to ED Now”, where 70.4% of callers were found to have an ED visit within 48 h. We note this advice appears to have been acted on quickly—over 90% (1840/2025) of the subset of concordant callers visit an ED within the first 4 h (see Additional File 1: Table S2). Concordance was lowest for those told to seek FP care now or within seven days at 41% and 47% respectively. Sixty percent of callers in the “Self-Manage” disposition did not have an identified ED visit, hospitalization, or FP encounter within seven days.
While several geographic signals emerged from this analysis, only the Northern Health Authority was significantly associated with concordance across all four dispositions (Table 6). For the “Go to ED Now” disposition, HEiDi callers from Northern were less likely (hazard ratio = 0.56 [95%CI: 0.35–0.61]) while Fraser (1.16 [1.03–1.30]) and Island (1.39 [1.21–1.59]) were more likely to be concordant as compared to Vancouver Coastal. Rurally-located callers were significantly less likely to be concordant with advice to “Go to ED Now” (0.53 [0.46–0.61]) and those advised to see a family physician either immediately (1.28 [1.01–1.62]) or soon (1.23 [1.11–1.37]) were significantly more likely to record an FP encounter within seven days than urban callers.
Callers in the “Go to the ED Now” disposition were more likely to be concordant with advice if they placed their call to 8–1-1 in the evening (1.20 [1.09–1.31]), or if their call was triaged by a nurse as “red-MD” rather than “yellow” (1.10 [1.01–1.20]). Individuals calling with an Obstetric/Postpartum health concern (0.62 [0.46 – 0.83]) or with a Gynecological concern (0.74 [0.56–0.98]) were less likely than those with a cardiovascular concern to be concordant.
Callers over 65 years old were more likely (1.48 [1.16–1.88]) to be concordant with physician advice to “Seek FP care now” compared with individuals in the 21–40 age category. Those at the second lowest level of economic deprivation (1.35 [1.06—1.70]) and second highest level (1.32 [1.03—1.69]), as compared to the least deprived, were more likely to be concordant. We observed no difference in concordance by the nature of the callers’ health concern for this disposition.
As with the “Seek FP care now” disposition, callers over 65 (1.30 [1.17–1.45]) and infants (1.19 [1.02–1.39]) advised “Schedule FP Appt” were more likely to be concordant than the 21 to40 year old reference category. Also, those with Obstetric /Postpartum (1.56 [1.23- 1.97]) or Pharmaceutical (Medication) (1.60 [1.03–2.46]) concerns were more likely to be concordant. Callers in this category without an attached FP were less likely to be concordant (0.76 [0.68–0.85]).
For the “Self-manage” disposition, there was a varying relationship with age, with children aged 2 to 5 (1.48 [1.21–1.80]) and children/adolescents 6 to 20 years old (1.49 [1.25–1.77]) more likely than the 21–40 reference category to stay home. Older adults (0.89 [0.80–0.98]) and seniors (0.73 [0.64–0.83]) were comparatively less likely to do so. Callers without an attached FP were more likely to be concordant (1.22 [1.08–1.37]), as were those whose medical concerns were in the “First Aid” category (1.43 [1.07–1.92]). In contrast, callers with health concerns in the Obstetrics/Postpartum (0.40 (0.30—0.53)], Psychology (MH) (0.53 [0.30 – 0.93]), and Respiratory (0.75 [0.59 – 0.96]) categories were less likely to be concordant. Those callers triaged to “RED” by a Nurse (vs yellow) (0.89 [0.82–0.97]), calling in the evening (vs day) (0.85 [0.79–0.93]) and at the second lowest level of economic dependency (vs lowest) (0.89 [0.80–1.0]) are also less likely.
We observed no significant difference in concordance by sex or weekends vs weekdays across any of the four dispositions (Table 6).
Sensitivity analysis results
With expanded definitions of concordance that consider broader health service utilizations, we found higher rates of concordance over 48 h and seven days for the “Go to ED Now”, “Seek FP Care Now”, and “Schedule FP Appointment” dispositions. For the latter seven-day dispositions, we found a marked increase in events during the first two days, mainly due to the inclusion of ED visits. For the “Go to ED Now” disposition, there were increases at 12 and 24 h with the inclusion of physician encounters outside of the ED. We observed some additional small changes to the significance of independent variables in some models, but no changes in the direction of observed relationships (see Additional File 1: Table S3).
Few studies have examined the impact of the inclusion of virtual physicians in a telephone triage services on subsequent health service use  and these did not examine the concordance between physician advice and subsequent care seeking.
We found variable rates of concordance across the four dispositions “Go to ED Now”, “See FP now”, “Schedule FP Appointment”, and “Self-manage”. Concordance was highest for individuals instructed to go to an ED (70% concordant) and lowest for those instructed to seek care in their community (41% and 47%). The rate of concordance with advice to seek ED care we found was consistent with or higher than those reported in previous studies of nurse-led telephone triage services that do not include virtual physicians – which suggests VPs may reinforce urgency. However, rates of concordance with advice to seek the care of a FP was low compared with previous studies [7,8,9].
We found a significant effect of geography in all four models, with individuals living in rural areas (or in Northern Health Authority, which is predominantly rural and remote) having a fundamentally different pattern of service use than urban areas, with ED use being lower and FP use higher. This may be because rural FPs in BC may be more likely to provide urgent after hours care and visits outside of office compared to their urban counterparts . Evidence from Alberta suggests that Family Medicine graduates who receive a rural as opposed to urban training program tend to have a broader scope of practice overall and urban-trained graduates who practice in rural areas tend to behave similarly, which supports the notion that rural care is typically more generalist and flexible . This variation may also be driven at least in part by a substitution effect due to lack of accessible EDs and rural providers serving as both family and emergency physicians. Further research examining both distance from a callers’ home to the nearest ED and the difficulty of the route (e.g., mountainous regions, islands) may also reveal further trends, as we note that 90% of those concordant with advice to “Go to ED Now” did so within 4 h or less – suggesting relative proximity to an ED.
Current literature on the general population level impact of rurality on ED use has mostly focussed on lower-acuity presentations and signals are not always clear, however they suggest that lower SES and rurality are associated with higher ED use [12, 13], which is not evident in our results. Importantly, when we included visits to a FP in our concordance definition for our sensitivity analysis, we observed only marginal improvement in concordance by rurality. It is worth nothing that the impact of rurality on ED utilization appears to be driven at least in part by characteristics and health needs of the population under study [35,36,37]. As this study examines the general population, signals regarding the impact of rurality are likely to be mixed and would require examination of specific cohorts to quantify and address. It is also worth noting that “RED/YELLOW” HEiDi callers, particularly those told to “Go to ED Now”, are being assessed as likely high acuity, and so comparisons to the literature are not exact.
Concordance with advice to “Seek FP care now” was below 50%, and there was little difference in concordance between the “Seek FP care now” and “Schedule FP Appointment” dispositions. Primary care access challenges are pervasive and persistent in BC [15, 33, 38] and it is likely that this lack of access is driving at least some of the poor concordance. A 2022 qualitative study of patients seeking primary care attachment by Marshall et al. describes unattached patients as experiencing additional burdens due to lost opportunities for care and having to self-manage navigation of their health information and system resources . They further note that these burdens are often worse for at-risk groups. Browne et al. examined access to primary care from an Indigenous perspective at an urban ED and found that ED use should be understood as “a function of patient’s prior and ongoing healthcare experiences in other settings” .
Lavergne et al.’s study on declining access to primary care in BC noted that within urban settings, encounters declined more rapidly in low-income areas while ED visits increased more rapidly. In this period, the percentage of physicians providing support for neighborhoods in the two lowest income quintiles declined from 30.6% to 26.3% . Hedden et al. found a similar erosion of primary care in BC from 2006 to 2012, with the proportions of physicians providing care in alternative locations or after hours declined significantly across all practices in the range of 5–22% . However, they also noted that rural physicians were significantly more likely to provide alternative locations or hours .
Concerningly, lack of attachment to a FP does not have a statistically significant effect on concordance for the most urgent FP advice category. This suggests that having a regular FP does not guarantee timely access to primary care, at least within the 7-day follow-up period we used. Additionally, if it is infeasible for patients to access an FP in the timely manner implied by the “Seek FP care now” disposition, we would suggest this advice category be modified, and possibly combined, with “Schedule FP Appointment” to reflect the real-world access to care of callers.
We did not observe differences in concordance by health concern, with the exception of callers with obstetric/postpartum and gynecological issues. Such patients appear to be less likely to attend an ED, more likely to schedule an FP appointment, and less likely to stay home when advised, suggesting that this group of patients may require additional communication efforts by VPs when provided advice and perhaps additional care pathways.
When conceptualizing potential strategies for HEiDi and Healthlink moving forward, we find some suggestions in the telehealth literature. In a 2016 systematic review of telehealth strategies in rural and remote Australia, Bradford et al. identified 6 key factors influencing success and sustainability: vision, ownership, adaptability, economics, efficiency, and equipment . “Adaptability”, which the authors define as a strategy to “trial and model the service according to the needs of patients and health service” and “remain[ing] responsive to requirements of all stakeholders” , seems to be the most salient to the current BC context. Our results suggest that, while concordance rates on advice for ED use are high in aggregate, more work needs to be done to identify and address the needs of specific groups – particularly rural BC residents. Furthermore, advice to seek care from a family physician does not appear to be functioning as intended and may need to be recontextualized based on current access issues.
A final consideration for how callers’ may consider their health service use in BC, but arguably throughout Canada, should be the 2020 “In Plain Sight” report on Indigenous-specific racism and discrimination in healthcare. While out of scope of for this population-level analysis, the report highlights concerns around the perception of EDs and/or hospitals as unsafe may deter Indigenous persons from seeking care . Similar perceptions may be shared by other racialized or historically marginalized groups and this should be examined by any future patient-centered work. Overall, it should be noted that ED utilization is driven at least in part by social determinants of health and should be considered using an equity lens.
This is a hypothesis-generating analysis using routinely collected provincial administrative data and is subject to all the limitations thereof including missing or incorrect data. We conducted this analysis during earlier phases of the COVID-19 pandemic when there were significant concerns about seeking in-person care, and this may have reduced ED and in-person physician visits; patients with access to virtual primary care (and this might include urban or wealthier patients) may have been more concordant.
It merits consideration that health categories may be miscategorized due to overlapping symptomology or miscommunication. Furthermore, it is not possible to determine whether the reason for a HEiDi call is the same reason for which a patient ultimately seeks in-person care as the HEiDi/811 service is not able to clinically determine and capture a standardized diagnostic code.
Furthermore, we did not have access to unique identifiers for nurse and/or VP providers in our data. This precluded the identification of baselines and trends within and across providers, including analyses such as clustering.
Seventy percent of callers to a virtual physician triage service who are advised to go to an emergency department do so within 48-h, suggesting an overall high-degree of concordance with this advice. However, this is markedly lower in rural areas and the Northern health authority, which suggests the need for targeted assessment of access to emergency care, particularly with regard to distance and difficulty travelling from home to ED.
Less than half of those advised to seek follow-up care with a physician in the community do so within seven days, and there is little difference between those advised to seek FP care now and those advised to seek such care within seven days. In conjunction with recent literature, this may be driven by long-term trends restricting access to primary care in BC. Qualitative analysis of patient-caller’s decision making from their perspective would be beneficial in further understanding these findings. The drivers for the low rates of concordance with advice, particularly with advice to seek care in the community, merit future research.
Availability of data and materials
Use of Data
Access Request Available
Discharge Abstract Database (DAD)
Identification of hospitalization (inpatient acute care) events
BC Health Data Platform,
Population Data BC
National Ambulatory Care Reporting System (NACRS)
Identification of emergency department visits
BC Health Data Platform,
Population Data BC
Medical Services Plan (MSP) Billing
Identification of outpatient fee-for-service events
BC Health Data Platform,
Population Data BC
Medical Services Plan Client Registry
Confirmation of BC residency/enrolment in MSP/basic demographic information
BC Health Data Platform,
Population Data BC
Vital Statistics: Deaths
BC Health Data Platform,
Population Data BC
HealthLink BC Knowledge and Decision Record
Identifying HEiDi callers and their characteristics
Canadian Index of Multiple Deprivation (CIMD)
Socioeconomic status indicator from Statistics Canada
BC Health Data Platform
Area Deprivation Index
Discharge Abstract Database
Emergency Medicine Network
Health Data Platform BC
HealthLink BC Emergency iDoctors in-assistance
Medial Services Plan
National Ambulatory Care Reporting System
Personal Health Number
Misericordia Health Centre Health Links – Info Santé. Misericordia Health Centre. [date of publication: unknown]. Available from: https://misericordia.mb.ca/programs/phcc/health-links-info-sante/. Accessed 30 Aug 2023.
Accessing Health Care Services in Saskatchewan - HealthLine. Government of Saskatchewan. [date of publication: unknown] Available from: https://www.saskatchewan.ca/residents/health/accessing-health-care-services/healthline. Accessed 6 Nov 2022.
Alberta Health Services Health Link. Alberta Health Services. [date of publication: unknown] Available from: https://www.albertahealthservices.ca/info/page12630.aspx. Accessed 6 Nov 2022.
Health811 Ontario. Health811. 2021. Available from: https://health811.ontario.ca/static/guest/home. Accessed 4 Sep 2023.
HealthLink BC - 24/7 Health Advice You Can Trust. HealthLink BC. [date of publication: unknown] Available from: https://www.healthlinkbc.ca. Accessed 6 Nov 2022.
Ho K, Lauscher HN, Stewart K, Abu-Laban RB, Scheuermeyer F, Grafstein E, et al. Integration of virtual physician visits into a provincial 8–1–1 health information telephone service during the COVID-19 pandemic: a descriptive study of HealthLink BC Emergency iDoctor-in-assistance (HEiDi). CMAJ Open. 2021;9(2):E635–41. https://doi.org/10.9778/cmajo.20200265.
Blank L, Coster J, O’Cathain A, Knowles E, Tosh J, Turner J, et al. The appropriateness of, and compliance with, telephone triage decisions: a systematic review and narrative synthesis. J Adv Nurs. 2012;68(12):2610–21.
Purc-Stephenson RJ, Thrasher C. Patient compliance with telephone triage recommendations: a meta-analytic review. Patient Educ Couns. 2012;87(2):135–42.
De Coster C, Quan H, Elford R, Li B, Mazzei L, Zimmer S. Follow-through after calling a nurse telephone advice line: a population-based study. Fam Pract. 2010;27(3):271–8.
Rushton S, Boggan JC, Lewinski AA, Gordon AM, Shoup JP, Van Voorhees E, Whited JD, Alishahi Tabriz A, Adam S, Fulton J, Kosinski AS, Van Noord MG, Williams JW Jr, Goldstein KM, Gierisch JM. Effectiveness of Remote Triage: A Systematic Review. Washington, DC: Evidence Synthesis Program, Health Services Research and Development Service, Office of Research and Development, Department of Veterans Affairs. VA ESP Project #09-010; 2019. Available from: https://www.hsrd.research.va.gov/publications/esp/reports.cfm.
Gibson A, Randall D, Tran DT, Byrne M, Lawler A, Havard A, et al. Emergency department attendance after telephone triage: a population-based data linkage study. Health Serv Res. 2018;53(2):1137–62.
Khan Y, Glazier RH, Moineddin R, Schull MJ. A population-based study of the association between socioeconomic status and emergency department utilization in Ontario. Canada Acad Emerg Med. 2011;18(8):836–43.
Carlson LC, Kim J, Samuels-Kalow ME, Yun BJ, Terry DF, Weilburg JB, et al. Comparing neighborhood-based indices of socioeconomic risk factors and potentially preventable emergency department utilization. Am J Emerg Med. 2021;44:213–9.
Browne AJ, Smye VL, Rodney P, Tang SY, Mussell B, O’Neil J. Access to primary care from the perspective of Aboriginal patients at an urban emergency department. Qual Health Res. 2011;21(3):333–48.
Lavergne MR, Bodner A, Peterson S, Wiedmeyer M, Rudoler D, Spencer S, et al. Do changes in primary care service use over time differ by neighbourhood income? Population-based longitudinal study in British Columbia, Canada. Int J Equity Health. 2022;21(1):80.
Li KY, Kim PS, Thariath J, Wong ES, Barkham J, Kocher KE. Standard nurse phone triage versus tele–emergency care pilot on Veteran use of in-person acute care: An instrumental variable analysis. Acad Emerg Med. 2023;30(4):310–20.
Population Estimates - Province of British Columbia. Ministry of Citizen’s Services, Province of British Columbia. 2023. Available from: https://www2.gov.bc.ca/gov/content/data/statistics/people-population-community/population/population-estimates. Accessed 23 Feb 2023.
Regional health authorities - Province of British Columbia. Ministry of Health. 2022. Available from: https://www2.gov.bc.ca/gov/content/health/about-bc-s-health-care-system/partners/health-authorities/regional-health-authorities. Accessed 23 Feb 2023.
Hospitals - 622 - Businesses - Canadian Industry Statistics. Innovation, Science and Economic Development Canada, Government of Canada. 2023. Available from: https://2canada.ca/app/ixb/cis/businesses-entreprises/622. Accessed 04 Sept 2023.
Emergency Rooms in BC - Data Catalogue. HealthLink BC. 2023. Available from: https://catalogue.data.gov.bc.ca/dataset/emergency-rooms-in-bc. Accessed 04 Sept 2023.
DISCHARGE ABSTRACT DATABASE. Health Data Platform British Columbia (HDPBC), British Columbia Ministry of Health. 2021. Available from: https://assets-hdp.healthbc.org/Dataset/details/2062e5b1-95fa-4a8a-98e9-68c9056e9ccf. Accessed 25 Jan 2023.
NATIONAL AMBULATORY CARE REPORTING SYSTEM. Health Data Platform British Columbia (HDPBC), British Columbia Ministry of Health. 2021. Available from: https://assets-hdp.healthbc.org/Dataset/details/d69f3377-6196-42e0-9f41-b303fd3ec4ae. Accessed 25 Jan 2023.
PRACTITIONER CLAIMS. Health Data Platform British Columbia (HDPBC); British Columbia Ministry of Health. 2021. Available from: https://assets-hdp.healthbc.org/Dataset/details/3fd6dd99-f027-4369-ba85-7aaa7388c58d. Accessed 25 Jan 2023.
Ho K, Abu-Laban RB, Stewart K, Duncan R, Scheuermeyer FX, Hedden L, et al. Health system use and outcomes of urgently triaged callers to a nurse-managed telephone service for provincial health information after initiation of supplemental virtual physician assessment: a descriptive study. CMAJ Open. 2023;11(3):E459–65. https://doi.org/10.9778/cmajo.20220196.
Dictionary, Census of Population, 2021 – Rural area (RA). Statistics Canada, Government of Canada. 2021. Available from: https://www12.statcan.gc.ca/census-recensement/2021/ref/dict/az/Definition-eng.cfm?ID=geo042. Accessed 23 Feb 2023.
Canadian Index of Multiple Deprivation: Dataset. Statistics Canada, Government of Canada. 2019. Available from: https://www150.statcan.gc.ca/n1/pub/45-20-0001/452000012019002-eng.htm. Accessed 23 Feb 2023.
Client Roster (CR Snapshot). Health Data Platform British Columbia (HDPBC); British Columbia Ministry of Health. 2021. Available from: https://assets-hdp.healthbc.org/Dataset/details/124c5a97-c0e9-4397-98a7-600ec4f126ca. Accessed 25 Jan 2023.
VITAL EVENTS DEATHS. Health Data Platform British Columbia (HDPBC), British Columbia Ministry of Health. 2021. Available from: https://assets-hdp.healthbc.org/Dataset/details/26709839-2d3f-4250-b299-58975e3467a0. Accessed 25 Jan 2023.
NACRS Emergency Department Visits and lengths of stay by province/territory. Canadian Institute for Health Information, Ottawa. [Date Unknown]. Available from: https://www.cihi.ca/en/nacrs-emergency-department-visits-and-lengths-of-stay. Accessed 11 Feb 2023.
Peterson S, Wickham M, Lavergne MR, Beaumier J, Ahuja M, Mooney D, McGrail K. Methods to comprehensively identify emergency department visits using administrative data in British Columbia. Vancouver (BC): UBC Centre for Health Services and Policy Research; 2021. Available from: https://chspr.sites.olt.ubc.ca/files/2021/02/CHSPR-ED-Report-2021.pdf. Accessed 13 Sept 2021.
Cox DR, Oakes D. Analysis of Survival Data [Internet]. 1st ed. New York: Chapman and Hall/CRC; 2017. p. 212. Available from: https://www.taylorfrancis.com/books/mono/10.1201/9781315137438/analysis-survival-data-reid-cox.
Population growth in Canada’s rural areas, 2016 to 2021. Statistics Canada, Government of Canada. 2022. Available from: https://www12.statcan.gc.ca/census-recensement/2021/as-sa/98-200-x/2021002/98-200-x2021002-eng.cfm. Accessed 6 Nov 2022.
Hedden L, Lavergne MR, McGrail KM, Law MR, Bourgeault IL, McCracken R, et al. Trends in Providing Out-of-Office, Urgent After-Hours, and On-Call Care in British Columbia. Annals Fam Medic. 2019;17(2):116–24.
Myhre D, Szafran O, Schipper S, Dickinson J, Janke F. Scope of practice of family medicine graduates who completed a rural versus urban program. Rural Remote Health. 2018;18(3):4514.
Myran D, Hsu A, Kunkel E, Rhodes E, Imsirovic H, Tanuseputro P. Socioeconomic and geographic disparities in emergency department visits due to alcohol in Ontario: a retrospective population-level study from 2003 to 2017. Can J Psychiatry. 2022;67(7):534–43.
Ko MC, Lien HY, Woung LC, Chen CY, Chen YL, Chen CC. Difference in frequency and outcome of geriatric emergency department utilization between urban and rural areas. J Chin Med Assoc. 2019;82(4):282–8.
Wilson J, Gedcke-Kerr L, Woo K, Plazas PC, Tranmer J. Effects of rurality and geographical distance on unplanned emergency department utilization for children with asthma: a population level retrospective cohort study. Can J Nurs Res. 2021;53(4):397–404.
Ssendikaddiwa J, Lavergne R. Access to primary care and internet searches for walk-in clinics and emergency departments in Canada: observational study using google trends and population health survey data. JMIR Public Health Surveill. 2019;5(4): e13130.
Marshall EG, Wuite S, Lawson B, Andrew MK, Edwards L, MacKenzie A, et al. “What do you mean I can’t have a doctor? this is Canada!” - a qualitative study of the myriad consequences for unattached patients awaiting primary care attachment. BMC Prim Care. 2022;23(1):60.
Bradford NK, Caffery LJ, Smith AC. Telehealth services in rural and remote Australia: a systematic review of models of care and factors influencing success and sustainability. Rural Remote Health. 2016;16(4):4268.
Turpel-Lafond M. In Plain Sight: Addressing Indigenous-specific racism and discrimination in BC health care. BC Ministry of Health. 2020. Available from: https://engage.gov.bc.ca/app/uploads/sites/613/2020/11/In-Plain-Sight-Summary-Report.pdf. Accessed 1 Jan 2023
The research team would like to thank Sandra Sundhu, Director of HealthLink BC, for her support of the HEiDi evaluation program within the BC health system, and the Health Data Platform team for facilitating the data acquisition and analysis.
The HEiDi service and the evaluation of this virtual care pathway is funded by the British Columbia Ministry of Health through HealthLink BC (HLBC). The Executive Director of HLBC is a member of the steering committee and involved in the design of this evaluation, interpretation, drafting the manuscript, and as a co-author for this publication.
Ethics approval and consent to participate
The acquisition and analysis of data and all methods were performed in accordance with the relevant guidelines and regulations, approved by the University of British Columbia’s Clinical Research Ethics Board (H21-02209). This was a minimal risk study of anonymized, routinely collected administrative data and so informed consent was deemed unnecessary by the University of British Columbia’s Clinical Research Ethics Board.
Consent to publication
Kendall Ho, Riyad B. Abu-Laban, Frank X. Scheuermeyer, and Jim.
Christenson received professional fees from HealthLink BC for part-time work as HEiDi virtual physicians during the course of this study. Kendall Ho received additional funding from HealthLink BC for administration of the HEiDi program. The remaining authors do not have competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Duncan, R., Stewart, K., Scheuermeyer, F.X. et al. Concordance between 8-1-1 HealthLink BC Emergency iDoctor-in-assistance (HEiDi) virtual physician advice and subsequent health service utilization for callers to a nurse-managed provincial health information telephone service. BMC Health Serv Res 23, 1031 (2023). https://doi.org/10.1186/s12913-023-09821-w