- Study protocol
- Open Access
Comparing models of delivery for cancer genetics services among patients receiving primary care who meet criteria for genetic evaluation in two healthcare systems: BRIDGE randomized controlled trial
BMC Health Services Research volume 21, Article number: 542 (2021)
Advances in genetics and sequencing technologies are enabling the identification of more individuals with inherited cancer susceptibility who could benefit from tailored screening and prevention recommendations. While cancer family history information is used in primary care settings to identify unaffected patients who could benefit from a cancer genetics evaluation, this information is underutilized. System-level population health management strategies are needed to assist health care systems in identifying patients who may benefit from genetic services. In addition, because of the limited number of trained genetics specialists and increasing patient volume, the development of innovative and sustainable approaches to delivering cancer genetic services is essential.
We are conducting a randomized controlled trial, entitled Broadening the Reach, Impact, and Delivery of Genetic Services (BRIDGE), to address these needs. The trial is comparing uptake of genetic counseling, uptake of genetic testing, and patient adherence to management recommendations for automated, patient-directed versus enhanced standard of care cancer genetics services delivery models. An algorithm-based system that utilizes structured cancer family history data available in the electronic health record (EHR) is used to identify unaffected patients who receive primary care at the study sites and meet current guidelines for cancer genetic testing. We are enrolling eligible patients at two healthcare systems (University of Utah Health and New York University Langone Health) through outreach to a randomly selected sample of 2780 eligible patients in the two sites, with 1:1 randomization to the genetic services delivery arms within sites. Study outcomes are assessed through genetics clinic records, EHR, and two follow-up questionnaires at 4 weeks and 12 months after last genetic counseling contactpre-test genetic counseling.
BRIDGE is being conducted in two healthcare systems with different clinical structures and patient populations. Innovative aspects of the trial include a randomized comparison of a chatbot-based genetic services delivery model to standard of care, as well as identification of at-risk individuals through a sustainable EHR-based system. The findings from the BRIDGE trial will advance the state of the science in identification of unaffected patients with inherited cancer susceptibility and delivery of genetic services to those patients.
Hereditary cancer syndromes affect patients’ risks of many common, adult-onset cancers [1,2,3,4,5]. Pathogenic variants (i.e., variants that increase cancer risk; PVs) in cancer predisposition genes can be identified in the germline of 7% of breast, 11–15% of ovarian [2, 6,7,8], 10% of colorectal [3, 9, 10], 4–11% of pancreas , and 12% of advanced prostate cancers unselected for age, family history, or ethnicity [12, 13]. Prior evidence supports individualizing cancer screening and prevention based on cancer risk for unaffected individuals without a personal history of cancer [14,15,16,17,18,19].
Advances in genetics and sequencing technologies are allowing the identification of more individuals with an inherited cancer susceptibility who could benefit from tailored cancer screening and prevention recommendations. A growing number of genes have been associated with increased risks for breast, ovarian, colorectal, pancreas, and prostate cancers [7, 10, 11, 13, 20,21,22,23,24]. Use of multi-gene panel testing can more than double the rate of detection of PVs compared to testing single genes [25,26,27,28], and newer sequencing technologies are also expanding the tumor spectrum associated with particular genes. These factors are leading to a broader range of family histories being considered as an indication for genetic testing . All these advances are leading to rapidly increasing numbers of unaffected patients who meet indications for genetic testing and highlight the need to develop novel ways to identify eligible patients and then deliver cancer genetics services. Our study, entitled Broadening the Reach, Impact, and Delivery of Genetic Services (BRIDGE), is addressing this gap.
Identification of unaffected individuals with hereditary cancer syndromes
Efforts to identify individuals with inherited cancer susceptibility have generally focused on first testing patients who have had cancer with subsequent testing of their unaffected at-risk relatives once a PV is found [30,31,32]. However, this strategy misses families in which there is no living, affected relative to test, and may be an important barrier to accessing genetic services. Studies have begun to explore the feasibility of screening unaffected patients for inherited cancer susceptibility in primary care settings [33,34,35,36]. In these settings, cancer family history information can be used to identify those most likely to carry a PV as well as to tailor screening regardless of whether a PV is identified [37,38,39,40,41,42,43]. National guidelines recommend testing for unaffected individuals with a significant cancer family history , and the Affordable Care Act mandated coverage of genetic testing for hereditary breast/ovarian cancer for unaffected individuals with appropriate family history . However, family history information is underutilized to stratify risk [46,47,48], leading to missed opportunities for referral to genetic testing . In one study, 37% of newly diagnosed breast cancer patients found to have PVs had a family history that warranted genetic testing prior to their diagnosis . The National Health Interview Survey reported that only 9.5% of unaffected women with a family history of breast and ovarian cancer had discussed genetic testing with their healthcare provider, and only 2.7% had genetic testing .
Novel strategies are therefore needed to facilitate the use of family history information to identify unaffected individuals who may have inherited cancer susceptibility. Although some family history information is often collected in primary care settings, barriers to collecting or using this information in clinical practice include limited visit time; competing demands; reimbursement criteria; and providers’ training, knowledge and skills [47, 52,53,54,55,56]. Primary care providers (PCPs) may not have specialized knowledge about genetics and genetic conditions or know who to refer for genetic services , and there may be limited availability of specialists outside of referral centers making the services difficult for many people to access, particularly those in rural areas. Many tools that are available to facilitate use of family history information in primary care require significant time and resources and were developed independent of workflow standards in clinics; as a result, widespread implementation of these tools has not occurred [48, 49]. System-level strategies, such as population health management, are needed to assist PCPs in identifying patients who may benefit from genetic services .
To address the need for a system-level population health management strategy, our team has developed an algorithm-based system to screen cancer family history information already available in the electronic health record (EHR) , and identify unaffected patients who receive primary care at the study sites and meet criteria for genetic evaluation for hereditary breast, ovarian, prostate, pancreas, and/or colorectal cancers [60, 61]. A pilot test conducted with 71 patients receiving primary care at University of Utah Health (UHealth) who were identified with the algorithm showed that the majority (62%) were successfully engaged through outreach from the cancer genetics team to consider genetics evaluation . This algorithm forms the basis of a system-wide approach in the BRIDGE study to identify unaffected primary care patients meeting guidelines for genetic evaluation.
Models for delivery of cancer genetic services
Once unaffected individuals at risk for a hereditary cancer syndrome are identified, genetic services (e.g., genetic counseling, genetic testing, risk-reduction recommendations) need to be delivered. The number of trained genetic specialists is limited both in capacity and location, and more sustainable, and reimbursable, service delivery models are needed to accommodate an increasing patient volume [63,64,65]. Therefore, the development and testing of innovative approaches to the delivery of cancer genetic services is essential.
Prior research has compared different delivery models for cancer genetic services . A number of these studies have evaluated alternative modes of delivering pre- and post-test counseling by a genetic counselor [67,68,69]. Studies comparing in-person and telephone counseling have found telephone counseling to be acceptable to patients, with no differences in knowledge, psychosocial outcomes, satisfaction, or patient-centered communication [66, 68, 70, 71]. However, uptake of genetic testing has been shown to be lower for telephone versus in-person counseling , and factors such as race/ethnicity, distress, and perceived risk may impact uptake of testing [72, 73]. Other studies have reported similar levels of knowledge, satisfaction, depression, and anxiety for in-person and video counseling [66, 70, 71, 74].
Fewer studies have explored supplementing genetic counselors with other models within the healthcare system [75, 76]. As referrals for hereditary cancer risk assessment increase [66, 70, 74, 77], models that direct genetic counseling time and resources to those patients with the greatest needs for in-person genetics care are warranted. Models are also needed that can reach rural and other underserved areas that may not be near genetics providers. Patient-directed approaches, in which patients seek the genetics information and services that they need, have promise as a service delivery model. One model of genetic testing that is patient-driven and has grown greatly in popularity is direct-to-consumer (DTC) genetic testing, in which consumers can order genetic testing directly and has minimal or no involvement from a clinician or genetic counselor . While DTC approaches may increase access to genetic testing, it is unknown whether DTC genetic test results will be shared with primary care providers  or result in appropriate clinical management [80,81,82]. Therefore, more effective genetic services delivery models may incorporate features of the DTC approach (e.g., patient-directed, increased access, accessible outside academic medical centers) while offering genetic testing within the healthcare system so that providers are aware of the results and have the support they need for using the results to individualize care.
Use of automated conversational agents (i.e., chatbots) may support a patient-directed genetic services delivery model for genetics education, decision making about genetic testing, and return of genetic test results. Chatbots have many advantages for patient education, including providing scripted education interactively, answering questions using natural language processing, chunking information into small segments that are easier to process, and allowing for choice in the amount of information received, consistent with adult learning recommendations [83,84,85]. This technology is being used in a variety of healthcare contexts, including mental health care, health promotion, and facilitation of informed decision making related to prostate cancer screening [86,87,88,89,90]. Chatbots are also being used in genetic services delivery such as collecting patient data, providing information, delivering results, and facilitating cascade testing of at-risk relatives [91,92,93,94,95]. However, user responses to the technology need to be further investigated in the context of genetics, as there is a lack of research that has compared genetic services delivery through a chatbot to standard of care genetic services delivery models using a randomized design. Research on chatbots to date indicates that users would be receptive to use of this technology in health, although concerns related to accuracy, data privacy, and lack of empathy have been raised [95, 96]. Chatbots are therefore a promising technology for use in genetic services delivery, but additional research is needed to examine their efficacy and to investigate implementation outcomes  within healthcare systems.
Effects of genetic services delivery models across population subgroups
In examining the efficacy of genetic services delivery models, it is critical to explore how these effects may vary across population subgroups defined by factors such as race, ethnicity, and geographic location (i.e., rural/frontier vs. urban) to avoid worsening health disparities in access to care and health outcomes [98,99,100]. Prior research has shown that individuals from minority racial and ethnic groups have decreased access to and utilization of genetic services [101,102,103,104], even when cost barriers are minimized , and that race and ethnicity can modify the effects of genetic services delivery models. A randomized trial comparing in-person and telephone-based genetic counseling found that the effect of mode of delivery differed by race; women from minority groups who were assigned to telephone counseling were the least likely to complete genetic testing . Less research has examined how geographic location may modify the effects of genetic services delivery models. Individuals in rural (< 100 persons per square mile) and frontier (< 7 persons per square mile)  areas in the U.S. have less access to care  and worse health outcomes [108,109,110,111,112], In rural and frontier regions, clinics and hospitals can be hundreds of miles from patients’ homes, so rural and frontier residents have less access to specialty genetics care [56, 113, 114]. In addition, clinical sites in rural areas may not have providers with specialized genetics knowledge . These prior findings indicate that exploring whether genetic services delivery models have similar effects across population subgroups is critical.
Aims of BRIDGE study
To address the research needs of developing system-wide population health management strategies to identify unaffected patients at risk for inherited cancer syndromes and delivering cancer genetic services effectively across population subgroups, we are conducting the BRIDGE randomized controlled trial (RCT) with patients who receive primary care at two large healthcare systems. The BRIDGE trial has the following specific aims:
Identify unaffected patients receiving primary care who qualify for genetic risk assessment in two healthcare systems (UHealth and New York University Langone Health [NYULH]) using a clinical decision support algorithm to automatically evaluate family history of cancer through a population health management approach.
Compare uptake of genetic counseling and testing for intervention (i.e., active outreach and automated, patient-directed education via a chatbot) vs. enhanced standard of care (i.e., active outreach followed by standard of care) genetic services delivery models among unaffected patients who receive primary care at each site.
Compare adherence to clinical care recommendations and patient cognitive and affective responses for the genetic services delivery models.
The primary outcomes of the RCT will be uptake of genetic counseling, uptake of genetic testing, and, among those who receive genetic services, adherence to management recommendations from genetics providers. We hypothesize that uptake of genetic counseling and genetic testing will be equivalent between the two genetic services delivery models. We will also explore how race, ethnicity, and geographic location modify the effects of the cancer genetics services delivery models on these outcomes. In addition to the trial outcomes, we will assess implementation outcomes based on the RE-AIM (Reach, Efficacy, Adoption, Implementation, and Maintenance) framework (Table 1) [116, 117].
We are conducting a RCT to compare uptake of genetic counseling and testing and patient adherence to management recommendations for automated, patient-directed versus enhanced standard of care cancer genetics services delivery models. We are enrolling unaffected patients receiving primary care who are eligible for cancer genetic testing based on current National Comprehensive Cancer Network (NCCN) guidelines at two healthcare systems (UHealth and NYULH). We are enrolling patients through outreach to a randomly selected sample of 2780 patients (1280 at UHealth and 1500 at NYULH). Eligible patients are identified using an open clinical decision support (CDS) infrastructure designed to extract cancer family history information available in the EHR. Identified patients are randomized 1:1 at each site prior to outreach to the study arms: automated, patient-directed intervention genetic services delivery model and enhanced standard of care control genetic services delivery model (Fig. 1). The study design is based on patient-level randomization because the outreach and clinical care in both arms is delivered centrally through the genetics clinic in each system with minimal need for involvement by the primary care clinic or PCP. Study outcomes are assessed through the EHR and two follow-up questionnaires at about 4 weeks and 12 months after last genetic counseling contact. The trial has been approved as a single IRB protocol by the participating universities.
We have created an open standards-based clinical decision support algorithm that identifies patients who receive primary care at the study sites and are eligible for genetics evaluation . The algorithm utilizes structured cancer family history data available in the EHR  and identifies unaffected patients who meet modified 2018 NCCN guidelines for genetic testing for hereditary breast/ovarian and colorectal cancer syndromes based on their family history (Table 2). The platform was designed to be interfaced with different EHR systems via the Health Level Seven International Fast Healthcare Interoperability Resources (FHIR) standard and was deployed initially in the Epic® EHR in use at the UHealth healthcare system. UHealth is one of the largest healthcare systems in the Intermountain West region, providing care for 1.2 million residents of six states in a referral area encompassing more than 10% of the continental U. S with vast rural and frontier regions. We have adapted the algorithm for the NYULH system, which serves a large, diverse population in New York, including over 300 ambulatory sites and affiliate hospitals in Manhattan, Brooklyn, and Long Island.
In addition to having a cancer family history meeting NCCN criteria for genetic evaluation, all patients identified as eligible for the trial are English- or Spanish-speaking, between the ages of 25 and 60 years, had a primary care appointment in one of the two participating healthcare systems in the previous 3 years, have not had a prior cancer diagnosis other than non-melanoma skin cancer, and have not had prior genetic counseling or testing related to hereditary cancer. We selected the 25–60 years age range because screening and prevention recommendations can be modified for those in this range with inherited cancer susceptibility or familial risk [118,119,120,121,122]. For the study we are defining primary care as internal medicine and family medicine at both sites. In addition, because many patients (23%) in the UHealth system receive primary care through obstetrics/gynecology clinics, we will also select UHealth patients who have had a primary care appointment in these clinics in the previous 3 years. To be eligible for the trial, patients need to have an electronic patient portal (MyChart in Epic®) account because of its use for outreach in both study arms. Patients identified as meeting the algorithm who do not have an account are contacted by mail or telephone about creating one. Those who opt not to create an account are ineligible for the trial but are offered standard of care genetic services.
The list of patients receiving primary care who are identified by the CDS algorithm as meeting criteria for genetic evaluation was entered into a population health registry in Epic® at each of the two sites, which allows the registry to be used for tracking eligible patients and managing outreach. The registry indicates to which arm the patient is randomized, with 1:1 randomization to the patient-directed or enhanced standard of care arm. Randomization was predetermined by the study biostatistician, who has no patient contact and is masked to patient condition. One week prior to outreach in either arm, a patient’s PCP is notified that the patient will be contacted. The subsequent procedures then vary between study arms as described below.
Enhanced standard of care arm
In the control enhanced standard of care arm, patients are first sent an electronic message through the MyChart patient portal indicating that genetic services are recommended for them. The message encourages patients to contact the genetics clinic within the appropriate healthcare system (UHealth or NYULH) to schedule a genetic counseling appointment. If the patient does not respond to the message, they receive a reminder patient portal message 1 week later and up to two follow-up telephone calls from a genetic counseling assistant (GCA). Procedures after this point follow standard workflow of the clinics. Interested patients are scheduled for a usual care pre-test genetic counseling appointment. These visits may be conducted by phone, telehealth, or in person at a designated time during clinic hours and with a certified genetic counselor following clinical standard of care. Patients who choose to proceed with genetic testing can give a sample of blood or saliva if seen in person. If counseled by telephone or telehealth, they are sent saliva collection kits which can be returned by mail; this service is offered by several commercial laboratories. All genetic test results are reviewed and returned by a genetic counselor either by phone or in person, based on patient preference. A copy of the results and letter with tailored cancer screening recommendations prepared by a genetic counselor are returned to the PCP. Patients who do not respond to initial outreach attempts are sent a final electronic message letting them know how to access genetic services in the future.
Automated, patient-directed arm
In the intervention automated, patient-directed arm, patients are first sent an electronic message through the MyChart patient portal indicating that genetic services are recommended for them. The message includes a link with instructions to complete the pre-test education chat with the chatbot through the online platform. If the patient does not complete the chat, they receive a reminder patient portal message 1 week later and up to two follow-up telephone calls from a GCA. Following the completion of the pre-test education chat, a transcript is added into the patient’s EHR as an outreach encounter to document the education received. A GCA contacts each patient who completes the chat to review their decision about testing and complete a comprehensive family history. If the patient opts to proceed with testing, the GCA explains the genetic testing process and payment options and places the genetic testing order. The encounter is documented in the EHR using a clinic note template that is signed by a genetic counselor.
Patients in this arm who opt to have genetic testing are sent a saliva collection kit as described above. If the genetic sample is not returned to the lab within 30 days of order, the patient receives up to one reminder phone call and two electronic messages through the patient portal. All genetic test results are reviewed by a genetic counselor. Patients with negative results receive an electronic message in the patient portal which contains a link to a negative return of results chat with the chatbot. Transcripts of completed negative return of results chats are added to the patient’s EHR to document the encounter. Patients with PVs or variants of uncertain significance (VUS) have results returned by a genetic counselor via a telephone or telehealth visit. All patient test results (i.e., positive, VUS, negative) are uploaded to the patient portal along with a letter of tailored screening recommendations written by the genetic counselor. The patient’s PCP is also sent a copy of all documentation via Epic.
Both chats in the automated, patient-directed arm (i.e., pre-test genetic education and negative return of results) utilize the Invitae technical platform and chatbot interface and were scripted for the BRIDGE study by an interdisciplinary team of genetic counselors, genetic counseling assistants, communication scientists, and research staff. The chat content was developed through an iterative process of review of recorded genetic counseling encounters and feedback by certified genetic counselors in order to most closely represent key content delivered during in-person genetic counseling appointments. The pre-test education chat is introduced by a short video from a lead genetic counselor at each site and then provides educational content about heritability of cancer, genetic testing process, multi-gene panel tests, and possible genetic testing outcomes. The negative return of result chat informs the patient of their negative results and educates the patient about what these results mean for their long-term care. For both chats, patients move through a core set of information and then may request additional information on topics they choose. Both chats also provide the patient with the opportunity to ask questions in a free-text format. The platform utilizes a question bank so that the chatbot can respond automatically to most inquiries with a response pre-scripted by the research team, using natural language processing to determine the most appropriate response. If the system cannot match an answer to the patient’s question, the platform forwards the question to the GCA for follow up.
Patients from both arms who decide not to test receive a letter summarizing their risks and recommendations based on the available personal and family history information. In addition, patients from both arms are offered the option to schedule follow-up appointments in the genetics clinics, and these contacts and appointments are tracked.
All genetic testing is performed at a Clinical Laboratory Improvement Act (CLIA)-certified commercial laboratory and, for NYULH patients, New York State approved laboratory. Patients receive a pan-cancer, multigene panel test for cancer susceptibility genes that includes approximately 34–36 genes. As in clinical practice, the choice of laboratory and specific multigene panel test is based on the patient’s need, services provided, and the patient’s insurance/financial status. Testing is billed to insurance, or patients can opt to self pay. Patients who are uninsured or lack coverage for genetic testing can also be assisted in applying for aid through programs offered by the laboratories. The out-of-pocket cost of genetic testing is typically between $0–$250 based on prior clinical experience, with most paying less than $100.
In order to collect data for the trial and implementation outcomes for participants who receive genetic counseling, we use a combination of questionnaires and abstraction of EHR data.
Patients who complete pre-test counseling in either arm are asked to complete two follow-up questionnaires, with different versions for those who did and did not opt for genetic testing. The first follow-up questionnaire is administered about 4 weeks after the last genetic counseling contact and the second is administered 12 months after the last contact. As shown in Table 3, the 4-week follow-up questionnaire assesses perceptions of genetic services, decision regret, cancer risk perceptions, genetic knowledge, numeracy, and sociodemographic characteristics. For those who have testing, we also assess cognitive (i.e., recall, comprehension), affective (i.e., test-related distress, uncertainty, positive reactions), and communication (i.e., family, provider) responses. The 12-month follow-up questionnaire assesses cancer screening and prevention behaviors, genetic discrimination, eHealth literacy, genetic self-efficacy, and sources of health information. For those who have testing, we also assess retention, risk perceptions, and communication about test results at 12 months. Patients may complete follow-up questionnaires online, by telephone, or by mail. Online questionnaires are administered via REDCap, which has a HIPAA-compliant interface. For any patients who would like to complete the questionnaires by telephone, a research coordinator masked to their individual test results administers the questionnaire. Patients receive a $10 electronic gift card as an incentive for each questionnaire. The sources of the validated items used in the questionnaires are indicated in Table 3. The questionnaires were tested as part of a pilot study at the University of Utah prior to the launch of the RCT. Questionnaires can be found as Supplemental materials.
Queries of structured data elements are used to abstract data from the EHR related to patients’ cancer family history and adherence to clinical management recommendations (e.g., breast MRI) at 12 months following genetic services. Data will be abstracted from the population health management registries at each site related to uptake of genetic counseling, uptake of genetic testing, and genetic test results.
For the primary trial outcome analyses, we will first check randomization by comparing demographic characteristics between patients in the two arms using bivariate statistics (t-test, Wilcoxon Ranked-Sum test, chi-squared test, or Fisher’s exact test). We will examine descriptive statistics, and will use chi-squared tests (or the nonparametric Fisher’s Exact test) with a two-sided 0.05 significance level for univariate comparison of proportions to examine the association between study arm and the primary outcomes (i.e., uptake of genetic counseling, uptake of genetic testing, adherence to clinical recommendations). We will next build multilevel multivariable logistic regression models to examine the effect of study arm on the outcome controlling for clinic-level (clinic type, patient volume, patient composition, number of providers), provider-level (specialty, years in practice, gender), and patient-level (i.e., sociodemographic, clinical) variables. Although the study design utilizes patient-level randomization and genetic counseling services are delivered centrally at both study sites, we will examine the intra-class correlation (ICC) by clinic and provider. If a significant ICC is observed, the regression models will be extended to include random effects for clinic or provider, and fit using software for generalized mixed models. Covariates will be included in models if significant in unadjusted analyses or if significantly different between arms. Using the multivariable regression models with interaction terms, we will explore whether the effects of study arm on uptake of genetic testing is modified by race/ethnicity or rurality. We will conduct both site-specific analyses and overall trial analyses. Statistical significance will be assessed as p < 0.05; SAS 9.4 and/or Stata 16.1 will be used for analysis.
Sample size (outreach to 1280 patients at UHealth and 1500 at NYULH) is based on pilot tests of both arms at the two study sites in order to enroll approximately the same number of patients at each site. With outreach to 640 patients per arm at UHealth and 750 at NYULH, we will achieve 80% power to detect equivalence for the uptake of genetic counseling outcome in site-specific analysis. For this analysis, the margin of equivalence, given in terms of the difference, extends from − 0.08 to 0.17. The actual difference is 0.11, and the reference group proportion is 0.18. This sample size will be sufficient to examine the uptake of genetic testing outcome as well. For that outcome, 523 patients per arm at each site achieves 80% power to detect equivalence. The margin of equivalence, given in terms of the difference, extends from − 0.04 to 0.11. The actual difference is 0.05, and the reference group proportion is 0.14.
The BRIDGE trial is designed to address the need to develop system-wide population health management strategies to deliver cancer genetic services to unaffected primary care patients. The primary outcomes of the trial will be uptake of genetic counseling, uptake of genetic testing, and, among those who receive genetic services, adherence to management recommendations from genetics providers. We hypothesize that uptake of genetic counseling and genetic testing will be equivalent for the automated, patient-directed genetic services delivery model delivered by a chatbot compared with the enhanced standard of care models. We will also explore whether race, ethnicity, and rurality modify the effects of the cancer genetics services delivery models on these outcomes.
BRIDGE is addressing critical clinical needs of increasing hereditary cancer testing in appropriate populations and identifying individuals with inherited cancer susceptibility . Innovative aspects of the trial include testing delivery of cancer genetic services via an automated chatbot for pre-test genetics education and return of negative genetic test results. While chatbots have been used previously in delivery of some genetic services, outcomes from this modality have not been compared with standard of care in a randomized trial. Utilization of chatbots to deliver some components of genetic services has a strong potential to increase volume and access to these services for patients receiving primary care. The patient population of unaffected primary care patients identified through an EHR-based algorithm is also novel, and tests a sustainable system-level population health management approach to identification and delivery of cancer genetics services. BRIDGE also has the advantage of being conducted at two sites (UHealth and NYULH) located in different regions of the country, which have clinical structures and patient populations that are unique from one another. This allows for the examination of multiple outcomes between two unique healthcare systems. The findings from the BRIDGE trial will therefore advance the state of the science in identification of unaffected patients at increased risk for cancer and delivery of genetic services to those patients.
Availability of data and materials
Not applicable. This protocol paper does not contain any data.
Broadening the Reach, Impact, and Delivery of Genetic Services
Clinical decision support
Clinical Laboratory Improvement Act
Electronic health record
Health Level Seven International Fast Healthcare Interoperability Resources
Genetic counseling assistant
National Comprehensive Cancer Network
New York University Langone Health
Primary care provider
Randomized controlled trial
Reach, Efficacy, Adoption, Implementation, and Maintenance
University of Utah Health
Variant of uncertain significance
King M-C, Marks JH, Mandell JB. The New York breast Cancer study group. Breast and ovarian cancer risks due to inherited mutations in BRCA1 and BRCA2. Science. 2003;302(5645):643–6. https://doi.org/10.1126/science.1088759.
Petrucelli N, Daly M, Pal T. BRCA1- and BRCA2-associated hereditary breast and ovarian Cancer. In: Adam M, Ardinger H, Pagon R, et al., editors. GeneReviews. Seattle: University of Washington; 2016.
Giardiello F, Allen J, Axilbund J, Boland C, Burke C, Burt R, et al. Guidelines on genetic evaluation and management of lynch syndrome: a consensus statement by the US multi-society task force on colorectal Cancer. Gastroenterology. 2014;147(2):502–6. https://doi.org/10.1053/j.gastro.2014.04.001.
Curras-Freixes M, Inglada-Perez L, Mancikova V, Montero-Conde C, Leton R, et al. Recommendations for somatic and germline genetic testing of single pheochoromocytoma and paraganglioma based on findings from a series of 329 patients. J Med Genet. 2015;52(10):647–56. https://doi.org/10.1136/jmedgenet-2015-103218.
Brito J, Asi N, Bancos I, Gionfriddo M, Zeballos-Palacios C, et al. Testing for germline mutations in sporadic pheocromocytoma/paraganglioma: a systematic review. Clin Endocrinol. 2015;82(3):338–45. https://doi.org/10.1111/cen.12530.
Judkins T, Leclair B, Bowles K, Gutin N, Trost J, McCulloch J, et al. Development and analytical validation of a 25-gene next generation sequencing panel that includes the BRCA1 and BRCA2 genes to assess hereditary cancer risk. BMC Cancer. 2015;15(1):215. https://doi.org/10.1186/s12885-015-1224-y.
National Cancer Institute. Genetics of Breast and Gynecologic Cancers Rockville: National Cancer Institute; 2015 [Available from: http://www.cancer.gov/cancertopics/pdq/genetics/breast-and-ovarian/HealthProfessional/page3.
Zhang S, Royer R, Li S, McLaughlin J, Rosen B, Risch H, et al. Frequencies of BRCA1 and BRCA2 mutations among 1,342 unselected patients with invasive ovarian cancer. Gynecol Oncol. 2011;121(2):353–7. https://doi.org/10.1016/j.ygyno.2011.01.020.
Hampel H, Frankel W, Martin E, et al. Screening for the lynch syndrome (hereditary nonpolyposis colorectal cancer). N Engl J Med. 2005;352(18):1851–60. https://doi.org/10.1056/NEJMoa043146.
Yurgelun MB, Kulke MH, Fuchs CS, Allen BA, Uno H, Hornick JL, et al. Cancer susceptibility gene mutations in individuals with colorectal cancer. J Clin Oncol. 2017;35(10):1086–95. https://doi.org/10.1200/JCO.2016.71.0012.
Shindo K, Yu J, Suenaga M, Fesharakizadeh S, Cho C, Macgregor-Das A, et al. Deleterious germline mutations in patients with apparently sporadic pancreatic adenocarcinoma. J Clin Oncol. 2017;35(30):3382–90. https://doi.org/10.1200/JCO.2017.72.3502.
Madelker D, et al. Mutation detection in patients with advanced cancer by universal sequencing of cancer-related genes in tumor and normal DNA vs guideline-based germline testing. J Am Med Assoc. 2017;318(9):825–35. https://doi.org/10.1001/jama.2017.11137.
Pritchard CC, Mateo J, Walsh MF, De Sarkar N, Abida W, Beltran H, et al. Inherited DNA-repair gene mutations in men with metastatic prostate cancer. N Engl J Med. 2016;375(5):443–53. https://doi.org/10.1056/NEJMoa1603144.
Hall MJ, Forman AD, Pilarski R, Wiesner G, Giri VN. Gene panel testing for inherited cancer risk. J Natl Compr Cancer Netw. 2014;12(9):1339–46. https://doi.org/10.6004/jnccn.2014.0128.
Hiraki S, Rinella ES, Schnabel F, Oratz R, Ostrer H. Cancer risk assessment using genetic panel testing: considerations for clinical application. J Genet Couns. 2014;23(4):604–17. https://doi.org/10.1007/s10897-014-9695-6.
Kurian AW, Hare EE, Mills MA, Kingham KE, McPherson L, Whittemore AS, et al. Clinical evaluation of a multiple-gene sequencing panel for hereditary cancer risk assessment. J Clin Oncol. 2014;32(19):2001–9. https://doi.org/10.1200/JCO.2013.53.6607.
Maxwell KN, Wubbenhorst B, D'Andrea K, et al. Prevalence of mutations in a panel of breast cancer susceptibility genes in BRCA1/2-negative patients with early-onset breast cancer. Genet Med. 2015;17:630–8.
Desmond A, Kurian AW, Gabree M, Mills MA, Anderson MJ, Kobayashi Y, et al. Clinical actionability of multigene panel testing for hereditary breast and ovarian cancer risk assessment. JAMA Oncol. 2015;1(7):943–51. https://doi.org/10.1001/jamaoncol.2015.2690.
Slavin TP, Niell-Swiller M, Solomon I, Nehoray B, Rybak C, Blazer KR, et al. Clinical application of multigene panels: challenges of next-generation counseling and cancer risk management. Front Oncol. 2015;5:208.
Pennington KP, Swisher EM. Hereditary ovarian cancer: beyond the usual suspects. Gynecol Oncol. 2012;124(2):347–53. https://doi.org/10.1016/j.ygyno.2011.12.415.
Domchek SM, Bradbury A, Garber JE, Offit K, Robson ME. Multiplex genetic testing for cancer susceptibility: out on the high wire without a net? J Clin Oncol. 2013;31(10):1267–70. https://doi.org/10.1200/JCO.2012.46.9403.
Mandelker D, Zhang L, Kemel Y, Stadler ZK, Joseph V, Zehir A, et al. Mutation detection in patients with advanced Cancer by universal sequencing of Cancer-related genes in tumor and Normal DNA vs guideline-based Germline testing. JAMA. 2017;318(9):825–35. https://doi.org/10.1001/jama.2017.11137.
Pearlman R, Frankel W, Swanson B, et al. Prevalence and spectrum of germline cancer susceptibility gene mutations among patietns with early onset colorectal cancer. JAMA Oncol. 2017;3(4):464–71. https://doi.org/10.1001/jamaoncol.2016.5194.
Stoffel E, Koeppe E, Everett J, et al. Germline genetic features of young individuals with colorectal cancer. Gastroenterology. 2018;154(4):897–905. https://doi.org/10.1053/j.gastro.2017.11.004.
Kapoor N, Curcio L, Blakemore C, et al. Multigene panel testing detects equal rates of pathogenic BRCA1/2 mutations and has a higher diagnostic yield compared to limited BRCA1/2 analysis along in patients at risk for hereditary breast cancer. Ann Surg Oncol. 2015;22(10):3282–8. https://doi.org/10.1245/s10434-015-4754-2.
Ricker C, Culver JO, Lowstuter K, Sturgeon D, Sturgeon JD, Chanock CR, et al. Increased yield of actionable mutations using multi-gene panels to assess hereditary cancer susceptibility in an ethnically diverse clinical cohort. Cancer Genet. 2016;209(4):130–7. https://doi.org/10.1016/j.cancergen.2015.12.013.
Susswein LR, Marshall ML, Nusbaum R, Vogel Postula KJ, Weissman SM, Yackowski L, et al. Pathogenic and likely pathogenic variant prevalence among the first 10,000 patients referred for next-generation cancer panel testing. Genet Med. 2016;18(8):823–32. https://doi.org/10.1038/gim.2015.166.
Yurgelun MB, Allen B, Kaldate RR, Bowles KR, Judkins T, Kaushik P, et al. Identification of a variety of mutations in Cancer predisposition genes in patients with suspected lynch syndrome. Gastroenterology. 2015;149(3):604–13 e20. https://doi.org/10.1053/j.gastro.2015.05.006.
Giri VN, Knudsen K, Kelly W, et al. Role of genetic testing for inherited prostate cancer risk: Philadelphia prostate Cancer consensus conference 2017. J Clin Oncol. 2018;36(4):414–24. https://doi.org/10.1200/JCO.2017.74.1173.
Hampel H. Genetic counseling and cascade genetic testing in lynch syndrome. Familial Cancer. 2016;15(3):423–7. https://doi.org/10.1007/s10689-016-9893-5.
Samini G, Bernardini M, Brody L, Caga-Anan C, Campbell I, Chenevix-Trench G. Traceback: a proposed framework to increase identification and genetic counseling of BRCA1 and BRCA2 mutation carriers through family-based outreach. J Clin Oncol. 2017;35(20):2329–37. https://doi.org/10.1200/JCO.2016.70.3439.
Katapodi M, Viassolo V, Caiata-Zufferey M, Nikolaidis C, Buhrer-Landolt R, Buerki N, et al. Cancer predisposition cascade screening for hereditary breast/ovarian cancer and lynch syndromes in Switzerland: study protocol. JMIR Res Prot. 2017;6(9):e184. https://doi.org/10.2196/resprot.8138.
Dinh T, Rosner B, Atwood J, Boland C, et al. Health benefits and cost-effectiveness of primary genetic screening for lynch syndrome in the general population. Cancer Prev Res. 2011;4(1):9–22. https://doi.org/10.1158/1940-6207.CAPR-10-0262.
Li Y, Arellano A, Bare L, et al. A multigene test could cost-effectively help extend life expectancy for women at risk of hereditary breast cancer. Value Health. 2017;20(4):547–55. https://doi.org/10.1016/j.jval.2017.01.006.
Luba D, Disario J, Rock C, et al. Community practice implementation of a self-administered version of PREMM1,2,6 to assess risk for lynch syndrome. Clin Gastroenterol Hepatol. 2018;16(1):49–58. https://doi.org/10.1016/j.cgh.2017.06.038.
Gou F, et al. Use of BRCA mutation test in the U.S. 2004-2014. Prev Med. 2017;52(6):702–9.
Cropper C, Woodson AH, Arun B, Barcenas C, Litton J, Noblin S, et al. Evaluating the NCCN criteria for recommending BRCA1 and BRCA2 genetic testing in patients with breast cancer. J Natl Compr Cancer Netw. 2017;15(6):797–803. https://doi.org/10.6004/jnccn.2017.0107.
Gilpin C, Carson N, Hunter A. A preliminary validation of a family history assessment form to select women at risk for breast or ovarian cancer for referral to a genetics center. Clin Genet. 2000;58(4):299–308. https://doi.org/10.1034/j.1399-0004.2000.580408.x.
Parmigiani G, Chen S, Iversen E Jr. Validity of models for predicting BRCA1 and BRCA2 mutations. Ann Intern Med. 2007;147(7):441–50. https://doi.org/10.7326/0003-4819-147-7-200710020-00002.
Bellcross C, Lemke A, Paper L, et al. Evaluation of a breast/ovarian cancer genetics referral screening tool in a mammography population. Genet Med. 2009;11(11):783–9. https://doi.org/10.1097/GIM.0b013e3181b9b04a.
Hoskins K, Zwaagstra A, Ranz M. Validation of a tool for identifying women at high risk for hereditary breast cancer in population-based screening. Cancer. 2006;107(8):1769–76. https://doi.org/10.1002/cncr.22202.
Ashton-Prolla P, Giacomazzi J, Schmidt A, et al. Development and validation of a simple questionnaire for the identification of hereditary breast cancer in primary care. BMC Cancer. 2009;9(1):283. https://doi.org/10.1186/1471-2407-9-283.
Khoury MJ, Feero WG, Valdez R. Family history and personal genomics as tools for improving health in an era of evidence-based medicine. Am J Prev Med. 2010;39(2):184–8. https://doi.org/10.1016/j.amepre.2010.03.019.
U.S. Preventive Services Task Force. Risk assessment, genetic counseling, and genetic testing for BRCA-related cancer: recommendation statement. Am Fam Physician. 2020;101(4):233–8.
Centers for Medicare & Medicaid Services. Affordable Care Act Implementation FAQs - Set 12 Baltimore: Centers for Medicare & Medicaid Services. https://www.cms.gov/CCIIO/Resources/Fact-Sheets-and-FAQs/aca_implementation_faqs12. Accessed 1 Mar 2021.
Acheson LS, Weisner GL, Zyzanski SJ, Goodwin MA, Stange KC. Family history-taking in community family practice: implications for genetic screening. Genet Medicine. 2000;2(3):180–5. https://doi.org/10.1097/00125817-200005000-00004.
Fuller M, Myers M, Webb T, Tabangin M, Prows C. Primary care providers' responses to patient-centered family history. J Genet Couns. 2010;19(1):84–96. https://doi.org/10.1007/s10897-009-9264-6.
Valdez R, Yoon PW, Qureshi N, Green RF, Khoury MJ. Family history in public health practice: a genomic tool for disease prevention and health promotion. Annu Rev Public Health. 2010;31(1):69–87. https://doi.org/10.1146/annurev.publhealth.012809.103621.
Ginsburg O, Ashton-Prolla P, Cantor A, Mariosa D, Brennan P. The role of genomics in global cancer prevention. Nat Rev Clin Oncol. 2020; ePub before press.
Grindedal E, Herabm C, Karsrud I, et al. Current guidelines for BRCA testing of breast cancer patietns are insufficient to detect all mutation carriers. BMC Cancer. 2017;17(1):438. https://doi.org/10.1186/s12885-017-3422-2.
Hull L, Haas J, Simon S, et al. Provider discussions of genetic tests with U.S. womend at risk for BRCA mutation. Am J Prev Med. 2018;54(2):221–8. https://doi.org/10.1016/j.amepre.2017.10.015.
Acheson L. Fostering applications of genetics in primary care: what will it take? Genet Med. 2003;5(2):63–5. https://doi.org/10.1097/01.GIM.0000056946.67707.67.
Rich EC, Burke W, Heaton CJ, Haga S, Pinsky L, Short P, et al. Reconsidering the family history in primary care. J Gen Intern Med. 2004;19(3):273–80. https://doi.org/10.1111/j.1525-1497.2004.30401.x.
Green RF, Olney RS. Connecting generations: family history an important tool in pediatrics, public health. AAP News. 2007;28:26.
Kelly KM, Ferketich AK, Sturm AC, Porter K, Sweet K, Kemp K, et al. Cancer risk and risk communication in urban, lower-income neighborhoods. Prev Med. 2009;48(4):392–6. https://doi.org/10.1016/j.ypmed.2009.01.009.
Kelly KM, Love MM, Pearce KA, Porter K, Barron MA, Andrykowski M. Cancer risk assessment by rural and Appalachian family medicine physicians. J Rural Health. 2009;25(4):372–7. https://doi.org/10.1111/j.1748-0361.2009.00246.x.
Delikurt T, Williamson G, Anastasiadou V, Skirton H. A systematic review of factors that act as barriers to patient referral to genetic services. Eur J Hum Genet. 2015;23(6):739–45. https://doi.org/10.1038/ejhg.2014.180.
Mikat-Stevens NA, Larson IA, Tarini BA. Primary-care providers' perceived barriers to integration of genetics services: a systematic review of the literature. Genet Med. 2015;17(3):169–76. https://doi.org/10.1038/gim.2014.101.
Mowery DL, Kawamoto K, Bradshaw R, Kohlmann W, Schiffman JD, Weir C, et al. Determining onset for familial breast and colorectal cancer from family history comments in the electronic health record. AMIA Jt Summits Transl Sci Proc. 2019;2019:173–81.
Gupta S, Provenzale D, Llor X, Halverson AL, Grady W, Chung DC, et al. Genetic/familial high-risk assessment: colorectal, version 2.2019: featured updates to the NCCN guidelines. J Natl Compr Cancer Netw. 2019;17(9):1032–41. https://doi.org/10.6004/jnccn.2019.0044.
Daly MB, Pilarski R, Yurgelun MB, Berry MP, Buys SS, Dickson P, et al. Genetic/familial high-risk assessment: breast, ovarian, and pancreatic, version 1.2020: featured updates to the NCCN guidelines. J Natl Compr Cancer Netw. 2020;18(4):380–91. https://doi.org/10.6004/jnccn.2020.0017.
Del Fiol G, Kohlmann W, Bradshaw R, Weir C, Flynn M, Hess R, et al. Standards-based clinical decision support platform to manage patients who meet guideline-based criteria for genetic evaluation of familial cancer. J Clin Oncol Clin Cancer Inform. 2020;4:1–9.
Hoskovec JM, Bennett RL, Carey ME, DaVanzo JE, Dougherty MJ, Hahn SE, et al. Projecting the supply and demand for certified genetic counselors: a workforce study. J Genet Couns. 2018;27(1):16–20. https://doi.org/10.1007/s10897-017-0158-8.
Attard C, Carmany E, Trepanier A. Genetic counselor workflow study: the times are they a-changin? J Genet Couns. 2019;28(1):130–40. https://doi.org/10.1002/jgc4.1041.
Maiese D, Keehn A, Lyon M, Flannery D, Watson M. Current conditions in medical genetics practice. Genet Med. 2019;21(8):1874–7. https://doi.org/10.1038/s41436-018-0417-6.
Buchanan A, Rahm A, Williams J. Alternate service delivery models in cancer genetic counseling: a mini-review. Front Oncol. 2016;6:120.
Kinney AY, Steffen LE, Brumbach BH, Kohlmann W, Du R, Lee JH, et al. Randomized noninferiority trial of telephone delivery of BRCA1/2 genetic counseling compared with in-person counseling: 1-year follow-up. J Clin Oncol. 2016;34(24):2914–24. https://doi.org/10.1200/JCO.2015.65.9557.
Schwartz MD, Valdimarsdottir HB, Peshkin BN, Mandelblatt JS, Nusbaum R, Huang A-T, et al. Randomized noninferiority trial of telephone versus in-person genetic counseling for hereditary breast and ovarian cancer. J Clin Oncol. 2014;32(7):618–26. https://doi.org/10.1200/JCO.2013.51.3226.
Sutphen R, Davila B, Shappell H, Holtje T, Vadaparampil S, Friedman S, et al. Real world experience with cancer genetic counseling via telephone. Familial Cancer. 2010;9(4):681–9. https://doi.org/10.1007/s10689-010-9369-y.
McCuaig J, Armel S, Care M, Volenik A, Kim R, Metcalfe K. Next-generation service delivery: a scoping review of patient outcomes associated with alternative models of genetic counseling and genetic testing for hereditary cancer. Cancers. 2018;10(11):435. https://doi.org/10.3390/cancers10110435.
Voils C, Venne V, Weidenbacher H, Sperber N, Datta S. Comparison of telephone and televideo modes for delivery of genetic counseling: a randomized trial. J Genet Couns. 2018;27(2):339–48. https://doi.org/10.1007/s10897-017-0189-1.
Butrick M, Kelly S, Peshkin BN, Luta G, Nusbaum R, Hooker GW, et al. Disparities in uptake of BRCA1/2 genetic testing in a randomized trial of telephone counseling. Genet Med. 2015;17(6):467–75. https://doi.org/10.1038/gim.2014.125.
Steffen L, Du R, Gammon A, Mandelblatt J, Kohlmann W, Lee J, et al. Genetic testing in a population-based sample of breast and ovarian cancer survivors from the REACH randomized trial: cost barriers and moderators of counseling mode. Cancer Epidemiol Biomark Prev. 2017;26(12):1772–80. https://doi.org/10.1158/1055-9965.EPI-17-0389.
Cohen S, Huziak R, Gustafson S, Grubs R. Analysis of advantages, limitations, and barriers of genetic counseling service delivery models. J Genet Couns. 2016;25(5):1010–8. https://doi.org/10.1007/s10897-016-9932-2.
Green MJ, Peterson SK, Baker MW, Friedman LC, Harper GR, Rubinstein WS, et al. Use of an educational computer program before genetic counseling for breast cancer susceptibility: Effects on duration and content of counseling sessions. Genet Med. 2005;7(4):221–9. https://doi.org/10.1097/01.gim.0000159905.13125.86.
Green MJ, Peterson SK, Baker MW, Harper GR, Friedman LC, Rubinstein WS, et al. Effect of a computer-based decision aid on knowledge, perceptions, and intentions about genetic testing for breast cancer susceptibility: a randomized controlled trial. JAMA. 2004;292(4):442–52. https://doi.org/10.1001/jama.292.4.442.
Trepanier A, Allain D. Models of service delivery for cancer genetic risk assessment and counseling. J Genet Couns. 2014;23(2):239–53. https://doi.org/10.1007/s10897-013-9655-6.
Keshavan M. Key players in the direct-to-consumer lab testing market: MedCityNews; 2016. Available from: https://medcitynews.com/2016/01/20-key-players-in-the-direct-to-consumer-lab-testing-market/.
van der Wouden C, Carere D. Maitland-van der zee a. consumer perceptions of interactions with primary care providers after direct-to-consumer personal genomic testing. Ann Intern Med. 2016;164(8):513–22. https://doi.org/10.7326/M15-0995.
Burke W, Trinidad S. The deceptive appeal of direct-to-consumer genetics. Ann Intern Med. 2016;164(8):564–5. https://doi.org/10.7326/M16-0257.
Tandy-Connor S, Guiltinan J, Kremply K, LaDuca H, Reineke P, Gutierrez S, et al. False-positive results released by direct-to-consumer genetic tests highlight the importance of clinical confirmation testing for appropriate patient care. Genet Med. 2018;20(12):1515–21. https://doi.org/10.1038/gim.2018.38.
Hamilton J, Abdiwahab E, Edwards H, Fan M, Jdayani A, Breslau E. Primary care providers' cancer genetic-testing related knowledge, attitudes, and communication behaviors: a systematic review and research agenda. J Gen Intern Med. 2017;32(3):315–24. https://doi.org/10.1007/s11606-016-3943-4.
Doak CC, Doak LG, Root JH. Teaching Patients with Low Literacy Skills. In: Teaching patients with low literacy skills. 2nd ed. Philadelphia: J.B. Lippincott Company; 1996.
Mayer RE, Dow GT, Mayer S. Multimedia learning in an interactive self-explaining environment: what works in the design of agent-based microworlds. J Educ Psychol. 2003;95(4):806–13. https://doi.org/10.1037/0022-0622.214.171.1246.
Agency for Healthcare Research and Quality. Health literacy universal precautions toolkit 2010. Available from: http://www.ahrq.gov/qual/literacy/index.html.
Bibault J-E, Chaix B, Nectoux P, Pienkowski A, Guillemase A, Brouard B. Healthcare ex Machina: are conversational agents ready for prime time in oncology? Clin Transl Rad Oncol. 2019;16:55–9. https://doi.org/10.1016/j.ctro.2019.04.002.
Fitzpatrick K, Darcy A, Vierhile M. Delivering cognitive behavior therapy to young adults with symptoms of depression and anxiety using a fully automated conversational agent (Woebot): a randomized controlled trial. JMIR Mental Health. 2017;4(2):e19. https://doi.org/10.2196/mental.7785.
Ly K, Ly A-M, Andersson G. A fully automated conversational agent for promoting mental wellbeing: a pilot RCT using mixed methods. Internet Interv. 2017;10:39–46. https://doi.org/10.1016/j.invent.2017.10.002.
Owens O, Felder T, Tavakoli A, Revels A, Friedman D, Hughes-Halbert C, et al. Evaluation of a computer-based decision aid for promoting informed prostate cancer screening decisions among African American men: iDecide. Am J Health Promot. 2018;33(2):267–78. https://doi.org/10.1177/0890117118786866.
Pereira J, Diaz O. Using health chatbots for behavior change: a mapping study. J Med Syst. 2019;43(5):135. https://doi.org/10.1007/s10916-019-1237-1.
Gordon E, Babu D, Laney D. The future is now: technology’s impact on the practice of genetic counseling. Am J Med Genet. 2018;178(1):15–23. https://doi.org/10.1002/ajmg.c.31599.
Biesecker B. Genetic counseling and the central tenets of practice. Cold Spring Harbor Perspect Med. 2020;10(3):a038968.
Flannery D. Challenges and opportunities for effective delivery of clinical genetic services in the U.S. healthcare system. Curr Opin Pediatr. 2018;30(6):740–5. https://doi.org/10.1097/MOP.0000000000000693.
Rashkin M, Bowes J, Dunaway K, Dhaliwal J, Loomis E, Riffle S, et al. Genetic counseling, 2030: an on-demand service tailored to the needs of a price conscious, genetically literate, and busy world. J Genet Couns. 2019;28(2):456–65. https://doi.org/10.1002/jgc4.1123.
Schmidlen T, Schwartz M, Diloreto K, Kirchner H, Sturm A. Patient assessment of chatbots for the scalable delivery of genetic counseling. J Genet Couns. 2019;28(6):1166–77. https://doi.org/10.1002/jgc4.1169.
Nadarzynski T, MIles O, Cowie A, Ridge D. Acceptability of artificial intelligence (AI)-led chatbot services in healthcare: a mixed methods study. Digital Health. 2019;5:1–12.
Roberts MC, Kennedy AE, Chambers DA, Khoury MJ. The current state of implementation science in genomic medicine: opportunities for improvement. Genet Med. 2017;19(8):858–63. https://doi.org/10.1038/gim.2016.210.
Institute of Medicine. Unequal treatment: understanding racial and ethnic disparities in health Care. Washington, DC: National Academy Press; 2002.
Halbert C, Harrison B. Genetic counseling among minority populations in the era of precision medicine. Am J Med Genet. 2018;178(1):68–74. https://doi.org/10.1002/ajmg.c.31604.
Pierle J, Mahon S. Genetic service delivery models: exploring approaches to care for families with hereditary cancer risk. Clin J Oncol Nurs. 2019;23(1):60–7. https://doi.org/10.1188/19.CJON.60-67.
Hall M, Olopade OI. Confronting genetic testing disparities: knowledge is power. J Am Med Assoc. 2005;293(14):1783–5. https://doi.org/10.1001/jama.293.14.1783.
Hall MJ, Olopade OI. Disparities in genetic testing: thinking outside the BRCA box. J Clin Oncol. 2006;24(14):2197–203. https://doi.org/10.1200/JCO.2006.05.5889.
Fisher E, Pratt R, Esch R, Kocher M, Wilson KR, Lee W, et al. The role of race and ethnicity in views toward and participation in genetic studies and precision medicine research in the United States: a systematic review of qualitative and quantitative studies. Mol Genet Gen Med. 2019;8(2):e1099.
McCarthy AM, Bristol M, Domchek SM, Groeneveld PW, Kim Y, Motanya UN, et al. Health care segregation, physician recommendation, and racial disparities in BRCA1/2 testing among women with breast cancer. J Clin Oncol. 2016;34(22):2610–8. https://doi.org/10.1200/JCO.2015.66.0019.
Alford SH, McBride CM, Reid RJ, Larson EB, Baxevanis AD, Brody LC. Participation in genetic testing research varies by social group. Public Health Gen. 2011;14(2):85–93. https://doi.org/10.1159/000294277.
Defining rural population. Available from: https://www.hrsa.gov/rural-health/about-us/definition/index.html. Accessed 26 Feb 2021.
Caldwell JT, Ford CL, Wallace SP, Wang MC, Takahashi LM. Intersection of living in a rural versus urban area and race/ethnicity in explaining access to health care in the United States. Am J Public Health. 2016;106(8):1463–9. https://doi.org/10.2105/AJPH.2016.303212.
Bhuyan SS, Wang Y, Opoku S, Lin G. Rural-urban differences in acute myocardial infarction mortality: evidence from Nebraska. J Cardiovasc Dis Res. 2013;4(4):209–13. https://doi.org/10.1016/j.jcdr.2014.01.006.
Weaver KE, Geiger AM, Lu L, Case LD. Rural-urban disparities in health status among US cancer survivors. Cancer. 2013;119(5):1050–7. https://doi.org/10.1002/cncr.27840.
Blake K, Moss J, Gaysynsky A, Srinivasan S, Croyle R. Making the case for investment in rural cancer control: an analysis of rural cancer incidence, mortality, and funding trends. Cancer Epidemiol Biomark Prev. 2017;26(7):992–7. https://doi.org/10.1158/1055-9965.EPI-17-0092.
Henley S, Anderson R, Thomas C, Massetti G, Peaker B, Richardson L. Invasive cancer incidence, 2004-2013, and deaths, 2006-2015, in nonmetropolitan and metropolitan counties - United States. MMWR. 2017;66(14):1–13. https://doi.org/10.15585/mmwr.ss6614a1.
Zahnd W, James A, Jenkins W, Izadi S, Fogleman A, Steward D, et al. Rural-urban differences in cancer incidence and trends in the United States. Cancer Epidemiol Biomark Prev. 2018;27(11):1265–74. https://doi.org/10.1158/1055-9965.EPI-17-0430.
George R, Kovak K, Cox SL. Aligning policy to promote cascade genetic screening for prevention and early diagnosis of heritable diseases. J Genet Couns. 2015;24(3):388–99. https://doi.org/10.1007/s10897-014-9805-5.
Villegas C, Haga S. Access to genetic counselors in the southern United States. J Personalized Med. 2019;9(3):33. https://doi.org/10.3390/jpm9030033.
Radford C, Prince A, Lewis K, Pal T. Factors which impact the delivery of genetic risk assessment services focused on inherited cancer genomics: expanding the role and reach of certified genetics professionals. J Genet Couns. 2014;23(4):522–30. https://doi.org/10.1007/s10897-013-9668-1.
Glasgow R, Klesges L, Dzewaltowski D, Estabrooks P, TM V. Evaluating the impact of health promotion programs: using the RE-AIM framework to form summary measures for decision making involving complex issues. Health Educ Res. 2006;21(5):688–94. https://doi.org/10.1093/her/cyl081.
Glasgow RE, Vogt TM, Boles SM. Evaluating the public health impact of health promotion interventions: the RE-AIM framework. Am J Public Health. 1999;89(9):1322–7. https://doi.org/10.2105/AJPH.89.9.1322.
National Comprehensive Cancer Network. Breast Cancer Screening and Diagnosis Version I.2017. 2017.
National Comprehensive Cancer Network. Genetic/Familial High-Risk Assessment: Colorectal Version 3.2017. 2017.
National Comprehensive Cancer Network. Genetic/familial high-risk assessment: breast/ovarian, Version I 2018 2018.
National Comprehensive Cancer Network. Colorectal Cancer Screening Version 2.2017 2017.
National Comprehensive Cancer Network. Prostate Cancer Early Detection Version 2.2017 2017.
DeMarco T, Peshkin B, Mars B, Tercyak K. Patient satisfaction with cancer genetic counseling: a psychometric anaysis of the genetic counseling satisfaction scale. J Genet Couns. 2004;13(4):293–304. https://doi.org/10.1023/B:JOGC.0000035523.96133.bc.
Peshkin BN, Kelly S, Nusbaum RH, Similuk M, DeMarco TA, Hooker GW, et al. Patient perceptions of telephone vs. in-person BRCA1/BRCA2 genetic counseling. J Genet Couns. 2015;25:472–82.
Kaphingst KA, McBride CM, Wade CH, Baxevanis AD, Reid RJ, Larson EB, et al. Patients' understanding of and responses to multiplex genetic susceptibility test results. Genet Med. 2012;14(7):681–7. https://doi.org/10.1038/gim.2012.22.
Lumish HS, Steinfeld H, Koval C, Russo D, Levinson E, Wynn J, et al. Impact of panel gene testing for hereditary breast and ovarian cancer on patients. J Genet Couns. 2017;26(5):1116–29. https://doi.org/10.1007/s10897-017-0090-y.
Roberts JS, Gornick MC, Carere DA, Uhlmann WR, Ruffin MT, Green RC. Direct-to-consumer genetic testing: user motivations, decision making, and perceived utility of results. Public Health Genomics. 2017;20(1):36–45. https://doi.org/10.1159/000455006.
Brehaut J, O'Connor A, Wood T, Hack T, Siminoff L, Gordon E, et al. Validation of a decision regret scale. Med Decis Mak. 2003;23(4):281–92. https://doi.org/10.1177/0272989X03256005.
Underhill-Blazey M, Stopfer J, Chittenden A, Nayak MM, Lansang K, Lederman R, et al. Development and testing of the KnowGene scale to assess general genetic knowledge related to multigene panel testing. Patient Educ Couns. 2019;102(8):1558–64. https://doi.org/10.1016/j.pec.2019.04.014.
Cella D, Hughes C, Peterman A, Chang C-H, Peshkin BN, Schwartz MD, et al. A brief assessment of concerns associated with genetic testing for cancer: the multidimensional impact of Cancer risk assessment (MICRA) questionnaire. Health Psychol. 2002;21(6):564–72. https://doi.org/10.1037/0278-6126.96.36.1994.
Fagerlin A, Zikmund-Fisher BJ, Ubel PA, Jankovic A, Derry HA, Smith DM. Measuring numeracy without a math test: development of the subjective numeracy scale. Med Decis Mak. 2007;27(5):672–80. https://doi.org/10.1177/0272989X07304449.
Chew LD, Griffin JM, Partin MR, Noorbaloochi S, Grill JP, Snyder A, et al. Validation of screening questions for limited health literacy in a large VA outpatient population. J Gen Intern Med. 2008;23(5):561–6. https://doi.org/10.1007/s11606-008-0520-5.
Norman CD, Skinner HA. eHEALS: the eHealth literacy scale. J Med Internet Res. 2006;8(4):e27. https://doi.org/10.2196/jmir.8.4.e27.
Parrott R, Silk K, Krieger JR, Harris T, Condit C. Behavioral health outcomes associated with religious faith and media exposure about human genetics. Health Commun. 2004;16(1):29–45. https://doi.org/10.1207/S15327027HC1601_3.
Hesse BW, Nelson DE, Kreps GL, Croyle RT, Arora NK, Rimer BK, et al. Trust and sources of health information: the impact of the internet and its implications for health care providers: findings from the first health information National Trends Survey. Arch Intern Med. 2005;165(22):2618–24. https://doi.org/10.1001/archinte.165.22.2618.
Nelson DE, Kreps GL, Hesse BW, Croyle RT, Willis G, Arora NK, et al. The health information National Trends Survey (HINTS): development, design, and dissemination. J Health Commun. 2004;9(5):443–60. https://doi.org/10.1080/10810730490504233.
Dutta-Bergman M. Trusted online sources of health information: differences in demographics, health beliefs, and health-information orientation. J Med Internet Res. 2003;5(3):e21. https://doi.org/10.2196/jmir.5.3.e21.
Conway LG, Woodard SR, Zubrod A. Social psychological measurements of COVID-19: coronavirus perceived threat, government response, impacts, and experiences questionnaires; 2020.
National Cancer Institute. Cancer Moonshot Blue Ribbon Panel Report 2016. Bethesda: National institutes of health, National Cancer Institute; 2016.
We thank Michael Flynn, MD, for his invaluable advice on the study.
Research reported in this publication was supported by the National Cancer Institute of the National Institutes of Health, USA under award number U01CA232826. As part of the grant review process, the study protocol underwent peer review by the funding body. The funders have no role in data collection, analysis or interpretation, writing of the report, or decision to submit a report for publication. The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health.
Ethics approval and consent to participate
The study is approved as a single IRB protocol by the University of Utah Institutional Review Board, consistent with current U.S. National Institutes of Health policy for multi-site randomized controlled trials (NOT-OD-16-094). The New York University IRB agreed to rely upon the University of Utah IRB as the single IRB for the trial. Eligible individuals receive a study invitation letter with a link to an IRB-approved consent cover letter and a questionnaire. Individuals review the consent cover letter first and then indicate their consent to participate in the trial by completing the questionnaire. The trial has an approved waiver of documentation of consent so a signature is not required.
Consent for publication
Not applicable. The manuscript does not contain any individual person’s data.
JDS is co-founder and shareholder in ItRunsInMyFamily.com, and co-founder and shareholder in PEEL Therapeutics, Inc.
KK2 reports honoraria, consulting, sponsored research, licensing, or co-development outside the submitted work in the past 3 years with McKesson InterQual, Hitachi, Pfizer, Premier, Klesis Healthcare, RTI International, Mayo Clinic, the University of Washington, the University of California at San Francisco, MD Aware, and the U.S. Office of the National Coordinator for Health IT (via ESAC and Security Risk Solutions) in the area of health information technology. KK2 was also an unpaid board member of the non-profit Health Level Seven International health IT standard development organization, he is an unpaid member of the U.S. Health Information Technology Advisory Committee, and he has helped develop a number of health IT tools which may be commercialized to enable wider impact. None of these relationships have direct relevance to the manuscript but are reported in the interest of full disclosure.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Kaphingst, K.A., Kohlmann, W., Chambers, R.L. et al. Comparing models of delivery for cancer genetics services among patients receiving primary care who meet criteria for genetic evaluation in two healthcare systems: BRIDGE randomized controlled trial. BMC Health Serv Res 21, 542 (2021). https://doi.org/10.1186/s12913-021-06489-y
- Genetic services
- Primary care
- Health technology
- Population health management