- Research article
- Open Access
Stakeholder perceptions affecting the implementation of teleophthalmology
BMC Health Services Research volume 22, Article number: 1086 (2022)
Teleophthalmology has become the subject of heightened interest and scrutiny in the wake of the SARS-CoV-2 global pandemic. A streamlined implementation framework becomes increasingly important as demand grows. This study identified obstacles to teleophthalmology implementation through summative content analysis of key stakeholders’ perceptions.
Summative content analysis of transcribed interviews with key stakeholders (including patients, technicians, ophthalmic readers, staff, nurses, and administrators at two teleophthalmology clinic sites).
Keyword Were counted and compared to examine underlying meaning. Two analysts coded text independently using MAXQDA for summative qualitative content analysis to derive themes and hierarchical relationships as a basis for future refinement of TECS implementation. xMind ZEN was used to map conceptual relationships and overarching themes that emerged to identify perceived facilitators and barriers to implementation
Analysis revealed two themes common to perceptions: (1) benefits of care, and (2) ease of implementation. Perceived benefits included efficiency, accessibility, and earlier intervention in disease course. The quality and quantity of training was heavily weighted in its influence on stakeholders’ commitment to and confidence in the program, as were transparent organizational structure, clear bidirectional communication, and the availability of support staff.
Using a determinant framework of implementation science, this report highlighted potential hindrances to teleophthalmology implementation and offered solutions in order to increase access to screening, improve the quality of care provided, and facilitate sustainability of the innovation.
Contributions to the literature
Considering the global slant towards telemedicine in the wake of the SARS-CoV-2 pandemic, streamlining program implementation will become a healthcare imperative
This study identified potential hindrances to teleophthalmology implementation through a multilevel determinant framework of implementation science.
Factors important to key stakeholders included ongoing hands-on training with formative feedback, dedicated support staff, transparent organizational structure, and clear bidirectional communication
Telemedicine, or care provided across spatial and/or temporal distance, is often touted as a solution to the critical dilemma posed by a rapidly expanding aging population in countries with inadequate healthcare infrastructures. In ophthalmology, telemedicine is well-validated and widely accepted in diabetic retinopathy screening , and more recently has found traction in glaucoma monitoring [2,3,4,5], retinopathy of prematurity screening [6, 7], macular degeneration screening [8, 9], and comprehensive ophthalmology . Increasingly inexpensive and ubiquitous technologies, expanding computational power, and surging demand for limited healthcare resources are all pressures that have contributed its popularity. The SARS-CoV-2 pandemic has further accelerated popular use in part due to expanded reimbursement , as well as encouragement on the part of governing bodies such as the American Academy of Ophthalmology.
Early data highlights teleophthalmology’s potential to reduce volume burden on clinics, travel burden on patients, and increase access to care for rural, impoverished, and otherwise vulnerable patients [12,13,14]. Data also suggests teleophthalmology is well-accepted by patients and providers [15,16,17]. Randomized controlled trials, while limited in number, suggest increased adherence to recommended frequency of diabetic eye exams , improved attendance at follow-up visits , and no significant difference in visual outcomes or delay to treatment compared to usual care . Pooled sensitivity and specificity for classification of diabetic retinopathy in teleophthalmology were found to be over 80% and 90% (respectively) by a meta-analysis . The United Kingdom successfully integrated store-and-forward telemedicine into its National Health Service Diabetic Eye Screening Programme in 2003. By 2010, Liew reported that diabetic retinopathy had been stripped of its 50-year reign as leading cause of blindness in working-aged adults . By 2018, nearly 83% of eligible individuals were being screened annually .
Despite its promise, widespread adoption of teleophthalmology has yet to occur across the public and private sector in North America. This may be attributed more to practical realities of implementation and operation than to its potential utility. Organizational Readiness theory argues that implementation of novel models of healthcare delivery relies on a collective commitment to, and confidence in, the ability to create and sustain organizational change [24,25,26]. Overcoming resistance and other barriers becomes particularly important as the technology in question reaches the “tipping point,”  after which the most influential stakeholder is no longer an early adopter focused on and invested in the technology. Instead, the influence shifts to the public, who is most concerned with practical integration to real life . For this reason, understanding how key stakeholders perceive the innovation is critical to facilitate meaningful implementation and long-term sustainability . This effort to characterize individual determinants of implementation outcomes falls within what is known as a “determinant framework” of implementation science and is a potentially useful antecedent to successfully executed implementation strategies . Using a multilevel determinant framework , this study elicited insight from patients, providers, and staff critical to the implementation and early operation of a comprehensive teleophthalmology clinic in an effort to identify remaining unmet needs and eventually facilitate long-term sustainability. At the time of publication, only one other study exploring obstacles perceived by teleophthalmology clinic staff existed .
VA comprehensive teleophthalmology clinic operations
One early adopter of teleophthalmology, the Veterans Health Administration (VA) [31,32,33], established asynchronous diabetic retinopathy screening in primary care clinics in 2006, and expanded its efforts in 2015 to include comprehensive teleophthalmology. Technology-based Eye Care Services (TECS), which now operates out of 40 sites nationally [32,33,34], is able to prescribe spectacles and screen for glaucoma in addition to diabetic retinopathy through its use of highly-trained ophthalmic technicians. Technicians operate out of primary care clinics and collect screening data including medical and ocular history, best corrected distance and near visual acuity, intraocular pressure (iCare tonometer), pupil check, refractive status (Marco ARK 1S), external photographs, spectral domain OCTs and visual field testing as necessary, and mydriatic, non-stereoscopic, 45 degree bilateral fundus photographs. Technicians upload data into the patient’s electronic health record, where a physician reviews the information remotely. Reading physicians develop their assessment and plan typically within the hour, and may prescribe eyeglasses or refer for in-person exam as needed . Any adult without known eye disease or evidence of acute eye disease is eligible to be seen in TECS.
The Atlanta VA Research and Development Department deemed this initiative was quality improvement and quality assurance in nature, therefore Institutional Review Board approval was not required. Information is reported according to Standards for Quality Improvement Reporting Excellence (SQUIRE) guidelines . Participants gave verbal informed consent. Tenets of the Declaration of Helsinki and the Health Insurance Portability and Accountability Act were followed.
Interviewers used a responsive method that relies on rapport-building and probing for understanding . The semi-structured questions appear in Supplementary Materials (Additional file 1: Appendix 1). Rather than a fixed total number in the sample, the sampling frame represents the series of key stakeholders for TECS.
Interviewees included patients, technicians, ophthalmic readers, staff at VA Community-Based Outpatient Clinics (CBOCs), nurses, administrators, and eye clinic providers. A minimum of four participants in each category were sought or until novel content was saturated. Stakeholders were invited to participate via e-mailed letters.
Individual interviews were conducted by a trained qualitative data analyst (A.G.). Interviews were conducted either in person or by video conference using Zoom (a HIPAA-compatible encrypted platform). Interviews were 30–60 min and were audio-recorded with participant consent. Interview recordings were transcribed and de-identified by the VA Informatics, Decision-Enhancement and Analytic Sciences Center (IDEAS) in Salt Lake City, UT. Coders at the VA Health Equity and Rural Outreach Innovation Center (HEROIC) in (Charleston, SC) entered the transcript material into MAXQDA, a qualitative data analysis software .
Interviews were qualitatively analyzed using summative content analysis . This inductive method separates data into analytical codes by counting and comparing keywords followed by interpretation of the underlying context without a pre-established coding frame . Two coders (C.P. and N.P.) reviewed the transcripts and coded the data independently, and discrepancies were resolved by consensus. Analytic categories were delineated and refined using memo writing. Latent content analysis was then applied to the process of interpretation to examine underlying meaning and patterns in the data. Rather than investigator-driven categories and seeing whether data fit into a pre-existing theoretical framework, the categories were derived from the views expressed by the study participants. xMind , a concept mapping software, was used to visually map conceptual relationships such that common themes could be identified [41, 42].
Twenty-nine participants, identified as either patients (P), technicians (T), ophthalmic readers (OR), staff at VA Community-Based Outpatient Clinics (CBOC), nurses (N), administrators (A), and eye service providers (ESP), were interviewed. On average, 10 questions were asked to each group (Additional file 1: Appendix 1). Six veterans, four administrators, three physicians, ten team members, and six technicians.
Qualitative content analysis
Perceptions of the implementation process were driven by two major common themes: (1) benefits of care, and (2) ease of implementation. The coding schema used to derive themes and hierarchical relationships is shown in Fig. 1. In Fig. 1, the two common themes underlying stakeholder perceptions can be seen branching from “Perceptions.” From left to right, “Benefits of Care” was further subdivided into “Negative” (or perceived lack of benefits) and “Positive.” Continuing, “Ease of Implementation” was further subdivided into “Barriers (to implementation)” and “Facilitators.” Each branch beyond this point represents analytical codes distilled from all interviews, and substantiating quotes are presented throughout the Results section.
Perceived benefits of care
Perceived advantages to TECS over usual care included improved efficiency, accessibility, and convenience, especially for rural patients. Staff perceived veterans seeking care at more regular intervals. Veterans enjoyed a reduced travel burden and greater appointment flexibility. Ophthalmic readers observed that TECS implementation led to earlier intervention in the course of their patients’ illnesses. Higher quality of life for patients and staff was a recurrent theme.
T350010: “The patients absolutely love it. They come back to me instead of going over to the hospital. They don’t have to wait. Patients really appreciate [us] being in their [community]. I've had the head of the department actually come and say we have zero percent wait time for a patient that's having a problem.”
Those who perceived fewer personal benefits or already had convenient access to eye care preferred the “one-stop shop” of the VA:
OR350019: “In our program, I don’t think [TECS] made much of an impact because the two sites already have optometry coverage.”
Perceived ease of implementation
Facilitators of implementation
The in-person training in Atlanta, GA was found to be constructive and uncomplicated. Administrators reported adequate support from Atlanta leadership during implementation, including monthly conference calls to address concerns. A dissemination packet provided as a guide was “unintimidating” and had “very good, basic information.” Patients, technicians, and CBOC staff found the spaces comfortable, charming, and practical. Administrators appreciated the practical assistance provided (e.g., blueprints of other functioning spaces), as this helped to reduce resistance and anxiety.
Barriers to implementation
Training was a major theme underlying concerns among individuals spanning all stakeholder groups. Most interviews identified one or more of the following needs: (a) hands-on, in-person training, (b) guidance and formative feedback from an experienced teacher, and (c) protocol to follow when uncertain. Administrators found a need for more guidance when navigating the challe nges of finding clinic space and securing funding. CBOC staff wanted to know more about the myriad roles and responsibilities within their TECS site so that they could help streamline patient flow. Ophthalmic readers, technicians, administrators, and other CBOC staff all voiced a need for easily accessible guidance protocols:
OR350024: “It's important to have everything very clearly outlined. For example, exactly what clinics to schedule into, how to schedule that, [and do I] overbook? I think having templates for our exam should also be very streamlined.”
CBOC350012: “Maybe following somebody who is established in the program and up and running in their own clinic [would help] get a good feel for the patient flow, how things work [so you can understand] why we do [what we do], how we deal with the consults, how the images get transferred into the computer, how the reader actually sees them. That way everything can kind of click when you see it [from all] sides.”
A350031: “Having some training videos for the technicians on how to use the equipment, [take] photographs, [perform] different parts of the exam, that would be really helpful.”
Administrators and CBOC staff identified a need for experienced TECS personnel to be present for the first few days surrounding site launch:
A350030: “I feel like Atlanta needs to have a dedicated person that travels out and hits the ground [running] at the sites and basically within the course of a day or two can start the entire site, get it up and running, troubleshoot for the first few days of clinic.”
Some stakeholders faced resistance from other CBOC occupants. Misunderstanding the goals of TECS was reportedly responsible for disputes among other clinics sharing the space and interdepartmental “mistrust.” When TECS work relied on cooperation from unaffiliated parties such as shared CBOC schedulers and check-in clerks, daily tasks became arduous:
T350010: “When I came here, it was a hostile work environment. [Other CBOC staff] felt like they were being invaded, and it was a strong territorial fight. The MSAs or clerks (who check in patients and set up appointments) [don’t always support me]. The dental program will still remind me that this is their space.”
Several technicians and CBOC staff felt unheard and undervalued. Despite bringing safety hazards to the attention of their superiors, they saw nothing done. They identified a need for the whole site to periodically convene and discuss issues for all stakeholders:
T350010: “I don’t think all of the parties were ever brought to the table and informed as to what was happening. It creates a loss of efficiency [and] safety hazards. I have to move the camera out, and it's [a] trip hazard. Although we alerted the safety department, nothing has changed. And I mean I've actually caught two or three patients from falling.”
As Lorenzi notes, the most effective, beneficial, cost-saving new technology can be “brought to its knees” by stakeholders with a low sense of ownership, confidence or investment in the new system . This study identified potential hindrances to teleophthalmology implementation through summative content analysis using a determinant framework of implementation science. Factors important to stakeholders included ongoing hands-on training with formative feedback, transparent organizational structure, clear bidirectional communication, and dedicated support staff.
Training was brought up extensively throughout interviews, marking the topic as critical to stakeholder investment. Technicians wished for more extensive hands-on training with formative feedback, administrators for clearer blueprints for operations, and physicians for clearer instructions. Ongoing training for all team members was also identified as a particularly important topic by Ramchandran et al.  Substantial evidence supports the utility of formative feedback, defined as specific, timely, supportive, information conveyed to the learner in response to an action with the intent to modify the learner’s thinking or behavior, in the development of procedural and motor skills . Administrators whose responsibility included securing funding and space identified the need for “blueprints” for success, or advice from more experienced peers. This group may benefit from structured peer mentoring and support. Physicians wished for more guidance by way of a clear protocol to follow when uncertain. Similarly, administrators expressed need for a “super user” available to assist during site opening. Project managers remaining available during Go-Lives is a common feature of many health technology products.
Miscommunication and insufficient buy-in led to issues ranging from safety hazards to a hostile work environment. Stakeholders felt they could not identify how their role fit into the larger picture, and did not have a good understanding of the full clinical process. Better training, transparent organizational structure, and clear bidirectional communication may address these concerns. Fostering a culture which regularly seeks feedback and acts upon it is especially important to successful implementation; feeling heard and empowered is critical to buy-in [45,46,47]. Although likely situational, others may still learn from the description of hostile sentiments towards TECS occupants of CBOC space for future planning. Interviews revealed misunderstanding and mistrust of TECS:
T350010: “The people on the frontlines … they don’t know who you are or what you’re doing or why. Get down to the grassroots…the people that are going to check [patients] in for you…[get] them on board before you start.”
Reaching out before site launch to let occupants of the incoming space know what the clinic is and how important the current occupants are to the mission of providing vision-preserving care to our vulnerable veteran population may ease misunderstandings.
Limitations of this study include the use of convenience sampling, non-standardized questions across groups, and unequal numbers of participants in each stakeholder group. Similarly, demographic data was not collected thus limiting contextual grounding of our results. In addition, by following summative qualitative methods, the opportunity to perform a mixed methods or quantitative analysis was missed. The hostility felt by CBOC staff was unexpected, thus the authors were unable to secure interviews with non-TECS parties; however, other health professionals sharing CBOC space with TECS stakeholders should be included in future quality improvement research in order to better understand relational obstacles.
Using a determinant framework of implementation science, this study identified several factors important to stakeholders, including ongoing hands-on training with formative feedback, dedicated support staff, transparent organizational structure, and clear bidirectional communication. Looking forward, meeting these needs has the potential to increase access to screening, improve the quality of care provided, and facilitate sustainability of the innovation.
Availability of data and materials
The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.
Veterans Health Administration
Technology-based Eye Care Services
Community-based Outpatient Clinic
Standards for Quality Improvement Reporting Excellence
Mansberger SL, Sheppler C, Barker G, et al. Long-term comparative effectiveness of telemedicine in providing diabetic retinopathy screening examinations: a randomized clinical trial. JAMA Ophthalmol. 2015;133:518–25. https://doi.org/10.1001/jamaophthalmol.2015.1
Elson MJ, Giangiacomo A, Maa AY, et al. Early experience with full-scope shared-care teleglaucoma in Canada. J Glaucoma. 2022;31:79–83. https://doi.org/10.1097/ijg.0000000000001905.
Thomas SM, Jeyaraman MM, Hodge WG, Hutnik C, Costella J, Malvankar-Mehta MS. The effectiveness of teleglaucoma versus in-patient examination for glaucoma screening: a systematic review and meta-analysis. PLoS ONE. 2014;9(12):e113779. https://doi.org/10.1371/journal.pone.0113779.
Kassam F, Amin S, Sogbesan E, Damji KF. The use of teleglaucoma at the University of Alberta. J Telemed Telecare. 2012;18:367–73. https://doi.org/10.1258/jtt.2012.120313.
Verma S, Arora S, Kassam F, Edwards MC, Damji KF. Northern Alberta remote teleglaucoma program: clinical outcomes and patient disposition. Can J Ophthalmol. 2014;49:135–40. https://doi.org/10.1016/j.jcjo.2013.11.005.
Weaver DT. Telemedicine for retinopathy of prematurity. Curr Opin Ophthalmol. 2013;24:425–31.
Lorenz B, Bock M, Muller HM, Massie NA. Telemedicine based screening of infants at risk for retinopathy of prematurity. Stud health technol inform. 1999;64:155–63.
De Bats F, Vannier Nitenberg C, Fantino B, Denis P, Kodjikian L. Age-related macular degeneration screening using a nonmydriatic digital color fundus camera and telemedicine. Ophthalmologica. 2014;231:172–6.
Kanagasingam Y, Bhuiyan A, Abramoff MD, Smith RT, Goldschmidt L, Wong TY. Progress on retinal image analysis for age related macular degeneration. Prog Retin Eye Res. 2014;38:20–42.
Maa AY, Wojciechowski B, Hunt KJ, et al. Early experience with technology-based eye care services (TECS): a novel ophthalmologic telemedicine initiative. Ophthalmology. 2017;124:539–46.
Patel SY, Mehrotra A, Huskamp HA, Uscher-Pines L, Ganguli I, Barnett ML. Trends in outpatient care delivery and telemedicine during the COVID-19 pandemic in the US. JAMA Intern Med. 2021;181:388–91.
Dorsey ER, Topol EJ. State of Telehealth. N Engl J Med. 2016;375:154–61.
Rathi S, Tsui E, Mehta N, Zahid S, Schuman JS. The current state of teleophthalmology in the United States. Ophthalmology. 2017;124:1729–34.
Uscher-Pines L, Mehrotra A. Analysis of Teladoc use seems to indicate expanded access to care for patients without prior connection to a provider. Health Aff. 2014;33:258–64.
Court JH, Austin MW. Virtual glaucoma clinics: patient acceptance and quality of patient education compared to standard clinics. Clin Ophthalmol. 2015;9:754–9.
Paul PG, Raman R, Rani PK, Deshmukh H, Sharma T. Patient satisfaction levels during teleophthalmology consultation in rural South India. Telemed J E Health. 2006;12:571–8.
Kim J, Driver DD. Teleophthalmology for first nations clients at risk of diabetic retinopathy: a mixed methods evaluation. JMIR Med Inform. 2015;3:e10-e.
Davis RM, Fowler S, Bellis K, Pockl J, Al Pakalnis V, Woldorf A. Telemedicine improves eye examination rates in individuals with diabetes: a model for eye-care delivery in underserved communities. Diabetes Care. 2003;26:2476.
Conlin PR, Fisch BM, Cavallerano AA, Cavallerano JD, Bursell SE, Aiello LM. Nonmydriatic teleretinal imaging improves adherence to annual eye examinations in patients with diabetes. J Rehabil Res Dev. 2006;43:733–40.
Li B, Powell AM, Hooper PL, Sheidow TG. Prospective evaluation of teleophthalmology in screening and recurrence monitoring of neovascular age-related macular degeneration: a randomized clinical trial. JAMA Ophthalmol. 2015;133:276–82.
Shi L, Wu H, Dong J, Jiang K, Lu X, Shi J. Telemedicine for detecting diabetic retinopathy: a systematic review and meta-analysis. Br J Ophthalmol. 2015;99:823–31.
Liew G, Michaelides M, Bunce C. A comparison of the causes of blindness certifications in England and Wales in working age adults (16–64 years), 1999–2000 with 2009–2010. BMJ Open. 2014;4: e004015.
(2019) P. NHS screening programmes in England. 1 April 2017–31 March 2018.
May C. Towards a general theory of implementation. Implement Sci. 2013;8:18. https://doi.org/10.1186/1748-5908-8-18.
Mair FS, May C, O’Donnell C, Finch T, Sullivan F, Murray E. Factors that promote or inhibit the implementation of e-health systems: an explanatory systematic review. Bull World Health Organ. 2012;90:357–64.
May C. Towards a general theory of implementation. Implement Sci. 2013;8:18.
Gladwell M. The tipping point: How little things can make a big difference. Little, Brown; 2006.
Stake RE. Qualitative research: Studying how things work. Guilford Press; 2010.
Nilsen P. Making sense of implementation theories, models and frameworks. Implement Sci. 2015;10:53.
Ramchandran RS, Yousefi-Nooraie R, Dadgostar P, Yilmaz S, Basant J, Dozier AM. Implementation of teleophthalmology to improve diabetic retinopathy surveillance: qualitative interview study of clinical staff informed by implementation science frameworks. JMIR Diabetes. 2022;7:e32162.
Knoblauch H. Focused ethnography. Qual Soc Res. 2005;6.
Maa AY, Evans C, DeLaune WR, Patel PS, Lynch MG. A novel tele-eye protocol for ocular disease detection and access to eye care services. Telemed J E Health. 2014;20:318–23.
Maa AY, Patel S, Chasan JE, Delaune W, Lynch MG. Retrospective evaluation of a teleretinal screening program in detecting multiple nondiabetic eye diseases. Telemed J E Health. 2017;23:41–8.
Maa AY, Medert CM, Lu X, et al. Diagnostic accuracy of technology-based eye care services: the technology-based eye care services compare trial part I. Ophthalmology. 2020;127:38–44.
Ogrinc G, Davies L, Goodman D, Batalden P, Davidoff F, Stevens D. SQUIRE 2.0 (Standards for quality improvement reporting excellence): revised publication guidelines from a detailed consensus process. BMJ Qual Saf. 2016;25:986–92.
Rubin HJ, Rubin IS. Qualitative interviewing: The art of hearing data. Sage; 2011.
Saillard EK. Systematic versus interpretive analysis with two CAQDAS packages: NVivo and MAXQDA.
Patton MQ. Qualitative research & evaluation methods: Integrating theory and practice. Sage publications; 2014.
Hsieh H-F, Shannon SE. Three approaches to qualitative content analysis. Qual Health Res. 2005;15:1277–88.
XMind. (n.d.) Version 3.7.9.
Tattersall C, Powell J, Stroud J, Pringle J. Mind mapping in qualitative research. Nurs Times. 2011;107:20–2.
Mammen JR, Mammen CR. Beyond concept analysis: Uses of mind mapping software for visual representation, management, and analysis of diverse digital data. Res Nurs Health. 2018;41:583–92.
Lorenzi NM, Riley RT. Managing change: an overview. J Am Med Inform Assoc. 2000;7:116–24.
Shute VJ. Focus on formative feedback. Rev Educ Res. 2008;78:153–89.
Fairless E, Nwanyanwu K. Barriers to and facilitators of diabetic retinopathy screening utilization in a high-risk population. J Racial Ethn Health Disparities. 2019;6:1244–9.
Agbakoba R, McGee-Lennon M, Bouamrane MM, Watson N, Mair FS. Implementation factors affecting the large-scale deployment of digital health and well-being technologies: A qualitative study of the initial phases of the “Living-It-Up” programme. Health Informatics J. 2016;22:867–77.
Turnbull B. Teacher participation and buy-in: Implications for school reform initiatives. Learning Environ Res. 2002;5:235–52.
Partially funded by an Atlanta Clinical and Translational Institute Translational Research grant. The funding source had no role in the design or conduct of this study.
Ethics approval and consent to participate
The Atlanta VA Research and Development Department deemed this initiative was quality improvement and quality assurance in nature, therefore Institutional Review Board approval was not required. Information is reported according to Standards for Quality Improvement Reporting Excellence (SQUIRE) guidelines.35 Participants gave verbal informed consent. Tenets of the Declaration of Helsinki and the Health Insurance Portability and Accountability Act were followed.
Consent for publication
No author has any conflict of interest with respect to the research, authorship, and/or publication of this article.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Snider, M.J.E., Maa, A.Y., Guyton, A.C. et al. Stakeholder perceptions affecting the implementation of teleophthalmology. BMC Health Serv Res 22, 1086 (2022). https://doi.org/10.1186/s12913-022-08386-4
- Implementation barriers
- Implementation science
- Stakeholder perceptions
- Innovation sustainability