Skip to main content

Virtual visits at the Helsinki Head and Neck Center during the COVID-19 pandemic: patient safety incidents and the experiences of patients and staff



During the COVID-19 pandemic, health care had to find new ways to care for patients while reducing infection transmission. The role of telemedicine role has grown exponentially.


A questionnaire on experiences and satisfaction was sent to the staff of the Head and Neck Center of Helsinki University Hospital and to otorhinolaryngology patients treated remotely between March and June 2020. Additionally, patient safety incident reports were examined for incidents involving virtual visits.


Staff (response rate 30.6%, (n = 116)) opinions seemed to be quite polarized. In general, staff felt virtual visits were useful for select groups of patients and certain situations, and beneficial in addition to face-to-face visits, not instead of them. Patients (response rate 11.7%, (n = 77)) gave positive feedback on virtual visits, with savings in time (average 89 min), distance travelled (average 31.4 km) and travel expenses (average 13.84€).


While telemedicine was implemented during the COVID-19 pandemic to ensure patient treatment, its usefulness after the pandemic must be examined. Evaluation of treatment pathways is critical to ensure that quality of care is upheld while new treatment protocols are introduced. Telemedicine offers the opportunity to save environmental, temporal, and monetary resources. Nonetheless, the appropriate use of telemedicine is essential, and clinicians must be offered the option to examine and treat patients face-to-face.

Peer Review reports


During the COVID-19 pandemic, health care had to find ways to care for patients while reducing infection transmission. As the virus replicates in the nasopharynx and many respiratory tract procedures may cause aerosolization, staff working in the head and neck area are thought to be at high risk for infection [1, 2]. Virtual visits have been one option implemented to ensure safety and have been found to be effective, for example, with rhinology patients [3]. Unplanned visits and re-referrals were rare in a two-year follow-up study of otorhinolaryngology virtual visits [4]. Virtual visits reduce waiting times, shorten the length of visits, reduce costs and reduce the carbon footprint of health care by decreasing the need to travel to healthcare facilities [5].

Physician satisfaction with otorhinolaryngology virtual visits was highest with follow-up patients, and when using teleconferencing instead of the telephone in a recent study of 15 respondents [6]. Patient satisfaction with virtual visits has been high – 94% – both in stroke follow-up and otorhinolaryngology (ENT) patients [7, 8]. However, research in the field is still in short supply.

Finland is part of the European Union and follows the General Data Protection Regulation (GDPR, 2016/679) in telemedicine. Finnish national legislation has multiple regulations considering privacy and confidentiality in healthcare. However, there are no specific requirements for the technical systems of remote healthcare in the Finnish legislation, but the supervisory authorities (the National Supervisory Authority for Welfare and Health, as well as the Office of the Data Ombudsman) have enforced some guidelines concerning telemedicine in Finland [9].

Virtual visits were broadly expanded at the Head and Neck Center of Helsinki University Hospital immediately when the COVID-19 pandemic began in Finland in March 2020. The aim of this study was to examine the experiences of staff and patients during virtual visits, and to review patient safety reports. We must examine whether virtual visits are a viable, environmental, and time-saving option in the future as healthcare costs are rising and the resources available are falling.


Letters containing a link to the anonymous voluntary online questionnaire, study information, and rights of participants were sent to health professionals of the Head and Neck Center of Helsinki University Hospital. The questionnaire was sent to staff three times to ensure it reached all employees. The Data Management Service of Helsinki University Hospital performed a search for all patients treated remotely by doctors at the Otorhinolaryngology – Head and Neck Surgery Clinic, a tertiary center, March 24—June 30, 2020. This list of patients was validated by cross-checking it with electronic patient records [4]. A visit was classified as virtual if it was conducted remotely by simple telephone conversation or video connection using any digital platform. Patients were excluded if there was no matching physician’s record of the appointment in the patient record system, if the appointment was only rescheduled with no treatment occurring during the visit, or if the patient contact was not real-time and remote [4]. A similar questionnaire and information letter were sent to these patients. To increase the response rate, 100 patients were chosen by random number generator, and were also sent a paper version of the questionnaire and a post-paid return envelope. The questionnaires for patients and staff were created solely for this study.

Helsinki University Hospital uses the national HaiPro Reporting System for Safety Incidents, which is voluntary and anonymous [10, 11]. Patients have also been able to report incidents since May 2021. Safety reports were reviewed for the mention of virtual visits March 1, 2020—December 31, 2021, a follow-up period of 18 months.

Descriptive statistics are presented as means or medians, and numbers with percentages for categorical variables. The relationship between demographic variables and patient and staff opinions was analyzed with cross-tabulation and differences tested with chi-square or Fisher’s exact test. Likelihood to recommend (scale 0–10) was tested with Mann–Whitney U test or Kruskal–Wallis test. A p-value of < 0.05 was chosen as significant. Statistics were performed using IBM SPSS Statistics 28 for Windows (IBM Corp., Armonk, NY, USA). Open-ended questions were analyzed using qualitative content analysis.

The study was approved by an independent Ethics Committee (HUS/2242/2020) and by the Research Administration of the hospital (§ 69, HUS/146/2020).


Staff questionnaire

The staff questionnaire was sent to a total of 322 residents and 57 nurses and allied health professionals (e.g., opticians, speech therapists, physiotherapists). A response rate of 30.6% was reached (n = 116/379): 6 nurses, 44 allied health professionals, and 66 doctors or dentists.

Virtual visits were carried out in numerous different subspecialties of ENT, phoniatrics, ophthalmology, dentistry, and oral maxillofacial surgery (OMS). In addition, 19 speech therapist respondents also treated patients not suffering from head and neck complaints. Twenty-two respondents had no virtual visits. Eighty-two staff members participated in virtual visits by phone, 57 by video and 21 did not answer. Thirty-seven staff members had technical difficulties, 20 did not answer. Most staff (n = 73, 62.9%) wished they had a video connection for the virtual visit, eight did not answer.

When asked to grade their likelihood to recommend virtual visits to a colleague, 103 staff members gave an average grade of 7.7 out of 10. Significant factors affecting the success of virtual visits are presented in Tables 1 and 2. Oral disease and OMS specialists were significantly more likely than residents (p = 0.014) to recommend virtual visits. Most ophthalmology staff felt conducting virtual visits at home would improve their well-being (borderline significance, p = 0.086) (Table 1). Table 3 shows answers on staff well-being.

Table 1 Significant factors affecting the success of virtual visits according to ophthalmology staff
Table 2 Significant factors affecting the success of virtual visits according to ENT/phoniatrics staff
Table 3 Experiences of 116 staff respondents during virtual visits at the Head and Neck Center of Helsinki University Hospital

Staff commented on the functionality of virtual visits and were asked to share their opinions in open answer form. Recurrent themes included the importance of patient and ailment selection, and the necessity of one well-functioning digital platform with easy useability. Negative opinions included that virtual visits cannot be used for all patients or for patients who need an interpreter, that a lot of time goes to helping patients with technical problems and connecting to video, and depending on the quality of the internet connection, voice quality may be difficult to evaluate. Virtual visits were useful with young patients as both guardians can participate and staff does not need to go to school or daycare to evaluate the child, saving staff’s time. Staff described virtual visits as patient-friendly: patients belonging to risk groups, working from home, and those living far away do not need to come to the hospital. In addition, virtual visits free up nurses to perform other duties instead of assisting in patient examination. Virtual group rehabilitation and speech therapy worked well and was embraced by the elderly, with only a handful of patients wanting to come to the hospital. Many mentioned the usefulness of virtual visits for follow-ups or as a pre-visit to take patient history. Surprisingly, of those commenting on working from home, many said they would rather work at the hospital due to better ergonomics (e.g., electric adjustable desks) and interaction with co-workers. Some thought the opportunity to work from home would be handy e.g., if one had a mild cold. Some mentioned that open offices made virtual visits impossible due to background noise and lack of confidentiality. Many suggested that virtual visits are a good addition to in-person visits, not in place of them. A few also mentioned the ecological aspect of virtual visits eliminating the need to travel to the hospital, thus reducing health care’s carbon footprint.

Patient questionnaire

In this study, 660 virtual visit patients were sent a questionnaire and study information letter (Fig. 1). Seventy-seven responses were received (response rate 11.7%; mean age 53.2 years, median 57.7 years) (Table 4). Most (n = 48, 63.2%) used less than 30 min (mean 29.7 min, median 23.0 min) to participate in virtual visits. When asked how much time they would have had to use if they had had a face-to-face appointment at the hospital, most (n = 23, 29.9%) answered 2–4 h (mean 118.7 min). Few (n = 19/75, 25.3%) wished they had a video connection for the visit. Patients travelled a mean of 31.4 km and saved a mean of 13.84€. When asked their likelihood to recommend virtual visits to a friend, 77 patients gave an average grade of 6.8 (scale 0–10). No significant relationship between likelihood to recommend and age, sex, ailment, distance, money saved, and mode of transport was found. The further away from the hospital the patient lived the more likely the patient was to recommend virtual visits (borderline significance, p = 0.050). No significant relationship existed between patient-staff interaction and age, sex, ailment, distance, and money saved. Patients who would have walked or bicycled to the hospital ranked patient-staff interaction as poor or very poor significantly more often than those using other transport (p = 0.013). Patients with a shorter distance to the hospital ranked staff interaction more poorly (borderline significance, p = 0.050).

Fig. 1
figure 1

Flow chart of study participants

Table 4 Demographics and experiences of 77 patient respondents during virtual visits at the Head and Neck Center of Helsinki University Hospital

Patient safety incidents

From March 1, 2020 until December 31, 2021 1,365 patient safety reports were submitted by Head and Neck Center staff; only two were related to virtual visits—both occurring during 2021. One was a misunderstanding, in which the patient did not attend laboratory testing before the virtual visit due to unclear instructions. The other incident occurred years earlier but came to light during a virtual visit when the treating physician noticed the patient had not been operated on as had been planned. In other words, no patient safety reports were filed because of an event directly occurring during a virtual visit.


Staff opinions seemed to be quite polarized – both vehemently for and against virtual visits. In general, staff felt virtual visits were useful for certain situations and patient groups, and beneficial in addition to face-to-face visits, not instead of them. Virtual visits brought savings in both time and money, in addition to reducing the carbon footprint of health care.

Most patients and staff felt ailments were completely treated during virtual visits, and staff rarely needed to reserve a face-to-face visit for patients due to inability to treat during virtual visits. These patients rarely had unplanned visits after virtual visits and most needed no face-to-face follow-ups in a previous 2-year follow-up study by our group [4]. Patient selection for these virtual visits seems apt.

Staff felt virtual visits took the same amount, or less, time. Virtual visits saved patients’ time dramatically (mean 29.7 min vs. 118.9 min). This temporal savings is also compelling to employers, which is often forgotten when calculating the cost of health care. While savings in travel costs were small, the fee billed from patients for virtual visits is also smaller than for face-to-face visits, thus increasing patient savings. In addition, one-third of patients said they would have had to take time off work if the visit had been at the hospital, consequently increasing patient savings and socioeconomic productivity. More than half of patients would have travelled by car, taxi, or bus i.e., means of transport that produce carbon emissions. Patients on average would have travelled 31.4 km. By replacing visits, which do not necessarily need to be face-to-face, with virtual visits, carbon emissions can be greatly reduced and even a small reduction is significant to the environment.

The success of the standardized virtual visit protocol for tonsil patients at our clinic prompted the development of a digital treatment pathway, which greatly reduced the time required for staff to treat these patients, cutting costs even more, and leading to the cessation of tonsil virtual visits [12]. Consequently, virtual visits can be a testing ground for future development of digital patient services.

Dedicated space for virtual visits is a must to ensure confidentiality and allow a calm environment for patient treatment without interruptions. Patient trust may be lost if a patient hears or sees others or feels staff is unable to concentrate on their ailment. Patients with hearing loss may have trouble participating in virtual visits if background noise drowns out the voice of their clinician or the connection is not clear. Evaluation of voice problems is also hampered if the patient’s voice cannot be properly heard, and vice versa, during speech therapy.

Working from home via virtual visit, even occasionally, was important to some to improve their work wellness and could provide an excellent alternative to sick leaves for ailments that do not necessarily impair the ability to work. Virtual visits could possibly decrease infection transmission in hospitals between patients and staff, decreasing the staff’s risk of illness. Most staff members felt virtual visits were as or less exhausting than face-to-face visits, making virtual visits a good way to lighten patient lists and free up nursing and room resources.

One possible downside of virtual visits is their impact on staff training. Training of junior staff members during virtual visits is rather complex, depending on the platform used for the visit. If the telephone is used, it may be confusing to the patient as to who is talking and what their role is. If using a video or digital platform, the senior and junior members of staff must be in the same room, therefore limiting telecommuting.

Surprisingly, only a minority of patients, but most staff, wished they had a video connection. The inability to gauge patient reaction and observe body language and physical features was seen by staff as a weakness of virtual visits without a video connection. A previous study found video connectivity, audio/visual definition, and ease of use to be important factors in patient satisfaction during virtual visits [13], which were mentioned as important to staff satisfaction in this study.

Finland has always been at the forefront of mobile services and digitalization: 97% of Finns have used the internet in the last three months compared to 66% worldwide [14]. Of 16–74-year-old Finns, 96% have smart phones [15]. Finns’ familiarity and comfort with digital services probably helped with their acclimation to virtual visits. In countries with less digital nativity, care should be taken to ensure patients have access to the tools necessary for virtual visits. For patients without this equipment, other forms of treatment must be available to insure equity of care.

Whenever new practices are introduced in medicine, safety must be evaluated. The hospital district requires units to perform risk analysis and draw up a self-monitoring plan to guarantee patient safety and quality of care before starting virtual visits. No patient safety incidents were filed connected to events occurring during virtual visits. While the HaiPro system is voluntary, it does give us an idea of safety. No missed diagnoses were found upon chart review for the patients in this study [4]. However, the potential for missed diagnoses must be remembered when conducting and planning telemedicine services. A standardized protocol for the most common ailments being treated, including red flag symptoms, is one approach to prevention. In addition, the availability of live visits must be secured so patients can also be examined if a red flag comes up during a virtual visit or if staff otherwise feels it is essential to treatment. Patients should be able to opt out of virtual visits if they are not comfortable with telemedicine. Patients must also be clearly informed as to how their treatment will continue after the virtual visit and what to do if they do not receive the next appointment or referral. Involving and activating patients in their treatment is crucial for the success of telemedicine. This is one example of how telemedicine can be used to monitor treatment between live visits.

Limitations of the study included its retrospective nature and small sample size in the patient group. The patient response rate is very low and therefore one cannot make any generalizations about the patient viewpoint of the service. Rather the findings can be an indication as to where further research can be undertaken. Readers must take this into account when assessing the data in the paper. As questionnaires were sent to patients sometime after their virtual visit, their answers may not be completely accurate due to recall bias. We also did not approach patients from other head and neck center specialties by questionnaire. Patients with eye or oral ailments may have felt differently than ENT patients. However, staff respondents comprised a good mix of professions, levels of experience and subspecialties. Non-responder bias is also present, as with all studies involving questionnaires. Nevertheless, the distribution of responders and non-responders into age groups and ailments is very similar, thus ensuring a representative sample.


While telemedicine was implemented during the COVID-19 pandemic to ensure patient treatment, its usefulness after the pandemic must be examined. This is an opportunity to advance leaps and bounds in how we offer services to patients. It is important to evaluate treatment pathways and ensure that the quality of care is upheld while new treatment protocols are introduced.

Availability of data and materials

The datasets used and analyzed during the current study are available from the corresponding author on reasonable request.



Coronavirus disease


Ear, nose and throat


General Data Protection Regulation


Oral and maxillofacial surgery


  1. Givi B, Schiff BA, Chinn SB, Clayburgh D, GopalakrishnaIyer N, Jalisi S, et al. Safety Recommendations for Evaluation and Surgery of the Head and Neck During the COVID-19 Pandemic. JAMA Otolaryngol Head Neck Surg. 2020;146(6):579–84.

    Article  PubMed  Google Scholar 

  2. Kowalski LP, Sanabria A, Ridge JA, Tong Ng W, de Bree R, Rinaldo A, et al. COVID-19 pandemic: Effects and evidence-based recommendations for otolaryngology and head and neck surgery practice. Head Neck. 2020;42(6):1259–67.

    Article  PubMed  PubMed Central  Google Scholar 

  3. Alshareef M, Alsaleh S, Albaharna H, Alghulikah A, Aloulah M, Alroqi A, et al. Utilization of telemedicine in rhinologic practice during COVID-19 pandemic. Am J Otolaryngol. 2021;42(3):102929.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  4. Tolvi M, Lahti T, Aaltonen LM. Otorhinolaryngology Virtual Visits During the COVID-19 Pandemic: A 2-Year Follow-Up Study. Telemed J E Health. 2023;29(5):665–73.

    Article  PubMed  Google Scholar 

  5. Edison MA, Connor MJ, Miah S, El-Husseiny T, Winkler M, Dasguptta R, et al. Understanding Virtual Urology Clinics: A Systematic Review. BJU Int. 2020;126(5):536–46.

    Article  PubMed  Google Scholar 

  6. Choi JS, Lin M, Park S, Abdur-Rahman F, Kim JH, Voelker CCJ. Physician satisfaction with telemedicine and in-person visits in otolaryngology. Am J Otolaryngol. 2022;43(5):103596.

    Article  PubMed  Google Scholar 

  7. Appireddy R, Khan S, Leaver C, Martin C, Jin A, Durafourt BA, et al. Home virtual visits for outpatient follow-up stroke care: cross-sectional study. J Med Internet Res. 2019;21(10):e13734.

    Article  PubMed  PubMed Central  Google Scholar 

  8. Layfield E, Triantafillou V, Prasad A, Deng J, Shanti RM, Newman JG, et al. Telemedicine for head and neck ambulatory visits during COVID-19: Evaluating usability and patient satisfaction. Head Neck. 2020;42(7):1681–9.

    Article  PubMed  PubMed Central  Google Scholar 

  9. National Supervisory Authority for Welfare and Health. Telemedicine services’ guidelines. Accessed 21 Feb 2023.

  10. Palojoki S, Mäkelä M, Lehtonen L, Saranto K. An analysis of electronic health record–related patient safety incidents. Health Informatics J. 2017;23(2):134–45.

    Article  PubMed  Google Scholar 

  11. Reporting System for Safety Incidents in Health Care Organizations. Accessed 5 Oct 2022.

  12. Hakanen O, Tolvi M, Torkki P. Cost analysis of face-to-face visits, virtual visits, and a digital care pathway in the treatment of tonsillitis patients. Am J Otolaryngol. 2023;44(4):103868.

    Article  PubMed  Google Scholar 

  13. Rodrigues A, Yu JS, Bhambhvani H, Uppstrom T, Ricci WM, Dines JS, et al. Patient Experience and Satisfaction with Telemedicine During Coronavirus Disease 2019: A Multi-Institution Experience. Telemed J E Health. 2022;28(2):150–7.

    Article  PubMed  Google Scholar 

  14. Finnish Federation for Communications and Teleinformatics. Accessed 21 Feb 2023.

  15. STT info. Accessed 21 Feb 2023.

Download references


The authors thank the staff of the Head and Neck Center of Helsinki University Hospital for participation in the study. The authors also thank statistician Tero Vahlberg for his statistical contribution.


Open Access funding provided by University of Helsinki including Helsinki University Central Hospital. Financial support was received from The Research Fund of Helsinki University Hospital for statistical analysis.

Author information

Authors and Affiliations



M.T. and L-M.A. conceptualized this study. M.T. led data collection. All authors assisted in staff recruitment. M.T. oversaw the statistical analysis of participant demographics. M.T. and L-M.A. were the primary contributors to the writing of the manuscript. S.A. retrieved patient safety incident data from the hospital database. All authors contributed to editing, reviewing, and approved the final manuscript.

Corresponding author

Correspondence to Morag Tolvi.

Ethics declarations

Ethics approval and consent to participate

The study was approved by the independent Ethics Committee II of Helsinki University Hospital (HUS/2242/2020) and by the Research Administration of the hospital (§ 69, HUS/146/2020). All participants gave their informed consent by participating in the voluntary, anonymous questionnaire. All methods were carried out in accordance with the relevant guidelines, regulations and the Helsinki Declaration.

Consent for publication

Not applicable.

Competing interests

The authors declare no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit The Creative Commons Public Domain Dedication waiver ( applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Tolvi, M., Oksanen, LM., Lehtonen, L. et al. Virtual visits at the Helsinki Head and Neck Center during the COVID-19 pandemic: patient safety incidents and the experiences of patients and staff. BMC Health Serv Res 23, 483 (2023).

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: