- Research
- Open access
- Published:
Has cross-level clinical coordination changed in the context of the pandemic? The case of the Catalan health system
BMC Health Services Research volume 24, Article number: 959 (2024)
Abstract
Background
The COVID-19 pandemic triggered numerous changes in health services organisation, whose effects on clinical coordination are unknown. The aim is to analyse changes in the experience and perception of cross-level clinical coordination and related factors of primary (PC) and secondary care (SC) doctors in the Catalan health system between 2017 and 2022.
Methods
Comparison of two cross-sectional studies based on online surveys by means of the self-administration of the COORDENA-CAT (2017) and COORDENA-TICs (2022) questionnaires to PC and SC doctors. Final sample n = 3308 in 2017 and n = 2277 in 2022. Outcome variables: experience of cross-level information and clinical management coordination and perception of cross-level clinical coordination in the healthcare area and related factors. Stratification variables: level of care and year. Adjusting variables: sex, years of experience, type of specialty, type of hospital, type of management of PC/SC. Descriptive bivariate and multivariate analysis using Poisson regressions models to detect changes between years in total and by levels of care.
Results
Compared with 2017, while cross-level clinical information coordination remained relatively high, with a slight improvement, doctors of both care levels reported a worse experience of cross-level clinical management coordination, particularly of care consistency (repetition of test) and accessibility to PC and, of general perception, which was worse in SC doctors. There was also a worsening in organisational (institutional support, set objectives, time available for coordination), attitudinal (job satisfaction) and interactional factors (knowledge between doctors). The use of ICT-based coordination mechanisms such as shared electronic medical records and electronic consultations between PC and SC increased, while the participation in virtual joint clinical conferences was limited.
Conclusions
Results show a slight improvement in clinical information but also less expected setbacks in some dimensions of clinical management coordination and in the perception of clinical coordination, suggesting that the increased use of some ICT-based coordination mechanisms did not counteract the effect of the worsened organisational, interactional, and attitudinal factors during the pandemic. Strategies are needed to facilitate direct communication, to improve conditions for the effective use of mechanisms and policies to protect healthcare professionals and services in order to better cope with new crises.
Introduction
Cross-level clinical coordination is a priority for health systems, particularly for national health systems (NHS) based on primary care (PC), such as the Catalan health system, as it contributes to care quality and efficiency [1, 2]. Among others, it is highly relevant for the care of patients with chronic conditions or complex needs, who frequently transit across different levels of care over time [3, 4]. It has been addressed in the last decades by a range of policies and organisational strategies to promote care coordination [5,6,7], which underwent a rapid transformation during the pandemic [8, 9].
Clinical coordination is here defined [10] as the harmonious connection of the different health services needed to provide care to a patient throughout the care continuum to achieve a common objective without conflicts and it is analysed based on a comprehensive theoretical framework [11, 12]. Two types are distinguished [12]: (a) clinical information coordination, that refers to the transfer and use of the patient clinical information between providers and (b) clinical management coordination, which involves healthcare provision in a sequential and complementary way and encompasses three dimensions: consistency of care, adequate patient follow-up and accessibility between levels. Clinical coordination is influenced, among others, by organisational factors, such as institutional support, the existing cross-level coordination mechanisms, time available to coordinate and integration of providers’ management [13] and interactional factors, such as knowledge between doctors or attitudinal factors, job satisfaction [13].
During the COVID-19 pandemic, several organisational changes were introduced in the health services, to reduce the risk of contagion while maintaining an appropriate response to the population healthcare needs [8, 9, 14], the effects of which on clinical coordination and its related factors is unknown. On the one hand, there was an acceleration in the introduction of information and communication technologies (ICT) based-coordination mechanisms [8, 15, 16], such as shared electronic medical records (EMR) or electronic consultations between PC and secondary care (SC) [8, 16], which should have increased cross-level clinical information coordination by facilitating transfer of information between levels [2] and clinical management coordination by improving access to SC and adequacy of referrals [17]. On the other hand, the cancellation of non-urgent treatments, tests, or consultations [8], especially during the first waves of the pandemic, and the introduction of telephone triage [8] and the rapid adoption of telemedicine [9, 18] opened new avenues of access to services that increased professionals workload, especially in PC [19], decreasing the time available to coordinate with the other level [8].
Despite its relevance, international evidence on cross-level clinical coordination during the pandemic is scarce. No methodological solid studies have been identified and the few reports mostly based on clinical records review of specific health services focused on evaluating one dimension of clinical coordination, accessibility between levels, reporting a global backlog in access especially to SC [20, 21]. The analysis of changes in factors influencing coordination is even more limited, and mostly explored by surveys to SC doctors that analysed job satisfaction during the pandemic [22, 23].
The Catalan NHS is part of the Spanish NHS, which is funded by taxes, of universal access and decentralised to the regions [24]. The provision of healthcare is organised into two care levels: PC, which acts as the gatekeeper and coordinator of the patient care throughout the care continuum, and SC that acts as a consultant to PC and is responsible for the management of more complex procedures [24]. in the Catalan NHS, patient care is the responsibility of a variety of providers: a large public entity, the Catalan Health Institute, and several public consortia, municipal foundations, and some private foundations (mostly non-profit but also some for-profit), which make up the Integrated Healthcare System for Public Use [25]. This diversity has originated differences in the type of management of PC and SC providers across the different healthcare areas (1) integrated: PC and SC providers are mostly managed by the same entity; (2) partially integrated: an entity manages SC and some PC centres, while the rest are managed by other entities, and (3) non-integrated: where PC and SC are managed by different entities [26, 27]. This complexity makes cross-level coordination even more relevant. Before the pandemic, the Catalan NHS had implemented several strategies, such as promoting integrated management or the introduction of a variety of coordination mechanisms, such as case managers, liaison nurses or shared protocols between levels, including ICT-based mechanisms, such as shared EMRs and electronic consultations between professionals [28], with great differences in implementation between areas and services [29]. Analysis on the changes during the pandemic in Spain or Catalonia are limited to few studies on accessibility of specific SC services that reported an increase in waiting times [30, 31] and a survey to PC doctors showing a low perception of clinical coordination between levels [32]. Regarding influencing factors, a study showed an increase in the use of electronic consultations [31] and a low satisfaction with the job was reported by a survey to SC doctors in training [33].
This study allowed us to explore whether there were any changes in cross-level clinical coordination and influencing factors in the Catalan health system during the pandemic and identify elements to guide strategies for improving it.
Methods
Aim
The aim of this study, which forms part of a wider research [34], is to analyse the changes in the experience, perception of cross-level clinical coordination of primary care (PC) and secondary care (SC) doctors and related factors in the Catalan health system between 2017 and 2022.
Study design and areas of study
A comparative analysis was conducted of two cross-sectional studies based on the online surveys by means of the self-administration of the COORDENA-CAT (2017) and COORDENA-TICs (2022) questionnaires by primary (PC) and secondary care (SC) doctors of the Catalan National Health System. In both years, the areas of study were defined based on the primary healthcare areas (PCC) and their referral hospitals (acute, and in 2017 also long-term care).
Study population and sample
The study population consisted of PC and SC doctors that had been working for at least one year in the organisation, and whose daily practice involved direct contact with patients, and with doctors of the other care level. Specialists in pathology, immunology, neurophysiology, radiology, pharmacy and clinical analysis and preventive medicine were excluded. In both surveys, the selection of the sample took place in two stages. In the first, 41 healthcare areas and its organisations belonging to the Catalan public health system were invited to participate (in 2022, starting by those that had already participated in 2017). In the second, those organisations that agreed to participate, sent an invitation with the questionnaire to all doctors who met the inclusion criteria. The final sample in 2017 was 3,308 doctors of 15,813 invited to participated (21% participation rate) and in 2022, a total of 2,277 doctors of 12,987 invited (17.5% participation rate). Of the 41 healthcare areas invited, in 2017, 32 areas participated both with primary care centres and hospitals, while in 2022, 22 areas did so.
Questionnaire
In 2017, the COORDENA questionnaire, which had been developed following the theoretical framework underlying this study [35] was adapted, pre-tested, piloted, and validated for the Catalan context [36]. It consists of three main sections: the first measures doctors’ experience of cross-level clinical information and clinical management coordination and perception of coordination within the healthcare area, by means of 12 items (described in detail in the variables of analysis section) and using a Likert scale and two open-ended questions on their reasons for that perception and suggestions for improvement. The second section measures the availability and use of cross-level clinical coordination mechanisms (shared electronic medical records (EMR), electronic consultations, telephone consultations, email consultations, joint clinical case conference, liaison nurses, shared protocols, and guidelines); and the third, individual, organisational and interactional factors that influence clinical coordination. In 2022, the questionnaire was slightly modified and renamed as COORDENA-TICs [34]. This new version keeps all main sections and all items of doctors’ experience of cross-level clinical information and clinical management coordination, perception of coordination and of factors related to clinical coordination. The adaptation relies in the coordination mechanisms section, that focuses on ICT-based coordination mechanisms but maintaining the items. Additional items related to the pandemic and some characteristics of use of some mechanisms were included but were not analysed in this study [Additional file 1].
Data collection
Data collection for the first survey took place between October and December in 2017 and for the second, between May and June of 2022 and October 2022 to April 2023. In both surveys, all PC and SC doctors who met the inclusion criteria of the organisations that agreed to participate, were invited to answer the questionnaire. To promote doctors’ participation, the involved organisations conducted informative sessions and displayed posters and posts in their institutional intranets. The invitation was sent to their corporate e-mail address, and included a link randomly generated that provided anonymous access to the questionnaire. The participants had the possibility of closing the incomplete questionnaire and retaking it on another occasion, and as many times as they wished, as long as it had not been sent.
Variables of analysis
The outcome variables were (a) experience of cross-level coordination of clinical information (information transfer and use; 3 items) and of clinical management (consistency of care, adequate follow-up, and accessibility; 11 items); (b) general perception of cross-level coordination in the area (1 item); (c) organisational, interactional, and attitudinal related factors (8 items); (d) use of ICT-based coordination mechanisms (shared EMR of the region (HC3/HES) and of the organisation and, electronic consultations through EMR, telephone consultations, email consultations and joint clinical session through videoconference (in 2022) (12 items). The explanatory variables were stratification variables: year and level of care and, adjustment variables: (a) sociodemographic: sex, type of speciality (clinical and surgical/clinical-surgical), (b) employment characteristics: years working as a doctor (c) type of hospital (local/regional, high-resolution, high-technology); and type of area according to the management of PC/SC (integrated, partially integrated, non-integrated).
Analysis
A bivariate descriptive analysis stratified by level of care (primary and secondary care) and year was conducted to determine the distribution of the outcome and explanatory variables. To identify differences between years in total and within the subgroups, the Chi-square test was used. To analyse the changes in the degree of clinical coordination and related factors including use of ICT-based coordination mechanisms between the two years in the total sample and within the levels of care, Poisson regression models with robust variance were estimated, obtaining prevalence ratios (PR) and their 95% confidence intervals (CI 95%), adjusting for the explanatory variables: level of care, sex, years working as a doctor, type of specialty, and type of hospital, in the case of the aggregated analysis of the sample. And sex, years working as a doctor, type of specialty, and type of hospital for the subgroup analysis. Type of area according to the management of PC/SC was used to control for a possible cluster effect. Participants who answered don’t know/no answer were excluded. Bayesian and Akaike reporting criteria were used to assess the fitness of the models.
Missing values were low for the outcome variables related to the experience and perception of clinical coordination (0.66–7.26%) and those related to factors and use of coordination mechanisms varied from 2.23 to 17.35% and were at random [see Additional file 2]. Percentage of missing values for explanatory variables varied from 0 to 19.46% and were at random [see Additional file 2]. A full case analysis to manage missing values was adopted. To make the results more robust, sensitivity analyses were performed to evaluate two alternative scenarios (1) analysis of the data after doing multiple imputation of those variables with a percentage of missing values higher than 10% [see Additional file 2] and (2) analysis of the data including the participants who answered do not know/no answer to the questions [see Additional file 3]. In both cases, there were not significant differences with the results presented in this article. Finally, a content analysis was performed for the open-ended questions on reasons for the general perception of cross-level clinical coordination in the healthcare area and suggestions for improvement in 2022. The answers were coded and classified into categories. Frequencies were calculated and presented stratified by level of care. Statistical analyses were conducted using Stata v.15.
Results
Characteristics of the sample
The sample composition was similar in both study years, with some differences. In 2022, most doctors still were women, but the proportion slightly decreased in PC (68.51% in 2017 to 66.50%) and increased in SC (51.76–53.62%) and in both levels most doctors still were between 41 and 55 years of age. Most doctors in both levels had clinical specialities, but the proportion of doctors with surgical (9.23% in 2017 to 14.85%) and medical/surgical (12.37% in 2017 to 23.31%) specialities considerably increased in SC and dropped almost to zero in PC [Table 1]. Regarding employment characteristics, one third of SC doctors still had 11–20 years’ work experience and 6 to 15 years working in the organisation (30.09% and 31.34% respectively), while in the case of PC, there was an increase of the doctors who had 21 to 30 years’ work experience (30.67% in 2017 to 38.79%) and 16 to 25 years working in the organisation (33.58% in 2017 to 37.22%). The proportion of doctors with a permanent contract increased in SC (88.10% in 2017 to 92.96%) and decreased in PC (96.31% in 2017 to 93.57%) and in both levels increased those with a full-time contract (PC: 92.71% in 2017 to 96.40%; SC: 91.44% in 2017 to 94.25%). Finally, regarding the type of area, the highest proportion of doctors worked in an area where the same entity manages SC and the majority of PC (44,04% in 2017 and 46,60% in 2022) and this proportion increased in SC (45.22% in 2017 to 50.45%). In terms of the type of hospital, the proportion of doctors working on an area with a high-technology hospital almost doubled (19.38 in 2017 to 38.21%) [Table 1].
Changes in doctor’s experience and perception of cross-level clinical coordination
Compared with 2017, the degree of cross-level coordination of clinical information (transfer and use) experienced by doctors was still high in 2022, with a slight increase of those reporting that the information they share is needed for the patient clinical management (PR:1.07, CI 95% 1.03–1.10), which was higher among PC doctors (PR:1.08, CI 95% 1.03–1.12) [Table 2].
Regarding cross-level coordination of clinical management, when compared with 2017, there were improvements in the relative high levels of experience but also setbacks in 2022. Regarding consistency of care, there was an increase in the relatively high proportion of doctors who reported agreeing with the treatments prescribed at the other care level (PR:1.02, CI95% 1.01–1.04), which was higher in PC doctors (PR:1.09, CI95% 1.06–1.12). However, there was a worsening in the already very low proportion of doctors who reported that joint patient management plans were established when needed (PR:0.90, CI95% 0.83–0.97) with no differences between levels, and an increase in the repetition of tests (PR:1.19, CI95% 1.06–1.32) [Table 2].
Concerning adequate follow-up between levels, when compared with 2017, the high proportion of doctors who considered that patients were adequately referred to SC decreased, and this decrease was higher in SC doctors (PR:0.96, CI95% 0.92–0.99). Likewise, the relatively high proportion of PC doctors who reported that SC doctors send patients to PC when appropriate decreased (PR:0.94, CI95% 0.91–0.97). Although there is still room for improvement, the proportion of PC doctors who reported receiving follow-up recommendations from SC doctors improved (PR:1.16, CI95% 1.09–1.24) and the proportion of doctors of both levels that reported that PC doctors consult with SC doctors doubts on the patient follow-up also increased (PR:1.10, CI95% 1.05–1.15) and this increase was higher among PC doctors [Table 2].
Regarding accessibility between levels, there was an increase in the already high proportion of doctors at both levels who reported long waiting times for patients to be seen after being returned to PC (PR: 1.52, CI95% 1.26–1.83), which was higher for SC doctors [Table 2].
Finally, the already low perception of cross-level clinical coordination in the healthcare are in 2017 has worsened by 2022 (PR: 0.78, CI95% 0.66–0.93) and more so among SC doctors (PR: 0.78, CI95% 0.69–0.88) [Table 2]. Reasons for considering the coordination to be low continued to be the limited direct communication between professionals and the insufficient availability of coordination mechanisms that promote cross-level communication [Fig. 1]. In the same line, main suggestions for improvement of cross-level clinical coordination included implementation of joint clinical case conferences and other mechanisms for direct communication between levels, as well as improving the existing coordination mechanisms [Fig. 2].
Changes in factors influencing cross-level clinical coordination, including use of ICT-based coordination mechanisms
Compared with 2017, there was a worsening of some organisational factors that influence cross-level clinical coordination, with an improvement in use of some ICT-based coordination mechanisms in 2022. On the one hand, there was a decrease in the already relatively low proportion of doctors reporting that their organisation’s management facilitated cross-level clinical coordination (PR: 0.78, CI95% 0.75–0.81) or set objectives aimed at cross-level clinical coordination (PR: 0.82, CI95% 0.78–0.87) and this decrease was higher among SC doctors [Table 3]. The proportion of those reporting to have enough time to dedicate to coordination, which was already low in 2017, decrease even more in 2022, especially among SC doctors (PR: 0.70, CI95% 0.61–0.81) [Table 3].
On the other hand, in 2022 there was an increase, among doctors from both levels of care who had access to [Additional file 4] and frequent use of some ICT-based coordination mechanisms such as, the shared EMR of the region (HC3/HES) (PR:1.21, CI95% 1.15–1.27) and the shared EMR of the organisations (PR:1.07, CI95% 1.04–1.11), that was already relatively high. This increase in use for both EMRs was higher among SC doctors, although they continue to be more used by PC doctors. There was also an increase in the relatively low proportion of doctors using electronic consultations between levels through EMR, especially by PC doctors (PR:1.48, CI95% 1.29–1.70) [Table 3]. Nonetheless, difficulties in the use of the mechanisms such as contradictory or disorganised information, technical problems, or lack of relevant information were reported [Additional file 5]. In addition, participation in joint clinical case conferences (PR: 0.89, CI95% 0.81–0.98) and use of email consultations (PR:0.66 CI95% 0.50–0.88) decreased, especially among PC doctors [Table 3].
As for interactional factors related to cross-level clinical coordination, when compared with 2017, the already low proportion of doctors that reported knowing doctors from the other level decreased (PR:0.56 CI95%. 0.43–0.72), especially among PC doctors. While factors such as trusting in the clinical skills of the other level’s doctors and perceiving that their own practice influences the other level’ remained high, with no differences between years or levels. Finally, doctors’ relatively high satisfaction with their job in their organisations fell significantly at both levels of care (PR: 0.91, CI95% 0.89–0.93) [Table 3].
Discussion
Improving cross-level clinical coordination is essential for healthcare systems based on PC, given the increasingly complex health needs of the patients, which often require care by multiple professionals at different levels of care [3, 4]. To address this challenge in recent years European healthcare systems have promoted the implementation of ICT-based coordination mechanisms as tools to improve communication and collaboration between professionals, as well as accessibility, quality, and efficiency [37]. Moreover, the disruption generated by the COVID-19 pandemic to the health services accelerated the introduction of those mechanisms, among other measures, but their impact on clinical coordination and quality of care is unknown and needs to be analysed to guide future strategies and to contribute to increase health systems resilience. This is the first study that comprehensively analyse changes in the experience and perception of clinical coordination of PC and SC doctors, and related factors, in a NHS following the pandemic, allowing the identification of areas for improvement.
Results show, with some differences between levels, that in 2022 the experience of cross-level coordination of clinical information remained relatively high, with slight improvement, while the experience of coordination of clinical management showed both improvements and setbacks related to cross-level care consistency and patient follow-up. Cross-level accessibility continued to be low and, particularly access to PC has worsened. Likewise, the already low perception of clinical coordination in the healthcare area worsened. There were also setbacks in the organisational factors related to coordination, although there was an improvement in the use of some ICT-based coordination mechanisms. In addition, interactional and attitudinal factors worsened.
Changes in the experience of clinical coordination highlights some resilience but also the need for improvement measures
Despite the relatively high experience of coordination of cross-level clinical information that remained in 2022, there was a worsening of some aspects related to consistency of care, such as tests repetition and contraindications and/or duplications of prescribed treatments, which should have improved with the increased use of the ICT-based coordination mechanisms (EMR, electronic consultations). This is probably related, on the one hand, to the difficulties reported such as, technical problems or outdated or contradictory information [38] and on the other hand, to the uneven implementation throughout the healthcare areas [39, 40] due to the diversity of service provision that characterises the Catalan NHS [52,53,54], pointing out the difficulties of implementing shared ICT-based coordination mechanisms and the efforts to overcome them [15, 25, 28]. Therefore, it is necessary for the health authority to address the problems related to the interoperability and uneven implementation of EMRs and electronic consultations [41, 42], promoting, in collaboration with the different stakeholders, the implementation of a single electronic health record throughout the territory, on which the rest of the ICT-based coordination mechanisms are based [43, 44].
Regarding clinical management coordination, there was an improvement in the agreement on prescribed treatments, consultation of doubts by PC and recommendations made by SC that could be related to the increase in the use of electronic consultations through the EMR, whose main use is to request the clinical opinion of colleagues in their area of expertise [11, 17]. However, it seems to be insufficient to improve the limited joint definition of individualized treatments plans, which fell even more in 2022. This could be explained by that shared management of patients with complex needs requires other types of direct synchronous feedback mechanisms (e.g., telephone consultations, joint clinical case conferences) [11, 43, 44]. The results of the study show precisely that the low mutual knowledge reported by doctors before the pandemic has been intensified, among others, because of the backlog in the use of mechanisms that allow direct contact such as joint clinical case conferences and the high staff turnover that healthcare organisations have faced during the pandemic [45], making interaction between professionals even more difficult.
The COVID-19 added pressure to healthcare professionals [8, 19] by increasing work overload with subsequent mental stress and exhaustion, especially in PC [46, 47], and may have contributed to the increase of inadequate referrals reported by PC and SC doctors. On the one hand, some studies have shown that it may be more difficult for mentally stressed and exhausted doctors to perform an adequate anamnesis [48, 49] and thus make proper referrals and, on the other, the increased use of ICT-based mechanisms may have exacerbated the stress [50, 51] and increased the unnecessary referrals to SC to release work overload [52]. Moreover, as some of the PC doctors reported that SC doctors refused referrals without explanation, the lack of proper feedback could lead to repeated unnecessary referrals. So, further research is needed to analyse more in-depth the factors related with this worsening, as well as, to promote strategies to improve the working environment of professionals, since it might have a negative impact on coordination and quality of care.
Finally, the results show an important decrease in the already limited accessibility between levels before the pandemic, with long waiting times to SC, and, particularly to PC. These results are in line with the available evidence [20, 21, 30, 31] that analyse the consequences of the measures introduced during the pandemic (elective procedures postponed, resources redirected to COVID-19 care, shift to telemedicine, etc.) [8, 20, 37, 53], that affected the functioning of health services already under pressure (and underfunded) due to the austerity measures introduced during the last financial crisis [16]. These results call into question the effectiveness of measures that were put in place to improve accessibility during the pandemic, such as the use of electronic consultations between levels [16]. In this regard, some studies have linked their use to increased barriers of access to SC, as SC doctors could refuse face-to-face referrals until additional tests were performed, among others [54]. It is also necessary to strengthen access to PC, among others, by promoting reorganisation plans in PC that includes mixed face-to-face/telematic consultations and optimisation of resources, so that it can properly act as the gatekeeper to the NHS and coordinator of patients care throughout the healthcare process [8].
Reduction in the poor perception of cross-level clinical coordination may be related to setbacks in organisational, interactional, and attitudinal factors during and after the pandemic
Despite maintenance or improvement in some aspects of the experience of clinical coordination between levels, there was a significant worsening in the perception of coordination in the healthcare area, already low before the pandemic, especially among SC doctors. This is congruent with a survey carried out with PC doctors of Catalonia during the first waves of the pandemic that showed a perception of lack of coordination, especially with emergency rooms and hospital outpatient care [32]. The results of the analysis of changes in factors related to coordination show that this drop may be related to: (1) the decrease in the use of synchronous coordination mechanisms such as joint clinical case conferences that facilitate direct communication, collaboration, and mutual knowledge [55]; (2) the decrease in institutional support to provide the appropriate conditions for coordination (time, common objectives, etc.); (3) the decrease in job satisfaction, also described in the literature [32, 56], and in addition to the above-mentioned factors, to the general worsening of working conditions and the burnout to which they are subjected [56, 57], especially in primary care [32]. The worsening of all these factors, which would have been exacerbated during the first waves of the pandemic, does not seem to have been reversed in the subsequent phases. Therefore, it is necessary to further analyse the causes of the high job dissatisfaction of professionals and organisational factors such as institutional support, to promote the implementation of strategies for their improvement.
Improving doctors’ mutual knowledge and existing coordination mechanisms: strategies proposed by doctors to improve cross-level coordination
Results on doctors’ suggestions to improve clinical coordination between levels referred to improving organisational and interactional factors and are consistent with previous results [58], highlighting the way forward and the relevance of involving professionals in the selection and design of interventions [59]. First, they suggested the implementation of mechanisms that promote direct communication and knowledge between professionals, essential factors to improve the experience and perception of coordination [60, 61]. Although ICT-based coordination mechanisms (e.g., shared EMR or electronic consultations) have been introduced to address this issue [28], due to their potential for improving transfer of clinical information and communication between professionals [17, 38], they need to be used in combination with others that allow verbal communication, feedback and standardisation of processes [40, 55, 58, 62] -specifically joint clinical case conferences, direct synchronous communication channels (telephone) between PC and SC and shared protocols-, even though they are more time consuming, they allow to establish common clear pathways of diagnosis and treatment and collaboration [40, 55]. Hence, the importance of facilitating an organisational environment that allows their proper use: time and an increase in needed resources [63].
Second, they suggested the improvement of the existing coordination mechanisms, in keeping with the evidence that difficulties -especially those affecting interoperability and safety- can discourage their use and limit the impact on clinical coordination [38, 42, 51]. Interventions for improving clinical coordination are often introduced but are not designed or evaluated in a participatory way [64], although the involvement of professionals in the process can be relevant to correct deficiencies or difficulties that may arise and generates greater acceptance, increasing its sustainability over time [65]. In short, results show the need for development of multicomponent strategies that include the participation of professionals in the identification of difficulties and design of mechanisms, since their involvement is key to adapt the strategies to the conditions and needs of each context to ensure that they can be properly implemented [59].
One of the potential limitations of this study is that there may have been a selection bias due to the self-administered nature of the questionnaire and the non-probabilistic sampling of the areas. Nevertheless, the characteristics of the sample were similar to the universe of doctors in the Catalan NHS [66,67,68] and the diversity of the health areas of the Catalan Health System was represented. Finally, a drop in participation in 2022, which may have been influenced by the critical time in which the survey was conducted, the beginning of the recovery after the increase in infections by the omicron variant of COVID-19 [69]. Nevertheless, the participation rate was within the expected range for an online survey [70].
Conclusions
The COVID-19 pandemic was a challenging milestone that put a great pressure on health systems. It led to the rapid adoption of strategies to ensure healthcare to the population such as ICT-based coordination mechanisms. However, its impact on clinical coordination is unknow. This study analysed the changes in the different dimensions of cross-level clinical coordination and related factors that occurred in the Catalan NHS after the pandemic. Its results help to identify areas of improvement and make recommendations that are also useful for others NHS.
Even though there was an increased use of coordination mechanisms such as shared EMRs or electronic consultations and an improvement in some elements of coordination of clinical information and of clinical management probably related to a greater use of these mechanisms, other aspects of coordination such as the adequacy of referrals and accessibility between care levels have worsened, contrary to expected. Therefore, further evaluation of the impact of ICT-based coordination mechanisms on care coordination, and the barriers and facilitators associated to its use, is needed. Likewise, particular attention must be paid to other issues that worsened and are associated to the low perception of general coordination seen such as institutional support for coordination, knowledge between doctors, and job satisfaction, as well as to the contextual elements that give rise to them and that have intensified following the pandemic, such as increased waiting lists, work overload, high staff turnover and worse working conditions.
In consequence, decision makers and managers would have to prioritise participatory strategies that facilitate direct communication and knowledge between professionals and to foster an organisational climate that facilitates its implementation and sustainability, as well as to address the difficulties detected in the existing ones. It is also necessary to encourage support and protection policies for healthcare professionals and services that improve the working environment, promote cross-level clinical coordination, and guarantee quality and efficient care for more resilient NHS.
Data availability
No datasets were generated or analysed during the current study.
Abbreviations
- NHS:
-
National Health System
- PC:
-
Primary Care
- SC:
-
Secondary Care
- EMR:
-
Electronic medical record
References
Ovretveit J. Does clinical coordination improve quality and save money - A summary review of the evidence. The health foundation [Internet]. 2011;2(June):1–30. http://www.ncbi.nlm.nih.gov/pubmed/21325659
Motulsky A, Sicotte C, MP M, Schuster T, Girard N, Buckeridge D et al. Using Health Information Exchange: Usage and Perceived Usefulness in Primary Care. Stud Health Technol Inform [Internet]. 2019;264:709–13. https://pubmed.ncbi.nlm.nih.gov/31438016/
Sampson R, Cooper J, Barbour R, Polson R, Wilson P. Patients’ perspectives on the medical primary–secondary care interface: systematic review and synthesis of qualitative research. BMJ Open. 2015;5(10):e008708.
Bywood P, Jackson-Bowers E, Muecke S. Initiatives to integrate primary and acute health care, including ambulatory care services. Adelaide: Primary Health Care Research & Information Service; 2011.
Simpson K, Nham W, Thariath J, Schafer H, Greenwood-Eriksen M, Fetters MD et al. How health systems facilitate patient-centered care and care coordination: a case series analysis to identify best practices. BMC Health Serv Res [Internet]. 2022;22(1):1448. https://bmchealthservres.biomedcentral.com/articles/https://doi.org/10.1186/s12913-022-08623-w
Graetz I, Reed M, Shortell S, Rundall T, Bellows J, Hsu J et al. The next step towards making use meaningful: electronic information exchange and care coordination across clinicians and delivery sites. Med Care [Internet]. 2014;52(12):1037–41. https://pubmed.ncbi.nlm.nih.gov/25304020/
Vimalananda VG, Orlander JD, Afable MK, Fincke BG, Solch AK, Rinne ST et al. Electronic consultations (E-consults) and their outcomes: a systematic review. Journal of the American Medical Informatics Association [Internet]. 2020;27(3):471–9. https://academic.oup.com/jamia/article/27/3/471/5588944
Satué de Velasco E, Gayol Fernández M, Eyaralar Riera MT, Magallón Botaya R, Abal Ferrer F. Impact of the pandemic on primary care. SESPAS Report 2022. Gac Sanit. 2022;36:S30–5.
Mohammed HT, Hyseni L, Bui V, Gerritsen B, Fuller K, Sung J et al. Exploring the use and challenges of implementing virtual visits during COVID-19 in primary care and lessons for sustained use. Prazeres F, editor. PLoS One [Internet]. 2021;16(6):e0253665. https://doi.org/10.1371/journal.pone.0253665
Longest B, Young G. Coordination and communication. In: Shortell S, Kaluzny A, editors. Healthcare Management: Organization Design and Behavior. 4th ed. New York: Delmar; 2000. pp. 210–43.
Terraza R, Vargas I, Vázquez ML. La coordinación entre niveles asistenciales: una sistematización de sus instrumentos y medidas. Gac Sanit. 2006;20(6):485–95.
Reid R, Haggerty JM. Defusing the Confusion: Concepts and Measures of Continuity of Healthcare. [Internet]. Ottawa, Ontario; 2002. https://www.researchgate.net/publication/245856177_Defusing_the_Confusion_Concepts_and_Measures_of_Continuity_of_Health_Care
Vázquez ML, Vargas I, Garcia-Subirats I, Unger JP, De Paepe P, Mogollón-Pérez AS et al. Doctors’ experience of coordination across care levels and associated factors. A cross-sectional study in public healthcare networks of six Latin American countries. Soc Sci Med [Internet]. 2017;182:10–9. https://linkinghub.elsevier.com/retrieve/pii/S0277953617302241
Pérez A. Retos, logros y dificultades del médico de familia ante la pandemia por COVID-19 en Andalucía. Actual Med [Internet]. 2021;106(814):Supl2: 109–117. https://actualidadmedica.es/articulo-suplementos/supl814-2_re15/
Servei Català de la Salut. Generalitat de Catalunya. Mapa estratègic CatSalut 2022–2024. Reptes i full de ruta. 2022.
Fahy N, Williams GA, Habicht T et al. Use of digital health tools in Europe: Before, during and after COVID-19 [Internet]. Copenhague; 2021 [cited 2022 Feb 10]. https://www.ncbi.nlm.nih.gov/books/NBK576970/pdf/Bookshelf_NBK576970.pdf
Vimalananda VG, Gupte G, Seraj SM, Orlander J, Berlowitz D, Fincke BG, et al. Electronic consultations (e-consults) to improve access to specialty care: a systematic review and narrative synthesis. J Telemed Telecare. 2015;21(6):323–30.
Jiménez Carrillo M, Martín Roncero U, Aldasoro Unamuno E, Morteruel Arizcuren M, Baza Bueno M. Percepciones y experiencias de la población ante la transformación de la modalidad de las consultas en atención primaria durante la pandemia. Aten Primaria. 2022;54(4):102263.
Ares-Blanco S, Astier-Peña MP, Gómez-Bravo R, Fernández-García M, Bueno-Ortiz JM. The role of primary care during COVID-19 pandemic: a European overview. Aten Primaria. 2021;53(8).
van Ginneken E, Reed S, Siciliani L, Eriksen A, Schlepper L, Tille F et al. Addressing backlogs and managing waiting lists during and beyond the COVID-19 pandemic. 2022.
NHS Staff Survey Co-ordination Centre. NHS Staff Survey National Results. London; 2021.
House S, Crandell J, Stucky C, Kitzmiller R, Jones C, Gittell JH. Relational Coordination as a Predictor of Job Satisfaction and Intent to Stay Among Nurses and Physicians in the Military Health System. Mil Med [Internet]. 2023;188(1–2):e316–25. https://academic.oup.com/milmed/article/188/1-2/e316/6432365
Capone V, Borrelli R, Marino L, Schettino G. Mental Well-Being and Job Satisfaction of Hospital Physicians during COVID-19: Relationships with Efficacy Beliefs, Organizational Support, and Organizational Non-Technical Skills. Int J Environ Res Public Health [Internet]. 2022;19(6):3734. https://www.mdpi.com/1660-4601/19/6/3734
Bernal-Delgado E, Garcia-Armesto S, Oliva J, Sanchez Martinez FI, Repullo JR, Pena-Longobardo LM et al. Spain: Health System Review. Health Syst Transit [Internet]. 2018;20(2):1–179. http://www.ncbi.nlm.nih.gov/pubmed/30277216
Direcció General de Planifcació en Salut. Pla de salut de Catalunya 2021–2025 [Internet]. Barcelona, Spain. 2021. https://hdl.handle.net/11351/7948
Esteve-Matalí L, Vargas I, Cots F, Ramon I, Sánchez E, Escosa A, et al. Does the integration of health services management improve clinical coordination? Experience in Catalonia. Gac Sanit. 2022;36(4):324–32.
Vargas I, Vázquez ML, Henao D, Calpe JF. De la competència a la col·laboració. Experiència en la integració assistencial a Catalunya. Fulls econòmics del sistema sanitari [Internet]. 2009;38:27. https://dialnet.unirioja.es/servlet/articulo?codigo=3492040
Generalitat de Catalunya. Departament de salut. The Catalan Information Systems Master Plan: Building a digital health strategy for Catalonia together [Internet]. 2017. https://salutweb.gencat.cat/web/.content/_ambits-actuacio/Linies-dactuacio/tic/pdsis/pdsis-en.pdf
Vazquez ML, Amigo F, Esteve-Matalí L, Vargas I. La coordinación clínica entre niveles de atención: Resultados comparativos entre áreas del sistema sanitario en Cataluña [Internet]. Barcelona, Spain; 2021. http://www.consorci.org/media/upload/arxius/coneixement/COORDENA.CAT/cast Informe general Coordena CAT_final2.pdf.
García-Rojo E, Manfredi C, Santos-Pérez-de-la-Blanca R, Tejido-Sánchez, García-Gómez B, Aliaga-Benítez M, et al. Impact of COVID-19 outbreak on urology surgical waiting lists and waiting lists prioritization strategies in the Post-COVID-19 era. Actas Urol Esp. 2021;45(3):207–14.
Pavón I, Rosado Sierra J, Salguero Ropero A, Viedma Torres V, Guijarro de Armas G, Cuesta Rodríguez-Torices M et al. [E-consultation as a tool for the relationship between Primary Care and Endocrinology. Impact of COVID-19 epidemic in its use]. J Healthc Qual Res [Internet]. 2022;37(3):155–61. https://pubmed.ncbi.nlm.nih.gov/34866028/
Societat Catalana de Medicina Familiar i Comunitària. Atenció Primària en l’era post-COVID: revolució per a la transformació. Barcelona; 2021.
Muñoz-Cobo Orosa B, Pérez García M, Rodríguez Ledott M, Varela Serrano C, Sanz Valero J. Satisfacción laboral y calidad de vida de Los médicos residentes españoles durante la pandemia por la COVID-19. Med Segur Trab (Madr). 2022;67(264):169–90.
Campaz D, Vargas I, Plaja P, Sanclemente M, Paino M, Madrid M et al. A questionnaire to measure the impact of ICT-based coordination mechanisms on clinical coordination. Eur J Public Health [Internet]. 2022;32(Supplement_3). https://academic.oup.com/eurpub/article/doi/https://doi.org/10.1093/eurpub/ckac130.118/6765902
Vazquez ML, Vargas I, Unger JP, De Paepe P, Mogollon-Perez AS, Samico I, et al. Evaluating the effectiveness of care integration strategies in different healthcare systems in Latin America: the EQUITY-LA II quasi-experimental study protocol. BMJ Open. 2015;5(7):e007037.
Vázquez ML, Vargas I, Romero A, Sánchez E, Ramon I, Plaja P, et al. Adapting the COORDENA questionnaire for measuring clinical coordination across health care levels in the public health system of Catalonia (Spain). Public Health Panorama. 2018;4(4):491–735.
Fahy N, Williams GA, Habicht T, et al. Use of digital health tools in Europe: before, during and after COVID-19. Copenhague; 2021.
Motulsky A, Sicotte C, MP M, Schuster T, Girard N, Buckeridge D, et al. Using Health Information Exchange: usage and Perceived Usefulness in Primary Care. Stud Health Technol Inf. 2019;264:709–13.
Schoen C, Osborn R, Squires D, Doty M, Rasmussen P, Pierson R et al. A Survey Of Primary Care Doctors In Ten Countries Shows Progress In Use Of Health Information Technology, Less In Other Areas. Health Aff [Internet]. 2012;31(12):2805–16. http://www.healthaffairs.org/doi/10.1377/hlthaff.2012.0884
Aller MB, Vargas I, Coderch J, Vázquez ML. Doctors’ opinion on the contribution of coordination mechanisms to improving clinical coordination between primary and outpatient secondary care in the Catalan national health system. BMC Health Serv Res. 2017;17(1):1–11.
Li E, Clarke J, Ashrafian H, Darzi A, Neves AL. The Impact of Electronic Health Record Interoperability on Safety and Quality of Care in High-Income countries: systematic review. J Med Internet Res. 2022;24(9):e38144.
Dutta B, Hwang HG. The adoption of electronic medical record by physicians. Medicine. 2020;99(8):e19290.
Secretaria General de Salud Digital Información e Innovación para el SNS. Estrategia de salud digital: Sistema Nacional de Salud [Internet]. 2021. https://www.sanidad.gob.es/ciudadanos/pdf/Estrategia_de_Salud_Digital_del_SNS.pdf
Miloris K, Papageorgiou K. A Study on Healthcare ICT Systems and their Usefulness During CoVid-19 Focused in the European Environment. Journal of Hospital and Healthcare Administration [Internet]. 2021;5(1). https://www.gavinpublishers.com/article/view/a-study-of-healthcare-ict-systems-and-their-usefulness-during-covid19-focused-in-the-european-environment-1
Randstad Research. Informe de rotación laboral en España 2022. 2022. Available on: https://www.randstadresearch.es/informe-rotacion-2022/
Seda-Gombau G, Montero-Alía JJ, Moreno-Gabriel E, Torán-Monserrat P. Impact of the COVID-19 pandemic on Burnout in Primary Care Physicians in Catalonia. Int J Environ Res Public Health. 2021;18(17):9031.
Prasad K, McLoughlin C, Stillman M, Poplau S, Goelz E, Taylor S, et al. Prevalence and correlates of stress and burnout among U.S. healthcare workers during the COVID-19 pandemic: a national cross-sectional survey study. EClinicalMedicine. 2021;35:100879.
Kushnir T, Greenberg D, Madjar N, Hadari I, Yermiahu Y, Bachner YG. Is burnout associated with referral rates among primary care physicians in community clinics? Fam Pract. 2014;31(1):44–50.
Mangory KY, Ali LY, Rø KI, Tyssen R. Effect of burnout among physicians on observed adverse patient outcomes: a literature review. BMC Health Serv Res. 2021;21(1):369.
Bahr TJ, Ginsburg S, Wright JG, Shachak A. Technostress as source of physician burnout: an exploration of the associations between technology usage and physician burnout. Int J Med Inf. 2023;177:105147.
Osman MA, Schick-Makaroff K, Thompson S, Bialy L, Featherstone R, Kurzawa J, et al. Barriers and facilitators for implementation of electronic consultations (eConsult) to enhance access to specialist care: a scoping review. BMJ Glob Health. 2019;4(5):1–16.
Gupte G, Vimalananda V, Simon SR, DeVito K, Clark J et al. Disruptive innovation: implementation of electronic consultations in a veterans affairs health care system. JMIR Med Inf. 2016;4(1):e6.
Pujolar G, Oliver-Anglès A, Vargas I, Vázquez ML. Changes in Access to Health Services during the COVID-19 pandemic: a scoping review. Int J Environ Res Public Health. 2022;19(3):1749.
Lee MS, Ray KN, Mehrotra A, Giboney P, Yee HF, Barnett ML. Primary care practitioners’ perceptions of electronic Consult systems. JAMA Intern Med. 2018;178(6):782.
Henao D, Vázquez ML, Vargas I. Factores que influyen en la coordinación entre niveles asistenciales según la opinión de directivos y profesionales sanitarios. Gac Sanit. 2009;23(4):280–6.
Alrawashdeh HM, Al-Tammemi AB, Alzawahreh MKh, Al-Tamimi A, Elkholy M, Al Sarireh F, et al. Occupational burnout and job satisfaction among physicians in times of COVID-19 crisis: a convergent parallel mixed-method study. BMC Public Health. 2021;21(1):811.
Costello H, Walsh S, Cooper C, Livingston G. A systematic review and meta-analysis of the prevalence and associations of stress and burnout among staff in long-term care facilities for people with dementia. Int Psychogeriatr. 2019;31(08):1203–16.
Esteve-Matalí L, Vargas I, Amigo F, Plaja P, Cots F, Mayer EF, et al. Understanding how to improve the use of clinical coordination mechanisms between primary and secondary care doctors: clues from Catalonia. Int J Environ Res Public Health. 2021;18(6):1–18.
Colquhoun HL, Squires JE, Kolehmainen N, Fraser C, Grimshaw JM. Methods for designing interventions to change healthcare professionals’ behaviour: a systematic review. Implement Sci. 2017;12(1):1–11.
Aller MB, Vargas I, Coderch J, Calero S, Cots F, Abizanda M et al. Doctors’ opinions on clinical coordination between primary and secondary care in the Catalan healthcare system. Gac Sanit. 2019.
Esteve-Matalí L, Vargas I, Sánchez E, Ramon I, Plaja P, Vázquez ML. Do primary and secondary care doctors have a different experience and perception of cross-level clinical coordination? Results of a cross-sectional study in the catalan national health system (Spain). BMC Fam Pract. 2020;21(1).
Collins SA, Bakken S, Vawdrey DK, Coiera E, Currie L. Clinician preferences for verbal communication compared to EHR documentation in the ICU. Appl Clin Inf. 2011;02(02):190–201.
Mitchell GK, Del Mar CB, Clavarino AM, Jong IC, Kennedy R. General practitioner attitudes to case conferences: how can we increase participation and effectiveness? Medical Journal of Australia. 2002;177(2):95–7.
Tang T, Lim ME, Mansfield E, McLachlan A, Quan SD. Clinician user involvement in the real world: Designing an electronic tool to improve interprofessional communication and collaboration in a hospital setting. Int J Med Inf. 2018;110:90–7.
Loewenson R, Laurell AC, Hogstedt C, D’Ambruoso L, Shroff Z. Participatory action research in health systems: a methods reader. AHPSR, WHO, IDRC Canada, Equinet: TARSC; 2014.
Solsona i Pairó M, Treviño R, Merino M, Ferrer L. Demografia de les Professions Sanitàries a Catalunya: Anàlisi dels Estocs Actuals de Professionals Sanitari. Barcelona, Spain; 2006.
Instituto de estadística de Cataluña. Personal hospitalario. Por categorias, tipos de concierto y tipos de hospital Cataluña. Internet. 2017;2019(cited 2024 Mar 5):Availablefromhttpswwwidescatcatindicadors–idaecn15813.
Instituto nacional de estadística. No de Médicos por Comunidades, Ciudades autónomas y Provincias de colegiación, edad y sexo. [Internet]. 2022 [cited 2023 Oct 13]. https://www.ine.es/jaxi/Tabla.htm?tpx=59167&L=0
Cunningham CT, Quan H, Hemmelgarn B, Noseworthy T, Beck CA, Dixon E, et al. Exploring physician specialist response rates to web-based surveys. BMC Med Res Methodol. 2015;15(1):32.
Smyth J, Pearson J. Internet survey methods: a review of strengths, weaknesses, and innovations. In: Das M, Este P, Kaczmirek L, editors. Social and behavioral research and the internet advances in applied methods and research strategies. New York: Taylor and Francis Group; 2011. pp. 11–43.
Acknowledgements
We highly appreciate the contributions to the data collection of the members who, together with the authors of the paper, constitute the Healthcare Integration Evaluation Group (GAIA): Alex Escosa (Institut Català de la Salut), Marta Banqué (Consorci Sanitari de l’Anoia), Rami Qanneta (Gestió i Prestació de Serveis de Salut). We also thank Marcos Azuaga for the online programming of the questionnaires and Palmira Borràs, Verónica Espinel, Aida Oliver, Zahara Lucena (Consorci de Salut i Social de Catalunya) for their support.
Funding
This study analyses data that were collected as part of two research projects, “The coordination between levels of care and its relationship with the quality of care in different healthcare environments of the public health system (COORDENA-CAT project, 2017) (PI15/0021)” and “Impact of ICT-based coordination mechanisms on clinical coordination and care quality in the National Health System (COORDENA-TICs project, 2022) (PI20/00290)”, both partially funded by Carlos III Health Institute and the European Regional Development Fund. The funding body did not participate in the study design, data collection, analysis interpretation or in writing the manuscript.
Author information
Authors and Affiliations
Contributions
ML.V and I.V were responsible for the design and supervision of the study. D.C.L analysed and interpreted the data and wrote the first draft of the manuscript. ML.V, I.V, D.C.L, E.S, F.C, P.P, JM.P.C and A.S.H coordinated data collection, participated in its interpretation and were contributors in writing the manuscript. All authors reviewed and approved the final manuscript.
Corresponding author
Ethics declarations
Ethics approval and consent to participate
The COORDENA-CAT study was carried out in accordance with the current legislation and EU and national conventions and declarations on ethics in research, in full conformance with principles of the Declaration of Helsinki (Fortaleza, Brazil, 2013) and was approved by the ethics committee of Parc de Salut Mar and Bellvitge hospital (code: (2016/6726/I) and the COORDENA-TICs study was approved by the ethics committee of Parc Salut Mar (code: 2020/9645), the research ethics committee of the Balearic Islands (code IB 4774/22) and the ethics committee for drug research of the Basque Country (code: PI2021151). All study participants read and gave their authorization by means of the informed consent prior to completing the survey and could withdraw at any time. The researchers did not have access to any of the participants’ personal data and anonymity was guaranteed by assigning a random code to each participant. The processing, communication, and transfer of personal data of all participating subjects complied with the provisions of the regulation (EU) 2016/679 of 27 April on the protection of personal data.
Consent for publication
Not applicable.
Competing interests
The authors declare no competing interests.
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Electronic supplementary material
Below is the link to the electronic supplementary material.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Campaz-Landazabal, D., Vargas, I., Sánchez, E. et al. Has cross-level clinical coordination changed in the context of the pandemic? The case of the Catalan health system. BMC Health Serv Res 24, 959 (2024). https://doi.org/10.1186/s12913-024-11445-7
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s12913-024-11445-7