What is the overall impact or effectiveness of visiting primary health care services in rural and remote communities in high-income countries? A systematic review

Abstract

Background

Visiting services address the problem of workforce deficit and access to effective primary health care services in isolated remote and rural locations. Little is known about their impact or effectiveness and thereby the extent to which they are helping to reduce the disparity in access and health outcomes between people living in remote areas compared with people living in urban regions of Australia. The objective of this study was to answer the question “What is the impact or effectiveness when different types of primary health care services visit, rather than reside in, rural and remote communities?”

Method

We conducted a systematic review of peer-reviewed literature from established databases. We also searched relevant websites for ‘grey’ literature and contacted several key informants to identify other relevant reference material. All papers were reviewed by at least two assessors according to agreed inclusion and exclusion criteria.

Results

Initially, 345 papers were identified and, from this selection, 17 papers were considered relevant for inclusion. Following full paper review, another ten papers were excluded leaving seven papers that provided some information about the impact or effectiveness of visiting services. The papers varied with regard to study design (ranging from cluster randomised controlled trials to a case study), research quality, and the strength of their conclusions. In relation to effectiveness or impact, results were mixed. There was a lack of consistent data regarding the features or characteristics of visiting services that enhance their effectiveness or impact. Almost invariably the evaluations assessed the service provided but only two papers mentioned any aspect of the visiting features within which service provision occurred such as who did the visiting and how often they visited.

Conclusions

There is currently an inadequate evidence base from which to make decisions about the effectiveness of visiting services or how visiting services should be structured in order to achieve better health outcomes for people living in remote and rural areas. Given this knowledge gap, we suggest that more rigorous evaluation of visiting services in meeting community health needs is required, and that evaluation should be guided by a number of salient principles.

Background

People living in remote locations, particularly in less populated countries such as Australia, experience poorer health compared to people living in cities [1]. Consequently, improving timely access to effective primary health care services to address the health disparity is a government priority. Over recent years, providing primary health care through various forms of visiting services has been a major strategy in Australia to increase access and to improve the health outcomes for remote residents. While visiting services can be configured in a variety of different ways, they generally conform to two basic models [2]. In the first model, an individual or a team operates from a central hub and travels to remote locations on a periodic basis. In the second model, the individual or the team travels in a continuous circuit between different remote locations.

Given the considerable investment required to operate these visiting services, it is imperative to determine how effective they are in reducing the health status inequity between metropolitan, regional, and remote residents. “Effectiveness” in this context is understood broadly to mean any improvement in health conditions or outcomes following the introduction of a service, program, or treatment. To that end, we conducted a systematic review to answer the question “What is the overall impact or effectiveness of visiting primary health care services in rural and remote communities in high-income countries?”. In particular, we were interested in literature that had some relevance to remote health care in Australia.

Visiting, or fly-in/fly out (FIFO), services have been introduced as a strategy to both improve access to health care in remote areas and also to improve the retention of these health care providers [3, 4]. This strategy is based on the premise that remote communities with small populations are unable to support resident health professionals. There are growing concerns, however, about the impact of visiting services on both patients in the community as well as on any existing resident health professionals [5, 6]. In some cases, it appears that FIFO services are used in communities that are, in fact, large enough to support resident health professionals and that, in these situations, the visiting service may be having a “deleterious effect” on the community [7].

The provision of visiting services has not been problem free. For example, there is compelling evidence that, in remote Australian Aboriginal communities, strong relationships are essential to the delivery of effective health services. Characteristic of the relationships which promote effective health services are communication and trust [8,9,10,11]. These important relationships, however, take time to develop, so this critical contextual aspect of effective remote primary health care is highly problematic for short-term visiting health professionals.

Social, demographic, and geographic context is a fundamental consideration in ensuring that primary health care is effective and sustainable in remote settings. Visiting health professionals, for example, may not have the knowledge and experience necessary to treat the health conditions that can arise in remote Australia [6, 12]. Anecdotal evidence suggests that this knowledge gap can result in more medical evacuations. There are also important cultural considerations to account for when delivering services in remote Aboriginal and Torres Strait Islander communities [11, 13], and these can be difficult to learn within restricted time-frames.

The coordination of multiple visiting services is also important for the provision of effective health care and this is often difficult in remote settings [6]. For example, when services are not well coordinated the demand for appropriate working spaces can exceed the resources that are available [11]. Furthermore, with multiple visiting health professionals arriving simultaneously, resident staff do not have sufficient time for tasks such as case conferencing and skill development [11].

Internationally, the literature with regard to improving access to health workers is very limited [3]. Similarly, in Australia there is a paucity of comprehensive and reliable data about the impact that the increase in short-term visiting health professionals is having on the effectiveness of remote primary health care services. In order for health service managers, policy-makers, and other decision makers to be able to produce sound, evidence-based decisions, it is vital that the effectiveness or impact (or both) of visiting services, in general, is well understood.

Method

Search strategy

Initially, scoping searches of established databases such as Medline and EBSCO were conducted. The search strategy was developed with the assistance of a librarian. Table 1 lists the inclusion and exclusion criteria for the review. It should be noted that, given the very different contexts in high-income countries (HICs) compared to middle-income and low-income countries (LMICs), particularly with regard to available health resources, a decision was made to focus the review on HICs. (A review protocol was not established in the public domain; however, procedures and forms are available from the corresponding author).

Table 1 Inclusion and exclusion standards according to specified criteria

Four established databases and a large number of websites were searched (see Table 2). In general, the same terms that were used for the database searches were used when searching websites for the grey literature. Key informants, including members of the research team, also contributed papers for consideration.

Table 2 Searches conducted throughout databases and the grey literature

Methods of screening and selection criteria

Figure 1 illustrates the screening process by which the final set of papers were derived. Once duplicate titles were removed from the initial search, two reviewers scanned the titles from the total pool of titles obtained from the search. Next, titles and abstracts were reviewed by the research team to identify the eligible papers according to the research question and the inclusion and exclusion criteria (see Table 1). From the review of titles and abstracts a small number of papers were retained. These were reviewed by the same team who examined the titles and abstracts using a standard data extraction pro-forma. The data extraction form enabled the researchers to examine the scientific quality of each paper by analysing components such as the objective of enquiry, the methods used, and the design of the study. The data extraction process was completed with the team working in two sets of two researchers. Each set extracted data from half the retained papers. This process led to more papers being excluded. If there were discrepancies between the two reviewers, a fifth researcher adjudicated.

Fig. 1

Electronic database selection process. *‘Other’ indicates papers obtained through the grey literature or key informants

Data extraction

From the final set of papers, of primary interest were the conclusions that were made regarding service effectiveness or impact. Also of interest were the methods and other research processes from which the conclusions were drawn. The credibility of the conclusions regarding effectiveness or impact was assessed in terms of the methodological rigour of the studies.

Results

Study characteristics

Figure 1 describes the process of screening the initial 345 papers selected from the electronic databases and websites down to seven which were finally included for data extraction. Table 3 lists the final set of seven papers, all of which were obtained through database searches.

Table 3 Final set of papers including how they were obtained

The studies varied markedly in design and methodological rigour (see Table 4). Two studies were cluster randomised controlled trials, one was a case study, two were retrospective analyses (with one being cross-sectional and the other being longitudinal), one was a cohort study using population level data as a comparator, and one was a descriptive cross-sectional design.

Table 4 Descriptions of the final set of papers in terms of the type of study and the key findings

There was variability in context and service models. Four studies had some sort of comparison group. One study was conducted in Saudi Arabia and the rest in Australia. One service was a mobile, remotely based primary health care service [14]. The remainder were visiting services from major population hubs. The studies covered medical, dental, and non-medical health services.

Data synthesis

The studies described mixed results – some effective, some not (see Table 4). In the Saudi Arabian study, for example, although participants were satisfied with some aspects of the service, many of them were dissatisfied with the clinic location and the service schedule [15]. A range of different outcomes related to service effectiveness were evident in the studies. Within the studies reviewed there were reported reductions in waiting lists [16], improvements in diabetes management [17], lower mortality and reduced hospitalisations compared with the general population [14], and improved melanoma detection [18]. One of the cluster randomized controlled trials (RCTs) found no significant differences between the intervention and control groups [19].

It is important to note that while each of these seven studies was evaluating a visiting service, the emphasis was generally on the service itself rather than the fact that it was visiting or periodic in the delivery of that service. That is, there were no studies comparing a service delivered by resident health professionals compared with the same service delivered by visiting health professionals. Given that the services being provided in these evaluations were, in many ways, standard evidence-based practices and in some cases were additional services, it should come as no surprise that they led to beneficial outcomes. While it will always remain important to establish that services are, in fact, as effective as we expect them to be, and have the desired impact, it is crucial to understand how these evidence-based practices can be delivered most effectively and have maximum positive impact in remote settings where populations are insufficient to support resident services. For that reason, it is the visiting component rather than the service that needs to be examined more closely.

A number of studies addressed some aspects of the visiting form of delivery of the service. Aljasir and Alghamdi [15] reported that many people were dissatisfied with the visiting service. For example, one in five of the people who were interviewed were dissatisfied with the once per week timing of the service, suggesting that this was insufficient availability to meet patient needs for primary health care. Jackson-Pulver et al. [16], on the other hand, reported that the service being evaluated in their study had met a pressing need and that continuity of care was important and had been addressed in the design of the service (see Table 4). Rowley et al. [14] offered a rationale for a community controlled mobile service that enabled the population to live in a desired decentralised fashion.

Discussion

In order to obtain the best value and most effective impact from visiting services, decision-makers and service funders require rigorous empirical evidence of what works best in which context. Unfortunately, as this systematic review shows, such evidence is scant. From the sparse literature available, it is not possible to answer our research question. This systematic review demonstrates that more rigorous evaluation of visiting services, their impact, effectiveness, and cost is required, and in particular, the specific impact of the ‘visiting’ modality requires examination. Given the investment in visiting services and the urgency in reducing the disparity in health outcomes between people in remote versus urban locations, it is surprising that so little attention has been given to assessing the effectiveness or impact of visiting services.

The limitations of systematic review methodology in answering some of the questions that are most important to rural and remote health should also be acknowledged. It has been suggested for almost ten years that a more flexible approach to systematic reviews should be adopted in rural and remote health settings [20]. For this reason we relaxed the inclusion and exclusion criteria that we developed and we searched a large number of websites to particularly focus on “grey” literature. In fact, our systematic review has highlighted one of the important issues in rural and remote health which is the lack of available data to inform policy development in important areas.

In the absence of knowledge about effectiveness or impact, health professionals, funders, policy-makers, and evaluators might benefit from considering a number of important principles [2]. The principles offered here have been derived from a synthesis of information obtained from the available literature, the current systematic review, and the authors’ expert knowledge and experience (see Table 5). The first principle relates to the justification of the service and addresses the concern mentioned in the introduction that visiting services are being used in some communities which have populations large enough to support a resident team of primary health care professionals. The second principle focuses on the scheduling of the service and the extent to which the timing of the service is commensurate with the needs of the community. For example, Aljasir and Alghamdi [15] described dissatisfaction relating to service scheduling only once per week. The third principle relates to co-ordination, which refers to the extent to which visiting services are integrated with each other but also linked with resident primary health care services. The fourth principle, scope, addresses whether or not the visiting service is sufficiently comprehensive and targeted to meet the prioritised needs of the community. The importance of the fifth principle (continuity), was highlighted by Jackson-Pulver et al., [16] who reported that virtually all respondents in their study emphasised the importance of continuity of care which had been successfully addressed through continuity of non-dentist staffing. The sixth principle, support, highlights the importance of reciprocity with the visiting health professionals supporting resident staff and resident staff supporting the visiting professionals. Review, the seventh principle, ensures that the effectiveness of the visiting service is monitored, evaluated, and improved. While our research identified a range of different outcome measures related to service effectiveness reported in the literature, future research in this field would ideally report on a suite of measures which assess effectiveness according to each of the identified key principles for providing visiting services. Table five summarises how papers addressed or didn’t address these principles.

Table 5 Analysis of papers addressing proposed key principles for effective visiting services

Conclusion

Visiting services are an important component of the delivery of primary health care services to isolated remote and rural communities. In order to ensure residents of remote communities are receiving the best possible primary health care it is important that evaluations of these visiting services are conducted systematically and routinely. Moreover, it is essential that, in addition to evaluating the effectiveness of the service, the appropriateness and efficiency of the visiting modality is also assessed. It is only through careful and comprehensive examination of both the visiting aspects and the service aspect that we will be able to make the most astute and informed evidence-based decisions regarding the way in which the health needs and priorities of residents of remote locations can be adequately addressed.