Implementation factors and their effect on e-Health service adoption in rural communities: a systematic literature review
© Hage et al.; licensee BioMed Central Ltd. 2013
Received: 12 July 2012
Accepted: 28 December 2012
Published: 12 January 2013
An ageing population is seen as a threat to the quality of life and health in rural communities, and it is often assumed that e-Health services can address this issue. As successful e-Health implementation in organizations has proven difficult, this systematic literature review considers whether this is so for rural communities. This review identifies the critical implementation factors and, following the change model of Pettigrew and Whipp, classifies them in terms of “context”, “process”, and “content”. Through this lens, we analyze the empirical findings found in the literature to address the question: How do context, process, and content factors of e-Health implementation influence its adoption in rural communities?
We conducted a systematic literature review. This review included papers that met six inclusion and exclusion criteria and had sufficient methodological quality. Findings were categorized in a classification matrix to identify promoting and restraining implementation factors and to explore whether any interactions between context, process, and content affect adoption.
Of the 5,896 abstracts initially identified, only 51 papers met all our criteria and were included in the review. We distinguished five different perspectives on rural e-Health implementation in these papers. Further, we list the context, process, and content implementation factors found to either promote or restrain rural e-Health adoption. Many implementation factors appear repeatedly, but there are also some contradictory results. Based on a further analysis of the papers’ findings, we argue that interaction effects between context, process, and content elements of change may explain these contradictory results. More specifically, three themes that appear crucial in e-Health implementation in rural communities surfaced: the dual effects of geographical isolation, the targeting of underprivileged groups, and the changes in ownership required for sustainable e-Health adoption.
Rural e-Health implementation is an emerging, rapidly developing, field. Too often, e-Health adoption fails due to underestimating implementation factors and their interactions. We argue that rural e-Health implementation only leads to sustainable adoption (i.e. it “sticks”) when the implementation carefully considers and aligns the e-Health content (the “clicks”), the pre-existing structures in the context (the “bricks”), and the interventions in the implementation process (the “tricks”).
Keywordse-Health services Rural Implementation Adoption Context Process Content
Recently, there has been increasing awareness of the societal consequences of aging. Around the world, fertility rates are dropping and life expectancy is increasing such that societies are faced with an ageing population . Aging will not only increase the need for healthcare services, and consequently increase healthcare costs [2, 3], it will have an impact on all spheres of human life: the economic, the social, as well as the political spheres [1, 4].
Rural communities will be especially affected by aging as they are confronted with the out-migration of working-age adults from rural to urban areas and the in-migration of former urban dwellers, often at retirement age [1, 5, 6]. These demographic trends have raised concerns about the quality of life and health in rural communities [5, 7]. e-Health services are seen as one solution to these concerns [8–16], with e-Health as diverse as web portals and domoticaa[17, 18], and possibly encompassing both core healthcare services and social innovation (see, for example, ). European policymakers are investing heavily in e-Health developments , but e-Health implementation is not always successful. While e-Health implementation within organizational settings is known to have adoption problems , few studies have addressed the peculiarities and particularities of e-Health in rural communities. Available studies report non- [22, 23] or only partial [24, 25] adoption. A systematic overview of e-Health implementation factors specific to rural communities, however, is lacking. The rural context deserves further study as rural communities may have greater need for e-Health services, not only because the aging process increases health care demand, but also because of local scarcity of alternative services and of health personnel. Moreover, implementation of e-Health services may be harder, due to e.g. lack of infrastructure. This makes rural e-Health implementation especially relevant and challenging at the same time. This the rationale for this study and leads to the following research aim.
Study aim and overview
This systematic literature review aims to contribute to our understanding of the implementation factors that determine successful e-Health adoption in rural communities. Such an understanding could improve policies and strengthen programs directed at enhancing living conditions in rural communities and thereby the quality of life and health of their inhabitants. Following the change model of Pettigrew and Whipp , this review identifies and classifies implementation factors in terms of the “context”, “process”, and “content” of the health intervention studied. Moreover, we explore patterns in which these implementation factors merge to trace possible interactions between them.
Our research question is formulated as follows: How do context, process, and content factors of e-Health implementation influence its adoption in rural communities? To answer this question we need to know 1) what e-Health services are implemented in rural communities and for what purposes, and 2) which factors promote or restrain e-Health services adoption by the targeted group of residents?
In our review, the term ‘e-Health services’ refers to any interactive communication and information technology aimed at enhancing community quality of life and/or individual health outcomes. This wide-ranging definition was chosen for a number of reasons. First, since to the best of our knowledge no reviews have been conducted on rural e-Health implementation factors, providing a broad overview is a logical first step. At a later stage such an overview can act as a starting point for research targeted at specific types of e-Health implementation. Second, as the rural community is of special interest to this study, a general definition of e-Health allows us to pay extra attention to community-directed e-Health applications in addition to those directed at individual health. Thus, this definition allows including all potentially relevant e-Health initiatives in rural communities.
In view of the dispersed nature of the e-Health implementation literature that originates from different scientific disciplines, we needed a flexible, but also solid framework to coherently organize the selected papers’ empirical findings. We draw on Pettigrew and Whipp’s classic model of strategic management of change , which has been widely applied in comparative case study research across many sectors and organizational contexts [27–29], as well as in studies on the implementation of innovations in healthcare [30, 31]. This model generates insight by analyzing three interactive elements; “context”, “process”, and “content” that together shape any strategic change. A guiding assumption  is that not only the change content, i.e., the e-Health application, but also the change context and process have a role in explaining change outcomes, i.e., adoption outcomes. Much evidence supports this assumption [33, 34], including the interactive nature of their explanatory roles [20, 35, 36]. In our search for implementation factors that either promote or restrain e-Health adoption in rural areas, this model allows to systematically assign each surfacing factor to one of these three robust, yet well-defined categories.
Classification framework with conceptual definitions
Interactive elements and their definitions
Factors within each element and their definitions
Geographical area with low population density, limited resource bases, relative isolation, and cultural or ethnic homogeneity , and the accompanying political, economic, social, and technological developments.
Socioeconomic variables - The social and monetary environment in which the community is located.
Individual resources and capabilities - Factors that influence the ability of rural residents to adopt e-Health.
A need for e-Health - Situation where e-Health can substitute for services that have disappeared or supplement existing services in a way that rural residents perceive as useful.
Third party involvement - Involvement of actors or stakeholders that do not belong to the targeted user group.
“Streams of activity across time” [26:39] undertaken with the aim of implementing e-Health.
Implementation team - Stakeholders that initiate or promote change (a single stakeholder or a coalition of stakeholders).
Implementation strategies - Assumptions of how change needs to be executed, formulated with the aim to implement e-Health.
Bottom-up strategy - Implementation strategy based on shared project ownership based on horizontal relationships between stakeholders.
Top-down strategy - Implementation strategy based on centralized project ownership with vertical relationships between a single stakeholder and external actors.
Resource management - Strategic allocation of scarce resources.
Conflict management - Management of competing stakeholder interests as well as their ideas on the project.
People and organizational issues - Problems among individuals and organizations that occur when implementing e-Health, such as with technical support.
Refers to any interactive communication and information technology aimed at enhancing the quality of life and/or health outcomes in the broadest sense .
Project design - The set of shared ideas about what the project is, including its aims, costs, and conditions for success.
e-Health design - Technical and user features of the implemented e-Health.
Sustainability - The enduring adoption of the e-Health content.
The degree of adoption by the targeted group, leading to individual and community-level outcomes.
Individual level adoption outcomes - The effects that the implemented e-Health has on the individual’s health.
Community-level adoption outcomes - The effects that the implemented e-Health has on the quality of life in the rural community.
The method section below explains the paper selection and search procedures applied as well as our classification and data analysis methods. In the results section, we then examine the research perspectives adopted in the selected papers, and analyze their empirical findings in terms of implementation factors that promote or restrain e-Health adoption. In the discussion section, we reflect on why the identified implementation factors might influence e-Health adoption in rural communities and how they may work together in doing so. This leads to potential areas for future research. Finally, we draw conclusions on what is known about the implementation and adoption of e-Health in rural communities.
Aiming to increase understanding of the implementation factors that determine the success of e-Health adoption in rural communities, we conducted a systematic literature review. The review followed a thematic analysis approach, which is especially well equipped to handle both qualitative and quantitative data [40, 41].
Inclusion and exclusion criteria
Before starting our search, we defined six inclusion and exclusion criteria. Criteria concern study population (inclusion and exclusion criteria 1–2), type of e-Health intervention (3–4) and study type (5–6). The inclusion and exclusion criteria are: 1) the papers focused exclusively on rural communities, or explicitly made a distinction between urban and rural communities (for a definition of rural community see Table 1); 2) the papers focused on the rural community as a whole, not on a specific group or minor characteristic within the group (e.g. a specific disease); 3) e-Health was considered as an interactive mechanism (e-Health is further defined in Table 1); 4) there was a relationship between the three keyword categories such that category “c” influences category “a” in an environment defined by category “b” (keyword categories are laid out in the search strategy section); 5) they were empirical studies addressing implementation published in peer-reviewed scientific journals; 6) the papers were written in English.
In order to ensure that this review encompassed all the relevant literature on the latest developments in e-Health adoption in rural communities the four authors formed an interdisciplinary research team. Together we outlined a specific search strategy that included five databases: “EBSCO1”, “EBSCO2” “Embase”, “MUSE”, and “Web of Science”. The “EBSCO” database was divided into two separate databases. EBSCO1 focuses on healthcare (“PsycINFO”, “CINAHL” and “MEDLINE”) while EBSCO2 provides a broader view (“Business Source Premier”, “Academic Search Premier”, “EconLit” and “SocINDEX”). The search was conducted using three categories of keywords: category a) “quality of life”, “social network”, “social cohesion”, “wellbeing”, “empower*”, “ownership”, “community participat*”; category b) “rural”, “deprived area”, “remote area”; and category c) “e-Health”, “e-care”, “tele*”, “ICT”, “information technology”, “communication technology”, “communication system”, “information system”. In each search, one keyword from each category was used, resulting in 168 search combinations.
A pilot research was conducted in the Web of Science database and detailed notes were kept of this process (including notes on exact search entry method and number of hits per search combination). Nevertheless, as the search engines of each database include slightly different search options, there was a short learning curve each time we started searching a new database. In order to acquire all relevant papers, we attempted to create the widest search possible.
In the database “EBSCO1” and “EBSCO2”, the search was carried out according to search strategy 1; keyword from “category a” (in the field of “left open”) and keyword from “category b” (in the field of “left open”) and keyword from “category c” (in the field of “left open”). Within this strategy only peer reviewed papers were allowed.
In the database “Embase”, the search was carried out according to search strategy 2; keyword from “category a” and keyword from “category b” and keyword form “category c”. No field limits were applied.
In the database “MUSE”, the search was carried out according to search strategy 3; keyword from “category a” (in the field of “all fields”) and keyword from “category b” (in the field of “all fields”) and keyword from “category c” (in the field of “all fields”).
In the database “Web of Science”, the search was carried out according to search strategy 4; keyword from “category a” (in the field of “Topic”) and keyword from “category b” (in the field of “Topic”) and keyword from “category c” (in the field of “Topic”). The last search was conducted on 31 May 2011. Identified studies were then divided among two researchers (EH and JPR) and separately analyzed. In order to reach a consensus and mutual understanding of the inclusion criteria, both researchers assessed and compared their interpretations. In this assessment, the researchers each independently selected three papers that they interpreted as highly relevant to the research question and therefore fitting the inclusion criteria, three papers that did not match the criteria, and three papers where the researcher was not sure whether to include or exclude the study. These papers were then evaluated by the other researcher. The research team discussed the differences in interpretations or doubts and this led to a further sharpening and refining of the inclusion criteria.
Alongside these inclusion and exclusion criteria, the papers were subjected to a quality assessment. Two methodological quality checklists, one focusing on qualitative research and the other on quantitative research, were applied. These quality checklists were based on previous checklists used in various research fields [42–45] reflecting the range of papers selected.
As with the selection process, the quality assessment was also conducted independently by the two researchers. During an initial quality assessment trial, the two researchers (EH and JPR) each evaluated four papers’ methodologies and then compared their conclusions. Since there were only minor deviations (in less than 10 percent of judgments), no corrective measures for assessing the methodological quality were taken.
As a final check on exhaustiveness, the reference lists of selected papers were scanned for any further relevant studies. In addition, we scanned reference lists of articles key to the papers under review.
The resulting papers were each characterized in terms of the country or region of data collection, the research field, the research aim, and the type of research (qualitative/quantitative data, data collection method and number of cases/sample size). The papers were categorized according to the focus of the research question and data. A classification matrix was used to carefully map each paper’s focus, and we will show in the results section how the focus of the papers varied. Each paper’s empirical findings were categorized according to the classification matrix into factors belonging to “context”, “process”, and “content” elements, and related to the reported “adoption outcomes”. Finally, after analyzing the resulting promoting and restraining factors, propositions were formulated for further research.
Number of papers published by period
Sub-question 1:What e-Health services are implemented in rural communities and for what purposes?
Internet and social media [25, 51–57, 59–68] based services are developed for purposes ranging from economic development to empowerment and bridging the digital divide, as shown in the project level studies (n=7). The population level studies (n=11) usually focus on their adoption outcomes, especially social connectivity and access to information. These studies were conducted in both non-Western and Western oriented (North-America, Europe and Oceania) regions.
Videoconferencing and telehealth [8–10, 13, 14, 22, 23, 58, 69–74] are typically applied in services aiming to enhance the quality of life by improving both the accessibility and quality of those health services (project level n=10, population level n=4). We only found studies on videoconferencing and telehealth in Western oriented countries.
Telecommunication applications (mobile phones) [11, 49, 50, 61, 64, 75–77]. Like internet and social media these are used to achieve a wide range of outcomes. Examples include saving health care costs by diagnosing a patient’s problems from mobile phone photographs, and enabling learning among rural women keeping goats by sending them voicemail messages (project level n=5); At the population level (n=3), telecommunication applications are mainly studied as a medium for reinforcing or changing social structures in view of long term health and wellbeing. A large share of the non-Western studies focused on projects implementing telecommunication applications.
Community networks [24, 46–48, 78–81] are analyzed for their ability to improve access to information, and particularly local information. In addition, community networks are believed to help bridge the digital divide (such as between rural and urban areas and between low and high income groups) and to empower rural communities (project level n=8). In addition to telecommunication, a large proportion of the non-Western studies focused on community networks.
Web portals [12, 82, 83] are usually believed to improve access to information, such as health-related and market information (project level n=3). The studies on web portals all originate from Western-oriented countries.
A computer lab [78, 84, 85] is usually implemented in a school setting and has an (e.g. health) educational purpose (project level n=3). Although small in number, these studies were conducted in Western and non-Western oriented regions.
Types and aims of e-Health
Type of e-Health
Aim related to
Internet and social media
Social contact (51,52,53,60,61,63,66); Economic development (55,56,57,61,63,65,68); Access to information (52,53,62,64,67); Empowerment (55,57,59,61,65,67); Health (55,59,62,67); Bridging digital divide (25,63,54,67); Quality of life (general/other) (55,61,65); Education (55,61); Reducing costs/time (63).
Videoconferencing and telehealth
Health (8,9,10,13,14,22,23,58,69,70,71,72,73,74); Bridging the digital divide (13,14,58,69,70,71,72); Reducing costs/time (13,22,23,58,73,74); Education (8,10). Access to information (71); Social contact (10).
Access to information (49,50,61,64); Education (61,75); Reduction cost/time (11,50); Health (11,61); Quality of life (general/other) (61,77). Bridging digital divide (50); Social contact (61); Economic development (61).
Access to information (24,46,47,48,80,81); Bridging the digital divide (46,47,48,80); Empowerment (47,78,79,81); Reducing costs/time (24); Health (78); Economic development (78,79); Education (78); Social contact (78).
Access to information (12,82,83); Health (12,82); Bridging the digital divide (83).
Individual and community characteristics. This perspective considers the individual and community level contextual factors (e.g. age, income, education level, social structures, local political climate) that influence e-Health adoption. Researchers adopting this perspective examine who is most likely to adopt e-Health. Linking this perspective to the elements of strategic change proposed by Pettigrew and Whipp  emphasizes ways in which contextual factors can influence e-Health adoption.
B: e-Health shaping context. This perspective focuses on the contextual effects of e-Health adoption and conceptualizes the relationship between e-Health content and context. Two sub-categories can be identified. Firstly, B1 where effects are measured on the individual level and papers discuss how individuals have been affected by e-Health (e.g. in terms of access to information, wellbeing) and, secondly, B2 where communities as a whole are the focus (e.g. wider social network).
C: e-Health implementation. Papers adopting this perspective address how e-Health services with specific characteristics are implemented in a particular context. The emphasis is on the process (i.e. activities) through which the e-Health content and the local context are adjusted to each other (e.g. through training or management strategies).
D: Community shaping of e-Health. This focus addresses how communities have participated during the implementation phase of an e-Health project. Here, the relationships between context and process, which were also present in the previous focus (C), are also applicable. The difference between perspectives C and D is that D emphasizes shared project ownership, whereas C emphasizes an implementation process that can have both centralized and shared project ownership.
E: Individual appropriation of e-Health. These papers focus on how individuals adopt e-Health. They address questions such as; how are e-Health services incorporated in an individual’s everyday life? The emphasis is on individuals finding appealing and innovative ways to use e-Health given the original functionalities. In terms of Pettigrew and Whipp’s strategic change elements, perspective E studies how the individual context affects the appropriation of the e-Health content.
Figure 2 shows that only a few of the 51 papers selected address perspectives B2, D, and E. This finding highlights the limited availability of data on how e-Health shapes the community, and how communities shape e-Health through their involvement in the implementation process and through individuals appropriating e-Health. Nevertheless, these perspectives are relevant as we will show in our discussion where we explore possible interaction effects between context, process, and content elements of change and develop propositions for future research.
Sub-question 2: Which factors promote or restrain e-Health services adoption?
We have identified the factors that have been reported as either promoting or restraining e-Health adoption. Using Pettigrew and Whipp’s elements of change, these factors have been classified as context, process, or content factors. The factors are then categorized and linked to the paper’s reference number and perspectives.
Context factors promoting e-Health implementation
Demographics (low age, male, married, family composition includes children)
High occupation status, high income
Individual resources and capabilities
Having non-local ties
Highly educated, high literacy
Political and community involvement
A need for e-Health
Lack of or barriers to services/information
Fulfilling a specific need
Context factors restraining e-Health implementation
Demographics (high age, female, single, having no children)
Unemployment, low occupation status, low income
Gendered society, caste system
Individual resources and capabilities
Lack of ICT skills
Low educated, illiteracy
Having local ties
Inadequate physical or mental condition
Unwilling third party
Available alternatives for receiving services/information
Process factors promoting e-Health implementation
Regionally based implementation staff
Capable, skilled, motivated implementation staff
Implementation strategy to motivate people (both from within and without)
Evaluation and feedback loops both bottom-up and top-down
Work with existing local community networks
Partnership: local residents as partners from an early stage add value and know their needs; objectives and roles should be transparent
In publically financed projects, civic leaders need the support of politically active citizens
Unbiased mediator role
Use of pilot implementation projects
Planned diffusion strategy with a need-based product/service
When computer resources are left to the market place, economy factors will dominate
Implementation leadership, creating collective learning through openness
Top-down decision-making through local politicians
Process factors restraining e-Health implementation
Projects that have no authority or financial means and lack the capability to improve vital parts of the implementation process
Lack of consensus, decision power, and commitment among key stakeholders
People and organizational issues
Problems with technical support
Content factors promoting e-Health implementation
Tailored to specific and agreed upon needs
Realistic and pragmatic goals
Funding and costs
Distinctions between artifacts are commonly interpreted among relevant social groups, partners, and stakeholders
Designers considered local context in their design
Stakeholders should become contractual partners
A community electronic network needs to sell itself
Content factors restraining e-Health implementation
Funding and costs
Not fulfilling a demand
Poor user friendliness
In the previous section we analyzed which factors promote or restrain e-Health service adoption within the context, process, and content elements of change.
To summarize, we have identified, in all the elements of change (context, process and content), key promoting and restraining factors related to e-Health adoption in rural communities. The identified factors in this review strongly relate to and cover Pettigrew and Whipp’s three original core elements of change . However, the subcategories and especially their labeling sometimes had to be adapted as the original model was more often applied within organizational instead of community settings.
In some instances we found conflicting or limited results. Here, we first saw that geographical isolation features as both a promoting and as a restraining variable. Next, we saw that pre-existing socio-economic structures, such as structures of gender inequality and caste systems, complicate balanced diffusion of e-Health throughout the community. However, three studies [24, 49, 72, 75] reported e-Health implementations that were able to diminish social inequalities. The question remains how these pre-existing socio-economic structures shape or get changed by ICT implementation. Finally, the studies show that local participation is essential in ensuring sustainability, but that it is not easy to manage. These three contradicting findings indicate that identifying promoting and restraining factors in itself does not provide solutions for these implementation issues. In this discussion we look at interaction effects to explain these results. While interaction effects have not been extensively studied in the papers reviewed, our theoretical framework  points towards explaining such seemingly contradictory results by taking a closer look at the interaction effects between the three change elements. We will discuss the contradictory findings below, but first address our review’s limitations.
Limitations of this research
To our knowledge, no previous review has specifically analyzed the implementation factors that influence rural e-Health adoption. Notwithstanding the interesting results, this review has some limitations. Although we were careful in developing and executing our search strategy, the fact that e-Health implementation in rural communities is an emerging, and therefore broad and diffuse, field means that we cannot be sure that we have included all the relevant findings. The variety of terms used in this field may have limited our ability to achieve an exhaustive review. Moreover, for practical reasons this study excluded non-English papers. Papers that address the antecedents of successful e-Health implementation in general were not included either. Their relevance to the specific rural context may not always be evident and therefore, they fall outside the scope of this review.
A limitation of any literature review is that the authors of the studies selected will have had different objectives, and used different methods and means of interpretation in reaching their conclusions - conclusions which do not necessarily fully align with the interests of this article.
Although Pettigrew and Whipp’s model is parsimonious, flexible, much-cited, and widely applied, we might have chosen a different theoretical lens to bring together the empirical evidence on e-Health implementation in rural communities. However, their model not only served to systematically categorize the papers’ perspectives and the identified implementation factors, it also opened our eyes to the interaction effects between the change elements.
As the included papers vary greatly in research methods applied, it was impossible to conduct a meta-analysis. Rural e-Health is an emerging research area and by excluding qualitative papers from the review, the study would miss potentially relevant implementation factors. As it was, it was deemed important to include both quantitative and qualitative studies, instead of conducting a meta-analysis, therefore we conducted a thematic analysis [40, 41] guided by the Pettigrew and Whipp-based classification matrix. We will now address the possible interaction effects suggested by our findings and their expected impact on e-Health implementation.
Interaction between context and content: the role of geographical isolation
Although geographical isolation and the specific socioeconomic characteristics of rural communities (contextual factors) in general seem to restrain e-Health implementation, they can also create specific, contextualized needs that can be addressed with e-Health applications [8, 12, 13, 22–25, 49, 51, 52, 59, 76, 78]. A few studies suggest that a needs-based e-Health content may compensate for the contextual factors that restrain e-Health implementation [8, 82]. Needs-based e-Health applications seem to be able to overcome recognized socioeconomic ICT adoption barriers such as advanced age [11, 14, 48, 49, 51, 53, 54, 60–63, 69, 83] and low incomes [24, 46, 47, 53, 54, 62, 63, 69, 83]. This relationship is especially well researched in Western oriented countries. Schmeida and McNeal , for example, found older people and individuals with low incomes to be more likely to use the internet in search of Medicare and Medicaid information than others. Moreover, in contrast to other studies [24, 47, 49, 53, 60–63, 69, 83], Schmeida and McNeil found no relationship between other personal characteristics, such as gender, race, ethnicity, and education, and online searches for Medicare or Medicaid information. Similar results are reported by Bynum et al.  who suggest that such findings “may be explained by the limited access to quality health care knowledge among these groups” :220]. These findings suggest a strong interaction between content and context factors in determining e-Health adoption. As such, they constitute a warning against overgeneralizing the adoption effects of socioeconomic factors such as age, income, and education.
Furthermore, several studies argue that geographical isolation creates a need for e-Health because of a lack of alternative services or media in these areas [8, 12, 13]. Shepherd et al.  and Shaw et al.  address this need for particular subgroups. For example, Shaw et al.  show that individuals with poor well-being and little social support, i.e. those with a greater need for medical services, spend relatively more time on health information websites. Based on these findings, the authors claim that psychological help is of greater importance in rural communities because rural residents are more likely to feel geographically isolated from face-to-face support groups and therefore experience a greater need for e-Health solutions.
This creates a field of tension. On the one hand, rural users of e-Health applications may perceive e-Health as valuable and experience a concrete, valuable outcome from its use. On the other hand, the low network density, which defines geographical isolation, creates high barriers to sustainable e-Health implementation since it is difficult to make e-Health profitable in these circumstances. This is especially the case when targeting those with low incomes and of advanced age, groups which could most benefit from e-Health applications as is shown in [9, 24, 62–64].
Authors have formulated conditions under which public e-Health applications might be feasible, and suggested ways to provide incentives for private e-Health suppliers [25, 48, 55, 65] (See also the later section on interaction between content and process). However, as these authors applied slightly different definitions of ‘rural’, further research is needed to test the proposed conditions and establish whether technology design can overcome the negative associations with socioeconomic trends. On this basis, we formulate the following proposition.
Proposition 1: Geographic isolation restrains e-Health implementation, yet provided that e-Health fulfills a specific need, geographical isolation promotes its subsequent adoption.
Interaction between process and context: how e-Health can add value for underprivileged groups
As shown in the previous section, and indicated in the studies reviewed, there is an “intriguing possibility that extant community structure […] may play an important mediating role in understanding the impact of internet access [or access to other ICT] on social relationships” :138]. Surprisingly, as shown in Figure 2, relatively little attention has been paid to the way these pre-existing socioeconomic community-level structures (i.e. context) affect the e-Health implementation process (i.e. process) and vice versa.
Although limited in number, some studies have considered the way pre-existing socioeconomic structures affect the process of e-Health implementation and adoption. Their general conclusion is that e-Health implementation usually reinforces rather than changes the pre-existing socioeconomic structures [49, 52, 53, 64, 66, 76, 79]. This reinforcement is in itself neither inherently positive nor negative, and may occur in quite subtle ways as illustrated by Gilbert et al. . However, there are cases in which e-Health reinforces structures of socioeconomic inequality based on income, gender, age, and education. Forestier et al.  show, for instance, that income inequality nationally tends to increase with rising levels of telephone and internet penetration. Aminuzzaman  found that e-Health implementation could reinforce gender inequality, even with a specific e-Health application aimed at empowering women. Also Stern and Dillman  conclude, in reference to Norris [86, 87], that e-Health “is a vital tool for activating the active” :421]. None of the available findings suggest that the availability of e-Health in itself will change socioeconomic structures. The irony is that underprivileged groups, including relatively many older, rural adults, who might benefit most are, however, less likely to start using it.
However, under certain conditions, e-Health implementation does alter socioeconomic structures [24, 49, 75, 79], enabling underprivileged groups to adopt e-Health. These projects were all implemented in regions characterized by forms of socio-economic inequality, e.g. gender-based, and located in Asian countries. Balasubraman  studied a project that did succeed in implementing an e-Health application for rural women in a context of gender inequality. This project was successful because, in addition to handing out e-Health applications, women were trained to use the application and supported in face-to-face discussion groups, and eventually enabled to participate in developing the e-Health content. These non-technological features of the project ensured that the e-Health application reached its target group. This example illustrates that social change will only be achieved through e-Health when the actors in the implementation process are aware of the existing socioeconomic structures and strongly driven to change these structures.
Proposition 2: e-Health implementation will reinforce the socioeconomic structures already in place in a rural community unless it includes interventions specifically aimed at changing these structures.
Interaction between content and process: sustainable e-Health implementation
Remarkably, only a few studies, from different parts of the world, address sustainability [47, 65, 84]. Almost all studies ended after the initial implementation phase, leaving unanswered the question of whether and how e-Health content becomes sustainably embedded within a community.
Hosman and Fife’s study  is one of those few studies that explicitly deal with sustainability. They present several apparently essential conditions for sustainable rural e-Health implementation, most of which relate to leadership and the development of effective partnerships. While not focusing on sustainability, seven other papers also underline the importance of leadership and partnerships in the implementation process [24, 25, 65, 70, 75, 80, 84]. We will discuss their findings below in order to better understand how e-Health implementation may become sustainable.
Three of the studies emphasize the importance of equal, bottom-up partnerships [24, 65, 80]. Kanungo, in studying the implementation of local knowledge centers, for example, concludes that “sustainability hinges on collaborative frameworks”:419]. Similarly, Cecchini and Raina , who studied a government-owned public computer network, ascribe its failure to governmental inability to establish an effective partnership with local communities and to allow these communities to acquire ownership of the e-Health project.
However, bottom-up partnerships alone may not be sufficient to ensure sustainable e-Health implementation as they also create complexity. Shin argued that calls for equal, bottom-up partnerships may be unrealistic as “the possibility that one person’s success may be another person’s failure […] is rarely mentioned”:331]. In relation to this, Wit and Berner state “the idea of mobilizing and organizing people collectively on the basis of horizontal [equal] ties and common interests does not appear to work well in most places, and, even more fatal, it appears to work less well the poorer and more dependent people are” :928]. This is the case because “frequently, partnerships are asymmetrical, uneasy and often unsustainable, as they are based on personalized, vertical and informal relations that are frequently politicized, rather than on horizontal, collective relations rooted broadly in communities” :931]. This leads both Hosman  and Shin  to suggest that e-Health implementation requires a “top-down-meets-bottom-up method” :38].
Following this line of thought, we suggest that bottom-up and top-down implementation strategies are in fact points on two continua: centralized versus shared ownership; and horizontal versus vertical relationships between the actors. Purely bottom-up or top-down implementation strategies are rare, if they exist at all, with most studies showing some in-between form. Further, as e-Health implementation is dynamic, implementation managers may decide to change their implementation strategy over the course of the implementation process. For example, a single stakeholder initiating an e-Health implementation may later want to partner other stakeholders to create broader support and ensure the project becomes embedded in the rural community. This entails a shift in implementation strategy from a horizontal, centralized ownership strategy to a horizontal or vertical shared ownership strategy. These results suggest that it is time to stop discussing the pros and cons of bottom-up versus top-down implementation strategies, and to start thinking about the strategic management of project ownership. By strategic, we mean that the implementation should involve well-timed shifts in project ownership with an eye on sustainable adoption. We therefore suggest the following proposition.
Proposition 3: In rural communities, sustainable e-Health adoption requires strategic changes in ownership over time.
Rural e-Health  implementation is an emerging and rapidly developing field. This review paper shows that rural e-Health implementation could fail due to underestimating the implementation factors involved and the interactions between context, process, and content elements of change. For e-Health implementation to lead to sustainable adoption (i.e. it “sticks”), the e-Health content (the “clicks”) needs to align with the local contextual structures (the “bricks”) through strategic interventions in the implementation process (the “tricks”). While the type of technologies studied differed somewhat across the various regions included in the study, the general categories of implementation factors identified were almost the same. This led to the development of three propositions on the required alignment between these factors that will hopefully act as stimuli for further research.
a Domotics can be defined as “the set of elements that, when installed, interconnected and automatically controlled at home, release the user from the routine of intervening in everyday actions and, at the same time, provide optimized control of comfort, energy consumption, security and communications” ;154].
Eveline Hage is a PhD student in the Innovation Management & Strategy Department of the Economics and Business Faculty, University of Groningen. Focusing on the elderly, she studies conditions for ICT-enabled social change in rural communities.
John P. Roo holds master degrees in business administration change management and in human resource management. He is interested in strategic change and social interaction.
Marjolein A.G. van Offenbeek is an assistant professor in the Innovation Management & Strategy Department of the Economics and Business Faculty, University of Groningen. She studies the implementation and effects of new technologies, work structures, and professional roles in changing healthcare environments.
Albert Boonstra is a professor in the Organization and Innovation Department of the Economics and Business Faculty, University of Groningen. His research focuses on the implementation and use of complex information systems in healthcare environments and in particular on acceptance, resistance, stakeholder management, conflict, and use of power and politics.
We wish to thank Hans Wortmann, Lusette Brouwer, John van Meurs, and Geke Dijkstra for sharing their ideas and practitioners’ insights.
This study was funded by the Dutch National Care for the Elderly Programme (NPO). This publicly funded programme aims to develop a coherent care provision that is better suited to the individual needs of elderly people. The NPO was not actively involved in the development of this study.
- United Nations Department of Economic and Social Affairs Population Division. 2009, New York: World population ageing
- Poisal JA, Truffer C, Smith S, Sisko A, Cowan C, Keehan S, et al: Health spending projections through 2016: modest changes obscure part D’s impact. Health Aff. 2007, 26: 242-253. 10.1377/hlthaff.26.2.w242.View Article
- OECD: Society at a Glance, OECD-Social Indicators. 2009, Paris: OECD Publishing
- Marsden T: Rural futures: Countryside and its regulation. Sociol Rural. 1999, 39 (4): 501-520. 10.1111/1467-9523.00121.View Article
- Fésüs G, Rillaers A, Poelman H, Gáková Z: Regions 2020: Demographic challenges for European regions, Commission of European communities. 2020, http://ec.europa.eu/regional_policy/sources/docoffic/working/regions2020/pdf/regions2020_demographic.pdf.
- Labrianidis L: The future of Europe’s rural peripheries. 2004, London: Ashgate Publishing Limited
- Kinsella K, Velkoff VA: U.S. Census Bureau, Series P95/01-1, An Aging World. 2001, Washington DC: U.S. Government Printing Office
- Bynum AB, Cranford CO, Irwin AA, Denny GS: Participant satisfaction in an adult telehealth education program using interactive compressed video delivery methods in rural Arkansas. J Rural Health. 2003, 19 (3): 218-222. 10.1111/j.1748-0361.2003.tb00565.x.PubMedView Article
- Ferrer-Roca O, Garcia-Nogales A, Pelaez RN, Pelaez C: The impact of telemedicine on quality of life in rural areas: The extremadura model of specialized care delivery. Telemed e-Health. 2010, 16 (2): 233-243. 10.1089/tmj.2009.0107.View Article
- Gibson KL, Coulson H, Miles R, Kakekakekung C, Daniels E, O'Donnell S: Conversations on telemental health: listening to remote and rural First Nation communities. Rural Remote Heal. 2011, 11 (2): 1656-1674.
- Jayaraman C, Kennedy P, Dutu G, Lawernson R: Use of mobile phone cameras for after-hours triage in primary care. J Telemed Telecare. 2008, 14 (5): 271-274. 10.1258/jtt.2008.080303.PubMedView Article
- Shaw BR, DuBenske LL, Han JY, Cofte-Woerpel L, Bush N, Gustafson DH, McTavish F: Antecedent characteristics of online cancer information seeking among rural breast cancer patients: An application of the Cognitive-Social Health Information Processing (C-SHIP) model. J Health Inf. 2008, 13 (4): 389-408.
- Shepherd L, Goldstein D, Whitford H, Thewes B, Brummell V, Hicks M: The utility of videoconferencing to provide innovative delivery of psychological treatment for rural cancer patients: Results of a pilot study. J Pain Symptom Manage. 2006, 32 (5): 453-461. 10.1016/j.jpainsymman.2006.05.018.PubMedView Article
- Simms DC, Gibson K, O'Donnell S: To use or not to use: clinicians' perceptions of telemental health. Can Psychol. 2011, 52 (1): 41-51.View Article
- Romanow R: Building on values: the future of health care in Canada. 2002, Ottawa: Health Canada
- Watanabe M, Jennett P, Watson M: The effect of information technology on the physician workforce and health care in isolated communities: the Canadian picture. J Telemed Telecare. 1999, 5 (Suppl. 2): 11-19.View Article
- Timmer S: eHealth in de praktijk; handreiking voor iedereen die wil kennismaken of starten met eHealth. 2011, Houten: Bohn Stafleu van Loghum
- Schalken F: Handboek online hulpverlening van de stichting e-Hulp.nl. 2010, Houten: Bohn Stafleu van Loghum
- E-Health Point: http://ehealthpoint.com.
- Ambient Assisted Living joint programme, Catalogue of Projects: http://www.aal-europe.eu/projects/AALCatalogueV3.pdf.
- Boonstra A, van Offenbeek M: Towards consistent models of e-Health implementation: structurational analysis of a telecare programme’s limited success. Inf Syst J. 2010, 20 (6): 537-561. 10.1111/j.1365-2575.2010.00358.x.View Article
- Hebert MA, Brant R, Hailey D, van der Pol M: Potential and readiness for video-visits in rural palliative homecare: results of a multi-method study in Canada. J Telemed Telecare. 2006, 12 (3): 43-45.View Article
- Hebert MA, Jansen JJ, Brant R, Hailey D, van der Pol M: Successes and challenges in a field-based multi-method study of home telehealth. J Telemed Telecare. 2004, 10 (1): 41-44. 10.1258/1357633042614348.PubMedView Article
- Cecchini S, Riana M: Electronic government and the rural poor: The case of Gyandoot. Inf Technol Int Dev. 2004, 2 (2): 65-75. 10.1162/1544752044193434.View Article
- Shin DH: The development of community telecommunication infrastructure: An evaluation of rural telecommunications project. Int J Inf Manage. 2008, 28 (4): 322-335. 10.1016/j.ijinfomgt.2008.02.003.View Article
- Pettigrew A, Whipp R: Managing change for competitive success. 1991, Malden: Blackwell Publishers Inc
- Lewin K: Field theory in social science. 1951, New York: Harper and Row
- Pettigrew A, Ferlie E, McKee L: Shaping strategic change – The case of the NHS in the 1980s. Public Money Manage. 1992, 12 (3): 27-31. 10.1080/09540969209387719.View Article
- Pettigrew A, Whipp R: Managing change and corporate performance. European industrial restructuring in the 1990s. Edited by: Cool K, Neven DJ, Walter I. 1992, Hampshire: Macmillan Academic and Professional, 227-265.View Article
- Stetler CB, Ritchie J, Rycroft-Malone J, Schultz A, Charns M: Improving quality of care through routine, successful implementation of evidence-based practice at the bedside: an organizational case study protocol using the Pettigrew and Whipp model of strategic change. Implementation Sci. 2007, 2.
- Hansson J, Tolf S, Øvretveit J, Carlsson J, Brommels M: What happened to the No-wait hospital? A case study of implementation of operational plans for reduced waits. Qual Manage Health Care. 2012, 21: 34-43.View Article
- Pettigrew AM: What is a processual analysis?. Scand J Mgmt. 1997, 13: 337-348. 10.1016/S0956-5221(97)00020-1.View Article
- Pawson R, Greenhalgh T, Harvey G, Walshe K: Realist review – a new method of systematic review designed for complex policy interventions. J Health Serv Res Policy. 2005, 10: 21-34. 10.1258/1355819054308530.PubMedView Article
- Greenhalgh T, Robert G, Bate P, Peacock R: How to Spread Good Ideas, A systematic review of the literature on diffusion, dissemination and sustainability of innovations in health service delivery and organization. Report for the National Co-ordinating Centre for NHS Service Delivery and Organisation R & D (NCCSDO). 2004
- Pettigrew AM: Context and Action in the transformation of the firm. J Manage Stud. 1985, 24: 649-670.View Article
- Pettigrew AM, Ferlie E, McKee L: Shaping strategic change: Making change in large organizations, the case of the NHS. 1992, London: Sage
- Harrison MI, Koppel R, Bar-Lev S: Unintended consequences of information technologies in health care—an interactive sociotechnical analysis. J Am Med Inform Assoc. 2007, 14: 542-549. 10.1197/jamia.M2384.PubMedPubMed CentralView Article
- Galbraith MW: Education in the rural American community: A lifelong process. Defining rural community(ies): Future considerations for informal and nonformal adult education in rural communities. Edited by: Bracken SJ. 2008, New directions for adult and continuing education, 83-92. 117
- World Health Organization: Constitution of the World Health Organization. 1946, New York: International Health Conference
- Dixon-Woods M, Agarwal S, Young B, Jones D, Sutton A: Integrative approaches to qualitative and quantitative evidence. 2004, Health development agency 2004, Available from: http://www.hda.nhs.uk.
- Mays N, Roberts E, Popay J: Synthesizing research evidence. Studying the organization and delivery of health services. Edited by: Fulop N, Allen P, Clarke A, Black N. 2001, London: Routledge
- Kmet LM, Lee RC, Cook LS: Standard quality assessment criteria for evaluating primary research papers from a variety of fields. Alberta Herit Found Med Res. 2004, 13: 1-11.
- Petticrew M, Roberts H: How to appraise the studies: An introduction to assessing study quality. Systematic reviews in the social sciences: A practical guide. 2006, Malden: Blackwell Publishing, 125-163.View Article
- Public health resource unit: NHS: Critical Appraisal Skills Programme (CAPS): 10 questions to help you make sense of qualitative research. 2006, England
- Thomas BH, Ciliska D, Dobbins M, Micucci S: A process for systematically reviewing the literature: Providing the research evidence for public health nursing interventions. Worldviews Evid Based Nurs. 2004, 1 (3): 176-184. 10.1111/j.1524-475X.2004.04006.x.PubMedView Article
- Borgida E, Sullivan JL, Oxendine A, Jackson MS, Riedel E: Civic culture meets digital divide: The role of community electronic networks. J Soc Issues. 2002, 58 (1): 125-141. 10.1111/1540-4560.00252.View Article
- Riedel E, Dresel L, Wagoner MJ, Sullivan JL, Borgida E: Electronic communities: Assessing equality of access in a rural Minnesota community. Soc Sci Comput Rev. 1998, 16 (4): 370-390. 10.1177/089443939801600403.View Article
- Sullivan JL, Borgida E, Jackson MS, Riedel E, Oxendine A: A tale of two towns: Assessing the role of political resources in a community electronic network. Pol Behav. 2002, 24 (1): 55-84. 10.1023/A:1020947005847.View Article
- Aminuzzaman S, Baldersheim H, Jamil I: Talking back! Empowerment and mobile phones in rural Bangladesh: A study of the village phone scheme of Grameen bank. Contemp S Asia. 2003, 12 (3): 327-348. 10.1080/0958493032000175879.View Article
- Chowdhury SK: Access to a telephone and factor market participation of rural households in Bangladesh. J Agricultural Econ. 2006, 57 (3): 563-576. 10.1111/j.1477-9552.2006.00065.x.View Article
- Stern MJ: How locality, frequency of communication and internet usage affect modes of communication within core social networks. Inf Commun Soc. 2008, 11 (5): 591-616. 10.1080/13691180802126778.View Article
- Stern MJ, Adams AE: Do rural residents really use the internet to build social capital? An empirical investigation. Am Behav Sci. 2010, 53 (9): 1389-1422. 10.1177/0002764210361692.View Article
- Stern MJ, Dillman DA: Community participation, social ties, and use of the internet. City Community. 2006, 5 (4): 409-424. 10.1111/j.1540-6040.2006.00191.x.View Article
- LaRose R, Gregg JL, Strover S, Straubhaar J, Carpenter S: Closing the rural broadband gap: promoting adoption of the internet in rural America. Telecommunications Policy. 2007, 31: 359-373. 10.1016/j.telpol.2007.04.004.View Article
- LaRose R, Strover S, Gregg JL, Straubhaar J: The impact of rural broadband development: Lessons from a natural field experiment. Gov Inf Q. 2011, 28: 91-100. 10.1016/j.giq.2009.12.013.View Article
- Hollifield CA, Donnermeyer JF: Creating demand: influencing information technology diffusion in rural communities. Gov Inf Q. 2003, 20: 135-150. 10.1016/S0740-624X(03)00035-2.View Article
- Hollifield CA, Donnermeyer JF, Wolford GH, Agunga R: The effects of rural telecommunications self-development projects on local adoption of new technologies. Telecommunications Policy. 2000, 24: 761-779. 10.1016/S0308-5961(00)00052-5.View Article
- Gagnon MP, Duplantie J, Fortin JP, Landry R: Implementing telehealth to support medical practice in rural/remote regions: what are the conditions for success?. Implementation Sci. 2006, 1 (18): 1-8.
- Wathen CN, Harris RM: I try to take care of it myself. How rural women search for health information. Qual Health Res. 2007, 17 (5): 639-651. 10.1177/1049732307301236.PubMedView Article
- Boase J: The consequences of personal networks for internet use in rural areas. Am Behav Sci. 2010, 53 (9): 1257-1267. 10.1177/0002764210361681.View Article
- Kivunike FN, Ekenberg L, Danielson M, Tusubira FF: Perceptions of the role of ICT on quality of life in rural communities in Uganda. Inf Technol Dev. 2011, 17 (1): 61-80. 10.1080/02681102.2010.511698.View Article
- Lear SA, Araki Y, Maric B, Kaan A, Horvat D: Prevalence and characteristics of home internet access in patients with cardiovascular disease from diverse geographical locations. Can J Cardiol. 2009, 25 (10): 589-593. 10.1016/S0828-282X(09)70722-6.PubMedPubMed CentralView Article
- Michailidis A, Partalidou M, Nastis SA, Papadaki-Klavdianou A, Charatsari C: Who goes online? Evidence of internet use patterns from rural Greece. Telecommunications Policy. 2011, 35 (4): 333-343. 10.1016/j.telpol.2011.02.006.View Article
- Forestier E, Grace J, Kenny C: Can information and communication technologies be pro-poor?. Telecommunications Policy. 2002, 26 (11): 623-646. 10.1016/S0308-5961(02)00061-7.View Article
- Hosman L, Fife E: Improving the prospects for sustainable ICT projects in the developing world. Int J Media Cult Polit. 2008, 4 (1): 51-69. 10.1386/macp.4.1.51_1.View Article
- Gilbert E, Karahalios K, Sandvig C: The network in the garden: Designing social media for rural life. Am Behav Sci. 2010, 53 (9): 1367-1388. 10.1177/0002764210361690.View Article
- Mars A, De: Internet usage by native Americans with disabilities living on American Indian reservations in the great plains. Rural Spec Educ Q. 2010, 29 (2): 34-40.
- Pigg KE, Crank LD: Do information communication technologies promote rural economic development?. Community Dev. 2005, 36: 65-76. 10.1080/15575330509489872.View Article
- Sørensen JFL: Attitudes toward telehealth use among rural residents: A Danish survey. J Rural Health. 2008, 24 (3): 330-335. 10.1111/j.1748-0361.2008.00178.x.PubMedView Article
- Singh R, Mathiassen L, Stachura ME, Astapova EV: Sustainable rural telehealth innovation: A public health case study. HSR: Health Serv Res. 2010, 45 (4): 985-1004. 10.1111/j.1475-6773.2010.01116.x.PubMedPubMed Central
- Pendleton SM, Stanton B, Cottrell LA, Marshall S, Pack R, Burns J, Gibson C, Wu Y, Li X, Cole M: Teens in the twenty-first century still prefer people over machines. J HIV/AIDS Prev Child Youth. 2008, 8 (2): 95-115. 10.1300/J499v08n02_06.View Article
- Zilliacus EM, Meiser B, Lobb EA, Kirk J, Warwick L, Tucker K: Women's experience of telehealth cancer genetic counseling. J Genet Couns. 2010, 19 (5): 463-472. 10.1007/s10897-010-9301-5.PubMedView Article
- Fortin JP, Gagnan MP, Cloutier A, Labbé F: Evaluation of a telemedicine demonstration project in the Magdalene Islands. J Telemed Care. 2003, 8: 89-94.
- Reid DS, et al: Telemedicine in Nova Scotia: Report of a pilot study. Telemed J. 1998, 4: 249-258. 10.1089/tmj.1.1998.4.249.PubMedView Article
- Balasubramanian K, Thamizoli R, Umar A, Kanwar A: Using mobile phones to promote lifelong learning among rural women in Southern India. Distance Education. 2010, 31 (2): 193-209. 10.1080/01587919.2010.502555.View Article
- Burrell J: Evaluating shares access: Social equality and the circulation of mobile phones in rural Uganda. J Comput-Mediated Commun. 2010, 15 (2): 230-250. 10.1111/j.1083-6101.2010.01518.x.View Article
- Madoc-Jones I, Warren E, Ashdown-Lambert J, Williams E, Parry O: Planned telephone support for disadvantaged parents in North Wales: perceptions of service users. Child Fam Soc Work. 2007, 12 (4): 316-325. 10.1111/j.1365-2206.2006.00471.x.View Article
- Zhao J: ICT4D: Internet adoption and usage among rural users in China. Knowl Technol Policy. 2008, 21 (1): 9-18. 10.1007/s12130-008-9041-0.View Article
- Kumar R, Best M: Social impact and diffusion of telecenter use: A study from the sustainable access in rural India project. J Commun Inform. 2006, 2: http://ci-journal.net/index.php/ciej/article/view/328/268.
- Kanungo S: On the emancipatory role of rural information systems. Rural Inf Syst. 2004, 17 (4): 407-422.
- Rubinoff DD: Life histories in cyberspace: life writing as a development tool for rural women. Geoforum. 2005, 36: 59-75. 10.1016/j.geoforum.2004.03.009.View Article
- Schmeida M, McNeal RS: The telehealth divide: Disparities in searching public health information online. J Health Care Poor Underserved. 2007, 17 (3): 637-647.View Article
- McQuaid RW, Lindsay C, Greig M: Reconnecting' the unemployed: Information and communication technology and services for jobseekers in rural areas. Inf Commun Soc. 2004, 7 (3): 364-388. 10.1080/1369118042000284605.View Article
- Hosman L: Policies, partnerships, and pragmatism: Lessons from an ICT-in-education project in rural Uganda. Inf Technol Int Dev. 2010, 6 (1): 48-64.
- McInerney CR: Educational inquiry and creativity: Developing digital resources in Ireland's information age town. Libr Trends. 2005, 54 (2): 266-285. 10.1353/lib.2006.0019.View Article
- Norris P: Digital divide: Civic engagement, information poverty, and the internet worldwide. 2001, Cambridge: Cambridge University PressView Article
- Norris P: The bridging and bounding of online communities. Harvard Inter J Press/Polit. 2002, 7 (3): 3-13.View Article
- de Wit J, Berner E: Progressive patronage? Municipalities, NGOs, CBOs and the limits to slum dwellers’ empowerment. Dev Change. 2009, 40 (5): 927-947. 10.1111/j.1467-7660.2009.01589.x.View Article
- Oh H, Rizo C, Enkin M, Jadad A: What is e-Health (3): a systematic review of published definitions. J Med Internet Res. 2005, 7 (1): e1.PubMedPubMed CentralView Article
- Bravo C, Redondo MA, Ortega M, Verdejo MF: Collaborative environments for the learning of design: a model and a case study in Domotics. Comput Educ. 2006, 46: 152-173. 10.1016/j.compedu.2004.07.009.View Article
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1472-6963/13/19/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.