- Research article
- Open Access
How to Design a Remote Patient Monitoring System? A French Case Study
BMC Health Services Research volume 20, Article number: 434 (2020)
Remote Patient Monitoring Systems (RPMS) based on e-health, Nurse Navigators (NNs) and patient engagement can improve patient follow-up and have a positive impact on quality of care (by limiting adverse events) and costs (by reducing readmissions). However, the extent of this impact depends on effective implementation which is often restricted. This is partly due to the lack of attention paid to the RPMS design phase prior to implementation. The content of the RPMS can be carefully designed at this stage and various obstacles anticipated. Our aim was to report on an RPMS design case to provide insights into the methodology required in order to manage this phase.
This study was carried out at Gustave Roussy, a comprehensive cancer centre, in France. A multidisciplinary team coordinated the CAPRI RPMS design process (2013–2015) that later produced positive outcomes. Data were collected during eight studies conducted according to the Medical Research Council (MRC) framework. This project was approved by the French National Data Protection Authorities.
Based on the study results, the multidisciplinary team defined strategies for resolving obstacles prior to the implementation of CAPRI. Consequently, the final CAPRI design includes a web app with two interfaces (patient and health care professionals) and two NNs. The NNs provide regular follow-up via telephone or email to manage patients’ symptoms and toxicity, treatment compliance and care packages. Patients contact the NNs via a secure messaging system. Eighty clinical decision support tools enable NNs to prioritise and decide on the course of action to be taken.
In our experience, the RPMS design process and, more generally, that of any complex intervention programme, is an important phase that requires a sound methodological basis. This study is also consistent with the notion that an RPMS is more than a technological innovation. This is indeed an organizational innovation, and principles identified during the design phase can help in the effective use of a RPMS (e.g. locating NNs if possible within the care organization; recruiting NNs with clinical and managerial skills; defining algorithms for clinical decision support tools for assessment, but also for patient decision and orientation).
The delivery of healthcare services for patients with chronic diseases requires more effective coordination between professionals and patients/relatives along the care pathway. In response, many health care organisations have implemented Remote Patient Monitoring Systems (RPMS). This type of intervention programme can improve patient follow-up and have a positive impact on the quality of care (reducing toxic effects, improving treatment compliance, limiting adverse events) and health-related costs (reducing the duplication of prescriptions and hospital readmissions) [1,2,3,4,5].
According to the Chronic Care Model [6, 7], an RPMS comprises three distinct components that facilitate the coordination of patient care: a) organisational methods (e.g. patient navigation program) [8, 9], b) e-health technology (e.g. web portal, apps) [10, 11] and c) patient engagement through information and training (e.g. health-literacy tools) [12, 13]. By combining one or more of these key components, many RPMS have been applied around the world in a variety of chronic diseases in recent years with some spectacular developments [14,15,16].
However, two recent literature reviews reported mixed results in terms of the effective impact of RPMS on quality of care and cost management [17, 18]. This is partly attributed to the fact that effective RPMS implementation remains a significant challenge. It depends on the processes accepted in relation to professionals and patients as well as on the local organizational context. It is important to understand the factors that can influence patient behaviour and healthcare practices, as well as the specific features of the intervention programme per se and its implementation context [5, 17, 19, 20]. The functional components of the RMPS must also be clearly described to facilitate implementation and replication. Hoffmann et al., for example, reported that only 39% of non-pharmacological interventions are adequately described. This lack of precision leads to replication difficulties in other settings . Finally, it is obvious that the evaluation protocol must be designed ex ante to the intervention . Otherwise, some data required may be omitted. Overall, these observations indicate a careful approach should be adopted when designing any RPMS. The more consideration given to the afore-mentioned issues during this design phase, the more effective the implementation is likely to be . A precise design can reduce the risk of ineffective implementation, avoid additional re-design costs and prevent replication problems [19, 23].
In order to investigate the design process, an RPMS is defined as a complex intervention involving several interactions between various individuals, organisations and tools which in this case refer to the combination of stages outlined above [19, 24]. An in-depth literature review has been proposed to guide the development, implementation and evaluation of such complex interventions [19, 25,26,27,28]. One major reference is the UK Medical Research Council (MRC) that defines four stages comprising key functions and activities: Development, Feasibility/piloting, Evaluation, and Implementation [25, 29]. This widely used guideline is of particular interest for interventions involving e-Health technologies such as RPMS . It helped us to use the intervention design process as the core development phase of this framework.
The aim of this paper is to report on our RPMS process design experience based on the CAPRI (Cancérologie Parcours Région Ile de France) Case Study. The RPMS, recognised as such by the French public authorities, consists of 2 NNs and technological support (a telephone platform and a web application). Its added-value has been assessed through a Randomized Clinical Trial (RCT) that significantly demonstrated an increased follow-up of the medical prescription, a reduction in the effects of severe toxicity, a decrease in hospital days, and a better patient experience in the follow-up of their disease . The RPMS is the result of a design process carried out to improve the management of cancer patients throughout the care pathway. Cancer is an ideal field for developing RPMS since it is a major chronic disease (leading cause of death in addition to having significant social and economic consequences) [32, 33], and requires organizational innovations for improving coordination along the care pathway. We based our design research protocol on the MRC (Medical Research Council) framework [25, 29]. A series of research studies have been conducted in accordance with the MRC’s guidelines to identify the evidence base, develop the appropriate theory and to model process and outcomes during the development phase. The contributions are two-fold. Firstly, they provide insight into an oncology-specific RPMS and its design process, which is a current issue. Secondly, it contributes to the methodological debate regarding guidelines for developing complex interventions.
The implementation and project management team
The RPMS under test, namely, CAPRI (CAncerologie Parcours Région Ile de France), was trialled at the Gustave Roussy Institute (Villejuif, France), a leading European cancer centre with 449 beds and 94 day-care places, treating over 48,000 patients (year 2018).
The purpose of CAPRI was to develop a RPMS dedicated to patients receiving oral cancer medication - a treatment that has been used more extensively in recent years . The use of such treatments is associated with organising and coordinating challenges [34,35,36]. Although most patients prefer oral therapy to IV therapy, they assume greater responsibility with oral therapies, and may encounter difficulties such as toxicity, which could affect treatment compliance. Furthermore, visits to health facilities are less frequent with primary care professionals potentially being the primary point of contact.
The initial stage of the project was devoted to the design of CAPRI (mid-2013-2015), and the second stage to implementation and evaluation (2016–2019). Three groups were formed depending on the work being carried out and the individual areas:
An expert group focused on the scientific aspects. Several disciplines were represented: oncologists, pharmacists, and health service researchers (management science and biostatistics);
A functional group was set up comprising hospital management personnel from various departments: Quality, Medical Information, Information System Management, Nursing Directorate, Outpatients, Pharmacy and Finance to make administrative decisions;
An operational working group including researchers from the expert group, and staff from different clinical departments to plan the daily agenda.
During the initial intervention design stage, the expert group met monthly, the functional group once every 3 months, and the last group on a weekly basis depending on project progression, in addition to telephone calls and emails.
The Principal Investigator of the evaluation programme was the Outpatient Senior Oncologist given his interaction with other healthcare professionals (MdP followed by OM). The Scientific Lead was a senior researcher in Healthcare Management Science (EM). A Programme Coordinator was also appointed to oversee all project management issues (MF).
Methodological principles to support the RPMS design process
The design process was managed by the multidisciplinary team comprising the three groups. Their role was backed by various studies carried out at Gustave Roussy. Eight studies were finally outlined, based on the three principles covered in the MRC framework during the development phase : (1) Identify the evidence base: to identify existing knowledge about similar interventions and the methods used to evaluate them, (2) Identify/develop an appropriate theory to promote the theoretical understanding of the likely process of change by drawing on existing evidence and theory and (3) Model process and outcomes prior to full-scale evaluation.
The CNIL approved each study. As a result, several stages in the design process were carried out between 2013 and 2015 (see Fig. 1).
The various studies carried out in support of the CAPRI design process are also summarised in Table 1. Some studies have been published in more detail elsewhere [37,38,39,40,41]. The four exploratory studies (studies 1 to 4) provided a preliminary draft of the CAPRI design including selected components (health technologies and new organisational methods involving nurses specialising in coordination) and the main functions and interaction. The intervention proposal was then presented to potential stakeholders (study 5) to model the process and outcomes. A patient study was conducted simultaneously to identify the unmet information needs of cancer patients and understand the reasons behind patient dissatisfaction (study 6). A quantitative study on the appropriateness and potential avoidance of emergency visits was also carried out to assess the potential contribution of the intervention (study 7). Finally, interviews were held with Gustave Roussy professionals involved in patient follow-up (oncologists, support teams) to model patient monitoring and develop the necessary monitoring tools (protocols, clinical decision support tools) (study 8).
The results are divided into two parts: the first part gives an insight into the RPMS design process whilst the second part describes the final Capri design.
The RPMS design process
The main results of the studies conducted during this design phase are summarised in Table 2.
They contributed in several stages to the design of the intervention programme and the assessment methods employed.
The literature reviews (studies 1 and 2, Table 2) taking into consideration the experiments carried out to coordinate care reported that a very wide range of tools and organisations are used to improve the care pathway. Some interventions are based on apps or tablets whereas others use telephone platforms. The role of case manager, coordination nurse or senior nursing clinician is often perceived as value added (studies 2 and 4, Table 2). As a result, the two main components retained, e-health technologies and new organizational methods with the implementation of Nurse Navigators (NN), were deemed potentially appropriate to meet coordination needs identified in the specific case of CAPRI. Patient commitment, another important factor in the successful patient-professional relationship, is linked as much with IT usage as with the quality of the NNs relationship (studies 3 and 6, Table 2).
Each CAPRI component was also analysed in order to predict implantation problems. The introduction of IT with a patient survey (median age 53.4 years) , has allowed the most appropriate technological tool (web and mobile app with two interfaces: patients and outpatient professionals) to be identified alongside the priority features to be developed to make the technological tool attractive for patients (studies 3 and 5, Table 2). Similarly, the combined study on home care coordination activities has prompted a better understanding of the current practices and skills required for the NNs role (study 4, Table 2) . Investigations have shown that NNs have to deal far more with organisational issues or routine activities in the life of a patient (e.g. how to travel with oral therapy) than with clinical ones.
Under the supervision of the three groups, these exploratory studies have led to a precise design, suggesting a technological tool, including a definition of these functions and a detailed description of the NNs role. The initial design could be discussed with potential users in order to model process and outcomes and define the major expected outcomes and the most relevant target population for the design of CAPRI.
Clinical decision support
The interviews carried out during study 5 (Table 2) highlighted the fact that NNs have clinical decision support tools to standardise patient follow-up in the very least (initial consultation, follow-up frequency and methods, evaluation parameters) to assess the situation, and finally to define the action to be taken. These tools were devised and validated with referral oncologists and health care support staff (study 8, Table 2), they were devised on the basis of NCI-CTCAE-V4 . The questions to be put to the patients were defined in order to determine the severity of the recurring events, action (procedure to implement) and results (assessment of actions). These algorithms led to 3 action-based principles for NNs: advice given to patients, the organisation of a consultation (hospital or GP), and the organisation of a hospital admission. Ultimately, 80 clinical decision support tools have been developed allowing NNs to prioritise and define the action to be taken based on alert parameters. This study also highlighted that NNs should be located within the hospital where patients are treated in order to have easy access to the oncologist’s expertise if necessary.
Alongside the intervention design, one major point was to define the entire assessment system prior to the implementation process in order to outline the evaluation criteria, the data to be collected and the target population.
According to the literature [20, 46], the group of experts also adopted the concept of an evaluation process, which led to the definition of two evaluation methods for the design of the protocol to measure the impact of CAPRI . Initially, as this is a type of study with a strong evidence base, a decision was taken to assess the « clinical » impact of the programme based on a randomised, controlled trial with a 700-patient cohort. The criteria for this study were determined using preliminary studies (studies 2 to 8, Table 2). The main evaluation criterion was defined as the relative dose intensity to assess compliance between the dose taken by the patient and the one scheduled in the protocol. Secondary endpoints were patient compliance with oral anticancer therapy, quality of life, patient experience, tumour response, Progression Free Survival (PFS), Overall Survival (OS) and the toxic side effects of treatment (severity and quantity). The RCT also includes an economic evaluation which adopts a societal perspective, assessing intervention, medical and non-medical costs. Finally, one endpoint focuses on the reason for emergency referrals. The results obtained in the Emergency Department study  have reinforced the value of the intervention programme in terms of reducing the number of unnecessary visits to the emergency department. Inappropriate and avoidable visits appear to be caused by inadequate referral to the most appropriate health professional, which is a key point in the follow-up process.
In addition, the difficulty in quantitatively measuring some of its effects and the behaviour of professionals in coordinating their actions, in particular, resulted in a longitudinal study. Collectively, and based on the analyses of articles in an attempt to RPMS evidence (studies 1, 2 and 8, Table 2), this approach was adopted to evaluate changes in the use and suitability of both tool and programme over time, focusing in addition on the behaviour of patients and professionals and how changes were implemented and knowledge was acquired during the implementation of the CAPRI programme.
In addition, regulatory strategies specific to developing the evaluation of telemedicine/remote medicine systems in an experimental setting were required. Since the CAPRI follow-up system is based on a telemedicine activity (remote follow-up), a telemedicine contract had to be signed with the Agence Régionale de Santé Ile de France (ARSIF) (Parisian Regional Health Agency). This step took 7 months and the contract with the ARS Ile de France was signed in October 2015. A mandatory procedure was also required with regard to the Commission Nationale de l’Informatique et des Libertés (CNIL) to authorise the pooling of personal health-related information. The CNIL procedure was initiated only after signature of the ARS Ile contract, and was obtained in May 2016. These legal issues have governed the regulatory framework in which the CAPRI system can be used.
Apart from the timescales imposed by these regulatory authorities, compliance also impacted system design. For instance, the plan was to allow community professionals, and General Practitioners in particular, to document mutual patient information using the shared patient follow-up record. This option was abandoned since an agreement would have been required with each health care professional in accordance with regulatory requirements. This system was deemed to be too complex for routine use.
A dynamic, iterative process
All the issues outlined above refer to a dynamic design process. As summarised in Fig. 2, our design process allowed a simultaneous process to be carried out using an iterative approach towards the three MRC principles we applied.
This iterative approach allowed various obstacles to be identified (e.g. real and priority needs, local context specifics) and corrected prior to implementation (e.g. target intervention to the patients most likely to benefit; correct combination of NNs activities and e-health technology functions; holistic process design and outcome evaluation measure).
Capri intervention specifications
The final CAPRI design includes a web/mobile app with two interfaces (patient and professional) and two Nurse Navigators (Fig. 3).
The organisational aspects are quite important. We have already described the different clinical decision support tools developed to assist NNs activities. The two NNs provide regular telephone follow-up to manage patients’ symptoms and toxicity issues, treatment compliance and supportive care needs. Patients have access to the app to record/track data, contact the NNs via a secure messaging system, view therapy and side effect information or store documents. The NNs are linked to health professionals involved in patient management.
Organisation of NNs activities
NNs conduct an initial assessment interview with each patient in-person or over the phone to identify his or her needs. The patient interview also includes a review of treatment, medical prescriptions and appointments. NNs then prepare the individual patient electronic medical record on the CAPRI application. Following this initial phase, NNs ensure patient follow-up (e.g. temperature, weight, pain, diet) remotely, through telephone interviews and emails, from Monday to Friday, during office hours only (from 9 am to 5 pm). Patients benefit from a regular phone follow-up in addition to individual contact depending on access difficulties, needs, and resources. In addition, NNs help patients to identify and overcome obstacles, provide health and practical information as well as emotional support, help patients to organise their appointments, help them to understand their conditions and treatments and help them to be actively involved in their care. They also forge links between the patient and hospital professionals and primary care providers (GP, private nurse, pharmacist, etc.) who are given access to the CAPRI application with the patient’s consent. To this end, NNs ensure that consultation reports, examination and test results and new medical prescriptions are available on the CAPRI application to all authorised healthcare providers at the time of an appointment. NNs inform health care providers about patient appointments, new treatments, new symptoms or difficulties, as required. Patient monitoring is described in a specific protocol prepared and validated by the expert group. During the initial assessment, each patient is given a starter box, which includes the following: login data to gain access to the portal, instructions for use and covering letters for healthcare providers, required (with information on the web portal, instructions on how to create an account and the, NNs’ contact details).
Web/mobile CAPRI application
The CAPRI application is available in web or mobile version and provides an interface to connect patients, hospital professionals, primary care providers and NNs.
The application offers patients several modules as shown in Table 3.
The CAPRI application provides NNs with a dashboard to enable them to monitor the individual electronic medical records of patients. Each time a patient is contacted, the NN can create intervention reports to record what they have done or discussed, and transmit the information to the professionals previously indicated by the patients. These professionals can log on the portal to communicate with the NNs online and access the relevant patient information. The system also generates automatic alerts which are sent to the patients or the NNs. The alerts and patients’ requests can be generated in different ways: 1) automatically, via the app, for instance while reporting follow-up measures (if the patient’s parameters are below or above predefined thresholds); 2) by the NNs during regular follow-ups; 3) by messaging/calling the patient or the professionals. The NNs assess the alert grade based on clinical decision support tools and determine the action to be taken according to navigation algorithms. Depending on the grade, the NNs can give advice, refer the patient to his or her primary care physician, or a Gustave Roussy professional or contact the relevant services in order to arrange hospitalisation or schedule an appointment for the patient.
This paper discusses the design of the CAPRI – an RPMS intended to improve the care pathway for cancer patients receiving oral medication. Two findings come to light.
Firstly, it outlines the crucial role of the design phase and provides an insight into the method required to carry out the process.
The way in which the system is accepted by patients and healthcare professionals as well as hospital managers is a key factor in effective implementation that starts during this design phase . One major criterion was the considerable work carried out by the three groups focusing on identifying the coordination difficulties and priority needs in order to grasp a better understanding of the context and to define the main problem to be addressed by the intervention. Particular focus was given to the setting-up of these three groups (expert, functional and transversal working groups) and to incorporating individual contributions to provide an overall view of the intervention programme [49, 50]. The close collaboration between the three groups and within various disciplines and functions has allowed the programme to be designed in line with the real-life context, thus creating psychological ownership whilst better addressing the needs of patients, clinicians and managers. These are key factors in successful implementation [51, 52].
Our experience also shows that evaluation design must be carefully analysed in advance as a process evaluation. In terms of process and outcome evaluation measures, the work on identifying the target population, outcomes and programme content was crucial to improve the design, criteria and indicators to be followed in the randomised control trial, as noted elsewhere [53, 54] and in process evaluation. Another important point was to define a combined method comprising a randomised, controlled trial and a longitudinal qualitative approach which requires process evaluation. This process evaluation decision was taken in response to two objectives: to understand and describe how the system works in practice and to assess the level of suitability and retrace the dynamics of the latter in terms of patients and professionals alike. Indeed, both objectives are required in order to explain the results observed during the randomised study period [20, 46]. Thus it is a case of establishing a link over time between the dynamics of system suitability (acceptance method and sustainability/continuity) and changes in the results obtained within the randomised study context. Furthermore, in terms of the latter, the aim is two-fold. On the one hand, the randomised study seeks to highlight the contextual and behavioural factors that promote or hamper the implantation and continuity of co-ordination systems (the evaluation of the effects could not be detected to adequate extent by the randomised study and did not provide any justification, regardless of whether the effects were positive or negative). On the other hand, the longitudinal study highlights the key issues through a scientific approach, driving and optimising the implementation of coordination systems more effectively in line with local requirements.
These insights can contribute to the knowledge of development and implementation processes of healthcare intervention programmes. We based our research protocol on the MRC framework for the development and evaluation of complex interventions [25, 29]. The three principles of the development phase (i.e. “identify the evidence”, “develop an appropriate theory” and “model process and outcomes before a full scale evaluation”), were very helpful. In the experiments reported in the scientific literature, existing evidence in terms of intervention content, implementation strategy and process evaluation measures was sparse. Following the MCR principles, we collected evidence about the relevant target population, anticipated outcomes and the most suitable intervention. We developed the underlying theory and finally designed the intervention programme in operational terms, modelling the implementation strategy and the process and outcome evaluation measures. Indeed, the exploratory survey carried out initially and the literature review on care coordination requirements highlighted the priorities in terms of both the target population and outcomes. An intervention programme designed to address numerous requirements or several outcomes at the same time may produce confused and imprecise results. Similarly, these guidelines allowed the intervention content to be finely tuned following an iterative approach . Although le MRC Framework proved useful in establishing the broad lines of the study, particular attention must be paid to the initial steps concerning the key elements in the « Development » stage. In fact, the method does not state this but, in our opinion, it is vital that interactions and repetitions are carried out between the « Developing appropriate theory », and « Modelling process and outcomes » phases described during this stage. The preliminary studies carried out during the development stage challenged the content of the intervention programme on many occasions and allowed us to define the interactions between the various components to align the evaluation criteria with the final actions taken within the intervention programme . Furthermore, the regulatory and legal constraints seem an inherent part of the intervention design process when working on innovation programmes such as RPMS. In terms of our experience, their impact on the length of time to the implementation authorisation stage was significant and it seems vital to include this complex issue at the design stage .
Secondly, our experience shows the importance of organizational aspects in the RPMS context, precisely the coordination of care required for the organization of a remote follow-up of patients, as noticed elsewhere . From a theoretical standpoint, many theories have already pointed out that the effectiveness of telemedicine can only be understood in its use, i.e. in social practices , or as a technology-in-practice in practice [58, 59]. In other words, the coordination of care cannot be predicted, and therefore, there is a limit to consider these organizational aspects during the design stage. In this context, this study provides elements on the aspects of care coordination that can be reasoned during the design phase. Our study shows that far from a definition of working rules of care coordination, some “principles” orienting its implementation, can be identified. The final CAPRI design provides the following principles that represent guidelines when designing coordination of care aspect into RPMSs:
-NNs have already proved their added-value in the patient management of different chronic diseases [14,15,16]. Here, we highlight that through their actions, NNs can enhance patient engagement in remote dialogue via the mobile app or telephone, by tailoring information, according to their needs , trigger clinical alerts, and develop coordination with the patient and other professionals (e.g. pharmacists, general practitioners, nurses). It requires a mix of clinical and managerial skills  that can lead to profile of NNs required.
-The clinical decision support tools provide a basis for defining the most appropriate answer for specific patient requirements as well as the most appropriate direction based on the clinical severity. Designing clinical decision support tools that are not only guides for evaluation, but also for orientation, whatever the organizational conditions to accomplish it, represent another recommendation.
-The need to link NNs to the technological application in order to process information more efficiently and direct patients accordingly suggests that there is a need to link the three factors of the Chronic Care Model [6, 7]: use of technological innovation (mobile app), the development of new coordination roles (NNs) and patient commitment. Furthermore, this choice prevent physicians from being overwhelmed by demands that are not related to their clinical expertise, thus allowing them to optimise their workload . At the same time, it is important for NNs to be able to coordinate easily with medical oncologists. This has led to NNs located within the facility rather than on an external platform to limit the risk of distance or “physical boundary” . Such a choice is also related to the hospital’s ability to recruit nurses, which depends on the number of patients followed.
-Finally, the selection of the feedback support, between the application allowing automated feedback and the phone, generally preferred by patients but more time-consuming for NNs, is another key point. In our design, we have integrated both options, the use of the RPMS showing the dominant use of the phone on the application afterwards [64, 65].
This study has various limitations. This was initially a specific case of RPMS, in a specific setting, namely Gustave Roussy, with the aim of monitoring patients receiving oral medication. All of these specific features require additional research in other settings, with other objectives, to define RPMS models. Secondly, the effective use of the RPMS and the study outcomes are not presented in the paper. The experimentation gave positive outcomes , and showed different insights about the use of the RPMS. As such, they suggest this type of design strategy can lead to positive outcomes, but it requires further evaluation to understand the relationships between the design phase, the implementation step, and the outcomes achieved. Thirdly, the strengths of our development process include the interactive approach combining the evidence base, theoretical framework and the involvement of a large network of stakeholders. However, this requires an important research investment in terms of time and money which is not always feasible. Fourthly, the use of the MRC framework meant that greater attention was focused on the context, resulting in the design of a customised intervention programme. Our aim was not to develop a design model that defines priority needs and the relevant content of such an intervention programme, but to show how to identify these needs and the key aspects in order to design the intervention. Moreover, by basing the design of the intervention programme on the local context, the risk is that the intervention designed may not be reproducible elsewhere. This is a key-aspect for large-scale circulation . Future research should investigate this balance between designing a pilot study and the ability to transfer it.
Despite limitations, our investigation reveals two findings about the RPMS content and the likelihood of encountering various issues relating to the implementation process during the design phase. Firstly, the RPMS programme is not only a technological innovation, something which is often outlined, but also an organisational innovation. This means that it is important to acknowledge the use of IT in conjunction with human practices and in a specific context (i.e. in our case, the 2 NNs and their relationship with other healthcare professionals). Secondly, this study confirms that the design phase of RPMS and, more generally, of any organisational intervention, must not be overlooked. As regards the methodological aspects of designing complex healthcare interventions, we wish to emphasise the fact that incorporation of the local context and relevant process evaluation are crucial in order to design an appropriate intervention programme and promote acceptance by users. Research programmes must therefore include the relevant dedicated stages. These preliminary phases warrant a constant review of the intervention content in order to ensure that it is fit for purpose in the given context. This should help to increase the likelihood of implementing an intervention programme in the most appropriate manner, which is a current issue in modern healthcare delivery systems.
Availability of data and materials
The data sets analysed in this study are available from the corresponding author on request.
Commission Nationale de l’Informatique et des Libertés (CNIL) (French National Data Protection Commission)
- ARS Ile de France:
Agence Régionale de Santé (French Regional Health Agency) –Ile-de France
Cancérologie Parcours Région Ile de France (Regional Oncology Pathway)
UK Medical Research Council
Remote Patient Monitoring System
Basch E, Deal AM, Dueck AC, Scher HI, Kris MG, Hudis C, et al. Overall survival results of a trial assessing patient-reported outcomes for symptom monitoring during routine cancer treatment. JAMA. 2017;318(2):197. Cited 2019 Sep 3. Available from. https://doi.org/10.1001/jama.2017.7156.
Denis F, Basch E, Septans A-L, Bennouna J, Urban T, Dueck AC, et al. Two-year survival comparing web-based symptom monitoring vs routine surveillance following treatment for lung cancer. JAMA. 2019;321(3):306. Cited 2019 Oct 9. Available from. https://doi.org/10.1001/jama.2018.18085.
Klersy C, De Silvestri A, Gabutti G, Raisaro A, Curti M, Regoli F, et al. Economic impact of remote patient monitoring: an integrated economic model derived from a meta-analysis of randomized controlled trials in heart failure. Eur J Heart Failure. 2011;13(4):450–9. Cited 2019 Oct 24. Available from. https://doi.org/10.1093/eurjhf/hfq232.
Hummel JP, Leipold RJ, Amorosi SL, Bao H, Deger KA, Jones PW, et al. Outcomes and costs of remote patient monitoring among patients with implanted cardiac defibrillators: an economic model based on the PREDICT RM database. J Cardiovasc Electrophysiol. 2019;30(7):jce.13934 Cited 2019 Oct 24. Available from: http://www.ncbi.nlm.nih.gov/pubmed/30938894.
Warrington L, Absolom K, Conner M, Kellar I, Clayton B, Ayres M, et al. Electronic Systems for Patients to Report and Manage Side Effects of Cancer Treatment: Systematic Review. J Med Int Res. 2019;21(1):e10875 Cited 2020 Apr 21. Available from: http://www.jmir.org/2019/1/e10875/.
Bodenheimer T, Wagner EH, Grumbach K. Improving primary care for patients with chronic illness. JAMA. 2002;288(15):1909. Cited 2019 Oct 24. Available from. https://doi.org/10.1001/jama.288.15.1909.
Bodenheimer T, Wagner EH, Grumbach K. Improving primary care for patients with chronic illness. JAMA. 2002;288(14):1775. Cited 2019 Oct 24. Available from. https://doi.org/10.1001/jama.288.14.1775.
Freeman HP. Patient navigation: a community centered approach to reducing cancer mortality. J Cancer Educ. 2006;21(1, suppl):S11–4 Available from: http://www.ncbi.nlm.nih.gov/pubmed/17020496.
Eschiti V, Burhansstipanov L, Watanabe-Galloway S. Native Cancer navigation: the state of the science. Clin J Oncol Nurs. 2012;16(1):73–89.
Madhavan S, Sanders AE, Chou W-YS, Shuster A, Boone KW, Dente MA, et al. Pediatric palliative care and eHealth opportunities for patient-centered care. Am J Prev Med. 2011;40(5 Suppl 2):S208–16 Available from: http://www.ncbi.nlm.nih.gov/pubmed/21521596.
Canadian Diabetes Association Clinical Practice Guidelines Expert Committee. Canadian Diabetes Association 2008 clinical practice guidelines for the prevention and management of diabetes in Canada. Can J Diabetes. 2008:1–201 Available from: http://www.diabetesclinic.ca/en/pdf/CDA_cpg-2008.pdf.
Swedberg K, Wolf RAN, Ekman RIN. Telemonitoring in Patients with Heart Failure. N Engl J Med. 2011;36411(17) Available from: http://www.utbildning.gu.se/digitalAssets/1331/1331376_new-england-journal-letter-gpcc.pdf.
Hesse BW, Hanna C, Massett HA, Hesse NK. Outside the box: will information technology be a viable intervention to improve the quality of Cancer care? JNCI Monographs. 2010;2010(40):81–9 Available from: http://www.ncbi.nlm.nih.gov/pubmed/20386056.
Scalvini S, Bernocchi P, Zanelli E, Comini L, Vitacca M. Maugeri centre for telehealth and telecare: a real-life integrated experience in chronic patients. J Telemed Telecare. 2018;24(7):500–7. Cited 2020 Apr 21. Available from. https://doi.org/10.1177/1357633X17710827.
Abdallah LM. Evercare nurse practitioner practice activities: similarities and differences across five sites. J Am Acad Nurse Pract. 2005;17(9):355–62 Cited 2020 Apr 24. Available from: http://www.ncbi.nlm.nih.gov/pubmed/16115114.
Tregenza L. The role of the community matron: a structured approach to case management. Nurs Older People. 2019;31(6):28–32 Cited 2020 Apr 24. Available from: http://www.ncbi.nlm.nih.gov/pubmed/31778064.
Slev VN, Mistiaen P, Pasman HRW, Leeuw IMV, van Uden-Kraan CF, Francke AL. Effects of eHealth for patients and informal caregivers confronted with cancer: A meta-review. Int J Med Inform. 2016;87:54–67 Cited 2020 Jan 21. Available from: http://www.ncbi.nlm.nih.gov/pubmed/26806712.
Vegesna A, Tran M, Angelaccio M, Arcona S. Remote patient monitoring via non-invasive digital technologies: a systematic review. Telemed E Health. 2017;23(1):3–17 Cited 2019 Sep 13. Available from: http://www.ncbi.nlm.nih.gov/pubmed/27116181.
Campbell NC, Murray E, Darbyshire J, Emery J, Farmer A, Griffiths F, et al. Designing and evaluating complex interventions to improve health care. BMJ. 2007;334(7591) Available from: http://www.bmj.com/content/334/7591/455/rapid-responses.
Lewin S, Glenton C, Oxman AD. Use of qualitative methods alongside randomised controlled trials of complex healthcare interventions: methodological study. BMJ. 2009;339 Available from: http://www.bmj.com/content/339/bmj.b3496.
Hoffmann TC, Erueti C, Glasziou PP. Poor description of non-pharmacological interventions: analysis of consecutive sample of randomised trials. BMJ. 2013;347:f3755 Cited 2019 Oct 9. Available from: http://www.ncbi.nlm.nih.gov/pubmed/24021722.
Oakley A, Strange V, Bonell C, Allen E, Stephenson J. Process evaluation in randomised controlled trials of complex interventions. BMJ. 2006;332(7538):413–6.
Datta J, Petticrew M. Challenges to evaluating complex interventions: a content analysis of published papers. BMC Public Health. 2013;13(1):568. Available from:. https://doi.org/10.1186/1471-2458-13-568gm.
Levati S, Campbell P, Frost R, Dougall N, Wells M, Donaldson C, et al. Optimisation of complex health interventions prior to a randomised controlled trial: a scoping review of strategies used. Pilot Feasibility Stud. 2016;2(1):17 Available from: http://www.pilotfeasibilitystudies.com/content/2/1/17.
Craig P, Dieppe P, Macintyre S, Mitchie S, Nazareth I, Petticrew M. Developing and evaluating complex interventions: the new Medical Research Council guidance. BMJ. 2008;337(October):979–83.
May CR, Cummings A, Girling M, Bracher M, Mair FS, May CM, et al. Using Normalization Process Theory in feasibility studies and process evaluations of complex healthcare interventions: a systematic review. Implementation Sci. 2018;13(1):80. Cited 2020 Jan 21. Available from. https://doi.org/10.1186/s13012-018-0758-1.
Murray E, Treweek S, Pope C, MacFarlane A, Ballini L, Dowrick C, et al. Normalisation process theory: a framework for developing, evaluating and implementing complex interventions. BMC Med. 2010;8(1):63. Available from:. https://doi.org/10.1186/1741-7015-8-63.
Michie S, Fixsen D, Grimshaw JM, Eccles MP. Specifying and reporting complex behaviour change interventions: the need for a scientific method. Implementation Sci. 2009;4(1):40. Cited 2019 Sep 13. Available from. https://doi.org/10.1186/1748-5908-4-40.
Moore GF, Audrey S, Barker M, Bond L, Bonell C, Hardeman W, et al. Process evaluation of complex interventions: Medical Research Council guidance. BMJ. 2015;350:h1258.
Bobrow K, Farmer A, Cishe N, Nwagi N, Namane M, Brennan TP, et al. Using the Medical Research Council framework for development and evaluation of complex interventions in a low resource setting to develop a theory-based treatment support intervention delivered via SMS text message to improve blood pressure control. BMC Health Serv Res. 2018;18(1):33. Cited 2019 Sep 13. Available from. https://doi.org/10.1186/s12913-017-2808-9.
Mir O, Ferrua M, Fourcade A, Delphine M, Duflot-Boukobza A, Dumont S, et al. Intervention combining nurse navigators (NNs) and a mobile application versus standard of care (SOC) in cancer patients (pts) treated with oral anticancer agents (OAA): results of CAPRI, a single-center, randomized phase III trial. In: American Society of Clinical Oncology, ASCO Annual meeting; 2020.
Fitzmaurice C, Dicker D, Pain A, Hamavid H, Moradi-Lakeh M, MacIntyre MF, et al. The global burden of Cancer 2013. JAMA Oncol. 2015;1(4):505.
Mariotto AB, Yabroff KR, Shao Y, Feuer EJ, Brown ML. Projections of the cost of cancer care in the United States: 2010-2020. J Natl Cancer Institute. 2011;103(2):117–28 Available from: http://www.ncbi.nlm.nih.gov/pubmed/21228314.
Greer JA, Amoyal N, Nisotel L, Fishbein JN, MacDonald J, Stagl J, et al. A systematic review of adherence to oral antineoplastic therapies. Oncologist. 2016;21(3):354–76 Cited 2019 Mar 8. Available from: http://www.ncbi.nlm.nih.gov/pubmed/26921292.
Wood L. A review on adherence management in patients on oral cancer therapies. Eur J Oncol Nurs. 2012;16(4):432–8 Available from: http://www.ncbi.nlm.nih.gov/pubmed/22051845.
May P, Figgins B. Oral anticancer therapy: a comprehensive assessment of patient perceptions and challenges. J Commun Support Oncol. 2016;14(3):112–6 Available from: http://www.oncologypractice.com/jcso/the-publication/past-issue-single-view/oral-anticancer-therapy-a-comprehensive-assessment-of-patient-perceptions-and-challenges/432e62e821db479c37e21ecd0399cdba.html.
Lapointe J, Minvielle É, Sicotte C. Usages des technologies de l’information et de communication pour la coordination des soins en cancérologie : État des connaissances. Quelles recommandations pour une implantation efficace ? J De Gestion Et D’économie Médicales. 2014;31:273–302 ESKA. Available from: http://www.cairn.info/article.php?ID_ARTICLE=JGEM_135_0273.
Girault A, Ferrua M, Lalloué B, Sicotte C, Fourcade A, Yatim F, et al. Internet-based technologies to improve cancer care coordination: current use and attitudes among cancer patients. Eur J Cancer. 2015;51(4):551–7.
Yatim F, Cristofalo P, Ferrua M, Girault A, Lacaze M, Di Palma M, et al. Analysis of nurse navigators’ activities for hospital discharge coordination: a mixed method study for the case of cancer patients. Support Care Cancer. 2017;25(3):863–8 Available from: http://www.ncbi.nlm.nih.gov/pubmed/27830394.
Yatim F, Cristofalo P, Minvielle E. What Are the Unmet Information Needs of Cancer Patients? A Qualitative Study. Global Journal of Health Science [Internet]. 2017;9(12):114. http://www.ccsenet.org/journal/index.php/gjhs/article/view/71550.[cited 2018 Oct 5].
Duflos C, Antoun S, Loirat P, DiPalma M, Minvielle E. Identification of appropriate and potentially avoidable emergency department referrals in a tertiary cancer care center. Support Care Cancer. 2017;25(8):2377–85 Cited 2019 Mar 22. Available from: http://www.ncbi.nlm.nih.gov/pubmed/28275897.
Tomasone JR, Brouwers MC, Vukmirovic M, Grunfeld E, O’Brien MA, Urquhart R, et al. Interventions to improve care coordination between primary healthcare and oncology care providers: a systematic review. ESMO Open. 2016;1(5):e000077 Available from: http://www.ncbi.nlm.nih.gov/pubmed/27843639.
Aubin M, Giguère A, Martin M, Verreault R, Fitch MI, Kazanjian A, et al. Interventions to improve continuity of care in the follow-up of patients with cancer. In: Aubin M, editor. Cochrane database of Systematic reviews. Chichester: Wiley; 2012. p. CD007672. Available from: http://www.ncbi.nlm.nih.gov/pubmed/22786508.
Ouwens M, Hulscher M, Hermens R, Faber M, Marres H, Wollersheim H, et al. Implementation of integrated care for patients with cancer: a systematic review of interventions and effects. Int J Qual HealthCare. 2009;21(2):137–44. Available from:. https://doi.org/10.1093/intqhc/mzn061.
National Institutes of Health, National Cancer Institute. Common Terminology Criteria for Adverse Events (CTCAE). Cited 2018 Sep 10. Available from: https://ctep.cancer.gov/protocolDevelopment/electronic_applications/ctc.htm.
Brady MC, Stott DJ, Norrie J, Chalmers C, St George B, Sweeney PM, et al. Developing and evaluating the implementation of a complex intervention: using mixed methods to inform the design of a randomised controlled trial of an oral healthcare intervention after stroke. Trials. 2011;12(1):168. Cited 2019 Mar 27. Available from. https://doi.org/10.1186/1745-6215-12-168.
Gervès-Pinquié C, Daumas-Yatim F, Lalloué B, Girault A, Ferrua M, Fourcade A, et al. Impacts of a navigation program based on health information technology for patients receiving oral anticancer therapy: the CAPRI randomized controlled trial. BMC Health Serv Res. 2017;17(1):133 Available from: http://www.ncbi.nlm.nih.gov/pubmed/28193214.
Kah P, Loh B, Mchugh C, Mohile SG, Mustian K, Flannery M, et al. Using information technology in the assessment and monitoring of geriatric oncology patients. Cited 2020 Apr 21; Available from: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5878089/pdf/nihms951716.pdf.
Woiceshyn J, Blades K, Pendharkar SR. Integrated versus fragmented implementation of complex innovations in acute health care. Health Care Manage Rev. 2017;42(1):76–86 Cited 2020 Jan 21. Available from: http://www.ncbi.nlm.nih.gov/pubmed/26469705.
Pfadenhauer LM, Gerhardus A, Mozygemba K, Lysdahl KB, Booth A, Hofmann B, et al. Making sense of complexity in context and implementation: the Context and Implementation of Complex Interventions (CICI) framework. Implementation Sci. 2017;12(1):21 Cited 2020 Jan 21. Available from: http://www.ncbi.nlm.nih.gov/pubmed/28202031.
Pierce JL, Kostova T, Dirks KT. Toward a theory of psychological ownership in organizations. Acad Manag Rev. 2001;26(2):298–310. Cited 2020 Jan 21. Available from. https://doi.org/10.5465/amr.2001.4378028.
Barki H, Pare G, Sicotte C. Linking it implementation and acceptance via the construct of psychological ownership of information technology. J Inform Technol. 2008;23(4):269–80. Cited 2020 Jan 21. Available from. https://doi.org/10.1057/jit.2008.12.
Marthick M, Dhillon HM, Alison JA, Cheema BS, Shaw T. An interactive web portal for tracking oncology patient physical activity and symptoms: prospective cohort study. JMIR Cancer. 2018;4(2):e11978 Cited 2020 Apr 24. Available from: http://www.ncbi.nlm.nih.gov/pubmed/30578217.
Passardi A, Rizzo M, Maines F, Tondini C, Zambelli A, Vespignani R, et al. Optimisation and validation of a remote monitoring system (Onco-TreC) for home-based management of oral anticancer therapies: an Italian multicentre feasibility study. BMJ Open. 2017;7(5):e014617 Cited 2019 Dec 9. Available from: http://www.ncbi.nlm.nih.gov/pubmed/28554917.
Moullin JC, Dickson KS, Stadnick NA, Rabin B, Aarons GA. Systematic review of the Exploration, Preparation, Implementation, Sustainment (EPIS) framework. Implementation Sci. 2019;14(1):1. Cited 2020 Jan 21. Available from. https://doi.org/10.1186/s13012-018-0842-6.
Kini V, Ho PM. Interventions to improve medication adherence. JAMA. 2018;320(23):2461 Cited 2020 Jan 21. Available from: http://www.ncbi.nlm.nih.gov/pubmed/30561486.
Suchman L, Blomberg J, Orr JE, Trigg R. Reconstructing technologies as social practice. Am Behav Scie. 1999;43(3):392–408. Cited 2020 Apr 24. Available from. https://doi.org/10.1177/00027649921955335.
Orlikowski WJ. Using technology and constituting structures: a practice lens for studying technology in organizations. Organ Sci. 2000;11(4):404–28. Cited 2020 Apr 24. Available from. https://doi.org/10.1287/orsc.11.4.404.14600.
Gherardi S. Telemedicine: a practice-based approach to technology. Hum Relat. 2010;63(4):501–24. Cited 2020 Apr 24. Available from. https://doi.org/10.1177/0018726709339096.
Marthick M, Janssen A, Cheema BS, Alison J, Shaw T, Dhillon H. Feasibility of an interactive patient portal for monitoring physical activity, remote symptom reporting, and patient education in oncology: qualitative study. JMIR Cancer. 2019;5(2):e15539 Cited 2020 Apr 24. Available from: http://cancer.jmir.org/2019/2/e15539/.
Minvielle E. (The patient and the system) Le patient et le système : en quête d’une organisation sur-mesure : approches innovantes du parcours de santé. Paris: Seli Arsal; 2018. p. 276.
Ferrua M, Yatim F, Fourcade A, Lacaze MG, Mir O, Minvielle E, et al. Nurse Navigators telephone and web application follow-up intervention for patients treated with oral anticancer medication: an optimization of oncologists' medical time. J Clin Oncol. 2019;37(15_suppl):6544. Available from. https://doi.org/10.1200/JCO.2019.37.15_suppl.6544. [Cited 2019 Dec 9].
Edmondson AC. Teaming: how organizations learn, innovate, and compete in the knowledge economy [Internet]. Wiley. Jossey-Bass; 2012. p. 352. Available from: https://www.wiley.com/en-us/Teaming%3A+How+Organizations+Learn%2C+Innovate%2C+and+Compete+in+the+Knowledge+Economy-p-9781118216767. [cited 2020 May 7].
Ferrua M, di Palma M, Fourcade A, Guillet M, Mathivon D, Puglisi V, et al. Patient experience and use of an intervention combining nurse-led telephone and technologies for the monitoring of oral cancer medication. Ann Oncol. 2019;30(Supplement_5) Cited 2019 Dec 9. Available from. https://doi.org/10.1093/annonc/mdz272.011/5578032.
Minvielle E, Ferrua M, di Palma M, Fourcade A, Guillet M, Mathivon D, et al. Providing a nurse-led telephone intervention for patients treated with oral anticancer medication: Symptom management and adherence monitoring. Ann Oncol. 2019;30:v837 Cited 2020 Apr 24. Available from: https://linkinghub.elsevier.com/retrieve/pii/S0923753419602395.
Schloemer T, Schröder-Bäck P. Criteria for evaluating transferability of health interventions: a systematic review and thematic synthesis. Implementation Sci. 2018;13(1):88. Cited 2020 Jan 21. Available from. https://doi.org/10.1186/s13012-018-0751-8.
We wish to thank M. Azoulay, M. Bonnamy, A. Duflot-Boukobza, M. Lacaze, D. Mathivon, Vanessa Puglisi and G.Vial, for their helpful advice on and involvement in the CAPRI project.
This research is part of a programme supported by the French National Research Agency, Regional Health Agency – Ile de France, Philanthropia Lombard Odier Foundation, Novartis and Astrazeneca. The funding bodies were not involved in the study design.
Ethics approval and consent to participate
Studies mentioned in this article were conducted with the approval of the Clinical Trial Department at Gustave Roussy (Scientific Commission for Clinical Trials) and by the competent French National Authority (CPP Ile de France 4– Ethics Committee) and CNIL (French National Data Protection Commission).
All patients enrolled in the study completed a written consent form to participate in the study.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
About this article
Cite this article
Ferrua, M., Minvielle, E., Fourcade, A. et al. How to Design a Remote Patient Monitoring System? A French Case Study. BMC Health Serv Res 20, 434 (2020). https://doi.org/10.1186/s12913-020-05293-4
- Remote Patient Monitoring system
- Care coordination
- Complex intervention