Open Access
Open Peer Review

This article has Open Peer Review reports available.

How does Open Peer Review work?

Sustainability in Health care by allocating resources effectively (SHARE) 1: introducing a series of papers reporting an investigation of disinvestment in a local healthcare setting

BMC Health Services ResearchBMC series – open, inclusive and trusted201717:323

https://doi.org/10.1186/s12913-017-2210-7

Received: 11 March 2016

Accepted: 31 March 2017

Published: 4 May 2017

Abstract

This is the first in a series of papers reporting Sustainability in Health care by Allocating Resources Effectively (SHARE). The SHARE Program is an investigation of concepts, opportunities, methods and implications for evidence-based investment and disinvestment in health technologies and clinical practices in a local healthcare setting. The papers in this series are targeted at clinicians, managers, policy makers, health service researchers and implementation scientists working in this context. This paper presents an overview of the organisation-wide, systematic, integrated, evidence-based approach taken by one Australian healthcare network and provides an introduction and guide to the suite of papers reporting the experiences and outcomes.

Keywords

Disinvestment Decommission De-adopt De-list De-implement Health technology TCP Resource allocation Decision-making Implementation

Background

The primary focus of health care should be on optimising patient outcomes, but without due consideration of value for money healthcare systems will not be sustainable [1, 2]. There are many challenges to the sustainability of healthcare services. Ageing populations and the increasing prevalence of chronic diseases, the proliferation and high costs of new health technologies, duplication and gaps in service delivery from poorly coordinated care, ineffective practices, systemic waste and external economic pressures all threaten the ability to maintain health services at acceptable standards [310].

In the first decade of this century healthcare expenditure rose steadily, in total and as a percentage of gross domestic product (GDP) [11]. The average for countries in the Organisation for Economic Co-operation and Development (OECD) rose from 8.2% GDP in 2001 to 9.3% 10 years later [11]. Advances in technology are considered to be a major driver of increased costs [1214]. In 2011 the global health technology market was valued at US$325 billion with an annual growth rate of 7% [15]. It has been estimated that health technologies account for 25–48% of health spending growth [16, 17]. The growth is not just due to adoption of new technology but also to rapidly increasing use of existing technology [12].

However, since 2010 the growth in global health care expenditure has plateaued and many countries have reduced public spending on health [11]. This has directed attention towards opportunities to save money, reduce waste and maximise outcomes from existing resources.

Many healthcare interventions reduce costs by improving timely access to treatment, facilitating earlier diagnosis, enhancing patient outcomes, decreasing hospital stays or minimising side effects, and provide value by increasing quality or length of life. Unfortunately it is also true that many interventions do not provide these benefits and the outcomes of many others are unknown. It has been estimated that “a third of medical practices are effective or likely to be effective; 15% are harmful, unlikely to be beneficial, or a trade-off between benefits and harms; and 50% are of unknown effectiveness” [18]. The cost-effectiveness is even less well known [14].

It is now customary to thoroughly appraise new technologies and procedures before introducing them into widespread use. Health Technology Assessment (HTA) involves systematic evaluation of safety, effectiveness and cost-effectiveness and often includes broader social and ethical impacts. However many practices in current use were not subjected to this rigorous evaluation prior to their introduction and would not meet contemporary standards [19]. In Australia, only 3% of all items on the Medicare Benefits Schedule have been formally assessed against evidence of safety, effectiveness and cost-effectiveness [20]. Reviews of the international literature have found that many interventions were implemented based on early evidence and the initial promising findings were reversed in subsequent studies [18, 21, 22]. Even practices that have clearly demonstrated benefits may be applied inappropriately or incorrectly [2325]. These issues can be seen as shortcomings, or viewed more constructively as opportunities to improve patient outcomes, optimise use of resources and possibly save money by removing or restricting practices that are unsafe or of little value.

Health authorities, hospitals and other health facilities have always moved resources from one area to another to achieve better clinical or corporate outcomes. Previously, decisions to restrict or reallocate resources were generally reactive, undertaken in response to established or emerging problems, and the processes and assumptions underpinning them were frequently implicit and opaque. However in the past two decades proactive, explicit and transparent methods have been sought to address rising health costs and the need to meet continuing advances in expensive technologies. Debate and research have focused on practices that offer little or no benefit, or where a better alternative is available, and the concept of disinvestment has emerged.

The early research in this area concentrated on projects guided by health economic principles to disinvest specific technologies or clinical practices (TCPs) in a local setting, while the broader discussion focused on central policy-making and the role of national agencies to inform decision-making [2628]. Although both play a vital role, there are limitations to these approaches. Individual projects can potentially be instigated and implemented independently of organisational goals, priorities, decision-making systems and communication processes. They may be driven by ad hoc decisions or individual champions and be undertaken in isolation from other local initiatives resulting in lack of coordination, duplication, inconsistent messages and change fatigue [29]. National recommendations cannot take into account local factors such as population needs, organisational priorities, budgets, capacity or capability; hence many crucial decisions about the use of TCPs have to be made at regional and institutional levels.

Although the research and debate has broadened considerably, a number of significant gaps remain. There is little evidence to guide healthcare networks or individual facilities in how they might take a systematic organisation-wide approach to disinvestment [26, 3034]. There is also a lack of information about the factors that influence resource allocation, the processes involved in implementation of disinvestment decisions, and the perspectives and experiences of healthcare staff undertaking disinvestment [29, 3438]. It has been proposed that in-depth research using longitudinal approaches from inception to implementation of disinvestment decisions at the health service level is needed to close these gaps and contribute to both the theory and practice of disinvestment [29, 35, 36, 39, 40].

The ‘Sustainability in Health care by Allocating Resources Effectively’ (SHARE) Program was the approach taken by one Australian health service to address these issues at the local level. The resulting suite of papers may contribute in part to filling these gaps [4150].

Aims

The aim of the SHARE Program was to establish organisation-wide, systematic, integrated, transparent, evidence-based systems and processes for decision-making about disinvestment in the context of resource allocation at Monash Health.

The aims of the SHARE series of publications are 1) to present the experiences and outcomes of the SHARE Program, 2) to review and discuss the current literature from the perspective of the local healthcare setting and 3) to propose frameworks and methods to inform future work in this area.

The aims of this paper are 1) to provide an overview of the SHARE Program, 2) to orient readers in how to find information and resources in this suite of publications, and 3) to discuss the contribution of the outputs of the program to policy, practice and research in disinvestment. The outcomes of SHARE are discussed in the final paper [50].

The SHARE program

Context

Monash Health (previously Southern Health), in the south east of Melbourne, Australia, is the largest health service network in the state of Victoria. It delivers primary, secondary, tertiary and quaternary services across more than 40 sites including six acute hospitals, subacute and rehabilitation services, mental health and community health services, and residential aged care [51]. Services are provided across the lifespan from conception and antenatal care through to care of the elderly; and all clinical specialties are offered.

Australian public hospitals operate under a state-allocated activity-based fixed-budget model of financing [52]. Staff are salaried and services are provided free of charge.

Monash Health established the first Technology/Clinical Practice Committee in Victoria to assess new TCPs prior to their introduction within the health service [53]. Australia has robust evidence-based processes for assessment at national level, however they do not address all the needs of health service decision-makers [53] and, as noted above, there are many reasons why decisions are required at local level. Although early leaders in this area, the Monash Health committee acknowledged that there were opportunities for improvement in their processes and undertook a project to identify and implement international best practice [53].

To build on this work, Monash Health leaders sought to explore the potential for a similar systematic organisation-wide approach to disinvestment of established practices that were unsafe, ineffective or inefficient or where better alternatives were available; and the SHARE Program was born.

The SHARE Program was undertaken by the Centre for Clinical Effectiveness (CCE), an Evidence Based Practice (EBP) Hospital Support Unit within Monash Health [54, 55]. Its role is to enable clinicians, managers and policy makers to use the best available evidence to improve healthcare decision-making. CCE facilitates knowledge translation by providing expertise, education and support in evidence synthesis and implementation and evaluation of evidence-based change; and delivering programs and projects underpinned by EBP. Consultants in health program evaluation and health economics were engaged to provide additional expertise to the SHARE project team.

The program was governed by a Steering Committee comprised of three Executive Directors (Medical, Nursing and Support Services), Clinical Program Directors (Medical, Nursing, Allied Health, Pharmacy and Diagnostic Services), Chairs of key committees (Technology/Clinical Practice, Therapeutics, Human Research and Ethics, and Clinical Ethics), representatives from relevant support services (Information Services, Procurement, Biomedical Engineering and Research Services), Legal counsel and two Consumer representatives.

Design

Case study

The SHARE papers present a case study of disinvestment in the local healthcare setting. This approach seeks to address the limited understanding of resource allocation processes in health services, particularly regarding disinvestment [35, 36], and the lack of detailed reporting of implementation of change in the literature [56, 57]. Case studies allow in-depth, multi-faceted explorations of complex issues in their real-life settings [58] and facilitate development of theory and interventions [59]. The case study approach enables examination of the complex behaviours of, and relationships among, actors and agencies; and how those relationships influence change [60]. All three case study approaches are used: description, exploration and explanation [61].

Framework for design and evaluation of complex interventions

When a review of the literature found no specific information to guide development of an organisation-wide approach at the local health service level, a two-phased program based on the UK Medical Research Council framework for design and evaluation of complex interventions was proposed (Fig. 1) [62]. Phase One includes specifying the context, understanding the problem and defining the components of an optimal intervention. Phase Two is a series of exploratory trials assessing acceptability and feasibility of the components and identifying methodological issues for implementation and evaluation.
Fig. 1

Overview of the SHARE Program

The questions outlined in Fig. 1 reflect the information needs of Monash Health decision-makers as they emerged in the respective phases of the SHARE process. The methods used to address these questions are noted alongside.

Model for evidence-based change

The SHARE Program was undertaken using the SEAchange model for Sustainable, Effective and Appropriate change in health services [63]. The model involves four steps: identifying the need for change, developing a proposal to meet the need, implementing the proposal and evaluating the extent and impact of the change. Each step is underpinned by the principles of evidence-based practice to ensure that the best available evidence from research and local data, the experience and expertise of health service staff and the values and perspectives of consumers are taken into account. Sustainability, avoidance of duplication and integration of new processes within existing systems are considered at each step. An action research component enables continuous investigation of the change process to improve the current project and inform future work.

The principles of this model were applied to the whole SHARE Program and to each individual project. In the overall SHARE Program, Steps 1 and 2 of the model map to Phase One and Steps 3 and 4 correspond to Phase Two (Fig. 2). The questions asked by decision-makers have been reframed as the research questions addressed in the SHARE papers.
Fig. 2

SEAchange model for evidence-based change adapted for SHARE (with permission from Harris et al [63])

Frameworks for evaluation and explication

Evaluation frameworks and plans were created for the SHARE Program as a whole [64] and for individual projects.

A framework and associated taxonomy for evaluation and explication of implementation of an evidence-based innovation were adapted for use in SHARE activities (Figs. 3a and 4) [65]. Evaluation and research activities were mapped to the corresponding components of the framework (Fig. 3b).
Fig. 3

Framework for evaluation and explication of implementation of an evidence-based innovation (adapted with permission from Harris et al [65]) a Components, b Evaluation and research activities for SHARE Program and pilot projects

Fig. 4

Taxonomy for evaluation and explication of implementation of an evidence-based innovation (adapted with permission from Harris et al [65])

Activities and publications

The activities in Phase One focused on understanding disinvestment from the local health service perspective and identifying potential mechanisms for a systematic organisation-wide approach; discovering where, how and by whom decisions are made, implemented and evaluated at Monash Health; and exploring opportunities and methods for consumer engagement in this process. These are reported in Papers 2, 3 and 4 respectively [4143]. A national workshop was conducted to share knowledge about disinvestment from three perspectives: health policy researchers, health economists and health service decision-makers. A report containing all findings and presentation materials is available [66, 67].

Following synthesis and analysis of the findings from these investigations and consideration of the implications that emerged, a plan for a multi-faceted disinvestment program was established. This is presented as a model for a systematic approach to evidence-based resource allocation in a local health service in Paper 5 [44].

Phase Two involved development, implementation and evaluation of the activities proposed in the model to determine which were sustainable, effective and appropriate at Monash Health. These projects are reported in Papers 6, 7 and 8 [4547].

After completion of Phase Two a review of the disinvestment literature from the perspective of the local health service was undertaken and the findings were integrated with the experiences and outcomes of the SHARE Program in Paper 9 [48]. Although there is little practical guidance in the literature, there are clear and consistent messages regarding principles for decision-making, settings and opportunities to identify disinvestment targets, steps in the disinvestment process, methods and tools, and barriers and enablers. This information was drawn together into an organisation-wide framework for disinvestment in the local healthcare setting in Paper 10 [49].

Paper 11 summarises the outcomes of the SHARE Program, discusses the contribution of SHARE to the knowledge and understanding of disinvestment in the local setting, and considers the implications for research, policy and practice [50].

To aid readers in navigation of this series, the research questions addressed in each paper are listed in Table 1.
Table 1

Research questions and outputs

Research questions

Outputs

SHARE 2: Identifying opportunities for disinvestment in a local healthcare setting

▪ What concepts, definitions and perspectives underpin disinvestment?

▪ What models or methods of disinvestment have been implemented in hospitals or health services?

▪ Where are the opportunities for systematic decisions about disinvestment in a local health service network?

▪ Framework and detailed discussion of potential settings and methods for disinvestment in the local healthcare context

▪ Summary of issues to consider in development of an organisational program for disinvestment

▪ Interview protocol for ascertaining local implications for disinvestment

SHARE 3: Examining how resource allocation decisions are made, implemented and evaluated in a local healthcare setting

▪ Where, how and by whom are decisions about resource allocation made, implemented and evaluated at Monash Health?

▪ What factors influence these processes?

▪ What knowledge or experience of disinvestment exists within Monash Health?

▪ Framework of eight components in the research allocation process, the elements of structure and practice for each component, and the relationships between them

▪ Classification of decision-makers, decision-making settings, type and scope of decisions, strengths and weaknesses, barriers and enablers

▪ Examples of decision-making criteria and types and sources of evaluation data used

▪ Interview and workshop protocols for ascertaining local decision-making systems and processes

SHARE 4: Exploring opportunities and methods for consumer engagement in resource allocation in a local healthcare setting

▪ How can consumer and community values and preferences be systematically integrated into organisation-wide decision-making for resource allocation?

▪ Model for integrating consumer values and preferences into decision-making for resource allocation

▪ Definitions for consumer engagement terminology

▪ Examples of sources of consumer information and data

▪ Examples of consumer-related activities generating proactive decisions to drive change

SHARE 5: Developing a model for evidence-driven resource allocation in a local healthcare setting

▪ What are the implications for disinvestment at Monash Health?

▪ What is the most appropriate and effective approach to organisation-wide, systematic, integrated, evidence-driven disinvestment at Monash Health?

▪ Can a model for evidence-driven resource allocation in the local healthcare setting be derived from the Monash Health program to enable replication and testing?

▪ Model for exploring Sustainability in Health care by Allocating Resources Effectively in the local healthcare setting

▪ Definition of four program components, aims and objectives, relationships between components, principles that underpin the program, implementation and evaluation plans, and preconditions for success and sustainability.

▪ Summary of implications for disinvestment in the local setting and resulting decisions for program development

▪ Summary of factors for program sustainability

▪ Evaluation framework and plan

SHARE 6: Investigating methods to identify, prioritise, implement and evaluate disinvestment projects in a local healthcare setting

▪ What methods are available to identify potential disinvestment opportunities in a local health service?

▪ What methods are available for prioritisation and decision-making to initiate disinvestment projects in a local health service?

▪ What methods are available to develop, implement and evaluate disinvestment projects in a local health service?

▪ What were the processes and outcomes of application of these methods at Monash Health?

▪ What factors influenced the decisions, processes and outcomes?

▪ Framework for evaluation and explication of a disinvestment project

▪ Examples of criteria for selection of disinvestment projects

▪ Methods for developing an evidence-based catalogue of potential disinvestment opportunities

▪ Algorithm for selecting a disinvestment project from an evidence-based catalogue of potential disinvestment opportunities

▪ Summary of barriers and enablers to implementation and evaluation

▪ Summary of factors related to determinants of effectiveness arising in SHARE process and disinvestment projects

SHARE 7: Supporting staff in evidence-based decision-making, implementation and evaluation in a local healthcare setting

▪ What is current practice in accessing and using evidence for making, implementing and evaluating decisions at Monash Health?

▪ What decisions were made and outcomes achieved in the piloting of support services?

▪ What factors influenced the decisions, processes and outcomes?

▪ Matrix of barriers, enablers, additional needs and evidence-based interventions mapped to their corresponding components in four support services to enable evidence-based decision-making, implementation and evaluation

▪ Summary of factors influencing decision-making for development of support services

▪ Summary of factors influencing the outcomes of the SHARE support services piloting process

▪ Summaries of current practice, knowledge, skills, confidence and needs in finding, accessing and using evidence for making, implementing and evaluating decisions; and preferred formats for education and training

▪ Summaries of nature, type and availability of local health service data; data sources; uses and expertise available

▪ Evaluation framework and plan

SHARE 8: Developing, implementing and evaluating an Evidence Dissemination Service in a local healthcare setting

▪ What are the potential features of an Evidence Dissemination Service in a local healthcare setting?

▪ How can high quality synthesised evidence be identified, captured, classified, stored, repackaged and disseminated?

▪ How can disseminated evidence be used to enhance current practice and how can use of evidence be reported?

▪ What are the processes and outcomes of disseminating evidence to self-selected and targeted participants in a voluntary framework?

▪ What are the processes and outcomes of disseminating evidence to designated decision-makers in a mandatory governance framework?

▪ What factors influenced the decisions, processes and outcomes?

▪ Two models for an Evidence Dissemination Service (EDS) in a local healthcare service

▪ Methods for identification, capture, classification, storage, repackaging and dissemination of evidence

▪ Methods to facilitate use of disseminated evidence and reporting of outcomes

▪ Taxonomy for categorising publications

▪ Framework for evaluation and explication of implementation of health information products and services

▪ Summaries of factors influencing decisions, processes and outcomes in development and delivery of the EDS

SHARE 9: Conceptualising disinvestment in the local healthcare setting

▪ Aims: To discuss the current literature on disinvestment from a conceptual perspective, consider the implications for local healthcare settings and propose a new definition and two potential approaches to disinvestment in this context to stimulate further research and discussion.

▪ Discussion of the disinvestment literature in relation to terminology and concepts, motivation and purpose, relationships with other health improvement paradigms, challenges, and implications for policy, practice and research in local healthcare settings

SHARE 10: Operationalising disinvestment in an evidence-based framework for resource allocation

▪ Aims: To discuss the current literature on disinvestment from an operational perspective, combine it with the experiences of the SHARE Program, and propose a framework for disinvestment in the context of resource allocation in the local healthcare setting.

▪ Discussion of the disinvestment literature from an operational perspective in local healthcare settings

▪ Summary of theories, frameworks and models used in disinvestment-related activities

▪ Framework for evidence-based disinvestment in the context of resource allocation

- Standardised definitions and concepts to underpin framework

- Principles for resource allocation decision-making

- Potential activities and settings for disinvestment

- Potential prompts and triggers to initiate disinvestment decisions

- Methods and tools for disinvestment

- Barriers to disinvestment

SHARE 11: Reporting outcomes of an evidence-driven approach to disinvestment in a local healthcare setting

▪ Aims: To consolidate the findings, discuss the contribution of the SHARE Program to the knowledge and understanding of disinvestment in the local healthcare setting, and consider the implications for policy, practice and research.

▪ Summary of outcomes of the SHARE Program

▪ Key messages

▪ Implications for research, policy and practice

SHARE National Workshop

▪ Aim: To share knowledge of disinvestment and develop links for future collaborative work opportunities

▪ Summary of disinvestment activities from health policy, health economics and health service perspectives

▪ Tools for group activities discussing disinvestment concepts and decision-making

▪ Tools for individual activities to capture information about current practice and research in disinvestment

▪ Workshop presentations

▪ Workshop evaluation tool and findings

▪ Summary of key messages

Outcomes and outputs

Outcomes are the changes that result from a program of activities. The outcomes of each investigation are reported and discussed in detail in the individual papers and summarised in the final paper [50].

Outputs are materials or methods produced in the delivery of a program that could be used to inform decision-making and planning for other programs, reproduced to save time and resources, or adjusted to suit local needs. The SHARE outputs may be useful resources for knowledge brokers, decision-makers and change agents in healthcare settings and offer opportunities for application, testing, refinement and theory development by researchers.

In addition to this suite of papers, the SHARE activities have also produced a range of outputs that includes summaries of concepts, definitions, current practice, needs, emerging issues, decision-making criteria and influencing factors; frameworks and models, a taxonomy and algorithm; sources of information and data; and survey instruments. These are collated in Table 1 and discussed below.

Discussion

Limitations

SHARE is a case study in a single public health service in the Australian health system which limits the generalisability to other contexts and settings.

It was developed as a health service improvement initiative, not a research project. However the importance of a research component was recognised at project inception and was built into the funding application and evaluation design [44, 64].

The project team responsible for delivering the SHARE Program at Monash Health were also the researchers investigating the processes undertaken. This has the potential to introduce subjectivity into the evaluations and limit insight if organisational assumptions are accepted without challenge. Extensive stakeholder involvement, transparency of methods and participation of an external evaluator in the role of ‘critical friend’ [64] were included in the SHARE processes to minimise these limitations.

Many of the findings are the first of their kind; while this provides more information than was previously available, it requires further confirmation or refutation in subsequent studies.

Implications for policy and practice

Establishing a disinvestment program in a local healthcare setting

Several outputs from SHARE activities may assist others seeking to establish similar programs. The proposed organisation-wide framework for disinvestment brings together the definitions, concepts, principles, decision-making settings, and steps in the disinvestment process, and addresses barriers and enablers when it is possible to do so through systems change (Paper 10). It is broad and theoretical, but may be made more specific and practical in combination with the SHARE models for resource allocation in a local healthcare setting (Paper 5) and integrating consumer views and perspectives into the resource allocation process (Paper 4). Additional information that may be of use includes summaries of issues to consider in development of an organisational program for disinvestment (Paper 2); implications for disinvestment in the local setting (Paper 5); factors that influenced decisions, processes and outcomes in disinvestment projects (Paper 6) and establishing services to support EBP (Papers 7 and 8); key messages from the SHARE Program (Paper 11); and theories proposed or applied in disinvestment-related projects and frameworks, methods and tools developed by others (Paper 10).

Seeking local information

The SHARE Program undertook multiple surveys, interviews and workshops. The protocols and instruments developed may be suitable for replication or adaptation to meet the needs of other settings. The results are provided in summary in the papers and in detail in additional files, and are discussed in the context of the current literature. The topics include local implications of a disinvestment program (Paper 2); current practice, barriers and enablers to making, implementing and evaluating decisions for resource allocation (Paper 3); current practice, knowledge, skills, confidence, barriers, enablers and needs of decision-makers in finding, appraising and using evidence in decisions, implementation and evaluation (Papers 7 and 8); content and format of training programs and support services to facilitate EBP (Papers 7 and 8) and sources, content, utilisation, availability, access and reporting of local health service datasets (Paper 7).

Identifying opportunities and making decisions for disinvestment

At the commencement of the SHARE Program Monash Health leaders did not have a complete or agreed understanding of where, how and by whom organisational decisions for resource allocation were made, implemented or evaluated. There was also a lack of this level of detail in the literature. The outputs of the investigation into decision-making systems and processes for resource allocation at Monash Health are reported in Paper 3 and include a framework for the process of resource allocation; classification of decision-makers, decision-making settings, type and scope of decisions; details of strengths and weaknesses, barriers and enablers; and examples of decision-making criteria used in a local healthcare setting.

A separate investigation, specifically considering disinvestment, evaluated methods for identification, prioritisation and decision-making for disinvestment projects (Paper 6). Outputs from this project include an algorithm for selecting projects from a catalogue of TCPs that were demonstrated to be harmful or ineffective; examples of criteria for selection of disinvestment projects; a summary of barriers and enablers to implementation and evaluation; and a summary of factors influencing the process and outcomes of undertaking disinvestment projects within the SHARE Program.

Implementing and evaluating change initiatives

There is some discussion of implementation strategies in the disinvestment literature, however much of it is theoretical and the authors do not report application or evaluation of these strategies in the local health service context [49]. The need for evaluation of disinvestment projects is highlighted in the literature but little guidance is provided [49]. The SHARE papers provide practical information from actual experiences to guide others in similar situations. These include:
  • ▪ summaries of barriers and enablers from SHARE activities related to implementing and evaluating health service decisions for resource allocation (Paper 3) and implementing a disinvestment project (Paper 6); and barriers and enablers to disinvestment as reported in the literature (Paper 10).

  • ▪ summaries of influencing factors and strategies to address them (Papers 2, 5, 6, 7 and 8).

  • ▪ completed checklists for success and sustainability, characteristics of interventions and/or determinants of effectiveness related to the overall SHARE Program (Papers 5 and 11), process of disinvestment (Paper 6) and establishment of services to support EBP (Papers 7 and 8).

  • ▪ evaluation frameworks and plans related to the overall SHARE Program (Paper 5) and establishment of support services (Papers 7 and 8).

  • ▪ a framework for evaluation of implementation of an evidence-based innovation was adapted for use in survey design to investigate decision-making processes for resource allocation (Paper 3) and evaluation design to map evaluation and research activities to the process of change (Paper 5), explore factors that influenced the processes and outcomes of identifying and undertaking disinvestment projects (Paper 6), and evaluate new health information products and services (Paper 8).

Implications for research

The SHARE outputs are described above in the context of policy and practice. The same lists could be repeated for research where the specific products could be trialled and refined, tested in different contexts or used to develop new hypotheses.

The need for frameworks and models for disinvestment is widely acknowledged [26, 29, 30, 32, 34, 39, 6872]. The SHARE Program has contributed three new conceptual frameworks and three models and adapted existing frameworks.

The frameworks include potential settings and methods to integrate disinvestment decisions into health service systems and processes (Paper 2), components of the resource allocation process (Paper 3), evaluation and explication of a disinvestment project (Paper 6), evaluation and explication of implementation of health information products and services (Paper 8), and organisation-wide disinvestment in the context of resource allocation (Paper 10).

The models include integrating consumer values and preferences into decision-making for resource allocation in a local healthcare setting (Paper 4), exploring sustainability in health care by allocating resources effectively in the local healthcare setting (Paper 5) and facilitating use of recently published synthesised evidence in organisational decision-making through an Evidence Dissemination Service (Paper 8).

The frameworks and models can be tested in clinical, management or policy contexts; for disinvestment, resource allocation or other decision-making processes. They are each based on multiple components and the relationships between them. A range of hypotheses could be developed for the components and their relationships which could be tested in a number of ways using various methodologies.

Conclusions

This suite of projects extends the existing literature on disinvestment and addresses some of the notable gaps. The outputs may be as useful as the outcomes for those considering disinvestment in the policy, practice and research contexts.

Abbreviations

CCE: 

Centre for clinical effectiveness

EBP: 

Evidence based practice

GDP: 

Gross domestic product

HTA: 

Health technology assessment

OECD: 

Organisation for Economic Co-operation and Development

SHARE: 

Sustainability in Health care by allocating resources effectively

TCPs: 

Technologies and clinical practices

Declarations

Acknowledgements

The authors would like to acknowledge the contribution of others. Members of the SHARE Steering Committee for direction and guidance. The SHARE project team and other CCE staff members who provided help and support. Monash Health staff and consumer representatives who gave their time generously to share their thoughts and experiences. Delwyn Goodrick and Duncan Mortimer for expert assistance with health program evaluation and health economics.

Funding

The SHARE Program was funded by Monash Health and the Victorian Department of Human Services. No conditions related to the project or subsequent publications were imposed. The overviews of the disinvestment literature and drafting of the SHARE series of publications were undertaken as part of an unfunded PhD.

Availability of data and materials

Many of the datasets supporting the conclusions of the articles in the SHARE series are included within the articles and/or the accompanying additional files. Some datasets provide information for more than one article and are only provided once; where they are not included within an article and/or the accompanying additional file, the relevant citations to the articles in which they are provided are included. Datasets have not been made available where it is impossible to de-identify individuals due to the nature of survey or interview responses or where the data is published in confidential internal reports.

Authors’ contributions

CH, WR, KA and RK contributed to project design and delivery, decision-making and direction throughout the SHARE Program. CH and SG conceived the design of the paper. CH drafted the initial manuscript. SG provided critical revisions. WR, KA and RK provided later feedback. All authors read and approved the final manuscript.

Authors’ information

CH was the Director of the Centre for Clinical Effectiveness and the SHARE Program Director. CH completed the SHARE publications as part of an unfunded PhD. SG is Professorial Fellow in the Monash University School of Public Health and Preventive Medicine and co-supervisor of CH’s PhD. WR was Executive Director of Medical Services and Chair of SHARE Steering Committee. KA was the SHARE Project Manager. RK was Director of Medicine Program, member of the SHARE Steering Committee and co-supervisor of CH’s PhD.

Competing interests

The authors declare that they have no competing interests.

Consent for publication

Not applicable.

Ethics approval and consent to participate

The Monash Health Human Research and Ethics Committee (HREC) approved the SHARE program as a Quality Assurance activity. Further ethical review was not required as the program met the following criteria [73]:

 ▪ “The data being collected and analysed is coincidental to standard operating procedures with standard equipment and/or protocols;

 ▪ The data is being collected and analysed expressly for the purpose of maintaining standards or identifying areas for improvement in the environment from which the data was obtained;

 ▪ The data being collected and analysed is not linked to individuals; and

 ▪ None of the triggers for consideration of ethical review are present.” [73]

Participation was based on the ‘opt-out approach’ [73]. “The opt-out approach is a method used in the recruitment of participants into an activity where information is provided to the potential participant regarding the activity and their involvement and where their participation is presumed unless they take action to decline to participate.”[73] Consent to participate was approved by the HREC based on the following criteria:

 ▪ Health care providers, managers, consumer representatives, and officers within government health departments will be informed about the project and the processes and invited to participate.

 ▪ Participation in interviews, workshops and/or surveys will be considered to be implied consent.

These conditions were met.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Authors’ Affiliations

(1)
School of Public Health and Preventive Medicine, Monash University
(2)
Centre for Clinical Effectiveness, Monash Health
(3)
Medical Services and Quality, Monash Health
(4)
Medicine Program, Monash Health

References

  1. Scott IA. Looking for value in health care. Med J Aust. 2012;197(10):538–9.View ArticlePubMedGoogle Scholar
  2. Garner S, Littlejohns P. Disinvestment from low value clinical interventions: NICEly done? BMJ. 2011;343(2):d4519. doi:https://doi.org/10.1136/bmj.d4519.View ArticlePubMedGoogle Scholar
  3. Scott I. Ten clinician-driven strategies for maximising value of Australian health care. Aust Health Rev. 2014;38(2):125–33. doi:https://doi.org/10.1071/ah13248.View ArticlePubMedGoogle Scholar
  4. Bennett CC. Are we there yet? A journey of health reform in Australia. Med J Aust. 2013;199(4):251–5.View ArticlePubMedGoogle Scholar
  5. Leeder S. Australia’s leadership in developing goals for sustainable global health. Med J Aust. 2013;199(6):377.View ArticlePubMedGoogle Scholar
  6. Berwick DM, Hackbarth AD. Eliminating waste in US health care. JAMA. 2012;307(14):1513–6. doi:https://doi.org/10.1001/jama.2012.362.View ArticlePubMedGoogle Scholar
  7. NHS Sustainable Development Unit. Route Map for Sustainable Health. 2011. Available from: file:///C:/Users/claireha/Downloads/Route_Map_folder_Sep13_FINAL.pdf. Accessed Sept 2015.
  8. Elshaug A, Moss J, Littlejohns P, Karnon J, Merlin T, Hiller J. Identifying existing health care services that do not provide value for money. Med J Aust. 2009;190(5):269–73.PubMedGoogle Scholar
  9. Stuart N, Adams J. The Sustainability of Canada’s Healthcare System: A Framework for Advancing the Debate. Healthc Q. 2007;10(2):96–103.View ArticlePubMedGoogle Scholar
  10. Appleby J. Spending on Health and Social Care over the Next 50 Years: Why Think Long Term? London, UK: The King’s Fund; 2013.Google Scholar
  11. Organisation for Economic Co-operation and Development. OECD Health Statistics. 2013. https://data.oecd.org/. Accessed Oct 2016.
  12. Bryan S, Mitton C, Donaldson C. Breaking the addiction to technology adoption. Health Econ. 2014;23(4):379–83. doi:https://doi.org/10.1002/hec.3034.View ArticlePubMedGoogle Scholar
  13. Qaseem A, Alguire P, Dallas P, Feinberg LE, Fitzgerald FT, Horwitch C, et al. Appropriate use of screening and diagnostic tests to foster high-value, cost-conscious care. Ann Intern Med. 2012;156(2):147–9. doi:https://doi.org/10.7326/0003-4819-156-2-201201170-00011.View ArticlePubMedGoogle Scholar
  14. Productivity Commission. Impacts of Advances in Medical Technology in Australia. Research Report; 2005. Available from: http://www.pc.gov.au/inquiries/completed/medical-technology. Accessed Oct 2016.
  15. Medical Technology Association of Australia Limited. Medical Technology in Australia: Key facts and figures 2013. Occasional Paper Series 2013. Available from: http://203.209.200.121/docs/key-documents/mtaa-factbook-2013-final.pdf?sfvrsn=0. Accessed 17 Apr 2017.
  16. Smith S, Newhouse JP, Freeland MS. Income, insurance, and technology: why does health spending outpace economic growth? Health Aff (Millwood). 2009;28(5):1276–84. doi:https://doi.org/10.1377/hlthaff.28.5.1276.View ArticleGoogle Scholar
  17. The Conference Board of Canada. Understanding health care cost drivers and escalators 2004. Available from: http://www.health.alberta.ca/documents/Health-Costs-Drivers-CBC-2004.pdf. Accessed Oct 2016.
  18. Prasad V, Vandross A, Toomey C, Cheung M, Rho J, Quinn S, et al. A Decade of Reversal: An Analysis of 146 Contradicted Medical Practices. Mayo Clinic Proc Mayo Clinic. 2013. doi:https://doi.org/10.1016/j.mayocp.2013.05.012
  19. Prasad V, Cifu A. Medical reversal: why we must raise the bar before adopting new technologies. Yale J Biol Med. 2011;84(4):471–8.PubMedPubMed CentralGoogle Scholar
  20. Medical Benefits Reviews Task Group. Development of a quality framework for the Medicare Benefits Schedule. Canberra: Discussion paper: Department of Health and Ageing; 2010.Google Scholar
  21. Wulff KC, Miller FG, Pearson SD. Can coverage be rescinded when negative trial results threaten a popular procedure? The ongoing saga of vertebroplasty. Health Aff (Millwood). 2011;30(12):2269–76. doi:https://doi.org/10.1377/hlthaff.2011.0159.View ArticleGoogle Scholar
  22. Ioannidis JP. Contradicted and initially stronger effects in highly cited clinical research. JAMA. 2005;294(2):218–28. doi:https://doi.org/10.1001/jama.294.2.218.View ArticlePubMedGoogle Scholar
  23. Morgan DJ, Brownlee S, Leppin AL, Kressin N, Dhruva SS, Levin L, et al. Setting a research agenda for medical overuse. BMJ. 2015;351:h4534. doi:https://doi.org/10.1136/bmj.h4534.View ArticlePubMedPubMed CentralGoogle Scholar
  24. Fronsdal KB, Facey K, Klemp M, Norderhaug IN, Morland B, Rottingen JA. Health technology assessment to optimize health technology utilization: using implementation initiatives and monitoring processes. Int J Technol Assess Health Care. 2010;26(3):309–16. doi:https://doi.org/10.1017/s0266462310000309.View ArticlePubMedGoogle Scholar
  25. Neumann PJ, Weinstein MC. The Diffusion of New Technology: Costs and Benefits to Health Care. In: Gelijns AC; Halm EA E, editor. The Changing Economics of Medical Technology. Committee on Technological Innovation in Medicine, Institute of Medicine; 1991.Google Scholar
  26. Polisena J, Clifford T, Elshaug AG, Mitton C, Russell E, Skidmore B. Case studies that illustrate disinvestment and resource allocation decision-making processes in health care: A systematic review. Int J Technol Assess Health Care. 2013;29(2):174–84. doi:https://doi.org/10.1017/s0266462313000068.View ArticlePubMedGoogle Scholar
  27. Rumbold G, Allen K, Harris C. Disinvestment of technologies and clinical practices in health services: Conceptual and policy perspectives. Centre for Clinical Effectiveness, Southern Health 2008. Available from: http://arrow.monash.edu.au/hdl/1959.1/1218935. Accessed Oct 2016.
  28. Pearson S, Littlejohns P. Reallocating resources: how should the National Institute for Health and Clinical Excellence guide disinvestment efforts in the National Health Service? J Health Serv Res Policy. 2007;12(3):160–5.View ArticlePubMedGoogle Scholar
  29. Rooshenas L, Owen-Smith A, Hollingworth W, Badrinath P, Beynon C, Donovan JL. “I won’t call it rationing…”: an ethnographic study of healthcare disinvestment in theory and practice. Soc Sci Med. 2015;128:273–81. doi:https://doi.org/10.1016/j.socscimed.2015.01.020.View ArticlePubMedGoogle Scholar
  30. Garcia-Armesto S, Campillo-Artero C, Bernal-Delgado E. Disinvestment in the age of cost-cutting sound and fury. Tools for the Spanish National Health System. Health Policy (Amsterdam, Netherlands). 2013;110(2–3):180–5. doi:https://doi.org/10.1016/j.healthpol.2013.01.007.View ArticleGoogle Scholar
  31. Robinson S, Glasby J, Allen K. ‘It ain’t what you do it’s the way that you do it’: lessons for health care from decommissioning of older people’s services. Health Social Care community. 2013;21(6):614–22. doi:https://doi.org/10.1111/hsc.12046.Google Scholar
  32. Leggett L, Noseworthy TW, Zarrabi M, Lorenzetti D, Sutherland LR, Clement FM. Health technology reassessment of non-drug technologies: current practices. Int J Technol Assess Health Care. 2012;28(3):220–7. doi:https://doi.org/10.1017/S0266462312000438.View ArticlePubMedGoogle Scholar
  33. Robinson S, Williams I, Dickinson H, Freeman T, Rumbold B. Priority-setting and rationing in healthcare: evidence from the English experience. Soc Sci Med. 2012;75(12):2386–93. doi:https://doi.org/10.1016/j.socscimed.2012.09.014.View ArticlePubMedGoogle Scholar
  34. Gerdvilaite J, Nachtnebel A. Disinvestment: overview of disinvestment experiences and challenges in selected countries. HTA- Projektbericht., vol Nr. 57. Ludwig Boltzmann Institut für Health Technology Assessment; 2011.Google Scholar
  35. Daniels T, Williams I, Robinson S, Spence K. Tackling disinvestment in health care services. The views of resource allocators in the English NHS. J Health Organ Manag. 2013;27(6):762–80.View ArticlePubMedGoogle Scholar
  36. Hollingworth W, Rooshenas L, Busby J, Hine CE, Badrinath P, Whiting PF, et al. Using clinical practice variations as a method for commissioners and clinicians to identify and prioritise opportunities for disinvestment in health care: a cross-sectional study, systematic reviews and qualitative study. Southampton UK: Queen’s Printer and Controller of HMSO 2015; 2015.Google Scholar
  37. Mayer J, Nachtnebel A. Disinvesting from ineffective technologies: Lessons learned from current programs. International journal of technology assessment in health care. 2015:1–8. doi:https://doi.org/10.1017/s0266462315000641.
  38. Riley BL, Robinson KL, Gamble J, Finegood DT, Sheppard D, Penney TL, et al. Knowledge to action for solving complex problems: insights from a review of nine international cases. Health Promot Chronic Dis Prev Canada. 2015;35(3):47–53.View ArticleGoogle Scholar
  39. Leggett L, MacKean G, Noseworthy T, Sutherland L, Clement F. Current status of health technology reassessment of non-drug technologies: survey and key informant interviews. Health Res Policy Syst. 2012. doi:https://doi.org/10.1186/1478-4505-10-38.PubMedPubMed CentralGoogle Scholar
  40. Eddama O, Coast J. A systematic review of the use of economic evaluation in local decision-making. Health Policy (Amsterdam, Netherlands). 2008;86(2–3):129–41. doi:https://doi.org/10.1016/j.healthpol.2007.11.010.View ArticleGoogle Scholar
  41. Harris C, Allen K, King R, Ramsey W, Kelly C, Thiagarajan M. Sustainability in Health care by Allocating Resources Effectively (SHARE) 2: Identifying opportunities for disinvestment in a local healthcare setting. BMC Health Serv Res. 2017. doi:https://doi.org/10.1186/s12913-017-2211-6.
  42. Harris C, Allen K, Waller C, Brooke V. Sustainability in Health care by Allocating Resources Effectively (SHARE) 3: Examining how resource allocation decisions are made, implemented and evaluated in a local healthcare setting. BMC Health Serv Res. 2017. doi:https://doi.org/10.1186/s12913-017-2207-2.
  43. Harris C, Ko H, Waller C, Sloss P, Williams P. Sustainability in Health care by Allocating Resources Effectively (SHARE) 4: Exploring opportunities and methods for consumer engagement in resource allocation in a local healthcare setting. BMC Health Serv Res. 2017. doi:https://doi.org/10.1186/s12913-017-2212-5.
  44. Harris C, Allen K, Waller C, Green S, King R, Ramsey W, et al. Sustainability in Health care by Allocating Resources Effectively (SHARE) 5: Developing a model for evidence-driven resource allocation in the local healthcare setting. BMC Health Serv Res. 2017. doi:https://doi.org/10.1186/s12913-017-2208-1.
  45. Harris C, Allen K, Brooke V, Dyer T, Waller C, King R, et al. Sustainability in Health care by Allocating Resources Effectively (SHARE) 6: Investigating methods to identify, prioritise, implement and evaluate disinvestment projects in a local healthcare setting. BMC Health Serv Res. 2017. in press.Google Scholar
  46. Harris C, Allen K, Waller C, Dyer T, Brooke V, Garrubba M, et al. Sustainability in Health care by Allocating Resources Effectively (SHARE) 7: Supporting staff in evidence-based decision-making, implementation and evaluation in a local healthcare setting. BMC Health Serv Res. 2017. in press.Google Scholar
  47. Harris C, Garrubba M, Melder A, Voutier C, Waller C, King R, et al. Sustainability in Health care by Allocating Resources Effectively (SHARE) 8: Developing, implementing and evaluating an Evidence Dissemination Service in a local healthcare setting. BMC Health Serv Res. 2017. in press.Google Scholar
  48. Harris C, Green S, Ramsey W, Allen K, King R. Sustainability in Health care by Allocating Resources Effectively (SHARE) 9: Conceptualising disinvestment in the local healthcare setting. BMC Health Serv Res. 2017. in press.Google Scholar
  49. Harris C, Green S. Sustainability in Health care by Allocating Resources Effectively (SHARE) 10: Operationalising disinvestment in an evidence-based framework for resource allocation. BMC Health Serv Res. 2017;in press.Google Scholar
  50. Harris C, Allen K, Waller C, Dyer T, King R, Ramsey W. Sustainability in Health care by Allocating Resources Effectively (SHARE) 11: Reporting outcomes of an evidence-driven approach to disinvestment in a local healthcare setting. BMC Health Serv Res. 2017. in press.Google Scholar
  51. Monash Health. http://www.monashhealth.org/. Accessed Dec 2016.
  52. Department of Health Victoria. Activity Based Funding https://www2.health.vic.gov.au/hospitals-and-health-services/funding-performance-accountability/activity-based-funding. Accessed Dec 2016.
  53. Harris C, Garrubba M, Allen K, King R, Kelly C, Thiagarajan M, et al. Development, implementation and evaluation of an evidence-based program for introduction of new health technologies and clinical practices in a local healthcare setting. BMC Health Serv Res. 2015;15(1):575. doi:https://doi.org/10.1186/s12913-015-1178-4.View ArticlePubMedPubMed CentralGoogle Scholar
  54. Monash Health. Centre for Clinical Effectiveness. http://www.monashhealth.org/page/CCE. Accessed Oct 2016.
  55. Robinson JS, Turnbull DA. Changing healthcare organisations to change clinical performance. Med J Australia. 2004;180(6 Suppl):S61–2.PubMedGoogle Scholar
  56. Michie S, Fixsen D, Grimshaw JM, Eccles MP. Specifying and reporting complex behaviour change interventions: the need for a scientific method. Implement Sci. 2009;4:40. doi:https://doi.org/10.1186/1748-5908-4-40.View ArticlePubMedPubMed CentralGoogle Scholar
  57. Douet L, Milne R, Anstee S, Habens F, Young A, Wright D. The completeness of intervention descriptions in published National Institute of Health Research HTA-funded trials: a cross-sectional study. BMJ Open. 2014;4(1), e003713. doi:https://doi.org/10.1136/bmjopen-2013-003713.View ArticlePubMedPubMed CentralGoogle Scholar
  58. Crowe S, Cresswell K, Robertson A, Huby G, Avery A, Sheikh A. The case study approach. BMC Med Res Methodol. 2011;11:100. doi:https://doi.org/10.1186/1471-2288-11-100.View ArticlePubMedPubMed CentralGoogle Scholar
  59. Baxter P, Jack S. Qualitative Case Study Methodology: Study Design and Implementation for Novice Researchers. Qualitative Rep. 2008;13(4):544–59.Google Scholar
  60. Gilson L. Health Policy and Systems Research: A Methodology Reader. Alliance for Health Policy and Systems Research, World Health Organization; 2012. Available from: http://www.who.int/alliance-hpsr/alliancehpsr_reader.pdf. Accessed Oct 2016.
  61. Yin R. Case study research, design and method. 4th ed. London: Sage Publications Ltd; 2009.Google Scholar
  62. Campbell NC, Murry E, Darbyshire J, Emery J, Farmer A, Griffiths F, et al. Designing and evaluating complex interventions to improve health care. BMJ. 2007;334:455–9.View ArticlePubMedPubMed CentralGoogle Scholar
  63. Harris C, Turner T, Wilkinson F. SEAchange. Guide to a pragmatic evidence-based approach to Sustainable, Effective and Appropriate change in health services. 2015. Available from: http://arrow.monash.edu.au/hdl/1959.1/1225377. Accessed Oct 2016.
  64. Centre for Clinical Effectiveness. Sustainability in Healthcare by Allocating Resources Effectively (SHARE): Evaluation and Research Plan. Southern Health 2009. Available from: https://figshare.com/articles/Sustainability_in_Healthcare_by_Allocating_Resources_Effectively_SHARE_Evaluation_and_Research_Plan/3979575. Accessed Oct 2016.
  65. Harris C, Brooke V, Turner T, Wilkinson F. Implementation of evidence-based paediatric guidelines: evaluation of complex interventions based on a theoretical framework. Centre for Clinical Effectiveness 2007. Available from: http://arrow.monash.edu.au/hdl/1959.1/1218931. Accessed Oct 2016.
  66. Harris C, Allen K, Waller C, Voutier C, Brooke V. Health technology disinvestment: tests, drugs and clinical practice. Report on a national disinvestment workshop. Part 1: Report. Centre for Clinical Effectiveness; 2009. Available from: http://arrow.monash.edu.au/hdl/1959.1/1218926. Accessed Oct 2016.
  67. Harris C, Allen K, Waller C, Voutier C, Brooke V. Health technology disinvestment: tests, drugs and clinical practice. Report on a national disinvestment workshop. Part 2: Appendices. Centre for Clinical Effectiveness; 2009. Available from: http://arrow.monash.edu.au/hdl/1959.1/1218922. Accessed Oct 2016.
  68. Healthcare Improvement Scotland. What approaches have been taken and efforts made to ensure public involvement in decision making relating to potential disinvestment in healthcare interventions and technologies? Technologies scoping report 16. 2013. Available from: file:///C:/Users/claireha/Downloads/Disinvestment%20(2).pdf. Accessed June 2015.
  69. Watt AM, Hiller JE, Braunack-Mayer AJ, Moss JR, Buchan H, Wale J, et al. The ASTUTE Health study protocol: deliberative stakeholder engagements to inform implementation approaches to healthcare disinvestment. Implement Sci. 2012;7:101. doi:https://doi.org/10.1186/1748-5908-7-101.View ArticlePubMedPubMed CentralGoogle Scholar
  70. Hughes D, Ferner R. New drugs for old: disinvestment and NICE. BMJ. 2010;340. doi:https://doi.org/10.1136/bmj.c572
  71. Department of Human Services. Future directions for health technology uptake, diffusion and disinvestment in Victorian public health services. Victoria, Australia: Department of Human Services; 2007.Google Scholar
  72. Niven DJ, Mrklas KJ, Holodinsky JK, Straus SE, Hemmelgarn BR, Jeffs LP, et al. Towards understanding the de-adoption of low-value clinical practices: a scoping review. BMC Med. 2015;13:255. doi:https://doi.org/10.1186/s12916-015-0488-z.View ArticlePubMedPubMed CentralGoogle Scholar
  73. National Health and Medical Research Council. Ethical Considerations in Quality Assurance and Evaluation Activities. Canberra: Commonwealth of Australia; 2014.Google Scholar

Copyright

© The Author(s). 2017