- Research article
- Open Access
- Open Peer Review
Sustainability in Health care by Allocating Resources Effectively (SHARE) 2: identifying opportunities for disinvestment in a local healthcare setting
BMC Health Services Researchvolume 17, Article number: 328 (2017)
This is the second in a series of papers reporting a program of Sustainability in Health care by Allocating Resources Effectively (SHARE) in a local healthcare setting. Rising healthcare costs, continuing advances in health technologies and recognition of ineffective practices and systematic waste are driving disinvestment of health technologies and clinical practices that offer little or no benefit in order to maximise outcomes from existing resources. However there is little information to guide regional health services or individual facilities in how they might approach disinvestment locally. This paper outlines the investigation of potential settings and methods for decision-making about disinvestment in the context of an Australian health service.
Methods include a literature review on the concepts and terminology relating to disinvestment, a survey of national and international researchers, and interviews and workshops with local informants. A conceptual framework was drafted and refined with stakeholder feedback.
There is a lack of common terminology regarding definitions and concepts related to disinvestment and no guidance for an organisation-wide systematic approach to disinvestment in a local healthcare service.
A summary of issues from the literature and respondents highlight the lack of theoretical knowledge and practical experience and provide a guide to the information required to develop future models or methods for disinvestment in the local context.
A conceptual framework was developed. Three mechanisms that provide opportunities to introduce disinvestment decisions into health service systems and processes were identified. Presented in order of complexity, time to achieve outcomes and resources required they include 1) Explicit consideration of potential disinvestment in routine decision-making, 2) Proactive decision-making about disinvestment driven by available evidence from published research and local data, and 3) Specific exercises in priority setting and system redesign.
This framework identifies potential opportunities to initiate disinvestment activities in a systematic integrated approach that can be applied across a whole organisation using transparent, evidence-based methods. Incorporating considerations for disinvestment into existing decision-making systems and processes might be achieved quickly with minimal cost; however establishment of new systems requires research into appropriate methods and provision of appropriate skills and resources to deliver them.
This is the second in a series of papers reporting a program of Sustainability in Health care by Allocating Resources Effectively (SHARE). The SHARE Program is an investigation of concepts, opportunities, methods and implications for evidence-based investment and disinvestment in health technologies and clinical practices in a local healthcare setting. The papers in this series are targeted at clinicians, managers, policy makers, health service researchers and implementation scientists working in this context. This paper discusses potential settings and methods to initiate disinvestment decisions in an Australian health service network.
In the past two decades, proactive and explicit methods have been sought to address rising healthcare costs and continuing advances in expensive health technologies. This has coincided with increasing recognition of ineffective practices and systemic waste in health services. As a result, debate and research has focused on removal of health technologies and clinical practices that offer little or no benefit in order to maximise outcomes from existing resources and the concept of ‘disinvestment’ has emerged [1, 2]. Cessation of potentially harmful, clinically ineffective or cost-inefficient procedures has the dual advantage of improving patient care and allowing for more efficient use of available resources, potentially increasing total health benefits without increasing spending.
In their 2007 paper, Pearson and Littlejohns considered the options available to the National Institute for Health and Clinical Effectiveness (NICE) to provide guidance and direction on disinvestment to the English National Health Service . They explored the role of an agency that has both the imprimatur to lead the debate and the resources to enable informed decision-making at the national level. Development of national policies and production of rigorous evidence-based guidance are crucial steps, but there are other complex issues to be addressed before disinvestment can be successful across the whole health sector.
Decisions to allocate resources can be made at macro (national, state/provincial and regional), meso (institutional) and micro (individual) levels ; but even those made centrally still need to be implemented locally. In addition, some decisions cannot be made centrally as national recommendations cannot take into account local factors such as population needs, organisational priorities, budgets, capacity or capability. Hence many essential decisions about the use of health technologies and clinical practices (TCPs), programs and services are made at regional and institutional levels . However, there is little information to guide regional health authorities or local facilities in how they might take a systematic approach to disinvestment [5–14]. The approach taken by Pearson and Littlejohns to guide disinvestment efforts at the national level can be adapted to inform decision-making at the local health service level .
Leaders at Monash Health (previously Southern Health), a large health service network in Melbourne, Australia, sought to establish an organisation-wide, systematic, integrated, transparent, evidence-based approach to disinvestment. This became known as the SHARE Program, exploring ‘Sustainability in Health care by Allocating Resources Effectively’ and was undertaken by the Centre for Clinical Effectiveness (CCE), an in-house resource to facilitate Evidence Based Practice (EBP). An overview of the SHARE Program, a guide to the SHARE publications and further details about Monash Health and CCE are provided in the first paper in this series .
In the absence of guidance from the literature, a two-phased process was proposed to identify and then evaluate potential opportunities for disinvestment at Monash Health (Fig. 1). The aim of Phase One was to understand concepts and practices related to disinvestment and the implications for a local health service and, based on this information, to identify potential settings and methods for decision-making. The aim of Phase Two was to implement and evaluate the proposed methods to determine which were sustainable, effective and appropriate at Monash Health.
The aim of this project was to identify opportunities for systematic decisions about disinvestment at Monash Health.
The aim of this paper is to report the investigation of potential settings and methods for disinvestment decision-making and propose a framework to integrate them into local health service systems and processes.
What concepts, definitions and perspectives underpin disinvestment?
What models or methods of disinvestment have been implemented in hospitals or health services?
Where are the opportunities for systematic decisions about disinvestment in a local health service?
Model for evidence-based change
The SHARE Program was undertaken using the SEAchange model for Sustainable, Effective and Appropriate change in health services . The model involves four steps: identifying the need for change, developing a proposal to meet the need, implementing the proposal and evaluating the extent and impact of the change. Each step is underpinned by the principles of evidence-based practice to ensure that the best available evidence from research and local data, the experience and expertise of health service staff and the values and perspectives of consumers are taken into account. Steps 1 and 2 of the SEAchange model map to Phase One of the SHARE Program and Steps 3 and 4 correspond to Phase Two. The research questions for this paper are highlighted in Fig. 1.
A literature review, interviews with members of the Technology/Clinical Practice Committee (TCPC) that initiated the SHARE Program, a survey of external experts, and workshops with the SHARE Steering Committee were conducted. Interviews with key local informants were undertaken to discuss the findings from the earlier activities and obtain additional information. Details are provided in Additional file 1.
Development of the framework
Findings from the literature review, survey, workshops and interviews were collated and analysed thematically by either content analysis  to identify emergent themes, or framework analysis  when categories had been specified a priori (Additional file 1). The potential settings and methods identified were drafted into a conceptual framework.
This was presented to the SHARE Steering Committee for feedback and decision-making (Additional file 1). The committee included Executive Directors (Medical, Nursing, Support Services), Program Directors (Medical, Nursing, Allied Health, Pharmacy, Diagnostic Services), Committee chairs (Technology/Clinical Practice, Therapeutics, Human Research and Ethics, Clinical Ethics), Managers (Information Services, Clinical Information Services, Procurement, Biomedical Engineering, Research Services), Legal counsel and two Consumer representatives.
The CCE project team had expertise in EBP and knowledge brokering. This expertise contributed to committee discussions regarding evidence-based decision-making and implementation and evaluation of change.
Discussion was informal and decisions were based on consensus.
The framework was refined based on input from the committee and the project team.
Results and Discussion
Results of the literature search and response rates and representativeness of participants in the survey, workshops and interviews are included in Additional file 1. The full literature review is published separately . Surveys were received from 15 external experts, 13 members of the Steering Committee attended the workshops and 10 individuals participated in interviews.
Data collected from these activities informed a range of research questions. Findings related to the research questions in this paper are presented below and discussed in the context of the current literature; additional findings are reported in other SHARE publications.
What concepts, definitions and perspectives underpin disinvestment?
The literature review identified a lack of common terminology and noted that several terms were used to describe disinvestment-type activities such as ‘decommissioning’, ‘removing ineffective services’, ‘resource release’ and ‘defunding’.
There were also multiple definitions for ‘disinvestment’ which were underpinned by different concepts (Table 1). Some definitions considered disinvestment to be reallocation of resources from one TCP to another while others were limited to removal or restriction of use without reference to reallocation. Some definitions were based on the relative value of one TCP over an alternative such as ‘this TCP has less value than that TCP’. Others were based on assessment of the absolute value of a TCP for example ‘this TCP is not worth funding’.
Reasons for disinvestment were similarly based on a range of concepts including safety, effectiveness, cost effectiveness, obsolescence and external factors (Table 2). Some focused only on TCPs with little or no health gain and others considered a broad range of factors. No definitive criteria for disinvestment decision-making were identified.
The literature presented the concept of disinvestment from two main perspectives. The first focused on the opportunities for disinvestment in national policy and decision-making processes and was found in government publications. The second was research in academic journals exploring health economics principles or decision-making theory used in disinvestment activities. Most of the research papers were reports of projects to identify a TCP to disinvest or to implement a disinvestment project.
Monash Health staff were not familiar with the term ‘disinvestment’ prior to its introduction in the workshops and interviews. Although the concept was readily understood, participants had no experience of specific definitions or perspectives.
One clear message from the literature, which was also reflected in local responses from Monash Health staff, was that the term ‘disinvestment’ had strong negative connotations and would be a barrier to effective decision-making processes and successful implementation of disinvestment-related change. It was associated with ‘taking away’, ‘cost cutting’, ‘top down interference’ and implied a criticism of current practice. Advice from authors and colleagues was to avoid use of this word. Hence the ‘Disinvestment Project’ became the ‘Sustainability in Health care by Allocating Resources Effectively’ (SHARE) Program.
More recently, questions about the concepts, context, settings, systems, processes and principles for disinvestment have been addressed in systematic reviews [7, 9, 13, 20–24] and other studies [8, 10, 11, 25–29] and more examples of individual projects have been published . No papers discussing the concept of an organisation-wide, systematic, integrated approach to disinvestment in a health service organisation have been identified . The individual elements of this concept have emerged in the current literature with authors recognising the need for systematic [24, 31–39] and integrated approaches [5, 9, 24, 28, 31, 34, 40–45] that are implemented ‘system-wide’ [9, 11, 25].
What models or methods of disinvestment have been implemented in hospitals or health services?
No theoretical guidance or practical advice for systematically undertaking disinvestment within a health service was identified. The literature review did not find any existing models or proposed methods for an organisation-wide, integrated, evidence-based approach to decision-making . The survey respondents’ research in disinvestment was focused on health economics or policy development and the librarians reported no involvement with disinvestment at all. None had any knowledge or experience to inform development of a systematic organisation-wide approach to disinvestment at the level of a local health service, however all viewed this idea positively. Although the local informants had no experience of disinvestment they were also primarily positive. They identified opportunities and enabling factors within their areas, and highlighted information and resource needs and other potential barriers to disinvestment.
Although there was debate in the literature about processes for disinvestment, there was no consensus or recommendations; and multiple gaps in theoretical knowledge and practical experience were acknowledged. Responses from external experts and local stakeholders were consistent with these findings and also provided additional information. Many issues were framed as questions highlighting the lack of experience in disinvestment. For example, ‘Who has the authority, and the will, to make and act upon decisions about disinvestment?’, ‘Who are the appropriate decision-makers?’ The other points identified in the literature or raised by respondents have been reframed as questions for consistency and all issues are presented in Table 3. The issues raised provide a guide to the information required to develop future models or methods for disinvestment in the local healthcare context.
Although the literature has broadened considerably since the initial review was undertaken, a recent review of the current literature was also unable to identify any systematic approaches at the local level . Many of the questions raised remain unanswered [19, 20, 30].
Where are the opportunities for systematic decisions about disinvestment in a health service?
In establishing the SHARE Program, members of the TCPC took the view that a systematic approach would be better than relying on ad hoc decisions or projects in isolation, and sought to integrate decisions about disinvestment into organisational structures and processes. Since no existing models or methods were identified, a conceptual framework was developed based on the findings from the literature review and the knowledge and experience of Monash Health participants.
A framework is made up of a set of concepts and the relationships between the concepts to facilitate the development of propositions; it provides a frame of reference to organise and focus thinking and assist interpretation [46, 47]. The framework would be used to underpin investigation of the feasibility and utility of the proposed settings and methods for systematic decision-making for disinvestment.
Three mechanisms that provide potential opportunities to introduce disinvestment decisions into health service systems and processes were identified (Fig. 2). They are presented in order of complexity, time to achieve outcomes, and resources required. The first two mechanisms, consideration of disinvestment in existing decision-making processes and proactive use of research evidence and data to drive decisions, were identified by Monash Health participants. The elements of the third mechanism, specific initiatives to consider disinvestment, were identified from the literature.
A. Explicit consideration of potential disinvestment in existing decision-making processes
Most health facilities have methods for how they make routine decisions. Two potential opportunities for initiating disinvestment decisions sit within the mechanisms for 1) allocating funding through clinical purchasing and capital procurement and 2) allocating non-monetary resources through guidelines and protocols.
Incorporating considerations for disinvestment into existing systems and processes might be achieved quickly and, once established, delivered with no additional costs.
Purchasing and procurement
Monash Health had systems and processes for recurrent purchasing of drugs and clinical consumables and capital expenditure on building and equipment. These were determined by policies and procedures that specified who can make decisions, which criteria are used, how decisions are authorised and other relevant parameters.
This existing structure provides opportunities to integrate prompts, triggers and potentially even mandatory requirements for those making decisions about expenditure to consider disinvestment. For example, prompts and triggers could be implemented in a range of formats such as algorithms, protocols or checklists. Mandatory requirements to consider disinvestment could be implemented as specific directions within purchase orders, explicit decision-making criteria for committees or steps in application processes that require authorisation.
Guidelines and protocols
Guidelines and protocols are designed to inform, direct and standardise clinical and corporate practice. In doing this they also determine allocation of resources for a specific condition, patient group or procedure by stipulating use of drugs or equipment, recommending diagnostic tests, selecting health professional groups, prioritising staff time, specifying referral mechanisms and allocating capacity in clinics, operating rooms and other facilities. There are potential opportunities for disinvestment in all of these activities. Existing decision-making processes for local guidance provide three possible mechanisms to introduce consideration of disinvestment.
Firstly, the process of developing new or revising existing local guidance could be used to identify disinvestment opportunities. Prompts, triggers and mandatory requirements to consider disinvestment in decisions about clinical and organisational practice could be introduced into the processes for document development and authorisation. Document developers and those overseeing the process could be charged with explicitly considering whether any current practices in the content of the guidance could be discontinued.
Secondly, local guidelines and protocols could be used to implement disinvestment decisions. Most guidance documents focus on implementation of effective practices, directing staff to do the things that are known to work. Implementation strategies, such as communication, education and use of tools like clinical paths and checklists, are undertaken to increase staff awareness and compliance with these desirable activities. Local guidance could also be used to recommend removal, reduction or restriction of aspects of current practice which have little or no benefit by incorporating reminders of ‘what not to do’ in the documents and using relevant implementation strategies to emphasise these changes.
Thirdly, potential target areas for disinvestment might also be ascertained through evaluation, audit and review of guidelines and protocols. These activities could routinely identify practices that are not consistent with the best available evidence or are not acceptable to staff or health service consumers. For this to be achieved, evaluators must be made aware of disinvestment concepts and provided with direction and support on how to follow up their findings.
We were unable to find any discussion of local guidelines and protocols being used as a method to identify disinvestment opportunities, however several authors refer to the potential to use guidelines for implementation of disinvestment recommendations [1, 35, 51–53].
B. Proactive decision-making about disinvestment driven by available evidence
High-quality evidence to identify potential opportunities for disinvestment is currently available, however it was not routinely accessed by most Monash Health decision-makers. Two sources of evidence that are readily available to health service decision-makers are published research findings and their own routinely-collected data. Monash Health decision-makers often turned to these sources to address problems or to respond to requests to introduce new TCPs, but they did not use it proactively to review current practice, seek opportunities for change or drive priority setting.
The project team noted that before existing evidence can be used proactively to drive decision-making, methods of identifying, capturing, evaluating, disseminating and utilising the information must be investigated. Once effective methods are determined, appropriate infrastructure, adequate resources and high-level skills in EBP and data utilisation will be required for implementation.
There is an increasing body of knowledge about practices that have been demonstrated to be harmful, found to be of little or no clinical benefit, or where a more effective or cost-effective alternative is available. Systems and processes could be developed to take this information directly to decision-makers.
To avoid wasting time and resources considering information that is not trustworthy or does not represent the best available evidence, the committee agreed that only high-quality synthesised information should be used to drive decisions. The project team were aware of publications from sources that require a rigorous process to identify, appraise and summarise all the available evidence systematically and objectively. Systematic reviews, health technology assessments and evidence-based guidelines generally note if there is potential harm or little or no benefit from specific clinical practices.
In addition to these generic sources of evidence, the literature review and consultation with international experts identified rigorous evidence-based publications specifically targeting disinvestment such as the NICE Commissioning Guides .
Participants noted that if evidence from the research literature and other publications is used proactively to identify disinvestment opportunities, the addition of information from local data about current use and potential impact of change would be required before decisions to disinvest are made. For example, there may be strong evidence that a particular TCP is not as effective as once thought. This provides a potential target for disinvestment. It should also be a prompt to check whether it is actually current practice within the organisation and that the burden of disease, volume of use, likely outcomes and potential cost of change warrant a disinvestment project or whether the resources would be better used elsewhere.
The range of lists outlining practices that should be discontinued or restricted has subsequently expanded. They are being developed by governments and health agencies [33, 55, 56], commissioners of health services , professional bodies [53, 58, 59] and researchers [27, 60]. Given the specific purpose of these ‘low value lists’ and the ease of access to them, it would be tempting to take this information directly to decision-makers. Unfortunately, not all the lists are as trustworthy as the high-quality sources noted above. Some are based on expert opinion only, some from a combination of evidence and expert opinion, and some do not specify methods or provide an explicit definition of ‘low value’. Users of this information may wish to confirm the validity and appropriateness of the claims before acting on the recommendations, in particular the definition being applied and the use of systematic review evidence in the process.
Routinely-collected local data
Monash Health routinely collects large amounts of data. Some indicators are required by overseeing authorities, others for in-house purposes, and some are collected for historical reasons that are no longer clear. This is a vastly underutilised source of information.
There is potential to use targeted analysis of routinely-collected data to discover opportunities for disinvestment. Participants proposed three approaches.
The first is to identify areas where a potential disinvestment process might have the greatest impact. Local data could be explored for characteristics such as high volume, high cost, extended length of stay or high rates of adverse events, readmission or re-operation where a change could have a large effect.
The second is to investigate practice variation which could highlight potential disinvestment opportunities. This could be done in-house for comparison between campuses, departments or individuals. If a service does not have an internal equivalent, such as highly specialised programs or high risk patient groups, comparisons can be made with similar services in other organisations. Comparisons of the health service utilisation and patient outcome data described above, as well as differences in rates of prescribing, ordering diagnostic tests or use of specific interventions, could indicate inappropriate or suboptimal practices suitable for disinvestment.
Thirdly, less commonly used data sources such as complaints registers or patient satisfaction surveys could also be explored for trends or emerging themes highlighting inappropriate practices that could be addressed through disinvestment.
In addition to reviewing local data when considering potential disinvestment targets arising from the research literature, participants also noted the reverse; that comparison of current practice against the best available evidence would be required before confirming a decision to disinvest a TCP identified from investigation of local data. For example, if physicians at one campus use twice the amount of a high cost drug than their counterparts at another campus with a clinically equivalent patient cohort, it is likely that one group needs to change their practice. If the physicians at the first campus are overprescribing, this would be an opportunity to reduce overall use, restrict use to a particular indication or replace the drug with a more cost-effective but equally effective alternative. However, it is possible that the group with the higher use actually reflects best practice and the others need to increase their prescribing to achieve optimum patient outcomes. The data only provides an alert to the potential for disinvestment, evidence for best practice from the research literature confirms the need and provides direction.
Two recent studies have used practice variation in national and regional settings specifically to identify ineffective practices and note the potential to do so within local health services, or for health services to benchmark against their counterparts [61, 62].
C. Specific initiatives that can incorporate disinvestment
Two specific project methodologies with potential to identify targets for disinvestment and implement disinvestment decisions were identified from the literature. Their role in a systematic organisation-wide approach to disinvestment in a local health service has not been explored. Other methodologies for specific project initiatives may also be relevant.
Implementation of priority setting and system redesign initiatives would require very specific skills and sufficient resources to undertake large projects.
Economic approaches to priority setting
Much of the literature on disinvestment focuses on use of economic principles to identify and prioritise targets for disinvestment. Specific priority setting exercises can be used to examine resource allocation at the disease, program or health service level. This is done by applying the best available data and making the usually implicit values and opinions that underpin decisions explicit and testable . These methods include examination of current funding levels, how funds are spent and whether reallocation of resources, based on priority setting, would result in a greater benefit. Examples of priority setting models include Program Budgeting and Marginal Analysis, Health Sector Wide Priority Setting, Quality Adjusted Life Year League Tables and Generalised Cost-Effectiveness Analysis [64–66].
Priority setting exercises in the health sector have predominantly been undertaken as research projects by health economists. Translation of these methods from the research setting to routine practice integrated within health service systems and processes could provide additional opportunities to identify and implement disinvestment decisions.
PBMA has subsequently been demonstrated to be effective in making decisions for disinvestment [67, 68] however, although the usefulness of PBMA is acknowledged by decision-makers, they find it difficult to achieve in practice [7, 34, 40]. The major issues are lack of standardised accounting practices, lack of sufficient high quality data to inform decision-making, and lack of time and skills to undertake the process and implement the decisions [7, 11, 31, 34, 40, 69, 70].
Review of whole systems of care, often referred to as system redesign, may be a potential vehicle for disinvestment. System redesign in health care describes an array of approaches rather than a single technique. A range of methods and tools have been adapted for use in health care including Lean thinking , Clinical process redesign , Program Logic mapping , Plan Do Study Act quality cycle  and Failure Mode Effect Analysis .
System redesign is a familiar process in health services and offers a well-accepted context to introduce practice change.
More recent publications report that methods used in system redesign have potential to identify disinvestment opportunities and implement and evaluate disinvestment decisions [11, 33, 76]. Using the term ‘system redesign’ is also thought to increase the likelihood of implementation by avoiding the word ‘disinvestment’ [76, 77]. System redesign could be integrated into a systematic organisational approach to disinvestment.
There was no information in the literature or from consultation with international experts in disinvestment about how a local health service might take an organisation-wide, systematic, integrated approach. However there was general agreement about issues that should be considered. Subsequent publications confirm both the validity of this approach and the need to fill these gaps.
Priority-setting exercises and System redesign were already known as methods for change; however the other four conceptual settings arose from brainstorming and extrapolating from issues identified in the literature and local consultation. In the absence of evidence, the framework of three pairs of opportunities to initiate disinvestment decision-making was primarily developed from knowledge of healthcare services and logical thinking. There may be other settings that provide opportunities for disinvestment that were not included in this framework. Some of the settings in this framework may not be applicable in other health services, and settings identified elsewhere may not be applicable to Monash Health.
The study samples were purposive but small, limiting the generalisability to other health services. However the subsequent SHARE activities exploring the feasibility and utility of these early proposals include extensive stakeholder consultation involving all health professional groups, managers, policy-makers and consumers [78–83].
Some countries, states/provinces or regions have more centralised decision-making and resource-poor countries may not have the same systems and processes or the capacity or capability to implement any proposed innovations, also limiting the generalisability.
There is no common terminology. There are multiple definitions for disinvestment based on a range of different concepts and numerous alternative terms to convey the same concepts. However there is one notably consistent message; the word ‘disinvestment’ has negative connotations and may be a barrier to effective decision-making processes and successful disinvestment outcomes.
No theoretical guidance or practical advice for an organisation-wide approach to disinvestment at the local health service level was identified. Further research in this area is needed.
The six concepts captured in the framework create potential opportunities to initiate disinvestment activities in a systematic, integrated approach that can be applied across a whole organisation using transparent, evidence-based methods. Incorporating considerations for disinvestment into existing decision-making systems and processes might be achieved quickly with minimal cost; however establishment of new systems requires research into appropriate methods and provision of appropriate skills and resources to deliver them.
Centre for Clinical Effectiveness
Evidence Based Practice
National Institute for Health and Clinical Effectiveness
Sustainability in Health care by Allocating Resources Effectively
Technology/Clinical Practice Committee
Technologies and clinical practices
Pearson S, Littlejohns P. Reallocating resources: how should the National Institute for Health and Clinical Excellence guide disinvestment efforts in the National Health Service? J Health Serv Res Policy. 2007;12(3):160–5.
Elshaug AG, Hiller JE, Tunis SR, Moss JR. Challenges in Australian policy processes for disinvestment from existing, ineffective health care practices. Aust N Z Health Policy. 2007;4:23. doi:10.1186/1743-8462-4-23.
Tanios N, Wagner M, Tony M, Baltussen R, van Til J, Rindress D, et al. Which criteria are considered in healthcare decisions? Insights from an international survey of policy and clinical decision makers. Int J Technol Assess Health Care. 2013;29(04):456–65. doi:10.1017/S0266462313000573.
Harris C, Garrubba M, Allen K, King R, Kelly C, Thiagarajan M, et al. Development, implementation and evaluation of an evidence-based program for introduction of new health technologies and clinical practices in a local healthcare setting. BMC Health Serv Res. 2015;15(1):575. doi:10.1186/s12913-015-1178-4.
Evans BA, Snooks H, Howson H, Davies M. How hard can it be to include research evidence and evaluation in local health policy implementation? Results from a mixed methods study. Implementation Sci. 2013;8:17. doi:10.1186/1748-5908-8-17.
Garcia-Armesto S, Campillo-Artero C, Bernal-Delgado E. Disinvestment in the age of cost-cutting sound and fury. Tools for the Spanish National Health System. Health Policy. 2013;110(2–3):180–5. doi:10.1016/j.healthpol.2013.01.007.
Polisena J, Clifford T, Elshaug AG, Mitton C, Russell E, Skidmore B. Case studies that illustrate disinvestment and resource allocation decision-making processes in health care: A systematic review. Int J Technol Assess Health Care. 2013;29(2):174–84. doi:10.1017/s0266462313000068.
Robinson S, Glasby J, Allen K. ‘It ain’t what you do it’s the way that you do it’: lessons for health care from decommissioning of older people's services. Health Soc Care Community. 2013;21(6):614–22. doi:10.1111/hsc.12046.
Henshall C, Schuller T, Mardhani-Bayne L. Using health technology assessment to support optimal use of technologies in current practice: the challenge of “disinvestment”. Int J Technol Assess Health Care. 2012;28(3):203–10. doi:10.1017/s0266462312000372.
Leggett L, Noseworthy TW, Zarrabi M, Lorenzetti D, Sutherland LR, Clement FM. Health technology reassessment of non-drug technologies: current practices. Int J Technol Assess Health Care. 2012;28(3):220–7. doi:10.1017/S0266462312000438.
Robinson S, Williams I, Dickinson H, Freeman T, Rumbold B. Priority-setting and rationing in healthcare: evidence from the English experience. Soc Sci Med. 2012;75(12):2386–93. doi:10.1016/j.socscimed.2012.09.014.
Watt AM, Hiller JE, Braunack-Mayer AJ, Moss JR, Buchan H, Wale J, et al. The ASTUTE Health study protocol: deliberative stakeholder engagements to inform implementation approaches to healthcare disinvestment. Implementation Sci. 2012;7:101. doi:10.1186/1748-5908-7-101.
Gerdvilaite J, Nachtnebel A. Disinvestment: overview of disinvestment experiences and challenges in selected countries. HTA- Projektbericht., vol Nr. 57. Ludwig Boltzmann Institut für Health Technology Assessment; 2011.
Riley BL, Robinson KL, Gamble J, Finegood DT, Sheppard D, Penney TL, et al. Knowledge to action for solving complex problems: insights from a review of nine international cases. Health Promot Chron Dis Prev Can. 2015;35(3):47–53.
Harris C, Green S, Ramsey W, Allen K, King R. Sustainability in Health care by Allocating Resources Effectively (SHARE) 1: Introducing a series of papers reporting an investigation of disinvestment in a local healthcare setting. BMC Health Serv Res. 2017. in press.
Harris C, Turner T, Wilkinson F. SEAchange: Guide to a pragmatic evidence-based approach to Sustainable, Effective and Appropriate change in health services. 2015. Available from: http://arrow.monash.edu.au/hdl/1959.1/1225377. Accessed 17 Apr 2017.
Hsieh HF, Shannon SE. Three approaches to qualitative content analysis. Qual Health Res. 2005;15(9):1277–88. doi:10.1177/1049732305276687.
Srivastava A, Thomson SB. Framework analysis: a qualitative methodology for applied policy research. JOAAG. 2009;4(4):72–9.
Rumbold G, Allen K, Harris C. Disinvestment of technologies and clinical practices in health services: Conceptual and policy perspectives. Centre for Clinical Effectiveness, Southern Health 2008. Available from: http://arrow.monash.edu.au/hdl/1959.1/1218935. Accessed 17 Apr 2017.
Niven DJ, Mrklas KJ, Holodinsky JK, Straus SE, Hemmelgarn BR, Jeffs LP, et al. Towards understanding the de-adoption of low-value clinical practices: a scoping review. BMC Med. 2015;13:255. doi:10.1186/s12916-015-0488-z.
Healthcare Improvement Scotland. What approaches have been taken and efforts made to ensure public involvement in decision making relating to potential disinvestment in healthcare interventions and technologies? Technologies scoping report 16. 2013. Available from: file:///C:/Users/claireha/Downloads/Disinvestment%20(2).pdf. Accessed June 2015.
Guindo LA, Wagner M, Baltussen R, Rindress D, van Til J, Kind P, et al. From efficacy to equity: literature review of decision criteria for resource allocation and healthcare decisionmaking. Cost Effectiveness Res Allocation. 2012;10(1):9. doi:10.1186/1478-7547-10-9.
Centre for Health Economics Research and Evaluation. Reducing the use of ineffective health care interventions, Working Paper 2010/5. Sydney: University of Technology Sydney; 2010.
Schmidt DE. The development of a disinvestment framework to guide resource allocation decisions in health service delivery organizations. The University of British Columbia. 2010. Available from: https://open.library.ubc.ca/cIRcle/collections/ubctheses/24/items/1.0073252. Accessed 17 Apr 2017.
Robert G, Harlock J, Williams I. Disentangling rhetoric and reality: an international Delphi study of factors and processes that facilitate the successful implementation of decisions to decommission healthcare services. Implementation Sci. 2014;9(1):123. doi:10.1186/s13012-014-0123-y.
Schumacher I, Zechmeister I. Assessing the impact of health technology assessment on the austrian healthcare system. Int J Technol Assess Health Care. 2013;29(1):84–91. doi:10.1017/s0266462312000748.
Elshaug AG, Watt AM, Mundy L, Willis CD. Over 150 potentially low-value health care practices: an Australian study. Med J Aust. 2012;197(10):556–60.
Fronsdal KB, Facey K, Klemp M, Norderhaug IN, Morland B, Rottingen JA. Health technology assessment to optimize health technology utilization: using implementation initiatives and monitoring processes. Int J Technol Assess Health Care. 2010;26(3):309–16. doi:10.1017/s0266462310000309.
Ruano-Ravina A, Velasco-Gonzalez M, Varela-Lema L, Cerda-Mota T, Ibargoyen-Roteta N, Gutierrez-Ibarluzea I et al. Identification, prioritisation and assessment of obsolete health technologies. A methodolgical guideline. Quality Plan for the National Health System. 2009;Galician Health Technology Assessment Agency(HTA Reports: avalia-t No. 2007/01).
Harris C, Green S, Ramsey W, Allen K, King R. Sustainability in Health care by Allocating Resources Effectively (SHARE) 9: Conceptualising disinvestment in the local healthcare setting. BMC Health Serv Res. 2017. in press.
Mitton C, Dionne F, Donaldson C. Managing healthcare budgets in times of austerity: the role of program budgeting and marginal analysis. Appl health Econ health Policy. 2014;12(2):95–102. doi:10.1007/s40258-013-0074-5.
NHS Confederation. Two sides of the same coin. Balancing quality and finance to deliver greater value. 2014. Available from: http://www.nhsconfed.org/~/media/Confederation/Files/Publications/Documents/two_sides_same_coin150413.pdf. Accessed 17 Apr 2017.
HealthPACT. Disinvestment in Australia and New Zealand. Health Policy Advisory Committee on Technology. 2013. Available from: http://www.health.qld.gov.au/healthpact/docs/papers/workshop/disinvestment-report.pdf. Accessed 17 Apr 2017.
Marks L, Weatherly H, Mason A. Prioritizing investment in public health and health equity: what can commissioners do? Public Health. 2013;127(5):410–8. doi:10.1016/j.puhe.2013.01.027.
Garner S, Littlejohns P. Disinvestment from low value clinical interventions: NICEly done? BMJ. 2011;343(2):d4519-d. doi:10.1136/bmj.d4519.
Stafinski T, Menon D, McCabe C, Philippon DJ. To fund or not to fund: development of a decision-making framework for the coverage of new health technologies. Pharmacoeconomics. 2011;29(9):771–80. doi:10.2165/11539840-000000000-00000.
Elshaug A, Moss J, Littlejohns P, Karnon J, Merlin T, Hiller J. Identifying existing health care services that do not provide value for money. Med J Aust. 2009;190(5):269–73.
Smith N, Mitton C, Peacock S, Cornelissen E, MacLeod S. Identifying research priorities for health care priority setting: a collaborative effort between managers and researchers. BMC Health Serv Res. 2009;9:165. doi:10.1186/1472-6963-9-165.
Rooshenas L, Owen-Smith A, Hollingworth W, Badrinath P, Beynon C, Donovan JL. “I won’t call it rationing…”: an ethnographic study of healthcare disinvestment in theory and practice. Soc Sci Med. 2015;128:273–81. doi:10.1016/j.socscimed.2015.01.020.
Cornelissen E, Mitton C, Davidson A, Reid RC, Hole R, Visockas AM et al. Changing priority setting practice: The role of implementation in practice change. Health policy (Amsterdam, Netherlands). 2014. doi:10.1016/j.healthpol.2014.04.010.
Armstrong R, Waters E, Dobbins M, Anderson L, Moore L, Petticrew M, et al. Knowledge translation strategies to improve the use of evidence in public health decision making in local government: intervention design and implementation plan. Implementation Sci. 2013;8(1):121. doi:10.1186/1748-5908-8-121.
Hughes E, McKenny K. Decommissioning and Disinvestment Toolkit 2013-2014. Rayleigh: Castle Point and Rochford Clinical Commissioning Group; 2013.
NHS Commissioning Board. Commissioning Policy: Ethical framework for priority setting and resource allocation. 2013. Available from: http://www.england.nhs.uk/wp-content/uploads/2013/04/cp-01.pdf. Accessed 17 Apr 2017.
Rumbold B, Alakeson V, Smith P. Rationing health care. Quest for NHS Efficiency Series 2012. Available from: https://www.nuffieldtrust.org.uk/files/2017-01/rationing-health-care-web-final.pdf. Accessed 17 Apr 2017.
MacKean G, Noseworthy T, Elshaug AG, Leggett L, Littlejohns P, Berezanski J, et al. Health technology reassessment: The art of the possible. Int J Technol Assess Health Care. 2013;29(04):418–23. doi:10.1017/S0266462313000494.
Rycroft-Malone J, Bucknall TK, editors. Models and Frameworks for Implementing Evidence-Based Practice: Linking Evidence to Action, Evidence-Based Nursing. Chichester: UK Wiley-Blackwell; 2010.
Ilott I, Gerrish K, Laker S, Bray K. Naming and framing the problem: using theories, models and conceptual frameworks. Bridging the gap between knowledge and practice. Your starter for 10: No.2. Sheffield Teaching Hospital NHS Foundation Trust, National Institute for Health Research Collaboration for Leadership in Applied Health Research and Care for South Yorkshire. 2013.
Bennett CC. Are we there yet? A journey of health reform in Australia. Med J Aust. 2013;199(4):251–5.
Mitchell MD, Williams K, Brennan PJ, Umscheid CA. Integrating local data into hospital-based healthcare technology assessment: two case studies. Int J Technol Assess Health Care. 2010;26(3):294–300. doi:10.1017/s0266462310000334.
Rubinstein A, Belizan M, Discacciati V. Are economic evaluations and health technology assessments increasingly demanded in times of rationing health services? The case of the Argentine financial crisis. Int J Technol Assess Health Care. 2007;23(2):169–76. doi:10.1017/s0266462307070274.
Chamberlain CA, Martin RM, Busby J, Gilbert R, Cahill DJ, Hollingworth W. Trends in procedures for infertility and caesarean sections: was NICE disinvestment guidance implemented? NICE recommendation reminders. BMC Public Health. 2013;13:112. doi:10.1186/1471-2458-13-112.
Haas M, Hall J, Viney R, Gallego G. Breaking up is hard to do: why disinvestment in medical technology is harder than investment. Aust Health Rev. 2012;36(2):148–52. doi:10.1071/AH11032.
Owens DK, Qaseem A, Chou R, Shekelle P. High-value, cost-conscious health care: concepts for clinicians to evaluate the benefits, harms, and costs of medical interventions. Ann Intern Med. 2011;154(3):174–80. doi:10.7326/0003-4819-154-3-201102010-00007.
National Institute of Health and Clinical Excellence (NICE). NICE commissioning guides. London: NICE; 2012.
National Institute of Health and Clinical Excellence. ‘Do Not Do’ Recommendations. National Institute of Health and Clinical Excellence. http://www.nice.org.uk/savingsAndProductivity/collection?page=1&pageSize=2000&type=Do%20not%20do&published=&impact=Unclassified&filter. Accessed 17 Apr 2017.
U.S. Preventive Services Task Force. The Guide to Clinical Preventive Services Recommendations of the U.S. Preventive Services Task Force. Agency for Healthcare Research and Quality 2014. Available from: http://www.uspreventiveservicestaskforce.org/Page/Name/tools-and-resources-for-better-preventive-care. Accessed 17 Apr 2017.
Audit Commission. Reducing spending on low clinical value treatments. London: Health Briefing; 2011.
Cassel CK, Guest JA. Choosing wisely: helping physicians and patients make smart decisions about their care. JAMA. 2012;307(17):1801–2. doi:10.1001/jama.2012.476.
Qaseem A, Alguire P, Dallas P, Feinberg LE, Fitzgerald FT, Horwitch C, et al. Appropriate use of screening and diagnostic tests to foster high-value, cost-conscious care. Ann Intern Med. 2012;156(2):147–9. doi:10.7326/0003-4819-156-2-201201170-00011.
Prasad V, Vandross A, Toomey C, Cheung M, Rho J, Quinn S et al. A Decade of Reversal: An Analysis of 146 Contradicted Medical Practices. Mayo Clinic proceedings Mayo Clinic. 2013. doi:10.1016/j.mayocp.2013.05.012.
Duckett S, Breadon P, Romanes D, Fennessy P, Nolan J. Questionable care: Stopping ineffective treatments. Grattan Institute 2015. Available from: http://grattan.edu.au/wp-content/uploads/2015/08/828-Questionable-Care3.pdf. Accessed 17 Apr 2017.
Hollingworth W, Rooshenas L, Busby J, Hine CE, Badrinath P, Whiting PF, et al. Using clinical practice variations as a method for commissioners and clinicians to identify and prioritise opportunities for disinvestment in health care: a cross-sectional study, systematic reviews and qualitative stud. Southampton: Queen’s Printer and Controller of HMSO; 2015.
Mitton C, Donaldson C. Health care priority setting: principles, practice and challenges. Cost Effectiveness & Resource Allocation. 2004;2(3). doi:10.1186/1478-7547-2-3.
Hauck K, Smith P, Goddard M. The Economics of Priority Setting for Health Care: A Literature Review. Health, Nutrition and Population Discussion Paper World Bank 2004. Available from: http://siteresources.worldbank.org/HEALTHNUTRITIONANDPOPULATION/Resources/281627-1095698140167/Chapter3Final.pdf. Accessed 17 Apr 2017.
Mitton C, Donaldson C. Tools of the trade: a comparative analysis of approaches to priority setting in healthcare. Health Serv Manag Res. 2003;16(2):96–105.
Segal L, Mortimer D. A population-based model for priority setting across the care continuum and across modalities. Cost Effectiveness Res Allocation. 2006;4:6.
Mitton C, Levy A, Gorsky D, MacNeil C, Dionne F, Marrie T. Allocating limited resources in a time of fiscal constraints: a priority setting case study from Dalhousie University Faculty of Medicine. Acad Med. 2013;88(7):939–45. doi:10.1097/ACM.0b013e318294fb7e.
Mitton C, Dionne F, Damji R, Campbell D, Bryan S. Difficult decisions in times of constraint: criteria based resource allocation in the Vancouver Coastal Health Authority. BMC Health Serv Res. 2011;11:169. doi:10.1186/1472-6963-11-169.
Rubenfeld GD. Cost-effective critical care: cost containment and rationing. Semin Respir Crit Care Med. 2012;33(4):413–20. doi:10.1055/s-0032-1322411.
Donaldson C, Bate A, Mitton C, Dionne F, Ruta D. Rational disinvestment. QJM. 2010;103(10):801–7. doi:10.1093/qjmed/hcq086.
Institute for Healthcare Improvement. Going Lean in Health Care. IHI Innovation Series white paper Cambridge; 2005. Available from: http://www.ihi.org/knowledge/Pages/IHIWhitePapers/GoingLeaninHealthCare.aspx. Accessed 17 Apr 2017.
O’Connell T, Ben-Tovim D, McCaughan B, Szwarcbord M, McGrath K. Health services under seige: the case for clinical process redesign. MJA. 2008;188(6):S9–S13.
The Health Communication Unit. Logic Models Workbook. Centre for Health Promotion, University of Toronto; 2001. Available from: http://www.blazesports.org/wp-content/uploads/2011/02/THCU-Logic-Model-Workbook.pdf. Accessed 17 Apr 2017.
Speroff T, O’Connor G. Study designs for PDSA quality improvement research. Q Manage Health Care. 2004;13(1):17–32.
Spath PL. Using failure mode and effects analysis to improve patient safety. AORN J. 2003;78(1):16–37.
Daniels T, Williams I, Robinson S, Spence K. Tackling disinvestment in health care services. The views of resource allocators in the English NHS. J Health Organ Manag. 2013;27(6):762–80.
Robinson S, Dickinson H, Williams I, Freeman T, Rumbold B, Spence K. Setting priorities in health: A study of English primary care trusts: Health Services Management Centre, University of Birmingham and the Nuffield Trust. 2011.
Harris C, Allen K, Waller C, Brooke V. Sustainability in Health care by Allocating Resources Effectively (SHARE) 3: Examining how resource allocation decisions are made, implemented and evaluated in a local healthcare setting. BMC Health Serv Res. 2017. in press.
Harris C, Ko H, Waller C, Sloss P, Williams P. Sustainability in Health care by Allocating Resources Effectively (SHARE) 4: Exploring opportunities and methods for consumer engagement in resource allocation in a local healthcare setting. BMC Health Serv Res. 2017. in press.
Harris C, Allen K, Waller C, Green S, King R, Ramsey W et al. Sustainability in Health care by Allocating Resources Effectively (SHARE) 5: Developing a model for evidence-driven resource allocation in the local healthcare setting. BMC Health Serv Res. 2017. in press.
Harris C, Allen K, Brooke V, Dyer T, Waller C, King R et al. Sustainability in Health care by Allocating Resources Effectively (SHARE) 6: Investigating methods to identify, prioritise, implement and evaluate disinvestment projects in a local healthcare setting. BMC Health Serv Res. 2017. in press.
Harris C, Allen K, Waller C, Dyer T, Brooke V, Garrubba M et al. Sustainability in Health care by Allocating Resources Effectively (SHARE) 7: Supporting staff in evidence-based decision-making, implementation and evaluation in a local healthcare setting. BMC Health Serv Res. 2017. in press.
Harris C, Garrubba M, Melder A, Voutier C, Waller C, King R et al. Sustainability in Health care by Allocating Resources Effectively (SHARE) 8: Developing, implementing and evaluating an Evidence Dissemination Service in a local healthcare setting. BMC Health Serv Res. 2017. in press.
National Health and Medical Research Council. Ethical Considerations in Quality Assurance and Evaluation Activities. Canberra: Commonwealth of Australia; 2014.
Department of Human Services. Future directions for health technology uptake, diffusion and disinvestment in Victorian public health services. Victoria: Department of Human Services; 2007.
The authors would like to acknowledge the contribution of others. Members of the Monash Health Technology/Clinical Practice Committee and SHARE Steering Committee for direction and guidance, in particular Beverley Castleman who provided valuable consumer perspectives. CCE staff members who provided help and support, in particular Greg Rumbold, Tari Turner and Catherine Voutier. Monash Health staff and consumer representatives who gave their time generously to share their thoughts and experiences. Professor Sally Green, Professorial Fellow, School of Public Health and Preventive Medicine, Monash University for review of the manuscript and co-supervision of CH’s PhD.
The SHARE Program was funded by Monash Health and the Victorian Department of Human Services. No conditions related to the project or subsequent publications were imposed.
Availability of data and materials
Many of the datasets supporting the conclusions of the articles in the SHARE series are included within the articles and/or the accompanying additional files. Some datasets provide information for more than one article and are only provided once; where they are not included within an article and/or the accompanying additional file, the relevant citations to the articles in which they are provided are included. Datasets have not been made available where it is impossible to de-identify individuals due to the nature of survey or interview responses or where the data is published in confidential internal reports.
CH and KA designed and implemented the methods with CCE colleagues noted in acknowledgements and conceived and developed the framework. RK initiated the SHARE Program. RK, WR, CK and MT provided guidance and direction for all project decisions. CH drafted the initial manuscript. KA, RK, WR, CK and MT provided feedback. All authors read and approved the final manuscript.
CH was the Director of the Centre for Clinical Effectiveness and the SHARE Program Director. CH completed the SHARE publications as part of an unfunded PhD. KA was the SHARE Project Manager. RK was Director of Medicine Program, TCPC Chair, member of the SHARE Steering Committee and co-supervisor of CH’s PhD. WR was Executive Director of Medical Services, Chair of SHARE Steering Committee, and Executive Sponsor of TCPC. CK was Director of Medical Services. MT was Legal Counsel for Research and Ethics. RK, CK and MT were all members of the SHARE Steering Committee.
The authors declare that they have no competing interests.
Consent for publication
Ethics approval and consent to participate
The Monash Health Human Research and Ethics Committee (HREC) approved the SHARE program as a Quality Assurance activity. Further ethical review was not required as the program met the following criteria :
▪ “The data being collected and analysed is coincidental to standard operating procedures with standard equipment and/or protocols;
▪ The data is being collected and analysed expressly for the purpose of maintaining standards or identifying areas for improvement in the environment from which the data was obtained;
▪ The data being collected and analysed is not linked to individuals; and
▪ None of the triggers for consideration of ethical review are present.” 
Participation was based on the ‘opt-out approach’ . “The opt-out approach is a method used in the recruitment of participants into an activity where information is provided to the potential participant regarding the activity and their involvement and where their participation is presumed unless they take action to decline to participate.”  Consent to participate was approved by the HREC based on the following criteria:
▪ Health care providers, managers, consumer representatives, and officers within government health departments will be informed about the project and the processes and invited to participate.
▪ Participation in interviews, workshops and/or surveys will be considered to be implied consent.
These conditions were met.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Methods (PDF 294 kb).
About this article
- Health Clinical Practice
- Resource allocation