- Study protocol
- Open Access
Effectiveness of quality incentive payments in general practice (EQuIP-GP): a study protocol for a cluster-randomised trial of an outcomes-based funding model in Australian general practice to improve patient care
BMC Health Services Research volume 19, Article number: 529 (2019)
There is international interest in whether improved primary care, in particular for patients with chronic or complex conditions, can lead to decreased use of health resources and whether financial incentives help achieve this goal. This trial (EQuIP-GP) will investigate whether a funding model based upon targeted, continuous quality incentive payments for Australian general practices increases relational continuity of care, and lessens health-service utilisation, for high-risk patients and children.
We will use a mixed methods approach incorporating a two-arm pragmatic cluster randomised control trial with nested qualitative case studies. We aim to recruit 36 general practices from Practice-Based Research Networks (PBRN) covering urban and regional areas of Australia, randomised into intervention and control groups. Control practices will provide usual care while intervention practices will be supported to implement a new service model incorporating incentives for relational continuity and timely access to appointments. Patients will comprise three groups: older (over 65 years); 18–65 years with chronic and/or complex conditions; and those aged less than 16 years with increased risk of hospitalisation. The funding model includes financial incentives to general practitioners (GPs) for providing longer consultations, same day access and timely follow-up after hospitalisation to enrolled patients. The payments are proportional to expected health system savings associated with improved quality of GP care. An outreach facilitator will work with practices to help incorporate the incentive model into usual work. The main outcome measure is relational continuity of care (Primary Care Assessment Tool short-form survey), with secondary outcomes including health-related quality of life and health service use (hospitalisations, emergency presentations, GP and specialist services in the community, medicine prescriptions and targeted pathology and imaging ordering). Outcomes will be initially evaluated over a period of 12 months, with ongoing data collection for 5 years.
The trial will provide robust evidence on a novel approach to providing continuous incentives for improving quality of general practice care, which can be compared to block payment incentives awarded at target quality levels of pay-for-performance, both within Australia and also internationally.
Australian New Zealand Clinical Trials Registry ACTRN12618000105246. Registered on 23 January 2018.
It is clear that health care systems with strong primary care have better population health , lower rates of unnecessary hospitalisations and more equitable health outcomes . Key components of primary care that contribute to improved population health outcomes include providing affordable first access to the health system for all medical needs; person-(not disease) focused care over time; comprehensiveness of care; and coordination of care [1, 3]. At the same time it has become clear that primary care fee-for-service health payment systems, as in Australia, need fundamental reform to create incentives better aligned to quality of care, rather than encouraging high-volume short consultations with resulting downstream health and health system impacts in populations over time .
International evidence has highlighted the significant benefits that relational continuity (an ongoing therapeutic relationship with one or more providers ) has for quality and outcomes of primary care, including decreasing hospitalisations for Ambulatory Care-Sensitive Conditions (ACSCs) and reducing mortality risk [6,7,8]. There is also evidence that access to longer consultations has a range of benefits in terms of the GP-patient relationship and in the quality of assessment, dealing with complexity, care planning and preventive care [9,10,11,12,13,14]. However, under the current fee-for-service system for GPs in Australia, rebates under the Medicare Benefits Schedule (MBS), subsidised by the Federal Government, are proportionally less for time spent conducting longer encounters than shorter encounters. This feature incentivises rapid patient turnover and has the potential to contribute to lower quality of care, particularly for patients living with chronic disease [15, 16].
Consequently, with financial assistance from the Federal Government, the Royal Australian College of General Practitioners (RACGP) sought proposals to develop and trial alternative funding models to support high-quality primary care. This trial formed the basis of one of the funded proposals.
The study aims to evaluate the impact of a new funding model in primary care, comprising targeted incentives for enrolment with a preferred provider, longer consultations, same day access and structured follow-up after hospitalisation, on the quality of care and health service utilisation, and related costs for patients at increased risk of hospitalisation. The impact of the intervention will be compared to usual care.
The funding model trial will test incentives for specific quality improvement factors in high-risk chronic disease populations and provides payment incentives that are proportional to the expected health system cost savings resulting from those patients’ care improvement. This model enables incentives for continuous quality of care improvement within existing overall health system budgets, rather than previous quality incentive models with fixed block payments at target thresholds having localised incentives and without budgetary justification [17,18,19].
The primary hypothesis is that among high-risk patients and children attending general practices, the introduction of a practice-level service model incorporating continuous and graded quality improvement incentives, will improve patient-perceived relational continuity. Our specific research questions are:
In patients over the age of 65 living with chronic illness, what is the impact of an incentivised practice-level service model promoting access to preferred primary care providers, longer consultations and structured post-hospitalisation follow-up on:
patient-perceived relational continuity of care;
referrals for specified radiology and pathology services;
potentially avoidable hospitalisations (PAHs); and
emergency department attendances.
Does the application of this model in patients under 16 years of age (with defined comorbidities) provide improved access to same day care?
Is the model cost-effective when used in each population?
How acceptable is the model for patients and staff members of primary care practices?
A mixed methods approach, incorporating a two-arm pragmatic cluster randomised controlled trial (RCT) with nested qualitative case studies, will be used to investigate the effectiveness, acceptability, resource use and costs of the service model in general practice. Pragmatic RCTs have emerged as a way of bridging the gap between traditional RCTs, which have a good internal validity, and observational studies, which have good external validity . Pragmatic trials measure effectiveness and seek to maximise external validity to ensure that the results can be generalised . To decrease contamination bias we will use cluster randomisation at the general practice level, where practices (and their associated physicians), rather than the individual patients, are randomised to the intervention or usual care arm funding models .
Our theoretical framework for the study is informed by the literature on organisational change, where organisations are considered as a whole, rather than as a set of independent attributes [22,23,24,25], and methods for structuring continuous quality of care improvement incentives [17,18,19]. Three principles underpin the work.
Use of the United Kingdom Medical Research Council framework for designing complex interventions, where previous data from baseline qualitative and observational work will be incorporated into the design and evaluation of a trial of a complex intervention .
Implementation based on intervention facilitation in primary care, where skilled individuals work to identify and overcome challenges in implementing evidence-based care and inefficiencies in non-clinical routines and processes .
Quality improvement research has been criticised for not capturing a sufficient understanding of the organisational change process about why interventions do or do not work . Therefore, this study is also incorporating qualitative case studies to investigate barriers and enablers of the service model within the intervention general practices.
The qualitative component of the research will provide insights into the impacts of the intervention on patients and general practice staff; develop an understanding of how the intervention is experienced by participants and assess its acceptability from multiple perspectives; explore and describe the contexts, mechanisms and outcomes that influence uptake and implementation of the intervention; and investigate the attitudes and beliefs of patients and general practice staff about the use of financial incentives in the general practice setting.
The study will be set in 36 general practices across three practice-based research networks (PBRNs) in NSW, Victoria and Tasmania (Table 1). The study’s three collaborating centres enable coverage and generalisability to practices across regional, rural and urban settings.
Practice inclusion criteria
be delivering generalist (i.e. non-specialised) primary care medical services and employing at least one full-time equivalent GP;
have been in business for at least 1 year and not be intending to close for a further 2 years.
be able to generate patient encounter data through either of the two most commonly used general practice clinical software systems in Australia (Medical Director or Best Practice);
consent to the use of NPS MedicineWise MedicineInsight clinical data extraction software ; and
not be registered as participants or potential participants in the Australian Government Health Care Homes trial .
Recruitment will commence through the three collaborating PBRNs. Publicity will be developed with the relevant media units at each site and communicated through the PBRN newsletter and/or blog posts. Publicity announcements will contain contact details for the research team, allowing eligible practices to contact the team directly at this point. A week after publicity appears, all eligible practices in the PBRN will be sent a letter, a comprehensive information pack and consent form. The research team will contact non-responding practices by phone 1 week after the information mail-out. Practices expressing interest in participation will receive a visit from investigators or a research team member to facilitate a more detailed discussion of the study. The general practice recruitment approach is outlined in Fig. 1.
Practitioner and support staff recruitment
Once practices have consented we will seek to identify individual general practitioners (GPs) and general practice registrars (trainees)(GPRs) under supervision, along with practice nurses (PNs) and practice manager (PMs), to participate. To reflect current work practices, GPs/GPRs with full-time or part-time work patterns will be included. GPs are not eligible if they provide a limited scope of practice (e.g. only skin cancer surgery). As part of the recruitment process, GPs, PNs and PMs who agree to participate will sign the consent forms.
Patient inclusion criteria
Three groups of ‘high-risk’ patients will be included in the study:
aged over 65 years;
aged 18–65 years with common chronic and/or complex ACSC (chronic obstructive pulmonary disease (COPD), diabetes, angina (or ischaemic heart disease), cardiac failure, asthma); or
aged less than 16 years and at risk of hospitalisation, defined by previous diagnosis with a high-risk condition (e.g. asthma, epilepsy, dental condition, acute bronchiolitis, pneumonia or croup).
Following practice randomisation, in both intervention and control practices, an electronic database search will be conducted by the PN, PM or appropriate administrative staff member (assisted by a research team member, when necessary) using the practice’s own clinical software search facility to identify active patients (attended the practice three or more times in the last 2 years) who meet the inclusion criteria for the study.
Practices will generate lists of eligible patients seen by participating GPs, using 31st May 2018 as an index consultation day from which to extend searches. The generated lists will be screened by patients’ GPs to exclude patients unable to understand English or with significant cognitive impairment or distress. Then, the practice will post out a supplied information pack, consisting of a letter of invitation, an information sheet and a consent form, to a total of 200 eligible patients. This process will be the same in both the intervention and control groups. Information packs will be distributed to a sample of three patient cohorts from each practice, as follows:
n = 60 patients aged over 65 years;
n = 60 patients aged 18–65 years with chronic and/or complex ACSCs; and
n = 80 parents of eligible children aged less than 16 years.
From the 200 information packs it is anticipated that, via an expected response rate of 25%, we can meet the target recruitment of 50 patients per practice. If recruitment is less than anticipated, a further wave of invitations will be sent and/or GPs can direct eligible patients to the trial information packs in each surgery. Patients’ consent to participate will be interpreted as the return of a completed consent form to the practice/the research team.
Randomisation of practices
We will use randomisation by minimisation to reduce the risk of the trial being unbalanced across arms by practice size (less than or equal to 5 full-time equivalent GPs, or 6 or more) and Index of Relative Socioeconomic Disadvantage (IRSD) at each practice’s local government area (whether in the most disadvantaged 40% or not, using Socio-Economic Indexes for Areas (SEIFA) . Randomisation will be dynamic and conducted by the trial statistician (MJB) as practice level consent is obtained. The identity of the practices will be masked from the statistician until after the analyses are performed. The project officers in each state will enter a code for each consented practice into a cloud-based database in the order that the practice consents are received and notify the statistician by email. The statistician will then perform dynamic randomisation by minimisation, balancing for practice size and IRSD, entering the allocation into the database. With the exception of the statistician, all participants and project staff will be aware of the practice allocation to the control or intervention arms of the trial.
Intervention general practices will be supported to implement a new service model incorporating quality incentives for patients’ relational continuity and timely access. The intervention itself will comprise a mechanism of, firstly, patient enrolment within a practice. The practice will then offer enrolled patients: a) guaranteed access to a minimum of three longer appointment types over the study period for older patients or those with chronic or complex illness; b) a review visit within 7 days of admission to an emergency department or hospital, or after other significant health events; and c) for patients aged less than 16 years, same day access for acute conditions.
Figure 2 summarises the incentive structure. All incentives are calculated over the 12 months of the trial and compared with the 12-month period immediately previous to the trial. The incentive payments apply to the percentage of change achieved across the group of enrolled patients at the level of the practice. The incentives supplement the existing payment arrangements. All incentives will be calculated and paid at the conclusion of the 12-month trial.
An intervention facilitator (IF) will be employed by each of the three collaborating centres. They will work with practices in the intervention arm of the study to facilitate implementation of the new service model. They will also collect data relevant to their facilitator role using structured diary keeping. These diaries will contribute data concerning practice culture, communication and routines, plus information about the challenges and successes of the intervention. The EQuIP-GP Trial timeline is summarised in Table 2.
Control practices will provide usual care. Usual care in the context of this study is care received by patients in daily practice in regard to their particular health concerns , and represents normal practice against which to compare the intervention.
Both intervention and control practices will be provided access to links to quality improvement education materials (e.g. including Choosing Wisely Australia recommendations for improving the quality of healthcare by eliminating unnecessary and sometimes harmful tests, treatments, and procedures ).
General practices and individual patients can withdraw at any time, without reason. There are no specific discontinuation criteria. Practices and patients can request withdrawal of their data if they discontinue up until the time of analyses. Unless requested by the participant, data will be retained for all participants including withdrawals and deviations from the protocol.
The primary outcome of the trial is relational continuity, as measured in the appropriate scale of the 43-item shortened Primary Care Assessment Tool (PCAT) . The domains of accessibility, coordination and comprehensive care in participants will also be measured using the relevant domain scales of the PCAT .
We will assess the use of care-related services in the 12 months prior to the trial in comparison with the 12-month trial period. Data elements include:
total prescription counts per patient and Pharmaceutical Benefits Scheme (PBS) costs;
selected pathology services (microscopy, culture and sensitivity testing for leg ulcer swabs or urine, full blood count, erythrocyte sedimentation rate, thyroid function tests, prostate specific antigen and serum vitamin D level) per patient and Medical Benefits Schedule (MBS) costs;
selected radiology services (lower back and chest x-rays, carotid duplex studies, computed tomography of the head) per patient and MBS costs; and
total specialist referrals per patient and MBS costs.
We will also assess and collect data on hospitalisation and emergency department attendance rates in the 12 months prior to the trial in comparison with the 12-month trial period and for 5 years following the trial. Due to funding and time constraints, it is not possible to adequately power the trial to measure a reduction in PAHs within the study period. Therefore, the study investigators will establish linked data collection procedures to enable ongoing data collection and analysis for up to 5 years. Patient mortality rates will also be assessed for up to 5 years.
The proportion of patients seen within 1 week of discharge from hospital, and under 16-year-olds seen on the same day as requested for acute conditions, will be assessed using quarterly manual chart audits of enrolled patients in each practice performed by the PNs. In addition, patient/parent perceived ease of access will be measured by a brief survey at the beginning and conclusion of the trial, along with health-related quality of life (EQ-5D-5 L) . Table 3 outlines the EQuIP-GP data variables, and Fig. 3 the program logic for the trial.
The aim of the qualitative component is to provide context and insight into the experience, acceptability and success of the intervention from the perspective of patients, GPs and PMs. A case study methodology will be used. It is recommended in health research when studying complex phenomena and the context in which they are embedded . The methodology is useful for conducting evaluations and developing interventions, both of which are relevant for this study. The constructivist underpinnings of case study methodology privilege the existence of multiple perspectives and subjective meanings , making it ideal to investigate the experiences of different staff members and patients within the same practice. Here, the ‘case’ to be examined at each practice is the uptake and implementation of an intervention using financial incentives.
The qualitative component combines interviews and the IF’s diary records. Semi-structured interviews will be conducted over the telephone or may be conducted in person if requested and where logistically viable. A total of 60 interviews (24 with patients, 24 with GPs and 12 with PMs) will be conducted – 30 at baseline and 30 at the conclusion of the 12-month trial. These will be divided evenly across the three collaborating PBRNs and conducted in intervention practices only. The case study sites will be purposively sampled using SEIFA code and practice size as descriptors to ensure diversity. A maximum variation approach to sampling of patients (age, gender, comorbidities) will be applied to invitation for the qualitative interviews.
On receipt of their consent forms, all participants (practice and patient) will be assigned a code, which will link their data to a master-sheet which will contain participants’ demographic details and location. The master-sheet will be kept secure and confidential by the project coordinator in a password-protected file in the project data management system. All data for the evaluation of the project will be identified by the participants’ code only. This is so that the data can be kept confidential, but can be re-identified to enable appropriate grouping and analysis in the case studies at the end of the study. As general practices will be involved in the extraction of their own consultation time and access data, data extraction will be performed by a staff member of the practice who has usual access to the data.
All participants (practices and patients) will have the choice of providing their data in hard copy or online data collection forms. We will use ‘CloudStor’ as a secure, password-protected, cloud-based data collection and storage facility for participant-provided project research data . The CloudStor server for the project is located in Australia. Permission for access to the data within the research team will be an only-if-needed basis. Hard copies of all consent forms will be stored in locked filing cabinets in the Departments of General Practice at each respective university (or password-protected folder on CloudStor if in soft copy form).
After data integrity checks, data extracts received from MedicineInsight will be stored in CloudStor. Data collected from the MBS, PBS, hospitalisation and deaths registries will be collected for 5 years following the trial, but only with express consent from the participants. These data will be stored and analysed in the Secure Unified Research Environment (SURE) maintained by the SAX Institute . SURE is a purpose-built remote-access data research laboratory and storage facility with servers located in Australia.
Interview and IF diary data will be stored securely at each site during the collection period.
De-identification will take place after transcription of interviews. The code sheets and de-identified transcripts will be stored separately in CloudStor.
Quantitative data analysis
Baseline characteristics will be summarised at the collaborating PBRN centre and general practice levels within each trial arm, to provide counts and frequencies for categorical variables and means with standard deviations or medians and ranges for continuous variables, as appropriate. The primary outcome measure is a between-group difference in changes in the domain of relational continuity, as measured in the appropriate scale of the PCAT  at completion of the trial in comparison with baseline. Between-group differences in the domains of accessibility, coordination and comprehensive care in participants will also be measured and tested using the relevant domain scales of the PCAT . To account for the potential effects of clustering, we will use hierarchical linear models with random main effects specified at the general practice level. Total prescription counts for the 12 months prior to trial commencement will also be used to control for case-mix across the trial.
Similarly, each of the other specified outcome variables (Table 2) will be statistically analysed using multi-level modelling methods to test for between-group (intervention vs. control) differences in the change in variables over the course of the study period. It is intended that data collection from administrative datasets (MBS, PBS and hospital admissions) will be continued beyond the trial period for 5 years, and analysed similarly. Data will not be excluded on the basis of non-adherence or protocol violation. The mixed models treat the data as missing at random and incorporate partial datasets, and are appropriate for analysis of datasets with missing data.
Qualitative data analysis
Using a realist evaluation approach to analysis, we will iteratively generate context-mechanism-outcome configurations (CMOc) to clarify what works for whom, why, when and in what context at the individual and practice level . A framework analysis approach will allow us to identify relationships and patterns across diverse data sources, including transcripts, documents, diary entries and observations. Framework analysis has been widely used in health research [40, 41]. Importantly, when using nested case studies as we are, framework analysis facilitates an ordered and organised way to compare and contrast data both across multiple cases and within individual cases.
We will use the seven-step process proposed by Gale et al.  to undertake the framework analysis. These steps are 1) transcription; 2) familiarisation; 3) coding; 4) developing a working analytical framework; 5) applying the framework; 6) charting the data; and 7) interpreting the data. By taking this approach we will be able to develop clusters of themes that facilitate both explanatory and descriptive conclusions directly relevant to our case study approach. Case study analysis calls for early analysis and organisation of data, and coding is one way to do this. We will utilise NVivo for Teams for coding and management of the qualitative data sets .
Health economic evaluation
The payment model has been designed following the net benefit correspondence theorem (NBCT) [17,18,19, 44] to create continuous quality of care improvement incentives with a conservatively health system budget neutral mechanism; with quality of care incentive payments relative to expected downstream cost savings from improved quality. The NBCT provides a generalised method to enable appropriate incentives for improving health system performance, which, as in hospital applications [17, 19], has robust coverage and comparability conditions to create appropriate accountability and prevent perverse incentives - cost and effect shifting and cream skimming.
Importantly, as quality improvement incentives are conservatively budget neutral or potentially somewhat cost saving to the health system, if the trial finds they are effective in improving quality of care relative to usual care, the mechanisms design provides for strong policy-relevant integration into current practice in a health system budget-constrained environment.
Generalisability, implementation and scalability of any such trial findings from case control analysis will be aided by triangulation with qualitative research and pre-post analysis of impacts in the intervention arm, with particular consideration of barriers and enablers to study findings.
The health economic analysis of trial outcomes will jointly consider the health effects and net costs, including downstream health system (prescribed medication and hospital) costs of a capitation-based GP payment system, where bonus payments are continuous across specified ranges for quality of care measures for each of the activities proposed [17,18,19, 45].
Analysis with patient level data will include representing joint cost and effect distributions on the cost-effectiveness plane (two strategy comparisons), cost-disutility plane (multiple strategy comparisons) and relevant summary measures. These summary measures include internationally recognised best practice measures of the level of the probability of, and expected gain from, being cost-effective: net benefit and cost-effectiveness acceptability curves for two strategy comparison ; expected net loss curves and frontiers for multiple strategy comparisons [17, 18, 45], and expected net loss planes and surfaces with multiple domain of effect comparisons [17, 44].
Sample size and power
To reduce bias and cross-group contamination, we propose to recruit 36 practices and then randomise practices to intervention and control groups of equal sizes. A total of 1800 patients (50 patients per practice) will then be recruited according to identical inclusion and exclusion criteria. The sample size will allow us to detect a change of 0.2 in the mean score of PCAT relational continuity scale (out of a total maximum of 4.0) with 98% power for adult participants, assuming an intracluster correlation coefficient (ICC) of 0.05 at the practice level. The study is powered to detect a similar change in the other domains of the PCAT .
In addition, the trial is powered to detect a 40% reduction in PAHs in the 5 years following the trial in comparison with the 12 months prior to the trial in an adult high-risk population with 80% power, assuming an annual PAH rate of 7.5%, ICC of 0.02, attrition of four practices and 25% attrition of patients from remaining practices. Due to funding and time constraints, it is not possible to adequately power the trial to measure a reduction in PAHs within the study period. Therefore, the study investigators will establish data collection procedures to enable ongoing data collection and analysis for up to 5 years.
All Chief Investigators are members of the trial steering committee, which meets every 2 weeks. Its remit includes data management. It is independent from the sponsor. Any reports of potential harm from participating general practices or patients will be investigated by the Steering committee and, if appropriate, reported to the ethics committees.
This trial consists of a practice-based intervention implemented in the primary care setting and predominantly using quantitative data collection and analysis. The trial is designed to test the effects of a new funding model that provides financial incentives for continuous quality improvement in general practice, proportional to the expected downstream cost savings. As part of the trial design, nested case studies are planned. These are intended to contextualise the quantitative findings and provide insights into the attitudes and beliefs of patients and practitioners, and their perceptions about the success or otherwise of the intervention.
The development of the intervention was underpinned by several key tenets, namely that:
high-quality primary health care can reduce the use of secondary care, thus reducing health system costs;
the design and use of financial models that support high-quality primary care are crucial to the uptake of quality improvement activities and better patient outcomes; and
financial incentives for quality improvement are more likely to succeed when incentives are continuous and targeted to specific tasks that are closely linked to high-quality care.
Thus, the trial was designed to incentivise GPs to provide enrolled patients with longer consultations, same day access and rapid follow-up after hospitalisation, and to achieve associated quality improvements linked to these tasks. The primary outcome measure of the trial is patient-perceived relational continuity and secondary outcomes include changes in pathology and imaging, total prescriptions and rates of PAHs - all indicators of quality of care.
The design of funding models to support high-quality primary care is crucial to the uptake of quality improvement activities and better patient outcomes . Health economic theory suggests that incentives with GP payments based on fee-for-service can be significantly improved with capitation payments conditional on continual quality improvement [49,50,51,52,53,54]. Indeed, our review of international financial models for effective primary care indicated that a blend of fee-for-service, capitation and pay-for-performance elements appeared to provide the best balance between improved patient outcomes and productivity. However, the evidence strongly suggested that the incentives were only successful when targeting tasks closely linked to professional standards of high-quality care .
The funding model within the trial seeks to provide incentives to encourage:
access to a preferred provider, longer consultations and structured follow-up after hospitalisation among older and chronically ill general practice patients;
reduced referrals for specified radiology and pathology services, and overall medicine prescriptions for older and chronically ill general practice patients;
improved access to same-day care for under 16-year-olds with defined comorbidities; and
reduced PAHs and emergency department attendances for all enrolled patients.
It is important to note that the absolute incidence of PAHs in the general population is low at around 2.8% per annum, which means that enrolling a non-selected cohort of patients is likely to lead to a null trial with time and funds available. In the 65–74 years age group, the national rate of PAH for 20011/12 was 7,344.8 per 100,000 population (7.3%). For those aged 75 years and over, the rate was 13.4% .
Chronic conditions contribute a significant proportion of PAHs, with diabetes complications, COPD, cardiac failure, asthma and angina being most common . Hence, we have focused on high-risk chronic/complex patients aged 18–65 years with the highest-risk ACSCs (COPD, diabetes, angina, ischaemic heart disease, cardiac failure, asthma) expected to have greatest benefit and health system cost saving where the model of care is effective.
The rate of PAHs in the general population under 16 years of age is approximately 2% per annum . Hence, we have targeted recruitment of patients aged less than 16 years to those with an increased risk of hospitalisation. Research from New Zealand has demonstrated a high rate of re-hospitalisation in under 15-year-olds with a defined expert-derived list of child-specific potentially avoidable hospitalisations (approximately 80% of re-hospitalisations up until 15 years of age) . We are therefore using these diagnoses to recruit participants (includes asthma, epilepsy, acute bronchiolitis, pneumonia, croup and dental conditions).
We are using an embedded mixed methods design to incorporate a qualitative component into an outcomes-based randomised controlled trial. This qualitative data will be used to develop understanding of how the intervention is experienced by participants, and to help contextualise and explain the quantitative results. Our analysis aligns with Creswell and Plano Clark’s model of mixing data using embedded mixed method design . At a pragmatic level, we anticipate that by integrating the embedded qualitative component with our quantitative trial data we will better be able to:
reveal and contextualise relationships between variables and outcomes;
explore and possibly explain differences in effect size;
assess the acceptability of the trial model from multiple perspectives; and
provide insight into discrete, potentially unanticipated impacts of the model on patients and practitioners.
The trial is designed to generate robust, policy-relevant evidence of the impact of a new service model of primary care practice, comprising targeted practice incentives for patient enrolment with a preferred provider, longer consultations, same day access and structured follow-up after hospitalisation, on the quality of primary care and health service utilisation for patients at increased risk of hospitalisation. In addition, the trial will provide evidence on continuous quality improvement incentives which can be compared to block funded pay-for-performance models in the UK , the patient-centred medical home model in the United States  and the Australian Government ‘Health Care Homes’ trial .
The trial is ongoing, with patient recruitment commencing June 1 2018 and completed December 31 2018 and trial completion July 31 2019. The study was in in the intervention and data collection stages at the time of the protocol manuscript submission.
Availability of data and materials
ambulatory care-sensitive conditions
chronic obstructive pulmonary disease
- EQ-5D-5 L:
five-level version of the EuroQol five-dimensional questionnaire
general practice registrar (trainee)
index of relative social disadvantage
Medicare Benefits Schedule
net benefit correspondence theorem
New South Wales
potentially avoidable hospitalisation
practice-based research network
Pharmaceutical Benefits Schedule
primary care assessment tool
quality of life
Royal Australian College of General Practitioners
randomised controlled trial
socio-economic indexes for areas
Starfield B, Shi L, Macinko J. Contribution of primary care to health systems and health. Milbank Q. 2005;83(3):457–502.
Kringos DS, Boerma W, van der Zee J, et al. Europe’s strong primary care systems are linked to better population health but also to higher health spending. Health Aff (Millwood). 2013;32(4):686–94.
Schneider EC, Sarnak DO, Squires D, Shah A, Doty MM. Mirror, Mirror 2017: International comparison reflects flaws and opportunities for better U.S. health care. The Commonwealth Fund, 2017. Available at: https://interactives.commonwealthfund.org/2017/july/mirror-mirror/ [Accessed 8 Jan 2019].
Rosenthal MB. Beyond pay for performance - emerging models of provider-payment reform. N Engl J Med. 2008;359(12):1197–200.
Haggerty JL, Reid RJ, Freeman GK, et al. Continuity of care: a multidisciplinary review. BMJ. 2003;327:1219.
Barker I, Steventon A, Deeny SR. Association between continuity of care in general practice and hospital admissions for ambulatory care sensitive conditions: cross sectional study of routinely collected, person level data. BMJ. 2017;356:j84.
Chen LM, Farwell WR, Jha AK. Primary care visit duration and quality: does good care take longer? Arch Intern Med. 2009;169(20):1866–72.
Maarsingh OR, Henry Y, van de Ven PM, et al. Continuity of care in primary care and association with survival in older people: a 17-year prospective cohort study. Br J Gen Pract. 2016;66(649):e531–9.
Howie JG, Porter AM, Heaney DJ, et al. Long to short consultation ratio: a proxy measure of quality of care for general practice. Br J Gen Pract. 1991;41(343):48–54.
Hutton C, Gunn J. Do longer consultations improve the management of psychological problems in general practice? A systematic literature review. BMC Health Serv Res. 2007;7:71.
Dugdale DC, Epstein R, Pantilat SZ. Time and the patient-physician relationship. J Gen Intern Med. 1999;14(Suppl 1):S34–40.
Goedhuys J, Rethans JJ. On the relationship between the efficiency and the quality of the consultation. A validity study. Fam Pract. 2001;18(6):592–6.
Martin CM, Attewell RG, Nisa M, et al. Characteristics of longer consultations in Australian general practice. Med J Aust. 1997;167(2):76–9.
Wilson A, Childs S. The relationship between consultation length, process and outcomes in general practice: a systematic review. Br J Gen Pract. 2002;52(485):1012–20.
Harris MF, Zwar NA. Care of patients with chronic disease: the challenge for general practice. Med J Aust. 2007;187(2):104–7.
Duckett S. Expanding the breadth of Medicare: learning from Australia. Health Econ Policy Law. 2018;13(3–4):344–68.
Eckermann S. Health economics from theory to practice. Optimally informing joint decisions of research, reimbursement and regulation with health system budget constraints and community objectives. Cham, Switzerland: Springer International Publishing, 2017.
Eckermann S, Briggs A, Willan AR. Health technology assessment in the cost-disutility plane. Med Decis Mak. 2008;28(2):172–81.
Eckermann S, Coelli T. Including quality attributes in efficiency measures consistent with net benefit: creating incentives for evidence based medicine in practice. Soc Sci Med. 2013;76(1):159–68.
Williamson M, Cardona-Morrell M, Elliott JD, et al. Prescribing data in general practice demonstration (PDGPD) project - a cluster randomised controlled trial of a quality improvement intervention to achieve better prescribing for chronic heart failure and hypertension. BMC Health Serv Res. 2012;12:273.
Godwin M, Ruhland L, Casson I, et al. Pragmatic controlled clinical trials in primary care: the struggle between external and internal validity. BMC Med Res Methodol. 2003;3:28.
Crabtree BF, Nutting PA, Miller WL, et al. Primary care practice transformation is hard work: insights from a 15-year developmental program of research. Med Care. 2011;49(Suppl):S28–35.
Greenhalgh T, Robert G, Bate P, Kyriakidou O, Mcfarlene F, Peacock R. How to spread good ideas: a systematic review of the literature on diffusion, spread and sustainability of innovations in health service delivery and organisation. London: NHS SDO Programme; 2004. http://www.netscc.ac.uk/hsdr/files/project/SDO_FR_08-1201-038_V01.pdf [Accessed 8 Jan 2019
Fiss PC. A set-theoretic approach to organizational configurations. Acad Manag Rev. 2007;32(4):1180–98.
Levesque JF, Pineault R, Provost S, et al. Assessing the evolution of primary healthcare organizations and their performance (2005-2010) in two regions of Quebec province: Montreal and Monteregie. BMC Fam Pract. 2010;11:95.
Craig P, Dieppe P, Macintyre S, et al. Developing and evaluating complex interventions: the new Medical Research Council guidance. Int J Nurs Stud. 2013;50(5):587–92.
Baskerville NB, Liddy C, Hogg W. Systematic review and meta-analysis of practice facilitation within primary care settings. Ann Fam Med. 2012;10(1):63–74.
Pawson R, Tilley N. Realist evaluation. London: British Cabinet Office; 2004. http://www.communitymatters.com.au/RE_chapter.pdf [Accessed 8 Jan 2019
Pawson R, Tilley N. Realistic evaluation. London: Sage Publications; 1997.
Radford J, Kitsos A, Stankovich J, et al. Epidemiology of chronic kidney disease in Australian general practice: National Prescribing Service MedicineWise MedicineInsight dataset. Nephrology (Carlton). 2018. https://doi.org/10.1111/nep.13537.
Australian Government Department of Health. Health Care Homes. Available at: https://www.health.gov.au/internet/main/publishing.nsf/content/health-care-homes-professional [Accessed 13 June 2019].
Australian Bureau of Statistics. Census of Population and Housing: Socio-Economic Indexes for Areas (SEIFA), Australia, 2011 (cat. no. 2033.0.55.001). Available at: http://www.ausstats.abs.gov.au/ausstats/subscriber.nsf/0/22CEDA8038AF7A0DCA257B3B00116E34/$File/2033.0.55.001%20seifa%202011%20technical%20paper.pdf [Accessed 8 Jan 2019].
Choosing Wisely Australia. Recommendations. Available at: http://www.choosingwisely.org.au/recommendations [Accessed 13 June 2019].
D'Avila OP, Pinto LF, Hauser L, et al. The use of the primary care assessment tool (PCAT): an integrative review and proposed update. Cien Saude Colet. 2017;22(3):855–65.
Herdman M, Gudex C, Lloyd A, Janssen M, Kind P, Parkin D, Bonsel G, Badia X. Development and preliminary testing of the new five-level version of EQ-5D (EQ-5D-5L). Qual Life Res. 2011;20(10):1727–36.
Baxter P, Jack S. Qualitative case study methodology: study design and implementation for novice researchers. Qual Rep. 2008;13(4):544–59 https://nsuworks.nova.edu/tqr/vol13/iss4/2 [Accessed 8 Jan 2019.
Yin RK. Case study research: design and methods. 3rd ed. Thousand Oaks, CA: Sage; 2003.
AARNet. Cloudstor. Available at https://www.aarnet.edu.au/network-and-services/cloud-services-applications/cloudstor [Accessed 13 June 2019].
SAX Institute. SURE. Available at https://www.saxinstitute.org.au/our-work/sure/ [Accessed 13 June 2019].
Ritchie J, Lewis J (eds.) qualitative research practice. A guide for social science students and researchers. London: Sage Publications, 2003.
Smith J, Firth J. Qualitative data analysis: the framework approach. Nurse Res. 2011;18(2):52–62.
Gale NK, Heath G, Cameron E, et al. Using the framework method for the analysis of qualitative data in multi-disciplinary health research. BMC Med Res Methodol. 2013;13:117.
QSR International Pty Ltd. NVIVO. Available at https://www.qsrinternational.com/nvivo/nvivo-products/nvivo-for-teams [Accessed 13 June 2019].
McCaffrey N, Agar M, Harlum J, et al. Better informing decision making with multiple outcomes cost-effectiveness analysis under uncertainty in cost-disutility space. PLoS One. 2015;10(3):e0115544.
Eckermann S, Willan AR. Presenting evidence and summary measures to best inform societal decisions when comparing multiple strategies. Pharmacoeconomics. 2011;29(7):563–77.
Briggs AH, O'Brien BJ, Blackhouse G. Thinking outside the box: recent advances in the analysis and presentation of uncertainty in cost-effectiveness studies. Annu Rev Public Health. 2002;23:377–401.
The John Hopkins Primary Care Policy Center. Primary Care Assessment Tools. 2017. Available at: http://www.jhsph.edu/research/centers-and-institutes/johns-hopkins-primary-care-policy-center/pca_tools.html [Accessed 8 Jan 2019].
Bonney A, Iverson D, Dijkmans-Hadley B. A review of models for financing primary care systems in the Netherlands, Ontario-Canada, United Kingdom and USA: A report for Peoplecare, 2015. Available at: https://peoplecare.com.au/_Documents/UOW-report.pdf [Accessed 8 Jan 2019].
Peacock SJ, Richardson JR. Supplier-induced demand: re-examining identification and misspecification in cross-sectional analysis. Eur J Health Econ. 2007;8(3):267–77.
Richardson JR, Peacock SJ. Supplier-induced demand: reconsidering the theories and new Australian evidence. Appl Health Econ Health Policy. 2006;5(2):87–98.
van Dijk CE, van den Berg B, Verheij RA, et al. Moral hazard and supplier-induced demand: empirical evidence in general practice. Health Econ. 2013;22(3):340–52.
Eckermann S. Avoiding a health system hernia and the associated outcomes and costs. Aust N Z J Public Health. 2014;38(4):303–5.
Eckermann S, Sheridan L, Ivers R. Which direction should Australian health system reform be heading? Aust N Z J Public Health. 2016;40(1):7–9.
British Medical Association. Models for paying providers: capitation. London: British Medical Association; 2018. https://www.bma.org.uk/collective-voice/policy-and-research/nhs-structure-and-delivery/nhs-structures-and-integration/models-for-paying-providers/capitation [Accessed 8 Jan 2019
Page A, Ambrose S, Glover J, Hetzel D. Atlas of avoidable Hospitalisations in Australia: ambulatory care-sensitive conditions. Adelaide: Public Health Information Development Unit; 2007. https://www.aihw.gov.au/getmedia/c4d175cd-f22f-4834-a96b-546a0595613f/10459.pdf.aspx?inline=true [Accessed 8 Jan 2019
Katterl R, Anikeeva O, Butler C, Brown L, Smith B, Bywood P. Potentially avoidable hospitalisations in Australia: causes for hospitalisations and primary health care interventions. Primary Health Care Research & Information Service: Adelaide; 2012. https://core.ac.uk/download/pdf/30678476.pdf [Accessed 8 Jan 2019
Oliver J, Foster T, Kvalsvig A, et al. Risk of rehospitalisation and death for vulnerable New Zealand children. Arch Dis Child. 2018;103(4):327–34.
Creswell JW, Plano Clark VL. Designing and conducting mixed methods research. Thousand Oaks, CA: Sage; 2006.
Roland M, Olesen F. Can pay for performance improve the quality of primary care? BMJ. 2016;354:i4058.
Epperly T. The patient-centred medical home in the USA. J Eval Clin Pract. 2011;17(2):373–5.
The authors would like to thank Prof Benjamin Crabtree and Prof William Hogg for their valuable advice regarding aspects of the study design and also thank Dr. Christine Metusela (Project Coordinator 2019), Ms. Catriona Rowe (Project Officer), Dr. Shandell Elmer (Project Officer), Ms. Lillian Watson (Research Assistant), Ms. Shelley Davey (Research Assistant), Ms. Jennie Raymond (Research Assistant) and Ms. Rebecca Thorne (Research Officer) for their work in making the trial an operational success. We thank all the participating general practices for their collaboration.
This trial protocol has been granted funding following peer review by the Royal Australian College of General Practitioners (RACGP), who issued a competitive Request for Proposals for the study topic and requested revisions to the initial proposal, including the incentive structure. The RACGP will not have any further authority over the study design, analyses or publication.
Ethics approval and consent to participate
Ethics approval was granted by the lead coordinating centre, University of Wollongong HREC (approval: 2017/417), and subsequently under prior approval provisions by Monash University and University of Tasmania. All participating general practices have signed a study agreement, while participating GPs, practice nurses, practice managers and patients must provide written informed consent.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
The original version of this article was revised: “The first name of the 3rd author is wrong. The correct name should be Jan C. Radford”
About this article
Cite this article
Peterson, G., Russell, G., Radford, J.C. et al. Effectiveness of quality incentive payments in general practice (EQuIP-GP): a study protocol for a cluster-randomised trial of an outcomes-based funding model in Australian general practice to improve patient care. BMC Health Serv Res 19, 529 (2019). https://doi.org/10.1186/s12913-019-4336-2
- Primary care
- General practice
- Continuity of care
- Health service utilisation