Skip to main content
Download PDF

The impact of introducing multidisciplinary care assessments on access to rheumatology care in British Columbia: an interrupted time series analysis

BMC Health Services Research volume 22, Article number: 327 (2022) Cite this article

Abstract

Background

In 2011 the British Columbia (BC) Ministry of Health introduced a new fee-for-service billing code that allowed “Multidisciplinary Care Assessment” (MCA). This change has the potential to change access to and quality of care for patients. This study aimed to explore the impact on access to rheumatology services in the province.

Methods

Fee-for-service rheumatology billings were evaluated for each rheumatologist 2 years before and after use of the MCA code. Numbers of 1) unique patients and 2) services provided per month were used as proxy measures of access to care. A multiple-baseline interrupted time series model assessed the impact of the MCA on levels and trends of the access outcomes.

Results

Our analysis consisted of 82,360 patients cared for by 26 rheumatologists who billed for an MCA. In our primary analysis we observed a sustained increase in the mean number of unique patients of 4.9% (95% CI: 0.0% to 9.9%, p = 0.049) and the mean number of services of 7.1% (95% CI: 1.0% to 13.6%, (p = 0.021), per month provided by a rheumatologist, corresponding to the initial use of MCA.

Conclusion

The introduction of the MCA code was associated with an initial increase in the measures of access, which was maintained but did not increase over time. Our study suggests that the use of Multidisciplinary Care Assessment can contribute to expanding and/or sustaining access to care for people with complex chronic conditions, like rheumatic diseases.

Peer Review reports

Background

Multidisciplinary care (MDC) teams are increasingly recognized as a potentially beneficial model of care for a myriad of conditions and contexts. This includes primary care, diabetes management, dermatology, cancer, chronic kidney disease, non-cancer pain management, stroke survivors, and rheumatology among others [1,2,3,4,5,6,7,8]. While many evaluations of MDC indicate encouraging results for quality of care and clinical outcomes [2,3,4,5, 8], research into MDC is complicated by the diversity of contexts and variations across intervention models [1, 9]. Rheumatology is a discipline that exemplifies this element of MDC, with Crossland et al. [8] finding that 9 out of 11 identified randomized controlled trials (RCT) reported clinical benefits to MDC, including reduced pain, improved self-management, improved emotional and psychological wellbeing, and reduction in inflammatory disease activity.

Inflammatory rheumatic disease typically involves chronic pain, inflammation and damage of joints and connective tissues, and, in severe cases, organ damage, and early intervention is associated with improved prognosis [10, 11]. Consequently, timely access to care, and ongoing management of disease is essential to slowing its progress, improving patient quality of life and to reducing long-term healthcare burden on the government payer. Unfortunately, there has been concern regarding workforce supply of rheumatologists in Canada broadly [12, 13], and in British Columbia (BC) in particular [14, 15]. A 2010 survey conducted by the BC Society of Rheumatologists (BCSR) described a “looming crisis” for BC’s rheumatology workforce; BC had approximately half the number of rheumatologists-per-capita recommended by the Canadian Rheumatology Association [14] and a high proportion of these rheumatologists were planning to retire within the next decade (24% within 5 years and another 28% within 10 years). In response, the BCSR was successful in persuading the BC Ministry of health (MoH) to fund the use MDC teams (nurse support for rheumatologists) to help bridge the gap in supply of rheumatology services [14]. The BCSR hoped that “[t]his treatment model would increase the ability of the rheumatologist to provide treatment to a wider spectrum of patients, and have an impact on the lengthy waits that exist for access to rheumatology consultation” [16].

While the benefits of MDC teams are relatively well-established, a natural experiment in shifting patterns of rheumatology care in the Canadian province of British Columbia provides the opportunity to examine a potential benefit of MDC that has not yet received much attention in the literature – the ability to support and/or expand access to care. Our hypothesis was that facilitating rheumatologist-nurse MDC in the community would increase access to services, and in the context of an apparent shortfall of supply of rheumatologists in BC, we would observe an increase in the level and trend of both these outcomes after the introduction of the new BC MoH policy. There is RCT-based evidence to suggest that nurse-led and/or nurse-supported rheumatology care is clinically equivalent to rheumatologist-only care [17, 18], is associated with improved patient satisfaction and outcomes [17,18,19], and can reduce costs of health care [17, 20, 21].

However, the BC policy intervention – a new fee-for-service billing code targeted at community practitioners – differs from examples of successful, institution-based nurse MDC interventions from these RCTs. The MDC interventions studied previously in RCTs include nurses with advanced training for and/or extensive experience in rheumatology [17,18,19,20,21], have structured protocols for intervention with a specific schedule of tasks [17, 18, 21], and had 3-monthly scheduled visits [17, 19, 20] with specialist nurses, in some cases with a nurse-led telephone helpline [19, 20]. In contrast, the MDC intervention in BC does not require the nurse to have any advanced qualifications or experience in rheumatology, could only be billed once every 6 months for each patient, and offered only broad guidance that an MDC consultation should consist of was “assessment, written treatment plan and any other counselling the patient needs for management of their particular diagnosis” [22.] It is therefore uncertain how MDC delivered through this billing code would impact care in an uncontrolled clinical context at a population-level. Whilst an uncontrolled study of three rheumatology offices in BC reported that use of the nurse-supported MDC was associated with increases in the number of patient visits provided by these clinics [16], the need for a large-scale evaluation of the impact on access remains. Therefore, we examined how the introduction of a billing code to enable nurse-supported care impacted access to rheumatology care in BC using evidence from a natural experiment at a provincial population-level with real world behavior as evidence.

Methods

Study context

A new billing code, now known as the Multidisciplinary Care Assessment (MCA), was approved by the BC MoH and added to the fee-for-service billing codes available to rheumatologists as G31060 in April 2011 through the Medical Services Plan (MSP). The MCA code provides an additional amount, in excess of most standard consultations, to allow a rheumatologist to pay a nurse to support care of rheumatology patients [16, 23]. In BC, the Medical Services Plan provides universal insurance to residents with no co-payment at the point of service, with fee-for-service practitioners billing the government directly.

The MCA code is restricted to rheumatology practices and is intended for patients with inflammatory diseases such as rheumatoid arthritis which require continuing management by a rheumatologist. It is not intended for the evaluation and/or management of uncomplicated rheumatologic disorders (e.g.: osteoarthritis, bursitis/tendonitis, neck and back pain). The billing code is only paid when either a Registered Nurse (RN) or Licensed Practical Nurse (LPN) is present at the consultation, and can be billed once per patient in a 6-month period, and cannot be paid in addition to other consultation codes [22]. As part of the assessment the patient should receive a written treatment plan and any counselling needed for management of their disease. The MCA code paid CAD$226 per consultation in 2019, and cannot be paid in addition to standard (code: 31,010; $209), repeat/limited (code: 31,012; $121), extended (code: G31050; $270) consultations or a subsequent office visit (code: 31,007; $87). By offering a premium over these codes, the MCA code is intended to allow rheumatologists to hire and remunerate the nurse, and is unique in Canada in allowing rheumatologists in private and community practices to provide nursing support (personal communication: K. Shojania, March 14th 2021 & M. Teo, May 19th 2021).

Data sources

This study uses two population-based datasets used in BC between April 1st 2009 through to March 31st 2016 and held by Population Data BC [24]. Population Data BC supports the linkage of and access to individual-level, de-identified data for research. First, the Medical Services Plan (MSP) payment information file records all procedures billed via fee-for-service in BC [25]. Associated with the MSP payment information dataset, we used the BC Ministry of Health Services Central Demographics File (MSP Registration and Premium Billings, Client Roster and Census Geodata)/Consolidation file (MSP registration and premium billing) data set to describe the demographic characteristics of patients (age, sex, rurality) [26].

Cohort definition

We used an open cohort of all people in the BC population living with rheumatic disease and receiving active care from a rheumatologist. We identified rheumatologists using two methods. First, using an anonymous pseudo-identifier provided by Population Data BC based on a list of MSP billing numbers we submitted. We obtained MSP billing numbers for all rheumatologists listed on directories of rheumatologists in BC during our study period using the directory of the College of Physicians and Surgeons of British Columbia. The second was by identifying practitioner numbers in the MSP data that billed rheumatology-specific codes (i.e. 44) in the “Physician Specialty Code” under the MSP fee schedule. Patients accessing rheumatology care were identified by services billed in MSP that are identified as rheumatology codes in the MSP fee schedule by practicing rheumatologists in BC. Patient diagnoses were based on International classification of disease (ICD) codes associated with each patient contact and classified using existing algorithms [27,28,29,30]. The algorithm evaluates the ICD-9 and 10 codes associated with patient encounters with the health system and prioritizes diagnoses from rheumatologist visits to identify a confirmed index diagnosis of rheumatic disease. Demographic characteristics of patients were based on data from the year of the indexed diagnosis date. During data cleaning, erroneous billings (identified by those set to 0 or negative service units) were removed from the MSP dataset. Prior to data cleaning, 1,210,738 rheumatology billings were identified during our study period, and 813,097 were retained after data cleaning.

Our primary analysis examined rheumatologists who “consistently” used MCA. We operationally defined “consistent” as a rheumatologist using MCA at least once per month, for every month that they billed any other rheumatology service. The latter condition was added to capture when the rheumatologist was actively practicing during months they had not used MCA, representing a discontinuity in use. Occasional months of no billing activity were taken to be periods of time-off by the rheumatologist and were not excluded but taken to be part of the secular workflow of physicians. We also conducted secondary analyses on rheumatologist behavior with respect to having “ever billed” the MCA code and “high-intensity” (using MCA at least 25 times per month, on average) using the same methods.

Outcome measures

This study assessed the impact of MCA on two measures of access to rheumatology care: 1) the total number of unique patients (including new and existing patients) seen by rheumatologists per month, identified by one or more billing codes submitted for their care in a given month, and 2) the total number of rheumatology services (including the MCA) billed by rheumatologists: a count of all rheumatology-specific billing codes submitted by rheumatologists to MSP for referred patients. These billing codes include consultations (consultation, extended consultations for patients with chronic and complex medical needs, and repeat or limited consultations within 6 months of the last consultant visit), continuing care by a consultant, telehealth services, and two miscellaneous codes (immunosuppressant review and the MCA).

Statistical analysis

We used a multiple-baseline interrupted time-series model on data for multiple rheumatologists, which establishes a unique baseline for each rheumatologist. The intervention occurred at different times for different rheumatologists within the different series because use of the MCA code was voluntary [31, 32]. A date of intervention (or “index date”) was defined for each rheumatologist as their first ever billing of the MCA (G31060) code, and rheumatologists with 24 months of data prior to and following this “index date” were included in the analysis, to ensure a balanced design with a sufficient data to capture secular and seasonal trends.

We used a generalized linear mixed-effects negative binomial model (GLMM) for count data with the log link and a random baseline intercept to account for heterogeneity of the study outcomes of patient and billing volumes that exists across rheumatologists. We chose a negative binomial model to correct for overdispersion [33] after assessing distributional appropriateness; the variance of the Pearson residuals from a Poisson model were more than 20 times what would be expected if the data were truly from a Poisson distribution. To account for serial correlation within rheumatologists, we used a first-order autoregressive function AR(1) in our models [34].

We computed standard errors and confidence intervals for the estimate parameters using bootstrapping, a nonparametric approach that relies on resampling with replacement (1000 samples) to approximate the distribution of parameters [35, 36]. We used the resulting bootstrap distribution to estimate the p-value and the 2.5 and 97.5 percentiles as the 95% confidence intervals for the parameters [37]. Due to differencing inherent in final GLMM specification, the results we present are the relative change, or the percentage change attributable to the policy effect compared to the counterfactual. All analyses were conducted using SAS 9.4 (SAS Institute, Cary NC).

This study was reviewed and approved by the University of British Columbia Clinical Research Ethics Board (H16-02934).

Results

The initial cohort consisted of 152,251 patients being cared for by 77 rheumatologists between April 1st 2009 through to March 31st 2016. 51 (66%) rheumatologists had billed the MCA code at least once between April 2011 and March 2016. In total, the MCA code was billed 44,871 times at a cost of $9,986,749 (CAD2016) during the study period, as well as 768,226 other rheumatology billing codes costing $86,902,482 (CAD2016). Of the 51 rheumatologists who had ever billed for an MCA, 26 (51%) had two years of data available before and after their index date (when they first billed the MCA code) and could be included in the analysis. Of the remaining 25, eight did not have 24 months of data prior to their index date, six did not have 24 months of data after their index date, and 11 did not have 24 months of data available before or after their index dates. Our primary analysis consisted of 16 rheumatologists, with sufficient data before and after their index data, who consistently used the billing code at least once per month following their index date, serving 53,546 patients. Patients in our primary analysis were predominantly female (68%) with a median age of 56 years old and living in an urban area (70%); almost half (47%) had a diagnosis of inflammatory arthritis (Table 1).

Table 1 Characteristics of patients cared for by the 77 rheumatologists in our cohort
Full size table

Sensitivity analyses in which the definition of intervention according to our criterion for use of the MCA code being either reduced or increased included 26 rheumatologists serving 82,360 patients (“ever-billed”) and 14 rheumatologists serving 59,515 patients (“high-intensity”), respectively.

Unique patients per month

As shown in Fig. 1, prior to billing the Multidisciplinary Care Assessment, the mean number of patients seen per month by a rheumatologist was 171 patients (95% CI: 151, 194), and there was no statistically significant secular (pre-intervention) monthly trend (p = 0.141). There was a sustained increase in the mean number of unique patients per rheumatologist of 4.9% (95%CI: 0.0% to 9.9%, p = 0.049) at the time that rheumatologists first started billing the MCA code (Table 2). This increase represents approximately 8.5 additional patients per rheumatologist, per month (95% CI 0.3 to 17.4, p = 0.049) on average. However, no significant effect was found on the post-intervention trend which was estimated at an 0.2% increase per month (95% CI: -0.3% to 0.7%, p = 0.507).

Fig. 1
figure 1

Interrupted time series model for the impact of Multidisciplinary Care Assessment billing on the number of unique patients seen by rheumatologists per month, Primary analysis (> = 1 use/month)

Full size image
Table 2 Policy effect on level and trend change in number of unique patients seen and rheumatology services provided per month, as evaluated by interrupted time series
Full size table

Number of services provided

The mean number of services billed by a rheumatologist prior to the first time they used the Multidisciplinary Care Assessment code was 196 (95% CI 173, 221), as shown in Fig. 2. We found no statistically significant secular trend (p = 0.425). There was a sustained increase in the mean number of services billed per rheumatologist of 7.1% (95% CI: 1.0% to 13.6%, p = 0.021) corresponding with the first time a rheumatologist billed for a “MCA". This increase in billing represents an additional 14.2 services per month (95%CI: 2.0 to 27.0, p = 0.021) provided per rheumatologist, on average. There was no statistically significant effect on the post intervention trend of number of services provided per month, with an average increase per rheumatologist per month of 0.09% (95% CI: -0.5% to 0.7%, p = 0.750).

Fig. 2
figure 2

Interrupted time series model for the impact of Multidisciplinary Care Assessment billing on the number of services provided by rheumatologists per month

Full size image

Sensitivity analyses

Sensitivity analyses in which the definition of intervention according to use of the MCA code was relaxed (“ever-billed”) or tightened (“high-intensity”) produced consistent results, finding statistically significant changes in level at the time of intervention, albeit with larger estimates of the change. For unique patients per month, the estimated change in level was 12.9% (95% CI, 5.3% to 21.0%, p = 0.001) for the “ever-billed” definition and 8.4% (95% CI: 2.7% to 14.5%, p =  < 0.001) for the “high-intensity” definition, compared with 4.9% (95% CI 0.0% to 9.9% p = 0.049) in the primary analysis (“consistent”). Similarly, for services provided per month, the estimated change in level was 16.8% (95% CI: 7.9% to 26.4%, p =  < 0.001) for the “ever-billed” definition and 8.1% (95% CI: 0.2% to 15.9%, p = 0.044) for the high-intensity definition, compared with 7.1% (95% CI 1.0% to 13.6%, p = 0.021) in the primary analysis (“consistent”). No statistically significant impact on post-intervention trend was detected in secondary analyses for either outcome.

Discussion

Our results show a statistically significant and sustained one-time increase in both the number of unique patients seen and rheumatology services provided by a rheumatologist, per month after the adoption of MCA. This finding was consistent in our primary and sensitivity analyses, although the magnitude of the effect varied according to the definition of use of MCA. Our analyses suggest that the impact of introducing MCA will permanently increase the number of unique patients seen per month, per rheumatologist between 4.9% (95% CI: 0.2% to 9.9%, p = 0.049), to 12.9% (95% CI:5.3% to 21%, p < 0.001) on average, depending on the definition of use of MCA by a rheumatologist. We found a similar increase in the number of services per month a rheumatologist provides after adopting MCA. The average increase in services provided ranged from 7.1% (95% CI:1.0 to 13.6%, p = 0.021) to 16.8% (95% CI: 7.9 to 26.4%, p < 0.001), depending on the definition of use of MCA by the rheumatologist.

The MCA was introduced in the context of a “looming crisis” of workforce demography [14] as a way of helping to maintain and improve access to rheumatology services for patients, which is crucial for their prognosis [14]. This is aligned with evidence from RCTs studying the efficacy of nurse-led rheumatology care in increasing access to and continuity of care [18, 38], suggesting that similar interventions like the MCA in BC, have been effective in increasing access to rheumatologists (numbers of patients seen/services provide) when introduced in practice. Further evidence from the literature suggests that satisfaction with nurse-led rheumatology care, an indicator of quality, access, and continuity of care [39], is comparable with or higher than with rheumatologist-led care [18, 19, 21, 38, 40, 41]. This increased satisfaction, linked to access, reported in the literature might be explained by more frequent contact, longer consultation times and more investigations associated with nurse support [42]. However, as the MCA introduced via a billing code in BC only pays for a nurse to see a patient every six months, which is less frequent contact than in other examples of successful nurse interventions, and is less prescriptive about the role of the nurse, it was unclear whether the efficacy seen in RCTs of nurse-led rheumatology care [21, 43,44,45] would be delivered in practice.

There are few studies evaluating the impact of multidisciplinary care teams, such as the MCA, on access measures directly. Two studies in BC have documented the role that nurses employed under the MCA billing code performed within a sample of three practices, and then a subsequent study of three practices compared the unique patients seen per week prior to and after the introduction of MCA in BC and patient satisfaction [16]. The first study of the MCA in BC reported that rheumatology nurses were providing patient management and counselling, training in self-injection of drugs, general education, and immunizations and tests [46], which might free up time for rheumatologists to see more patients. The subsequent study, again in 3 rheumatologist clinics in BC, reported a 74% increase in average number of patients seen per week, from 17.4 in 2009 to 30.4 in 2016 as well as patient satisfaction [16], which is consistent with the previous literature [39]. Whilst our findings suggest a smaller increase in numbers of patients seen, as well as an increase in services provided, they are consistent in suggesting that the MCA in BC has had some success in increasing access to rheumatology services for patients in BC, and that despite less frequent contact of nurses with patients, and a less prescriptive role for nurses, that some of the benefits documented in RCTs have been achieved in practice.

Any increases in access, measured by unique patients seen and services provided, should be considered in the context of the additional cost of the intervention, to understand whether the MCA led to greater efficiency in service provision. However, there are two main reasons to be cautious in using the results of this study for this purpose. Firstly, consideration of efficiency requires a stated objective. The MCA code was introduced to allow patients with specific inflammatory diseases to have additional counseling, training and education about managing their disease and therapy from rheumatology nurses alongside their regular rheumatology care [47]. Therefore, the overarching goal appears to have been to increase the quality of care to improve patient outcomes, although other potential benefits of reducing waiting times and freeing up physician time, which could translate to increased access have been acknowledged. Although access to care is increasingly identified as a key indicator of quality of care in the USA [48] and Canada [12, 49], the potential benefits of the MCA go beyond increasing access to care. Secondly, although the MCA code was billed almost 45,000 times at a cost of nearly $10 m (CAD2016) during the study period, this does not represent the true cost of the intervention; the MCA code is a substitute for other codes, offering a premium for nursing care over standard, repeat or limited, or subsequent office visits, and paying less than extended consultations. Therefore, the incremental cost of the MCA will be considerably smaller.

Whilst the addition of nurses to the care team may lead to increased costs [17, 20, 21, 38, 50, 51], there is evidence from RCTs that the use of multidisciplinary care teams, usually nurse-supported or led, appears to be clinically equivalent to rheumatologist-only care according to multiple RCTs, with equivalent or marginally better patient outcomes in multidisciplinary teams [17, 19, 21]. This is consistent with evaluations of multidisciplinary care teams within the context of primary care [52]. Furthermore, multidisciplinary rheumatologists clinics with nurses have also been reported to result in fewer contacts with other health care professionals [50]. Further research in BC should explore the impact of the MCA on patient outcomes and overall costs and cost-effectiveness to the BC Ministry of Health.

Our analysis has some limitations. While we used a population-based approach, the total population of rheumatologists in BC is small, with only 77 unique practitioners identified across the entire study period, and not all practicing continuously. Furthermore, as the use of MCA is voluntary, only a subgroup of the population of rheumatologists were included in our analysis. However, our results represent the most valid assessment of impact of the MCA on access using robust methods on the total population of rheumatologists who switched to using the MCA following the introduction of the billing code. Our analysis was also limited in several ways by the nature of the administrative data available. Secondly, there is no linkable dataset with information on the demographics of rheumatologists or regarding the context of their practice, which may affect their adoption of and use of MCA. A 2019 study on rheumatology workforce planning suggests that rheumatologists’ working hours and patient volume vary according to characteristics like their age and sex, as well as the type of practice in which they work, for example whether they run clinics as solo practitioners or work in small teams [53]. As the effect of MCA is likely to occur at the level of the entire practice, not just the rheumatologist who billed the code, evaluation would ideally occur at the clinic level. However, without this data available, it was only possible to conduct a rheumatologist-level evaluation regarding the introducing of MCA. The lack of information about the demographics and practice patterns of rheumatologists is not unique to this study, a literature review recently highlighted the need for better information on working patterns, interaction with remote communities, and the models of care used by rheumatologists [54].

Our study also has major strengths. First, the analysis was population based, meaning that all practitioners and patients providing and receiving rheumatology care under the BC health care system were available for analysis and our inclusion criteria sought to maximize the internal validity of our statistical design. Furthermore, we tested the robustness of our results to changes in the definition of intensity of use of the MCA billing code. Secondly, we used a robust, quasi-experimental statistical method, multiple-baseline segmented regression, that has been consistently used to evaluate the impact of changes in policy such as the MCA using administrative data in BC [55,56,57] and across the world [58,59,60,61]. By incorporating pre- and post-intervention periods, we were able to observe and adjust for secular trends, shocks, and seasonal effects that may otherwise lead to invalid results [62]. By indexing the intervention point individually for each rheumatologist, we were able to make fair comparisons of our measures of access before and after use of a nurse through the MCA using data from as many rheumatologists as possible. Short of a randomized controlled trial, the methods used in this study represent the most internally valid possible evaluation of MCA’s impact on our outcome measures.

Conclusion

In conclusion, the introduction of multidisciplinary care by rheumatologists and nurse in BC was associated with a sustained, one-time increase in the number of unique patients seen and number of rheumatology services provided. Our study suggests that the use of Multidisciplinary Care Assessment can contribute to expanding and/or sustaining access to care for people with complex chronic conditions, like rheumatic diseases.

Availability of data and materials

The data that support the findings of this study are available from Population Data BC (https://www.popdata.bc.ca/) but restrictions apply to the availability of these data, which were used for the current study under Data Stewards’ approval and Research Agreements with Data Stewards, and so are not publicly available. Data are however available from Population Data BC upon reasonable request and with permission of the Data Stewards.

Abbreviations

AR:

Autoregressive

BC:

British Columbia

BCSR:

British Columbia Society of Rheumatologists

CAD:

Canadian Dollar

CI:

Confidence Interval

ICD:

International Classification of Diseases

GLMM:

Generalized Linear Mixed-Effects Model

ITS:

Interrupted Time Series

LPN:

Licensed Practical Nurse

MCA:

Multidisciplinary Care Assessment

MDC:

Multidisciplinary Care

MoH:

Ministry of Health

MSP:

Medical Services Plan

RCT:

Randomized Controlled Trial

RN:

Registered Nurse

References

  1. Schepman S, Hansen J, Putter I de, Batenburg R, Bakker D de. The common characteristics and outcomes of multidisciplinary collaboration in primary health care: a systematic literature review. Int J Integr Care [Internet]. 2015 [cited 2021 Jan 12];15(2). https://doi.org/10.5334/ijic.1359/

  2. Siaw MYL, Lee JY-C. Multidisciplinary collaborative care in the management of patients with uncontrolled diabetes: A systematic review and meta-analysis. Int J Clin Pract. 2019;73(2):e13288.

    Article  PubMed  Google Scholar 

  3. Patel A, Jafferany M. Multidisciplinary and Holistic Models of Care for Patients With Dermatologic Disease and Psychosocial Comorbidity: A Systematic Review. JAMA Dermatol. 2020;156(6):686.

    Article  PubMed  Google Scholar 

  4. Rosell L, Alexandersson N, Hagberg O, Nilbert M. Benefits, barriers and opinions on multidisciplinary team meetings: a survey in Swedish cancer care. BMC Health Serv Res. 2018;18(1):249.

    Article  PubMed  PubMed Central  Google Scholar 

  5. Wang S-M, Hsiao L-C, Ting I-W, Yu T-M, Liang C-C, Kuo H-L, et al. Multidisciplinary care in patients with chronic kidney disease: A systematic review and meta-analysis. Eur J Intern Med. 2015;26(8):640–5.

    Article  CAS  PubMed  Google Scholar 

  6. Sud A, Armas A, Cunningham H, Tracy S, Foat K, Persaud N, et al. Multidisciplinary care for opioid dose reduction in patients with chronic non-cancer pain: A systematic realist review. PLoS One. 2020;15(7):e0236419.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  7. Fens M, Vluggen T, Haastregt J, Verbunt J, Beusmans G, Heugten C. Multidisciplinary care for stroke patients living in the community: A systematic review. J Rehabil Med. 2013;45(4):321–30.

    Article  PubMed  Google Scholar 

  8. Crossland V, Field R, Ainsworth P, Edwards CJ, Cherry L. Is There Evidence to Support Multidisciplinary Healthcare Working in Rheumatology? A Systematic Review of the Literature. Musculoskeletal Care. 2015;13(1):51–66.

    Article  CAS  PubMed  Google Scholar 

  9. Ouwens M, Wollersheim H, Hermens R, Hulscher M, Grol R. Integrated care programmes for chronically ill patients: a review of systematic reviews. Int J Qual Health Care. 2005;17(2):141–6.

    Article  PubMed  Google Scholar 

  10. Lard LR, Visser H, Speyer I, vander Horst-Bruinsma IE, Zwinderman AH, Breedveld FC, et al. Early versus delayed treatment in patients with recent-onset rheumatoid arthritis: comparison of two cohorts who received different treatment strategies. Am J Med. 2001;111(6):446–51.

    Article  CAS  PubMed  Google Scholar 

  11. van der Linden MPM, le Cessie S, Raza K, van der Woude D, Knevel R, Huizinga TWJ, et al. Long-term impact of delay in assessment of patients with early arthritis. Arthritis Rheum. 2010;62(12):3537–46.

    Article  PubMed  Google Scholar 

  12. Barber CEH, Marshall DA, Mosher DP, Akhavan P, Tucker L, Houghton K, et al. Development of System-level Performance Measures for Evaluation of Models of Care for Inflammatory Arthritis in Canada. J Rheumatol. 2016;43(3):530–40.

    Article  PubMed  Google Scholar 

  13. Barber CEH, Jewett L, Badley EM, Lacaille D, Cividino A, Ahluwalia V, et al. Stand Up and Be Counted: Measuring and Mapping the Rheumatology Workforce in Canada. J Rheumatol. 2017;44(2):248–57.

    Article  PubMed  Google Scholar 

  14. Kur J, Koehler B. Rheumatologist demographics in British Columbia: A looming crisis. BC Med J. 2011;53(3):128–31.

    Google Scholar 

  15. Chan J, Kur J. Update on Rheumatologist Demographics in British Columbia. Can Rheumatol Assoc J. 2014;24(4):15.

    Google Scholar 

  16. Connell J, Kur J, Gurmin J. Assessing the impact of a nursing model of care on rheumatology practice patterns and patient satisfaction in British Columbia. BC Med J. 2020;62(3):98–102.

    Google Scholar 

  17. Ndosi M, Lewis M, Hale C, Quinn H, Ryan S, Emery P, et al. The outcome and cost-effectiveness of nurse-led care in people with rheumatoid arthritis: a multicentre randomised controlled trial. Ann Rheum Dis. 2014;73(11):1975–82.

  18. Koksvik HS, Hagen KB, Rødevand E, Mowinckel P, Kvien TK, Zangi HA. Patient satisfaction with nursing consultations in a rheumatology outpatient clinic: a 21-month randomised controlled trial in patients with inflammatory arthritides. Ann Rheum Dis. 2013;72(6):836–43.

    Article  PubMed  Google Scholar 

  19. Primdahl J, Sørensen J, Horn HC, Petersen R, Hørslev-Petersen K. Shared care or nursing consultations as an alternative to rheumatologist follow-up for rheumatoid arthritis outpatients with low disease activity—patient outcomes from a 2-year, randomised controlled trial. Ann Rheum Dis. 2014;73(2):357–64.

    Article  PubMed  Google Scholar 

  20. Sørensen J, Primdahl J, Horn HC, Hørslev-Petersen K. Shared care or nurse consultations as an alternative to rheumatologist follow-up for rheumatoid arthritis (RA) outpatients with stable low disease-activity RA: cost-effectiveness based on a 2-year randomized trial. Scand J Rheumatol. 2015;44(1):13–21.

    Article  PubMed  Google Scholar 

  21. Larsson I, Fridlund B, Arvidsson B, Teleman A, Svedberg P, Bergman S. A nurse-led rheumatology clinic versus rheumatologist-led clinic in monitoring of patients with chronic inflammatory arthritis undergoing biological therapy: a cost comparison study in a randomised controlled trial. BMC Musculoskelet Disord. 2015;16(16):354.

    Article  PubMed  PubMed Central  Google Scholar 

  22. Ministry of Health. Medical Services Commission Payment Schedule [Internet]. 2017. (https://www2.gov.bc.ca/assets/gov/health/practitioner-pro/medical-services-plan/msc-payment-schedule-december-2017.pdfcited 2018 Sep 11).

    Google Scholar 

  23. Ministry of Health. MSC Payment Schedule - Province of British Columbia [Internet]. [cited 2018 Sep 11] https://www2.gov.bc.ca/gov/content/health/practitioner-professional-resources/msp/physicians/payment-schedules/msc-payment-schedule

  24. Population Data BC | www.popdata.bc.ca [Internet]. [cited 2019 Jul 4].  https://www.popdata.bc.ca/home

  25. British Columbia Ministry of Health [creator 2017]. Medical Services Plan (MSP) Payment Information File. V2. [Internet]. Population Data BC [publisher]. Data Extract. MOH. 2018. http://www.popdata.bc.ca/data

  26. British Columbia Ministry of Health [creator 2017]. Consolidation File (MSP Registration & Premium Billing). V2. [Internet]. Population Data BC [publisher]. Data Extract. MOH. 2018. http://www.popdata.bc.ca/data

  27. Lacaille D, Anis AH, Guh DP, Esdaile JM. Gaps in care for rheumatoid arthritis: A population study. Arthritis Care Res. 2018;53(2):241–8.

    Article  Google Scholar 

  28. MacLean CH, Louie R, Leake B, McCaffrey DF, Paulus HE, Brook RH, et al. Quality of Care for Patients With Rheumatoid Arthritis. JAMA. 2000;284(8):984–92.

    Article  CAS  PubMed  Google Scholar 

  29. Bernatsky S, Joseph L, Pineau CA, Belisle P, Hudson M, Clarke AE. Scleroderma prevalence: Demographic variations in a population-based sample. Arthritis Care Res. 2009;61(3):400–4.

    Article  CAS  Google Scholar 

  30. Bernatsky S, Joseph L, Pineau CA, Bélisle P, Boivin JF, Banerjee D, et al. Estimating the prevalence of polymyositis and dermatomyositis from administrative data: age, sex and regional differences. Ann Rheum Dis. 2009;68(7):1192–6.

    Article  CAS  PubMed  Google Scholar 

  31. Ferron J, Scott H. Multiple Baseline Designs. In: Everitt B, Howell D, editors. Encyclopedia of Statistics in Behavioral Science. West Sussex, UK: Wiley; 2005. p. 1306–9.

    Google Scholar 

  32. Baek EK, Ferron JM. Multilevel models for multiple-baseline data: modeling across-participant variation in autocorrelation and residual variance. Behav Res Methods. 2013;45(1):65–74.

    Article  PubMed  Google Scholar 

  33. VerHoef JM, Boveng PL. Quasi-Poisson vs. negative binomial regression: how should we model overdispersed count data? Ecology. 2007;88(11):2766–72.

    Article  Google Scholar 

  34. Murphy DL, Pituch KA. The Performance of Multilevel Growth Curve Models Under an Autoregressive Moving Average Process. J Exp Educ. 2009;77(3):255–84.

    Article  Google Scholar 

  35. Mooney CZ. Bootstrap Statistical Inference: Examples and Evaluations for Political Science. Am J Polit Sci. 1996;40(2):570–602.

    Article  Google Scholar 

  36. Mooney CZ, Duval RD. Bootstrapping: a nonparametric approach to statistical inference. Newbury Park: Sage Publications; 1993.

    Book  Google Scholar 

  37. Cassell DL. 183–2007: Don’t Be Loopy: Re-Sampling and Simulation the SAS® Way. 2007. p. 18.

    Google Scholar 

  38. Hall J, Kaal KJ, Lee J, Duncan R, Tsao N, Harrison M. Patient Satisfaction and Costs of Multidisciplinary Models of Care in Rheumatology: a Review of the Recent Literature. Curr Rheumatol Rep. 2018;20(4):19.

    Article  PubMed  Google Scholar 

  39. Jacobi CE, Boshuizen HC, Rupp I, Dinant HJ, Van Den Bos GAM. Quality of rheumatoid arthritis care: the patient’s perspective. Int J Qual Health Care. 2004;16(1):73–81.

    Article  PubMed  Google Scholar 

  40. Hill J, Bird HA, Hopkins R, Lawton C, Wright V. Survey of satisfaction with care in a rheumatology outpatient clinic. Ann Rheum Dis. 1992;51(2):195–7.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  41. Chew L-C, Lim TG, Loy KL, Kong MC, Chang WT, Tan SB, et al. A questionnaire survey of patient experience with the Rheumatology Monitoring Clinic in Singapore. Int J Rheum Dis. 2012;15(4):390–8.

    Article  PubMed  Google Scholar 

  42. Donald FC. Review: nurse practitioner primary care improves patient satisfaction and quality of care with no difference in health outcomes. Evid Based Nurs. 2002;5(4):121–121.

    Article  PubMed  Google Scholar 

  43. Hill J, Thorpe R, Bird H. Outcomes for patients with RA: a rheumatology nurse practitioner clinic compared to standard outpatient care. Musculoskeletal Care. 2003;1(1):5–20.

    Article  PubMed  Google Scholar 

  44. Hill J, Bird HA, Harmer R, Wright V, Lawton C. An evaluation of the effectiveness, safety and acceptability of a nurse practitioner in a rheumatology outpatient clinic. Br J Rheumatol. 1994;33(3):283–8.

    Article  CAS  PubMed  Google Scholar 

  45. van den Hout WB, de Jong Z, Munneke M, Hazes JMW, Breedveld FC, VlietVlieland TPM. Cost-utility and cost-effectiveness analyses of a long-term, high-intensity exercise program compared with conventional physical therapy in patients with rheumatoid arthritis. Arthritis Rheum. 2005;53(1):39–47.

    Article  PubMed  Google Scholar 

  46. Sun M, Jamal S, Kur J. Analysis of Rheumatology Nursing Interventions in Out-patient Practice Settings. J Can Rheumatol Assoc. 2014;24(3):18–22.

    Google Scholar 

  47. Connell J, Kur J, Gurmin JH. Assessing the impact of a nursing model of care on rheumatology practice patterns and patient satisfaction in British Columbia. BCMJ. 2020;62(3):5.

    Google Scholar 

  48. Saag KG, Yazdany J, Alexander C, Caplan L, Coblyn J, Desai SP, et al. Defining quality of care in rheumatology: the American College of Rheumatology white paper on quality measurement. Arthritis Care Res. 2011;63(1):2–9.

    Article  Google Scholar 

  49. Barber CEH, Twilt M, Pham T, Currie GR, Benseler S, Yeung RSM, et al. A Canadian evaluation framework for quality improvement in childhood arthritis: key performance indicators of the process of care. Arthritis Res Ther. 2020;22(1):53.

    Article  PubMed  PubMed Central  Google Scholar 

  50. Watts RA, Mooney J, Barton G, MacGregor AJ, Shepstone L, Irvine L, et al. The outcome and cost-effectiveness of nurse-led care in the community for people with rheumatoid arthritis: a non-randomised pragmatic study. BMJ Open. 2015;5(8):e007696.

    Article  PubMed  PubMed Central  Google Scholar 

  51. Muñoz-Fernández S, Aguilar MD, Rodríguez A, Almodóvar R, Cano-García L, Gracia LA, et al. Evaluation of the impact of nursing clinics in the rheumatology services. Rheumatol Int. 2016;36(9):1309–17.

    Article  PubMed  Google Scholar 

  52. Saint-Pierre C, Herskovic V, Sepúlveda M. Multidisciplinary collaboration in primary care: a systematic review. Fam Pract. 2018;35(2):132–41.

    Article  PubMed  Google Scholar 

  53. Barber CEH, Nasr M, Barnabe C, Badley EM, Lacaille D, Pope J, et al. Planning for the Rheumatologist Workforce: Factors Associated With Work Hours and Volumes. JCR J Clin Rheumatol. 2019;25(3):142.

    Article  PubMed  Google Scholar 

  54. Brophy J, Marshall DA, Badley EM, Hanly JG, Averns H, Ellsworth J, et al. Measuring the Rheumatology Workforce in Canada: A Literature Review. J Rheumatol. 2016;43(6):1121–9.

    Article  PubMed  Google Scholar 

  55. Laba T-L, Cheng L, Worthington HC, McGrail KM, Chan FKI, Mamdani M, et al. What happens to drug use and expenditure when cost sharing is completely removed? Evidence from a Canadian provincial public drug plan. Health Policy Amst Neth. 2020;124(9):977–83.

    Article  Google Scholar 

  56. Kitchen SA, McGrail K, Wickham ME, Law MR, Hohl CM. Emergency department-based medication review on outpatient health services utilization: interrupted time series. BMC Health Serv Res. 2020;20(1):254.

    Article  PubMed  PubMed Central  Google Scholar 

  57. McGrail K, Ahuja M, Huang X, Law M, Wong S, Harrison M, et al. An Evaluation of the Accelerated Integrated Primary and Community Care Initiatives. Vancouver: University of British Columbia; 2019. (UBC Centre for Health Services and Policy Research).

    Google Scholar 

  58. Wagenaar BH, Augusto O, Beste J, Toomay SJ, Wickett E, Dunbar N, et al. The 2014–2015 Ebola virus disease outbreak and primary healthcare delivery in Liberia: Time-series analyses for 2010–2016. Kruk ME, editor. PLOS Med. 2018;15(2):e1002508.

    Article  PubMed  PubMed Central  Google Scholar 

  59. Wagenaar BH, Sherr K, Fernandes Q, Wagenaar AC. Using routine health information systems for well-designed health evaluations in low- and middle-income countries. Health Policy Plan. 2016;31(1):129–35.

    Article  PubMed  Google Scholar 

  60. Ali M, Khan DM, Aamir M, Khalil U, Khan Z. Forecasting COVID-19 in Pakistan. PloS One. 2020;15(11):e0242762.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  61. Hategeka C, Ruton H, Karamouzian M, Lynd LD, Law MR. Use of interrupted time series methods in the evaluation of health system quality improvement interventions: a methodological systematic review. BMJ Glob Health. 2020;5(10):e003567.

    Article  PubMed  PubMed Central  Google Scholar 

  62. Wagner AK, Soumerai SB, Zhang F, Ross-Degnan D. Segmented regression analysis of interrupted time series studies in medication use research. J Clin Pharm Ther. 2002;27(4):299–309.

    Article  CAS  PubMed  Google Scholar 

Download references

Acknowledgements

Not applicable.

Disclaimer

Access to data provided by the Data Steward(s) is subject to approval, but can be requested for research projects through the Data Steward(s) or their designated service providers.  All inferences, opinions, and conclusions drawn in this publication are those of the author(s), and do not reflect the opinions or policies of the Data Steward(s).

Funding

This study was supported by a Project Grant from the Canadian Institutes of Health Research (Competition 201603, “A population-based analysis of multi-disciplinary rheumatology nursing care for people with complex rheumatic diseases”, P.I. Mark Harrison) and a Strategic Operating Grant from The Arthritis Society (SOG-16–369). Dr. Harrison received salary support through a 2017 Scholar Award from the Michael Smith Foundation for Health Services Research and a 2016 Young Investigator Salary Award from The Arthritis Society (YIS-16–104). Dr. Law received salary support through a Canada Research Chair and a Michael Smith Foundation for Health Research Scholar Award. Dr. De Vera received salary support through a Canada Research Chair and a Michael Smith Foundation for Health Research Scholar Award. The funders had no role in the collection, analysis and interpretation of data; in the writing of the manuscript; or in the decision to submit the manuscript for publication.

Author information

Authors and Affiliations

  1. Faculty of Pharmaceutical Sciences, University of British Columbia, 2405-4625 Wesbrook Mall, Vancouver, BC, V6T 1Z3, Canada

    Ross Duncan, Mary A. De Vera & Mark Harrison

  2. Arthritis Research Canada, Richmond, BC, Canada

    Ross Duncan, Kam Shojania, Mary A. De Vera & Mark Harrison

  3. BC Academic Health Science Network, Vancouver, BC, Canada

    Ross Duncan

  4. School of Population and Public Health, Centre for Health Services and Policy Research, University of British Columbia, Vancouver, BC, Canada

    Lucy Cheng & Michael R. Law

  5. Department of Medicine, Division of Rheumatology, University of British Columbia Faculty of Medicine, Vancouver, BC, Canada

    Kam Shojania

  6. Centre for Health Evaluation and Outcome Sciences, St. Paul’s Hospital, Vancouver, BC, Canada

    Mark Harrison

Authors
  1. Ross Duncan
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Lucy Cheng
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Michael R. Law
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Kam Shojania
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Mary A. De Vera
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Mark Harrison
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

All authors contributed to the conception and design of the study. RD drafted the manuscript and all authors participated in revisions for intellectual content. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Mark Harrison.

Ethics declarations

Ethics approval and consent to participate

This study was reviewed and approved by the University of British Columbia Clinical Research Ethics Board (H16-02934). All use of data was approved through a Population Data BC data access request.

Consent for publication

Not applicable.

Competing interests

Michael Law has consulted for Health Canada, the Health Employees’ Union, the Conference Board of Canada, and provided expert witness testimony for the Attorney General of Canada and the Federation of Post-secondary Educators. Dr Shojania is a rheumatologist who uses the G31060 “Multidisciplinary Care Assessment” billing code. All other authors report no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1: Appendix A.

ITS regression plots for secondary analyses. Appendix B. Rheumatologist Categorization Algorithm.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Duncan, R., Cheng, L., Law, M.R. et al. The impact of introducing multidisciplinary care assessments on access to rheumatology care in British Columbia: an interrupted time series analysis. BMC Health Serv Res 22, 327 (2022). https://doi.org/10.1186/s12913-022-07715-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12913-022-07715-x

Keywords

BMC Health Services Research

ISSN: 1472-6963

Contact us