Development of a case-mix funding system for adults with combined vision and hearing loss
© Guthrie and Poss; licensee BioMed Central Ltd. 2013
Received: 27 June 2012
Accepted: 8 April 2013
Published: 15 April 2013
Adults with vision and hearing loss, or dual sensory loss (DSL), present with a wide range of needs and abilities. This creates many challenges when attempting to set the most appropriate and equitable funding levels. Case-mix (CM) funding models represent one method for understanding client characteristics that correlate with resource intensity.
A CM model was developed based on a derivation sample (n = 182) and tested with a replication sample (n = 135) of adults aged 18+ with known DSL who were living in the community. All items within the CM model came from a standardized, multidimensional assessment, the interRAI Community Health Assessment and the Deafblind Supplement. The main outcome was a summary of formal and informal service costs which included intervenor and interpreter support, in-home nursing, personal support and rehabilitation services. Informal costs were estimated based on a wage rate of half that for a professional service provider ($10/hour). Decision-tree analysis was used to create groups with homogeneous resource utilization.
The resulting CM model had 9 terminal nodes. The CM index (CMI) showed a 35-fold range for total costs. In both the derivation and replication sample, 4 groups (out of a total of 18 or 22.2%) had a coefficient of variation value that exceeded the overall level of variation. Explained variance in the derivation sample was 67.7% for total costs versus 28.2% in the replication sample. A strong correlation was observed between the CMI values in the two samples (r = 0.82; p = 0.006).
The derived CM funding model for adults with DSL differentiates resource intensity across 9 main groups and in both datasets there is evidence that these CM groups appropriately identify clients based on need for formal and informal support.
KeywordsCase-mix systems Dual sensory loss Standardized assessment Resource allocation
Case-mix (CM) measurement systems attempt to categorize clients according to perceived need for service or resource use. The overarching goal of CM measurement is to develop an equitable distribution of resources across a particular client group. The business of resource allocation is considered a political process based on the goals of the particular funding organization. As such, CM systems can inform the process of resource allocation but are not a substitute for sound political judgment.
One of the earliest methodologies for grouping clients was developed in the acute care sector and uses primary diagnosis as the main variable to classify patients. These groups, known as Diagnosis-Related Groups (DRGs), are primarily used to categorize patients into unique groups that share similar processes of care and would be expected to receive a similar set of services or interventions . In other sectors of the health care system, such as the long-term or home care sector, it is generally agreed that diagnosis alone would be inadequate for grouping clients according to resource intensity . In these settings, many individuals will have chronic illnesses, multiple co-morbid health conditions and other factors that affect their physical and cognitive functioning.
In the nursing home sector, the Resource Utilization Groups (RUGs) system was developed in the early 1980s and is used for prospective payment for both Medicare- and Medicaid-funded nursing homes. The RUGs groups were derived from information collected using the Resident Assessment Instrument (RAI 2.0), a comprehensive, standardized assessment tool that was mandated for virtually all US nursing home beds in 1990. The RAI 2.0 is a multidimensional assessment that covers multiple domain areas including activities of daily living (ADLs), instrumental ADLs (IADLs), pain, cognition, mood and psychosocial well-being . It was developed by interRAI (http://www.interrai.org), a non-profit organization of over 30 countries, whose focus is on the development and testing of assessment systems to improve the quality of life and delivery of services for vulnerable populations including older persons and persons with disabilities. The RUGs system has undergone several iterations. The most recent version, RUG-III, was found to explain approximately 40% of total costs in a sample of 176 US nursing homes .
In the Ontario home care sector, the RAI for Home Care (RAI-HC) is mandated for all long stay clients. A similar CM system, the RUG-III/HC, for use in the home care setting, was first developed by Bjorkgren et al. in 2000 . The classification rules of RUG-III/HC were based on those of RUG-III, and were tested against both formal home care costs as well as a variable made up of formal costs along with shadow-costed informal (unpaid) care. RUG-III/HC has 23 classification groups, compared to 44 in the original RUG-III. In a recent study examining this system in a sample of Ontario home care clients, the CM model explained 37% of the variance when modeling the combination of formal and informal costs .
Good CM systems generally share the following characteristics: 1) the measurement tools used to generate client data are valid and reliable; 2) only client characteristics are included as measures to predict resource use; 3) the system has statistical rigour; 4) the groups are consistent with professional knowledge; and 5) the data collection system for measuring CM provides data that are useful for other purposes (e.g., development of service plans) . Finally, in any CM system, research should be undertaken to continually test the system to ensure that it reflects any ongoing changes in the delivery of service.
CM systems are derived using statistical modeling techniques and decision-tree analysis. The dependent, or outcome, variable of interest can be strictly the level of formal services (i.e., provided by paid professionals), informal services (i.e., that provide by family/friends) or some combination of the two.
In Ontario, the provincial government provides intervenor services for eligible clients with both vision and hearing loss, or dual sensory loss (DSL). When a person loses some, or all, of their vision and hearing, being able to communicate with others becomes difficult as does being able to gather information and move about within the community. Intervenors are trained professionals who provide individuals with DSL with information to enable them to communicate with others and to be aware of what is taking place in the environment. Intervenors are trained in a variety of communication techniques and work one-on-one with persons who have DSL.
In 2005, the provincial government commissioned a project to develop a standardized assessment tool for use with individuals who are have DSL and are considered functionally deafblind. The development and testing of the tool have been reported elsewhere [7, 8]. The current paper describes the development and testing of a CM measurement system for a group of individuals who have vision and hearing loss and are residing in the community.
A standardized assessment tool, the interRAI Community Health Assessment (interRAI CHA) and Deafblind Supplement was developed as part of an initiative funded by the Ontario government. The interRAI CHA captures basic demographic background as well as detailed information across 13 domains, including ADLs, IADLs, social functioning, mental health and pain . The Deafblind Supplement includes roughly 150 items that provide further detailed information related to the person’s vision and hearing, including visual acuity, the reason and timing of the vision/hearing loss, orientation and mobility skills, communication, mood, behaviour, psychosocial well-being and formal and informal service use . The assessment has been shown to have good reliability and validity [7, 8].
A number of health sub-scales can be automatically generated from items within the interRAI CHA or the Deafblind Supplement. The Cognitive Performance Scale (CPS) assesses difficulties in memory, decision-making and ADLs and has been validated against the Mini-Mental State examination [11, 12]. The ADL Self-performance Hierarchy Scale assesses both the level of performance across several ADLs (e.g., personal hygiene, toilet use) and categorizes ADLs according to the timing of the loss. It has been shown to be consistent with other ADL measures and can reliably measure changes in ADL impairment over time . The Depression Rating Scale (DRS) is a 7-item scale that ranges from 0–14 and captures typical signs/symptoms of negative mood (e.g., crying/tearfulness, persistent anger, negative statements). A DRS score of 3 or higher has been shown to be a valid indicator of clinical depression [14, 15]. The Instrumental Activities of Daily Living Involvement Scale is a summary score across three items: meal preparation, ordinary housework and telephone use. Each activity is scored from 0 to 3 (a value of 3 is assigned if the activity did not occur). Higher values indicate a greater dependence upon others for IADL tasks . The Deafblind Severity Index (DbSI) is a relatively new scale that assesses the degree of impairment in both vision and hearing and ranges from 0 (no impairment in either sense) to 5 (severe impairment in both senses). Persons with severe DSL have been shown to have greater difficulty interacting with others and performing IADLs .
The CM model was derived in 2006 based on data collected during field testing of the interRAI CHA and Deafblind Supplement. A total of 182 unique assessments were completed in 2005–2006 (the derivation sample) by trained assessors who were all staff of organizations funded by the provincial government to provide intervenor services. Clients were approached by the assessors to take part in the project and each person, or a substitute decision-maker, signed a consent form. The assessors forwarded the completed assessments with all identifiers removed.
In a second pilot test (2008–2010), 135 unique assessment were completed (the replication sample). An identical protocol was followed by the assessors. However, since a different type of identifier was used in this second sample, it is impossible to link the assessments for a given client. Anecdotal information from the assessors indicated that there was some overlap in client participation between the two projects.
Average weekly costs of formal services (based on derivation sample; n = 182)
Mean $ per week (sd)
Orientation and mobility instruction
Personal assistance/home health aide
Candidate independent variables considered for inclusion in the CM model were chosen based on the current literature (e.g., variables known to influence resource intensity in home care or complex continuing care) and expert opinion, which included advice from service providers as well as members of the research team and government representatives. Item selection was based on several criteria, including: the ability to explain variance in the dependent variable; avoidance of service provider variables in favour of variables relating to client characteristics; psychometric properties of the item; and avoidance of variables that might be easily “gamed” in order to obtain desired levels of service, either by providers or clients.
Decision-tree analysis was performed using SAS Enterprise Miner software (Carey, NC). The criterion for creating branches in the tree was the Gini coefficient, which assesses the level of homogeneity in the different branches. Although Enterprise Miner automatically suggests the most statistically powerful splits for independent variables, the user can over-ride these and select other splits, as appropriate. As such, decision tree models were created using both statistical properties and expert opinion. Several decision-tree models were presented to a stakeholder group made up of members of the research team and representatives from the provincial government. This group provided valuable feedback that was useful in guiding the choice of the ‘best’ model.
The replication dataset was subsequently made available, in 2010, and the classification rules applied to these assessments. Both studies were reviewed and approved by the Wilfrid Laurier University Research Ethics Board.
Characteristics of clients in the derivation sample (n = 182)
Age (mean, SD)
Private home/apartment/rented room
Board and care or assisted living
Setting for persons with intellectual disability
Long-term care facility (nursing home)
With spouse/partner only
With parent(s) or guardian(s)
Health sub-scales embedded within the interRAI CHA/Deafblind Supplement
Cognitive Performance Scale (CPS)
Borderline to moderate impairment (1–2)
Moderately severe to very severe impairment (3+)
Depression Rating Scale
No signs/symptoms of depression (0–2)
Signs/symptoms of depression (3+)
ADL Self-performance Hierarchy Scale
Supervised to extensive assistance (1–3)
Extensive assistance (4–6)
Deafblind Severity Index (DbSI)
No hearing or vision impairment (0)
Mild/moderate impairment in 1 sense (1)
Severe impairment in 1 sense (2)
Mild/moderate impairment in both senses (3)
Severe impairment in 1 sense, mild/moderate in other (4)
Severe impairment in both senses (5)
IADL Difficulty Scale
No difficulty on any of the 3 areas (0)
Some difficulty in 1 to 3 areas(1–3)
Great difficulty in 1 to 3 areas (4–6)
Other items in the CM model
Ability to understand others (receptive communication)
Understands others (0)
Usually/rarely/never understands others (1–4)
Adapted or manually coded communication language
Did not use in previous 3 days (0)
Used in previous 3 days (1)
Level of independence in personal hygiene
Is independent/requires setup help (0–1)
Requires supervision/more extensive help/did not occur in previous 7 days (2+)
Independence in transportation
Independent/requires setup help/ supervision (0–2)
Requires a higher level of assistance from others/is totally dependent on others/did not occur in previous 7 days (3+)
The mean cost of formal service use in this sample was $925.20 in the previous week. As shown in Table 1, the vast majority of formal costs were in the area of intervenor services (mean = $882.84). The remaining formal services accounted for less than $30 per week.
List of variables used in case-mix algorithm
Type of measure
Source of variables
Items used to create variable
Cognitive Performance Scale
Short term memory, cognitive skills for decision making, eating, making self understood
Ability to understand others (comprehension)
Adapted or manually coded language
Use of an adapted or manually coded language as a form of communication
Self performance in personal hygiene ADL
Self performance capacity in transportation instrumental ADL
Depression Rating Scale
Sum of frequency of: negative statements, persistent anger, unrealistic fears, repetitive health complaints, repetitive anxious complaints, tearfulness, sad/pained facial expression in last 3 days
Case-mix groups and distribution in derivation and replication samples
Case mix group
Derivation Sample (n = 182)
Replication Sample (n = 135)
Mean Informal hours (CV)
Formal Cost CMI (CV)*
Formal and informal cost CMI (CV)
Mean Informal hours (CV)
Formal Cost CMI (CV)
Formal and informal cost CMI (CV)
The CMI provides an estimate of relative cost and is calculated by dividing the mean group cost by the overall cost. For example, a CMI of 1.20 indicates that the group had costs that were 20% higher, on average, relative to the entire sample. The CMI values, in the derivation sample, exhibited a 38-fold range for formal costs and a 35-fold range for the combined formal and informal costs (Table 4). These values were somewhat lower in the replication sample, with a 15-fold range for formal costs and a 13-fold range in the combined costs.
For each CM level, the coefficient of variation (CV; standard deviation/mean) was used to show within group homogeneity. In the derivation sample for formal costs alone, only two groups show CV values higher than the overall CV, namely, groups 3 and 7. These groups, as well as group 1, showed higher than average within group variation based on the combined costs. In the replication sample, only group 5 exceeded the overall CV for formal costs, and the same was true for group 8, based on the combined costs. These findings suggest that there were a small number of groups that contain cases with above average variation but overall, the model seems to be working well in terms of gathering cases with similar resource use patterns.
Explained variance was obtained by regressing both formal costs alone and the combined costs against the 9 CM groups. In the derivation sample, the R2 value was 67.7% for total costs and 62.4% for formal costs. Not surprising, the values were lower in the replication sample at 28.2% and 26.5%, respectively. However, these levels of explained variance are quite high given the relatively small sample sizes in each of the two datasets.
To our knowledge, this is the first time a CM model has been developed to examine resource use in an adult population of individuals with DSL. Overall, the model performed very well in terms of explained variance. Using the derivation data, the model performed as well as or better than CM models developed for home care [5, 6] and long-term care . Although the explained variance values were lower in the replication sample, this is not surprising since one would expect the highest explained variance in the original dataset and the values were still in line with those reported in home care which ranged from 21% to 37% for either formal costs or total costs [5, 6].
The goal of a good CM system is to group clients according to homogeneity in terms of resource utilization and to include variables that would be acceptable and reasonable to service providers with experience in working with this client population. The present model showed a very wide range in the CMI values for overall costs (35-fold difference) which demonstrates substantial variability in overall service use by clients with vision and hearing loss and which was roughly 2.5 times as high as that seen in home care . This is not unexpected given the wide range of individuals classified as having DSL.
This population includes adults with vision and hearing losses that occurred early in life (e.g., prior to 2 years of age) and those who have acquired one or more of these losses over time, possibly due to changes associated with aging or the presence of a genetic disorder (e.g., Usher syndrome). As such, these clients have a vast range of abilities and needs and have markedly different resources in terms of their personal ability to cope with these sensory changes. For some individuals with remaining vision and/or hearing, these sensory losses may continue to decline over time, creating special challenges for determining the need for services and appropriate service intensity.
The CM model included variables from both the interRAI CHA and the Deafblind Supplement and these variables show significant overlap with those used in other CM models. For example, the model developed for home care clients also includes measures of ADL and IADL performance as well as cognition . In one of the earliest CM models, developed for the US long-term care sector, it also split clients based on cognition, depression and ADL performance . Although a somewhat different client population, a proposed CM model for in-patient psychiatry also includes variables related to depression, cognition and functional performance . These findings lend support to the face validity of this new model and reinforce the importance of these factors in determining resource utilization and client needs.
At least one CM group (group 8) showed substantial variation between the two samples (CMI range from 1.42 to 2.68) with relatively high resource intensity compared with the other groups. This group also displayed a high coefficient of variation, indicating higher than average variability within the group. This does not appear to be driven by differences in informal support as the CMI values, within each of the two samples, were relatively stable comparing formal services alone versus the combined costs of formal and informal support. Although it may appear that collapsing group 8 and group 9 would eliminate this issue, this would result in nearly half the client population falling into this combined group. As such, we contend that the groups remain independent.
A key weakness of this study is the method for defining the main outcome of interest. Trained assessors gathered information on resource utilization in the previous seven days based on interviews with clients, family members and formal service providers, as appropriate. With this approach, there is the potential for reporting bias, however, we have no evidence to suggest that this was a major factor in the current project. The service providers are trained to pull together all information, from a variety of source, and to come up with the most appropriate answer to each item on the assessment. As such, if there was substantial over- or under-reporting on the part of clients or caregivers, we would anticipate that the assessor would consider all the information and record a value that was in line with what would be reasonable. A stronger approach would involve the use of actual billing data provided by formal service organizations but these data were not available during this project. Future validation of the derived CM model should attempt to utilize more objective measures of resource use.
This project involved the creation of a unique CM funding model for adults with DSL. To date, this is the first time that a CM methodology has been applied to adults with this unique disability. Although limited in terms of sample size, the model has excellent explained variance and there is good evidence that the 9 groups differentiate clients into homogeneous groups. This model represents an important piece of information in understanding the various needs for services among adults with the DSL. Although not a substitute for politically-driven decisions, the derived model can inform policy makers as they face the ongoing challenges of meeting clients’ needs while working in an environment of fiscal restraint.
Activities of daily living
Changes in Health, End-stage disease and Signs and Symptoms
Coefficient of variation
Cognitive Performance Scale
Complex continuing care
Deafblind Severity Index
Depression Rating Scale
Dual sensory loss
- interRAI CHA:
InterRAI Community Health Assessment
Resident Assessment Instrument
Resident Assessment Instrument for Home Care
Resource Utilization Groups.
The authors gratefully acknowledge the following service provider organizations and their staff who were instrumental in client recruitment and data collection: Deafblind Ontario Services, CNIB, Rotary Cheshire Homes, Lions McInnes House and the Canadian Deafblind Association. We also acknowledge the financial support provided by the Ontario Ministry of Community and Social Services. The views expressed in this article do not necessarily reflect those of the working group consulted by the author. At the time of publication, the Ministry of Community and Social Services had not yet finalized an assessment system or funding model for adults who are deafblind.
- Fetter RB, Shin Y, Freeman JL, Averill RF, Thompson JD: Case mix definition by diagnosis-related groups. Med Care. 1980, 18: 1-53.Google Scholar
- Hirdes JP, Botz CA, Kozak J, Lepp V: Identifying an appropriate case mix measure for chronic care: evidence from an Ontario pilot study. Healthc Manage Forum. 1996, 9: 40-46. 10.1016/S0840-4704(10)60943-X.View ArticlePubMedGoogle Scholar
- Canadian Institute for Health Information: Resident Assessment Instrument (RAI) MDS 2.0 and RAPs Canadian Version User’s Manual. 2002, Ottawa, ON: Canadian Institute for Health InformationGoogle Scholar
- Fries BE, Schneider D, Foley WJ, Gavazzi M, Burke R, Cornelius E: Refining a case-mix measure for nursing homes: Resource Utilization Groups (RUG-III). Med Care. 2001, 32: 668-685.View ArticleGoogle Scholar
- Bjorkgren MA, Fries BE, Shugarman LR: Testing a RUG-III based case-mix system for home care. Can J Aging. 2000, 19 (suppl 2): 106-125.View ArticleGoogle Scholar
- Poss JW, Hirdes JP, Fries BE, McKillop I, Chase M: Validation of resource utilization groups version III for home care (RUG-III/HC): evidence from a canadian home care jurisdiction. Med Care. 2008, 46: 380-387. 10.1097/MLR.0b013e31815c3b6c.View ArticlePubMedGoogle Scholar
- Guthrie DM, Pitman R, Stolee P, Strong G, Poss J, Tjam EY: Reliability of standardized assessment for adults who are deafblind. J Rehabil Res Dev. 2011, 48: 545-554. 10.1682/JRRD.2010.09.0175.View ArticlePubMedGoogle Scholar
- Dalby D, Hirdes JP, Stolee P, Strong JG, Poss J, Tjam EY: Development and psychometric properties of a standardized assessment for adults who are deaf-blind. Journal of Visual Impairment and Blindness. 2009, 103: 1-18.Google Scholar
- Morris JN, Berg K, Bjorkgren M, Declercq A, Finne-Soveri H, Fries BE: interRAI community health (CHA) assessment form and user’s manual, Version 9.1. 2010, Canadian Edition edn: Washington, DCGoogle Scholar
- Hirdes JP, Dalby DM, Curtin-Telegdi N, Poss JW, Stolee P, Strong G: interRAI deafblind supplement to CHA: guide for use of the interRAI deafblind supplement assessment form (Canadian Version 9). 2007, Washington, DC: interRAIGoogle Scholar
- Morris JN, Fries BE, Mehr DR, Hawes C, Mor V, Lipsitz L: MDS Cognitive Performance Scale. J Gerontol A Biol Sci Med Sci. 1994, 49: M174-M182.View ArticleGoogle Scholar
- Hartmaier SL, Sloane PD, Guess HA, Koch GG, Mitchell CM, Phillips CD: Validation of the minimum data Set cognitive performance scale: agreement with the mini-mental state examination. J Gerontol A Biol Sci Med Sci. 1995, 50A: M128-M133. 10.1093/gerona/50A.2.M128.View ArticleGoogle Scholar
- Morris JN, Fries BE, Morris SA: Scaling ADLs within the MDS. J Gerontol A Biol Sci Med Sci. 1999, 54A: M546-M553.View ArticleGoogle Scholar
- Burrows AB, Morris JN, Simon SE, Hirdes JP, Phillips CD: Development of an MDS-based depression rating scale for use in nursing homes. Age Ageing. 2000, 29: 165-172. 10.1093/ageing/29.2.165.View ArticlePubMedGoogle Scholar
- Martin L, Poss JW, Hirdes JP, Jones RN, Stones MJ, Fries BE: Predictors of a new depression diagnosis among older adults admitted to complex continuing care: implications for the Depression Rating Scale (DRS). Age Ageing. 2008, 37: 51-56.View ArticlePubMedGoogle Scholar
- Morris JN, Carpenter I, Berg K, Jones RN: Outcome measures for use with home care clients. Can J Aging. 2000, 19: 87-105. 10.1017/S071498080001391X.View ArticleGoogle Scholar
- Bland JM, Altman DG: Comparing methods of measurement: why plotting difference against standard method is misleading. Lancet. 1995, 346: 1085-1087. 10.1016/S0140-6736(95)91748-9.View ArticlePubMedGoogle Scholar
- JPPC Mental Health Technical Working Group: Grouper and weighting methodology for adult inpatient mental health care in Ontario. http://www.ontla.on.ca/library/repository/mon/22000/286770.pdf . 2003. JPPC
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1472-6963/13/137/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.