Skip to main content

Advertisement

Table 1 Inter-Rater Reliability Statistics of MDS items for Research Nurse Pairs

From: Inter-rater reliability of nursing home quality indicators in the U.S

Agreement among Gold Standard Assessors Item/QI Percent Agreement kappa weighted kappa*
A10B. DO NOT RESUSCITATE 91.45 0.83 0.83
A10C. DO NOT HOSPITALIZE 97.22 0.39 0.39
B2A. SHORT-TERM MEMORY 88.24 0.63 0.63
B4. COG SKILL FOR DAILY DECISN MAKING 97.29 0.85 0.89
C4. MAKING SELF UNDERSTOOD 95.89 0.73 0.82
C6. ABILITY TO UNDERSTAND OTHERS 96.08 0.76 0.80
E1C. REPETITIVE VERBALIZATIONS 98.11 0.65 0.71
E1I. REPETITIVE ANXIOUS COMPLAINTS 97.69 0.74 0.73
E1L. SAD, PAINED, FACIAL EXPRESSION 95.38 0.68 0.71
E4A.A FREQ WANDERING 98.79 0.85 0.85
E4C.A FREQ PHYSICALLY ABUSIVE 98.69 0.76 0.74
E4D.A FREQ SOCIALLY INAPPR BEHAV 99.35 0.75 0.87
G1AA BED MOBILITY SELF-PERFORM 96.02 0.72 0.86
G1BA TRANSFER SELF-PERFORM 97.80 0.71 0.92
G1GA DRESSING SELF-PERFORM 96.59 0.69 0.85
G1HA EATING SELF-PERFORM 96.96 0.84 0.88
G1IA TOILET USE SELF-PERFORM 97.59 0.76 0.91
G1JA PERSONAL HYGIENE SELF-PERFORM 96.96 0.70 0.89
G8D. MAJOR DIFF ADLS-MORNING VS EVE 95.37 0.26 0.26
H1A. BOWEL CONTINENCE 94.96 0.77 0.88
H1B. BLADDER CONTINENCE 95.70 0.78 0.88
H3D. INDWELLING CATHETER 97.22 0.79 0.79
I1X. PARAPLEGIA 97.22 0.39 0.39
I2E. PNEUMONIA 99.08 0.85 0.85
I2F. RESPITORY INFECTION 98.15 0.89 0.89
I2J. URINARY TRACT INFECTION 96.36 0.88 0.88
I2L. WOUND INFECTION 99.07 0.80 0.80
J1L. SHORTNESS OF BREATH 91.82 0.71 0.71
J2A. PAIN FREQUENCY 92.95 0.72 0.78
J2B. PAIN INTENSITY 98.18 0.73 0.82
K3A. WEIGHT LOSS 97.46 0.83 0.83
K5B. FEEDING TUBE 99.08 0.92 0.92
M2A. PRESSURE ULCERS 98.73 0.73 0.83
N2. AVG TIME INVOLVED IN ACTIVITIES 95.34 0.57 0.65
O4A. DAYS RECEIVED: ANTIPSYCHOTICS 97.32 0.91 0.92
P1AO. SPEC PROGRAM: HOSPICE 99.07 0.66 0.66
P4C. RESTRAINTS: TRUNK RESTRAINT 98.09 0.66 0.72
P4E. RESTRAINTS: CHAIR PREVENTS RISING 97.01 0.74 0.80
  1. * weight = 1 - [(i - j)^2/(g - 1)^2] where i, j are row and column number, and g the number of groups ** weighted kappa inflated with the function sbicc = (2*kw) /(2*kw + (1 - kw)) where kw is the weighted kappa