Skip to main content

Table 1 Inter-Rater Reliability Statistics of MDS items for Research Nurse Pairs

From: Inter-rater reliability of nursing home quality indicators in the U.S

Agreement among Gold Standard Assessors Item/QI

Percent Agreement

kappa

weighted kappa*

A10B. DO NOT RESUSCITATE

91.45

0.83

0.83

A10C. DO NOT HOSPITALIZE

97.22

0.39

0.39

B2A. SHORT-TERM MEMORY

88.24

0.63

0.63

B4. COG SKILL FOR DAILY DECISN MAKING

97.29

0.85

0.89

C4. MAKING SELF UNDERSTOOD

95.89

0.73

0.82

C6. ABILITY TO UNDERSTAND OTHERS

96.08

0.76

0.80

E1C. REPETITIVE VERBALIZATIONS

98.11

0.65

0.71

E1I. REPETITIVE ANXIOUS COMPLAINTS

97.69

0.74

0.73

E1L. SAD, PAINED, FACIAL EXPRESSION

95.38

0.68

0.71

E4A.A FREQ WANDERING

98.79

0.85

0.85

E4C.A FREQ PHYSICALLY ABUSIVE

98.69

0.76

0.74

E4D.A FREQ SOCIALLY INAPPR BEHAV

99.35

0.75

0.87

G1AA BED MOBILITY SELF-PERFORM

96.02

0.72

0.86

G1BA TRANSFER SELF-PERFORM

97.80

0.71

0.92

G1GA DRESSING SELF-PERFORM

96.59

0.69

0.85

G1HA EATING SELF-PERFORM

96.96

0.84

0.88

G1IA TOILET USE SELF-PERFORM

97.59

0.76

0.91

G1JA PERSONAL HYGIENE SELF-PERFORM

96.96

0.70

0.89

G8D. MAJOR DIFF ADLS-MORNING VS EVE

95.37

0.26

0.26

H1A. BOWEL CONTINENCE

94.96

0.77

0.88

H1B. BLADDER CONTINENCE

95.70

0.78

0.88

H3D. INDWELLING CATHETER

97.22

0.79

0.79

I1X. PARAPLEGIA

97.22

0.39

0.39

I2E. PNEUMONIA

99.08

0.85

0.85

I2F. RESPITORY INFECTION

98.15

0.89

0.89

I2J. URINARY TRACT INFECTION

96.36

0.88

0.88

I2L. WOUND INFECTION

99.07

0.80

0.80

J1L. SHORTNESS OF BREATH

91.82

0.71

0.71

J2A. PAIN FREQUENCY

92.95

0.72

0.78

J2B. PAIN INTENSITY

98.18

0.73

0.82

K3A. WEIGHT LOSS

97.46

0.83

0.83

K5B. FEEDING TUBE

99.08

0.92

0.92

M2A. PRESSURE ULCERS

98.73

0.73

0.83

N2. AVG TIME INVOLVED IN ACTIVITIES

95.34

0.57

0.65

O4A. DAYS RECEIVED: ANTIPSYCHOTICS

97.32

0.91

0.92

P1AO. SPEC PROGRAM: HOSPICE

99.07

0.66

0.66

P4C. RESTRAINTS: TRUNK RESTRAINT

98.09

0.66

0.72

P4E. RESTRAINTS: CHAIR PREVENTS RISING

97.01

0.74

0.80

  1. * weight = 1 - [(i - j)^2/(g - 1)^2] where i, j are row and column number, and g the number of groups ** weighted kappa inflated with the function sbicc = (2*kw) /(2*kw + (1 - kw)) where kw is the weighted kappa