Skip to main content

Table 1 Agreement at the individual level between test-retest for weights, scores and MCDA value estimates for tramadol

From: Bridging health technology assessment (HTA) with multicriteria decision analyses (MCDA): field testing of the EVIDEM framework for coverage decisions by a public payer in Canada

 

Weights

Scores

Value Estimates

Number of test-retest pairs

126*

126*

9

Mean of test data

3.81

1.31

0.44

Mean of retest data

3.81

1.33

0.44

ICC (3, 1)

0.683

0.676

0.698

Proportion of pairs with no test-retest difference (%)

65.1

78.6

NA

Proportion of pairs with test-retest difference of 1 point (%)

31.7

19.8

NA

Proportion of pairs with test-retest difference of 2 points (%)

3.2

1.6

NA

  1. *9 evaluators × 14 MCDA criteria
  2. NA: Not applicable
  3. ICC: intra-class correlation coefficient, defined according to Shrout and Fleiss (1979) [31]