Skip to main content

Table 6 Results, kappa agreement among the evaluators for each of the 12 examples in the pilot study

From: Systems for grading the quality of evidence and the strength of recommendations II: Pilot study of a new system

Example

No of outcomes

P

Kappa

(SE)

1

3

0.436

0.149

0.031

2

3

0.769

0.075

0.053

3

6

0.643

0.441

0.024

4

3

0.926

0.823

0.050

5

2

0.608

-0.044

0.065

6

3

0.618

0.163

0.050

7

3

0.520

-0.028

0.044

8

3

0.451

0.146

0.036

9

4

0.441

-0.022

0.037

10

5

0.579

0.005

0.034

11

4

0.377

0.112

0.027

12

7

0.718

-0.083

0.043