Skip to main content

Table 2 Inter-rater reliability of AGREE instrument – individual items

From: Reliability and validity of the AGREE instrument used by physical therapists in assessment of clinical practice guidelines

 

Generalists

Clinical Specialists

Researchers

Overall

 

Single Rater ICC

Average of Raters ICC

Single Rater ICC

Average of Raters ICC

Single Rater ICC

Average of Raters ICC

Single Rater ICC

Average of Raters ICC

Item 1

0.34

0.51

0.50

0.66

0.58

0.73

0.46

0.84

Item 2

0.28

0.44

0.03

0.05

-0.09

-0.19

0.25

0.67

Item 3

0.45

0.62

0.23

0.37

0.19

0.31

0.22

0.63

Item 4

0.58

0.74

0.65

0.79

0.75

0.86

0.67

0.92

Item 5

0.57

0.73

0.37

0.54

0.55

0.71

0.45

0.83

Item 6

0.43

0.60

0.62

0.76

0.69

0.82

0.55

0.88

Item 7

0.48

0.65

0.18

0.30

0.36

0.53

0.36

0.77

Item 8

0.88

0.93

0.77

0.87

0.78

0.88

0.83

0.97

Item 9

0.72

0.84

0.84

0.91

0.69

0.82

0.72

0.94

Item 10

0.61

0.76

0.54

0.70

0.66

0.80

0.62

0.91

Item 11

0.45

0.63

0.13

0.23

0.32

0.49

0.39

0.79

Item 12

0.61

0.75

0.46

0.63

0.55

0.71

0.63

0.91

Item 13

0.74

0.85

0.66

0.79

0.56

0.72

0.64

0.92

Item 14

0.57

0.73

0.61

0.76

0.70

0.82

0.65

0.92

Item 15

0.31

0.47

0.30

0.46

0.25

0.40

0.38

0.79

Item 16

0.39

0.56

0.49

0.66

0.46

0.63

0.43

0.82

Item 17

0.31

0.48

0.31

0.48

0.41

0.58

0.35

0.76

Item 18

0.32

0.48

0.60

0.75

0.42

0.59

0.52

0.87

Item 19

0.53

0.69

0.50

0.67

0.45

0.62

0.43

0.82

Item 20

0.48

0.65

0.40

0.57

0.49

0.66

0.43

0.82

Item 21

0.34

0.51

0.37

0.54

0.20

0.34

0.28

0.70

Item 22

0.53

0.69

0.15

0.27

0.42

0.60

0.26

0.68

Item 23

0.58

0.73

0.53

0.69

0.72

0.84

0.40

0.80

  1. ICC – Intraclass correlation coefficient
  2. Results statistically significant at the p < 0.05 level except where indicated by bold.