Table 1 Inter rater agreement between two referees for 52 abstracts submitted for a primary care research conference
From: Inter-rater agreement in the scoring of abstracts submitted to a primary care research conference
Component | Mean difference (AG minus AM) | Crude ICC | Adjusted ICC |
|---|---|---|---|
1. importance of the topic | 0.71 | 0 | 0.24 |
2. originality | 0.27 | 0 | 0.01 |
3. overall quality of the study design | 0.40 | 0.30 | 0.40 |
4. appropriateness of the design used | 0.17 | 0.40 | 0.41 |
5. achievement of aim | -0.12 | 0.44 | 0.45 |
6. contribution to academic primary care | 0.25 | 0.20 | 0.25 |
7. likelihood of provoking discussion | 0.15 | 0.22 | 0.24 |
Overall score | 1.85 | 0.31 | 0.41 |