Combined kappa coefficients* | ||||||||||
---|---|---|---|---|---|---|---|---|---|---|
In the same country | ||||||||||
Germany (N = 17) | Hungary (N = 16) | The Netherlands (N = 28) | Spain (N = 18) | The UK (N = 14) | ||||||
Availability Agreement level | Importance Agreement level | Availability Agreement level | Importance Agreement level | Availability Agreement level | Importance Agreement level | Availability Agreement level | Importance Agreement level | Availability Agreement level | Importance Agreement level | |
0.1223 | 0.2483 | 0.1826 | 0.2021 | 0.1246 | 0.2711 | 0.2648 | 0.2077 | 0.2293 | 0.4246 | |
Slight | Fair | Slight | Slight | Slight | Fair | Fair | Fair | Fair | Moderate | |
Between the two countries | ||||||||||
Germany | Hungary | The Netherlands | Spain | The UK | ||||||
Germany | 0.1318 | 0.2134 | 0.1142 | 0.2509 | 0.1138 | 0.2120 | 0.1021 | 0.2842 | ||
Slight | Fair | Slight | Fair | Slight | Fair | Slight | Fair | |||
Hungary | 0.1198 | 0.2317 | 0.1203 | 0.1961 | 0.1131 | 0.2830 | ||||
Slight | Fair | Slight | Slight | Slight | Fair | |||||
The Netherlands | 0.1225 | 0.2377 | 0.1057 | 0.2981 | ||||||
Slight | Fair | Slight | Fair | |||||||
Spain | 0.2377 | 0.2739 | ||||||||
Fair | Fair | |||||||||
The UK | ||||||||||
Total (All settings; Number of raters = 93) | ||||||||||
Combined kappa for availabilitya = 0.0980* (Slight agreement); p-value < 0.001; 95% CI = [0.085, 0.111] | ||||||||||
Combined kappa for importanceb = 0.2386* (Fair agreement); p-value < 0.001; 95% CI = [0.208, 0.253]). |