Table 4 Inter-coder analysis using Cohen’s Kappa coefficients
| Â | Key concepts | 1st team of coders (initial stage) | 2nd team of coders (later stage) | ||
|---|---|---|---|---|---|
Kappa (unweighted) | Kappa (weighted) | Kappa (unweighted) | Kappa (weighted) | ||
1 | Relationships | 0.772 | 0.750 | 0.806 | 0.805 |
2 | Characteristics of care in EDs pre- and post-4HR/NEAT | 0.825 | 0.837 | 0.720 | 0.726 |
3 | Staffing and 4HR/NEAT | 0.978 | 0.974 | 0.794 | 0.808 |
4 | Recommendations | 0.772 | 0.691 | 0.875 | 0.864 |
5 | Access block | 0.909 | 0.914 | 0.948 | 0.949 |
6 | 4HR/NEAT introduction and management | 0.786 | 0.724 | 0.810 | 0.820 |
7 | External factors | 0.710 | 0.707 | 0.874 | 0.871 |
8 | Changes to ED related to 4HR/NEAT | 0.792 | 0.775 | 0.815 | 0.816 |
9 | 4HR/NEAT performance | 0.912 | 0.905 | 0.700 | 0.702 |
10 | Medical education and training | 0.789 | 0.632 | 0.855 | 0.865 |
Overall Kappa | – | 0.765 | – | 0.822 | |