Barene [18] | Hewitt [38] | Kullgren [39] | Lemon [40] | Low [41] | Lowe [42] | Matsugaki [43] | Ostbye [44] | Palumbo [45] | Stenner [46] | Strijk [47] | Thorndike [48] | Borg [49] | Hamm [50] | LaCaille [13] | Sallon [51] | Yuan [52] | |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
2014 | 2008 | 2013 | 2010 | 2015 | 2010 | 2017 | 2015 | 2012 | 2020 | 2012 | 2012 | 2010 | 2019 | 2016 | 2017 | 2009 | |
1. Clear aims and justification | |||||||||||||||||
A. Clear statement of the aims of the research | ✓✓ | ✓✓ | ✓✓ | ✓✓ | ✓✓ | ✓✓ | ✓✓ | ✓✓ | ✓✓ | ✓✓ | ✓✓ | ✓✓ | ✓✓ | ✓✓ | ✓✓ | ✓✓ | ✓✓ |
2. Managing bias in sampling or between groups | |||||||||||||||||
A. Sequence Generation | ✓✓ | ✓✓ | ✓✓ | ✓ | ✓ | ✓✓ | ✓✓ | ✓✓ | ✓ | ✓✓ | ✓✓ | ✓✓ | N/A | N/A | N/A | N/A | N/A |
B. Allocation Concealment | ✓✓ | ✓✓ | ✓✓ | ✓ | ✓ | ✓ | ✓✓ | ✓ | ✓ | ✓✓ | ✓✓ | ✓ | N/A | N/A | N/A | N/A | N/A |
D. Intervention and control group selection designed to protect against systematic difference/selection bias | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | ✓ | ✓✓ | ✓✓ | ✗ | ✗ |
3. Managing bias in outcome measurements and blinding | |||||||||||||||||
A. Blinding | ✓ | ✗ | ✓✓ | ✓ | ✓ | ✗ | ✓✓ | ✓ | ✓ | ✓✓ | ✓✓ | ✓ | N/A | N/A | N/A | N/A | N/A |
B. Protection against selection bias | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | ✓✓ | ✓✓ | ✓✓ | ✓✓ | ✓✓ |
C. Protection against contamination | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | N/A | ✓ | ✓✓ | ✓✓ | ✓ | ✓ |
E. Protection against detection bias | ✓✓ | ✓✓ | ✓✓ | ✓✓ | ✓✓ | ✓✓ | ✓✓ | ✓✓ | ✓✓ | ✓✓ | ✓✓ | ✓✓ | ✓✓ | ✓✓ | ✓✓ | ✓ | ✓✓ |
F. Reliable primary outcome measures | ✓✓ | ✓✓ | ✓ | ✓✓ | ✓✓ | ✓✓ | ✓✓ | ✓✓ | ✓✓ | ✓✓ | ✓✓ | ✓✓ | ✓✓ | ✓✓ | ✓✓ | ✓✓ | ✓✓ |
4. Managing bias in follow-up | |||||||||||||||||
A. Follow-up of subjects (protection against exclusion bias) | ✗ | ✓ | ✓✓ | ✓✓ | ✓ | ✗ | ✓✓ | ✓✓ | ✗ | ✓✓ | ✗ | ✗ | N/A | N/A | N/A | N/A | N/A |
B. Follow-up of patients or episodes of care | ✗ | ✓✓ | ✓✓ | ✓✓ | ✓ | ✗ | ✓✓ | ✓✓ | ✗ | ✓✓ | ✓ | ✓✓ | N/A | N/A | N/A | N/A | N/A |
C. Incomplete outcome data addressed | ✓✓ | ✓ | ✓✓ | ✓ | ✓✓ | ✓ | ✓ | ✓✓ | ✓ | ✓✓ | ✓✓ | ✓✓ | ✓✓ | ✓✓ | ✓✓ | ✓ | ✓ |
5. Managing bias in other study aspects | |||||||||||||||||
A. Protection against detection bias: Intervention unlikely to affect data collection | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ | ✓ |
6. Analytical rigour | |||||||||||||||||
C. Analysis sufficiently rigorous/free from bias | ✓✓ | ✓✓ | ✓✓ | ✓✓ | ✓✓ | ✓✓ | ✓✓ | ✓✓ | ✓ | ✓✓ | ✓✓ | ✓✓ | ✓✓ | ✓✓ | ✓✓ | ✓✓ | ✓✓ |
7. Managing bias in reporting/ethical considerations | |||||||||||||||||
A. Free of selective outcome reporting | ✓✓ | ✓✓ | ✓✓ | ✓✓ | ✓✓ | ✓✓ | ✓✓ | ✓✓ | ✓✓ | ✓✓ | ✓✓ | ✓✓ | ✓✓ | ✓✓ | ✓✓ | ✓✓ | ✓✓ |
B. Limitations addressed | ✓✓ | ✓ | ✓✓ | ✓✓ | ✓✓ | ✓ | ✓✓ | ✓✓ | ✓✓ | ✓✓ | ✓✓ | ✓ | ✓✓ | ✓✓ | ✓✓ | ✓ | ✓✓ |
C. Conclusions clear and justified | ✓✓ | ✓✓ | ✓✓ | ✓✓ | ✓✓ | ✓ | ✓✓ | ✓✓ | ✓✓ | ✓✓ | ✓✓ | ✓✓ | ✓✓ | ✓✓ | ✓✓ | ✓✓ | ✓✓ |
D. Free of other bias | ✓ | ✓✓ | ✓✓ | ✓ | ✓ | ✗ | ✓✓ | ✓ | ✗ | ✓✓ | ✓✓ | ✓✓ | ✓✓ | ✓✓ | ✓✓ | ✓ | ✓ |
E. Ethics issues addressed | ✓✓ | ✓✓ | ✓✓ | ✓✓ | ✓✓ | ✓✓ | ✓✓ | ✓✓ | ✗ | ✓✓ | ✓✓ | ✓✓ | ✓✓ | ✓✓ | ✓✓ | ✓✓ | ✓✓ |
Met mandatory criteria | |||||||||||||||||
✗ | ✗ | ✓ | ✗ | ✗ | ✗ | ✓ | ✗ | ✗ | ✓ | ✓ | ✗ | ✗ | ✓ | ✓ | ✗ | ✗ | |
Met minimum score (≥22 if RCT, ≥18 if CBA) | |||||||||||||||||
Score | 25 | 26 | 30* | 26 | 25 | 19 | 30* | 28 | 18 | 30* | 28* | 26 | 25 | 27* | 27* | 20 | 22 |