Study | Domain 1: Study eligibility criteria* | Domain 2: Identification and selection of studies^ | Domain 3: Data collection and study appraisal# | Domain 4: Synthesis and findings+ | Overall risk of bias of review | Justification |
---|---|---|---|---|---|---|
Atlantis 2014 [23] | High | Unclear | High | High | High | D1: Eligibility criteria lacked detail D2: Unclear whether authors searched for unpublished or ongoing studies and whether selection of studies was completed independently or in duplicate D3: Concerns raised about data extraction and risk of bias assessment D4: Risk of bias was not taken into consideration when conclusions were formed |
Huang 2013 [24] | High | High | High | High | High | D1: No published protocol D2: Did not include sources for unpublished reports in search D3: No information on data extraction and risk of bias assessment for two of the studies included in qualitative synthesis D4: Results might have not been reported in light of risk of bias |
Joshi 2014 [25] | High | High | High | High | High | D1: No protocol and lack of specific details on eligibility criteria D2: Did not consider other methods of searching for unpublished literature D3: Lack of information on quality assessment D4: Did not pre-specify methods of data analysis. Risk of bias not adequately assessed or reported with results |
Smith 2016 [26] | Low | Low | Low | Low | Low | No concerns |
Watson 2013 [27] | Low | Low | Low | Low | Low | The review’s eligibility criteria are limited to studies in the English language; however overall there is no concern. After deliberation, all review authors judged this review as a low risk of bias. |