Skip to main content

Table 2 Summary of Quality Appraisal

From: Defining and assessing context in healthcare implementation studies: a systematic review

2A Quality appraisal of qualitative articles and the qualitative aspects of mixed methods studies
Author, Year Qualitative approach appropriate? Qualitative data collection methods adequate? Findings adequately derived from the data? Is the interpretation of results sufficiently substantiated by data? Coherence between qualitative data sources, collection, analysis and interpretation?
Al Shemeili et al. (2016) [31] Yes Yes Yes Yes Yes
Arney et al. (2018) [32] Yes Yes Yes Yes Yes
Bain et al. (2015) [33] Yes Yes Yes Yes Yes
Beidas et al. (2014) (Mixed methods) [34] Yes Yes Yes Yes Yes
Belaid & Ridde (2015) [35] Yes Yes Yes Yes Yes
Bergström et al. (2012) [36] Yes Yes Yes Yes Yes
Bocoum et al. (2017) [37] Yes Yes Yes Yes Yes
Bokhour et al. (2015) [26] Yes Yes Yes Yes Yes
Bradley & Griffin (2016)
(Mixed methods) [27]
Yes Yes Yes Yes Yes
Burau et al. (2018) [38] Yes Yes Yes Yes Yes
Busetto et al. (2017) [39] Yes Yes Yes Yes Yes
Cheyne et al. (2013) [40] Yes Yes Yes Yes Yes
Drainoni et al. (2016) [41] Yes Yes Yes Yes Yes
Eboreime et al. (2018)
(Mixed methods) [42]
Yes Yes Yes Yes Yes
Gadomski et al. (2014) [43] Yes Yes Yes Yes Yes
Gagliardi et al. (2014) [44] Yes Yes Yes Yes Yes
Georgiou & Westbrook (2009) [45] Yes Yes Yes Yes Yes
Gibb (2013) (Mixed-methods) [46] Yes Yes Yes Yes Yes
Glidewell et al. (2013) [47] Yes Yes Yes Yes Yes
Greenhalgh et al. (2008)
(Mixed methods) [48]
Yes Yes Yes Yes Yes
Griffin et al. (2017) [49] Yes Yes Yes Yes Yes
Hansen et al. (2011) [8] Yes Yes Yes Yes Yes
Higgins et al. (2015) [50] Yes Yes Yes Yes Yes
Kramer et al. (2017) (Mixed methods) [28] Yes Yes Yes Yes Yes
Menon et al. (2014) (Mixed methods) [51] Yes Yes Yes Yes Yes
Murdoch (2016) [19] Yes Yes Yes Yes Yes
Naik et al. (2015) [52] Yes Yes Yes Yes Yes
Padwa et al. (2016) (Mixed-methods) [53] Yes Yes Yes Yes Yes
Presseau et al. (2017) [54] Yes Yes Yes Yes Yes
Rabbani et al. (2011) (Mixed methods) [55] Yes Yes Yes Yes Yes
Rotteau et al. (2015) [56] Yes Yes Yes Yes Yes
Smith et al. (2018) [57] Yes Yes Yes Yes Yes
Spitzer-Shohat et al. (2018
(Mixed methods) [58]
Yes Yes Yes Yes Yes
VanDevanter et al. (2017) [59] Yes Yes Yes Yes Yes
Ware et al. (2018) [60] Yes Yes Yes Yes Yes
Williams et al (2016) [61] Yes Yes Yes Yes Yes
Yamada et al. (2018) [62] Yes Yes Yes Yes Yes
Yip et al. (2016) [63] Yes Yes Yes Yes Yes
Durbin et al. (2016) [64] Yes Yes Yes Can’t tell Yes
Erasmus et al. (2017) (Mixed methods) [65] Yes Yes Yes Can’t tell Yes
Hill et al. (2017) [66] Yes Yes Yes Can’t tell Yes
Iribarren et al (2015) [67] Yes Yes Yes Can’t tell Can’t tell
Prashanth et al. (2014) [68] Yes Yes Can’t tell Can’t tell Can’t tell
Rodríguez & Peterson (2016) [69] Yes Can’t tell Can’t tell Can’t tell Can’t tell
Baron & Newman (2016)
(Mixed methods) [70]
Yes Can’t tell Can’t tell Can’t tell Can’t tell
Vanderkruik & McPherson (2017) [71] Yes Can’t tell Can’t tell Can’t tell Can’t tell
2B Quality appraisal of randomised control trials and quantitative aspects of a mixed method study
Author, Year Randomization appropriately performed? Are the groups comparable at baseline? Are there complete outcome data? Are outcome assessors blinded to the intervention? Did participants adhere to the assigned intervention?
Forberg et al. (2016) [72] Yes Yes Yes Can’t tell Yes
Chan et al. (2011) [73] Can’t tell Can’t tell Yes Can’t tell Can’t tell
Baron & Newman (2016)
(Mixed methods) [70]
No Yes No Can’t tell Yes
2C Quality appraisal of non-randomised control trial
Author, Year Sample representative? Measurements appropriate? Complete outcome data? Confounders accounted for? Intervention administered (or exposure occurred) as intended?
Abdekhoda et al. (2015) [25] Yes Yes Yes Can’t tell Yes
2D Quality appraisal of quantitative articles and the quantitative aspects of mixed methods studies
Author, Year Sampling strategy relevant? Sample representative? Measurements appropriate? Risk of nonresponse bias low? Statistical analysis appropriate?
Beenstock et al. (2012) [74] Yes Yes Yes Yes Yes
Cummings et al. (2010) [75] Yes Yes Yes Yes Yes
Glisson et al. (2008) [76] Yes Yes Yes Yes Yes
Guerrero et al. (2015) [77] Yes Yes Yes Yes Yes
Hoffman & Rodrígrez (2015) [78] Yes Yes Yes Yes Yes
Lemmens et al. (2009) [79] Yes Yes Yes Yes Yes
Eboreime et al. (2018) (Mixed methods) [42] Yes N/A Yes N/A N/A
Abdekhoda et al. (2015) [25] Yes Yes Yes Can’t tell Yes
Almblad et al. (2018) [80] Yes Yes Yes Can’t tell Yes
Beidas et al. (2014) (Mixed methods) [34] Yes Yes Yes Can’t tell Yes
Bradley & Griffin (2016) (Mixed methods) [27] Yes Yes Yes Can’t tell Yes
Chiu & Ku (2015) [81] Yes Yes Yes Can’t tell Yes
Ehrhart et al. (2014) [82] Yes Yes Yes Can’t tell Yes
Erasmus et al. (2017) (Mixed methods) [65] Yes Yes Yes Can’t tell Yes
Huijg et al. (2014) [83] Yes Yes Yes Can’t tell Yes
Fernandez et al. (2018) [20] Yes Yes Yes Can’t tell Yes
Kramer et al. (2017) (Mixed methods) [28] Yes Can’t tell Yes Yes Yes
Menon et al. (2014) (Mixed methods) [51] Yes Yes Yes Can’t tell Yes
Obrecht et al. (2014) [84] Yes Yes Yes Can’t tell Yes
Rabbini et al. (2011) (Mixed methods) [55] Yes Yes Yes Can’t tell Yes
Spitzer-Shohat et al. (2018)
(Mixed methods) [58]
Yes Yes Yes Can’t tell Yes
Greenhalgh et al. (2008) (Mixed methods) [48] Yes Can’t tell Yes Yes N/A
Beidas et al. (2015) [85] Yes Yes Yes Can’t tell Yes
Douglas (2016) [86] Yes Can’t tell Yes No Yes
Padwa et al. (2016) (Mixed methods) [53] Yes Can’t tell Yes Can’t tell Yes
Yamada et al. (2017) [87] Yes Can’t tell Yes Can’t tell Yes
Gibb (2013)
(Mixed methods) [46]
Can’t tell Can’t tell Can’t tell Can’t tell Can’t tell
2E Quality appraisal of mixed-methods studies
Author, Year Adequate rationale for using a mixed methods design? Different components of the study effectively integrated? Outputs of the integration of qualitative and quantitative components adequately interpreted? Divergences and inconsistencies between quantitative and qualitative results adequately addressed? Different components of the study adhere to the quality criteria of each tradition of the methods involved?
Beidas et al. (2014) [34] Yes Yes Yes Yes Yes
Bradley & Griffin (2016) [27] Yes Yes Yes Yes Yes
Kramer et al. (2017) [28] Yes Yes Yes Yes Yes
Rabbini et al. (2011) [55] Yes Yes Yes Yes Yes
Spitzer-Shohat et al. (2018) [58] Yes Yes Yes Yes Yes
Eboreime et al. (2018) [42] Yes Yes Yes Can’t tell Yes
Erasmus et al. (2017) [65] Yes Yes Yes Can’t tell Yes
Greenhalgh et al. (2008) [48] Yes Yes Yes Can’t tell Yes
Menon et al. (2014) [51] Yes Yes Yes Can’t tell Yes
Padwa et al. (2016) [53] Yes Yes Yes Can’t tell Yes
Gibb (2013) [46] Yes Yes Yes Can’t tell Can’t tell
Baron & Newman (2016) [70] Can’t tell Yes Yes Can’t tell Can’t tell