From: Defining and assessing context in healthcare implementation studies: a systematic review
2A Quality appraisal of qualitative articles and the qualitative aspects of mixed methods studies | |||||
Author, Year | Qualitative approach appropriate? | Qualitative data collection methods adequate? | Findings adequately derived from the data? | Is the interpretation of results sufficiently substantiated by data? | Coherence between qualitative data sources, collection, analysis and interpretation? |
Al Shemeili et al. (2016) [31] | Yes | Yes | Yes | Yes | Yes |
Arney et al. (2018) [32] | Yes | Yes | Yes | Yes | Yes |
Bain et al. (2015) [33] | Yes | Yes | Yes | Yes | Yes |
Beidas et al. (2014) (Mixed methods) [34] | Yes | Yes | Yes | Yes | Yes |
Belaid & Ridde (2015) [35] | Yes | Yes | Yes | Yes | Yes |
Bergström et al. (2012) [36] | Yes | Yes | Yes | Yes | Yes |
Bocoum et al. (2017) [37] | Yes | Yes | Yes | Yes | Yes |
Bokhour et al. (2015) [26] | Yes | Yes | Yes | Yes | Yes |
Bradley & Griffin (2016) (Mixed methods) [27] | Yes | Yes | Yes | Yes | Yes |
Burau et al. (2018) [38] | Yes | Yes | Yes | Yes | Yes |
Busetto et al. (2017) [39] | Yes | Yes | Yes | Yes | Yes |
Cheyne et al. (2013) [40] | Yes | Yes | Yes | Yes | Yes |
Drainoni et al. (2016) [41] | Yes | Yes | Yes | Yes | Yes |
Eboreime et al. (2018) (Mixed methods) [42] | Yes | Yes | Yes | Yes | Yes |
Gadomski et al. (2014) [43] | Yes | Yes | Yes | Yes | Yes |
Gagliardi et al. (2014) [44] | Yes | Yes | Yes | Yes | Yes |
Georgiou & Westbrook (2009) [45] | Yes | Yes | Yes | Yes | Yes |
Gibb (2013) (Mixed-methods) [46] | Yes | Yes | Yes | Yes | Yes |
Glidewell et al. (2013) [47] | Yes | Yes | Yes | Yes | Yes |
Greenhalgh et al. (2008) (Mixed methods) [48] | Yes | Yes | Yes | Yes | Yes |
Griffin et al. (2017) [49] | Yes | Yes | Yes | Yes | Yes |
Hansen et al. (2011) [8] | Yes | Yes | Yes | Yes | Yes |
Higgins et al. (2015) [50] | Yes | Yes | Yes | Yes | Yes |
Kramer et al. (2017) (Mixed methods) [28] | Yes | Yes | Yes | Yes | Yes |
Menon et al. (2014) (Mixed methods) [51] | Yes | Yes | Yes | Yes | Yes |
Murdoch (2016) [19] | Yes | Yes | Yes | Yes | Yes |
Naik et al. (2015) [52] | Yes | Yes | Yes | Yes | Yes |
Padwa et al. (2016) (Mixed-methods) [53] | Yes | Yes | Yes | Yes | Yes |
Presseau et al. (2017) [54] | Yes | Yes | Yes | Yes | Yes |
Rabbani et al. (2011) (Mixed methods) [55] | Yes | Yes | Yes | Yes | Yes |
Rotteau et al. (2015) [56] | Yes | Yes | Yes | Yes | Yes |
Smith et al. (2018) [57] | Yes | Yes | Yes | Yes | Yes |
Spitzer-Shohat et al. (2018 (Mixed methods) [58] | Yes | Yes | Yes | Yes | Yes |
VanDevanter et al. (2017) [59] | Yes | Yes | Yes | Yes | Yes |
Ware et al. (2018) [60] | Yes | Yes | Yes | Yes | Yes |
Williams et al (2016) [61] | Yes | Yes | Yes | Yes | Yes |
Yamada et al. (2018) [62] | Yes | Yes | Yes | Yes | Yes |
Yip et al. (2016) [63] | Yes | Yes | Yes | Yes | Yes |
Durbin et al. (2016) [64] | Yes | Yes | Yes | Can’t tell | Yes |
Erasmus et al. (2017) (Mixed methods) [65] | Yes | Yes | Yes | Can’t tell | Yes |
Hill et al. (2017) [66] | Yes | Yes | Yes | Can’t tell | Yes |
Iribarren et al (2015) [67] | Yes | Yes | Yes | Can’t tell | Can’t tell |
Prashanth et al. (2014) [68] | Yes | Yes | Can’t tell | Can’t tell | Can’t tell |
RodrÃguez & Peterson (2016) [69] | Yes | Can’t tell | Can’t tell | Can’t tell | Can’t tell |
Baron & Newman (2016) (Mixed methods) [70] | Yes | Can’t tell | Can’t tell | Can’t tell | Can’t tell |
Vanderkruik & McPherson (2017) [71] | Yes | Can’t tell | Can’t tell | Can’t tell | Can’t tell |
2B Quality appraisal of randomised control trials and quantitative aspects of a mixed method study | |||||
Author, Year | Randomization appropriately performed? | Are the groups comparable at baseline? | Are there complete outcome data? | Are outcome assessors blinded to the intervention? | Did participants adhere to the assigned intervention? |
Forberg et al. (2016) [72] | Yes | Yes | Yes | Can’t tell | Yes |
Chan et al. (2011) [73] | Can’t tell | Can’t tell | Yes | Can’t tell | Can’t tell |
Baron & Newman (2016) (Mixed methods) [70] | No | Yes | No | Can’t tell | Yes |
2C Quality appraisal of non-randomised control trial | |||||
Author, Year | Sample representative? | Measurements appropriate? | Complete outcome data? | Confounders accounted for? | Intervention administered (or exposure occurred) as intended? |
Abdekhoda et al. (2015) [25] | Yes | Yes | Yes | Can’t tell | Yes |
2D Quality appraisal of quantitative articles and the quantitative aspects of mixed methods studies | |||||
Author, Year | Sampling strategy relevant? | Sample representative? | Measurements appropriate? | Risk of nonresponse bias low? | Statistical analysis appropriate? |
Beenstock et al. (2012) [74] | Yes | Yes | Yes | Yes | Yes |
Cummings et al. (2010) [75] | Yes | Yes | Yes | Yes | Yes |
Glisson et al. (2008) [76] | Yes | Yes | Yes | Yes | Yes |
Guerrero et al. (2015) [77] | Yes | Yes | Yes | Yes | Yes |
Hoffman & RodrÃgrez (2015) [78] | Yes | Yes | Yes | Yes | Yes |
Lemmens et al. (2009) [79] | Yes | Yes | Yes | Yes | Yes |
Eboreime et al. (2018) (Mixed methods) [42] | Yes | N/A | Yes | N/A | N/A |
Abdekhoda et al. (2015) [25] | Yes | Yes | Yes | Can’t tell | Yes |
Almblad et al. (2018) [80] | Yes | Yes | Yes | Can’t tell | Yes |
Beidas et al. (2014) (Mixed methods) [34] | Yes | Yes | Yes | Can’t tell | Yes |
Bradley & Griffin (2016) (Mixed methods) [27] | Yes | Yes | Yes | Can’t tell | Yes |
Chiu & Ku (2015) [81] | Yes | Yes | Yes | Can’t tell | Yes |
Ehrhart et al. (2014) [82] | Yes | Yes | Yes | Can’t tell | Yes |
Erasmus et al. (2017) (Mixed methods) [65] | Yes | Yes | Yes | Can’t tell | Yes |
Huijg et al. (2014) [83] | Yes | Yes | Yes | Can’t tell | Yes |
Fernandez et al. (2018) [20] | Yes | Yes | Yes | Can’t tell | Yes |
Kramer et al. (2017) (Mixed methods) [28] | Yes | Can’t tell | Yes | Yes | Yes |
Menon et al. (2014) (Mixed methods) [51] | Yes | Yes | Yes | Can’t tell | Yes |
Obrecht et al. (2014) [84] | Yes | Yes | Yes | Can’t tell | Yes |
Rabbini et al. (2011) (Mixed methods) [55] | Yes | Yes | Yes | Can’t tell | Yes |
Spitzer-Shohat et al. (2018) (Mixed methods) [58] | Yes | Yes | Yes | Can’t tell | Yes |
Greenhalgh et al. (2008) (Mixed methods) [48] | Yes | Can’t tell | Yes | Yes | N/A |
Beidas et al. (2015) [85] | Yes | Yes | Yes | Can’t tell | Yes |
Douglas (2016) [86] | Yes | Can’t tell | Yes | No | Yes |
Padwa et al. (2016) (Mixed methods) [53] | Yes | Can’t tell | Yes | Can’t tell | Yes |
Yamada et al. (2017) [87] | Yes | Can’t tell | Yes | Can’t tell | Yes |
Gibb (2013) (Mixed methods) [46] | Can’t tell | Can’t tell | Can’t tell | Can’t tell | Can’t tell |
2E Quality appraisal of mixed-methods studies | |||||
Author, Year | Adequate rationale for using a mixed methods design? | Different components of the study effectively integrated? | Outputs of the integration of qualitative and quantitative components adequately interpreted? | Divergences and inconsistencies between quantitative and qualitative results adequately addressed? | Different components of the study adhere to the quality criteria of each tradition of the methods involved? |
Beidas et al. (2014) [34] | Yes | Yes | Yes | Yes | Yes |
Bradley & Griffin (2016) [27] | Yes | Yes | Yes | Yes | Yes |
Kramer et al. (2017) [28] | Yes | Yes | Yes | Yes | Yes |
Rabbini et al. (2011) [55] | Yes | Yes | Yes | Yes | Yes |
Spitzer-Shohat et al. (2018) [58] | Yes | Yes | Yes | Yes | Yes |
Eboreime et al. (2018) [42] | Yes | Yes | Yes | Can’t tell | Yes |
Erasmus et al. (2017) [65] | Yes | Yes | Yes | Can’t tell | Yes |
Greenhalgh et al. (2008) [48] | Yes | Yes | Yes | Can’t tell | Yes |
Menon et al. (2014) [51] | Yes | Yes | Yes | Can’t tell | Yes |
Padwa et al. (2016) [53] | Yes | Yes | Yes | Can’t tell | Yes |
Gibb (2013) [46] | Yes | Yes | Yes | Can’t tell | Can’t tell |
Baron & Newman (2016) [70] | Can’t tell | Yes | Yes | Can’t tell | Can’t tell |