Skip to main content

Table 2 Summary of Quality Appraisal

From: Defining and assessing context in healthcare implementation studies: a systematic review

2A Quality appraisal of qualitative articles and the qualitative aspects of mixed methods studies

Author, Year

Qualitative approach appropriate?

Qualitative data collection methods adequate?

Findings adequately derived from the data?

Is the interpretation of results sufficiently substantiated by data?

Coherence between qualitative data sources, collection, analysis and interpretation?

Al Shemeili et al. (2016) [31]

Yes

Yes

Yes

Yes

Yes

Arney et al. (2018) [32]

Yes

Yes

Yes

Yes

Yes

Bain et al. (2015) [33]

Yes

Yes

Yes

Yes

Yes

Beidas et al. (2014) (Mixed methods) [34]

Yes

Yes

Yes

Yes

Yes

Belaid & Ridde (2015) [35]

Yes

Yes

Yes

Yes

Yes

Bergström et al. (2012) [36]

Yes

Yes

Yes

Yes

Yes

Bocoum et al. (2017) [37]

Yes

Yes

Yes

Yes

Yes

Bokhour et al. (2015) [26]

Yes

Yes

Yes

Yes

Yes

Bradley & Griffin (2016)

(Mixed methods) [27]

Yes

Yes

Yes

Yes

Yes

Burau et al. (2018) [38]

Yes

Yes

Yes

Yes

Yes

Busetto et al. (2017) [39]

Yes

Yes

Yes

Yes

Yes

Cheyne et al. (2013) [40]

Yes

Yes

Yes

Yes

Yes

Drainoni et al. (2016) [41]

Yes

Yes

Yes

Yes

Yes

Eboreime et al. (2018)

(Mixed methods) [42]

Yes

Yes

Yes

Yes

Yes

Gadomski et al. (2014) [43]

Yes

Yes

Yes

Yes

Yes

Gagliardi et al. (2014) [44]

Yes

Yes

Yes

Yes

Yes

Georgiou & Westbrook (2009) [45]

Yes

Yes

Yes

Yes

Yes

Gibb (2013) (Mixed-methods) [46]

Yes

Yes

Yes

Yes

Yes

Glidewell et al. (2013) [47]

Yes

Yes

Yes

Yes

Yes

Greenhalgh et al. (2008)

(Mixed methods) [48]

Yes

Yes

Yes

Yes

Yes

Griffin et al. (2017) [49]

Yes

Yes

Yes

Yes

Yes

Hansen et al. (2011) [8]

Yes

Yes

Yes

Yes

Yes

Higgins et al. (2015) [50]

Yes

Yes

Yes

Yes

Yes

Kramer et al. (2017) (Mixed methods) [28]

Yes

Yes

Yes

Yes

Yes

Menon et al. (2014) (Mixed methods) [51]

Yes

Yes

Yes

Yes

Yes

Murdoch (2016) [19]

Yes

Yes

Yes

Yes

Yes

Naik et al. (2015) [52]

Yes

Yes

Yes

Yes

Yes

Padwa et al. (2016) (Mixed-methods) [53]

Yes

Yes

Yes

Yes

Yes

Presseau et al. (2017) [54]

Yes

Yes

Yes

Yes

Yes

Rabbani et al. (2011) (Mixed methods) [55]

Yes

Yes

Yes

Yes

Yes

Rotteau et al. (2015) [56]

Yes

Yes

Yes

Yes

Yes

Smith et al. (2018) [57]

Yes

Yes

Yes

Yes

Yes

Spitzer-Shohat et al. (2018

(Mixed methods) [58]

Yes

Yes

Yes

Yes

Yes

VanDevanter et al. (2017) [59]

Yes

Yes

Yes

Yes

Yes

Ware et al. (2018) [60]

Yes

Yes

Yes

Yes

Yes

Williams et al (2016) [61]

Yes

Yes

Yes

Yes

Yes

Yamada et al. (2018) [62]

Yes

Yes

Yes

Yes

Yes

Yip et al. (2016) [63]

Yes

Yes

Yes

Yes

Yes

Durbin et al. (2016) [64]

Yes

Yes

Yes

Can’t tell

Yes

Erasmus et al. (2017) (Mixed methods) [65]

Yes

Yes

Yes

Can’t tell

Yes

Hill et al. (2017) [66]

Yes

Yes

Yes

Can’t tell

Yes

Iribarren et al (2015) [67]

Yes

Yes

Yes

Can’t tell

Can’t tell

Prashanth et al. (2014) [68]

Yes

Yes

Can’t tell

Can’t tell

Can’t tell

Rodríguez & Peterson (2016) [69]

Yes

Can’t tell

Can’t tell

Can’t tell

Can’t tell

Baron & Newman (2016)

(Mixed methods) [70]

Yes

Can’t tell

Can’t tell

Can’t tell

Can’t tell

Vanderkruik & McPherson (2017) [71]

Yes

Can’t tell

Can’t tell

Can’t tell

Can’t tell

2B Quality appraisal of randomised control trials and quantitative aspects of a mixed method study

Author, Year

Randomization appropriately performed?

Are the groups comparable at baseline?

Are there complete outcome data?

Are outcome assessors blinded to the intervention?

Did participants adhere to the assigned intervention?

Forberg et al. (2016) [72]

Yes

Yes

Yes

Can’t tell

Yes

Chan et al. (2011) [73]

Can’t tell

Can’t tell

Yes

Can’t tell

Can’t tell

Baron & Newman (2016)

(Mixed methods) [70]

No

Yes

No

Can’t tell

Yes

2C Quality appraisal of non-randomised control trial

Author, Year

Sample representative?

Measurements appropriate?

Complete outcome data?

Confounders accounted for?

Intervention administered (or exposure occurred) as intended?

Abdekhoda et al. (2015) [25]

Yes

Yes

Yes

Can’t tell

Yes

2D Quality appraisal of quantitative articles and the quantitative aspects of mixed methods studies

Author, Year

Sampling strategy relevant?

Sample representative?

Measurements appropriate?

Risk of nonresponse bias low?

Statistical analysis appropriate?

Beenstock et al. (2012) [74]

Yes

Yes

Yes

Yes

Yes

Cummings et al. (2010) [75]

Yes

Yes

Yes

Yes

Yes

Glisson et al. (2008) [76]

Yes

Yes

Yes

Yes

Yes

Guerrero et al. (2015) [77]

Yes

Yes

Yes

Yes

Yes

Hoffman & Rodrígrez (2015) [78]

Yes

Yes

Yes

Yes

Yes

Lemmens et al. (2009) [79]

Yes

Yes

Yes

Yes

Yes

Eboreime et al. (2018) (Mixed methods) [42]

Yes

N/A

Yes

N/A

N/A

Abdekhoda et al. (2015) [25]

Yes

Yes

Yes

Can’t tell

Yes

Almblad et al. (2018) [80]

Yes

Yes

Yes

Can’t tell

Yes

Beidas et al. (2014) (Mixed methods) [34]

Yes

Yes

Yes

Can’t tell

Yes

Bradley & Griffin (2016) (Mixed methods) [27]

Yes

Yes

Yes

Can’t tell

Yes

Chiu & Ku (2015) [81]

Yes

Yes

Yes

Can’t tell

Yes

Ehrhart et al. (2014) [82]

Yes

Yes

Yes

Can’t tell

Yes

Erasmus et al. (2017) (Mixed methods) [65]

Yes

Yes

Yes

Can’t tell

Yes

Huijg et al. (2014) [83]

Yes

Yes

Yes

Can’t tell

Yes

Fernandez et al. (2018) [20]

Yes

Yes

Yes

Can’t tell

Yes

Kramer et al. (2017) (Mixed methods) [28]

Yes

Can’t tell

Yes

Yes

Yes

Menon et al. (2014) (Mixed methods) [51]

Yes

Yes

Yes

Can’t tell

Yes

Obrecht et al. (2014) [84]

Yes

Yes

Yes

Can’t tell

Yes

Rabbini et al. (2011) (Mixed methods) [55]

Yes

Yes

Yes

Can’t tell

Yes

Spitzer-Shohat et al. (2018)

(Mixed methods) [58]

Yes

Yes

Yes

Can’t tell

Yes

Greenhalgh et al. (2008) (Mixed methods) [48]

Yes

Can’t tell

Yes

Yes

N/A

Beidas et al. (2015) [85]

Yes

Yes

Yes

Can’t tell

Yes

Douglas (2016) [86]

Yes

Can’t tell

Yes

No

Yes

Padwa et al. (2016) (Mixed methods) [53]

Yes

Can’t tell

Yes

Can’t tell

Yes

Yamada et al. (2017) [87]

Yes

Can’t tell

Yes

Can’t tell

Yes

Gibb (2013)

(Mixed methods) [46]

Can’t tell

Can’t tell

Can’t tell

Can’t tell

Can’t tell

2E Quality appraisal of mixed-methods studies

Author, Year

Adequate rationale for using a mixed methods design?

Different components of the study effectively integrated?

Outputs of the integration of qualitative and quantitative components adequately interpreted?

Divergences and inconsistencies between quantitative and qualitative results adequately addressed?

Different components of the study adhere to the quality criteria of each tradition of the methods involved?

Beidas et al. (2014) [34]

Yes

Yes

Yes

Yes

Yes

Bradley & Griffin (2016) [27]

Yes

Yes

Yes

Yes

Yes

Kramer et al. (2017) [28]

Yes

Yes

Yes

Yes

Yes

Rabbini et al. (2011) [55]

Yes

Yes

Yes

Yes

Yes

Spitzer-Shohat et al. (2018) [58]

Yes

Yes

Yes

Yes

Yes

Eboreime et al. (2018) [42]

Yes

Yes

Yes

Can’t tell

Yes

Erasmus et al. (2017) [65]

Yes

Yes

Yes

Can’t tell

Yes

Greenhalgh et al. (2008) [48]

Yes

Yes

Yes

Can’t tell

Yes

Menon et al. (2014) [51]

Yes

Yes

Yes

Can’t tell

Yes

Padwa et al. (2016) [53]

Yes

Yes

Yes

Can’t tell

Yes

Gibb (2013) [46]

Yes

Yes

Yes

Can’t tell

Can’t tell

Baron & Newman (2016) [70]

Can’t tell

Yes

Yes

Can’t tell

Can’t tell