Table 2 Quality appraisal of included studies using the Effective Public Health Practice Project
From: A systematic review of the effects of advance care planning facilitators training programs
Component | Description | First author, year | |||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Alexander, 2006 [17] | Bristowe, 2014 [18] | Detering, 2014 [19] | Greenberg, 1993 [20] | Jo, 2015 [21] | Lum, 2018 [22] | Murray, 2010 [23] | Seal, 2007 [24] | Smith, 2013 [25] | Wilson, 2017 [26] | ||||||||||||
A | R | A | R | A | R | A | R | A | R | A | R | A | R | A | R | A | R | A | R | ||
A) Selection bias | Q1) Are the individuals selected to participate in the study likely to be representative of the target population? (1: Very likely; 2: Somewhat likely; 3: Not likely; 4: Can’t tell) | 2 | 2 (M) | 2 | 2 (M) | 2 | 2 (M) | 2 | 2 (M) | 2 | 2 (M) | 2 | 2 (M) | 2 | 2 (M) | 1 | 3 (W) | 2 | 2 (M) | 2 | 2 (M) |
Q2) What percentage of selected individuals agreed to participate? (1: 80–100% agreement; 2: 60–79% agreement; 3: Less than 60% agreement; 4: Not applicable; 5: Can’t tell) | 1 | 1 | 1 | 1 | 1 | 1 | 2 | 3 | 2 | 5 | |||||||||||
B) Study Design | Indicate the study design (1: RCT; 2: Controlled clinical trial; 3: Cohort analytic (two group pre + post); 4: Case-control; 5: Cohort (one group pre + post (before and after)); 6: Interrupted time series; 7: other specify; 8: Can’t tell) | 2 | 1 (S) | 5 | 2 (M) | 5 | 2 (M) | 1 | 1 (S) | 3 | 2 (M) | 6 | 2 (M) | 1 | 1 (S) | 3 | 2 (M) | 5 | 2 (M) | 5 | 2 (M) |
Was the study described as randomized? If NO, go to Component C. | N | N | N | Y | N | N | Y | N | N | N | |||||||||||
If Yes, was the method of randomization described? | N | Y | |||||||||||||||||||
If Yes, was the method appropriate? | N | Y | |||||||||||||||||||
C) Confounders | Q1) Were there important differences between groups prior to the intervention? (1: Yes; 2: No; 3: Can’t tell) | 2 | 1 (S) | 3 | 3 (W) | 1 | 3 (W) | 2 | 1 (S) | 2 | 1 (S) | 2 | 1 (S) | 2 | 1 (S) | 3 | 3 (W) | 2 | 1 (S) | 3 | 3 (W) |
Q2) If yes, indicate the percentage of relevant confounders that were controlled (either in the design (e.g. stratification, matching) or analysis)? (1:80–100% agreement; 2:60–79% agreement; 3: Less than 60% agreement; 4: Not applicable; 5: Can’t tell) | 4 | 4 | 3 | 1 | 4 | 4 | 1 | 5 | 4 | 5 | |||||||||||
D) Binding | Q1) Was (were) the outcome assessor (s) aware of the intervention or exposure status of participants? (1: Yes; 2: No, 3: Can’t tell) | 2 | 2 (M) | 3 | 3 (W) | 3 | 3 (W) | 1 | 3 (W) | 1 | 3 (W) | 1 | 3 (W) | 2 | 2 (M) | 1 | 3 (W) | 1 | 3 (W) | 1 | 3 (W) |
Q2) Were the study participants aware of the research question? (1: Yes; 2: No; 3: Can’t tell) | 3 | 3 | 3 | 3 | 1 | 1 | 3 | 1 | 1 | 1 | |||||||||||
E) Data Collection Method | Q1) Were data collection tools shown to be valid? (1: Yes; 2: No; 3: Can’t tell) | 1 | 2 (M) | 3 | 3 (W) | 3 | 3 (W) | 3 | 3 (W) | 1 | 1 (S) | 3 | 3 (W) | 1 | 1 (S) | 3 | 3 (W) | 1 | 2 (M) | 1 | 2 (M) |
Q2) Were data collection tools shown to be reliable? (1: Yes; 2: No; 3: Can’t tell) | 3 | 3 | 3 | 3 | 1 | 3 | 1 | 3 | 3 | 3 | |||||||||||
F) Withdrawals and Dropouts | Q1) Were withdrawals and drop-outs reported in terms of numbers and/or reasons per group? (1: Yes; 2: No; 3: Can’t tell; 4: Not applicable) | 1 | 1 (S) | 3 | 3 (W) | 1 | 1 (S) | 2 | 1 (S) | 1 | 1 (S) | 1 | 2 (M) | 1 | 1 (S) | 2 | 3 (W) | 1 | 1 (S) | 3 | 3 (W) |
Q2) Indicate the percentage of participants completing the study. (If the percentage differs by groups, record the lowest). (1:80–100%; 2:60–79%; 3: Less than 60%; 4: Can’t tell; 5: Not applicable) | 1 | 4 | 1 | 1 | 1 | 2 | 1 | 3 | 1 | 1 | |||||||||||
G) Intervention Integrity | Q1) What percentage of participants received the allocated intervention or exposure of interest? (1:80–100%; 2:60–79%; 3: Less than 60%; 4: Can’t tell) | 1 | 1 | 1 | 1 | 1 | 1 | 1 | 3 | 1 | 1 | ||||||||||
Q2) Was the consistency of the intervention measured? (1: Yes; 2: No; 3: Can’t tell) | 3 | 3 | 3 | 3 | 1 | 3 | 2 | 3 | 3 | 3 | |||||||||||
Q3) Is it likely that subjects received an unintended intervention (contamination or co-intervention) that may influence the results? (1: Yes; 2: No; 3: Can’t tell) | 3 | 3 | 3 | 3 | 3 | 3 | 3 | 3 | 3 | 3 | |||||||||||
H) Analysis | Q1) Indicate the unit of allocation (Community OR Organisation/institution OR Practice/office OR individual) | Ind | Ind | Ind | Ind | H | Ins | Ind | Wa | Ind | Ind | ||||||||||
Q2) Indicate the unit of analysis (Community OR Organisation/institution OR Practice/office OR individual) | Ind | Ind | Ind | Ind | Ind | Ind | Ind | Ind | Ind | Ind | |||||||||||
Q3) Are the statistical methods appropriate for the study design? (1: Yes; 2: No; 3: Can’t tell) | 1 | 1 | 1 | 1 | 1 | 3 | 1 | 1 | 1 | 1 | |||||||||||
Q4) Is the analysis performed by intervention allocation status (i.e. intention to treat) rather than the actual intervention received? (1: Yes; 2: No; 3: Can’t tell) | 2 | 1 | 1 | 2 | 2 | 2 | 2 | 2 | 2 | 3 | |||||||||||
Global rating | 1 (S) | 3 (W) | 3 (W) | 3 (W) | 2 (M) | 3 (W) | 1 (S) | 3 (W) | 2 (M) | 3 (W) | |||||||||||