Table 4 Methodologic design employed by conjoint analyses/discrete choice experiments to elicit stakeholder preferences for mental health services

Preparatory^a work

Literature review

Dwight-Johnson et al. (2013), Dwight-Johnson et al. (2010), Ng-Mak (2018), Wymbs (2018), Townend (2000), Fach et al. (2004), Fegert et al. (2011), Okumura et al. (2012), Lee et al. (2014), Huang et al. (2014), Becker et al. (2016), Fahey et al. (2017), Zipursky et al. (2017)

Patient qualitative work

Albus et al. (2005), Bell et al. (2010), Cunningham et al. (2008), Cunningham et al. (2012), Cunningham et al. (2013), Cunningham et al. (2014), Cunningham et al. (2018), Cunningham et al. (2015), Dwight-Johnson et al. (2013), Dwight-Johnson et al. (2010), Dwight-Johnson et al. (2004), Herman et al. (2016), Ng-Mak et al. (2018), Wittink et al. (2010), Wymbs (2018), Zimmerman et al. (2013), Townend (2000), Townend et al. (2002), Fegert et al. (2011), Okumura et al. (2012), Becker et al. (2016)

Policy maker/provider qualitative work

Cunningham et al. (2017), Cunnigham et al. (2018), Becker et al. (2016)

Quantitative work

Albus et al. (2005), Cunningham et al. (2008), Cunningham et al. (2012), Cunningham et al. (2013), Cunningham et al. (2014), Cunningham et al. (2017), Cunningham et al. (2018), Dwight-Johnson et al. (2013), Dwight-Johnson et al. (2010), Ng-Mak et al. (2018), Riepe et al. (2017), Wymbs (2018), Zimmerman et al. (2013), Townend et al. (2002), Becker et al. (2016)

Not specified

Waschbusch et al. (2011), Hajime (2018)

Type of Choice

Binary

Ng-Mak et al. (2018), Zimmerman et al. (2013), Townend et al. (2002), Dwight-Johnson et al. (2004), Wittink et al. (2010), Bell et al. (2010), Dwight-Johnson et al. (2010), Fegert et al. (2011), Dwight-Johnson et al. (2013), Lee et al. (2014), Cunningham et al. (2015), Hajime (2018)

Ternary

Albus et al. (2005), Becker et al. (2016), Cunningham et al. (2008), Cunningham et al. (2012), Cunningham et al. (2013), Cunningham et al. (2014), Cunningham et al. (2017), Cunningham et al. (2018), Herman et al. (2016), Wymbs (2018), Zipursky et al. (2017), Flach et al. (2004), Wittink et al. (2010), Waschbusch et al. (2011), Okumura et al. (2012), Fahey et al. (2017)

Not specified

Townend (2000), Huang et al. (2014), Becker et al. (2016), Riepe et al. (2017)

Number of Attributes

2

Flach et al. (2004)

3

Okumura et al. (2012), Huang et al. (2014)

4

Albus et al. (2005), Becker et al. (2016), Cunningham et al. (2008), Cunningham et al. (2012), Cunningham et al. (2013), Cunningham et al. (2014), Cunningham et al. (2017), Cunningham et al. (2018), Wittink et al. (2010), Dwight-Johnson et al. (2013), Fahey et al. (2017)

5

Lee et al. (2014)

6

Ng-Mak et al. (2018), Dwight-Johnson et al. (2004), Fegert et al. (2011), Hajime (2018)

7

Dwight-Johnson et al. (2010),

8

Herman et al. (2016), Townend et al. (2002)

More than 8

Bell et al. (2010), Waschbusch et al. (2011), Cunningham et al. (2013), Cunningham et al. (2014), Cunningham et al. (2017), Cunningham et al. (2018), Cunningham et al. (2015), Flach et al. (2004), Wittink et al. (2010), Wymbs (2018), Zimmerman et al. (2013), Zipursky et al. (2017),

Not specified

Townend (2000), Becker et al. (2016), Riepe et al. (2017)

Number of choices per individual

5 or less

Cunningham et al. (2008), Cunningham et al. (2013), Fahey et al. (2017), Herman et al. (2016), Okumura et al. (2012), Townend et al. (2002), Zimmerman et al. (2013), Zipursky et al. (2017)

6–10

Albus et al. (2005), Dwight-Johnson et al. (2010), Flach et al. (2004), Fegert et al. (2011), Dwight-Johnson et al. (2013), Lee et al. (2014), Fahey et al. (2017)

11–15

Dwight-Johnson et al. (2004), Huang et al. (2014), Hajime (2018)

More than 15

Becker et al. (2016), Cunningham et al. (2008), Huang et al. (2014), Wittink et al. (2010), Bell et al. (2010), Waschbusch et al. (2011), Cunningham et al. (2012), Cunningham et al. (2017), Cunningham et al. (2015), Cunningham et al. (2018)

Not specified

Townend (2000), Riepe et al. (2017), Ng-Mak et al. (2018)

Administration of survey

Self-completed questionnaire

Albus et al. (2005), Cunningham et al. (2008), Cunningham et al. (2018), Cunningham et al. (2012), Cunningham et al. (2013), Cunningham et al. (2014), Cunningham et al. (2015), Cunningham et al. (2017), Dwight-Johnson et al. (2004), Becker et al. (2016), Herman et al. (2016), Townend (2000), Townend et al. (2002), Waschbusch et al. (2011), Zimmerman et al. (2013), Wittink et al. (2010), Bell et al. (2010), Fegert et al. (2011), Okumura et al. (2012), Huang et al. (2014), Zipursky et al. (2017), Wymbs (2018), Ng-Mak et al. (2018), Hajime (2018)

Interview administered

Fahey et al. (2017), Lee et al. (2014), Riepe et al. (2017), Dwight-Johnson et al. (2010), Dwight-Johnson et al. (2013)

Sample size

10–100

Townend (2000), Townend et al. (2002), Dwight-Johnson et al. (2004), Flach et al. (2004), Wittink et al. (2010), Dwight-Johnson et al. (2013), Riepe et al. (2017), Wymbs (2018)

101–300

Albus et al. (2005), Bell et al. (2010), Fegert et al. (2011), Waschbusch et al. (2011), Zimmermann et al. (2013), Lee et al. (2014), Huang et al. (2014), Fahey et al. (2017), Zipursky et al. (2017), Ng-Mak et al. (2018), Hajime (2018)

> 300

Cunningham et al. (2008), Dwight-Johnson et al. (2010), Okumura et al. (2012), Cunningham et al. (2012), Cunningham et al. (2013), Cunningham et al. (2014), Cunningham et al. (2015), Becker et al. (2016), Herman et al. (2016), Cunningham et al. (2017), Cunningham et al. (2018), Okumura et al. (2012)

Design Plan

Main effects only

Townend et al. (2002), Dwight-Johnson et al. (2004), Fegert et al. (2011), Lee et al. (2014)

Main effects + Interactions

Albus et al. (2005), Cunningham et al. (2008), Cunningham et al. (2012), Becker et al. (2016), Cunningham et al. (2013), Cunningham et al. (2014), Cunningham et al. (2017), Cunningham et al. (2018), Cunningham et al. (2015), Herman et al. (2016), Ng-Mak et al. (2018), Waschbusch et al. (2011), Wittink et al. (2010), Zimmerman et al. (2013), Zipursky et al. (2017), Dwight-Johnson et al. (2010), Riepe et al. (2017)

Not clearly reported in the methods but main effects only reported

Dwight-Johnson et al. (2013), Flach et al. (2004), Bell et al. (2010), Fahey et al. (2017), Wymbs (2018), Hajime (2018)

Not clearly reported in the methods and unclear in the results

Huang et al. (2014), Townend (2000)

Analytic software

Sawtooth software

Albus et al. (2005), Becker et al. (2016), Bell et al. (2010), Cunningham et al. (2008), Cunningham et al. (2012), Cunningham et al. (2013), Cunningham et al. (2014), Cunningham et al. (2015), Cunningham et al. (2017), Cunningham et al. (2018), Herman et al. (2016), Ng-Mak et al. (2018), Waschbusch et al. (2011), Zimmerman et al. (2013), Wymbs (2018)

Latent gold choice

Becker et al. (2016), Cunningham et al. (2017), Cunningham et al. (2015), Zipursky et al. (2017)

SPEED

Townend et al. (2002), Fegert et al. (2011)

SPSS

Dwight-Johnson et al. (2013), Fahey et al. (2017), Lee et al. (2014), Dwight-Johnson et al. (2004), Lee et al. (2014), Hajime (2018)

SAS

Dwight-Johnson et al. (2010), Huang et al. (2014), Ng-Mak et al. (2018), Wittink et al. (2010)

Stata

Flach et al. (2004)

Mplus

Okumura et al. (2012)

R

Okumura et al. (2012)

Atlas.ti

Ng-Mak et al. (2018)

MATLAB

Riepe et al. (2017)

Not Reported

Townend (2000)