Skip to main content

Table 6 Usability Testing Themes (with domain interaction code), Factors, and Example Veteran Quotes

From: Development of a 5As-based technology-assisted weight management intervention for veterans in primary care

Theme 1

Theme 2

Theme 3

Tool Language Elicits Emotional Response (USER-TOOL)

Users Seek Clarification When Question Purpose is Unclear (USER-CONTEXT/USER-TOOL)

Answer options & advice must be clear & health literate (USER-TOOL)

Round 1 Example Quotes

MOD: So how did you feel when you were reading this paragraph…that’s telling you to lose weight?

US-08: Well I’m getting scolded.

US-01: It’s…telling you you’re fat and these people, they’re here because they know they’re fat…And they want to lose weight.

MOD: Okay.

US-01: Could you reword it? Try not to gain weight, I would recommend that you try not to, not that you do not. It’s a little nicer, I think.

US-06: What do you think may get in the way to change your eating habits, check all that apply…Used to eating a certain way, I don’t understand the question.

MOD: What do you think it might mean?

US-08: Just to eating a certain way like (long pause) I don’t know.

US-08: Make my goals into smart goals, I’m not sure I know what that means.

MOD: Okay, all right so it’s unclear at this page what you’re supposed to do?

US-08: Right.

US-02: Now I got a question with the eating disorder…Binge eating, anorexia or bulimia. Okay maybe I binge eat…but I don’t consider it something out of control because I don’t do it all the time, I may do it once a month.

MOD: How would we make that more clear…?

US-02: I would say maybe if it’s something they do more than maybe twice a month or something, you know, put a number on it, you know...

US-05: So it’s asking me for my ID number right, your ID number or is this saying there is an ID number up here right?... So where would I have this ID number…would it be on my military card or what?

MOD: So it’s unclear kind of what the ID number is for.

US-05: Yes.

Round 2 Examples Quotes

MOD: So it says at the top “lost over 45 pounds.” What do you think about having these show up?

US-11: That’s good, it shows they’re motivated and they’re doing something positive for themselves.

US-13: I like the fact that…you have the motivation part, that’s great keep it up. I like that I really like that.

US-14: Okay, why is this (clicks on red underline).

MOD: What do you think about that information?

US-14:: I love that …it’s telling me … something I know but you see I always go for the bigger numbers because then it will motivate me even more. But I like the fact it gives you smaller increments, you know, it’s telling you to choose smaller increments and why.

MOD: Do you know why that is red and underlined?

US-09: Yes it would tell me in detail.

MOD: How do you feel about that advice?

US-04: Great. No she was very good, very good and if you’re in doubt you just tell them go ask my coach or the healthcare team where I can go get help.

MOD: So what do you think about this slide?

US-04: Well in case I didn’t know, this will help me to know…It’s informative. It will give me information I need to at least start.

  1. Abbreviations: MOD moderator; US-## = Respondent ID)