Skip to main content

A qualitative study examining the benefits and challenges of incorporating patient-reported outcome substance use and mental health questionnaires into clinical practice to improve outcomes on the HIV care continuum



Inadequate identification and treatment of substance use (SU) and mental health (MH) disorders hinders retention in HIV care. The objective of this study was to elicit stakeholder input on integration of SU/MH screening using computer-assisted patient-reported outcomes (PROs) into clinical practice.


We conducted semi-structured interviews with HIV-positive patients who self-reported SU/MH symptoms on a computer-assisted PROs (n = 19) and HIV primary care providers (n = 11) recruited from an urban academic HIV clinic. Interviews were audio-recorded and transcribed. We iteratively developed codes and organized key themes using editing style analysis.


Two themes emerged: (1) Honest Disclosure: Some providers felt PROs might improve SU/MH disclosure; more were concerned that patients would not respond honestly if their provider saw the results. Patients were also divided, stating PROs could help overcome stigma but that it could be harder to disclose SU/MH to a computer versus a live person. (2) Added Value in the Clinical Encounter: Most providers felt PROs would fill a practice gap. Patients had concerns regarding confidentiality but indicated PROs would help providers take better care of them.


Both patients and providers indicated that PROs are potentially useful clinical tools to improve detection of SU/MH. However, patients and providers expressed conflicting viewpoints about disclosure of SU/MH using computerized PROs. Future studies implementing PROs screening interventions must assess concerns over confidentiality and honest disclosure of SU/MH to understand the effectiveness of PROs as a clinical tool. More research is also needed on patient-centered integration of the results of PROs in HIV care.

Peer Review reports


The HIV treatment continuum includes steps to achieve and maintain HIV suppression, and reduce HIV transmission. These steps include linkage to and retention in HIV care through regular HIV clinic visits, antiretroviral therapy (ART) prescription, ART adherence, and HIV RNA suppression [1,2,3]. Optimal engagement in HIV care allows people living with HIV (PLWH) to benefit from HIV therapy to improve their own clinical outcomes and to prevent the transmission of HIV to others [3]. However, retention in the United States is low, with over 50% of diagnosed persons failing to establish or remain engaged in medical care and less than 25% of all PLWH stably suppressed on ART [3].

Substance use (SU) and mental health (MH) disorders are highly prevalent among PLWH and are associated with worse HIV outcomes. The prevalence of SU among PLWH is high, reported in 10–40% of PLWH [4,5,6,7]. The lifetime prevalence of depression among PLWH has been reported as high as 45% [8] with recent depressive symptoms endorsed by 20–50% of PLWH [9,10,11,12]. Dual diagnosis is common; a large prevalence study demonstrated that 38% of PLWH had both a SU and a mood disorder [13]. SU and MH disorders among PLWH are associated with worse adherence to medication, appointment attendance, and other self-care behaviors [7, 14,15,16]. Previous studies have revealed an association between these disorders and worse retention in care [17, 18].

Furthermore, there is inadequate treatment of SU/MH among PLWH, starting with the under-recognition of these disorders. Among PLWH with SU disorders, both discussions with providers regarding SU and receipt of SU disorder treatment are low [19]. Prior research has demonstrated that effective SU/MH disorder treatment can improve HIV clinical outcomes [20,21,22,23]. However, as in general primary care, depression is under-recognized [24] and goes untreated or undertreated in many PLWH [25].

Computer-assisted interviewing may lead to increased patient disclosure and provider recognition of SU/MH disorders. Standardized screening using patient reported outcomes (PROs), defined as reports that come directly from the patient, rather than typical clinical care or chart review, increase identification of MH disorders [26]. There are many potential benefits of computer-assisted screening to increase patient reporting of SU/MH disorders. Routine use of patient reporting may enhance patient-provider communication. Furthermore, it may increase provider recognition of these problems and appropriate treatment and/or referral. Computer-assisted screening has been shown to have high acceptability in HIV clinics [27, 28]. However, potential barriers to clinical use of these screening measures include clinic space considerations, increased staff burden, and competing priorities for both patients and providers. To increase chances of success, PROs must be integrated into clinic flow in a patient- and provider-friendly manner, with high-perceived value of the information to providers [29].

The objective of this qualitative study was to assess the acceptability of using computer-assisted PROs by providers and patients in a clinic setting to facilitate identification and treatment of SU/MH disorders in HIV primary care. We were interested in learning if the perception of PROs differed by retention status. Since people who are not retained are more likely to have SU/MH issues, we were interested in whether they would be more or less likely to perceive use of PROs to identify SU/MH issues as helpful. Our long-term goal with this work is to determine if the use of computer-assisted PROs will improve outcomes along the HIV care continuum by improving engagement in care and management of SU/MH disorders.


This study was nested within the Johns Hopkins HIV Clinical Cohort (JHHCC), an observational study of individuals receiving HIV care at the Johns Hopkins HIV Clinic in Baltimore, MD. The cohort has been described in detail previously [30]. Currently, JHHCC participants are offered computer-assisted PROs questionnaires every 6 months for research purposes and the results are not conveyed to the clinical team. These questionnaires include the Alcohol Use Disorders Identification Test Alcohol Consumption questions (AUDIT-C), the Alcohol, Smoking and Substance Involvement Screening Test (ASSIST), the Personal Health Questionnaire Depression Scale (PHQ-8), and the Generalized Anxiety Disorder (GAD-7) scale. At that time, no other SU/MH screening was routinely performed in clinic. In addition to those measures, the PROs include measures of adherence to HIV therapy, quality of life, etc. (full list in Interview Guide in Additional file 1).

From January to June 2016, we conducted 11 interviews with providers and 19 interviews with HIV-positive participants (hereafter referred to as patients). Of the 30 interviews, 29 were audio-recorded and the other interview (an individual living with HIV) was documented with field notes, because the patient declined to be recorded. The study sample was recruited as follows:

Patient participants

English-speaking adult (≥ 18 years old) patients enrolled in the JHHCC, who completed a JHHCC PROs assessment from September 2013 through October 2014, and self-reported drug use, heavy alcohol use, or MH (depression or anxiety) symptoms using clinically relevant cutoffs from the screening tools were eligible for this study. This date range of PROs was selected to ensure at least 12 months of follow-up data was available to calculate retention measures. Retention status was calculated using the visit adherence measure (the proportion of kept visits/ (scheduled visits + kept visits)). Participants with a visit adherence score of less than 0.80 were considered not retained in HIV care. Medical record numbers from this roster of patients were matched with prior PROs for JHHCC participants who agreed to be contacted for other research and were subsequently sent a letter in the mail or approached to participate during a clinical encounter. We purposively sampled to obtain a mixture of patients who were retained and not retained and had SU only, MH symptoms only, or both.

Provider participants

Clinic personnel, including physicians, nurse practitioners and physician assistants, from the Johns Hopkins HIV clinic were interviewed. Clinical personnel were sent an email from the principal investigator (PI) to describe the study and opt-in to participate in the study.

Both provider and patient participants signed informed consent; patients received $15 for their participation and providers received $25. This study was approved by the Institutional Review Board at the Johns Hopkins University School of Medicine.

Study development and design

The semi-structured interview guide was developed based on our conceptual framework, which incorporates factors influencing recognition and response to SU/MH disorders among providers, engagement in SU/MH care among patients in HIV primary care, and implementation of PROs as a clinical tool. The interview guide was iteratively revised as the study progressed. Patient interviews included questions regarding how SU/MH disorders affected retention in HIV care, prior attempts to access SU/MH treatment services, and perceived benefits and harms of using computerized PROs in clinical care, and preferences regarding receipt of PROs results by their own medical provider/other members of the clinic team. Provider interviews included questions regarding perceived benefits and harms of SU/MH treatment as related to retention in HIV care, provider/clinic obligation in response to positive screening for SU/MH disorders, preferences for incorporating computer-assisted PROs administration into the clinical workflow, delivery of PROs results. We asked questions regarding additional domains collected in the PROs, including sexual risk behavior and adherence to ART, however, this analysis includes only SU/MH data. (See Additional file 1 for Interview Guides).

Semi-structured in-person interviews were conducted by a trained research assistant for patient interviews and by the PI for provider interviews. The PI conducted the clinical personnel interviews, because the PI is familiar with the clinic flow and procedures needed to probe and obtain feedback from providers. Interviews lasted 15–20 min (patients) or 20–45 min (providers). Interviews were digitally audio-recorded and transcribed verbatim. No personal identifiers were included in the transcripts.

Data analysis

Using an application of grounded theory [31], the research team identified preliminary themes while reviewing the transcripts, and used an iterative consensus process to continue to refine themes as data analysis continued. Two separate comprehensive codebooks, (patients and providers) were developed based on themes. The team determined clear and applicable code definitions through an iterative consensus process. Two coders independently coded each transcript and came to consensus on discrepancies via discussion.

We did not formally calculate inter-coder reliability, rather we used established methods for addressing differences in coding due to multiple coders by addressing all coding discrepancies and reconciling them through discussion and consensus [32, 33]. We used QSR NVivo Version 11.0 to apply codes to the transcripts and organize text segments and relevant quotes abstracted during analysis. Editing style analysis, by which the coded text is organized to develop the final themes [34]. We examined whether different themes were endorsed by individuals who were or were not retained in HIV care.



The demographic characteristics of the patient sample categorized by retention status are summarized in Table 1. The racial and gender makeup of the sample were similar to the Johns Hopkins HIV clinic population, which is about 75% African American and 34% female. Overall, 57.9% of the sample was categorized as retained in HIV care. Twelve patients had active or recent SU, 4 had only MH symptoms, and 3 had both active/recent SU and MH symptoms. Although the sample size was small, we observed more non-retained participants with positive screens for both SU and MH. Additionally, we observed a higher number of overall positive screens among non-retained participants.

Table 1 Patient Sample Characteristics

The majority of the provider sample was female (n = 8, 72.7%). The sample included an array of health professionals, including 5 physicians (45.5%), 4 nurse practitioners (36.4%), and 2 physician assistants (18.2%).

Overall, there was some ambivalence about whether the added benefit of the computer-assisted PROs was worth the added effort on the part of the patients in completing the PROs and on the part of providers in reviewing them. Two themes that emerged were: (1) Honest Disclosure and (2) Added Value in the Clinical Encounter. We present these themes with illustrative quotations below and also provide tables (Tables 2, 3, 4) with additional quotations.

Table 2 PROs and Honest Disclosure of SU/MH – Provider Viewpoints
Table 3 PROs and Honest Disclosure of SU/MH – Patient Viewpoints
Table 4 Added Value in the Clinical Encounter – Provider Viewpoints

Qualitative themes

Theme 1: PROs and honest disclosure of SU/MH

Both providers and patients had mixed views about the PROs to improve detection of SU/MH issues and as a facilitator of honest SU/MH disclosure. There were opposing views on how forthcoming patients would be when disclosing to a computer compared with disclosing to a healthcare provider. Some providers and patients expressed that patients would be less honest if the results would be conveyed to providers; however, other stated they would be more honest.

Less willing to honestly disclose SU/MH with PROs

Challenges noted by providers

Some providers worried patients would answer differently if they knew their provider would see the PROs results versus when the PROs were completed solely as a research tool. Providers suggested patients would not want to disappoint their provider, so patients would perhaps be less willing to disclose SU/MH. Other providers expressed concerns that patients may be less forthcoming if their PROs results were documented in their chart:

“I’m very much afraid their answers are going to change when they know it’s ‘part of their record’” (Physician).

One provider also indicated that the patient-provider relationship fosters a safe space where patients may feel more comfortable being honest compared to the computerized PROs setting:

“There are also people who...when they feel they can talk to their provider do talk to their provider pretty honestly when they know that they’re going to be able to a judgment free zone” (Physician Assistant).

Challenges noted by patients

Like the providers, a few patients expressed hesitation to disclose honest results due to fear of being judged both in context of PROs and standard clinical encounters. One patient expressed that this fear of judgment might even drive people away from clinic and have a negative effect on the provider-patient relationship. Interestingly, none of the not retained patients expressed fear of provider judgment as a potential barrier to disclosing SU/MH problems. One patient described this fear of judgment in the following way:

“A lot of times a lot of people [are] afraid to discuss it because then they may… then they thinking that now the doctor may have a different conception of me or view of me and start treating me differently” (Patient, Retained, MH only).

Other patients suggested SU/MH disclosure would cause their provider to be disappointed. Social desirability could impede honest disclosure:

“Certain things I wouldn’t disclose, because… I’ll feel bad to tell her that I’m drinking and missed my medication” (Patient, Retained, SU only).

More willing to honestly disclose SU/MH with PROs

Advantages noted by providers

In contrast to the aforementioned viewpoints, some providers felt that the PROs as a clinical tool would improve patients’ ability to honestly disclose SU/MH. This would be beneficial to providers, because improved detection could lead to improved management. Rather than expressing concern about decreasing honest disclosure due to social desirability, providers expressed that the PROs would mitigate these fears, leading to more forthcoming disclosure:

There is a tendency for patients to down play the things that are really stigmatized with your provider...I don’t think that I get really good substance use history and understand what’s going on until, and this is an exaggeration, but until they are at the point where they really want to stop(Physician Assistant).

Many providers cited the literature indicating patients were more likely to disclose sensitive information to a computer than in a face-to-face clinical encounter. One provider expressed that the PROs would increase honesty, because the process would give patients the space and time to formulate truthful answers:

People sometimes don’t recognize what they’re thinking until maybe they’re having a quiet moment to read questions and think about their [answer]...maybe the written or the readable word helps people be a little more honest(Nurse Practitioner).

Advantages noted by patients

Like providers, patients felt the PROs would be beneficial, because it would provide a tool to help patient alert providers to issues that patients are unlikely to disclose during their appointment:

“But if you see it on black and white… they [patients] won’t tell you, but they’ll put it on paper… [Interviewer asks why patient thinks this is] Shame. Shame. Shame” (Patient, Retained, SU only).

Some patients indicated that provider recognition of honest disclosure on the PROs would foster improved rapport between patients and providers. This patient expressed his provider would appreciate forthcoming answers on the PROs results:

“I think it would be about appreciation of honesty from the patient if my doctor was to read something and say oh wow. He was really honest about everything” (Patient, Retained, SU only).

Theme 2: Added value in the clinical encounter

As noted by many clinicians, the busy clinical setting, with full schedules and a short time allotted for appointments, sometimes left providers stressed and unable to sufficiently and consistently assess for SU/MH problems. This was compounded by the varying needs that are a patient’s priority for the visit. Some providers felt the PROs would detract from patient-centered care, because it would be something else in the visit that needed to be addressed. Several providers felt they would have a difficult time prioritizing, planning, and carrying out a response personalized to each patient’s needs and that the additional information from the PROs might make that harder. Conversely, many providers expressed that the PROs results would alleviate the burden of screening for SU/MH. The PROs were seen as a detailed and structured assessment to alert and guide the provider to address the issue. Patients did not express concern about the potentially overwhelming volume of information the PROs would provide but did think the PROs would improve the care from their HIV provider, including SU/MH treatment.

Challenges noted by providers

Generally, providers were concerned that viewing all PROs results would take too much time to process and evaluate to effectively incorporate and prioritize for a clinic encounter. This overwhelming volume of information could potentially consume the clinical encounter. As one provider noted:

“The only downside I see is ...that we might not be able to address anything or everything or necessarily know how to address everything” (Physician).

Providers generally endorsed wanting a score for the assessment along with an interpretation and recommendation for the results. Some providers suggested incorporating the assessment results into the EMR; however, they worried that including the information in the EMR would add time without improving the patient-provider relationship or medical care. A minority of providers feared this technological-based intervention had the potential to decrease patient centeredness:

“I’m worried that we spend less time doing what we should be doing, which is talking with our patients, examining them, explaining things, hearing their input, as opposed to looking through yet another series of things that I have to go through”(Physician).

Another concern that was expressed by a minority of providers was that the SU and MH history taking in the patient interview is an integral part of building the patient-provider relationship, and that providers themselves should ask SU/MH questions rather than having this part of the history conducted by a computerized PRO.

Challenges noted by patients

A minority of patients expressed that the PROs would not be valuable to them personally as a clinical tool, because they already disclosed all issues to their provider and would not change the patient-provider relationship or the interaction at medical visits. These were patients with a strong relationship with their provider:

“I don’t keep nothing from my doctor...I really don’t. You know, you keep stuff from your doctor, they can’t treat you” (Patient, Retained, SU only).

One patient who described a close patient-provider relationship subsequently noted that other patients might not be as forthcoming with their doctor; it is unclear, however, if they felt that this problem will be ameliorated with the PROs approach.

Patients expressed concern about who would view their PROs results, stating that they would need to get to know the provider before they would be comfortable having their results disclosed. Some patients also described the lack of control over who could view the PROs results once transmitted to the medical chart. As the following patient said:

“I don’t want everybody to know my business and like I said… for it to be confidential” (Patient, Not Retained, SU only).

Although patients did not explicitly state that they would complete PROs differently, talking about SU/MH evoked concerns about confidentiality and trust, whether through verbally reporting problems or on the PRO. Patients described needing a foundation of trust in order to disclose issues:

“For me to tell you about my private life and what’s going on with it, I have to like you and trust you” (Patient, Not Retained, SU only).

Advantages noted by providers

While recognizing that PROs results might affect clinic flow, other providers were less concerned about the time to review the results and expressed that the PROs would both fill a gap in the provider’s practice by improving the assessment and detection of SU/ MH disorders and save time. For example, one provider expressed how the PROs would detect SU/MH problems that the provider is currently unable to consistently and thoroughly assess:

A lot of time in the visit, you just get backed up with whatever the patient brings in for the visit like that you don’t really get to ask all those questions” (Physician).

The detailed and standardized PROs results were seen as beneficial to provider practices by improving detection of SU/MH disorders, as the following provider expressed about the depression-screening questionnaire:

I do not screen, I don’t ask these eight or ten questions... I believe, and it’s all it is a subjective belief, I believe I’m pretty good at picking up on it, but I have no proof” (Physician Assistant).

Additionally, several providers stated that knowing the severity of a patient’s issue based on the PROs results could help them prioritize what to address at the visit.

Two providers presented implementation strategies to ensure the PROs can be used to supplement and support the HIV primary care visit rather than detract from patient-centered care. One physician suggested:

What if the patient does the PROs and they get the feedback, gosh, you have high scores on depression, drug use, and low physical activity, which of these would you like to talk to your doctor about today?” (Physician).

A few providers indicated the PROs results could be seen like a lab value, to which prompt evaluative action on the part of the provider:

“The same way if you have a CT scan with an abnormal cancer and we get this information. This is important. This could be a barrier to patient’s treatment” (Physician).

Finally, in the discussion of the PROs at the study site, where they are already in use in a research capacity, one provider expressed the importance of research results that provide important information for clinical diagnoses and management and expressed frustration at not receiving the results:

“You guys do get this information every six months whether I get it or not. What do you guys do with it? [Response from interviewer: It goes into the research database]. That’s the same thing those research people do. They get stuff and they don’t tell you anything” (Physician).

Advantages noted by patients

Patients expressed the PROs could improve the patient-provider relationship by increasing the “bond” with providers. Patients felt the PROs would improve the care they received, because the results would be valuable for treatment management:

“They would go the…extra mile to help me more, to try to take another step … See, see I’m getting better, get off the drugs and stuff” (Patient, Not Retained, SU only).

Because of the perceived value for improving care, a patient was frustrated that research results were not used to improve care and stated:

“Even though we take them kind of surveys and they ask you them kind of questions. I still don’t see nowhere where they trying to assist someone who do have a problem…So why asking me? When you asking them questions, you just really being nosy because ...nothing been implemented to help people that is using that really may want to get off using” (Patient 18, Retained, MH only).

This quotation suggests that some patients complete surveys with the hope that the responses will trigger support, even if they have been told it is only for research.


In a qualitative study of providers and PLWH from an urban academic HIV clinic, stakeholders expressed optimism about the potential for computer-assisted PROs to enhance identification of SU/MH disorders. The main themes identified about the use of computerized PROs in clinical care were: 1) Honest Disclosure and 2) Added Value in the Clinical Encounter. Patients and providers had mixed views about the impact the computer-assisted PROs would have on honest disclosure. One potential benefit was increased honesty when interfacing with a computer-delivered questionnaire, as there would be less social desirability bias as compared to a provider interview [35, 36]. However, the opposing view was that the strength of the patient-provider relationship ultimately determines whether patients disclose SU/MH issues to their providers and that the computer-assisted PROs might actually decrease patient-centeredness and rapport building. Some providers expressed concern regarding impeding clinic flow due to PROs, with others stating that having the results of SU/MH assessments could actually expedite care. Prior work has shown that screening for substance use [37] and mental health [38] in a primary care setting is acceptable to patients. However, time was cited as a barrier to implementing screening and brief intervention [39], which was raised by some providers. Patients were not certain that PROs would augment the clinic visit if their provider “already knows everything” about them.

The ultimate impact of computer-assisted PROs on retention in HIV care is unclear. Prior to starting the interviews, we thought there might be different views of PROs expressed by retained and not retained patients (e.g., non-retained patients might express more concerns about confidentiality or limited usefulness of the PROs). However, patients’ views on PROs did not vary substantially by retention status. This suggests that PROs completion itself is likely not a barrier to retention, but beyond that conclusion, it is difficult to predict the effect of PROs on retention without additional research. What became clear during the study was that the integration of PROs must reinforce patient-centeredness and strong patient-provider relationships. This will foster an environment where the important work to ensure adequate follow up of a newly identified SU/MH disorder can occur.

There is long-standing interest in using PROs to improve detection of clinical issues, improve patient-provider communication, and monitor response to treatment [40], however, there is still little empiric data supporting the clinical utility of PROs [41]. The results of a qualitative study of providers in HIV clinic sites that have integrated PROs into clinical care [42] differed from ours in that those providers did not report concern that the patients might fail to disclose behavior on the PROs. At those clinics, the results are viewed by the provider but not entered into the patients’ medical records. Similar to our results, the authors noted that providers who had confidence in the strength of their relationship with the patient were less likely to find the PROs helpful. It has been previously shown that self-administration (compared with face-to-face interview) may increase the disclosure of stigmatized conditions or behaviors [43, 44]. However, providers still may not trust that patients are truthfully disclosing [45]. From the patient side, at least one patient highlighted the need for a robust rapport between patient and provider to improve detection and management of SU/MH issues. Without this foundation patients may be unwilling to disclose such issues in the clinic setting. Additional findings pertinent to our future work were that providers wanted patients to identify an issue that was pressing to them, rather than simply receiving results of all screens. Finally, providers wanted more training on managing the results of positive screens. Our work adds to the published literature by eliciting viewpoints from both patients and providers and starting to examine the impact of PROs on retention in HIV care.

The limitations of our study are that we had data from one clinic, and we were recruiting individuals who had already agreed to participate in the PROs administered through the parent cohort study; we did not have information from people who refused the PROs even as research tool. The SU/MH symptom data and subsequent retention data was collected in advance of the interview for this study and may not have accurately reflected current behavior of the PLWH in care. Finally, we did not recruit anyone who was completely disengaged from care, i.e., not attending HIV clinic, therefore our responses may not accurately reflect their concerns and viewpoints. A potential limitation of the provider interviews, given that they were conducted by the Principal Investigator, was that colleagues who knew the Principal Investigator’s line of research might not have been as forthcoming about negative perceptions about the use of PROs.


With this work, we gathered stakeholder input regarding logistical challenges of implementing SU/MH screening in a busy clinic as well as the perceived utility of screening. Additionally, we heard from patients about their experiences disclosing SU/MH in their HIV primary care appointments. Patients believed that disclosure can help the patient-provider relationship and the quality of care received, but only if it is done in the context of confidentiality and trust. Thus, how the information about SU/MH is obtained may not matter as much to the patients as the ensuing conversation, which should be empathetic, supportive, and productive. Our next steps with this work are to pilot an intervention in which patients completing the PROs can select one result they would like to address with their provider, enhancing the patient-centeredness of the screening. Simultaneously, we will work to ensure that there are resources in place to help providers have supportive conversations and make appropriate treatment decisions and/or referral plans. We will emphasize the development of sustainable systems that do not excessively increase provider burden to have the largest potential impact on retention in HIV care.



Antiretroviral therapy


Alcohol, Smoking and Substance Involvement Screening Test


Alcohol use disorders identification test


General anxiety disorder


Human immunodeficiency virus


Johns Hopkins Clinical Cohort


Mental health


Personal Health Questionnaire Depression Scale


Principal investigator


People living with HIV


Patient-reported outcomes


Substance use


  1. Gardner EM, McLees MP, Steiner JF, del Rio C, Burman WJ. The spectrum of engagement in HIV care and its relevance to test-and-treat strategies for prevention of HIV infection. Clin Infect Dis. 2011;52(6):793–800.

    Article  PubMed  PubMed Central  Google Scholar 

  2. Hall HI, Gray KM, Tang T, Li J, Shouse L, Mermin J. Retention in care of adults and adolescents living with HIV in 13 US areas. J Acquir Immune Defic Syndr. 2012;60(1):77–82.

    Article  PubMed  Google Scholar 

  3. Mugavero MJ, Amico KR, Horn T, Thompson MA. The state of engagement in HIV care in the United States: from cascade to continuum to control. Clin Infect Dis. 2013;57(8):1164–71.

    Article  PubMed  Google Scholar 

  4. Chander G, Josephs J, Fleishman JA, et al. Alcohol use among HIV-infected persons in care: results of a multi-site survey. HIV Med. 2008;9(4):196–202.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  5. Cook RL, Zhu F, Belnap BH, et al. Longitudinal trends in hazardous alcohol consumption among women with human immunodeficiency virus infection, 1995-2006. Am J Epidemiol. 2009;169(8):1025–32.

    Article  PubMed  PubMed Central  Google Scholar 

  6. Galvan FH, Bing EG, Fleishman JA, et al. The prevalence of alcohol consumption and heavy drinking among people with HIV in the United States: results from the HIV cost and services utilization study. J Stud Alcohol. 2002;63(2):179–86.

    Article  PubMed  Google Scholar 

  7. Mimiaga MJ, Reisner SL, Grasso C, et al. Substance use among HIV-infected patients engaged in primary care in the United States: findings from the center for AIDS research network of integrated clinical systems cohort. Am J Public Health. 2013;103(8):1457–67.

    Article  PubMed  PubMed Central  Google Scholar 

  8. Basu S, Chwastiak LA, Bruce RD. Clinical management of depression and anxiety in HIV-infected adults. AIDS. 2005;19(18):2057–67.

    Article  PubMed  Google Scholar 

  9. Burack JH, Barrett DC, Stall RD, Chesney MA, Ekstrand ML, Coates TJ. Depressive symptoms and CD4 lymphocyte decline among HIV-infected men. JAMA. 1993;270(21):2568–73.

    Article  PubMed  CAS  Google Scholar 

  10. Ickovics JR, Hamburger ME, Vlahov D, et al. Mortality, CD4 cell count decline, and depressive symptoms among HIV-seropositive women: longitudinal analysis from the HIV epidemiology research study. JAMA. 2001;285(11):1466–74.

    Article  PubMed  CAS  Google Scholar 

  11. Lyketsos CG, Hoover DR, Guccione M, et al. Depressive symptoms as predictors of medical outcomes in HIV infection. JAMA. 1993;270(21):2563–7.

    Article  PubMed  CAS  Google Scholar 

  12. Lyketsos CG, Hutton H, Fishman M, Schwartz J, Treisman GJ. Psychiatric morbidity on entry to an HIV primary care clinic. AIDS. 1996;10(9):1033–9.

    Article  PubMed  CAS  Google Scholar 

  13. Tegger MK, Crane HM, Tapia KA, Uldall KK, Holte SE, Kitahata MM. The effect of mental illness, substance use, and treatment for depression on the initiation of highly active antiretroviral therapy among HIV-infected individuals. AIDS Patient Care STDs. 2008;22(3):233–43.

    Article  PubMed  Google Scholar 

  14. Golin CE, Liu H, Hays RD, et al. A prospective study of predictors of adherence to combination antiretroviral medication. J Gen Intern Med. 2002;17(10):756–65.

    Article  PubMed  PubMed Central  Google Scholar 

  15. Gordillo V, del Amo J, Soriano V, Gonzalez-Lahoz J. Sociodemographic and psychological variables influencing adherence to antiretroviral therapy. AIDS. 1999;13(13):1763–9.

    Article  PubMed  CAS  Google Scholar 

  16. Mellins CA, Havens JF, McDonnell C, et al. Adherence to antiretroviral medications and medical care in HIV-infected adults diagnosed with mental and substance abuse disorders. AIDS Care. 2009;21(2):168–77.

    Article  PubMed  PubMed Central  Google Scholar 

  17. Giordano TP, Visnegarwala F, White AC Jr, et al. Patients referred to an urban HIV clinic frequently fail to establish care: factors predicting failure. AIDS Care. 2005;17(6):773–83.

    Article  PubMed  Google Scholar 

  18. Ulett KB, Willig JH, Lin HY, et al. The therapeutic implications of timely linkage and early retention in HIV care. AIDS Patient Care STDs. 2009;23(1):41–9.

    Article  PubMed  PubMed Central  Google Scholar 

  19. Korthuis PT, Josephs JS, Fleishman JA, et al. Substance abuse treatment in human immunodeficiency virus: the role of patient-provider discussions. J Subst Abus Treat. 2008;35(3):294–303.

    Article  Google Scholar 

  20. Angelino AF, Treisman GJ. Management of psychiatric disorders in patients infected with human immunodeficiency virus. Clin Infect Dis. 2001;33(6):847–56.

  21. Bruce RD, Altice FL. Clinical care of the HIV-infected drug user. Infect Dis Clin N Am. 2007;21(1):149–79. ix

    Article  Google Scholar 

  22. Horberg MA, Silverberg MJ, Hurley LB, et al. Effects of depression and selective serotonin reuptake inhibitor use on adherence to highly active antiretroviral therapy and on clinical outcomes in HIV-infected patients. J Acquir Immune Defic Syndr. 2008;47(3):384–90.

    Article  PubMed  CAS  Google Scholar 

  23. Turner BJ, Laine C, Cosler L, Hauck WW. Relationship of gender, depression, and health care delivery with antiretroviral adherence in HIV-infected drug users. J Gen Intern Med. 2003;18(4):248–57.

    Article  PubMed  PubMed Central  Google Scholar 

  24. Asch SM, Kilbourne AM, Gifford AL, et al. Underdiagnosis of deprssion in HIV. J Gen Intern Med. 2003;18(6):450–60.

    Article  PubMed  PubMed Central  Google Scholar 

  25. Weaver MR, Conover CJ, Proescholdbell RJ, Arno PS, Ang A, Ettner SL. Utilization of mental health and substance abuse care for people living with HIV/AIDS, chronic mental illness, and substance abuse disorders. J Acquir Immune Defic Syndr. 2008;47(4):449–58.

    Article  PubMed  Google Scholar 

  26. Yano EM, Chaney EF, Campbell DG, et al. Yield of practice-based depression screening in VA primary care settings. J Gen Intern Med. 2012;27(3):331–8.

    Article  PubMed  Google Scholar 

  27. Crane HM, Lober W, Webster E, et al. Routine collection of patient-reported outcomes in an HIV clinic setting: the first 100 patients. Curr HIV Res. 2007;5(1):109–18.

    Article  PubMed  CAS  Google Scholar 

  28. Crane PK, Gibbons LE, Willig JH, et al. Measuring depression levels in HIV-infected patients as part of routine clinical care using the nine-item patient health questionnaire (PHQ-9). AIDS Care. 2010;22(7):874–85.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  29. Crane H. Collecting and analyzing patient reported outcomes for comparative effectiveness research: benefits, barriers and strategies for implementing patient reported outcomes in routine clinical care: HIV as an example Heidi M. Crane, MD MPH University of Washington School of Medicine Academy Health Annual Research Meeting, June 24, 2012.

  30. Moore RD. Understanding the clinical and economic outcomes of HIV therapy: the Johns Hopkins HIV clinical practice cohort. J Acquir Immune Defic Syndr Hum Retrovirol. 1998;17(Suppl 1):S38–41. (Journal Article)

    Article  PubMed  Google Scholar 

  31. Charmaz Kathy. “Grounded theory.” in Lewis-Beck MS, Bryman A, Liao TF, & SagePublications. (2004). The Sage encyclopedia of social science research methods.

  32. Barbour RS. Checklists for improving rigour in qualitative research: a case of the tail wagging the dog? Br Med J. 2001;322(7294):1115–7.

    Article  CAS  Google Scholar 

  33. Patton M. Qualitative evaluation and research methods. 3rd ed. Newbury Park, CA: Sage; 2002.

  34. Malterud K. Qualitative research: standards, challenges, and guidelines. Lancet. 2001;358(9280):483–8.

    Article  PubMed  CAS  Google Scholar 

  35. Adebajo S, Obianwu O, Eluwa G, et al. Comparison of audio computer assisted self-interview and face-to-face interview methods in eliciting HIV-related risks among men who have sex with men and men who inject drugs in Nigeria. PLoS One. 2014;9(1):e81981.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  36. Ghanem KG, Hutton HE, Zenilman JM, Zimba R, Erbelding EJ. Audio computer assisted self interview and face to face interview modes in assessing response bias among STD clinic patients. Sex Transm Infect. 2005;81(5):421–5.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  37. Spear SE, Shedlin M, Gilberti B, Fiellin M, McNeely J. Feasibility and acceptability of an audio computer-assisted self-interview version of the alcohol, smoking and substance involvement screening test (ASSIST) in primary care patients. Subst Abus. 2016;37(2):299–305.

    Article  PubMed  PubMed Central  Google Scholar 

  38. Zimmerman M, Lush DT, Farber NJ, et al. Primary care patients' reactions to mental health screening. Int J Psychiatry Med. 1996;26(4):431–41.

    Article  PubMed  CAS  Google Scholar 

  39. Holland CL, Pringle JL, Barbetti V. Identification of physician barriers to the application of screening and brief intervention for problem alcohol and drug use. Alcohol Treat Q. 2009;27(2):174–83.

    Article  Google Scholar 

  40. Jensen RE, Rothrock NE, DeWitt EM, et al. The role of technical advances in the adoption and integration of patient-reported outcomes in clinical care. Med Care. 2015;53(2):153–9.

    Article  PubMed  PubMed Central  Google Scholar 

  41. Valderas JM, Kotzeva A, Espallargues M, et al. The impact of measuring patient-reported outcomes in clinical practice: a systematic review of the literature. Qual Life Res. 2008;17(2):179–93.

    Article  PubMed  CAS  Google Scholar 

  42. Fredericksen RJ, Tufano J, Ralston J, et al. Provider perceptions of the value of same-day, electronic patient-reported measures for use in clinical HIV care. AIDS Care. 2016;28(11):1428–33.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  43. Gnambs T, Kaspar K. Disclosure of sensitive behaviors across self-administered survey modes: a meta-analysis. Behav Res Methods. 2015;47(4):1237–59.

    Article  PubMed  Google Scholar 

  44. Lucas GM, Gratch J, King A, Morency L-P. It’s only a computer: virtual humans increase willingness to disclose. Comput Human Behav. 2014;37:94–100.

    Article  Google Scholar 

  45. Missed opportunity: National survey of primary care physicians and patients on substance abuse. Accessed 26 May 2017.

Download references


We thank the patients and providers who participated in the study. We thank Kayla Herne and Sarah Morris from the Johns Hopkins Center for AIDS Research (CFAR) for their recruitment assistance for this study.


This project was funded by K23MH105–284-03 (A.K.M.); additional support provided by the Johns Hopkins University Center for AIDS Research (P30AI094189). The funding bodies were not directly involved in the design of the study and collection, analysis, and interpretation of data and in writing the manuscript.

Availability of data and materials

The datasets generated and/or analyzed during the current study are not publicly available due to the clinic-level detail included in the interviews but are available from the corresponding author on reasonable request.

Author information

Authors and Affiliations



AKM contributed to all aspects and obtained funding for this study, designed the study, obtained IRB approval, participated in data collection and analysis and led the writing of the manuscript. SMJ and SP participated in data collection and analysis and drafting of the manuscript. JCK, RDM, GC, and KAR provided guidance on study design, analysis, and performed critical review and revisions of the manuscript. All authors provided critical contributions to this manuscript’s revisions and approved the final manuscript.

Corresponding author

Correspondence to Anne K. Monroe.

Ethics declarations

Ethics approval and consent to participate

This study was reviewed by the Johns Hopkins Medicine Institutional Review Board (IRB00079058). Both provider and patient participants signed informed consent.

Competing interests

The authors declare that they have no competing interests.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Additional file

Additional file 1:

Interview Guides. Interview guides used for patient and provider interviews. (DOCX 20 kb)

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (, which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver ( applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Monroe, A.K., Jabour, S.M., Peña, S. et al. A qualitative study examining the benefits and challenges of incorporating patient-reported outcome substance use and mental health questionnaires into clinical practice to improve outcomes on the HIV care continuum. BMC Health Serv Res 18, 419 (2018).

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: