Skip to main content
Download PDF

Definition of a core set of quality indicators for the assessment of HIV/AIDS clinical care: a systematic review

BMC Health Services Research volume 13, Article number: 236 (2013) Cite this article

Abstract

Background

Several organizations and individual authors have been proposing quality indicators for the assessment of clinical care in HIV/AIDS patients. Nevertheless, the definition of a consensual core set of indicators remains controversial and its practical use is largely limited. This study aims not only to identify and characterize these indicators through a systematic literature review but also to propose a parsimonious model based on those most used.

Methods

MEDLINE, SCOPUS, Cochrane databases and ISI Web of Knowledge, as well as official websites of organizations dealing with HIV/AIDS care, were searched for articles and information proposing HIV/AIDS clinical care quality indicators. The ones that are on patient’s perspective and based on services set were excluded. Data extraction, using a predefined data sheet based on Cochrane recommendations, was done by one of the authors while a second author rechecked the extracted data for any inconsistency.

Results

A total of 360 articles were identified in our search query but only 12 of them met the inclusion criteria. We also identified one relevant site. Overall, we identified 65 quality indicators for HIV/AIDS clinical care distributed as following: outcome (n=15) and process-related (n=50) indicators; generic (n=36) and HIV/AIDS disease-specific (n=29) indicators; baseline examinations (n=19), screening (n=9), immunization (n=4), prophylaxis (n=5), HIV monitoring (n=16), and therapy (=12) indicators.

Conclusions

There are several studies that set up HIV clinical care indicators, with only a part of them useful to assess the HIV clinical care. More importantly, HIV/AIDS clinical care indicators need to be valid, reliable and most of all feasible.

Peer Review reports

Background

Quality performance or quality of clinical care is the main subject in the health care system and it can be precisely defined. Many studies have been made on this subject [1–3]. The Institute of Medicine defined Quality of care as the degree to which health services for individuals and populations increase the likelihood of desired health outcomes and are consistent with current professional knowledge [3, 4]. This assessment can be made by measures that can give us the degree of quality of care. Indicators are defined as a measurement tool that can be used to monitor and evaluate the quality of important governance, management, clinical, and supported functions [5]. They provide a quantitative basis for clinicians, organizations, and planners aiming to achieve improvement in care and in the processes by which patient care is provided [6]. Donabedian and Fleming related indicators to structure, process and outcome [7]. Process indicators assess what the provider did to the patient and if it was well done; it measures the activities and tasks in patient episodes of care. Outcome indicators measure the state of health or events that follow care and that may be affected by health care. In general, either process or outcome may be valid measures of quality. For an outcome to be considered a valid measure of quality, it must be closely related to processes of care that can be manipulated to affect the outcome. Likewise, for a process to be a valid measure of quality, it must be closely related to an outcome that people care about [4]. In many cases, there are multiple factors that contribute to a patient’s survival and health outcome. In those cases, it is useful that outcome measures are adjusted for factors like psychosocial characteristics, lifestyle factors and severity of the illness, if we want to make fair comparisons. Risk adjustment is useful to control confounding factors that might contribute to the outcome indicator [8].

Quality indicator – development and validation methods

Mainz says that for developing evidence-based clinical indicators, it is necessary to follow certain steps, namely choosing the clinical area to evaluate, organizing the measurement team, providing an overview of existing evidence and practice, selecting clinical indicators and standards, designing measure specification, and performing a pilot test [8].

The pilot test aims to identify areas that require further specifications of the quality measures. The validation process determines the degree to which an indicator measure, what is intended to measure, that is, whether the results of measurement corresponds to the true state of the phenomenon being measured [8], Figure 1.

Figure 1
figure 1

Flow diagram for the search and selection of studies for the systematic review.

Full size image

Quality indicators - key characteristics

For each quality indicator it is important to verify if it meets quality requirements such as validity, reliability, relevance and applicability, based evidence [9, 10], and the flexibility of obtaining the indicator data [8]. The Agency for Healthcare Research and Quality (AHRQ) uses the following methods for identifying, selecting, and evaluating the quality of the Inpatient Quality Indicators: face validity, precision, minimum bias, construct validity, fosters real quality improvement, and application, mostly for determining the reliability and validity of a quality indicator [11].

The assessment of the quality of care given to HIV/AIDS patients has been a major focus of the HIV/AIDS disease issue since 1990. Agins et al. [12] proposed a model of indicators which assesses clinical care based on tuberculosis (TB) screening, prophylactic therapy and pneumocystis prophylaxis. Mallor et al. [13] proposed a model which assesses the clinical care based on CD4+ count, viral load, as a marker of the evolution of the patient; while Badri and Wood [14] suggested the usefulness of total lymphocyte count in monitoring highly active antiretroviral therapy in resource-limited settings. The New York State Department of Health AIDS Institute [15] uses five indicators to evaluate the quality of clinical care provided to patients with HIV / AIDS, namely: (a) Management of Antiretroviral (ARV) Therapy, (b) Viral Load Monitoring, (c) HIV Intrapartum Prophylaxis, (d) Tuberculosis Screening, and (e) Pelvic Examination. So, we may find different types of indicators used to assess the quality of clinical care given to HIV/AIDS patients.

In this study we performed a systematic review to identify the current existing quality indicators, evidence-based, used for monitoring and evaluating HIV/AIDS impatient and outpatient clinical care, and, based on the clinical relevance and practice utility, we propose a core set of indicators, through observational studies.

Methods

Data source

A systematic review (SR) of observational studies on HIV/AIDS quality indicators for clinical care and its development and validation methods, using electronic databases such as MEDLINE (1966–2012 through PubMed), SCOPUS (2004–2012), Cochrane Collaboration database (CENTRAL) (1980–2012) and ISI Web of knowledge ( −2012), without limitations of language. Additional studies were identified by searching reference-lists of articles and on the official institutions sites that work with HIV/AIDS quality indicators.

Search terms

We used the following search terms and Medical Subject Headings (MeSH) to search observational studies: “observational studies”, “quality indicators”, “validation studies”, “HIV/AIDS”. We developed a search query for each database, and one of the 3 search-queries we set up down can be seen in Table 1. At first, we found all sub heading terms of observational studies and summarized the results. We selected only studies that were carried out on human and excluded those related to animals. After that, we looked for quality indicators and HIV/AIDS studies. This search strategy was based on Cochrane Review recommendations [16].

Table 1 MEDLINE search query
Full size table

Inclusion and exclusion criteria

In this SR we included the primary studies that had met the following criteria, (i) talk about HIV/AIDS clinical care quality indicators, and (ii) set up a conceptual model of quality indicators for HIV/AIDS in clinical care context, or (iii) describe or validate HIV/AIDS clinical care quality indicators.

We excluded studies that (i) are based only on services set, (ii) are based on patient perspective or (iii) did not provide sufficient details in methods and results sections, thus failing to answer research questions.

Study selection

Eligibility assessment was performed independently by 2 reviewers based on inclusion criteria, and disagreements between reviewers were solved by consensus.

Data collection processes

We developed a data extraction sheet adapted to observational studies (based on Cochrane Consumers and Communication review Group’s data extraction template), we pilot-tested it on 2 included studies, and refined it accordingly. One reviewer extracted the following data from included studies and the second checked the extracted data: first author, year, publication country and study design, objective, number of clinical indicators and selection criteria. For each indicator: name, type (process or outcome), quality (generic or specific) selection and validation criteria. Disagreements were solved by discussion between the two reviewers. If no agreement could be reached, a third author was planned but it was not necessary. We did not contact any authors for further information.

Data analysis

For each quality indicator of HIV clinical care some parameters were determined. Similar indicators were grouped together. We classified indicators according to the dimension of quality of care as process (referred to the actions of healthcare providers, such as measuring or screening), or outcome (the results actions of healthcare providers, for instance, non-detectable viral load at 48 treatment week) indicators as described by Donabedian [7]. We also figured out if the American [17] and European [18] guidelines endorsed each indicator. The core set of HIV clinical care indicators was defined by the ones that were simultaneously used in at least two studies and were endorsed by both guidelines.

Results

Study selection

The search of MEDLINE, Cochrane, Scopus and ISI web knowledge provided a total of 360 citations. After adjusting for duplicates 343 remained. Of these, 329 studies were discarded after revision as the papers clearly did not met the inclusion criteria. One study, Bennet (1996) [19] was discarded because the full text of the study was not available. The full texts of the remaining 31 citations were examined in more detail. Of those, 22 were excluded for being based on services set (20) and on patient perspective (2). The remaining 9 studies met the inclusion criteria and were included in the systematic review (SR). Two other studies were added to the SR from the reference list. No unpublished relevant studies were obtained. Two papers [20, 21] are from the same author and on the same subject and, for that reason, we considered them as one study. As a result, 12 different studies were included for review. The flow diagram for the study selection can be seen in Figure 1.

Web HIV/AIDS quality indicators search

On the internet, we looked for official sites and only one met the inclusion criteria, namely the Indicator Registry [22] owned by the World Health Organization through United Nations General Assembly Special Session on HIV/AIDS (UNGASS) and other agencies (World Health Organization, UNICEF, the Global Fund to Fight AIDS, Tuberculosis and Malaria, the U.S. President’s Emergency Plan for AIDS Relief, and the UNAIDS Secretariat and guided by the MERG that sets standards for indicators and their use). This registry is a central repository of information on indicators used to track the AIDS epidemic and the national, regional and global response, with 184 indicators.

Studies characteristics

This systematic review covers a range of 23 years between the first and the last study, published in 2012. Nine studies represent experiences made in the USA [20–28], one in Ethiopia [29], one in Spain [30], one in Thailand [31], and other in Malawi [32]. According to the study design, four are projects that aimed to develop HIV quality indicators [22, 23, 27, 30], three are cross-sectional studies that aimed to assess the clinical care given to HIV/AIDS patients [24, 26, 29], one is a retrospective cohort [20, 21], one is a program evaluation[31], and one is an observational cohort [28]. All studies aimed to assess the quality of a HIV care program, and the last one presents a conceptual model [32] aimed to discuss the validity of indicators within routine programs and their predictive value for ART care. Several indicators were proposed by experts through a panel, and others were taken from guidelines (see Table 2).

Table 2 Description of studies by author, year, country, study design, objective, number of clinical care indicators and selection criteria
Full size table

Quality indicators

From the 12 studies, 65 HIV clinical care quality indicators related to process and outcome were retrieved. From these 65 indicators, 29 are HIV/AIDS-specific and 36 are generic indicators; 15 are related to outcome and 50 to process indicators. These indicators cover the following clinical care areas: Baseline evaluation (19), screening for opportunistic diseases and STD (9), immunization (4), prophylaxis (5), HIV monitoring (16), and therapy (12). The boundaries of these clinical areas are not very well delimitated, and therefore some indicators could be easily changed from one to another area (Table 3).

Table 3 Quality indicators for the assessment of HIV/AIDS clinical care by name, type, indicators, and selection criteria
Full size table

HIV/AIDS quality indicators applicability

We analyzed the HIV/AIDS quality indicators studies and found that some of the HIV clinical indicators pertain to assessing the availability of laboratory facilities [20, 21, 29], HIV clinical care [25, 27–29], and quality of care, looking for a symptom-based framework [24] or for determining whether a selected set of indicators can represent a single overall quality construct [26, 32] or mortality risk adjustment approach, according to institutional performance [20].

Selection and validation methods

All studies refer the use of literature review for searching HIV/AIDS quality indicators. Some were based on national guidelines for the treatment of patients with HIV/AIDS [26, 29, 31], or on expert HIV clinician panels to identify specific processes of care that a clinician would be expected to perform for HIV patients presenting particular symptoms [23, 24]. In one study [20, 21] there is no clear description of the methods used to select the quality indicators.

In the validation phase of three studies, the proposed indicators were revised after discussion by physicians who were working on an HIV/AIDS control program as well as HIV care-providing facilities, for their local relevance and retained only the indicators where consensus was achieved [22, 27–29, 31]. In other six studies there was no reference to validation. The main characteristic of all studies is the quality of care assessment and not the approach to the validity of HIV/AIDS quality indicators.

From the internet search, we identified one official site that has a core set of HIV/AIDS indicators, and we retrieved 22 indicators that met our inclusion criteria. For each indicator we read the definition and what it measures, the data type, and the indicator type level to find out the ones we could use to assess hospital care. Nine quality indicators can be used to assess HIV/AIDS clinical care. Five are related to co-management of HIV and TB, two are related to the care of pregnant woman, and two are related to HIV care itself. Six are process related and 3 are outcome indicators.

To answer the question, “What core indicators are useful to assess HIV clinical care?”, we made a selection process through observation of indicators that are used in more than one study, are not the same or do not assess the same situation, and are endorsed by both American and European guidelines; for the treatment of HIV we found 21 HIV/AIDS quality indicators that can be used to assess the clinical care (Table 4).

Table 4 Core indicators proposed for the assessment of the quality of HIV/AIDS clinical care
Full size table

Discussion

In this review we wanted to find out what HIV/AIDS quality indicators are used to assess clinical care, their development and validation methods. We found few studies. Most of them are process or outcome indicators and, as Mainz defined, “process denotes what is actually done in giving and receiving care and outcomes measures attempt to describe the effects of care on the patients’ health status and populations” [10]. So, through this review, we have an overview of the most relevant aspects that we have to look at when assessing HIV clinical care. The methods used (guidelines and expert panels) to select them are according to what is described in the literature [8, 9, 33], nevertheless, little information has been given about their validation methods.

We found 50 process indicators that assess different aspects of HIV/AIDS hospital care. Wollersheim et al. [9] say that there is some conflict between the number of indicators selected and the amount of work which must be spent on recording data. They argue that to achieve a good balance, it is recommended to select about 12 clinical indicators for care process.

Attempting to establish the core set of indicators useful to assess HIV/AIDS clinical care, we compared the quality indicators we got with the American and European guidelines. For some indicators, there is no doubt about their relevance, they are in both guidelines and in more than one study, for instance, CD4 count cell, viral load; for others, the difference is that they are only in one guideline, but this doesn’t make them less important. Indicators like syphilis or gonorrhea screening are also very important even though they are not endorsed by the American guideline. The fact of the matter is that there are specific guidelines for each aspect of HIV care. Another important aspect in this comparison between indicators studies and guidelines is that there are some indicators that are in both guidelines, but are only mentioned by one study. For instance, knowing the “Proportion of patients eligible for ART who are currently on ART” is as important as knowing if they have prescribed appropriate ART. Defining a core set of indicators is a hard task.

In Table 4, we have the core set of indicators we think that can be used to approach HIV/AIDS clinical care. Some specific HIV clinical care indicators used are: CD4 cell count, viral load test, non-detectable HIV viral load at 48 treatment weeks, Hepatitis C screening, Hepatitis B testing, Tuberculosis screening, Hepatitis B vaccination, PCP (pneumocystis jiroveci pneumonia) prophylaxis, adherence to ART, appropriately prescribed ART, and HIV-TB co-treatment. All these measures are considered to be critical elements in the clinical care of individuals with HIV/AIDS [25], and they have clinical utility because they are endorsed by guidelines [17, 18]. In the core of indicators that we propose, only 3 of the 23 are outcome indicators. Although it is desirable to obtain outcome indicators it is not always possible, due to: firstly, there are many processes that compete for the same outcome [34]; secondly, due to the time needed to obtain the desired result, surrogate measures are used; thirdly, data limits often dictate the extent of the measures that can be established or are not suitable to every HIV-infected patient. Unless a measure addresses potential pitfalls adequately, the results produced from the measure may be misleading rather than helpful [35].

Some indicators are obtained from a set of steps which includes more than one data element, or are influenced by many factors, such as age or gender (adjustment measures). One of the challenges hospitals face nowadays is the quality of the data they collect [36–38]. Some variables can have missing values, can be biased (for instance, because of their main purpose), or may not be possible to collect, and so adjustments can be difficult. Nevertheless the dissemination of indicators throughout regions and hospitals should help them to understand the key elements of HIV/AIDS care that will be under scrutiny, and thereby encourage hospitals to implement data management systems that facilitate measurement of their HIV/AIDS care process and patient outcomes.

When we analyze the validity of the quality indicators, a common characteristic is that most of the studies assess the quality of care, only one is about the validity of the quality indicator itself. So for each indicator, it is necessary to analyze it in order to find out its reliability, relevance and applicability.

Indicators included in the WHO Indicator and Measurement Registry are set up “on a national basis”; some of them can be applied at a local level, but few of them are to assess the quality of HIV clinical care. These indicators are well defined and are ready to be used by everyone as they are valid and reliable.

Future works

Many institutions have been using HIV/AIDS quality indicators to assess the quality of clinical care and make a benchmarking between caregivers. The results seem to be good, and improvement of care has been achieved [25, 26].

Quality care indicators or clinical care indicators are used in many situations, as the ones described next. (1) To improve the quality of care, for instance Asch at al. [24], used a symptom-based framework and their results suggested that symptom-based measures of quality may measure domains that are distinct from those captured by conventional indicators. The matter is that nowadays, when using TARV, many symptoms are more scarce unless people are run out of the healthcare system. While Thanprasertsuk et al. [31] used the quality indicator to improve the quality of care, they compared one setting before and after using quality indicators, and the improvement of quality of clinical care rose from 0 to 95% of accomplishment. (2) To figure out if the system is delivering clinical care, according to the guidelines. Here we noted that Alemayehu et al. [29], focused their work on assessing the accomplishment of the guidelines through process and outcome measures. They pointed out the need for regular monitoring and improvement of processes and outcomes of care in order to achieve good results. (3) To compare institutions or services (benchmarking). Wilson et al. [26], looked through 69 sites from 30 states to determine whether a selected set of indicators can represent a single overall quality construct. The main result of this study was that it is necessary to define a core set of indicators in order to compare sites fairly.

The next step is to test the measures in real data, to find out the reliability of each indicator and to validate a set core of quality indicators that can be used to assess HIV clinical care and may be used to compare services, hospitals or even countries.

This review had several limitations. Although we found few studies, we made a wide search on the web using multiple terms and databases. Search in gray literature was limited. Studies in languages other than English were not included. Anyway, as far as we know, there is no other published systematic review about HIV/AIDS quality indicators for clinical care assessment, and we summarized here a vast and wide set of information. The fact of the matter is that we include experiences from USA, Ethiopia, Malawi, Spain and Thailand, and a core of organizations that work on the HIV/AIDS field under the WHO umbrella.

Conclusions

We wanted to identify a core set of indicators that represent optimal care and that will facilitate uniform measurement and benchmarking of the quality of HIV/AIDS clinical care at a local level, and can lead to the establishment of comparative reporting between developed and developing countries.

The main findings of this systematic review are that there are efforts from the USA and Spain to establish a national core set of indicators useful to assess the HIV/AIDS clinical care; the assessment of HIV/AIDS clinical care must take into account the main aspects of baseline assessment, screening, immunization, prophylaxis, HIV monitoring, and therapy. Most of the indicators are process-related, are intended to guide (the good practice) and to evaluate the clinical care provided to HIV/AIDS patients.

References

  1. Fontela PS, Pant Pai N, Schiller I, Dendukuri N, Ramsay A, Pai M: Quality and Reporting of Diagnostic Accuracy Studies in TB, HIV and Malaria: Evaluation Using QUADAS and STARD Standards. PLoS One. 2009, 4 (11): e7753-10.1371/journal.pone.0007753.

    Article  PubMed  PubMed Central  Google Scholar 

  2. De Vos M, Graafmans W, Kooistra M, Meijboom B, Van Der Voort P, Westert G: Using quality indicators to improve hospital care: a review of the literature. Int J Qual Health Care. 2009, 21 (2): 119-129. 10.1093/intqhc/mzn059.

    Article  PubMed  Google Scholar 

  3. Hongoro C, McPake B, Vickerman P: Measuring the quality of hospital tuberculosis services: a prospective study in four Zimbabwe hospitals. Int J Qual Health Care. 2005, 17 (4): 287-292. 10.1093/intqhc/mzi040.

    Article  PubMed  Google Scholar 

  4. Donaldson MS: Measuring the quality of health care. 1999, Washington, DC: National Academy Press, 3.

    Google Scholar 

  5. Klazinga N, Stronks K, Delnoij D, Verhoeff A: Indicators without a cause. Reflections on the development and use of indicators in health care from a public health perspective. Int J Qual Health Care. 2001, 13 (6): 433-438. 10.1093/intqhc/13.6.433.

    Article  CAS  PubMed  Google Scholar 

  6. Althabe F, Bergel E, Cafferata ML, Gibbons L, Ciapponi A, Alemán A, Colantonio L, Palacios AR: Strategies for improving the quality of health care in maternal and child health in low- and middle-income countries: an overview of systematic reviews. Paediatr Perinat Epidemiol. 2008, 22 (s1): 42-60. 10.1111/j.1365-3016.2007.00912.x.

    Article  PubMed  Google Scholar 

  7. Donabedian A: The Quality of Care. JAMA. 1988, 260 (12): 1743-1748. 10.1001/jama.1988.03410120089033.

    Article  CAS  PubMed  Google Scholar 

  8. Mainz J: Developing evidence-based clinical indicators: a state of the art methods primer. Int J Qual Health Care. 2003, 15 (1): i5-11. 10.1093/intqhc/15.1.5.

    Article  PubMed  Google Scholar 

  9. Wollersheim H, Hermens R, Hulscher M, Braspenning J, Ouwens M, Schouten J, Marres H, Dijkstra R, Grol R: Clinical indicators: development and applications. Neth J Med. 2007, 65 (1): 15-22.

    CAS  PubMed  Google Scholar 

  10. Mainz J: Defining and classifying clinical indicators for quality improvement. Int J Qual Health Care. 2003, 15 (6): 523-530. 10.1093/intqhc/mzg081.

    Article  PubMed  Google Scholar 

  11. Guide to Inpatient Quality Indicators:Quality of Care in Hospitals – Volume, Mortality, and Utilization. 2007, AHRQ Quality Indicators

  12. Agins BD, Young MT, Keyes CW, Ellis WC: Selection and Transformation of Clinical Practice Guidelines into Review Algorithms for Evaluating the Quality of HIV Care in New York State. Clin Perform Qual Health Care. 1994, 2 (4): 209-213.

    Google Scholar 

  13. Mellors JW, Munoz A, Giorgi JV, Margolick JB, Tassoni CJ, Gupta P, Kingsley LA, Todd JA, Saah AJ, Detels R, et al: Plasma viral load and CD4+ lymphocytes as prognostic markers of HIV-1 infection. Ann Intern Med. 1997, 126 (12): 946-954. 10.7326/0003-4819-126-12-199706150-00003.

    Article  CAS  PubMed  Google Scholar 

  14. Badri M, Wood R: Usefulness of total lymphocyte count in monitoring highly active antiretroviral therapy in resource-limited settings. AIDS. 2003, 17 (4): 541-545. 10.1097/00002030-200303070-00009.

    Article  PubMed  Google Scholar 

  15. New York State Department of Health: Clinical management of HIV infection; quality of care performance in New York State 1999-2001. 2003, http://www.hivguidelines.org/wp-content/uploads/2009/06/perf-data-release.pdf.

    Google Scholar 

  16. Higgins JPT, Green S: Cochrane Handbook for Systematic Reviews of Interventions. 2011. Version 510 [updated March 2011]. The Cochrane Collaboration, 2011. 2011, Available from http://handbook.cochrane.org/, accessed 03.04.2012

    Google Scholar 

  17. Panel on Antiretroviral Guidelines for Adults and Adolescents: Guidelines for the use of antiretroviral agents in HIV-1-infected adults and adolescents. 2012, USA: Department of Health and Human Services, Available at http://aidsinfo.nih.gov/contentfiles/lvguidelines/adultandadolescentgl.pdf

    Google Scholar 

  18. European AIDS Clinical Society (EACS): EACS Guidelines, Version 6 - October 2011. 2011, Available at from http://www.europeanaidsclinicalsociety.org/images/stories/EACS-Pdf/EACSGuidelines-v6.0-English.pdf

    Google Scholar 

  19. Bennett CL, Ullman M, Dickinson GM, Horner RD, Feinglass J, Curtis JR: Patterns of care for HIV-related Pneumocystis carinii pneumonia in a university medical program: a case study. Clinical performance and quality health care. 1996, Chicago, 186-189.

    Google Scholar 

  20. Mathews WC, Ferdon E, Bennett C, Kanouse D: Evaluating institutional performance in AIDS-associated Pneumocystis carinii pneumonia: a risk adjustment approach. J Clin Epidemiol. 1989, 42 (5): 421-425. 10.1016/0895-4356(89)90131-5.

    Article  CAS  PubMed  Google Scholar 

  21. Mathews WC, Kanouse DE: Treatment adequacy for HIV-related pneumocystis pneumonia: quality measures for inpatient care. Int J Qual Health Care. 1997, 9 (5): 349-359. 10.1093/intqhc/9.5.349.

    Article  CAS  PubMed  Google Scholar 

  22. UNAIDS Indicator Registry. http://www.indicatorregistry.org/.

  23. Wu AW, Gifford A, Asch S, Cohn SE, Bozzette SA, Yurk R: Quality-of-Care Indicators for HIV/AIDS. Dis Manag Health Out. 2000, 7 (6): 315-330. 10.2165/00115677-200007060-00003.

    Article  CAS  Google Scholar 

  24. Asch SM, Fremont AM, Turner BJ, Gifford A, McCutchan JA, Mathews WMC, Bozzette SA, Shapiro MF: Symptom-based framework for assessing quality of HIV care. Int J Qual Health Care. 2004, 16 (1): 41-50. 10.1093/intqhc/mzh004.

    Article  PubMed  Google Scholar 

  25. Solomon L, Flynn C, Lavetsky G: Managed care for AIDS patients: is bigger better?. JAIDS J Acquir Immune Defic Syndr. 2005, 38 (3): 342-347.

    PubMed  Google Scholar 

  26. Wilson IB, Landon BE, Marsden PV, Hirschhorn LR, McInnes K, Ding L, Cleary PD: Correlations among measures of quality in HIV care in the United States: cross sectional study. Br Med J. 2007, 335 (7629): 1085-1088. 10.1136/bmj.39364.520278.55.

    Article  Google Scholar 

  27. Horberg MA, Aberg JA, Cheever LW, Renner P, O’Brien Kaleba E, Asch SM: Development of national and multiagency HIV care quality measures. Clin Infect Dis. 2010, 51 (6): 732-738. 10.1086/655893.

    Article  PubMed  Google Scholar 

  28. Korthuis PT, Fiellin DA, Fu RW, Lum PJ, Altice FL, Sohler N, Tozzi MJ, Asch SM, Botsko M, Fishl M, et al: Improving adherence to HIV quality of care indicators in persons with opioid dependence: the role of buprenorphine. Jaids-J Acquir Immune Defic Syndr. 2011, 56: S83-S90.

    Article  CAS  Google Scholar 

  29. Alemayehu YK, Bushen OY, Muluneh AT: Evaluation of HIV/AIDS clinical care quality: the case of a referral hospital in North West Ethiopia. Int J Qual Health Care. 2009, 21 (5): 356-362. 10.1093/intqhc/mzp030.

    Article  PubMed  PubMed Central  Google Scholar 

  30. von Wichmann MA, Locutura J, Blanco JR, Riera M, Suarez-Lozano I, Saura RM, Vallejo P: [GESIDA quality care indicators for the care of persons infected by HIV/AIDS]. Enferm Infecc Microbiol Clin. 2010, 28 (Suppl 5): 6-88.

    Article  PubMed  Google Scholar 

  31. Thanprasertsuk S, Supawitkul S, Lolekha R, Ningsanond P, Agins BD, Mcconnell MS, Fox KK, Srisongsom S, Chunwimaleung S, Gass R, et al: HIVQUAL-T: monitoring and improving HIV clinical care in Thailand, 2002–08. Int J Qual Health Care. 2012, 24 (4): 338-347. 10.1093/intqhc/mzs008.

    Article  PubMed  Google Scholar 

  32. Hoskins S, Weller I, Jahn A, Kaleebu P, Malyuta R, Kirungi W, Fakoya A, Porter K: An appraisal of indicators used to monitor the treated population in antiretroviral programmes in low-income countries. AIDS. 2010, 24 (17): 2603-2607. 10.1097/QAD.0b013e32833dd0d3.

    Article  PubMed  Google Scholar 

  33. Heuschmann PU, Biegler MK, Busse O, Elsner S, Grau A, Hasenbein U, Hermanek P, Janzen RWC, Kolominsky-Rabas PL, Kraywinkel K, et al: Development and implementation of evidence-based indicators for measuring quality of acute stroke care: the quality indicator board of the German Stroke Registers Study Group (ADSR). Stroke. 2006, 37 (10): 2573-2551. 10.1161/01.STR.0000241086.92084.c0.

    Article  PubMed  Google Scholar 

  34. Edge JM, Van der Merwe AE, Pieper CH, Bouic P: Clinical outcome of HIV positive patients with moderate to severe burns. Burns. 2001, 27 (2): 111-114. 10.1016/S0305-4179(00)00090-5.

    Article  CAS  PubMed  Google Scholar 

  35. McGlynn EA: The outcomes utility index: will outcomes data tell us what we want to know?. Int J Qual Health Care. 1998, 10 (6): 485-490. 10.1093/intqhc/10.6.485.

    Article  CAS  PubMed  Google Scholar 

  36. Cruz-Correia RJ, Rodrigues P, Freitas A, Almeida FC, Chen R, Costa-Pereira A: Data Quality and Integration Issues in Electronic Health Records. Information Discovery on Electronic Health Records. Edited by: Vagelis H. 2009, Chapman and Hall/CRC, 55-95.

    Google Scholar 

  37. Freitas A, Silva-Costa T, Lopes F, Garcia-Lema I, Teixeira-Pinto A, Brazdil P, Costa-Pereira A: Factors influencing hospital high length of stay outliers. BMC Heal Serv Res. 2012, 12 (1): 265-10.1186/1472-6963-12-265.

    Article  Google Scholar 

  38. Freitas JA, Silva-Costa T, Marques B, Costa-Pereira A: Implications of data quality problems within hospital administrative databases. MEDICON 2010. Volume 29. Edited by: Bamidis PD, Pallikarakis . 2010, Chalkidiki, Greece, 823-826.

    Google Scholar 

Pre-publication history

Download references

Acknowledgments

The authors wish to thank Dr. Fernando Lopes for reviewing the manuscript, Dr. Luis Filipe Azevedo for the methodological inputs, and all Center for Research in Health Technologies and Information Systems (CINTESIS) staff for their continuous support during the execution of this study.

Author information

Authors and Affiliations

  1. Department of Health Information and Decision Sciences, Faculty of Medicine, University of Porto, Al. Prof. Hernâni Monteiro, Porto, 4200-319, Portugal

    Emanuel Catumbela, Victor Certal, Alberto Freitas & Altamiro da Costa Pereira

  2. Department of Pathology, Faculty of Medicine, Universidade Agostinho Neto, Luanda, Angola

    Emanuel Catumbela

  3. CINTESIS - Center for Research in Health Technologies and Information Systems, University of Porto, Porto, Portugal

    Emanuel Catumbela, Victor Certal, Alberto Freitas & Altamiro da Costa Pereira

  4. National School of Public Health, University Nova de Lisboa, Lisbon, Portugal

    Carlos Costa

  5. Department of Infectious Diseases, Faculty of Medicine, University of Porto, Porto, Portugal

    António Sarmento

Authors
  1. Emanuel Catumbela
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Victor Certal
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Alberto Freitas
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Carlos Costa
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. António Sarmento
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Altamiro da Costa Pereira
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Emanuel Catumbela.

Additional information

Competing interests

The authors declare that no competing interests exist.

Authors’ contributions

EC carried out the systematic review, conceived the study, and participated in its design and coordination and drafted the manuscript. VC participated in data collection process. AF participated in the analysis of the results and helped to draft the manuscript. CC participated in the design and coordination of the study. AS participated in the design and coordination of the study. ACP conceived the study, and participated in its design and coordination and helped to draft the manuscript. All authors read and approved the final manuscript.

Authors’ original submitted files for images

Below are the links to the authors’ original submitted files for images.

Authors’ original file for figure 1

Rights and permissions

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and permissions

About this article

Cite this article

Catumbela, E., Certal, V., Freitas, A. et al. Definition of a core set of quality indicators for the assessment of HIV/AIDS clinical care: a systematic review. BMC Health Serv Res 13, 236 (2013). https://doi.org/10.1186/1472-6963-13-236

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/1472-6963-13-236

Keywords

BMC Health Services Research

ISSN: 1472-6963

Contact us