Statistical models for analyzing count data: predictors of length of stay among HIV patients in Portugal using a multilevel model
BMC Health Services Research volume 21, Article number: 372 (2021)
This study offers a comprehensive approach to precisely analyze the complexly distributed length of stay among HIV admissions in Portugal.
To provide an illustration of statistical techniques for analysing count data using longitudinal predictors of length of stay among HIV hospitalizations in Portugal.
Registered discharges in the Portuguese National Health Service (NHS) facilities Between January 2009 and December 2017, a total of 26,505 classified under Major Diagnostic Category (MDC) created for patients with HIV infection, with HIV/AIDS as a main or secondary cause of admission, were used to predict length of stay among HIV hospitalizations in Portugal. Several strategies were applied to select the best count fit model that includes the Poisson regression model, zero-inflated Poisson, the negative binomial regression model, and zero-inflated negative binomial regression model. A random hospital effects term has been incorporated into the negative binomial model to examine the dependence between observations within the same hospital. A multivariable analysis has been performed to assess the effect of covariates on length of stay.
The median length of stay in our study was 11 days (interquartile range: 6–22). Statistical comparisons among the count models revealed that the random-effects negative binomial models provided the best fit with observed data. Admissions among males or admissions associated with TB infection, pneumocystis, cytomegalovirus, candidiasis, toxoplasmosis, or mycobacterium disease exhibit a highly significant increase in length of stay. Perfect trends were observed in which a higher number of diagnoses or procedures lead to significantly higher length of stay. The random-effects term included in our model and refers to unexplained factors specific to each hospital revealed obvious differences in quality among the hospitals included in our study.
This study provides a comprehensive approach to address unique problems associated with the prediction of length of stay among HIV patients in Portugal.
Background and introduction
Length of stay (LOS) is a key instrument to assess the quality of care in light of recent attempts to control the increasing costs of health care services [1,2,3]. The number of days a patient stays at the hospital represents a good illustration of resources utilized during the in-patient hospitalization . Shorter inpatient stays reduce hospital resources consumption; hence, decrease the related health expenditure . However, although hospitals are acclimating to clinical and financial standards induced by policy reforms to reduce length of in-patient care, hospitals’ quality tends to vary widely . In our previous paper , we shed light on the importance of length of stay as a quality indicator in Portugal. Determining the factors that may push LOS further may add to efforts in controlling unnecessary days of admissions, planning resources allocation, and customizing appropriate interventions [4, 5]. Unfortunately, the use of common statistical techniques, particularly the ordinary least squares (OLS) and the logistic regression, to analyze the predictors of LOS as a count variable with overdispersion can violate the assumptions behind each technique, leading to biased estimates that do not precisely reflect the observed data [3, 6, 7] (for an informative overview of count distribution see Atkins, Baldwin, Zheng, Gallop, & Neighbors, 2013 ). Relatively recently, several statistical models have been generated to analyze data with count nature [3, 9, 10].
The first model to analyze count outcomes is the Poisson regression model (PRM) [6, 11, 12]. This model is based on Poisson distribution has two restrictive assumptions [6, 12, 13]. First, the variance of the count outcome is equal to the mean. The second assumption is that occurrences of events are independent of each other [6, 12]. However, in practice, these assumptions are usually violated [6, 12], and count variables tend to have a conditional variance that often exceeds the conditional mean, which is known as “overdispersion” [6, 14]. Using the PRM to analyze outcomes in which one of these two assumptions is violated may result in biased data with underestimated standard error .
The second model is the negative binomial regression model (NBRM) that attempted to overcome the above-mentioned limitations in the Poisson distribution and has proven to properly represent the observed counts than the Poisson distribution [6, 15]. Accordingly, unlike the PRM, this distribution does not require the mean and variance of the count outcome to be equal [6, 12]. Additionally, the previously mentioned assumption of independence of events required for PRM is no longer mandatory in the NBRM since it assumes that events can be repeated, given the influence of individual differences on the probability of an event to occur [6, 12, 13].
Two other alternatives count models are the Zero-Inflated Count Models: zero-inflated Poisson (ZIP) and zero-inflated negative binomial (ZINB). These models had been developed to overcome circumstances in which the origin of overdispersion is due to excessive zero counts. These kinds of distributions assume that the zero counts originate from two different sources and can be classified into two groups . The first group is the “structured zeros” in which there is no chance to go beyond zero [16, 17]. For example, some HIV patients may have been admitted to a hospital and discharged on the same day (same-day separation) because they do not need further treatment, and hence, counted as a zero-length of stay (in days). This phenomenon of same-day separation can be explained by the fact that advancements in healthcare services, medical treatment, and technologies have allowed health facilities to provide more efficient services and improve patients’ outcomes . As a result, a steady decrease in length of stay and an increase in the probability of same-day separations can be observed . These hospitalizations with same-day separations (LOS = 0) which partially constitute the zero counts should be distinguished from the overnight stays (LOS = 1) for resource allocation purposes. On the other hand, the remaining patients with zero count are classified as the “sampling or random zero” group [16, 17] as they can be admitted for more than zero days, e.g. a patient who could have been hospitalized for a non-zero number of days but decides to exit against medical advice before completing overnight stay and hence counted as zero number of days. The first two count models, Poisson and negative binomial are not sufficiently fit for this kind of data since they may fail to address the excess zeros that arise from two different data generating methods, and hence, may induce overestimated variance of model parameters . After considering the excessive zero problem, the zero-inflated techniques generate two regression models. The first model predicts the occurrence of the count, while the second regression model predicts the frequency of occurrence of this count [6, 11]. The zero-inflated model selection, whether ZIP or ZINB, is determined by the sort of overdispersion. If the excessive number of zeros generates the overdispersion, then the ZIP is more appropriate to model count data [6, 11]. On the other hand, if the overdispersion is caused by factors not related to the excessive number of zeros, then the ZINB model is more suitable [6, 11].
However, in some specific contexts in which hierarchically structured data are the norm, as in the case of a patient in hospital multilevel data, the use of the above-mentioned ordinary count models may violate the assumption of independence of variance of the ordinary count regression [5, 19]. The multilevel models (or the random-effects models) are becoming increasingly popular in the social, behavioral, and medical sciences in which hierarchically structured data [20, 21]. In Diagnosis Related Group (DRG) data, as in our study, patients tend to cluster within hospitals based on their preferences such as neighborhood, trust in a specific physician, or hospital, and hence violating the assumption of independence of variance of the ordinary count regression [5, 19]. Accordingly, multilevel modelling is more appropriate than ordinal count regression when dealing with data arranged in a hierarchical structure, such as patients nested within hospital two-level data [22,23,24]. Random-effects models can help in identifying outstanding hospitals and assess hospital quality accordingly . Additionally, ignoring the existence of within-hospital clustering, as in-patient level analysis with no hospital random effect terms generates serious technical problems . Disregarding this clustering will lead to an increase in the number of independent observations at the hospital level, thus underestimating the standard errors of regression coefficients at the hospital’s level [20, 25, 26]. Therefore, the random-effects model is more relevant to analyze the impact of a set of predictors on LOS while controlling for variations in hospitilizations and hospital characteristics [25,26,27].
In Portugal, hospitalizations among HIV/AIDS patients account for the highest average LOS and represent a substantial economic burden, being classified as the second major diagnosis category [3, 28]. Morever, it is important to understand whether the zero-inflated data can affect selecting the appropriate count regression model. Previous studies among HIV hospitalizations in Portugal either used logistic regression  or Poisson regression  to analyze a count variable with overdispersion. Accordingly, unlike other studies, this study aims to examine the predictors of LOS using the best count fit model through comprehensive comparisons between the different count models using the national admissions database among HIV patients in Portugal.
Data collection and source
The present analysis is based on data collected as part of the national registry of discharges among the Portuguese National Health Service (NHS) facilities. We reviewed hospitalization records for all HIV/AIDS patients admitted in Portugal between 1st January, 2009, and 31st December, 2017. Each record corresponds to a discharge episode and contains information collected while the patients were admitted to the hospital, such as type of admission, principal diagnosis, secondary diagnoses, procedures, region, age, sex, and discharge status. These data are anonymous, refers to the Diagnosis Related Groups (DRGs), and were obtained through the Central Health System Administration (ACSS) . The DRGs were first introduced in Portugal through a pilot study in 1984, and since 1989 a systematic collection of DRGs applies to NHS hospitals [19, 31, 32]. Implementing DRGs in Portugal aimed to increase transparency and vindicate the allocation of resources to NHS hospitals by connecting inpatient care resources to hospital outcomes . Since August 2006, there is only one non-modified version of DRGs in use in Portugal, knowing as All Patients DRGs version 21 (AP–DRGs version 21) . This version is implemented in all Portuguese NHS hospitals and applies to all inpatients and ambulatory surgery with an exception for patients treated in psychiatric and rehabilitation care settings . The AP–DRGs version 21 includes 669 DRGs under 25 Major Diagnostic Categories (MDCs), and each MDC refers to one organ or physiological system, with the MDC 24 corresponding to HIV Infection . Since 1984, diagnoses and procedures within the DRGs system have been coded using the International Classification of Diseases, Ninth Revision, Clinical Modification (ICD-9-CM), and since 2016 they have been coded using ICD-10-CM [31, 33].
The collection and validation of the DRG database in Portugal are carried out through several internal and external auditing steps to ensure high-quality data, a criterion necessary for any DRG system . Coding in Portugal is first standardised and performed by physicians with specific training in coding . An internal auditor assigned by each hospital supervises the data collection and the coding process. Afterward, the external coding auditing process starts with trained physicians supervised by a senior manager from the ACSS to assist and monitor the internal auditing process . Moreover, this external auditing team is authorized to carry out visits for the included hospitals and validate patients’ records to ensure if the DRG coding and classification have been done correctly . It is also important to mention that the DRG clinical coding process is carried out through computer software to identify data errors and discrepancies in hospital records . Afterward, this software delivers data regarding the mean number of codes per record, the proportion of incorrect codes and coding errors, together with notifying the operator of deficient information within the records such as duplications, undefined primary diagnosis, or atypical lengths of stay . We also used a unique fictional code included in the data for data validation that allows determining how many episodes correspond to the same user in the same institution, hence avoid duplicates. This fictional code does not identify the user or allow its identification afterward.
A total of 26,505 discharges among patients aged 18 years or older were included in the study. We considered only discharges classified under MDC created for patients with HIV infection (MDC 24). For the purpose of this study, data about discharges with HIV/AIDS as a main or secondary cause of admission were analyzed. Primary and secondary diagnoses and procedures were coded according to the International Classification of Diseases. Nineteen secondary diagnoses and up to 20 procedures were considered in this study.
The dependent variable in our study is length of stay (LOS) which is defined as the number of days between in-patient admission and hospital discharge.
Descriptive and univariate analyses were carried out. A p-value ≤0.05 was considered to be significant. To select the best count model, we applied several strategies that included three separate phases. The first phase in our analysis was to test the overdispersion of our count variable. Accordingly, the mean and the variance of LOS were calculated. In the second phase of our analysis, we included a flowchart (Fig. 1) to assist in deciding the most fitting count technique. By using STATA® software, we confirmed overdispersion, this time by using the likelihood ratio test to examine for overdispersion. We took the advantage that STATA® automatically calculates the likelihood-ratio (LR) whenever a negative binomial model is applied to examine if the dispersion parameter is equal to zero  (for more informative overview of the LR see Long, 1997 ). The following stage in the second phase of our analysis included the evaluation of the excessive zero counts, which is represented by the left half of our flowchart. We used Vuong test to examine any significant increase in the zero counts by considering the predicted probabilities of two count models .
In the third phase of our analysis, an exploratory analysis using the “countfit” estimation command in STATA®  was done to distinguish the corresponding fit of the different count models. Model performance and estimates of precision for each of the models were calculated. The command also generates the Akaike information criterion (AIC) and the Bayesian information criterion (BIC), which are estimators of the corresponding quality of statistical models [36, 37]. Each test estimates the quality of each of the four models compared to each of the other models. Hence, they provide an approach for model selection. Accordingly, we examined the model fit by comparing the AIC, BIC, and predicted and observed probabilities of each count outcome for each probability distribution. To show the effect of choosing a model in which its assumptions are violated, the ordinary linear regression model was included in our study for the purpose of comparison.
In our multivariable analyses, to assess the effect of covariates on LOS, information on patients, clinical characteristics, admissions’ characteristics were extracted from the hospital discharge database. The following potential determinants of LOS were considered: age (1 = “18–29″, 2 = “30–39″, 3 = “40–49″, 4 = “50–59″, 5 = “60–69″, 6=” > =70″), gender (0 = male, 1 = female), region (0 = Non-resident, 1 = Norte, 2 = Centro, 3 = Lisbon, 4 = Alentejo, 5 = Algarve), HIV/AIDS as a primary diagnosis (0 = no, 1 = yes), having national health coverage (SNS) (0 = no, 1 = yes), admission status (0 = elective, 1 = emergency), treatment classification (0 = medical, 1 = surgical), number of diagnoses (0 = “<=5″, 1 = “6–8″,2 = “9–12″, 3 = “> 12″), number of procedures (0 = “<=4″, 1 = “5–7″, 2 = “8–9″, 3 = “> 9″), in-hospital death (0 = no, 1 = yes), transferred admission (0 = no, 1 = yes), 30-day readmission (0 = no, 1 = yes), tuberculosis (TB) (0 = no, 1 = yes), Hepatitis B (0 = no, 1 = yes), Hepatitis C (0 = no, 1 = yes), Pneumocystis (0 = no, 1 = yes), Cytomegalovirus (0 = no, 1 = yes), Mycobacterial disease (0 = no, 1 = yes), Toxoplasmosis (0 = no, 1 = yes), Candidiasis (0 = no, 1 = yes), Kaposi’s sarcoma (0 = no, 1 = yes), history of recurrent pneumonia (0 = no, 1 = yes), weight loss (0 = no, 1 = yes), asymptomatic HIV (0 = no, 1 = yes). Since several hospitals have been merged in one hospital during the period between 2009 and 2017, we created a dummy variable (Merge) to categorize hospitals according to the merging status (0 = not merged, 1 = merged) to be able to study the effect of merging on hospital quality. We created a dummy variable for the years of admission in which years before the financial crisis and bailout in Portugal were coded as 0 (2009, 2010, and 2011), while years after the financial bailout were coded as 1 (2012, 2013, 2014, 2015, 2016 and 2017).
After choosing the most appropriate count technique, and in addition to the fixed patient and clinical related factors, we incorporated a random hospital effects term to the negative binomial model to examine the dependence between observations within the same hospital. Multiple comparisons of hospital effects were done by constructing 95% confidence intervals (CI) for random-effects.
All analyses were conducted with STATA®, version 13 (StataCorp LP, College Station, Texas, USA), and MLwiN®, version 3.04 (University of Bristol, Bristol, UK). MLwiN is a specialized software package for fitting multilevel models .
Table 1 summarizes the main characteristics of the study population. The study population was mostly composed of males (71.3%), with a median age of 44 years (interquartile range (IQR): 38–53)), with more than half living in Lisbon (52.9%), and almost 3% not being registered in the national health system. Admissions during 2009 accounted for 14.6% of the total admissions representing the highest admission rate, while admissions during 2017 accounted for 6.5% of admissions representing the lowest admission rate. A descending trend in the frequency of admissions was observed through the years. Most of the hospital admissions were preceded by an emergency (83.3%), with 12.0% of them resulting in the death of the patient, 6.4% were discharged to another health facility, and 4.1% exit against medical advice. In 9.5% of the admissions, the patient had to be transferred to another hospital, and in 11%, the patient had been readmitted within 30 days of the last discharge. Most episodes were classified as medical (94.2%). The median number of procedures per episode was 8 (IQR: 5–12), whereas the median number of diagnoses was 7 (IQR: 5–10). HIV was the primary diagnosis in 67.6% of the hospital admissions, while 6.6% of the patients had asymptomatic HIV infection at hospital admission. Hepatitis C was the most frequent co-infection (25.1%), followed by tuberculosis (7.3%), pneumocystosis (7.0%), mycobacterial infections (6.5%), Hepatitis B (4.3%), and cytomegalovirus (2.5%).
The median LOS in our study was 11 days (IQR: 6–22). Figure 2 shows our dependent variable as zero-inflated, positively skewed, and over-dispersed with a mean of 17.9 days and a standard deviation of 22.4 days, indicating an obvious difference between the mean and median LOS. Moreover, to confirm overdispersion, results from the likelihood ratio test were significant, (LR χ2(1) = 0.79, P < 0.001), indicating overdispersed data. Therefore, the NBRM is more appropriate to analyze LOS when compared to PRM. The second stage in the second phase of our analysis, which was dedicated to evaluating the excessive zero counts, shows that 784 participants were with zero values representing around 3.0% of the total admissions. Results from the Vuong test confirm the significant favorability of using the NBRM over the PRM (z = 4.55, p < 0.001).
Results from the “countfit” estimator in STATA show that NBRM and ZINB provide the best relative fit as they exhibited the least difference between the predicted and observed values and thus are preferred over the PRM and ZIP (Fig. 3). According to the figure, the best models are the models with estimates close to the zero line, the two negative binomial models. Being close to the zero line means that the predicted and the objected values are close to each other. Under the same countfit command, results from the AIC and the BIC tests (Table 2) illustrate a notable reduction in the AIC and BIC measures of both the NBRM (198,008.241 and 198,352.015, respectively) model and ZINB model (197,424.156 and 198,103.519, respectively) which means better quality of models compared to the PRM (445,042.083 and 445,377.671, respectively) and ZIP (432,277.401 and 432,948.578, respectively). Accordingly, the NBRM and ZINB were the models of choice since they demonstrate the lowest difference between the predicted and observed estimates and the lowest AIC and BIC test results.
Table 3 presents the predictors of LOS according to the ordinary least square model, the four selected count models, and the random-effects model. The OLS model results produced values that are overstating the actual coefficients compared to the count models. Regarding the negative binomial model with random-effects, admissions among males or admissions associated with TB infection, pneumocystis, cytomegalovirus, candidiasis, toxoplasmosis, or mycobacterium disease exhibit a highly significant increase in LOS. Moreover, perfect trends were observed in which a higher number of diagnoses or procedures lead to significantly higher LOS. On the other hand, admissions associated with Hepatitis C, HIV as the primary diagnosis, asymptomatic HIV, recurrent pneumonia, or weight loss show a statistically significant LOS decrease. Lower LOS was also observed among admissions registered in Norte, Centro, or Lisbon regions. Moreover, similar findings were observed among hospitalizations associated with exited against medical advice, a transfer to another hospital, inpatient mortality, or hospitalizations that occurred in the years that followed signing the financial bailout program (after 2011). As expected, the standard error in the ordinary count models was underestimated when compared to the random-effects count regression model.
Fig. 4 represents the caterpillar plot of the hospital effects. The plot illustrates the random-effects model for 54 hospitals included in our study that was used to determine unmeasured and unobserved factors specific to each hospital with their respective 95% CI. The first nine hospitals have random-effects and respective 95% CI below zero, being considered with more quality when compared to the mean, whereas the last seven hospitals’ random-effects exhibit higher LOS (random-effects and corresponding 95%CI above zero). The plot shows that the remaining hospitals, almost 70% of the hospitals included, cannot be distinguished from the overall average.
This paper provides an illustration of statistical techniques that are appropriate to overcome obstacles linked to the prediction of count data with overdispersion using longitudinal predictors of LOS among HIV hospitalizations in Portugal. The advantages of the selected count models were presented and explained. To the best of our knowledge, this is the first study to consider analyzing LOS among HIV patients in Portugal by using the best count fit model after comparing the four aforementioned models.
The fact that applying different statistical techniques results in different results demonstrates the importance of precisely selecting a model that accurately represents the observed count data. In other words, we can say that this paper illustrates the consequences of using methods that do not precisely consider the nature of the data distribution. Analyzing LOS among HIV patients as a count variable with overdispersion will yield more precise outcomes if the assumptions behind the selected model are not violated.
Previous studies in Portugal that analyzed LOS among HIV patients either used logistic regression  or Poisson regression  without explaining the theory and assumptions behind selecting the Poisson regression over the other count models. LOS as an overdispersed count variable is violating the assumption of using the Poisson model in which the variance of LOS should be equal to the mean. As shown in our results, linear regression through the OLS technique, whose assumptions were violated by the count distribution of LOS data, produced values that are overstating the actual coefficients compared to the count models. Moreover, the same linear model identified some factors (emergency admissions, merged hospitals, and 30-day readmission) as significantly decreasing LOS although they are not when compared to the most appropriate models, namely ZINB and the random-effects model. On the contrary, the linear model showed a non-significant decrease in LOS among admissions with HIV as a primary diagnosis, while the ZINB and random-effects model showed a significant decrease. In addition, and when compared to the zero-inflated negative binomial model or the random-effects model, the other count models underestimated the standard errors of regression coefficients. However, this result was expected, especially for the random-effects model, since accurate standard errors will be generated if variation at multilevel, patient, and hospital levels is allowed in the analysis [20, 25]. Ignoring the hierarchy in multilevel data will result in data that underestimate the magnitude of hospital level’s standard errors of regression coefficients [20, 25]. The other technical problem is inflation in the number of independent observations at the hospital level of the hierarchy. For example, Poisson and ZIP identified some factors as significantly decreasing LOS, although they are not when compared to the random-effects model, namely 30-day readmission, merged hospitals, and emergency admissions. Moreover, all the included models showed a significant increase in LOS for admissions in Algarve, while the random-effects model, the most appropriate model, showed a non-significant decrease in LOS in the Algarve region. These findings can explain how using an inappropriate model may mislead policy making decisions.
The median LOS of 11 days in our study is equal to the median reported by a similar study in Brazil . Shorter LOS was reported by similar studies in Spain (8 days) , United Kingdom (7.5 days) , and the United States (6 days) . Moreover, the median of 11 days in Portugal is higher than the national Portuguese LOS average of 9 days . On the contrary, higher LOS was reported in Colombia (14 days) , and Italy (16 days) . Differences in LOS duration between countries can be explained by different applied policies on HIV infection control or different population samples among countries. This study pointed out several factors that tend to push LOS further after using the random-effects count model. First, socio-demographic factors indicate that admissions among females are frequently less prolonged than in men. This result is in accordance with a previous study in Ontario, Canada in which female sex was predictive of shorter hospital stays among HIV hospitalizations when compared to men . This finding can be explained by the fact that male patients who are living with HIV carry a substantial burden of the disease with respect for severity , and morbidity , which can be reflected on LOS. Also, individuals who are registered as non-residents or individuals who are not registered in the National Portuguese Health System tend to have a significantly higher LOS. Since all Portuguese citizens and documented migrants are entitled to the NHS , this finding sheds light on how the migration status can affect health outcomes, especially among undocumented migrants in Portugal. Exit against medical advice was significantly associated with shorter hospital stays in our study. In general, exit against medical advice is associated with shorter stays and lower hospital charges at the beginning, as reported in previous studies [49, 50]. However, while this result is logical and expected, patients who exit against medical advice encounter a later higher risk of readmissions as shown in our previous study among HIV hospitalizations  or studies from other countries but among similar hospitalizations . Accordingly, history of exit against medical advice can increase future utilization of healthcare resources . Given this implication, further analysis of populations at risk and factors that can push exit against medical advice is mandatory to consider proper interventions.
Comorbidities were among the most important factors that tend to push LOS further. Also, comorbidities showed a perfect trend in which the higher number of comorbidities, diagnosis, or procedures were associated with higher LOS in days. Similar findings have been reported by a similar study in the United States in which the presence of comorbid conditions was a strong predictor of LOS . The same study also defined the number of diagnoses and procedures as independent predictors of LOS . Another study in Italy came to the conclusion that chronic diseases and comorbidities increase the costs of hospitalizations among HIV admissions . Moreover, the presence of co-infections or AIDS-defining illnesses that are commonly associated with HIV patients led to a significant increase in LOS in our study. In general, these co-infections or AIDS-defining illnesses represent a major public health concern as they lead to patients’ disabilities and adverse hospital outcomes [44, 55,56,57,58,59,60]. These results from our study generally agree with those obtained in previous studies in other countries. For example, LOS was found to be significantly higher among individuals with HIV-TB coinfection in a study conducted in the United States . Another study found that LOS and hospitalization costs were higher in the Hepatitis B-HIV co-infected patients compared to the Hepatitis B mono-infected patients or HIV mono-infected patients with statistically significant results . Moreover, previous studies conducted in different countries defined Hepatitis C-HIV- co-infection as a significant predictor of LOS and early readmissions among HIV admissions [40, 41, 63]. In addition, another study defined the presence of an AIDS-defining illness as independent predictors of LOS . In our earlier work , comorbidities and co-infections were among the main factors to increase the probability of 30-day readmission among HIV patients in Portugal. Since comorbidities and coinfections tend to increase both inpatient LOS and 30-day readmission, further exploration of any flaws in outpatient care and continuity of care following discharge should be addressed. In other words, to ensure more efficient care, healthcare providers should guarantee the entire care continuum for improvements. By encouraging an overall patient care plan, providers can potentially improve health outcomes while at the same time reducing costs. Accordingly, it is in the hospitals’ best interest to encourage communication, coordination, and follow-up with the primary care, rehabilitation centers, outpatient care, specialists, and general practitioners who are following their patients, even after they are discharged. In accordance with previous studies, HIV admissions associated with surgical interventions in our study were predictive of longer inpatient stays. These studies demonstrated that HIV/AIDS patients are more likely to develop surgical site infections and complications compared to the general population, hence, have longer LOS [64,65,66].
Years that followed the economic crisis in Portugal and culminated in signing the Economic Adjustment Program for Portugal, also known as the Bailout program, were associated with a significant decrease in LOS. Two facts can explain this phenomenon. First, by signing this Bailout program, Portugal was obligated to implement strict austerity measures that had led to a reduction of spending on sensitive health sectors, payments to NHS hospitals, day cases, and in-patients’ admissions [3, 26, 67]. These measures have reduced hospital quality by reducing LOS and number of admissions or by substituting in-patient hospitalizations by day cases [3, 26, 67]. The second fact that can explain this phenomenon is the continuous reforms of the hospitals’ sector in Portugal that translated into a 3 years plan for hospitals reforming that have been monitored by the Regional Health Authority [26, 68]. These reforms that started in 2011 have positively affected quality levels, with a significant reduction in LOS [26, 68].
The random-effects term included in our model and refers to unexplained factors specific to each hospital revealed obvious differences in quality among the hospitals included in our study. In other words, LOS is still significantly higher in some hospitals than others in Portugal. The seven hospitals that showed significantly higher LOS requires further investigation. These hospitals’ unexplained factors can range from discrepancies in medical expertise, health care, and human medical resources. However, this finding can be explained by how the health care system and the provided services can be affected by the socio-demographic inequalities in Portugal. These inequalities translate into an unfair distribution of medical resources, equipment, doctors, and nurses . Moreover, some geographical areas in Portugal, particularly the coastal regions, exhibit higher concentrations of young populations and better economic growth indicators, leading to better health outcomes . These findings necessitate a further examination of any potential discrepancies in the hospital’s performance by region that can be associated with higher LOS.
This study used the entire Portuguese national data for public hospital admissions, from which HIV patients were analyzed. The main strengths of our study can be concluded in the following points. First, we used a large dataset representing the entire national Portuguese admissions in public hospitals. Second, our study provided a comprehensive review and comparison between statistical procedures for analyzing count data to select the most optimal model. Third, we used multilevel random effect predictions that can help in the identification of outstanding hospitals and may serve as an indicator to assess hospital quality/performance. Finally, the study provides information on indicators that can push LOS further, which can enlighten health policymakers to control unnecessary hospitalizations. The main limitation of our study is the absence of additional socio-economic factors, access to primary care indicators, and clinical factors such as immune status, CD4 cell count, and ART at discharge that may contribute to a better understanding of factors that can increase LOS. Moreover, LOS could be underestimated due to death occurring during admission and/or in-hospital stay. Findings from this study support the conclusion of the Portuguese Court of Auditors, stating that the techniques used to analyze LOS within the DRG system is insufficient and is not the most appropriate way . Accordingly, using fairly recent statistical techniques presented in our study to address complexly distributed data, unique problems associated with the prediction of LOS can be solved. Moreover, our study supports the Portuguese policy of cost reduction by preventing unnecessary spending . Accordingly, LOS, as a quality/performance indicator, should be handled as a national priority, and health policies should be directed to consider addressing the determinants that can push it further.
Analyzing LOS among HIV patients will yield more precise results if the nature of LOS as a count outcome met the assumptions behind the used statistical method. Using suboptimal techniques can mislead health professionals and policymakers. Results from our study can help to target the factors that tend to increase length of stay among HIV patients in Portugal and hence reduce unnecessary spending, given the weight and the economic burden of HIV/AIDS hospitalizations.
Availability of data and materials
Administração Central do Sistema de Saúde [Central Administration of the Health System]
Akaike information criterion
Acquired Immunodeficiency syndrome
- AP–DRGs version 21:
All Patients Diagnosis Related Groups version 21
Bayesian information criterion
Diagnosis Related Groups
Human immunodeficiency virus
International Classification of Diseases
Length of stay
Major Diagnostic Category
Negative binomial regression model
National Health Service (Portugal)
Ordinary Least Squares
People living with HIV/AIDS
Poisson regression model
Serviço Nacional de Saúde [National Health Services Coverage]
Zero-inflated negative binomial
Parsons T III. Length of stay: managed care agenda or a measure of clinical efficiency? Psychiatry. 2006;3(6):46.
Brasel KJ, Lim HJ, Nirula R, Weigelt JA. Length of stay: an appropriate quality measure? Arch Surg. 2007;142(5):461–6. https://doi.org/10.1001/archsurg.142.5.461.
Shaaban AN, Martins O, Rosario M. The importance of improving the quality of care among HIV/AIDS hospitalizations in Portugal. Front Public Health. 2019;7:266. https://doi.org/10.3389/fpubh.2019.00266.
Carter EM, Potts HW. Predicting length of stay from an electronic patient record system: a primary total knee replacement example. BMC Med Inform Decision Making. 2014;14(1):26. https://doi.org/10.1186/1472-6947-14-26.
Feng CX, Li L. Modeling zero inflation and overdispersion in the length of hospital stay for patients with ischaemic heart disease. Adv Stat Methods Data Sci. 2016:35–53. https://doi.org/10.1007/978-981-10-2594-5_3 Springer.
Karazsia BT, Van Dulmen MH. Regression models for count data: illustrations using longitudinal predictors of childhood injury. J Pediatr Psychol. 2008;33(10):1076–84. https://doi.org/10.1093/jpepsy/jsn055.
Hammer TH, Landau JC. Methodological issues in the use of absence data. J Appl Psychol. 1981;66(5):574–81. https://doi.org/10.1037/0021-9010.66.5.574.
Atkins DC, Baldwin SA, Zheng C, Gallop RJ, Neighbors C. A tutorial on count regression and zero-altered count models for longitudinal substance use data. Psychol Addict Behav. 2013;27(1):166–77. https://doi.org/10.1037/a0029508.
Hall DB. Zero-inflated Poisson and binomial regression with random effects: a case study. Biometrics. 2000;56(4):1030–9. https://doi.org/10.1111/j.0006-341X.2000.01030.x.
Lambert D. Zero-inflated Poisson regression, with an application to defects in manufacturing. Technometrics. 1992;34(1):1–14. https://doi.org/10.2307/1269547.
Long SJ, Long JS, Freese J. Regression models for categorical dependent variables using Stata. Texas: Stata Press; 2006.
Williams R. Models for count outcomes. Notre Dame: University of Notre Dame; 2016.
Sturman MC. Multiple approaches to analyzing count data in studies of individual differences: the propensity for type I errors, illustrated with the case of absenteeism prediction. Educ Psychol Meas. 1999;59(3):414–30. https://doi.org/10.1177/00131649921969956.
Cameron AC, Trivedi PK. Econometric models based on count data. Comparisons and applications of some estimators and tests. J Appl Econ. 1986;1(1):29–53. https://doi.org/10.1002/jae.3950010104.
Hausman JA, Hall BH, Griliches Z. Econometric models for count data with an application to the patents-R&D relationship. Cambridge: National Bureau Of Economic Research; 1984.
Brooks ME, Kristensen K, van Benthem KJ, Magnusson A, Berg CW, Nielsen A, et al. glmmTMB balances speed and flexibility among packages for zero-inflated generalized linear mixed modeling. R J. 2017;9(2):378–400. https://doi.org/10.32614/RJ-2017-066.
Hua H, Wan T, Wenjuan W, Paul C-C. Structural zeroes and zero-inflated models. Shanghai Arch Psychiatry. 2014;26(4):236.
Yau KK, Wang K, Lee AH. Zero-inflated negative binomial mixed regression modeling of over-dispersed count data with extra zeros. Biometric J. 2003;45(4):437–52. https://doi.org/10.1002/bimj.200390024.
Dias SS, Andreozzi V, Martins RO. Analysis of HIV/AIDS DRG in Portugal: a hierarchical finite mixture model. Eur J Health Econ. 2013;14(5):715–23. https://doi.org/10.1007/s10198-012-0416-5.
Rasbash J, Steele F, Browne WJ, Goldstein H, Charlton C. A user’s guide to MLwiN. In: Centre for Multilevel Modelling. UK: University of Bristol; 2015.
Leckie G, Charlton C. Runmlwin-a program to run the MLwiN multilevel modelling software from within stata. J Stat Softw. 2013;52(11):1–40.
Greenland S. Principles of multilevel modelling. Int J Epidemiol. 2000;29(1):158–67. https://doi.org/10.1093/ije/29.1.158.
Diez-Roux AV. Multilevel analysis in public health research. Annu Rev Public Health. 2000;21(1):171–92. https://doi.org/10.1146/annurev.publhealth.21.1.171.
Leyland AH, Goldstein H. Multilevel modelling of health statistics. Chichester: Wiley; 2001.
Sanagou M, Wolfe R, Forbes A, Reid CM. Hospital-level associations with 30-day patient mortality after cardiac surgery: a tutorial on the application and interpretation of marginal and multilevel logistic regression. BMC Med Res Methodol. 2012;12(1):28. https://doi.org/10.1186/1471-2288-12-28.
Shaaban AN, Dias SS, Muggli Z, Peleteiro B, Martins MRO. Risk of readmission among HIV patients in public Portuguese hospitals: longitudinal multilevel population-based study. Front Public Health. 2020;8:15. https://doi.org/10.3389/fpubh.2020.00015.
Cho S-H. Using multilevel analysis in patient and organizational outcomes research. Nurs Res. 2003;52(1):61–5. https://doi.org/10.1097/00006199-200301000-00010.
Dias SS, Martins MF. HIV AIDS length of stay outliers. Proc Comp Sci. 2015;64:984–92. https://doi.org/10.1016/j.procs.2015.08.617.
Augusto GF, Dias SS, Abrantes AV, Martins MR. HIV/AIDS length of stay in Portugal under financial constraints: a longitudinal study for public hospitals, 2009–2014. BMC Health Serv Res. 2019;19(1):303. https://doi.org/10.1186/s12913-019-4131-0.
The Central Administration of the Health System (ACSS) [Available from: http://www.acss.min-saude.pt/. Accessed Oct 2019.
Mateus C. Portugal: results of 25 years of experience with DRGs. In: Diagnosis-related groups in Europe: moving towards transparency, efficiency and quality in hospitals. New York: McGraw Hill; 2011. p. 381–400.
Administração Central do Sistema de Saúde (ACSS). Grupos de Diagnósticos Homogéneos. 2020 [Available from: http://www2.acss.min-saude.pt/Default.aspx?TabId=460&language=pt-PT. Accessed Jan 2021.
Circular Informativa ACSS. Implementação do Sistema de Codificação Clínica ICD-10-CM/PCS em Portugal em Substituição da Atual ICD-9-CM 2016 Available from: www.acss.min-saude.pt/circulares/Circular_Informativa/2016/Circular_Informativa_24_2016.pdf.
Long JS. Regression models for categorical and limited dependent variables. Adv Quantitative Techn Soc Sci. 1997;7:217–49.
Williams R. Review of regression models for categorical dependent variables using Stata, by Long and Freese. Stata J. 2006;6(2):273–8. https://doi.org/10.1177/1536867X0600600208.
Lindsey JK, Jones B. Choosing among generalized linear models applied to medical data. Stat Med. 1998;17(1):59–68. https://doi.org/10.1002/(SICI)1097-0258(19980115)17:1<59::AID-SIM733>3.0.CO;2-7.
Burnham KP, Anderson DR. Multimodel inference: understanding AIC and BIC in model selection. Sociol Methods Res. 2004;33(2):261–304. https://doi.org/10.1177/0049124104268644.
Charlton, C., Rasbash, J., Browne, W.J., Healy, M. and Cameron, B. (2019) MLwiN version 3.04. Centre for Multilevel Modelling, University of Bristol.
Coelho LE, Ribeiro SR, Veloso VG, Grinsztejn B, Luz PM. Hospitalization rates, length of stay and in-hospital mortality in a cohort of HIV infected patients from Rio de Janeiro, Brazil. Brazil J Infect Dis. 2017;21(2):190–5. https://doi.org/10.1016/j.bjid.2016.10.007.
Meijide H, Mena Á, Rodríguez-Osorio I, Pértega S, Castro-Iglesias Á, Rodríguez-Martínez G, et al. Trends in hospital admissions, re-admissions, and in-hospital mortality among HIV-infected patients between 1993 and 2013: impact of hepatitis C co-infection. Enfermedades infecciosas y microbiologia clinica. 2017;35(1):20–6.
Tittle V, Cenderello G, Pasa A, Patel P, Artioli S, Dentone C, et al. A comparison of inpatient admissions in 2012 from two European countries. J Int AIDS Soc. 2014;17(4 Suppl 3):19712. https://doi.org/10.7448/IAS.17.4.19712.
Rowell-Cunsolo TL, Liu J, Shen Y, Britton A, Larson E. The impact of HIV diagnosis on length of hospital stay in New York City, NY, USA. AIDS Care. 2018;30(5):591–5. https://doi.org/10.1080/09540121.2018.1425362.
OECD. Length of hospital stay 2000 Available from: https://data.oecd.org/healthcare/length-of-hospital-stay.htm.
Barreneche MFÁ, Castro CAR, Botero AH, Franco JPV, Romero IMT, Carvajal LR, et al. Hospitalization causes and outcomes in HIV patients in the late antiretroviral era in Colombia. AIDS Res Ther. 2017;14(1):1–7.
Turcotte LA, Perlman CM, Fries BE, Hirdes JP. Clinical predictors of protracted length of stay in Ontario complex continuing care hospitals. BMC Health Serv Res. 2019;19(1):218. https://doi.org/10.1186/s12913-019-4024-2.
Jiang H, Yin J, Fan Y, Liu J, Zhang Z, Liu L, et al. Gender difference in advanced HIV disease and late presentation according to European consensus definitions. Sci Rep. 2015;5(1):1–10.
Lorenc A, Ananthavarathan P, Lorigan J, Banarsee R, Jowata M, Brook G. The prevalence of comorbidities among people living with HIV in Brent: a diverse London borough. London J Prim Care. 2014;6(4):84–90. https://doi.org/10.1080/17571472.2014.11493422.
Shaaban AN, Morais S, Peleteiro B. Healthcare services utilization among migrants in Portugal: results from the National Health Survey 2014. J Immigr Minor Health. 2019;21(2):219–29. https://doi.org/10.1007/s10903-018-0744-3.
Saitz R, Ghali WA, Moskowitz MA. The impact of leaving against medical advice on hospital resource utilization. J Gen Intern Med. 2000;15(2):103–7. https://doi.org/10.1046/j.1525-1497.2000.12068.x.
Alfandre DJ. “I’m going home”: discharges against medical advice. In: Mayo Clinic Proceedings. Amsterdam: Elsevier; 2009.
Anis AH, Sun H, Guh DP, Palepu A, Schechter MT, O'Shaughnessy MV. Leaving hospital against medical advice among HIV-positive patients. CMAJ. 2002;167(6):633–7.
Tummalapalli SL, Goodman ER. What are best practices for patients discharged against medical advice. Hospitalist. 2016;1.
Santella A, Shi L, Campbell C. Factors associated with hospital length of stay among HIV-infected adults in Louisiana. J La State Med Soc. 2010;162:325–6.
Cammarota S, Citarella A, Manzoli L, Flacco ME, Parruti G. Impact of comorbidity on the risk and cost of hospitalization in HIV-infected patients: real-world data from Abruzzo region. Clin Econ Outcomes Res. 2018;10:389–98. https://doi.org/10.2147/CEOR.S162625.
Anwar KP, Malik A, Subhan KH. Profile of candidiasis in HIV infected patients. Iran J Microbiol. 2012;4(4):204–9.
Basavaraju A. Toxoplasmosis in HIV infection: an overview. Trop Parasitol. 2016;6(2):129–35. https://doi.org/10.4103/2229-5070.190817.
Gianella S, Letendre S. Cytomegalovirus and HIV: a dangerous pas de deux. J Infect Dis 2016;214(suppl_2):S67-S74.
Sulkowski MS. Viral hepatitis and HIV coinfection. J Hepatol. 2008;48(2):353–67. https://doi.org/10.1016/j.jhep.2007.11.009.
Koziel MJ, Peters MG. Viral hepatitis in HIV infection. N Engl J Med. 2007;356(14):1445–54. https://doi.org/10.1056/NEJMra065142.
McShane H. Co-infection with HIV and TB: double trouble. Int J STD AIDS. 2005;16(2):95–101. https://doi.org/10.1258/0956462053057576.
Falana A, Akpojiyovwi V, Sey E, Akpaffiong A, Agumbah O, Chienye S, et al. Hospital length of stay and cost burden of HIV, tuberculosis, and HIV-tuberculosis coinfection among pregnant women in the United States. Am J Infect Control. 2018;46(5):564–70. https://doi.org/10.1016/j.ajic.2017.09.016.
Rajbhandari R, Jun T, Khalili H, Chung RT, Ananthakrishnan AN. HBV/HIV coinfection is associated with poorer outcomes in hospitalized patients with HBV or HIV. J Viral Hepat. 2016;23(10):820–9. https://doi.org/10.1111/jvh.12555.
Cenderello G, Tittle V, Pasa A, Dentone C, Artioli S, Setti M, et al. Inpatient admissions of patients living with HIV in two European centres (UK and Italy); comparisons and contrasts. J Infect. 2015;70(6):690–4. https://doi.org/10.1016/j.jinf.2014.12.009.
Dimitroulis D, Karaolanis G, Katafigiotis I, Anastasiou I, Palla V-V, Kontos A, et al. Influence of HIV virus in the hospital stay and the occurrence of postoperative complications classified according to the Clavien-Dindo classification and in comparison with the Charlson comorbidity index in patients subjected to urologic and general surgery operations. Our preliminary results. Archivio Italiano di Urologia e Andrologia. 2017;89(2):125–9. https://doi.org/10.4081/aiua.2017.2.125.
Morrison CA, Wyatt MM, Carrick MM. Effects of human immunodeficiency virus status on trauma outcomes: a review of the national trauma database. Surg Infect. 2010;11(1):41–7. https://doi.org/10.1089/sur.2008.050.
Drapeau C, Pan A, Bellacosa C, Cassola G, Crisalli M, De Gennaro M, et al. Surgical site infections in HIV-infected patients: results from an Italian prospective multicenter observational study. Infection. 2009;37(5):455–60. https://doi.org/10.1007/s15010-009-8225-1.
Perelman J, Felix S, Santana R. The great recession in Portugal: impact on hospital care use. Health Policy. 2015;119(3):307–15. https://doi.org/10.1016/j.healthpol.2014.12.015.
Publishing O. OECD reviews of health care quality: Portugal 2015-raising standards. Paris: OECD Publishing; 2015.
de Almeida SJ, Augusto GF, Fronteira I, Hernández-Quevedo C. Portugal. Health Syst Transit. 2017;19(2):1–184.
Carpinteiro J, Viegas M, Morgado M, Fonseca P. Auditoria ao sistema de pagamentos e de formação dos preços pagos às unidades hospitalares do Serviço Nacional de Saúde: Court of Auditors of Portugal [Tribunal de Contas de Portugal]; Lisbon, Portugal; 2011 [Available from: https://www.tcontas.pt/pt-pt/ProdutosTC/Relatorios/RelatoriosAuditoria/Documents/2011/rel030-2011-2s.pdf.
The authors thank the Central Health System Administration (ACSS) for providing the data.
This research was co-financed by Saúde Global e Medicina Tropical, Instituto de Higiene e Medicina Tropical, Universidade NOVA de Lisboa, Portugal, ref. UID/04413/2020 and Unidade de Investigação em Epidemiologia – Instituto de Saúde Pública da Universidade do Porto (EPIUnit), ref. UIDB/04750/2020; and the Foundation for Science and Technology – FCT (Portuguese Ministry of Science, Technology and Higher Education) [grant number PD/BD/128066/2016 (A. N. Shaaban)].
Ethics approval and consent to participate
This is a secondary analysis of data routinely collected in Portuguese public hospitals in which the secondary use of personal data is regulated by a personal data protection legislation, and was conducted under the supervision of the Central Administration of the Health System (ACSS) (http://www.acss.min-saude.pt/), Ministry of Health (Portugal), the legal owner of the DRG database in Portugal. The national legislations provide that, as a principle, health data must be anonymized for secondary use. Under Portuguese national laws and legislations, it is mandatory to inform the patient of the content of the electronic health records and their rights before the electronic health records are put in place. This article does not contain any studies with human participants performed by any of the authors. The data obtained from the ACSS is anonymous and confidential, in which the authors cannot identify any subject on that database, in accordance with the national legislation, the institutional requirements, and the Portuguese National Authority of Data Protection for the creation of an individual database.
Consent for publication
The authors declare no conflict of interest.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Shaaban, A.N., Peleteiro, B. & Martins, M.R.O. Statistical models for analyzing count data: predictors of length of stay among HIV patients in Portugal using a multilevel model. BMC Health Serv Res 21, 372 (2021). https://doi.org/10.1186/s12913-021-06389-1