- Research article
- Open Access
- Open Peer Review
Determinants of efficiency growth of county-level public hospitals-evidence from Chongqing, China
BMC Health Services Research volume 19, Article number: 858 (2019)
The reform of county-level public hospitals is a breakthrough in the new era of healthcare reform in China and has attracted considerable attention since 2012. Continuous and efficient operations of hospital are primary concerns of this reform. To ensure the effectiveness of county-based intervention reform measures in Chongqing, it is significant to understand how hospital and county characteristics are associated with county-level public hospital efficiency due to significant development differences between counties. This study identifies the trajectory of hospital efficiency over time and determinants. It will also provide preliminary references for advancing reform.
This study employs data from the Chongqing Regional Health Information Platform, Chongqing Health and Family Planning Statistical Yearbook, and Chongqing Statistical Yearbook for 2012–2016. A three-level growth model is used to estimate the efficiency growth trajectories within the contexts of hospitals and counties.
The intra-hospital level factors that affect the initial efficiency include government financial assistance, daily charge per bed, total assets turnover, number of hospital healthcare technicians, and medical costs per 100-yuan medical income. Inter-hospital variance is explained by hospital type. Inter-county level factors affecting the growth rate include the number of healthcare technicians per 1000 people and population density of the county. The interaction effect of the number of hospital healthcare technicians, hospital type, and number of healthcare technicians per 1000 people on hospital efficiency growth is significant.
This study identifies determinants that contribute to efficiency changes in public county-hospitals over time by using a three-level growth model. The differences in efficiency are associated with intra-hospital, inter-hospital, and inter-county characteristics in Chongqing, which provides useful insight into government decision-making and the progress of reform. The stability and reasonable increase in the number of healthcare technicians in a county are the key factors that improve the efficiency. Further reform should focus on maternal and child healthcare hospitals for increasing investment and implementing government compensation.
Hospitals are one of the main components of the health system and also an important driver of increased health care costs constituting the largest single component of health expenditure in many countries . They now face the daunting challenge of providing safe, effective care in complex organizations strapped by heavy patient loads, limited staffing, and shrinking financial resources . Although the ratio of health expenditures to gross domestic product (GDP) in China has increased from 3.15% in 1980 to 6.36% in 2017 , the government is still confronted with an endemic public deficit. Under these circumstances, the new comprehensive nationwide health care reforms have been initiated by the Chinese government since 2009 and have focused on efficiency, quality, patient-centered care, and payment reforms . In June 2012, the State Council issued the “Opinions on the Comprehensive Reform of Public Hospitals at the County Level” and determined that “the reform of public hospitals should take county hospitals as the breakthrough point,” thus directing the focus of the medical reform to county-level public hospitals.
County-level public hospitals play an important role in the urban and rural medical and health service system in China. There are three types in China—general hospitals (GHs), traditional Chinese medicine hospitals (TCMHs), and maternal and child healthcare hospitals (MCHHs). These serve more than 900 million people, accounting for more than 70% of county residents . In comparison with community health service agencies, township hospitals, and other primary health institutions, county-level hospitals’ internal operation management, external policy environment, commitment to medical tasks, and structure of personnel resources are more complex and dynamic . They have long confronted the challenges of poor medical equipment, outdated technology, and weak scientific research. The reform of county-level public hospitals is targeted at the supply-side to form a more scientific and regulated management system, and mechanisms for governance, compensation, and monitoring, and to improve internal management to upgrade operating performance for safe, high quality, cost-effective, efficient, and better services . Optimizing county health resource allocation and continuous and efficient operations are important considerations of the reform .
Therefore, it is significant to understand the relative efficiency in healthcare resource utilization for the county so that the National Health Commission of the People’s Republic of China (NHCPRC) can develop targeted policy decision-making. Efficiency mainly examines the relationship between input and output. It is used to measure the extent to which resources are used effectively under given input conditions of an organization. Pareto efficiency is optimal under fully competitive market conditions and makes the most of the available resources. However, for public hospitals, in many cases, that do not have total competition in the marketplace, alternative strategies must be devised for improving efficiency in resource use . Moreover, county-level public hospitals seeking to improve efficiency and maximize health outcomes must first address the question of how to identify determinants .
This study identifies determinants of the efficiency of county-level hospitals in Chongqing, China. Chongqing is located in the western part of China and has a population of 30 million. It is spread over a vast area, of which mountains account for 76% . There are significant differences in the development of counties. In 2007, the State Development and Reform Commission officially established Chongqing as a pilot area for the overall development and reform of counties, along with Chengdu. Chongqing is required to comprehensively promote the reform of various aspects, in accordance with the requirements of the reform experiment, for the comprehensive planning of counties. In recent years, Chongqing’s government has taken various effective measures to promote the balanced development of counties and gradually narrow the gap, with the integration of county health as the focus. This requires equity of basic public health and the homogenization of basic medical services. However, due to significant differences between counties, the balanced development of county health services still faces great challenges. To continue developing reform measures that reduce the gap in county health services, it is important to understand whether there is a difference in the efficiency between county-level hospitals in different hospitals and counties, and what determinants influence them. Therefore, we propose the following research questions: How efficiency are county public hospitals? Has the efficiency improved since the new healthcare reform was initiated in 2012? In what ways have efficiency growth trajectories changed over time? Do these trajectories vary significantly across hospitals and counties? If so, are there any hospital or county characteristics associated with this variation? The study assumptions are as follows:hypothesis 1: there is a difference in hospital efficiency between hospitals and counties; hypothesis 2: county characteristics have an impact on efficiency; hypothesis 3: hospital characteristics have an impact on efficiency; hypothesis 4: intra-hospital characteristics have an impact on efficiency; hypothesis 5: intra-hospital, hospital, and county characteristics will affect the efficiency growth and can adjust the relationship between time and it. To answer the above questions and verify hypotheses, the present study examined the relationships among efficiency, intra-hospital, inter-hospital, and inter-county characteristics.
Hospital efficiency analysis is an important issue within the field of health economics, and while there is abundant literature on this subject [6, 10,11,12,13,14,15,16,17,18,19,20,21,22,23,24,25,26,27,28,29,30], only a handful of studies focus on identifying the determinants of hospital efficiency [16,17,18,19,20,21,22]. Moreover, there is little research on which hospital and county characteristics are associated with efficiency changes. A review of the literature on hospital efficiency identifies two contemporary approaches to measure hospital efficiency: parametric and non-parametric approaches . Efficiency measurement methods have been continuously innovated, such as stochastic frontier analysis, data envelopment analysis (DEA), and the bootstrap method. The DEA method has received increasing attention and is a valuable efficiency measurement and benchmarking tool for most organizations, especially in the healthcare sector . This methodology not only expands the applications of efficiency evaluation, but also increases the accuracy of efficiency measurements and provides a new perspective for the study of hospital efficiency. Simultaneously, the research objective has evolved from purely the measurement of efficiency to the discussion of factors affecting efficiency to provide a direction for efficiency improvement. Although some studies use ordinary least squares, Tobit analysis has been the most popular analytical method, wherein the output-based efficiency score or reciprocal of the input-based efficiency score is regressed on variables posited to affect efficiency [32, 33].
The relationships among hospital efficiency and hospital and regional characteristics are often analyzed separately [24, 27, 34]. Prior literature suggests that hospital size and average length of stay are negatively associated with efficiency, whereas occupancy rate, bed-to-nurse ratio, and nurse-to-physician ratio are positively associated with efficiency . Small and rural hospitals are slightly less efficient compared with large and urban hospitals, and teaching hospitals are substantially more efficient compared with non-teaching hospitals . Although such research has attracted increasing attention from scholars, there remains a lack of formal academic studies examining the efficiency of healthcare delivery systems across states or counties. Hussey et al.  note that, between 1990 and 2008, only four studies examined the geographical differences in healthcare efficiency. To date, no study has been conducted on county-level public hospitals’ efficiency change over time to identify variables that accurately predict change across states or counties. Moreover, analysis has been limited to cross-sectional models. Gearhart  hypothesized that cross-country healthcare efficiency rankings should not be the primary tool to drive reform and policy. For policy prescriptions based on efficiency rankings, one should look within a country by considering efficiency rankings among individual states or localities , because there is an objective correlation between individual states and localities. Ignoring the rankings will inevitably bias the analysis results. This highlights the potential for methodological improvement .
A multilevel growth model is an effective statistical model to solve the above contradiction with longitudinal data [38,39,40]. Over the past several decades, longitudinal designs for studying individuals’ growth and change have slowly become popular in the area of psychological well-being (e.g., [41, 42]), although they are rarely used in studies on hospital efficiency. To ensure the effectiveness of county-based intervention reform measures in Chongqing, it is important to understand how hospital and county characteristics were associated with county-level public hospital efficiency. Three-level growth model was used to describe and demonstrate the importance of examining both hospital and county characteristics related to efficiency over time. Through the analysis of different hospital and county characteristics, the effects of these characteristics on the initial efficiency and efficiency growth rate are revealed, and the interaction effects are tested. The variability in efficiency trajectories between hospitals and counties was a unique perspective. The characteristics of counties and hospitals were examined to determine if they explain variability across the average growth trajectories of counties and hospitals.
This study contributes to the current knowledge base by filling the abovementioned gap in literature using the Chongqing case, and presents an innovation by introducing the multilevel growth model into the area of hospital efficiency studies. It will also provide important references for policymakers and hospital managers.
Materials and methods
To study the trajectory of hospital efficiency growth and the effects of hospital and county characteristics on efficiency, a three-level growth model was used. All analyses were conducted using the Mplus 8.0 software and the maximum likelihood robust estimator. In a three-level growth model (see Fig. 1),Footnote 1 Level-1(Intra-hospital level) is a repeated observation at different times in the same hospital, observing the growth trajectory of each hospital over time; Level-2 (Inter-hospital level) is an inter-hospital observation that determines the heterogeneity of individual changes and how different hospital characteristics influence changes in efficiency; Level 3 (Inter-counties level) is a group variable that determines the heterogeneity of changes between counties .
A three-level growth model does not need to assume individual independence and can correct the bias of parameter standard error estimation caused by the non-independence of observation data. The effects of less- and highly independent variables on outcomes can be analyzed simultaneously. Random slope and cross-horizontal interactions can also be analyzed. The initial mean levels of the dependent variable and each explanatory variable can be obtained with parameter estimation results of the fixed component.
After considering the effect of different interpretation variables on the development differences between hospitals, three-level growth model use the difference between the interception and slope to explain the degree of change in the interpretation of the differences through parameter estimation of the random component . Compared with traditional statistical methods, it is more flexible and has advantages in dealing with repeated measurement data.
Sample and data sources
There are 38 counties in Chongqing totally. We implemented a purposive sampling design to obtain a representative sample of county hospitals throughout Chongqing, and to focus on 24 counties on the premise of balancing the geographical, economic, and service population characteristics, as well as hospital operations, according to the recommendation by the Chongqing Health Commission. The sample size was determined by data availability and the DEA method requires a complete set of input and output variables for study.Footnote 2 Efficiency, Intra-hospital changes, hospital characteristics, and county characteristics were measured at five points from 2012 to 2016, forming a repeated measurement of annual data for five years. Relevant operational data were taken from the Chongqing Regional Health Information Platform. Information on county characteristics was supplemented from the Chongqing Health and Family Planning Statistical Yearbook and Chongqing Statistical Yearbook (2012–2016). Finally, 360 observations were obtained, and we had a multilevel longitudinal data set. No patient information was included in the study, so an ethics statement was not needed. An obvious feature of the above data was the multilevel nesting structure: observation time variables were nested in hospitals, and hospitals were nested in counties. The results in a sample of 72 hospitals were nested within 24 counties.
Efficiency requires a production process [or unit] to maximize output for a given level of inputs . Under the limited health resources in counties, the total market competition makes the resource utilization optimal and the efficiency increases gradually. An ability to operate efficiently often depends on the operational conditions and practices, such as the external operational environment in which production occurs, internal characteristics of firms, such as the type and vintage of technology, and managerial practices . Therefore, the above measures of such contextual factors provide a better understanding of efficiency differences and identify the key efficiency determinants across hospitals. The factors of the geopolitical setting, economy, population structure and state of health, health resources, medical market competition, and demand for health services, as discussed in previous literature, pose challenges to healthcare delivery and access. Therefore, we hypothesize that these factors influence the efficiency of hospitals, and, thus, are included in our analysis.
The level-1 variables are measured over five time periods to determine how the efficiency of a hospital changed over five years. Following the literature review [47,48,49], level-1 variables include: financial assistance, medical business area, actual number of beds available, number of hospital healthcare technicians, total fixed assets, daily charge per bed, medical costs per 100-yuan medical income,Footnote 3 total assets turnover, ratio of revenue and expenditure, and asset-liability ratio, on behalf of the hospital’s internal operation management. Level-2 variables identified how different characteristics of hospitals influence changes in hospital efficiency. These variables include hospital grade (unrated, middle second-class, upper second-class, middle first-class, and upper first-class hospitals) and type (GHs, TCMHs, and MCHHs). Level-3 variables identified how county characteristics influence changes in hospital efficiency. These variables include: per capita GDP, number of healthcare technicians per 1000 people (reflecting regional health resources), population density (reflecting population characteristics), density of medical institutions (reflecting medical market competition), and urbanization rate (reflecting counties’ economy, administration, and culture) [50, 51]. Efficiency is hospital technical efficiency scores and came from the input-oriented BCC-CCR DEA model. In this model, the selection of input and output variables was guided by previous empirical studies [49, 52,53,54,55] and systematic clustering analysis, depending on the availability of data in the Chongqing Regional Health Information Platform. Four input indicators and four output indicators were selected. The statistical characteristics of the input-output data are shown in Table 1. Remaining measurement variables of various levels of the multilevel growth model are shown in Table 2.
The model is developed in four main steps. To verify the existence of hierarchy in the data, we first establish an empty Eq. 1 with uninterpreted variables:
Here, Y is the efficiency score of hospitals, t = 0,1,2,3…,represents the year; i = 1,2,3… indicates the hospital; j = 1,2,3… indicates the county; γ000 represents the average of total efficiency, and etij, r0ij, and u00j represent random variations of levels 1, 2, and 3, respectively. π0ij represents the five-year average efficiency of the i hospitals in the j counties, β00j represents the average efficiency of the j counties.
To test for a significant increase in efficiency and variance in levels 2 and 3 and to determine the rate of this growth change, we established an unconditional growth model (random coefficient model, Eqs. 2 and 3). Level 1 includes only T (time variables), and levels 2 and 3 did not include any explanatory variables; we set the slope of the time variables to be random. Models of linear growth (Eq. 2) and nonlinear growth (Eq. 3) were established to investigate the possible growth curve of efficiency.
Here, r0ij is an interceptor residual in Level 2, r1ij is a slope residue residual in Level 2; u00j is an interceptor residual in Level 3, u10j is a slope residue residual in Level 3. β10j is the average linear growth rate of efficiency in the j hospitals, and γ100 is the overall average linear growth rate of efficiency. The remaining parameters have the same meaning as Eq. 1.
Here, β20j is the average nonlinear growth rate of efficiency in j hospital, γ200 is the average nonlinear growth rate of efficiency, and u20j is the slope residue residual in Level-3. The remaining parameters have the same meaning as Eq. 2.
Based on Eq. 2 and Eq. 3, we include the explanatory variables at level 3 (Eq. 4) and level 2 (Eq. 5), and level 1 remained unchanged. To prevent multicollinearity between the interaction and original variable, explanatory variables at level 3 were grand-mean center processed. All variables at level 2 were categorical or hierarchical variables without centralization. Based on Eq. 5, the explanatory variables at level 1 were treated as group-mean centered and included to create Eq. 6. In Eqs. 4, 5 and 6, γ00p(p = 1,2,3 ... 5) is the slope of the influence of the level 3 interpretation variable on the initial efficiency score; γ10p(p = 1,2, 3 ...5) is the slope of the influence of the level 3 interpretation variables on the growth rate of efficiency; β0pj(p = 1,2,3,4) is the slope of the level 2 interpretation variable on the initial efficiency score; and β1pj(p = 1,2,3,4) is the slope of the level 2 interpretation variable on the efficiency growth rate. The remaining parameters have the same meaning as previous models.
To test the interaction effect between a single variable at level 1 and the time, the slope of each explanatory variable at level 1 is set separately as the cross-layer random slope. The results show that the random slope of all these variables is not significant at levels 2 and 3, and so we fix all their slopes. This study assumes that variables FP, A2, A3, A6, and A11 affect the growth rate; that is, the relationship between time and efficiency. The interaction between these explanatory variables and time are included in the respective models, thus resulting in Eq. 7 (the full model).
Among them, π12ij 、π13ij 、π14ij 、π15ij are the slope of the interaction items of A2, A3, A6, and A11 with the time variable T on the initial efficiency. Other parameters have the same meaning as the preceding model.
Descriptive statistics were depicted for the hospitals’ efficiency scores and other continuous variables across the five measurement points (Tables 3 and 4). As seen in Table 3, the mean efficiency score was 0.79 in 2012 and 0.85 in 2016, exhibiting a trend that was growing at an increasing rate in Chongqing. Due to lack of the national average efficiency scores, we did literature review and found the score in 2012 was lower than those scores in other provinces [56,57,58,59], the changes over time indicate a diversifying trend of efficiency over the years.
The results of Eq. 1 (Table 5) showed that the intraclass correlation coefficient (ICC) is 48.2% (ICC > 16%), indicating that 48.2% of total variance in average efficiency existed at level 2. For level 3, 6% < ICC < 16% (ICC = 8.1%), which indicated that 8.1% of the total variance in average efficiency exists at level 3 . Based on this, the preliminary judgment was that there are statistically significant variance at both levels 2 and 3 . Because the multilevel growth model considers both the initial efficiency and the slope, we must combine the significant test results of the increasing slope of Y in level 3 to judge the suitability of the three-level model.
The results of Eqs. 2 and 3 (Table 5) showed that the average growth rate of the linear growth model was significant (β = 0.016). There was a significant, negative correlation between the linear growth rate and initial efficiency (r = − 0.003), indicating that the lower the initial efficiency score, the higher the growth rate. However, the primary (linear) growth rate of the nonlinear growth model was significant (β = 0.028) and the secondary (nonlinear) growth rate was not significant (β = − 0.003), suggesting that linear growth is maintained. In addition, the growth variance of the linear growth model was significant at levels 2 and 3, but variance of the primary and secondary growth rates in the nonlinear growth model were not significant. This suggests that the growth rate of only the linear growth model differs between hospitals and counties. In addition, judging from the model-fitting, the Akaike and Bayesian information criteria of the linear growth model were lesser than those of the nonlinear growth model, indicating that the linear growth model fitted better. Judging from the above, county public hospital efficiency exhibits linear growth, and this growth was different for different hospitals and counties. Thus, the multilevel linear growth model for the “time-hospital-county” was suitable in this context.
Adding variables in turn from level 3 to level 1 resulted in Eqs. 4, 5 and 6Footnote 4 and model 7. According to the results of the full model (Eq. 7) in Table 5, FP (β = 0.324), V1 (β = 0.114), and V8 (β = 0.041) had significant, positive effects on the initial efficiency, while A6 (β = − 0.006) and V7 (β = − 10.366) had significant, negative effects. In level 2, the influence of the variable GHP on the initial efficiency was not significant, and the initial efficiency of MCHHs was significantly higher than that of GHs (β = 0.11). However, there was no significant difference between the initial efficiency score of TCMHs and GHs, and no variables at level 3 had significant impacts on initial efficiency. In terms of growth rate, the efficiency growth rate of MCHHs at level 2 was significantly lower than that of GHs (β = − 0.036). The GHP had no significant impacts on the growth rate, and there was no significant difference in the efficiency growth rate between TCMHs and GHs. The variable D1 in level 3 had a significant, positive effect on the growth rate (β = 0.009). However, the impact of GDP, DP, HP, and CZ on the growth rate was not significant. Results of the simultaneous interaction were shown in Table 5 and depicted a significant increase in hospital efficiency (β = 0.025); that is, an average annual increase of 0.025. At level 1, only the interaction of A6 and T were significant (β = 0.003). In addition, THP (FY) and D1 also had significant impacts on the growth rate. To better understand the results of the final model (Eq. 7), we showed the results graphically in Fig. 2. The graphs displayed the model-based trajectories for A6, THP, and D1, further subdivided by high and low levels, which were defined as one standard deviation (SD) above and below the mean, respectively. According to the results of Table 6, when D1 and A6 are high, the efficiency of the GHs increases significantly (the slope was 0.064, with an average annual increase of 0.064). For a high D1 and low A6, the efficiency of the MCHHs decreased significantly (the slope was − 0.049, with an average annual decrease of 0.049).
Effective health promotion measures are a crucial part of bringing the differences of efficiency in the initial efficiency and linear growth between hospitals and counties in Chongqing into parity. The results presented in section 4 provide timely implications.
Inter-County level implications
Previous studies suggest that greater competition is positively associated with efficiency . However, the present study finds that HP does not affect the initial score and growth rate of hospital efficiency. Possible explanation of this result is that a county’s medical market competition cannot function well as a market that allocates resources due to the existence of monopoly, externality, etc. Existing health resources of hospital are still far from meeting the service requirements. Further analysis is needed to confirm this explanation. Moreover, D1 has a significant, positive impact on the growth rate of efficiency. Combined with the theory of economies of scale, it should take into account the service radius, population density, amount of services that hospitals can actually carry, and competition between county medical institutions in expanding the resources and scale to avoid blind development. Therefore, maintaining the stability of the current number and reasonable increase in the number of new county health technicians is significant to the next reform according to model results.
Geographical locations are also significant determinants of efficiency , although this study illustrates that the impacts of GDP and CZ on the growth rate are not significant. This is in contrast with the traditional relationship between hospital service efficiency and the level of economic development seen in the past, and it provides another perspective for future researchers other than the level of counties’ economic development.
Inter-hospital level implications
This study shows that GHP has no effect on the initial efficiency and growth rate of hospital efficiency. The initial efficiency score for MCHHs is higher than that for GHs, and there is no significant difference in the initial efficiency and growth rate between TCMHs and GHs. However, the growth rate of MCHHs is significantly lower than that of GHs. This means that, in 2012, the efficiency of MCHHs was relatively high in Chongqing, but efficiency growth between 2012 and 2016 was significantly lower for GHs and TCMHs. The reason may be that, since the new medical reform, the state has reformed GHs and TCMHs more vigorously to ensure they are fully functional and effective. Meanwhile, the construction of a traditional medicine services system has been incorporated into regional health plans. As the main entities of this system, TCMHs have increased investment in infrastructure and personnel, strengthened discipline development, vigorously promoted appropriate technologies, improved their ability to innovate in science and technology, and improved their overall efficiency. Further reform should focus on MCHHs for increasing investment and implementing government compensation.
Intra-hospital level implications
FP has a positive impact on the initial efficiency of public hospitals at level 1, which is in line with a previous study . One reasonable explanation is that the General Office of the State Council issued the “Guidance on the Comprehensive Reform of Urban Public Hospitals” on May 17, 2015 (National Office, 2015, No. 38) and proposed that the compensation channel for public hospitals should be changed from original service charges, income from the sale of drugs, and government subsidies to service charges and government subsidies. As an important source of compensation, government subsidies have a positive impact on the operation of public hospitals.
In a review of the literature on medical personnel, Tsekouras et al.  find that medical personnel are crucial for the improvement of public hospitals’ productive efficiency. Results of the present study show that A6 has a significant, negative impact on the initial efficiency. This is consistent with the information revealed by the iutput-oriented DEA model, which hints that the number of health technicians in the hospital must be reduced to be more efficient in a given output, and also match the principles of basic microeconomics.
Moreover, V7 has a significant, negative effect on the initial efficiency. The “Guidance of the General Office of the State Council on the Pilot Reform of Urban Public Hospitals” (National Office, 2015, No. 38) notes that, by 2017, the consumption of health materials in V7 of public hospitals in pilot cities will be reduced to less than 20 yuan. This indicator is used as a key factor in the cost control of hospitals. The control of the consumption ratio of 100-yuan medical income has promoted the rationalization and adjustment of the medical income structure, optimized the level of hospitals’ organizational efficiency, effectively promoted the structural adjustment of medical income, and improved hospital efficiency .
Implications of the interaction of variables
An important implication of the results is that A2, A3, A6, and A11 separately affect the relationship between T and efficiency, which can significantly affect growth rates. When these four interaction items are included simultaneously, there is a significant increase in efficiency, with an average annual increase of 0.025. However, only D1, THP, and A6 remain significant, and interactions of other terms should be explored in future research with a larger sample. The stability and increase of D1 in a county are factors that improve the efficiency of county-level hospitals in Chongqing.
Finally, it should be noted that the situation of county-level public hospitals in different counties of Chongqing is more complex, and the limited factors in this model cannot fully explain the growth trajectory of hospital efficiency or the differences. The results of the analysis show that after considering the relevant factors of hospital and county characteristics, some indicators still exhibit significant differences between hospitals and counties. Some hospital-specific indicators, such as FP, V1, and V8, also vary between hospitals or counties. The difference is mainly reflected in the initial efficiency rather than the growth rate. That is, these differences in indicators can be explained by factors at the hospital level. In this study, the variation of hospital efficiency is decomposed into the difference among Intra-hospital, Inter-hospitals, and Inter-counties so that the random error of individuals is purer, and the obtained parameters are more accurate. The reasons for the difference in hospital efficiency can be more rationally analyzed and explained. As studies on hospital efficiency have infrequently used multilevel growth models, the results of related studies should be interpreted and treated with significant caution. The following are noteworthy limitations of this study. First, the sample size for this study is relatively insufficient, and some meaningful results have not been observed. Although, results of the study have good robustness to the change in the efficiency trend, because five rounds of panel data were selected . Second, this study is limited by the variables available in the Chongqing Information Platform. Other variables not incorporated in the model include the health policy system, health service needs, responsiveness, and health status of the population, which can be collected through interviews, questionnaires, etc. The study’s implications are relatively limited, which limits the pertinence and reliability of the research conclusions. Third, reform itself is really a non-ignorable factor for hospital efficiency change over time. Since it is not the focus of this paper, it is not taken into account in this research design. Discussing the impact of reform on efficiency will be a meaningful direction for future studies.
Despite these limitations, this study is a useful preliminary study, based on the existing information system platform, to explore factors over time and at different levels in Chinese county-level hospitals during the period of new healthcare reform.
This study describes and demonstrates the importance of examining both hospital and county characteristics related to efficiency over time. With the application of multilevel analysis techniques, the method of hospital efficiency evaluation has undergone a fundamental change. A three-level growth model describes relationships between time, hospital characteristics, and county characteristics. In this study, the variation of hospital efficiency is decomposed into different levels, which increases the purity of the random error of individuals, and the parameter estimation is more accurate. The reasons for the difference in hospital efficiency can be analyzed and explained more accurately. The results of this study illustrate that per capita GDP has no significant effect on efficiency, but government financial assistance to hospitals has a significant, positive effect. This is because counties with a developed economy can guarantee financial subsidies to hospitals. There is a possibility that a county’s economy indirectly affects hospital efficiency through fiscal aid. Therefore, there is a need within this field for further studies that use a large sample. Combined with the above results, the stability and reasonable increase in the number of healthcare technicians in a county are the key factors that improve the efficiency of county-level hospitals in Chongqing. Further reform should focus on MCHHs for increasing investment and implementing government compensation.
Availability of data and materials
All data generated or analyzed in this study are included in this published study and the additional tables. The used statistical data during this research are available on the official website of the Chongqing Health Statistics, http://tj.cqshic.com/category.aspx?id=5c4e162b-e84b-4964-9b43-83f2a38d58ed
The datasets and materials during the current study are available from the corresponding author on reasonable request.
In this figure, horizontal arrows represent the role of a horizontal variable, and diagonal arrows represent the interaction between horizontal variables.
The minimum sample capacity of the DEA model is 2*N*M, where N, M represent the number of inputs and output indicators, respectively.
In China, the medical costs per 100-yuan medical income is measured as follows: (medical business cost + administrative cost) / (medical income * 100) and is used to measure hospital cost management.
Models 4, 5, 6 were estimated, but their results were not discussed due to space limitations.
Data envelopment analysis
Gross Domestic Product
Intraclass correlation coefficient
Maternal and child healthcare hospitals
Traditional Chinese medicine hospitals
Barber SL, Borowitz M, Bekedam H, Ma J. The hospital of the future in China: China’s reform of public hospitals and trends from industrialized countries. Health Policy Plan. 2014;29:367–78.
Tucker AL, Singer SJ, Hayes JE, Falwell A. Front-line staff perspectives on opportunities for improving the safety and efficiency of hospital work systems. Health Serv Res. 2008;43:1807–29.
National Health Commission of the People’s Republic of China. China Health Statistics Yearbook 2018. China Union Medical University Press; 2018. p. 93.
Fang PQ, Min R, Zou XX. Key points and pathway of county public hospital reform in China. Chin Hosp Manag. 2014;34:4–8.
Li NN, Wang CH, Ni H, Wang H. Efficiency and productivity of county-level public hospitals based on the data envelopment analysis model and Malmquist index in Anhui. China Chin Med J. 2017;130:2836–43.
Cheng ZH, Tao HB, Cai M, Lin HF, Lin XJ, Shu Q, et al. Using a two-stage data envelopment analysis to estimate the efficiency of county hospitals in China: a panel data study. Lancet. 2015;386(Suppl 1):64.
Jacobs R, Smith P, Street A. Measuring efficiency in health care: analytic techniques and health policy. Cambridge: Cambridge University Press; 2006.
Cantor VJM, Poh KL. Integrated analysis of healthcare efficiency: a systematic review. J Med Syst. 2018;42:8.
Chongqing Municipal People's Government: City Profile. http://www.cq.gov.cn/zqfz/zhsq/sqjj. Accessed 20 Feb 2018.
Sun J, Luo H. Evaluation on equality and efficiency of health resources allocation and health services utilization in China. Int J Equity Health. 2017;16:127.
Hollingsworth B, Wildman J. The efficiency of health production: re-estimating the WHO panel data using parametric and non-parametric approaches to provide additional information. Health Econ. 2003;12:493–504.
O'Neill L, Rauner M, Heidenberger K, Kraus M. A cross-national comparison and taxonomy of DEA-based hospital efficiency studies. Socio Econ Plan Sci. 2008;42:158–89.
Garcia-Lacalle J, Martin E. Rural vs urban hospital performance in a ‘competitive’ public health service. Soc Sci Med. 2010;71:1131–40.
Rosko MD, Mutter RL. What have we learned from the application of stochastic frontier analysis to U.S. hospitals? Med Care Res Rev. 2011;68:75S–100S.
Magnussen J. Efficiency measurement and the operationalization of hospital production. Health Serv Res. 1996;31:21–37.
Grosskopf S, Margaritis D, Valdmanis VG. Competitive effects on teaching hospitals. Eur J Oper Res. 2004;154:515–25.
Lee KS, Chun KH, Lee JS. Reforming the hospital service structure to improve efficiency: urban hospital specialization. Health Policy. 2008;87:41–9.
Blank JL, Valdmanis VG. Environmental factors and productivity on Dutch hospitals: a semi-parametric approach. Health Care Manag Sci. 2010;13:27–34.
Tsekouras K, Papathanassopoulos F, Kounetas K, Pappous G. Does the adoption of new technology boost productive efficiency in the public sector? The case of ICUs system. Int J Prod Econ. 2010;128:427–33.
Nedelea IC, Fannin JM. Analyzing cost efficiency of critical access hospitals. J Policy Model. 2013;35:183–95.
Ding DX. The effect of experience, ownership and focus on productive efficiency: a longitudinal study of US hospitals. J Oper Manag. 2014;32:1–14.
Chowdhury H, Zelenyuk V. Performance of hospital services in Ontario: DEA with truncated regression approach. Omega. 2016;63:111–22.
Chilingerian JA. Evaluating physician efficiency in hospitals: a multivariate analysis of best practices. Eur J Oper Res. 1995;80:548–74.
Rosko MD. Cost efficiency of US hospitals: a stochastic frontier approach. Health Econ. 2001;10:539–51.
Staat M. Efficiency of hospitals in Germany: a DEA-bootstrap approach. Appl Econ. 2006;38:2255–63.
Wang X, Luo H, Qin X, Feng J, Gao H, Feng Q. Evaluation of performance and impacts of maternal and child health hospital services using data envelopment analysis in Guangxi Zhuang autonomous region, China: a comparison study among poverty and non-poverty county level hospitals. Int J Equity Health. 2016;15:131.
Herr A, Schmitz H, Augurzky B. Profit efficiency and ownership of German hospitals. Health Econ. 2011;20:660–74.
Chang SJ, Hsiao HC, Huang LH, Chang H. Taiwan quality indicator project and hospital productivity growth. Omega. 2011;39:14–22.
Sultan WIM, Crispim J. Measuring the efficiency of Palestinian public hospitals during 2010-2015: an application of a two-stage DEA method. BMC Health Serv Res. 2018;18:381.
Zheng W, Sun H, Zhang P, Zhou G, Jin Q, Lu X. A four-stage DEA-based efficiency evaluation of public hospitals in China after the implementation of new medical reforms. PLoS One. 2018;13:e0203780.
Barros CP, Gomes de Menezes A, Peypoch N, Solonandrasana B, Vieira JC. An analysis of hospital efficiency and productivity growth using the Luenberger indicator. Health Care Manag Sci. 2008;11:373–81.
Fried HO, Schmidt SS, Yaisawarng S. Incorporating the operating environment into a nonparametric measure of technical efficiency. J Prod Anal. 1999;12:249–67.
Harris JE. The internal organization of hospitals: some economic implications. Bell J Econ. 1977;8:467–82.
Burgess JF Jr, Wilson PW. Hospital ownership and technical inefficiency. Manag Sci. 1996;42:110–23.
Hussey PS, de Vries H, Romley J, Wang MC, Chen SS, Shekelle PG. A systematic review of health care efficiency measures. Health Serv Res. 2009;44:784–805.
Gearhart R. The robustness of cross-country healthcare rankings among homogeneous OECD countries. J Appl Econ. 2016;19:113–43.
Hafidz F, Ensor T, Tubeuf S. Efficiency measurement in health facilities: a systematic review in low- and middle-income countries. Appl Health Econ Health Policy. 2018;16:465–80.
Singer JD. Using SAS PROC MIXED to fit multilevel models, hierarchical models, and individual growth models. J Educ Behav Stat. 1998;23(4):323–55.
Gee KA. Multilevel growth modeling: an introductory approach to analyzing longitudinal data for evaluators. Am J Eval. 2014;35:543–61.
Westra D, Angeli F, Carree M, Ruwaard D. Coopetition in health care: a multi-level analysis of its individual and organizational determinants. Soc Sci Med. 2017;186:43–51.
Mroczek DK, Spiro A III. Change in life satisfaction during adulthood: findings from the veterans affairs normative aging study. J Pers Soc Psychol. 2005;88:189–202.
Taylor IM, Ntoumanis N, Standage M, Spray CM. Motivational predictors of physical education students’ effort, exercise intentions, and leisure-time physical activity: a multilevel linear growth analysis. J Sport & Exerc Psychol. 2010;32(1):99–120.
Heck RH, Thomas SL. An introduction to multilevel modeling techniques. 2nd ed. London: Psychology Press; 2008. p. 163–200.
Zheng WE. Review of the application of multi-level linear model in panel research. Manag Sci. 2011;24:111–20.
Bliese PD, Chan D, Ployhart RE. Multilevel methods: future directions in measurement, longitudinal analyses, and nonnormal outcomes. Organ Res Methods. 2007;10:551–63.
Lee CY, Johnson AL. Two-dimensional efficiency decomposition to measure the demand effect in productivity analysis. Eur J Oper Res. 2012;216:584–93.
Cheng Z, Tao H, Cai M, Lin H, Lin X, Shu Q, et al. Technical efficiency and productivity of Chinese county hospitals: an exploratory study in Henan province. China BMJ Open. 2015;5:e007267.
Worthington AC. Frontier efficiency measurement in health care: a review of empirical techniques and selected applications. Med Care Res Rev. 2004;61:135–70.
Kirigia JM, Asbu EZ. Technical and scale efficiency of public community hospitals in Eritrea: an exploratory study. Health Econ Rev. 2013;3:6.
Afonso A, St. Aubyn M. Assessing health efficiency across countries with a two-step and bootstrap analysis. Appl Econ Lett. 2011;18:1427–30.
Rahman MA, Capitman JA. Factors affecting profit efficiency of private hospitals in Bangladesh: are urban hospitals more profit-efficient? J Health Manag. 2012;14:83–96.
Ng YC. The productive efficiency of Chinese hospitals. China Econ Rev. 2011;22:428–39.
Li H, Dong S, Liu T. Relative efficiency and productivity: a preliminary exploration of public hospitals in Beijing China. BMC Health Serv Res. 2014;14:158.
Ozcan YA, Luke RD. A national study of the efficiency of hospitals in urban markets. Health Serv Res. 1993;27:719–39.
Sherman HD. Hospital efficiency measurement and evaluation: empirical test of a new technique. Med Care. 1984;22:922–38.
Wang Y. Efficiency evaluation of medical Services in Shandong County Public Hospitals. Shandong University 2015.
Zhang XN. Analysis on the effect of comprehensive reform of county-level public hospitals in Jiangsu Province. Nanjing University of Chinese Medicine2018.
Chen JX. Trial reform of public hospitals at the county level in Fujian province efficiency analysis-based on empirical analysis of the DEA model. Tianjin Medical University2016.
Zhang XH. Study on efficiency for medical resources allocation of Ningxia County public hospital. Ningxia Medical University 2016.
Cohen J. Statistical power and analysis for the behavioral sciences. New York: Academic Press; 1997. p. 456–67.
Snijders TAB, Bosker R. Modeled variance in two-level models. Sociol Methods Res. 1994;22:342–63.
Yang SX, Dai T, Ju H. The impact of financial subsidy of economic operation of county-level hospitals: empirical analysis based on pilot counties. Chin Health Econ. 2016;35:10–3.
Wen SD, Jiang Z, Li Z, Zhang T, Fan C, Jiang B. Application practice on the consumable proportion of target examination’s medical income costed above 100 Yuan. Chin Health Econ. 2017;36:83–4.
We are grateful to all researchers involved in the project as well as all the experts for reviewing the manuscript.
This study was supported by The Loan Project of the International Bank for Chongqing Coordinated Urban and Rural Development and Reform Project (CURIP) Phase II Health Project(P126210). Funding body had no role in the design of the study and collection, analysis, and interpretation of data and in writing the manuscript, which is solely the work of the authors.
Ethics approval and consent to participate
Not applicable. This manuscript does not involve the use of any animal or human data or tissue.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Liu, J., He, B., Xu, X. et al. Determinants of efficiency growth of county-level public hospitals-evidence from Chongqing, China. BMC Health Serv Res 19, 858 (2019) doi:10.1186/s12913-019-4609-9
- County hospital efficiency
- Three-level growth model
- Longitudinal data