Assessment of maternal services in China based on WHO’s comprehensive evaluation model
BMC Health Services Research volume 22, Article number: 1571 (2022)
To understand the trend of equalization in maternal services and to guide policy-makers regarding resource allocation and public health policy in China.
Twelve indicators, including maternal services needs, utilization, and resource allocation, were collected from China Health Statistical Year Book 2010 and 2020. WHO’s comprehensive evaluation model and the non-integral Rank Sum Ratio (RSR) method were used to analyze, rank, and categorize maternal services of 31 provinces (cities, autonomous regions) in China.
All provinces (cities, autonomous regions) are grouped into relative balance areas, low input areas, resource shortage areas, overutilization areas, and resource waste areas. In 2019, there were 18 provinces (cities, autonomous regions) in the relative balanced area, and more than one-half had achieved equal development. Compared to 2009, the resource shortage area decreased from three to zero, and the resource waste area increased from four to six. Among the provinces (cities, autonomous regions) with a type change compared with 2009, eight changed to a relative balance areas, and four showed an improvement.
Under the policy guidance of promoting the equalization of public health services, maternal services are gradually realized. However, several provinces (cities, autonomous regions) still have problems such as the mismatch between resource input and health needs, resource waste, over-utilization, etc. Therefore, specific policies should be formulated according to the actual types to promote the transformation into equalization regions.
Maternal health is decisive for the country, and maternal mortality is one of the most important indicators to measure the development of social and economic, and social equity . Since 2000, 189 heads of state, including China, signed the Millennium Declaration and committing themselves to achieve target 5, which was to the reduce maternal mortality ratio by three-quarters between 1990 and 2015 . Without exception, all had made continuous efforts to achieve the goal. In China, it had promulgated laws and policies such as the law of the People Republic of China on Maternal and Infant Health Care, the Program for the Development of Chinese Women (2001–2010), and implemented the project of reducing maternal mortality and eliminating neonatal tetanus in 378 counties of 12 provinces in western China, and so on [3, 4]. Under the efforts of the government and people, the target for Millennium Development Goal 5 achieved ahead of schedule in 2014. The past two decades, China has pushed down the maternal mortality ratio at an annualized rate of 6.5% per year, one of the fastest decreases in the world [5, 6]. In recent years, the maternal mortality rate showes a decreasing trend, but there are still gaps among regions and have reached the bottleneck stage [7,8,9]. The healthy China Initiative 2019 to 2030 states that the maternal mortality ratio should reduced to 12.0 per 100,000 by 2030 . It is a great challenge to take measures to reduce the maternal mortality rate continuously.
In 1996, World Health Organization (WHO) and Swedish International Development Cooperation Agency (SIDA) proposed that equity in health services means that all members of society have the same access to health services, without differences based on social privileges . Therefore, the same access to health services in the same state of health and disease is a fundamental right of members of society. The research showed that the frequency of prenatal check-ups, the proportion of systematic management of high-risk women, the rate of a new delivery, and hospital delivery were the influencing factors of maternal death [12,13,14]. Strengthening the management of maternal to improve the quality and level of maternal health care is an important measure to implement the Healthy China Strategy. At the same time, the impact of economics on maternal mortality is also crucial [15, 16]. Inadequate funding, resources, and level of health services can lead to poor access to health services, unreasonable allocation, and under-utilization of resources, which directly affect maternal health and make it unequal across regions. Therefore, it is urgent to solve the problem of whether the decrease in maternal mortality is caused by insufficient investment or inadequate utilization of resources, and whether health needs and health supply are balanced.
In 2009, promoting equalization of Basic Public Health services was one of the five major tasks of China’s health care reform, aiming to ensure that all residents in urban and rural areas could access the services and focus on equity [17, 18]. The seventh population census in 2020 showed that population growth has slowed, mainly due to the continuous decrease in fertile women that has led to a weakening of the momentum of population growth and a slight decline in the fertility level. Meanwhile, the proportion aged 65 and above reached 13.50%, which was higher than the world average of 9.3% . With the aging population increasing and fertility level decreasing, it has put forward higher requirements for the health of fertile women, especially for maternal. Maternal health is the foundation of universal health and is the main object of public health services. Equity is the focus of research.
The study aimed to understand the relationship among maternal service needs, utilization, and resource allocation of 31 provinces (cities, autonomous regions) in China in 2009 and 2019, using a multi-index comprehensive evaluation method. Also, from the perspective of equity and efficiency to understand the changing trends and differences in the region, and provide guidance for policymakers regarding resource allocation and public health policy.
The data that included maternal services needs, utilization, and resource allocation was retrieved from the China Health Statistics Yearbook 2010 and 2020 (http://www.nhc.gov.cn/mohwsbwstjxxzx/tjtjnj/new_list.shtml) [20, 21]. Twelve indicators were selected to comprehensively evaluate and analyze the equalization of maternal services across 31 provinces (cities, autonomous regions).
The three maternal services needs indicators X1 ~ X3 are maternal mortality rate (1/100,000), the proportion of obstetric hemorrhage in maternal deaths (%), and pregnancy-induced hypertension.
in maternal deaths(%). The five indicators X4 ~ X8 in the utilization of maternal services are.
registration rate (%), system management rate (%), prenatal checkup rate (%), postpartum visitrate (%), and hospital delivery rate (%). The maternal system management rate refers to the.
number of women who have received early pregnancy checkups, antenatal checkups, sterile.
delivery, and postpartum visits within 28 days after delivery to the number of live births in a given area during the year. Four resource allocation indicators X9 ~ X12 are the number of medical institutions (1/100,000), the number of practicing (assistant) physicians (1/1000), and the number of registered nurses (1/1000), the number of obstetrics and gynecology beds (1/100,000). Combined with the responsibilities of maternal health care and the desirability of indicators, the institutions includecomprehensive hospitals, primary medical institutions, maternal and child health hospitals (stations). Health technicians are involved physicians and nurses in maternal and child health hospitals (stations).
The RSR method
The fundamental theory of the RSR method is that a dimensionless statistical indicator is calculated from an n × m matrix using rank conversion. After this calculation, the distribution of RSR using parametric statistical methods. Generally, the RSR indicator ranges from zero (worst) to one (best) and follows a normal distribution. Additionally, the status (worst/best) uses the RSR order or a set of ordinal classifications to evalute .
In our study, the RSR method was used to rank and classify 31 provinces in China in terms of maternal service needs, utilization, and resource allocation, respectively. All indicators used the same weight, and considering that the integer rank method would lose the original data information, the non-integer rank RSR was adopted to overcome the disadvantage of losing the quantitative information of the original data.
The detailed processes are as follows:
Rank the indicators of maternal services in each province, the high-quality ranked in ascending,and the low-quality indicator ranked in descending order, such as
Where R is the rank of each maternal services indicator of 31 provinces in China, X is the original value, n = 31, Except for maternal mortality rate, the other is high quality in the study.
Calculate the value of RSR, the equation as follows
Where Rij is the rank of indicators in maternal services needs, utilization, and resource allocation, m is the number of indicator in each dimension, n is the number of provinces, i = 1,2∙∙∙n, j = 1,2∙∙∙m.
Determine the distribution of RSR. Sort the RSR from small to large; calculate the downward
cumulative frequency P (average rank/n*100%) according to the cumulative frequency and average rank; then convert it into Probit.
Calculate the regression equation. The value of RSR as the dependent variable and Probit as the
independent variable to fit the linear regression equations of maternal services needs, utilization, and resource allocation, then calculate the fitted RSR of each region.
Grading and sorting. Concerning the commonly used three-grading table, the Probit critical values are substituted into the regression equation to calculate the RSR critical values for grading, and variance analysis is used to compare the differences among groups. SNK-q is used for pairwise comparison; the statistically significant level is set at P < 0.05
WHO’s comprehensive evaluation model
Based on the investigation of health services in many countries and regions, the WHO proposed to combine health service needs, utilization, and resource input, and grade the sample mean of the three categories of indicators to form eight evaluation types from A to H , as shown in Table 1.
Type A and H indicate appropriate allocation of resources. The high resource utilization is types B and F, types C and E mean low and over resource utilization, respectively. Types D and G indicate the low and over the investment of resources.
In China, scholar Chen H and others established the comprehensive evaluation modelof Basic Public Health services, and combined the method of RSR, which is grouped into five categories, including relative balance area (types A,H, and F), low input area (type B), resource shortage area (type D), overutilization area (type E), and resource waste area (types C and G), which is detailed in Table 2 .
In our study, we used it for reference to carry out comprehensive evaluation of maternal services.
The RSR value in needs, utilization, and resource allocation of maternal services across China in 2009 and 2019
According to the RSR value ranking evaluation of the maternal services in each region, in 2009, the top three maternal health needs were in Xizang, Qinghai, and Xinjiang. The utilization of maternal health care was in Beijing, Zhejiang, and Shandong, and the resource allocations were in Beijing, Ningxia, and Xinjiang. While ten years later, the top three maternal health needs were in Xizang, Tianjin, and Qinghai; maternal health care utilization was in Zhejiang,Tianjin, and Guangxi; resource allocations were in Guizhou, Ningxia, and Qinghai (Table 3).
The distribution of RSR in needs, utilization, and resource allocation of maternal services across China in 2009 and 2019
According to the value of RSR and Probit (Table 4), six regression equations were obtained. In 2009, regression equations in needs, utilization, and resource allocation of maternal services were RSR1= 0.132Probit-0.37 (r = 0.798), RSR2 = 0.136Probit-0.029 (r = 0.693), RSR3 = 0.125Probit-0.293 (r = 0.964), respectively. In 2019, they were RSR4 = 0.126Probit-0.36 (r = 0.849), RSR5 = 0.113Probit + 0.281 (r = 0.444), RSR6 = 0.130Probit-0.289 (r = 0.921). The results of variance analysis showed that all regression equations were statistically significant (P < 0.05).
Grading and sorting maternal services needs, utilization, and resource allocation across China in 2009 and 2019
The Probit critical values of 4 and 6 were substituted into all regression equations to calculate the RSR as the basis of classification, and then calculated the fitted values of RSR in maternal service needs, utilization, and resource allocation of all provinces, and the final results were shown in Table 5 and Table 6.
The test of variance consistency showed no significant differences among groups in each dimension (P > 0.05). In 2009, an analysis of variance showed that the statistics value F of maternal service needs, utilization, and resource allocation were 36.424, 36.431, and 36.363, respectively, and 36.565, 36.306, and 36.507. In 2019, there were significant differences in the fitted values of RSR among groups of each dimension (P < 0.05). The SNK-q test showed a significant difference pairwise, and the grading was reasonable.
The comprehensive evaluation of maternal services in 2009 and 2019
According to the results of grading, all regions were filled into the model (Table 7). In 2009, the relative balance area, low input area, resource shortage area, resource waste area, and overutilization area were16, 3, 4, 3, and 5, respectively. In 2019, they were 18, 3, 6, 0, and 4, respectively.
Since China announced a health reform blueprint to achieve universal coverage by 2020, the equalization of public health services between different regional, urban and rural areas has gradually improved [25,26,27,28,29]. The research showed that 18 regions were in the relative balance area in maternal health resources allocation and health needs, and more than half had met the requirements for equitable development, which was higher than that of 16 provinces in 2009. In addition, the overutilization area decreased one province, and the resource shortage area decreased three. Compared to 2009, several regions experienced a type shift, eight changed from non-balanced to a relative balance area, and four showed an improvement in type. It indicated that under the guidance of the Public Health Service policy, including system construction, project promotion, serviceability strength, and the fund guarantee, the equalization of maternal services were gradually being realized.
In 2019, three regions were still in the low input area, and the resource allocation was not meet the needs. From the perspective of regional GDP, these were at the bottom in 2019. The economy could limit fund-raising ability, which leads to insufficient investment in infrastructures such as institutions, personnel, and beds; the RSR value of resource allocation ranked in the bottom five. At the same time, the limit on salary, training, and promotion opportunities resulted in brain drain, personnel shortage, insufficient service capacity, and other issues. According to research statistics, the full-time public health personnel in primary medical health institutions accounted for only 10% of health technicians in 2017, and 31% of physicians in urban community health service centers (stations) failed to meet the requirements of practicing assistant physicians in 2015 . Therefore, it is critical to strengthen financial investment and consolidate the appropriation of special funds.
Ten years later, 10 regions still with low efficiency in maternal services, of which six were resource waste and four were over-utilized areas, resource waste coexists with overutilization. Under the guidance of macro policies, while the whole country was actively implementing the public health services tasks, the control of the efficiency of resource utilization had been neglected, especially for consideration of professional public health institutions. Therefore, it is urgent to integrate resources and optimize the utilization efficiency of health resources. We should combine the system of grading diagnosis and treatment to improve the capacity of primary-level medical institutions, promote the development of appropriate health technologies, and give full play to the role of primary-level medical institutions. Therefore, it is urgent to integrate and optimize the efficiency of resources. The hierarchical diagnosis and treatment and medical association should combine to improve the ability of maternal health, promote the development of appropriate health technology, and give full play to the role of primary medical institutions. Resource input was higher than health needs in four regions, which lead to oversupply, so the cost measurement mechanism should be improved to ensure that resources such as personnel and beds are set up according to demand.
Based on the WHO’s comprehensive evaluation model of Health Services, this study evaluated the needs and supply of maternal services from the perspective of equity and efficiency in China. The results showed that the equalization of maternal services was gradually being realized under the guidance of the equalization of Public Health Service policies. However, there were still some problems, such as the mismatch of resource input, health needs and waste, and the over-utilization of resources. So the non-balanced regions should formulate targeted policies in the light of their specific circumstances to promote their transformation to equalization. However, due to the availability of data, it is unable to include all technicians serving maternal, and unable to obtain dedicated public health funding. It is suggested the relevant departments should refine the statistical classification of information as much as possible and make more public resources available.
Availability of data and materials
The data that support the findings of this study are available from the first author upon reasonable request.
Zhao Q, Chen J, Li F, Li A, Li Q. An integrated model for evaluation of maternal health care in China. PLoS One. 2021;16(1):e0245300. https://doi.org/10.1371/journal.pone.0245300.
Liang J, Li XH, Kang CY, et al. Maternal mortality ratios in 2852 Chinese counties, 1996–2015, and achievement of millennium development goal 5 in China: a sub national analysis of the global burden of disease study 2016. Lancet. 2019;393(10168):241–52. https://doi.org/10.1016/S0140-6736(18)31712-4.
China Ministry of Health. Guidelines on further strengthening hospital delivery work for pregnant women in rural areas. http://www.gov.cn/gongbao/content/2009/content_1365916.htm (accessed Aug 30,2021).
China Ministry of Health. Hospital delivery subsidy program for rural pregnant women. http://www. gov.cn/gongbao /content/ 2010/content_1593340.htm (accessed Aug 30,2021).
GBD 2016 Causes of Death Collaborators. Global, regional, and national age-sex specific mortality for 264 causes of death, 1980–2016: a systematic analysis for the Global Burden of Disease Study 2016. Lancet. 2017;390:1151–210. https://doi.org/10.1016/S0140-6736(17)32152-9.
Small MJ, Allen TK, Brown HL. Global disparities in maternal morbidity and mortality. Semin Perinatol. 2017;41(5):318–22. https://doi.org/10.1053/j.semperi.2017.04.009.
Zhou HY, Deng F, LV JH. Analysis on the changes of maternal mortality in China from 1991 to 2016. Chin J Fam Plann Gynecotokology. 2019;11(6):34–36–44. https://doi.org/10.3969/j.issn.1674-4020.2019.06.10.
Zhu ML, Jiang W, Huang YQ, et al. Analysis of maternal mortality trend and countermeasures in Nanning. J Guangxi Med Univ. 2019;36(9):1523–6. https://doi.org/10.16190/j.cnki.45-1211/r.2019.09.031.
Zhu LL, Meng FJ, Li JL. The trends of maternal mortality in China and principal component analysis of health status. Chin J Dis Control Prev. 2019;23(5):613–6. https://doi.org/10.16462/j.cnki.zhjbkz.2019.05.024.
CPC Central Committee and State Council. Outline of Healthy China 2030 Plan. http://www. gov.cn/zhengce/ 2016-10/ 25/content_5124174.htm(accessed Aug 30, 2021).
WHO. Equity in health and health care, a WHO/SIDA initiative. Geneva: WHO; 1996.
Ye AX, Wu XX, Chen SH, et al. Analysis of maternal mortality trends and causes of death in Wenzhou from 2010 to 2019. Prev Med. 2021;33(1):87–90. https://doi.org/10.19485/j.cnki.issn2096-5087.2021.01.023.
Song GY, Yu L, Yang HH, et al. Analysis of maternal mortality monitoring in Liaoning Province from 2014 to 2019. Chin J Fam Plann Gynecotokology. 2021;13(3):82–4. https://doi.org/10.3969/j.issn.1674-4020.2021.03.20.
Qian B, Wang X, Guo YW, et al. Changing trend and influencing factors of maternal mortality in China, 2000-2016. Pract Prev Med. 2019;26(8):1020–2. https://doi.org/10.3969/j.issn.1006-3110.2019.08.036.
Sun YY. Study on the strategies of further reducing the Midwest maternal mortality rates. Shanghai: Fudan University; 2013.
Zhang XS. A study on related factors influencing maternal mortality and its downward trend. Beijing: Beijing University; 2002.
Song S, Yuan B, Zhang L, et al. Increased inequalities in health resource and access to health care in rural China. Int J Environ Res Public Health. 2018;16(1):49. https://doi.org/10.3390/ijerph16010049.
Yip W, Fu H, Chen AT, et al. 10 years of health-care reform in China: progress and gaps in universal health coverage. Lancet. 2019;394(10204):1192–204. https://doi.org/10.1016/S0140-6736(19)32136-1.
National Bureau of Statistics. The main data of the seventh National census. http:// www. gov.cn/ xinwen/ 2021–05/11/content_5605760.htm(accessed Aug 30, 2021).
China Ministry of Health. 2010 annual report on health statistics. Beijing: Peking Union Medical College Publishing House; 2010.
National Health Commission. China health statistical yearbook 2020. Beijing: Peking Union Medical College Publishing House; 2020.
Sun ZQ. Comprehensive evaluation method and its application medicine. Beijing: People's Medical Publishing House; 2006. p. 35–47.
White KL, Kalimo E, Anderson DO, et al. Health services: concepts and information for national planning and management. Public Health Pap. 1977;67:1–117.
Chen H, Sun YY, Zhu L, et al. Assessment of essential public health services in China based on WHO's comprehensive evaluation model. Chin J Hosp Admin. 2019;35(11):881–5.
Opinions of the CPC Central Committee and the State Council on Deepening the Health Care System Reform. Available online: http://www.gov.cn/test/2009-04/08/content_1280069. htm (accessed Sep 2021).
Implementation Plan for the Recent Priorities of the Health Care System Reform (2009–2011). Available online: http://www.gov.cn/zwgk/2009-04/07/content_1279256.htm (accessed Sep 2021).
Sang S, Wang Z, Yu C. Evaluation of health care system reform in Hubei Province, China. Int J Environ Res Public Health. 2014;11(2):2262–77. https://doi.org/10.3390/ijerph110202262.
Qin JM. Progress in basic public health service projects in China. Chin J Public Health. 2017;33(9):1289–97. https://doi.org/10.11847/zgggws2017-33-09-01.
Wang ZH, Yang JX, Xin C, et al. Evaluation on implementation effect of National Basic Public Health Service Project. Chin Health Econ. 2018;37(10):63–6. https://doi.org/10.7664/CHE20181015.
Xi L, Lu JP, Shuang H, et al. The primary health-care system in China. Lancet. 2017;390(10112):2584–94. https://doi.org/10.1016/S0140-6736(17)33109-4.
The authors would like to thank all the persons who participated in the study.
This research received no specific funding/grant from any funding agency in the public, commercial, or not-for-profit sectors.
Ethics approval and consent to participate
Consent for publication
The authors declare no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Liu, Y., Yan, L. & Xia, Y. Assessment of maternal services in China based on WHO’s comprehensive evaluation model. BMC Health Serv Res 22, 1571 (2022). https://doi.org/10.1186/s12913-022-08836-z