Attributes of primary health care in Mato Grosso do Sul state: PCAT-Brazil paired for users and health professionals, 2018
BMC Health Services Research volume 22, Article number: 972 (2022)
The objective of the present study was to analyse the quality of adults and older adults health care in Primary Health Care (PHC) services in the State of Mato Grosso do Sul, 2018.
A quantitative survey was carried out in which the municipalities participating in the study included the four macro-regions following the Director Regional Plan (DRP). In this study, the quality of care was verified using the validated version of the PCAT-Br for adult and older adults users over 18 years of age and professionals. The professional’s and users’ views were compared between PHC attributes in the State of Mato Grosso do Sul. We performed the paired student t-test. STATA v.14.2 software (College Station, TX, USA) was used for the analyses. Sensitivity analysis was done to compare socio-demographic characteristics.
Eight hundred twenty-five users and 424 professionals participated in the study. According to users, the Accessibility attribute had the worst performance in all macro-regions (mean score PCAT = 3.58). There were significant differences between the perception of users and professionals (PCAT = 5.32 for users and PCAT = 7.11 for professionals) in all attributes evaluated.
There was a difference in users’ and professionals’ perceptions between PHC attributes. Therefore, it is necessary to strengthen PHC care networks in the State, mainly considering the users’ perspectives.
In Brazil, Primary Health Care (PHC), through the work of Family Health teams (eSF), corresponds to the structuring and coordinating axis of the Unified Health System (SUS) , being the main access route for users to health services. SUS services, whose actions must be centred on the individual, meeting their health needs . Shreds of evidence [3,4,5,6] indicate the positive impact of PHC on the primary health indicators in the country after implementing the Family Health Strategy (ESF), mainly due to the significant increase in the number of eSF, implying greater coverage of this service in Brazilian territory. From this perspective, the power of PHC is demonstrated as a policy that supports access to health care for a significant portion of the Brazilian population, an issue that becomes critical when considering the continental dimensions and the pronounced Brazilian socioeconomic inequality.
However, the country still faces difficulties implementing PHC and the quality and effectiveness of the services offered [7,8,9,10,11]. The organisation and orientation of services by PHC attributes promote better indicators, greater user satisfaction, equity, lower costs, and, consequently, positively impact the health of the population [1, 12]. The evaluation of operational quality in PHC is linked to the presence and extent of four essential attributes and three derived ones . The essential ones correspond to attention to the first contact (accessibility), longitudinally, comprehensiveness and care coordination, and the derived attributes consist of people- and family-centred (family orientation) health care, community orientation and cultural competence .
In this sense, the orientation of the work performed by professionals to fulfil PHC attributes has been widely performed in the world [13,14,15,16,17,18,19,20,21,22,23] and Brazil [24,25,26,27] through the use of the Primary Care Assessment Tool (PCA-T) . Therefore, to the extent that PHC services are strongly oriented towards achieving the presence of most of these attributes, their ability to provide comprehensive care is considered optimized .
Thus, it is important to use strategies to consolidate universal and equitable access within the scope of the SUS through tools that promote evaluation and monitoring of the performance of PHC teams . The evaluation process also makes it possible to unveil the experiences lived by both users and professionals that can reflect on other levels of care services in the health care network and other experiences articulated with the rest of the system . Given the different organisational arrangements and specific aspects of care offerings in health services existing in Brazil, the search for performance evaluation, knowledge of the opinions of professionals who work on it, as well as information on users’ experiences, can evidence the actual effectiveness of PHC and assist in the definition of public policies [12, 28].
Although the evaluation of PHC through the PCATool is a topic widely explored by researchers around the world [20,21,22,23], there are limited publications that analyse and problematise, at the same time, the set of essential and derived attributes of PHC services from the perspective of users and professionals, comparing them. Such approaches are essential, considering that one study  has shown discrepancies between the views of users and professionals about the health services offered, with professionals tending to evaluate services more positively concerning users. Additionally, the PCATool proposal is to identify whether PHC services are guided by the set of their attributes, whose presence and extent reflect in health indicators, user satisfaction, costs and equity  and, through good results, promote comprehensive care  with impacts and positive effects on the health of people and populations.
The objective of this study was to analyse the quality of adult health care in PHC services from the perspective of users and professionals in the four health macro-regions of the State of Mato Grosso do Sul, using the PCAT-Brazil instrument.
This study was a cross-sectional research carried out from August to December 2018 in Mato Grosso do Sul State. Mato Grosso do Sul is an important Brazilian state in the Midwest region and is responsible for a strong agribusiness that supplies the other geographical regions in the country. In Brazil, agribusiness accounts for approximately 25% of the GDP (Gross Domestic Product) . The State of Mato Grosso do Sul is one of the 27 federative units in Brazil, located in the south of the Central-West Region, divided into 79 municipalities and occupies an area comparable in size to Germany, with a population of 2,839,188 inhabitants with an average of HDI 0.729 . As in all of Brazil, health promotion and prevention for the population of the State of Mato Grosso do Sul is offered to every Brazilian citizen through the Unified Health System (SUS) with full, universal and free access to health services . The municipalities participating in the study included the 11 health microregions of Mato Grosso do Sul following the Regional Master Plan (RMP), which divided the State into four macro-regions: 1) Campo Grande, Dourados, Três Lagoas and Corumbá (Fig. 1).
Sample size calculation
The sample size calculation was performed on the representativeness of the macro-regions using the STATA software (College Station, TX, USA). The total number of health professionals who worked in the Family Health Teams (as professionals who passed public examinations and are not on a temporary contract) was considered, representing all macro-regions. The parameter used to perceive differences in the mean scores of 0.25 between users and professionals, considering all attributes in the PCAT-Br instrument with an alpha of 5%, power of 80%, and allocation of 2 users for one professional. Our sample size estimated 800 users and 400 PHC professionals. Assuming 10% of losses, our final sample size was estimated at 880 users and 440 professionals. Thus, the municipalities were randomly selected, and their distribution was proportional to the number of municipalities per macro-region. The participating municipalities were defined by random selection, including all the microregions. Therefore, we respect at least four health units in each municipality and four users per health unit selected to obtain an overview of the perception of users and professionals (ratio 2:1) of the SUS in the State of Mato Grosso do Sul.
Calibration of examiners
Data collection was performed by interviewers who received theoretical and practical qualifications (24 hours) and underwent inter-and intra-examiner calibration, resulting in a Kappa index equal to or greater than 0.87. Then, the items and questions of the Primary Care Assessment Tool (PCAT-Brazil), validated in Brazil [25, 26], were studied and discussed to fluency the execution. The possible doubts that arose were resolved in time to ensure the reliability of the data. We chose this instrument because it has already been used in several countries, which gives it the characteristic of international comparability [13,14,15,16,17,18,19,20,21,22,23].
In this study, the quality of care was verified using the PCAT-Brazil instrument for adult users over 18 years of age and professionals . This instrument measures the presence and extent of essential and derived attributes of PHC and thus infers strong or weak orientation for PHC of the evaluated service . In addition, the municipal health departments indicated the Primary Health Units (PHU) and those that accepted and agreed to participate in the research were included. However, the health units indicated by the secretariats were restricted because they were made up of Family Health teams, which helped in the logistics of data collection for the research.
The sample of health professionals consisted of those in the eSF in the selected units. In addition, professionals should assist adult users, fulfil a workload of at least 20 hours per week and work at the health unit for at least one year. Exclusion criteria were limited to professionals who cared for children, worked at the health unit for less than a year and were temporary professionals. The sample of professionals was determined by random selection, as those who worked in the health units indicated by the municipal secretariats were interviewed. After including professionals, we included only users attended by the included professional. The interviewers collected data from the users at the participants’ homes. These were randomly selected from a list also provided by the municipal health departments, containing the families assigned to each area of activity of the ESF participating in the study. Users should have resided in the territory for at least one year for the inclusion criteria.
The scores for each attribute or component were calculated by the simple arithmetic mean of the response values of the items that make up each attribute or component. Then, the scores were calculated and transformed into a scale from 0 to 10, according to the PHC Assessment Instrument Manual (PCAT-Brazil) .
In the adult version, answered by users, the essential score is measured by the sum of the average score of the components that belong to the essential attributes (plus Affiliation Degree) divided by the number of components. The overall score is measured by the average score of components belonging to essential attributes plus components belonging to derived attributes (plus Affiliation Degree), divided by the total number of components. More information on calculation scores could be seen elsewhere .
The score for each essential and derived PHC attribute was the dependent variable. The methodology of the PCAT instrument considers a score ≥ 6.6 as a minimum quality value to assess primary care services from the adult user’s perspective, and in both surveys, this general quality value .
Main exposures variables
The main exposure variable was the professional/user data.
Descriptive data from users like gender, income, education, self-reported race, according to the Brazilian IBGE, time living in the region, sex and age group were reported. Furthermore, descriptive data from professionals like the category of the health professional, gender, and if they lived and worked in the same city and time since graduation was described.
To compare the averages between professionals and users, paired Student’s t-test was used (the professional was paired with the users). A significance level of 5% was considered, and Data Analysis and Statistical Software (STATA) v.14 (College Station, TX, USA) was used. In addition, chi-squared tests between each socio-demographic characteristic were done as a sensitivity analysis to show that it did not influence variations in the Overall Score.
The Research Ethics Committee of the Federal University of Mato Grosso do Sul approved this study (CAAE 58735316.4.0000.0021).
A total of 825 PHC users from 29 municipalities in the State of Mato Grosso do Sul participated in the study. Therefore, we had 6,25% participant losses as the estimated sample was the same as the included sample. Regarding the socio-demographic profile of the participants, female users were predominant, in the age groups of 18 to 34 years, self-declared whites and Browns, with an elementary school and above ten years resided in the area assigned to the health units, as shown in Table 1.
Concerning the profile of the 424 professionals linked to PHC in the 29 municipalities of the State of Mato Grosso do Sul, the majority did not reside in the region attached to the health unit they operate. We had 3,63% on professionals losses. Furthermore, they presented a predominant age between 22 and 44 years, trained for more than ten years and predominantly nurses, as shown in Table 2.
The results referring to the attributes of people- and family-centred (family orientation) health care differed between the participants. The scores were higher for professionals in all macro-regions than users (Table 3). The average score for family orientation ranged from 4.72 in the macro-region of Campo Grande to 6.58 in the region of Corumbá. The highest average score related to people orientation was equivalent to the Três Lagoas macro-region with 5.34. There were significant differences in all analysed attributes between professional and user views, being the views about users under the minimum quality value of 6.6.
Sensitivity analysis showed no differences between socio-demographic data and the four macro-regional in Mato Grosso do Sul State (p > 0.05).
This study highlighted one critical finding. It was the difference in perception between users and professionals in all analysed attributes, with worse evaluations for all attributes among users, not reaching the minimum of 6.6.
The PHC acts as a care coordinator for the population to have population benefits . The present research results showed significant differences in the evaluations of PHC attributes between users and professionals. We observed a weak health services orientation evaluated from the users’ experience and perspective and a strong orientation from the professionals’ point of view. These data confirm the results of previous studies that used the PCAT-Brazil [33,34,35,36,37]. The overestimated perception from professionals regarding the evaluation of the service is favourable.
Nevertheless, the confrontation of ideas between professionals and users shows important differences. The highest scores best evaluated by both group participants converge to the attribute care coordination - Information System, corroborating the results of other study . This fact becomes relevant because, without coordination, the potential of longitudinally would decrease, compromise comprehensiveness, and the first contact would be essentially administrative. Coordination is defined as a state of harmony resulting from a joint effort. Therefore, it expresses its essence: the availability of information about previous problems and services and its recognition of the service and current needs . Moreover, we did not identify literature that analyses the presence and extent of the PHC set of attributes and the discrepancies between the evaluations of users and professionals through the PCATool in different primary care services. Thus, this study produces relevant and innovative knowledge to support professionals and policymakers in implementing primary health care at the local level by bringing a broader assessment and for the production of knowledge that contributes to the planning of PHC services in the realities of other developing countries.
Comparing our results to the major national epidemiological survey conducted in Brazil (The National Health Survey in 2019) that used the PCAT-Brazil , they found an overall score of 5.8[5.6–6.0] for Mato Grosso do Sul State. Our findings have shown an overall score of 5.3 [IC95% 5.2–5.4]. The methodology of the PCAT instrument considers a score ≥ 6.6 as a minimum quality value to assess primary care services from the adult user’s perspective. In both surveys, this general quality value was not reached, confirming that our State is below average in terms of attributes in PHC. Furthermore, it was not seen under professionals’ views that showed values above the minimum of 6.6.
This study has strengths and limitations; the first relates to the instrument (PCAT-Br) that assesses the work process, not precisely the health outcomes in all macroregions. Indeed, through cross-sectional data, we could not infer causality between differences in the work process between all macroregions. Second, as a limitation, the health department’s indication of the PHU and professionals is an important selection bias. However, we agree that the large sample size detects slight mean scores differences and does not influence the results. Third, as we excluded professionals with a temporary contract, it may cause some selection bias in our sample. As potential, we highlight the broad scope of the research, representative of the Mato Grosso do Sul State. To the authors’ knowledge, it is the largest state survey in Mato Grosso do Sul using the full version of the PCAT-Brazil for professionals and users. The instrument used is objective, easy to apply, and presents greater possibilities for comparison since it was evaluated and applied worldwide. In addition, the tool allows the evaluation of the attributes separately, even being related to each other in the health service practice. It is worth emphasising the importance of these attributes positively and concretely. It supports the evaluation and investigation strategies of health systems based on and defined in a service-oriented towards PHC12 as the degree of orientation to PHC increased the mental component score of quality of life . Another strength of the study concerns the relationship of inclusion of professionals and users of the same Health Units in the research; most studies developed until then were conducted with professionals or users.
Finally, it is concluded that there is a need to improve the development of PHC in the State, especially the attributes of accessibility and comprehensiveness of the services provided. In addition, it is necessary to strengthen PHC care networks in the State, mainly considering the users’ perspectives.
Availability of data and materials
The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.
Starfield B, Shi L, Macinko J. Contribution of primary care to health systems and health. Milbank Q. 2005;83(3):457–502.
Bastos ML, Menzies D, Hone T, Dehghani K, Trajman A. The impact of the Brazilian family health on selected primary care sensitive conditions: a systematic review. PLoS One. 2017;12(8):e0182336.
Macinko J, Guanais FC, Souza MFM. Evaluation of the impact of the family health program on infant mortality in Brazil, 1990-2002. J Epidemiol Community Health. 2006;60:13–9.
DDG d N, SHM M, Cast S, de Souza AS, Bomfim RA, De Carli AD, et al. Impact of continuing education on maternal and child health indicators. PLoS One. 2020;15(6):e0235258.
Hone T, Saraceni V, Medina Coeli C, Trajman A, Rasella D, Millett C, et al. Primary healthcare expansion and mortality in Brazil's urban poor: a cohort analysis of 1.2 million adults. PLoS Med. 2020;17(10):e1003357.
Rocha R, Soares RR. Evaluating the impact of community-based health interventions: evidence from Brazil's family health program. Health Econ. 2010;19(Suppl):126–58.
Brasil. Ministério da Saúde. eGestor: Relatório Histórico de Coberta – equipes de saúde da família (eSF) e de equipes de Atenção Básica (eAB) eGestor. Brasil 2020 [Acessado em 20/05/2019]. Disponível em: https://egestorab.saude.gov.br/.
Moraes dos Santos ML, Zafalon EJ, Bomfim RA, Kodjaoglanian VL, Mendonça de Moraes SH, et al. Impact of distance education on primary health care indicators in Central Brazil: an ecological study with time trend analysis. PLoS One. 2019;14(3):e0214485.
Tasca R, Massuda A, Carvalho WM, Buchweitz C, Harzheim E. Recommendations to strengthen primary health care in Brazil. Rev Panam Salud Publica. 2020;44:e4.
Afonso MPD, Shimizu HE, Merchan-Hamann E, Ramalho WM, Afonso T. Association between hospitalisation for ambulatory care sensitive conditions and primary health care physician specialisation: a cross-sectional ecological study in Curitiba (Brazil). BMJ Open. 2017;7:e015322.
Gomes TN, Thuany M, Dos Santos FK, Rosemann T, Knechtle B. Physical (in) activity, and its predictors, among Brazilian adolescents: a multilevel analysis. BMC Public Health. 2022;22(1):219.
Starfield B. Primary care: balance between health needs, services and technology. Brasília: UNESCO Brazil; Ministry of Health; 2002.
Shi L, Starfield B, Xu J. Validating the adult primary care assessment tool. J Fam Pract. 2001;50(2):161–75.
Starfield B, Cassady C, Nanda J, Forrest CB, Berk R. Consumer experiences and provider perceptions of the quality of primary care: implications for managed care. J Fam Pract. 1998;46(3):216–26.
Cassady CE, Starfield B, Hurtado MP, Berk RA, Nanda JP, Friedenberg LA. Measuring consumer experiences with primary care. Pediatrics. 2000;105:998–1003.
Brick G, Sayed AR, Le Grange C, Bhagwan S, Manga N. Adaptation and cross-cultural validation of the United States primary care assessment tool (expanded version) for use in South Africa, 2015. Afr J Prim Health Care Fam Med. 2015;7(1):a783.
Berra S, Hauser L, Audisio Y, Mántaras J, Nicora V, Oliveira MMC, et al. Validity and reliability of the argentine version of the PCAT-AE for the evaluation of primary health care. Rev Panam Salud Publica. 2013;33(1):30–9.
Yang H, Shi L, Lebrun L, Zhou X, Liu J, Wang H. Development of the Chinese primary care assessment tool: data quality and measurement properties. Int J Qual Health Care. 2013;25(1):92–105.
Wang W, Shi L, Yin A, Lai Y, Maitland E, Nicholas S. Development and validation of the Tibetan primary care assessment tool. Biomed Res Int. 2014;308739:7.
Wei X, Li H, Yang N, Wong S, Owolabi O, Xu J, et al. Comparing quality of public primary care between Hong Kong and Shanghai using validated patient assessment tools. PLoS One. 2015;10(3):e0121269.
We X, Li H, Yang N, Wong S, Chong M, Shi L, et al. Changes in the perceived quality of primary care in Shanghai and Shenzhen, China: a difference-in-difference analysis. Bull World Health Organ. 2015;93(6):407–16.
Hu R, Liao Y, Du Z, Hao Y, Liang H, Shi L. Types of health care facilities and the quality of primary care: a study of characteristics and experiences of Chinese patients in Guangdong Province, China. BMC Health Serv Res. 2016;16:335.
Feng S, Shi L, Zeng J, Chen W, Ling L. Comparison of primary care experiences in village clinics with different ownership models in Guangdong province, China. PLoS One. 2017;12(1):e0169241.
D’Avila OP, Pinto LFS, Hauser L, Gonçalves MR, Harzheim E. O uso do Primary Care Assessment Tool (PCAT): uma revisão integrativa e proposta de atualização. Cien Saude Colet. 2017;22(3):855–65.
Harzheim E, Oliveira MMC, Agostinho MR, Hauser L, Stein AT, Gonçalves MR, et al. Validação do instrumento de avaliação da atenção primária à saúde: PCATool-Brasil adultos. Revista Brasileira de Medicina de Família e Comunidade. 2013;8(29):274–84.
Harzheim E, Starfield B, Rajmil L, Álvarez-Dardet C, Stein AT. Internal consistency and reliability of primary care assessment tool (PCATool-Brasil) for child health services. Cad Saude Publica. 2006;22(8):1649–59.
Pinto LFS, Meira VST. Primary Care Asssement Tool (PCAT): a construção de uma nova linha de base para avaliação dos serviços de saúde no Brasil. Ciência & Saúde Coletiva [online]. 2021, v. 26, n. 02 [Acessado 8 Maio 2022], pp. 651–656. Disponível em: https://doi.org/10.1590/1413-81232021262.42552020. Epub 12 Fev 2021. ISSN 1678-4561.
Carneiro MSM, Melo DMS, Gomes JM, Pinto FJM, Carlos SMG. Assessment of the coordination attribute in primary health care: application of the PCATool to professionals and users. Saúde debate. 2014;38:279–95.
Sonneveld RE, Wensing M, Bronkhorst EM, Truin GJ, Brands WG. The estimation of patients' views on organisational aspects of a general dental practice by general dental practitioners: a survey study. BMC Health Serv Res. 2011;11:263.
Malouin RA, Starfield B, Sepulveda MJ. Evaluating the tools used to assess the medical home. Manag Care. 2009;18(6):44–8.
IBGE – Instituto Brasileiro de Geografia e Estatística. Censo Brasileiro de 2010. Rio de Janeiro: IBGE; 2012.
Brazil. Ministry of Health. Secretariat of Primary Health Care. Department of Family Health. Primary Health Care Assessment Instrument Manual: PCATool-Brasil – 2020 [electronic resource] / Ministry of Health, Primary Health Care Secretariat. Brasília: Ministry of Health; 2020.
Oliveira MMC, Harzheim E, Riboldi J, Duncan BB. PCATool-ADULTO-BRASIL: a reduced version. Rev Bras Med Fam Comunidade. 2013;8(29):256–63.
Nascimento AC, Moysés ST, Werneck RI, Gabardo MCL, Moysés SJ. Assessment of public oral healthcare services in Curitiba, Brazil: a cross-sectional study using the Primary Care Assessment Tool (PCATool). BMJ Open. 2019;9(1):e023283. https://doi.org/10.1136/bmjopen-2018-023283.
Ibañez N, Rocha JSY, Castro PC, Ribeiro MCSA, Forster AC, Novaes MHD, et al. Avaliação do desempenho da atenção básica no Estado de São Paulo. Cien Saude Colet. 2006;11(3):683–703.
Stralen CJ, Belisário S, van Stralen TBS, Lima ÂMD, Massote AW, Oliveira CL. Percepção dos usuários e profissionais de saúde sobre atenção básica: comparação entre unidades com e sem saúde da família na Região Centro-Oeste do Brasil. Cad Saúde Pública. 2008;24(1):148–58.
Araújo RL, Mendonça AVM, Sousa MF. Perception of users and health professionals in the Federal District: the attributes of primary care. Saúde Debate. 2015;39(105):387–99.
dos Santos H, de Carvalho VC, Rossato SL, Fuchs FD, Harzheim E, Fuchs SC. Assessment of primary health care received by the elderly and health-related quality of life: a cross-sectional study. BMC Public Health. 2013;13:605.
This study was partially financed by the Federal University of Mato Grosso do Sul (UFMS) and by Fiocruz.
This study was partially financed by the Fiocruz/Mato Grosso do Sul and Federal University of Mato Grosso do Sul.
Ethics approval and consent to participate
The Brazilian Committee approved the survey protocol on Ethics in Human Research (The Research Ethics Committee of the Federal University of Mato Grosso do Sul approved this study (CAAE 58735316.4.0000.0021). Informed consent was obtained from all subjects and from the legal guardian of illiterate participants. All methods were carried out in accordance with relevant guidelines and regulations.
Consent for publication
The authors declare no conflict of interest.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Bomfim, R.A., Leite, H.Q.N.C., Zafalon, E.J. et al. Attributes of primary health care in Mato Grosso do Sul state: PCAT-Brazil paired for users and health professionals, 2018. BMC Health Serv Res 22, 972 (2022). https://doi.org/10.1186/s12913-022-08363-x