Abstract
The present study aimed to assess the degree of orientation for PHC from the perspective of adult and child users in the city of Rio de Janeiro. The design was a cross-sectional observational study and included independent samples of child and adult users leaving medical appointments at different health units in Rio de Janeiro (RJ). The study outcome was the essential and general scores of the PCATool Brazil, categorized as High Score above 6.6 and Low Score below 6.6. Socioeconomic, health-related, service use, and general characteristic variables were also collected. A total of 889 adults and 956 children answered the questionnaire and were analyzed. The core and overall PCATool scores were slightly higher in children than in the adult sample. The overall score was 6.72, 95%CI (6.63-6.81) and 6.40, 95%CI (6.30-6.50) in adults. In the adjusted models, individuals with five or more consultations in the last year: children - (OR=1.33, 95%CI [1.01-1.75])/adults - (OR=2.63, 95%CI [1.68-4.11]) and consultation with the same doctor: children - (OR=2.34, 95%CI [1.77-3.08])/adults - (OR=3.42, 95%CI [2.19-5.32]) were associated with a higher overall score.
Key words:
Primary Health Care; Health Evaluation; Rio de Janeiro
Resumo
O estudo tem como objetivo avaliar o grau de orientação à APS na perspectiva dos usuários adultos e crianças no município do Rio de Janeiro. O desenho foi observacional transversal e incluiu amostras independentes de usuários infantis e adultos que saíam de consulta médica em diferentes unidades de saúde do Rio de Janeiro (RJ). O desfecho do estudo foram os escores essencial e geral do PCATool Brasil categorizados em Alto Escore acima de 6,6 e Baixo Escore abaixo de 6,6. Variáveis socioeconômicas, relacionadas à saúde, uso de serviços e características gerais foram também coletadas. Um total de 889 adultos e 956 para crianças responderam ao questionário e foram analisadas. As pontuações essenciais e gerais do PCATool foram ligeiramente maiores em crianças do que na amostra de adultos. O escore geral foi de 6,72, IC95% (6,63-6,81) e 6,40, IC95% (6,30-6,50) em adultos. Nos modelos ajustados, indivíduos com cinco ou mais consultas no último ano: crianças - (OR=1,33, IC95% [1,01-1,75])/adultos - (OR=2,63, IC95% [1,68-4,11]) e consulta com o mesmo médico: crianças - (OR=2,34, IC95% [1,77-3,08])/adultos - (OR=3,42, IC95% [2,19-5,32]) foram associados a maior escore geral.
Palavras-chave:
Atenção Primária à Saúde; Avaliação em Saúde; Rio de Janeiro
Resumen
El objetivo del estudio fue evaluar el grado de orientación a la APS desde la perspectiva de usuarios adultos y niños en el ciudad de Rio de Janeiro. El diseño fue observacional transversal e incluyó muestras independientes de usuarios niños y adultos que salían de consultas médicas en diferentes unidades de salud de Río de Janeiro (RJ). El resultado del estudio fueron las puntuaciones esenciales y generales del PCATool Brasil, categorizadas como Puntuación Alta por encima de 6,6 y Puntuación Baja por debajo de 6,6. También se recogieron variables socioeconómicas, relacionadas con la salud, uso de servicios y características generales. Un total de 889 adultos y 956 niños respondieron al cuestionario y fueron analizados. Las puntuaciones esenciales y generales de la PCATool fueron ligeramente superiores en los niños que en la muestra de adultos. La puntuación global fue de 6,72, IC95% (6,63-6,81) y de 6,40, IC95% (6,30-6,50) en adultos. En los modelos ajustados, los individuos con cinco o más consultas en el último año: niños - (OR=1,33, IC95% [1,01-1,75])/adultos - (OR=2,63, IC95% [1,68-4,11]) y consulta con el mismo médico: niños - (OR=2,34, IC95% [1,77-3,08])/adultos - (OR=3,42, IC95% [2,19-5,32]) se asociaron con una puntuación global más alta.
Palabras clave:
Atención Primaria de Salud; Evaluación sanitaria; Rio de Janeiro
Introduction
Health systems organized around Primary Health Care (PHC) have proven to be more equitable, efficient, sustainable, and better for the population’s overall health. The stronger the presence of their essential attributes (first contact access, longitudinality, comprehensiveness, coordination) and derivatives (family and community guidance, cultural competence) in the user experience, the greater the likelihood that the PHC objectives will be achieved, as demonstrated by Starfield et al.1 and Shi2. Health systems structured around quality PHC offer better health and financial results3, which then encourages them to invest in and qualify their PHC models to strengthen their attributes4. Despite the clear advances regarding the expansion of PHC services in Brazil, the challenge remains to address heterogeneous quality, limited resolution, low technological incorporation, and the virtual absence of care coordination mechanisms, combined with difficult access to PHC5.
Fifteen years ago, the government of Rio de Janeiro began a reform of the municipal health network, prioritizing the increase in PHC coverage by expanding the Family Health Strategy (FHS) through contracts with social organizations. This expansion represented an increase in FHS coverage from 3.5% (2008) of the population to 70% (2025), which was accompanied by an increase in the number of procedures of around 535.4%. This expanded access and production was complemented by opening family clinics (FCs), adopting a broad portfolio of services and clinical protocols, and implementing a medical and multidisciplinary residency program, which helped to qualify the network6.
The Primary Care Assessment Tool (PCATool)7 was developed to assess PHC services and is one of the most widely used tools. Over the past two decades, the PCATool has been adapted and validated for various national contexts, becoming a widely recognized research instrument on all continents8-11. This allows for an important scenario of comparability. The official version of the instrument for users (aged 0 to 12) in Brazil was validated in 200612 and later incorporated into the Ministry of Health’s PHC Assessment Manual13. It was updated in 2020 with a revised set of instruments that make up the “PCATool family”, incorporating new versions and occasionally updating the wording of some items14. Over the past few decades, several PHC assessment studies using the PCATool have been published in Brazil and around the world, allowing for a scenario of comparability.
More specifically, in Rio de Janeiro, in 2014, when assessing the presence and extent of PHC attributes in the experience of adult and child users, using the PCATool - Brazil, child users evaluated PHC services better than adults. The attribute “access-first contact/accessibility” was the most unfavorable, and “community guidance” and “family guidance” revealed attributes of lesser importance15.
Although the expansion of PHC in Rio de Janeiro has been significant, gaps remain in knowledge about the quality of services and user experience, especially after the PHC reform was implemented. Expanding the FHS teams and opening FCs represented significant progress. Thus, evaluating services is essential to identifying strengths and weaknesses, and to directing future actions. The PCATool, an internationally recognized tool for evaluating PHC, allows for comparison of user experiences from different contexts. Considering the magnitude of the reform implemented in Rio de Janeiro and the importance of evaluating its results, this study aimed to examine the degree of orientation for PHC from the perspective of adult and child users in the city of Rio de Janeiro.
Method
Study design
This work follows a cross-sectional survey study design, with independent random samples of users (children and adults) of PHC services in Rio de Janeiro (FCs), the Municipal Health Center (MHC), and city of Rio de Janeiro.
Adult users, or responsible caregivers (in the case of children), responded to the PCATool-Brazil, which measures the degree of orientation for PHC in health services, and some structured questions posed in a questionnaire concerning sociodemographic variables and reported morbidity. The questionnaires were applied by properly trained interviewers with the support of the OTICS-RIO Network of the Municipal Health Department of Rio de Janeiro (MHD-RJ). The data collection period took place between May and June 2024.
Ethical Aspects
This study, entitled “Research to assess the degree of guidance for primary health care (PHC) based on the experience of users of Family Clinics (FCs) in the city of Rio de Janeiro”, was approved by the Ethics Committee of UFRGS under No. 77802624.0.0000.5347/2024 and by MHD-RJ. The interviews were conducted upon presentation of a research letter to users or guardians, as well as after reading and digitally marking the Free and Informed Consent Form.
Research Sample
A 95% confidence interval and a precision (d) of 4% of the estimates to be calculated were considered, recalling that, in addition to the questionnaire scores generated by the PCATool, several questions with frequencies would also be calculated. Therefore, due to the absence of previous studies, the most unfavorable case was considered in which p=q=0.5, estimating a sample size (for both adults and children) of 1,120 for FCs and 1,034 for MHCs. This value was calculated considering an estimated loss of 10%. The distribution of interviews in the health units was proportional to the number of FHS teams per planning area (PA), and the sample represents only the total for city of Rio de Janeiro.
Inclusion/exclusion criteria
The participating health units had received at least six months of the implementation of Family Health, according to the MHD-RJ list provided in May 2024. Eligible users were adults aged 18 or over and children aged 12 or under, who were leaving a medical appointment at the health unit on the day of the interview and who had consulted with the physician at the same health unit at least twice in the last two years (including the consultation carried out on the day of the interview). Users who were not physically or mentally able to answer the questionnaire, and those who had not consulted a doctor at least twice at the health unit in the last two years, were excluded.
Data collection
Data collection was conducted by interviewers trained in the OTICS-RIO Network of MHD-RJ from March to April 2024. Users were systematically approached at the internal entrances of the health units as they were leaving. The questionnaires consisted of the PCATool Brazil14, in its versions for child and adult users, and questions related to sociodemographic issues, links to the health service, health assessment, and lifestyle habits (for adults only). The Kobotool program version 202413 was used to design the questionnaires, read the images of the questionnaires and validate the data, and build the research database.
Variables
The PCATool Brazil’s essential and general scores were used as the outcome variable of the study. The scores for the PHC attributes, as well as the Essential Score and the General Score, were produced according to the instrument manual (Brazil, 2020) and presented on a scale of 0 to 10. The item scores were obtained by transforming the original item scale (ranging from 1 to 4) to the same scale as the scores (ranging from 0 to 10). A score above 6.6 indicates a high quality of health care in the respective item/attribute. Thus, the scores were categorized as High Score above 6.6 and Low Score below 6.6.
The other variables used in both samples included the Net Promoter Score (NPS), sociodemographic information, health status, and health services. The NPS is a tool used to assess patient experience in the international scenario. Using only one question, “On a scale of 0 to 10, how likely are you to recommend a particular service (name of service) to a friend or family member?”, the NPS compares the balance between those who are likely or not to recommend the services, obtaining a strong indication of the patient’s perception of the service by analyzing whether or not they would encourage other people to use it16,17. Patients responding to the NPS are divided into three categories: promoters (with scores of 9 and 10), neutral/passive (with scores of 7 and 8), and detractors (with scores of 0 to 6). Promoters are considered those patients who are enthusiastic about the service, while detractors represent dissatisfied patients who give it a negative rating. As the name suggests, passive/neutral respondents are not necessarily dissatisfied, but are not inclined to actively promote the service. The final NPS calculation is based on the percentage of participants considered promoters, subtracting the detractors, and disregarding the neutral/passive respondents. Thus, the result may range from “-100” to “+100”, with the higher the value, the better the indicator. To better understand the results, the final result was categorized into: Excellence Zone: between 76 and 90, Quality Zone: between 51 and 75, Improvement Zone: between 1 and 50, and Critical Zone: between -100 and 0618.
The sociodemographic, health condition, and health service variables included for the adult user sample were: age (up to 39 years old/40 to 59 years old/60 or older), sex (male/female), skin color (white/non-white), education (under 10 years/10 to 12 years/more than 12 years), receipt of social assistance - Bolsa Família (Family Grant) or Cartão Família Carioca (Rio Family Card) (yes/no), economic classification - “Critério Brasil” (A, B1 and B2/ C1, C2 and DE) according to ABEP (2024), self-reported health condition (positive/negative), daily use of medication (yes/no), hypertension (yes/no), diabetes (yes/no), time of use of health service (up to 12 months/more than 12 months), number of consultations in the last year (fewer than 5 consultations per year/5 consultations or more during the year), same physician as the last consultation (yes/no), type of PHC service (CF/CMS), type of consultation (scheduled/spontaneous), and private health plan (yes/no).
The sociodemographic, health condition, and health service variables included for the child user sample were: age of the guardian (up to 39 years/ 40 to 59 years/ 60 years or older), education of the guardian (fewer than 10 years/10 to 12 years/more than 12 years), and parenthood of the guardian with the child (Mother yes/ no); and the following information about the children: age (up to 4 years old/over 4 years old), sex (male/female), child’s skin color (white/non-white), receives social assistance - Bolsa Família or Cartão Família Carioca (yes/no), economic classification - “Critério Brasil” (A, B1 and B2/ C1, C2 and DE) according to ABEP19, self-reported health condition (positive/negative), daily use of medication (yes/no), time of use of the health service (up to 12 months/more than 12 months), number of consultations in the last year (fewer than 5 consultations per year/5 consultations or more during the year), same physician as the last consultation (yes/no), type of PHC service (CF/CMS), type of consultation (scheduled/spontaneous), and private health plan (yes/no).
Data analysis
Statistical analysis was performed using Stata 16.0 software (StataCorp, College Station, TX, USA). Descriptive analysis was initially performed by estimating the total, mean, and 95% confidence interval (95%CI) values of the PCATool attributes. The relative and absolute frequency of high PCATool scores (general and core attributes) were estimated according to the covariates using Fisher’s exact test.
A mixed-effects multilevel logistic regression was used to analyze the association with a high PCATool-Brazil score. Individual data (level 1) were grouped according to the planning area (PA - level 2). Variables with p>0.250 in the crude model were not included in the final model. Covariates were included in the multivariate model in blocks according to their respective theoretical model: i) theoretical model for children: contextual and socioeconomic variables (block 1) were considered distal variables; respondent/parent variables (block 2); general characteristics of the child and self-perception of health (block 3); and variables related to service use (block 4), being the variables most proximal to the outcome; ii) theoretical model for adults: contextual and socioeconomic variables (block 1) were considered distal variables; general characteristics (block 2); health-related variables (block 3); and variables related to the use of service (block 4), being the variables closest to the outcome.
A forward stepwise procedure was used to select variables to be retained in the final model, with only variables with p≤0.05 being retained. Odds Ratios (ORs) and their 95%CI were estimated. The goodness-of-fit of the multilevel models was evaluated using deviance (-2 log-likelihood). The median odds ratio (MOR) was estimated to quantify the variability between clusters in the model. The MOR translates the variance of the random effect into an odds ratio scale, providing an interpretation of the heterogeneity between clusters. The MOR is defined as the median value of the odds ratio between individuals with the highest and lowest risk when randomly selecting two individuals from different clusters. An MOR value close to 1 indicates low variability between clusters, while higher values suggest greater heterogeneity in risk between clusters. A sensitivity analysis was performed by estimating E-values, which provided insights into the robustness of the results against potential unmeasured confounders.
Results
A total of 889 adults and 956 children responded to the questionnaire and were analyzed. The general characteristics of the population are presented in Table 1. The PCATool score and overall scores were slightly higher in children than in the adult sample (Table 2). The attribute “affiliation” was the attribute with the highest scores in both samples (mean of 9.53 [CI: 9.45-9.61] for children and mean of 9.20 [CI: 9.07-9.32] for adults). The attribute “community orientation” was the attribute with the lowest score in the child sample 4.57 [CI: 4.40-4.75], while the attribute “comprehensiveness - services provided” showed the lowest score in the adult sample 4.50 [CI: 4.33-4.68].
Tables 3 and 4 show the distribution of high PCATool scores according to the covariates for child and adult samples, respectively. Both samples, having consulted the same physician in the last consultation and five or more times during the past year, were associated with a high score. Regarding the NPS scores, the adult sample presented a higher score (+28) than the child sample (+15), both classified within the improvement zone. Individuals who were classified as health service promoters according to the NPS were associated with a better evaluation for all PHC attributes and essential and general PCATool scores in both samples (Table 5).
Table 6 presents the results of the factors associated with high PCATool scores (general and essential) based on multilevel logistic regression for the general and essential score in the children’s sample. In the adjusted model of the general score, individuals responsible for children with higher education (≥12 years) (OR=1.97, 95%CI [1.31-2.96]), children with positive self-perception of health (OR=1.76, 95%CI [1.17-2.65]), with five or more consultations in the past year (OR=1.33, 95%CI [1.01-1.75]), and consultations with the same physician (OR=2.34, 95%CI [1.77-3.08]) were associated with a higher score. An MOR of 1.46 was observed in the final model, indicating that, if an individual moved from a lower-risk cluster to a higher-risk cluster, their odds would increase by 46%. Considering the essential score, having more than 12 years of schooling (OR=1.99, 95%CI [1.26-3.14]), reporting positive self-perception of health (OR=1.77, 95%CI [1.17-2.69]), consulting a physician five times or in the last year (OR=1.45, 95%CI [1.08-1.95]), and consulting the same physician (OR=2.98, 95%CI [2.22-4.01]) were associated with a higher PCATool score, while guardians of children older than 4 years had a 36% lower chance of indicating a worse score (OR=0.64, 95%CI [0.48-0.85]). An MOR of 1.45 was observed in the final model.
Table 7 presents the results of the multilevel logistic regression for the adult sample. In the adjusted model of the overall score, individuals who consult at the CF (OR=1.30, 95%CI [1.01-1.71]), with children (OR=1.57, 95%CI [1.14-2.18]), with positive self-perception of health (OR=1.78, 95%CI [1.16-2.71]), with diabetes (OR=1.75, 95%CI [1.11-2.76]), with five or more consultations in the last year (OR=2.63, 95%CI [1.68-4.11]) and consulting with the same doctor (OR=3.42, 95%CI [2.19-5.32]) were associated with a higher score on the PCATool, while retired individuals (OR=0.62, 95%CI [0.45-0.85]) were associated with reporting a low score. An MOR of 1.00 was observed in this final model, indicating that there was no change in risk according to the different clusters. We also observed a significant reduction in deviance in the block of health-related variables, indicating that these variables were the ones that most improved the quality of the model’s fit. For the essential score, individuals with children (OR=1.75, 95%CI [1.26-2.42]), with positive self-perceived health (OR=2.27, 95%CI [1.45-3.55]), with hypertension (OR=1.70, 95%CI [1.09-2.63]) and diabetes (OR=1.72, 95%CI [1.06-2.78]), with five or more consultations in the last year (OR=2.57, 95%CI [1.62-4.09]) and consulting with the same doctor (OR=3.48, 95%CI [2.19-5.52]) were associated with a higher PCATool score. However, retired individuals (OR=0.56, 95%CI [0.41-0.77]) were associated with reporting a low score. A MOR of 1.32 was observed in this final model.
Discussion
The results showed that the city of Rio de Janeiro health services presented an essential score of 7.11, 95%CI [7.03-7.19] and an overall score of 6.72, 95%CI [6.63-6.81] above 6.6 for the child sample, which represents good guidance for PHC, according to the PCATool-Brazil, and an essential score of 6.64, 95%CI [6.55-6.73] above 6.6 for the adult sample, and an overall score slightly below 6.40, 95%CI [6.30-6.55], but close to the cut-off point.
The overall score found in the adult sample and the child sample presented a higher result than that observed in Brazil of 5.9, 95%CI [5.8-5.9] and in the state of Rio de Janeiro of 5.3. 95%CI [5.6-5.9] in 201920. Nevertheless, the result of the present study demonstrated an improvement as compared to the results found for the most recent survey with a sample of users and children conducted in the same municipalities in the first half of 2014, which found an essential score of 5.93, 95%CI [5.82-6.04] and an overall score of 5.73, 95%CI [5.60-5.84] for the adult sample and an essential score of 6.30, 95%CI [6.18-6.43] and an overall score of 6.09, 95%CI [5.95-6.22] for the child sample15. However, the results found in this study for the city of Rio de Janeiro were below the results reported in the literature in cities such as Montevideo (7.51/6.93), the metropolitan region of Seoul (7.63/7.45), the Santander department in Colombia (7.84/6.99), Shigats and Linzi in Tibet (7.36/7.41), and Columbia in the USA (6.99/6.63)7.
The investigation of the association between sociodemographic characteristics and self-reported health conditions of the user and the characteristics of the service and the essential/general score is not widely disseminated in the literature. A study in Hong Kong involving adult users observed that having higher than a secondary education, a higher income, being diagnosed with a chronic disease, and having a private family physician as their primary care provider were associated with the general score21. In a national study aimed at estimating the quality of Brazilian PHC based on the experience of adult users, Rech et al.22 observed that being older, belonging to a lower socioeconomic status, having more than one chronic disease, and having a physician make house calls were associated with the general score. The result was in line with the findings presented in this study, which found an association between the general and essential scores. For adult users, positive self-reported health status, having seen the same physician in the last appointment, and having seen a physician five or more times during the past year were associated with a high score. Similar results were found for the child sample, where individuals responsible for the children with higher levels of education, positive self-reported health status, having seen the same physician in the last appointment, and having seen the physician five or more times during the past year were associated with a high score. No studies were found in the literature that proposed investigating sociodemographic characteristics and self-reported health status for a sample of child users.
For both samples, consulting the same physician and using the PHC service more frequently were associated with better essential and general scores. This could be an effect of longitudinality of care and access, which improves the trajectory of service quality. Another relevant aspect is that 48.4% of the adult sample and 22.5% of the child sample responded to the care coordination attribute. This may reflect the adults’ high referral, considering the evaluation items for this attribute pertain to referrals. The reduction in referrals and possible improvement could be explained by adopting clinical protocols and qualified professional training based on medical residencies in these spaces.
Health Residencies play a crucial role in qualifying health professionals and improving PHC services. The MHD-RJ has one of the largest Family and Community Medicine Residency Programs (FCMRP) in Brazil, which was established in 2012 as an outcome of PHC care reform in the city of Rio de Janeiro23. Some previous studies have suggested that units with FCMRPs or residencies in Family Health have different scores in the PCATool-Brazil as compared to those that do not have them24,25. In the study conducted in the city of Rio de Janeiro15, using the PCATool-Brazil, the results were superior in areas where FCMRPs were traditionally present. Therefore, literature on the subject is still scarce and lacks robust sampling, and new studies are needed to assess the effects of Health Residencies on the PCATool scores.
The use of NPS as a measure of user satisfaction in PHC has been gradually introduced. In the Continuous National Household Sample Survey26, in the PHC module interviewing guardians of children under 13 years of age, the NPS for the state of Rio de Janeiro was found to be +28 (the same result found for Brazil), although higher than that found in this study for the municipality (+15), placing both results within the NPS Improvement Zone.
To the best of the knowledge of the authors of this study, no previous studies have tested the association between NPS and PCATool scores. However, the present study observed a strong direct association, thus highlighting the possibility of using NPS in new PHC evaluation studies as an outcome of user satisfaction, indicating the option of using it as a quick estimation measure by managers.
Final considerations
Several challenges remain evident for city of Rio de Janeiro. Despite the recent expansion of PHC services within the municipality, access in some areas remains a major barrier to improving their quality. The use of scheduling tools, remote access methods, and extending the hours of PHC services may be important steps toward improving the scenario. Another attribute is comprehensiveness. Although the municipality has a broad portfolio of PHC services, it may be necessary to create metrics and indicators so that the available services are, in reality, offered. In addition, the research has shown that it is desirable to strengthen communication with the population as a way to publicize what is available in each health unit.
The city of Rio de Janeiro’s PHC has undergone changes over the last 15 years and has been improving the scope of PHC attributes in 2024, representing a return to the quality of the service it offers. Periodic evaluations are essential to understanding the context, comparing results, and correcting directions. Few studies propose to compare the results achieved by PHC services over time, and the city of Rio de Janeiro presents two evaluations conducted over 10 years with methodological characteristics that may be important for future studies with this objective in mind15.
New studies should be conducted using NPS in PHC, comparing the results with those obtained by the PCATool and observing possible variations according to the characteristics of the services and users. NPS was able to measure user satisfaction from a single question and, thus, be a faster and more economical option for estimating users’ perception of the services, in addition to the research having demonstrated a positive association with the overall PCATool score for both adults and children.
References
- 1 Starfield B, Shi L, Macinko J. Contribution of primary care to health systems and health. Milbank Q 2005; 83(3):457-502.
- 2 Shi L. The impact of primary care: a focused review. Scientifica (Cairo) 2012; 2012:432892.
- 3 Koller CF, Khullar D. Primary care spending rate - A lever for encouraging investment in primary care. N Engl J Med 2017; 377(18):1709-1711.
- 4 Starfield B, Shi L. Policy relevant determinants of health: an international perspective. Health Policy 2002; 60(3):201-218.
- 5 Macinko J, Guanais FC, Fátima M, Souza M. Evaluation of the impact of the Family Health Program on infant mortality in Brazil, 1990-2002. J Epidemiol Community Health 2006; 60(1):13-19.
- 6 Soranz D, Pinto LF, Penna GO. Eixos e a Reforma dos Cuidados em Atenção Primária em Saúde (RCAPS) na cidade do Rio de Janeiro, Brasil. Cien Saude Colet 2016; 21(5):1327-1338.
- 7 D'Avila OP, Pinto LFS, Hauser L, Gonçalves MR, Harzheim E. O uso do Primary Care Assessment Tool (PCAT): uma revisão integrativa e proposta de atualização. Cien Saude Colet 2016; 22(3):855-865.
- 8 Shi L, Starfield B, Xu J. Validating the adult primary care assessment tool. J Fam Pract 2001; 50(2):161-175.
- 9 Starfield B, Cassady C, Nanda J, Forrest CB, Berk R. Consumer experiences and provider perceptions of the quality of primary care: implications for managed care. J Fam Pract 1998; 46(3):216-226.
- 10 Cassady CE, Starfield B, Hurtado MP, Berk RA, Nanda JP, Friedenberg LA. Measuring consumer experiences with primary care. Pediatrics 2000; 105(4):998-1003.
- 11 Bresick G, Sayed AR, Le Grange C, Bhagwan S, Manga N. Adaptation and cross-cultural validation of the United States Primary Care Assessment Tool (expanded version) for use in South Africa. Afr J Prim Health Care Fam Med 2015; 7(1):783.
- 12 Harzheim E, Starfield B, Rajmil L, Álvarez-Dardet C, Stein AT. Internal consistency and reliability of Primary Care Assessment Tool (PCATool-Brasil) for child health services. Cad Saude Publica 2006; 22(8):1649-1659.
- 13 Brasil. Ministério da Saúde (MS). Manual do instrumento de avaliação da atenção primária à saúde: Primary Care Assessment Tool PCATool. Brasília: MS; 2010.
- 14 Brasil. Ministério da Saúde (MS). Manual do Instrumento de Avaliação da Atenção Primária à Saúde: PCATool-Brasil - 2020. Brasília: MS; 2020.
- 15 Harzheim E, Pinto LF, Hauser L, Soranz D. Avaliação dos usuários crianças e adultos quanto ao grau de orientação para Atenção Primária à Saúde na cidade do Rio de Janeiro, Brasil. Cien Saude Colet 2016; 21(5):1399-1408.
- 16 Alismail A, Schaeffer B, Oh A, Hamiduzzaman S, Daher N, Song HY, Furukawa B, Tan LD. The use of the NPS (NPS) in an outpatient allergy and pulmonary clinic: an innovative look into using tablet-based tool vs traditional survey method. Patient Relat Outcome Meas 2020; 11:137-142.
- 17 Koladycz R, Fernandez G, Gray K, Marriott H. The NPS (NPS) for Insight Into Client Experiences in Sexual and Reproductive Health Clinics. Glob Health Sci Pract 2018; 6(3):413-424.
- 18 Reichheld FF. The one number you need to grow. Harv Bus Rev 2003; 81(12):46-54.
- 19 Associação Brasileira de Empresas de Pesquisa (ABEP). Critério de Classificação Econômica Brasil. São Paulo: ABEP; 2024.
- 20 Pinto LF, Quesada LA, D'Avila OP, Hauser L, Gonçalves MR, Harzheim E. Primary Care Asssement Tool: diferenças regionais a partir da Pesquisa Nacional de Saúde do Instituto Brasileiro de Geografia e Estatística. Cien Saude Colet 2021; 26(9):3965-3979.
- 21 Wong SY, Kung K, Griffiths SM, Carthy T, Wong MC, Lo SV, Chung VC, Goggins WB, Starfield B. Comparison of primary care experiences among adults in general outpatient clinics and private general practice clinics in Hong Kong. BMC Public Health 2010; 10:397.
- 22 Rech MRA, Hauser L, Wollmann L, Roman R, Mengue SS, Kemper ES, Florencio ASR, Alfaro G, Tasca R, Harzheim E. Qualidade da atenção primária no Brasil e associação com o Programa Mais Médicos. Rev Panam Salud Publica 2018; 42:e164.
- 23 Justino ALA, Oliver LL, Melo TP. Implantação do Programa de Residência em Medicina de Família e Comunidade da Secretaria Municipal de Saúde do Rio de Janeiro, Brasil. Cien Saude Colet 2016; 21(5):1471-1480.
- 24 Leão CDA, Caldeira AP. Avaliação da associação entre qualificação de médicos e enfermeiros em atenção primária em saúde e qualidade da atenção. Cien Saude Colet 2011; 16(11):4415-4423.
- 25 Costa LB, Mota MV, Porto MMA, Fernandes CSGV, Santos ET, Oliveira JPM, Mota TC, Porto ALS, Alencar MNA. Avaliação da qualidade da Atenção Primária à Saúde em Fortaleza, Brasil, na perspectiva dos usuários adultos no ano de 2019. Cien Saude Colet 2021; 26(6):2083-2096.
-
26 Instituto Brasileiro de Geografia e Estatística (IBGE). Pesquisa Nacional de Amostra Contínua. Atenção Primária à Saúde 2022 [Internet]. [acessado 2024 nov 20]. Disponível em: https://static.poder360.com.br/2022/12/pnad-continua-saude-2022.pdf
» https://static.poder360.com.br/2022/12/pnad-continua-saude-2022.pdf - 27 Harzheim E. Relatório Final - Pesquisa PCATool - Rio - 2024: Avaliação do grau de orientação para Atenção Primária à Saúde entre as unidades de saúde na cidade do Rio de Janeiro - 2024. Porto Alegre: UFRGS; 2025.
