Bay Júnior Osvaldo de Goes, Diniz Vieira Silva Cícera Renata, Santos Martiniano Cláudia, de Figueiredo Melo Lygia Maria, Barros de Souza Marize, Lopes Monique da Silva, Coelho Ardigleusa Alves, de Medeiros Rocha Paulo, de Albuquerque Pinheiro Themis Xavier, de Sá Pinto Dantas Rocha Nadja, da Costa Uchôa Severina Alice
Postgraduate Program in Collective Health, Federal University of Rio Grande do Norte, Natal, Brazil.
Federal University of Campina Grande, Cajazeiras, Brazil.
JMIR Form Res. 2022 Jul 29;6(7):e35996. doi: 10.2196/35996.
The application of cell phones, similar portable devices (ie, tablets), apps, the internet, and GPS in evaluation have established new ways of collecting, storing, retrieving, transmitting, and processing data or information. However, evidence is incipient as to which technological resources remain at the center of assessment practice and the factors that promote their use by the assessment community.
This study aimed to analyze the relationship between the use of the National Program for Improving Primary Healthcare Access and Quality's (PMAQ-AB; Programa Nacional de Melhoria do Acesso e da Qualidade da Atenção Básica) mobile app and management system and the external evaluation quality of Brazil's PMAQ-AB.
We conducted a qualitative case study during the external evaluation of Brazil's PMAQ-AB. Data collection consisted of interviews, focus groups, and document analysis. A total of 7 members from the Department of Primary Care of the Ministry of Health and 47 researchers from various higher education and research institutions across the country participated in the study. Data were categorized using the ATLAS.ti software program, according to the quality standards of the Joint Committee on Standards for Educational Evaluation, following the content analysis approach by Bardin.
The results related to feasibility, thematic scope, field activity management, standardized data collection, data consistency, and transparency. They demonstrated improvements and opportunities for advancements in evaluation mediated by the use of information technology (IT), favored the emergence of new practices and remodeling of existing ones, and took into account the multiple components required by the complex assessment of access and quality in primary health care. Difficulties in technology operation, inoperative systems, and lack of investment in equipment and human resources posed challenges to increasing the effectiveness of IT in evaluation.
The use of technology-based tools-the app and the management system-during the external evaluation offered evaluators a greater opportunity for stakeholder engagement. This also allowed the insertion of different organizational, operational, and methodological components that are capable of triggering influences and confluences. In addition, this allowed connections in collaborative and synergistic networks to increase the quality and allow the development of a more consistent and efficient evaluation process with greater possibility of incorporating the results into public health policies.
手机、类似的便携式设备（如平板电脑）、应用程序、互联网和全球定位系统在评估中的应用开创了收集、存储、检索、传输和处理数据或信息的新方式。然而，关于哪些技术资源仍是评估实践的核心以及促进评估界使用这些资源的因素，相关证据尚处于初始阶段。
本研究旨在分析国家改善初级医疗保健可及性和质量计划（PMAQ-AB；Programa Nacional de Melhoria do Acesso e da Qualidade da Atenção Básica）移动应用程序和管理系统的使用与巴西PMAQ-AB外部评估质量之间的关系。
我们在巴西PMAQ-AB的外部评估期间进行了一项定性案例研究。数据收集包括访谈、焦点小组讨论和文件分析。卫生部初级保健司的7名成员以及来自全国各高等教育和研究机构的47名研究人员参与了该研究。根据教育评估标准联合委员会的质量标准，采用巴丁的内容分析方法，使用ATLAS.ti软件程序对数据进行分类。
结果涉及可行性、主题范围、实地活动管理、标准化数据收集、数据一致性和透明度。这些结果表明，通过信息技术（IT）的使用，评估在改进和进步方面有机会，有利于新实践的出现和现有实践的重塑，并考虑到初级卫生保健中可及性和质量复杂评估所需的多个组成部分。技术操作困难、系统无法运行以及设备和人力资源缺乏投资对提高IT在评估中的有效性构成了挑战。
在外部评估期间使用基于技术的工具——应用程序和管理系统——为评估人员提供了更大的机会来促进利益相关者的参与。这也允许纳入不同的组织、运营和方法组成部分，这些组成部分能够引发影响和融合。此外，这允许在协作和协同网络中建立联系，以提高质量，并使评估过程更加一致和高效，更有可能将结果纳入公共卫生政策。
