Someko Hidehiro, Yamamoto Ryohei, Ariie Takashi, Onishi Akira, Kumasawa Junji, Okazawa Yuki, Hanaki Nao, Anan Keisuke, Matsuda Yuki, Fujiwara Gaku, Hashimoto Katsuhiko, Tada Masafumi, Akamatsu Yuri, Murakami Minoru, Fujii Kotaro, Kataoka Yuki
Department of Healthcare Epidemiology, Kyoto University Graduate School of Medicine/Public Health, Japan.
Scientific Research WorkS Peer Support Group (SRWS-PSG), Japan.
Intern Med. 2024 Dec 26. doi: 10.2169/internalmedicine.4724-24.
Introduction Evidence-based medicine (EBM) competency is crucial for healthcare professionals; however, validated tools to assess EBM skills in Japanese are scarce. This study aimed to develop and validate a Japanese version of the Assessing Competency in EBM (ACE) tool. Methods We translated the ACE tool into Japanese, following international standards, and distributed it online to 99 healthcare professionals and students. The participants completed demographic questions and the Japanese version of the ACE tool. A subset also completed the retest and Fresno test. Internal consistency was assessed using Cronbach's alpha, test-retest reliability using the intraclass correlation coefficient (ICC), and construct validity using a confirmatory factor analysis and correlation with the Fresno test. Results The Japanese version of the ACE tool showed a low internal consistency (Cronbach's alpha = 0.31, 95% CI: 0.09-0.49), but an acceptable test-retest reliability (ICC = 0.64, 95% CI: 0.40-0.81). A confirmatory factor analysis provided moderate support for the structure of the tool (SRMR = 0.092, RMSEA = 0.048, CFI = 0.852). The tool demonstrated a moderate correlation with the Fresno test (r = 0.35). The median completion time was 847 s (IQR, 577-1,249 s). Conclusion Although the Japanese version of the ACE tool showed some promising aspects, including a quick administration and partial validity, its low internal consistency suggests that refinement is needed before it can be confidently used in Japanese medical education settings. Future studies should focus on improving the tool's reliability, potentially through in-person administration, to develop a robust EBM assessment tool in the Japanese healthcare context.
引言 循证医学（EBM）能力对医疗保健专业人员至关重要；然而，在日本，用于评估循证医学技能的经过验证的工具却很稀缺。本研究旨在开发并验证日语版的循证医学能力评估（ACE）工具。方法 我们按照国际标准将ACE工具翻译成日语，并在线分发给99名医疗保健专业人员和学生。参与者完成了人口统计学问题以及日语版的ACE工具。一部分参与者还完成了重测和弗雷斯诺测试。使用克朗巴哈系数评估内部一致性，使用组内相关系数（ICC）评估重测信度，使用验证性因子分析以及与弗雷斯诺测试的相关性评估结构效度。结果 日语版的ACE工具显示出较低的内部一致性（克朗巴哈系数 = 0.31，95%置信区间：0.09 - 0.49），但重测信度尚可接受（ICC = 0.64，95%置信区间：0.40 - 0.81）。验证性因子分析为该工具的结构提供了适度支持（SRMR = 0.092，RMSEA = 0.048，CFI = 0.852）。该工具与弗雷斯诺测试显示出中等相关性（r = 0.35）。中位完成时间为847秒（四分位间距，577 - 1249秒）。结论 尽管日语版的ACE工具显示出一些有前景的方面，包括施测迅速和部分效度，但它较低的内部一致性表明在其能够自信地用于日本医学教育环境之前还需要改进。未来的研究应专注于提高该工具的可靠性，可能通过面对面施测，以在日本医疗保健背景下开发一个强大的循证医学评估工具。
