Harrison Taylor B, Hu Dian, Fu Sunyang, Liu Hongfang
Artificial Intelligence and Informatics, Mayo Clinic, Rochester, MN, USA.
Bioinformatics and Computational Biology, University of Minnesota, Minneapolis, MN, USA.
AMIA Annu Symp Proc. 2025 May 22;2024:493-502. eCollection 2024.
Digital health technologies (DHTs) have revolutionized clinical trials, offering unprecedented opportunities to streamline processes, enhance patient engagement, and improve data quality. Growing technology device and broadband access are contributing to the increasing number of DHT-enabled trials. Ideally, DHTs have the potential to make clinical research more inclusive and diverse. However, while the variety in digital technologies and implementations present a strong display of healthcare innovation, major challenges arise concerning DHT generalizability and translation into real-world medical practice. In this study, we report our efforts in accelerating the literature review process related to the use of DHTs in randomized controlled trials (RCTs) by leveraging large language models (LLMs); identified in existing LLM task evaluations as possible tools supporting evidence harvesting scalability. We designed three tasks for automating title screening and information extraction of DHT-enabled RCTs using multiple LLMs, which yielded promising results towards large scale literature review.
数字健康技术(DHTs)彻底改变了临床试验,为简化流程、提高患者参与度和改善数据质量提供了前所未有的机会。技术设备和宽带接入的不断发展促使启用DHT的试验数量不断增加。理想情况下,DHTs有潜力使临床研究更具包容性和多样性。然而,尽管数字技术和实施方式的多样性充分展示了医疗保健创新,但在DHT的通用性以及转化为实际医疗实践方面仍存在重大挑战。在本研究中,我们报告了通过利用大语言模型(LLMs)加速与DHTs在随机对照试验(RCTs)中的使用相关的文献综述过程所做的努力;在现有的LLM任务评估中,LLMs被确定为可能支持证据收集可扩展性的工具。我们设计了三项任务,使用多个LLMs自动筛选启用DHT的RCTs的标题并提取信息,这为大规模文献综述带来了有希望的结果。