Tak Divyanshu, Garomsa Biniam A, Chaunzwa Tafadzwa L, Zapaishchykova Anna, Climent Pardo Juan Carlos, Ye Zezhong, Zielke John, Ravipati Yashwanth, Vajapeyam Sri, Mahootiha Maryam, Smith Ceilidh, Familiar Ariana M, Liu Kevin X, Prabhu Sanjay, Bandopadhayay Pratiti, Nabavizadeh Ali, Mueller Sabine, Aerts Hugo Jwl, Huang Raymond Y, Poussaint Tina Y, Kann Benjamin H
Artificial Intelligence in Medicine (AIM) Program, Mass General Brigham, Harvard Medical School, Boston, MA, United States.
Department of Radiation Oncology, Dana-Farber Cancer Institute and Brigham and Women's Hospital, Harvard Medical School, Boston, MA, United States.
medRxiv. 2024 Dec 3:2024.12.02.24317992. doi: 10.1101/2024.12.02.24317992.
Artificial intelligence (AI) applied to brain magnetic resonance imaging (MRI) has the potential to improve disease diagnosis and management but requires algorithms with generalizable knowledge that can perform well in a variety of clinical scenarios. The field has been constrained, thus far, by limited training data and task-specific models that do not generalize well across patient populations and medical tasks. Foundation models, by leveraging self-supervised learning, pretraining, and targeted adaptation, present a promising paradigm to overcome these limitations. Here, we present Brain Imaging Adaptive Core (BrainIAC), a novel foundation model designed to learn generalized representations from unlabeled brain MRI data and serve as a core basis for diverse downstream application adaptation. Trained and validated on 48,519 brain MRIs across a broad spectrum of tasks, we demonstrate that BrainIAC outperforms localized supervised training and other pretrained models, particularly in low-data settings and high-difficulty tasks, allowing for application in scenarios otherwise infeasible. BrainIAC can be integrated into imaging pipelines and multimodal frameworks and may lead to improved biomarker discovery and AI clinical translation.
应用于脑磁共振成像(MRI)的人工智能(AI)有改善疾病诊断和管理的潜力,但需要具有可推广知识的算法,以便在各种临床场景中都能表现良好。到目前为止,该领域一直受到训练数据有限和特定任务模型的限制,这些模型在不同患者群体和医疗任务中无法很好地推广。基础模型通过利用自监督学习、预训练和针对性适应,提供了一个克服这些限制的有前景的范例。在此,我们展示了脑成像自适应核心(BrainIAC),这是一种新型基础模型,旨在从未标记的脑MRI数据中学习通用表示,并作为各种下游应用适应的核心基础。在广泛任务的48519例脑MRI上进行训练和验证后,我们证明BrainIAC优于局部监督训练和其他预训练模型,特别是在低数据设置和高难度任务中,从而能够应用于其他情况下不可行的场景。BrainIAC可以集成到成像流程和多模态框架中,并可能改善生物标志物发现和AI临床转化。