Zhou Xiao, Balachandra Akshara R, Romano Michael F, Chin Sang Peter, Au Rhoda, Kolachalama Vijaya B
Department of Molecular Biophysics and Biochemistry, Yale University, New Haven, CT 06520, USA.
Department of Medicine, Stanford University School of Medicine, Stanford, CA 94305, USA.
IEEE Access. 2024;12:83169-83182. doi: 10.1109/access.2024.3408840. Epub 2024 Jun 3.
Game theory-inspired deep learning using a generative adversarial network provides an environment to competitively interact and accomplish a goal. In the context of medical imaging, most work has focused on achieving single tasks such as improving image resolution, segmenting images, and correcting motion artifacts. We developed a dual-objective adversarial learning framework that simultaneously 1) reconstructs higher quality brain magnetic resonance images (MRIs) that 2) retain disease-specific imaging features critical for predicting progression from mild cognitive impairment (MCI) to Alzheimer's disease (AD). We obtained 3-Tesla, T1-weighted brain MRIs of participants from the Alzheimer's Disease Neuroimaging Initiative (ADNI, N=342) and the National Alzheimer's Coordinating Center (NACC, N = 190) datasets. We simulated MRIs with missing data by removing 50% of sagittal slices from the original scans (i.e., diced scans). The generator was trained to reconstruct brain MRIs using the diced scans as input. We introduced a classifier into the GAN architecture to discriminate between stable (i.e., sMCI) and progressive MCI (i.e., pMCI) based on the generated images to facilitate encoding of disease-related information during reconstruction. The framework was trained using ADNI data and externally validated on NACC data. In the NACC cohort, generated images had better image quality than the diced scans (Structural similarity (SSIM) index: 0.553 ± 0.116 versus 0.348 ± 0.108). Furthermore, a classifier utilizing the generated images distinguished pMCI from sMCI more accurately than with the diced scans (F1-score: 0.634 ± 0.019 versus 0.573 ± 0.028). Competitive deep learning has potential to facilitate disease-oriented image reconstruction in those at risk of developing Alzheimer's disease.
受博弈论启发的使用生成对抗网络的深度学习提供了一个用于竞争性交互和实现目标的环境。在医学成像领域,大多数工作都集中在实现单一任务上,例如提高图像分辨率、分割图像和校正运动伪影。我们开发了一种双目标对抗学习框架,该框架同时1)重建更高质量的脑磁共振图像(MRI),2)保留对于预测从轻度认知障碍(MCI)进展到阿尔茨海默病(AD)至关重要的疾病特异性成像特征。我们从阿尔茨海默病神经成像倡议(ADNI,N = 342)和国家阿尔茨海默病协调中心(NACC,N = 190)数据集中获取了参与者的3特斯拉T1加权脑MRI。我们通过从原始扫描(即切块扫描)中去除50%的矢状切片来模拟有缺失数据的MRI。生成器被训练使用切块扫描作为输入来重建脑MRI。我们在GAN架构中引入了一个分类器,以基于生成的图像区分稳定型(即sMCI)和进展型MCI(即pMCI),以便在重建过程中促进疾病相关信息的编码。该框架使用ADNI数据进行训练,并在NACC数据上进行外部验证。在NACC队列中,生成的图像比切块扫描具有更好的图像质量(结构相似性(SSIM)指数:0.553±0.116对0.348±0.108)。此外,利用生成图像的分类器比使用切块扫描更准确地区分pMCI和sMCI(F1分数:0.634±0.019对0.573±0.028)。竞争性深度学习有潜力促进对有患阿尔茨海默病风险的人群进行面向疾病的图像重建。