IEEE Trans Med Imaging. 2023 Apr;42(4):959-970. doi: 10.1109/TMI.2022.3221890. Epub 2023 Apr 3.
An important goal of medical imaging is to be able to precisely detect patterns of disease specific to individual scans; however, this is challenged in brain imaging by the degree of heterogeneity of shape and appearance. Traditional methods, based on image registration, historically fail to detect variable features of disease, as they utilise population-based analyses, suited primarily to studying group-average effects. In this paper we therefore take advantage of recent developments in generative deep learning to develop a method for simultaneous classification, or regression, and feature attribution (FA). Specifically, we explore the use of a VAE-GAN (variational autoencoder - general adversarial network) for translation called ICAM, to explicitly disentangle class relevant features, from background confounds, for improved interpretability and regression of neurological phenotypes. We validate our method on the tasks of Mini-Mental State Examination (MMSE) cognitive test score prediction for the Alzheimer's Disease Neuroimaging Initiative (ADNI) cohort, as well as brain age prediction, for both neurodevelopment and neurodegeneration, using the developing Human Connectome Project (dHCP) and UK Biobank datasets. We show that the generated FA maps can be used to explain outlier predictions and demonstrate that the inclusion of a regression module improves the disentanglement of the latent space. Our code is freely available on GitHub https://github.com/CherBass/ICAM.
医学影像学的一个重要目标是能够准确检测特定于个体扫描的疾病模式;然而,在脑成像中,由于形状和外观的异质性程度,这一目标面临挑战。基于图像配准的传统方法在历史上无法检测到疾病的可变特征,因为它们使用基于人群的分析,主要适用于研究群体平均效应。因此,在本文中,我们利用生成式深度学习的最新进展,开发了一种用于同时分类或回归和特征归因(FA)的方法。具体来说,我们探索了使用称为 ICAM 的变分自动编码器-生成对抗网络(VAE-GAN)进行翻译,以明确分离与疾病相关的特征,以及背景混杂因素,从而提高可解释性和神经表型的回归。我们在阿尔茨海默病神经影像学倡议(ADNI)队列的 Mini-Mental State Examination(MMSE)认知测试分数预测以及神经发育和神经退行性疾病的大脑年龄预测等任务上验证了我们的方法,使用正在开发的人类连接组计划(dHCP)和英国生物银行数据集。我们表明,生成的 FA 图可用于解释异常预测,并证明包含回归模块可改善潜在空间的解缠。我们的代码可在 GitHub 上免费获得:https://github.com/CherBass/ICAM。