Yalçin Abdullah, Rekik Islem
BASIRA lab, Faculty of Computer and Informatics, Istanbul Technical University, Istanbul, Turkey.
BASIRA lab, Faculty of Computer and Informatics, Istanbul Technical University, Istanbul, Turkey; School of Science and Engineering, Computing, University of Dundee, UK.
J Neurosci Methods. 2021 Jan 15;348:109014. doi: 10.1016/j.jneumeth.2020.109014. Epub 2020 Dec 10.
Presence of multimodal brain graphs derived from different neuroimaging modalities is inarguably one of the most critical challenges in building unified classification models that can be trained and tested on any brain graph regardless of its size and the modality it was derived from.
One solution is to learn a model for each modality independently, which is cumbersome and becomes more time-consuming as the number of modalities increases. Another traditional solution is to build a model inputting multimodal brain graphs for the target prediction task; however, this is only applicable to datasets where all samples have joint neuro-modalities.
In this paper, we propose to build a unified brain graph classification model trained on unpaired multimodal brain graphs, which can classify any brain graph of any size. This is enabled by incorporating a graph alignment step where all multi-modal graphs of different sizes and heterogeneous distributions are mapped to a common template graph. Next, we design a graph alignment strategy to the target fixed-size template and further apply linear discriminant analysis (LDA) to the aligned graphs as a supervised dimensionality reduction technique for the target classification task.
We tested our method on unpaired autistic and healthy brain connectomes derived from functional and morphological MRI datasets (two modalities).
Our results showed that our unified model method not only has great promise in solving such a challenging problem but achieves comparable performance to models trained on each modality independently.
从不同神经成像模态中获取多模态脑图谱,无疑是构建统一分类模型时面临的最关键挑战之一,该模型需能在任何脑图谱上进行训练和测试,无论其大小及所源自的模态。
一种解决方案是为每种模态独立学习一个模型,这很繁琐,且随着模态数量增加会变得更耗时。另一种传统解决方案是构建一个输入多模态脑图谱以进行目标预测任务的模型;然而,这仅适用于所有样本都具有联合神经模态的数据集。
在本文中,我们提议构建一个在未配对多模态脑图谱上训练的统一脑图谱分类模型,该模型能够对任何大小的脑图谱进行分类。这通过纳入一个图谱对齐步骤来实现,在该步骤中,所有不同大小和异质分布的多模态图谱都被映射到一个通用模板图谱。接下来,我们设计一种针对目标固定大小模板的图谱对齐策略,并进一步将线性判别分析(LDA)应用于对齐后的图谱,作为用于目标分类任务的监督降维技术。
我们在源自功能和形态MRI数据集(两种模态)的未配对自闭症和健康脑连接组上测试了我们的方法。
我们的结果表明,我们的统一模型方法不仅在解决此类具有挑战性的问题上极具前景,而且与独立在每种模态上训练的模型具有相当的性能。