BASIRA lab, Faculty of Computer and Informatics, Istanbul Technical University, Istanbul, Turkey; Higher Institute of Informatics and Communication Technologies, University of Sousse, Tunisia.
Higher Institute of Informatics and Communication Technologies, University of Sousse, Tunisia.
Med Image Anal. 2021 Feb;68:101902. doi: 10.1016/j.media.2020.101902. Epub 2020 Nov 16.
Developing predictive intelligence in neuroscience for learning how to generate multimodal medical data from a single modality can improve neurological disorder diagnosis with minimal data acquisition resources. Existing deep learning frameworks are mainly tailored for images, which might fail in handling geometric data (e.g., brain graphs). Specifically, predicting a target brain graph from a single source brain graph remains largely unexplored. Solving such problem is generally challenged with domain fracturecaused by the difference in distribution between source and target domains. Besides, solving the prediction and domain fracture independently might not be optimal for both tasks. To address these challenges, we unprecedentedly propose a Learning-guided Graph Dual Adversarial Domain Alignment (LG-DADA) framework for predicting a target brain graph from a source brain graph. The proposed LG-DADA is grounded in three fundamental contributions: (1) a source data pre-clustering step using manifold learning to firstly handle source data heterogeneity and secondly circumvent mode collapse in generative adversarial learning, (2) a domain alignment of source domain to the target domain by adversarially learning their latent representations, and (3) a dual adversarial regularization that jointly learns a source embedding of training and testing brain graphs using two discriminators and predict the training target graphs. Results on morphological brain graphs synthesis showed that our method produces better prediction accuracy and visual quality as compared to other graph synthesis methods.
在神经科学中开发预测智能,以学习如何从单一模态生成多模态医学数据,可以用最少的数据采集资源改善神经紊乱诊断。现有的深度学习框架主要针对图像进行了优化,因此可能无法处理几何数据(例如脑图)。具体来说,从单源脑图预测目标脑图在很大程度上仍未得到探索。解决此类问题通常面临着源域和目标域分布差异导致的领域断裂问题。此外,分别解决预测和领域断裂问题可能对两个任务都不是最优的。为了解决这些挑战,我们史无前例地提出了一种用于从源脑图预测目标脑图的学习引导图对偶对抗域对齐(LG-DADA)框架。所提出的 LG-DADA 基于三个基本贡献:(1)使用流形学习进行源数据预聚类步骤,首先处理源数据异质性,其次避免生成对抗学习中的模式崩溃;(2)通过对抗性学习源域和目标域的潜在表示来对齐源域和目标域;(3)双重对抗正则化,使用两个鉴别器联合学习训练和测试脑图的源嵌入,并预测训练目标图。形态脑图合成的结果表明,与其他图合成方法相比,我们的方法产生了更好的预测准确性和视觉质量。