Wang Junjie, Kang Huanlan, Liu Tao
School of Mathematics and Statistics, Northeastern University at Qinhuangdao, Qinhuangdao 066004, China.
Diagnostics (Basel). 2025 Jun 18;15(12):1552. doi: 10.3390/diagnostics15121552.
: Magnetic Resonance Imaging (MRI) provides rich tumor information through different imaging modalities (T1, T1ce, T2, and FLAIR). Each modality offers distinct contrast and tissue characteristics, which help in the more comprehensive identification and analysis of tumor lesions. However, in clinical practice, only a single modality of medical imaging is available due to various factors such as imaging equipment. The performance of existing methods is significantly hindered when handling incomplete modality data. : A Teacher-Assistant-Student Collaborative and Competitive Net (TASCCNet) is proposed, which is based on traditional knowledge distillation techniques. First, a Multihead Mixture of Experts (MHMoE) module is developed with multiple experts and multiple gated networks to enhance information from fused modalities. Second, a competitive function is formulated to promote collaboration and competition between the student network and the teacher network. Additionally, we introduce an assistant module inspired by human visual mechanisms to provide supplementary structural knowledge, which enriches the information available to the student and facilitates a dynamic teacher-assistant collaboration. : The proposed model (TASCCNet) is evaluated on the BraTS 2018 and BraTS 2021 datasets and demonstrates robust performance even when only a single modality is available. : TASCCNet successfully addresses the challenge of incomplete modality data in brain tumor segmentation by leveraging collaborative knowledge distillation and competitive learning mechanisms.
磁共振成像(MRI)通过不同的成像模态(T1、T1ce、T2和FLAIR)提供丰富的肿瘤信息。每种模态都提供独特的对比度和组织特征,有助于更全面地识别和分析肿瘤病变。然而,在临床实践中,由于成像设备等各种因素,通常只能获得单一模态的医学图像。现有方法在处理不完整模态数据时,性能会受到显著阻碍。
提出了一种教师-助手-学生协作竞争网络(TASCCNet),它基于传统的知识蒸馏技术。首先,开发了一个多头专家混合(MHMoE)模块,该模块包含多个专家和多个门控网络,以增强融合模态的信息。其次,制定了一个竞争函数,以促进学生网络和教师网络之间的协作与竞争。此外,我们引入了一个受人类视觉机制启发的辅助模块,以提供补充结构知识,丰富学生可用的信息,并促进动态的教师-助手协作。
所提出的模型(TASCCNet)在BraTS 2018和BraTS 2021数据集上进行了评估,即使只有单一模态可用,也表现出强大的性能。
TASCCNet通过利用协作知识蒸馏和竞争学习机制,成功解决了脑肿瘤分割中不完整模态数据的挑战。