Suppr超能文献

用于脑肿瘤分割的具有缺失模态的教师-助手-学生协作与竞争网络

The Teacher-Assistant-Student Collaborative and Competitive Network for Brain Tumor Segmentation with Missing Modalities.

作者信息

Wang Junjie, Kang Huanlan, Liu Tao

机构信息

School of Mathematics and Statistics, Northeastern University at Qinhuangdao, Qinhuangdao 066004, China.

出版信息

Diagnostics (Basel). 2025 Jun 18;15(12):1552. doi: 10.3390/diagnostics15121552.

Abstract

: Magnetic Resonance Imaging (MRI) provides rich tumor information through different imaging modalities (T1, T1ce, T2, and FLAIR). Each modality offers distinct contrast and tissue characteristics, which help in the more comprehensive identification and analysis of tumor lesions. However, in clinical practice, only a single modality of medical imaging is available due to various factors such as imaging equipment. The performance of existing methods is significantly hindered when handling incomplete modality data. : A Teacher-Assistant-Student Collaborative and Competitive Net (TASCCNet) is proposed, which is based on traditional knowledge distillation techniques. First, a Multihead Mixture of Experts (MHMoE) module is developed with multiple experts and multiple gated networks to enhance information from fused modalities. Second, a competitive function is formulated to promote collaboration and competition between the student network and the teacher network. Additionally, we introduce an assistant module inspired by human visual mechanisms to provide supplementary structural knowledge, which enriches the information available to the student and facilitates a dynamic teacher-assistant collaboration. : The proposed model (TASCCNet) is evaluated on the BraTS 2018 and BraTS 2021 datasets and demonstrates robust performance even when only a single modality is available. : TASCCNet successfully addresses the challenge of incomplete modality data in brain tumor segmentation by leveraging collaborative knowledge distillation and competitive learning mechanisms.

摘要

磁共振成像(MRI)通过不同的成像模态(T1、T1ce、T2和FLAIR)提供丰富的肿瘤信息。每种模态都提供独特的对比度和组织特征,有助于更全面地识别和分析肿瘤病变。然而,在临床实践中,由于成像设备等各种因素,通常只能获得单一模态的医学图像。现有方法在处理不完整模态数据时,性能会受到显著阻碍。

提出了一种教师-助手-学生协作竞争网络(TASCCNet),它基于传统的知识蒸馏技术。首先,开发了一个多头专家混合(MHMoE)模块,该模块包含多个专家和多个门控网络,以增强融合模态的信息。其次,制定了一个竞争函数,以促进学生网络和教师网络之间的协作与竞争。此外,我们引入了一个受人类视觉机制启发的辅助模块,以提供补充结构知识,丰富学生可用的信息,并促进动态的教师-助手协作。

所提出的模型(TASCCNet)在BraTS 2018和BraTS 2021数据集上进行了评估,即使只有单一模态可用,也表现出强大的性能。

TASCCNet通过利用协作知识蒸馏和竞争学习机制,成功解决了脑肿瘤分割中不完整模态数据的挑战。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/6a05/12192063/72288ff66973/diagnostics-15-01552-g001.jpg

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验