Department of Intelligent Systems Engineering, Sun Yat-sen University, Shenzhen, 518107, China.
The First Affiliated Hospital of Sun Yat-sen University, Guangzhou, 510080, China.
Comput Biol Med. 2024 May;174:108308. doi: 10.1016/j.compbiomed.2024.108308. Epub 2024 Mar 27.
Automated Osteosarcoma Segmentation in Multi-modality MRI (AOSMM) holds clinical significance for effective tumor evaluation and treatment planning. However, the precision of AOSMM is challenged by the diverse characteristics of multi-modality MRI and the inherent heterogeneity and boundary ambiguity of osteosarcoma. While numerous methods have made significant strides in automated osteosarcoma segmentation, they primarily focused on the use of a single MRI modality and overlooked the potential benefits of integrating complementary information from other MRI modalities. Furthermore, they did not adequately model the long-range dependencies of complex tumor features, which may lead to insufficiently discriminative feature representations. To this end, we propose a decoupled semantic and boundary learning network (DECIDE) to achieve precise AOSMM with three functional modules. The Multi-modality Feature Fusion and Recalibration (MFR) module adaptively fuses and recalibrates multi-modality features by exploiting their channel-wise dependencies to compute low-rank attention weights for effectively aggregating useful information from different MRI modalities, which promotes complementary learning between multi-modality MRI and enables a more comprehensive tumor characterization. The Lesion Attention Enhancement (LAE) module employs spatial and channel attention mechanisms to capture global contextual dependencies over local features, significantly enhancing the discriminability and representational capacity of intricate tumor features. The Boundary Context Aggregation (BCA) module further enhances semantic representations by utilizing boundary information for effective context aggregation while also ensuring intra-class consistency in cases of boundary ambiguity. Substantial experiments demonstrate that DECIDE achieves exceptional performance in osteosarcoma segmentation, surpassing state-of-the-art methods in terms of accuracy and stability.
多模态 MRI 中的自动骨肉瘤分割(AOSMM)对于有效的肿瘤评估和治疗计划具有重要的临床意义。然而,由于多模态 MRI 的特征多样、骨肉瘤的固有异质性和边界模糊性,AOSMM 的精度受到了挑战。虽然许多方法在自动骨肉瘤分割方面取得了重大进展,但它们主要侧重于使用单一的 MRI 模态,而忽略了整合其他 MRI 模态互补信息的潜力。此外,它们没有充分建模复杂肿瘤特征的长程依赖性,这可能导致特征表示不够有区分力。为此,我们提出了一种解耦语义和边界学习网络(DECIDE),通过三个功能模块实现精确的 AOSMM。多模态特征融合和再校准(MFR)模块通过利用其通道依赖性自适应地融合和再校准多模态特征,计算低秩注意力权重,从而有效地从不同的 MRI 模态中聚合有用信息,促进多模态 MRI 之间的互补学习,并实现更全面的肿瘤特征描述。病变注意增强(LAE)模块采用空间和通道注意力机制,捕获局部特征上的全局上下文依赖性,显著提高复杂肿瘤特征的可区分性和表示能力。边界上下文聚合(BCA)模块进一步利用边界信息来增强语义表示,有效地进行上下文聚合,同时在边界模糊的情况下确保类内一致性。大量实验表明,DECIDE 在骨肉瘤分割中表现出色,在准确性和稳定性方面均优于最先进的方法。