The School of Computer and Communication Engineering, University of Science and Technology Beijing, Beijing 100083, China.
The Department of Ultrasound, Chinese PLA General Hospital, Beijing, 100853, China.
Comput Methods Programs Biomed. 2022 Mar;215:106613. doi: 10.1016/j.cmpb.2021.106613. Epub 2021 Dec 31.
Colorectal tumors are common clinical diseases. Automatic segmentation of colorectal tumors captured in computed tomography (CT) images can provide numerous possibilities for computer-assisted treatment. Obtaining large datasets is expensive, and completing labeling is time- and manpower-consuming. To solve the challenge using a limited pathological dataset, this paper proposes a multi-series fusion network with treeconnect (TMSF-Net), which can automatically achieve colorectal tumor segmentation using CT images.
To drive the TMSF-Net, three-series enhanced CT images were collected from all patients to improve the data characteristics. In the TMSF-Net, the coding path was designed as a three-branch structure to realize the feature extraction of the different series. Subsequently, the three branches were merged to start the feature analysis in the decoding path. To achieve the objective of feature fusion, different layers in the decoding path fused feature maps from the upper layer in the encoding path to achieve a cross-scale fusion. In addition, to reduce the problem of parameter redundancy, this study adopted a three-dimensional treeconnect to complete data connection on three branches.
A total of 22 cases were conducted by ablation and comparative experiments to test the TMSF-Net. The results showed that the TMSF-Net can improve the network performance by multiseries fusion, and its expressiveness is better than many classic networks.
The TMSF-Net is a many-to-one structure network, which can enhance the network learning ability and improve the analysis of potential features. Therefore, it yields good results in colorectal tumor segmentation. It can provide a new direction for neural network models based on feature fusion.
结直肠肿瘤是常见的临床疾病。自动分割计算机断层扫描(CT)图像中捕获的结直肠肿瘤,可以为计算机辅助治疗提供多种可能性。获取大的数据集是昂贵的,并且完成标记是耗时且需要人力的。为了解决使用有限的病理数据集的挑战,本文提出了一种多序列融合网络与 treeconnect(TMSF-Net),它可以使用 CT 图像自动实现结直肠肿瘤分割。
为了驱动 TMSF-Net,从所有患者中收集了三系列增强 CT 图像,以提高数据特征。在 TMSF-Net 中,编码路径设计为三分支结构,以实现不同系列的特征提取。随后,三条分支合并以开始解码路径中的特征分析。为了实现特征融合的目标,解码路径中的不同层融合了来自编码路径上层的特征图,以实现跨尺度融合。此外,为了减少参数冗余问题,本研究采用了三维 treeconnect 来完成三条分支的数据连接。
通过消融和对比实验对 22 例 TMSF-Net 进行了测试。结果表明,多序列融合可以提高网络性能,其表现力优于许多经典网络。
TMSF-Net 是一种多对一结构的网络,可以增强网络的学习能力,并提高潜在特征的分析能力。因此,它在结直肠肿瘤分割中取得了良好的效果。它为基于特征融合的神经网络模型提供了一个新的方向。