College of Medicine and Biological Information Engineering, Northeastern University, Shenyang, China; Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China.
Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China; Department of Radiology, The Second Affiliated Hospital of Harbin Medical University, Harbin, China.
Comput Biol Med. 2021 Mar;130:104183. doi: 10.1016/j.compbiomed.2020.104183. Epub 2020 Dec 16.
Multiscale feature fusion is a feasible method to improve tumor segmentation accuracy. However, current multiscale networks have two common problems: 1. Some networks only allow feature fusion between encoders and decoders of the same scale. It is obvious that such feature fusion is not sufficient. 2. Some networks have too many dense skip connections and too much nesting between the coding layer and the decoding layer, which causes some features to be lost and means that not enough information will be learned from multiple scales. To overcome these two problems, we propose a multiscale double-channel convolution U-Net (MDCC-Net) framework for colorectal tumor segmentation.
In the coding layer, we designed a dual-channel separation and convolution module and then added residual connections to perform multiscale feature fusion on the input image and the feature map after dual-channel separation and convolution. By fusing features at different scales in the same coding layer, the network can fully extract the detailed information of the original image and learn more tumor boundary information.
The segmentation results show that our proposed method has a high accuracy, with a Dice similarity coefficient (DSC) of 83.57%, which is an improvement of 9.59%, 6.42%, and 1.57% compared with nnU-Net, U-Net, and U-Net++, respectively.
The experimental results show that our proposed method has good performance in the segmentation of colorectal tumors and is close to the expert level. The proposed method has potential clinical applicability.
多尺度特征融合是提高肿瘤分割准确性的一种可行方法。然而,目前的多尺度网络存在两个常见问题:1. 一些网络仅允许在同一尺度的编码器和解码器之间进行特征融合。显然,这种特征融合是不充分的。2. 一些网络具有太多密集的跳过连接和编码层与解码层之间的嵌套,这会导致一些特征丢失,并且意味着从多个尺度学习到的信息不足。为了克服这两个问题,我们提出了一种用于结直肠肿瘤分割的多尺度双通道卷积 U-Net (MDCC-Net) 框架。
在编码层,我们设计了双通道分离和卷积模块,然后添加残差连接,对输入图像和双通道分离卷积后的特征图进行多尺度特征融合。通过在同一编码层融合不同尺度的特征,网络可以充分提取原始图像的详细信息,并学习更多的肿瘤边界信息。
分割结果表明,我们提出的方法具有较高的准确性,其 Dice 相似系数(DSC)为 83.57%,与 nnU-Net、U-Net 和 U-Net++ 相比,分别提高了 9.59%、6.42%和 1.57%。
实验结果表明,我们提出的方法在结直肠肿瘤分割中具有良好的性能,接近专家水平。该方法具有潜在的临床适用性。