Institute of Clinical Medicine, Pathology and Forensic Medicine, Translational Cancer Research Area, University of Eastern Finland, P.O. Box 1627, 70211, Kuopio, Finland.
Department of Clinical Radiology, Kuopio University Hospital, P.O. Box 100, 70029, Kuopio, Finland.
Sci Rep. 2021 Jul 8;11(1):14105. doi: 10.1038/s41598-021-93169-w.
We propose a novel multi-level dilated residual neural network, an extension of the classical U-Net architecture, for biomedical image segmentation. U-Net is the most popular deep neural architecture for biomedical image segmentation, however, despite being state-of-the-art, the model has a few limitations. In this study, we suggest replacing convolutional blocks of the classical U-Net with multi-level dilated residual blocks, resulting in enhanced learning capability. We also propose to incorporate a non-linear multi-level residual blocks into skip connections to reduce the semantic gap and to restore the information lost when concatenating features from encoder to decoder units. We evaluate the proposed approach on five publicly available biomedical datasets with different imaging modalities, including electron microscopy, magnetic resonance imaging, histopathology, and dermoscopy, each with its own segmentation challenges. The proposed approach consistently outperforms the classical U-Net by 2%, 3%, 6%, 8%, and 14% relative improvements in dice coefficient, respectively for magnetic resonance imaging, dermoscopy, histopathology, cell nuclei microscopy, and electron microscopy modalities. The visual assessments of the segmentation results further show that the proposed approach is robust against outliers and preserves better continuity in boundaries compared to the classical U-Net and its variant, MultiResUNet.
我们提出了一种新颖的多层次扩张残差神经网络,是经典 U-Net 架构的扩展,用于生物医学图像分割。U-Net 是最流行的生物医学图像分割深度学习架构,但尽管是最先进的,该模型仍存在一些局限性。在这项研究中,我们建议用多层次扩张残差块替代经典 U-Net 的卷积块,从而提高学习能力。我们还建议在跳连接中加入非线性多层次残差块,以减少语义差距,并在将编码器到解码器单元的特征连接时恢复丢失的信息。我们在五个具有不同成像模式的公开生物医学数据集上评估了所提出的方法,包括电子显微镜、磁共振成像、组织病理学和皮肤镜检查,每个数据集都有自己的分割挑战。所提出的方法在磁共振成像、皮肤镜检查、组织病理学、细胞核显微镜和电子显微镜模态方面,与经典 U-Net 相比,分别在骰子系数上提高了 2%、3%、6%、8%和 14%。分割结果的可视化评估进一步表明,与经典 U-Net 及其变体 MultiResUNet 相比,所提出的方法对异常值具有更强的鲁棒性,并且边界的连续性更好。