Deng Yunjiao, Wang Hui, Hou Yulei, Liang Shunpan, Zeng Daxing
School of Mechanical Engineering, Yanshan University, Qinhuangdao 066004, China.
School of Information Science and Engineering, Yanshan University, Qinhuangdao 066004, China.
Curr Med Imaging. 2023;19(4):347-360. doi: 10.2174/1573405618666220622154853.
In the series of improved versions of U-Net, while the segmentation accuracy continues to improve, the number of parameters does not change, which makes the hardware required for training expensive, thus affecting the speed of training convergence.
The objective of this study is to propose a lightweight U-Net to balance the relationship between the parameters and the segmentation accuracy.
A lightweight U-Net with full skip connections and deep supervision (LFU-Net) was proposed. The full skip connections include skip connections from shallow encoders, deep decoders, and sub-networks, while the deep supervision learns hierarchical representations from full-resolution feature representations in outputs of sub-networks. The key lightweight design is that the number of output channels is based on 8 rather than 64 or 32. Its pruning scheme was designed to further reduce parameters. The code is available at: https://github.com/dengdy22/U-Nets.
For the ISBI LiTS 2017 Challenge validation dataset, the LFU-Net with no pruning received a Dice value of 0.9699, which achieved equal or better performance with a mere about 1% of the parameters of existing networks. For the BraTS 2018 validation dataset, its Dice values were 0.8726, 0.9363, 0.8699 and 0.8116 on average, WT, TC and ET, respectively, and its Hausdorff95 distances values were 3.9514, 4.3960, 3.0607 and 4.3975, respectively, which was not inferior to the existing networks and showed that it can achieve balanced recognition of each region.
LFU-Net can be used as a lightweight and effective method in the segmentation tasks of two and multiple classification medical imaging datasets.
在U-Net的一系列改进版本中,虽然分割精度不断提高,但参数数量却没有变化,这使得训练所需的硬件成本高昂,从而影响训练收敛速度。
本研究的目的是提出一种轻量级U-Net,以平衡参数与分割精度之间的关系。
提出了一种具有全跳连接和深度监督的轻量级U-Net(LFU-Net)。全跳连接包括来自浅层编码器、深层解码器和子网络的跳连接,而深度监督则从子网络输出中的全分辨率特征表示中学习分层表示。关键的轻量级设计是输出通道数基于8而不是64或32。其剪枝方案旨在进一步减少参数。代码可在以下网址获取:https://github.com/dengdy22/U-Nets。
对于ISBI LiTS 2017挑战赛验证数据集,未进行剪枝的LFU-Net的Dice值为0.9699,其性能与现有网络相当或更好,而参数仅为现有网络的约1%。对于BraTS 2018验证数据集,其在WT、TC和ET上的Dice值平均分别为0.8726、0.9363、0.8699和0.8116,其Hausdorff95距离值分别为3.9514、4.3960、3.0607和4.3975,不逊色于现有网络,表明它可以实现对每个区域的平衡识别。
LFU-Net可作为二分类和多分类医学影像数据集分割任务中的一种轻量级有效方法。