School of Computer Science and Engineering, Northeastern University, Shenyang 110819, China.
School of Computer Science and Engineering, Northeastern University, Shenyang 110819, China; Engineering Research Center of Security Technology of Complex Network System, Ministry of Education, China; Key Laboratory of Intelligent Computing in Medical Image, Ministry of Education, Northeastern University, Shenyang 110819, China.
Comput Biol Med. 2022 Oct;149:106051. doi: 10.1016/j.compbiomed.2022.106051. Epub 2022 Aug 24.
Semi-supervised learning has made significant strides in the medical domain since it alleviates the heavy burden of collecting abundant pixel-wise annotated data for semantic segmentation tasks. Existing semi-supervised approaches enhance the ability to extract features from unlabeled data with prior knowledge obtained from limited labeled data. However, due to the scarcity of labeled data, the features extracted by the models are limited in supervised learning, and the quality of predictions for unlabeled data also cannot be guaranteed. Both will impede consistency training. To this end, we proposed a novel uncertainty-aware scheme to make models learn regions purposefully. Specifically, we employ Monte Carlo Sampling as an estimation method to attain an uncertainty map, which can serve as a weight for losses to force the models to focus on the valuable region according to the characteristics of supervised learning and unsupervised learning. Simultaneously, in the backward process, we joint unsupervised and supervised losses to accelerate the convergence of the network via enhancing the gradient flow between different tasks. Quantitatively, we conduct extensive experiments on three challenging medical datasets. Experimental results show desirable improvements to state-of-the-art counterparts.
自监督学习在医学领域取得了重大进展,因为它减轻了语义分割任务中收集大量像素级注释数据的繁重负担。现有的半监督方法通过从有限的标记数据中获得的先验知识来提高从未标记数据中提取特征的能力。然而,由于标记数据的稀缺性,模型提取的特征在监督学习中受到限制,对未标记数据的预测质量也无法保证。这两者都会阻碍一致性训练。为此,我们提出了一种新的不确定性感知方案,使模型有目的地学习区域。具体来说,我们采用蒙特卡罗采样作为一种估计方法来获得不确定性图,该图可以作为损失的权重,根据监督学习和无监督学习的特点,迫使模型专注于有价值的区域。同时,在反向过程中,我们联合无监督和监督损失,通过增强不同任务之间的梯度流来加速网络的收敛。在三个具有挑战性的医学数据集上进行了广泛的实验,实验结果表明与最先进的方法相比有了显著的改进。