IEEE Trans Med Imaging. 2023 Sep;42(9):2490-2501. doi: 10.1109/TMI.2023.3258069. Epub 2023 Aug 31.
Despite the tremendous progress made by deep learning models in image semantic segmentation, they typically require large annotated examples, and increasing attention is being diverted to problem settings like Few-Shot Learning (FSL) where only a small amount of annotation is needed for generalisation to novel classes. This is especially seen in medical domains where dense pixel-level annotations are expensive to obtain. In this paper, we propose Regularized Prototypical Neural Ordinary Differential Equation (R-PNODE), a method that leverages intrinsic properties of Neural-ODEs, assisted and enhanced by additional cluster and consistency losses to perform Few-Shot Segmentation (FSS) of organs. R-PNODE constrains support and query features from the same classes to lie closer in the representation space thereby improving the performance over the existing Convolutional Neural Network (CNN) based FSS methods. We further demonstrate that while many existing Deep CNN-based methods tend to be extremely vulnerable to adversarial attacks, R-PNODE exhibits increased adversarial robustness for a wide array of these attacks. We experiment with three publicly available multi-organ segmentation datasets in both in-domain and cross-domain FSS settings to demonstrate the efficacy of our method. In addition, we perform experiments with seven commonly used adversarial attacks in various settings to demonstrate R-PNODE's robustness. R-PNODE outperforms the baselines for FSS by significant margins and also shows superior performance for a wide array of attacks varying in intensity and design.
尽管深度学习模型在图像语义分割方面取得了巨大进展,但它们通常需要大量标注示例,并且越来越多的注意力被转移到 Few-Shot Learning (FSL) 等问题设置上,这些设置只需要少量标注即可推广到新的类别。这在医学领域尤其明显,因为密集像素级的标注获取成本很高。在本文中,我们提出了 Regularized Prototypical Neural Ordinary Differential Equation (R-PNODE),这是一种利用神经微分方程内在特性的方法,通过额外的聚类和一致性损失来辅助和增强,从而实现器官的 Few-Shot Segmentation (FSS)。R-PNODE 约束来自同一类别的支持和查询特征在表示空间中更接近,从而提高了现有基于卷积神经网络 (CNN) 的 FSS 方法的性能。我们进一步证明,虽然许多现有的基于深度 CNN 的方法往往极易受到对抗攻击的影响,但 R-PNODE 对广泛的这些攻击表现出更高的对抗鲁棒性。我们在域内和跨域 FSS 设置中使用了三个公开的多器官分割数据集来验证我们方法的有效性。此外,我们在各种设置中进行了七种常用对抗攻击的实验,以验证 R-PNODE 的鲁棒性。R-PNODE 在 FSS 方面的表现明显优于基线,并且在各种强度和设计的广泛攻击中也表现出了卓越的性能。