Huang Qidong, Dong Xiaoyi, Chen Dongdong, Zhou Hang, Zhang Weiming, Zhang Kui, Hua Gang, Cheng Yueqiang, Yu Nenghai
IEEE Trans Image Process. 2024;33:2183-2196. doi: 10.1109/TIP.2024.3372456. Epub 2024 Mar 22.
Notwithstanding the prominent performance shown in various applications, point cloud recognition models have often suffered from natural corruptions and adversarial perturbations. In this paper, we delve into boosting the general robustness of point cloud recognition, proposing Point-Cloud Contrastive Adversarial Training (PointCAT). The main intuition of PointCAT is encouraging the target recognition model to narrow the decision gap between clean point clouds and corrupted point clouds by devising feature-level constraints rather than logit-level constraints. Specifically, we leverage a supervised contrastive loss to facilitate the alignment and the uniformity of hypersphere representations, and design a pair of centralizing losses with dynamic prototype guidance to prevent features from deviating outside their belonging category clusters. To generate more challenging corrupted point clouds, we adversarially train a noise generator concurrently with the recognition model from the scratch. This differs from previous adversarial training methods that utilized gradient-based attacks as the inner loop. Comprehensive experiments show that the proposed PointCAT outperforms the baseline methods, significantly enhancing the robustness of diverse point cloud recognition models under various corruptions, including isotropic point noises, the LiDAR simulated noises, random point dropping, and adversarial perturbations. Our code is available at: https://github.com/shikiw/PointCAT.
尽管点云识别模型在各种应用中表现出色,但它们经常受到自然损坏和对抗性扰动的影响。在本文中,我们深入探讨如何提升点云识别的总体鲁棒性,提出了点云对比对抗训练(PointCAT)。PointCAT的主要直觉是通过设计特征级约束而非逻辑级约束,鼓励目标识别模型缩小干净点云和损坏点云之间的决策差距。具体而言,我们利用监督对比损失来促进超球面表示的对齐和一致性,并设计了一对带有动态原型引导的中心化损失,以防止特征偏离其所属类别簇之外。为了生成更具挑战性的损坏点云,我们从零开始与识别模型同时对抗训练一个噪声生成器。这与之前使用基于梯度攻击作为内循环的对抗训练方法不同。综合实验表明,所提出的PointCAT优于基线方法,显著增强了各种损坏情况下(包括各向同性点噪声、激光雷达模拟噪声、随机点丢弃和对抗性扰动)不同点云识别模型的鲁棒性。我们的代码可在以下网址获取:https://github.com/shikiw/PointCAT。