Chen Yifan, Zhao Yang, Li Xuelong
IEEE Trans Neural Netw Learn Syst. 2025 Jan;36(1):1545-1554. doi: 10.1109/TNNLS.2023.3331050. Epub 2025 Jan 7.
Gait recognition has become a mainstream technology for identification, as it can recognize the identity of subjects from a distance without any cooperation. However, when subjects wear coats (CL) or backpacks (BG), their gait silhouette will be occluded, which will lose some gait information and bring great difficulties to the identification. Another important challenge in gait recognition is that the gait silhouette of the same subject captured by different camera angles varies greatly, which will cause the same subject to be misidentified as different individuals under different camera angles. In this article, we try to overcome these problems from three aspects: data augmentation, feature extraction, and feature refinement. Correspondingly, we propose gait sequence mixing (GSM), multigranularity feature extraction (MFE), and feature distance alignment (FDA). GSM is a method that belongs to data enhancement, which uses the gait sequences in NM to assist in learning the gait sequences in BG or CL, thus reducing the influence of lost gait information in abnormal gait sequences (BG or CL). MFE explores and fuses different granularity features of gait sequences from different scales, and it can learn as much useful information as possible from incomplete gait silhouettes. FDA refines the extracted gait features with the help of the distribution of gait features in real world and makes them more discriminative, thus reducing the influence of various camera angles. Extensive experiments demonstrate that our method has better results than some state-of-the-art methods on CASIA-B and mini-OUMVLP. We also embed the GSM module and FDA module into some state-of-the-art methods, and the recognition accuracy of these methods is greatly improved.
步态识别已成为一种主流的身份识别技术,因为它可以在无需任何配合的情况下从远处识别对象的身份。然而,当对象穿着外套(CL)或背着背包(BG)时,他们的步态轮廓会被遮挡,这将丢失一些步态信息,并给识别带来极大困难。步态识别中的另一个重要挑战是,不同摄像头角度捕捉到的同一对象的步态轮廓差异很大,这会导致同一对象在不同摄像头角度下被误识别为不同个体。在本文中,我们试图从三个方面克服这些问题:数据增强、特征提取和特征细化。相应地,我们提出了步态序列混合(GSM)、多粒度特征提取(MFE)和特征距离对齐(FDA)。GSM是一种属于数据增强的方法,它使用NM中的步态序列来辅助学习BG或CL中的步态序列,从而减少异常步态序列(BG或CL)中丢失的步态信息的影响。MFE探索并融合来自不同尺度的步态序列的不同粒度特征,并且它可以从不完整的步态轮廓中学习尽可能多的有用信息。FDA借助现实世界中步态特征的分布对提取的步态特征进行细化,使其更具判别力,从而减少各种摄像头角度的影响。大量实验表明,我们的方法在CASIA - B和mini - OUMVLP上比一些现有方法具有更好的结果。我们还将GSM模块和FDA模块嵌入到一些现有方法中,这些方法的识别准确率得到了极大提高。