IEEE Trans Image Process. 2021;30:3041-3055. doi: 10.1109/TIP.2021.3055936. Epub 2021 Feb 22.
Gait recognition aims to recognize persons' identities by walking styles. Gait recognition has unique advantages due to its characteristics of non-contact and long-distance compared with face and fingerprint recognition. Cross-view gait recognition is a challenge task because view variance may produce large impact on gait silhouettes. The development of deep learning has promoted cross-view gait recognition performances to a higher level. However, performances of existing deep learning-based cross-view gait recognition methods are limited by lack of gait samples under different views. In this paper, we take a Multi-view Gait Generative Adversarial Network (MvGGAN) to generate fake gait samples to extend existing gait datasets, which provides adequate gait samples for deep learning-based cross-view gait recognition methods. The proposed MvGGAN method trains a single generator for all view pairs involved in single or multiple datasets. Moreover, we perform domain alignment based on projected maximum mean discrepancy to reduce the influence of distribution divergence caused by sample generation. The experimental results on CASIA-B and OUMVLP dataset demonstrate that fake gait samples generated by the proposed MvGGAN method can improve performances of existing state-of-the-art cross-view gait recognition methods obviously on both single-dataset and cross-dataset evaluation settings.
步态识别旨在通过行走方式识别人员的身份。与面部和指纹识别相比,步态识别具有非接触和远距离的独特优势。跨视角步态识别是一项具有挑战性的任务,因为视角变化可能会对步态轮廓产生很大的影响。深度学习的发展将跨视角步态识别性能提升到了一个更高的水平。然而,现有的基于深度学习的跨视角步态识别方法的性能受到缺乏不同视角下的步态样本的限制。在本文中,我们采用多视角步态生成对抗网络(MvGGAN)生成虚假的步态样本,以扩展现有的步态数据集,为基于深度学习的跨视角步态识别方法提供充足的步态样本。所提出的 MvGGAN 方法为单个或多个数据集中涉及的所有视角对训练单个生成器。此外,我们基于投影最大均值差异进行域对齐,以减少样本生成引起的分布发散的影响。在 CASIA-B 和 OUMVLP 数据集上的实验结果表明,所提出的 MvGGAN 方法生成的虚假步态样本可以显著提高现有最先进的跨视角步态识别方法在单数据集和跨数据集评估设置下的性能。