IEEE Trans Image Process. 2023;32:4773-4784. doi: 10.1109/TIP.2023.3305822. Epub 2023 Aug 25.
Graph convolutional networks have been widely applied in skeleton-based gait recognition. A key challenge in this task is to distinguish the individual walking styles of different subjects across various views. Existing state-of-the-art methods employ uniform convolutions to extract features from diverse sequences and ignore the effects of viewpoint changes. To overcome these limitations, we propose a condition-adaptive graph (CAG) convolution network that can dynamically adapt to the specific attributes of each skeleton sequence and the corresponding view angle. In contrast to using fixed weights for all joints and sequences, we introduce a joint-specific filter learning (JSFL) module in the CAG method, which produces sequence-adaptive filters at the joint level. The adaptive filters capture fine-grained patterns that are unique to each joint, enabling the extraction of diverse spatial-temporal information about body parts. Additionally, we design a view-adaptive topology learning (VATL) module that generates adaptive graph topologies. These graph topologies are used to correlate the joints adaptively according to the specific view conditions. Thus, CAG can simultaneously adjust to various walking styles and viewpoints. Experiments on the two most widely used datasets (i.e., CASIA-B and OU-MVLP) show that CAG surpasses all previous skeleton-based methods. Moreover, the recognition performance can be enhanced by simply combining CAG with appearance-based methods, demonstrating the ability of CAG to provide useful complementary information.
图卷积网络已广泛应用于基于骨架的步态识别中。该任务的一个关键挑战是区分不同视角下不同个体的独特行走风格。现有的最先进方法采用统一卷积从不同序列中提取特征,而忽略视角变化的影响。为了克服这些限制,我们提出了一种条件自适应图(CAG)卷积网络,该网络可以动态适应每个骨架序列和相应视角的特定属性。与为所有关节和序列使用固定权重不同,我们在 CAG 方法中引入了关节特定滤波器学习(JSFL)模块,该模块在关节级别生成序列自适应滤波器。自适应滤波器捕获每个关节特有的细粒度模式,从而提取关于身体部位的不同时空信息。此外,我们设计了视图自适应拓扑学习(VATL)模块,生成自适应图拓扑。这些图拓扑根据特定的视图条件自适应地关联关节。因此,CAG 可以同时适应各种行走风格和视角。在两个最广泛使用的数据集(即 CASIA-B 和 OU-MVLP)上的实验表明,CAG 优于所有以前的基于骨架的方法。此外,通过简单地将 CAG 与基于外观的方法相结合,即可提高识别性能,这表明 CAG 能够提供有用的补充信息。