Jiang Xiaoyan, Hu Zuojin, Wang Shuihua, Zhang Yudong
School of Mathematics and Information Science, Nanjing Normal University of Special Education, Nanjing, 210038, China.
School of Computing and Mathematical Sciences, University of Leicester, Leicester, LE1 7RH, UK.
Comput Model Eng Sci. 2023 Apr 23;137(1):35-82. doi: 10.32604/cmes.2023.027676.
Over the years, the continuous development of new technology has promoted research in the field of posture recognition and also made the application field of posture recognition have been greatly expanded. The purpose of this paper is to introduce the latest methods of posture recognition and review the various techniques and algorithms of posture recognition in recent years, such as scale-invariant feature transform, histogram of oriented gradients, support vector machine (SVM), Gaussian mixture model, dynamic time warping, hidden Markov model (HMM), lightweight network, convolutional neural network (CNN). We also investigate improved methods of CNN, such as stacked hourglass networks, multi-stage pose estimation networks, convolutional pose machines, and high-resolution nets. The general process and datasets of posture recognition are analyzed and summarized, and several improved CNN methods and three main recognition techniques are compared. In addition, the applications of advanced neural networks in posture recognition, such as transfer learning, ensemble learning, graph neural networks, and explainable deep neural networks, are introduced. It was found that CNN has achieved great success in posture recognition and is favored by researchers. Still, a more in-depth research is needed in feature extraction, information fusion, and other aspects. Among classification methods, HMM and SVM are the most widely used, and lightweight network gradually attracts the attention of researchers. In addition, due to the lack of 3D benchmark data sets, data generation is a critical research direction.
多年来,新技术的不断发展推动了姿态识别领域的研究,也使得姿态识别的应用领域得到了极大扩展。本文旨在介绍姿态识别的最新方法,并回顾近年来姿态识别的各种技术和算法,如尺度不变特征变换、方向梯度直方图、支持向量机(SVM)、高斯混合模型、动态时间规整、隐马尔可夫模型(HMM)、轻量级网络、卷积神经网络(CNN)。我们还研究了CNN的改进方法,如堆叠沙漏网络、多阶段姿态估计网络、卷积姿态机和高分辨率网络。分析和总结了姿态识别的一般过程和数据集,并比较了几种改进的CNN方法和三种主要的识别技术。此外,还介绍了先进神经网络在姿态识别中的应用,如迁移学习、集成学习、图神经网络和可解释深度神经网络。研究发现,CNN在姿态识别方面取得了巨大成功,受到研究人员的青睐,但在特征提取、信息融合等方面仍需更深入的研究。在分类方法中,HMM和SVM应用最为广泛,轻量级网络逐渐引起研究人员的关注。此外,由于缺乏3D基准数据集,数据生成是一个关键的研究方向。