Tayyab Muhammad, Alateyah Sulaiman Abdullah, Alnusayri Mohammed, Alatiyyah Mohammed, AlHammadi Dina Abdulaziz, Jalal Ahmad, Liu Hui
Department of Computer Science, Air University, Islamabad 44000, Pakistan.
Department of Computer Engineering, College of Computer, Qassim University, Buraydah 52571, Saudi Arabia.
Sensors (Basel). 2025 Jan 13;25(2):441. doi: 10.3390/s25020441.
This paper presents an approach for event recognition in sequential images using human body part features and their surrounding context. Key body points were approximated to track and monitor their presence in complex scenarios. Various feature descriptors, including MSER (Maximally Stable Extremal Regions), SURF (Speeded-Up Robust Features), distance transform, and DOF (Degrees of Freedom), were applied to skeleton points, while BRIEF (Binary Robust Independent Elementary Features), HOG (Histogram of Oriented Gradients), FAST (Features from Accelerated Segment Test), and Optical Flow were used on silhouettes or full-body points to capture both geometric and motion-based features. Feature fusion was employed to enhance the discriminative power of the extracted data and the physical parameters calculated by different feature extraction techniques. The system utilized a hybrid CNN (Convolutional Neural Network) + RNN (Recurrent Neural Network) classifier for event recognition, with Grey Wolf Optimization (GWO) for feature selection. Experimental results showed significant accuracy, achieving 98.5% on the UCF-101 dataset and 99.2% on the YouTube dataset. Compared to state-of-the-art methods, our approach achieved better performance in event recognition.
本文提出了一种利用人体部位特征及其周围环境在序列图像中进行事件识别的方法。关键身体点被近似处理,以在复杂场景中跟踪和监测它们的存在。各种特征描述符,包括最大稳定极值区域(MSER)、加速鲁棒特征(SURF)、距离变换和自由度(DOF),被应用于骨骼点,而二进制鲁棒独立基元特征(BRIEF)、方向梯度直方图(HOG)、加速段测试特征(FAST)和光流则用于轮廓或全身点,以捕捉基于几何和运动的特征。采用特征融合来增强提取数据以及不同特征提取技术计算出的物理参数的判别能力。该系统利用混合卷积神经网络(CNN)+循环神经网络(RNN)分类器进行事件识别,并采用灰狼优化(GWO)进行特征选择。实验结果显示出显著的准确率,在UCF - 101数据集上达到98.5%,在YouTube数据集上达到99.2%。与现有方法相比,我们的方法在事件识别方面取得了更好的性能。