Kareem Irfan, Ali Syed Farooq, Bilal Muhammad, Hanif Muhammad Shehzad
Department of Mathematics and Computer Science, University of Calabria, Rende, Italy.
School of Systems and Technology, University of Management and Technology, Lahore, Pakistan.
PLoS One. 2024 Dec 5;19(12):e0314959. doi: 10.1371/journal.pone.0314959. eCollection 2024.
Over the last decade, there have been a lot of advances in the area of human posture recognition. Among multiple approaches proposed to solve this problem, those based on deep learning have shown promising results. Taking another step in this direction, this paper analyzes the performance of deep learning-based hybrid architecture for fall detection, In this regard, the fusion of the residual network (ResNet-50) deep features with support vector machine (SVM) at the classification layer has been considered. The proposed approach outperforms the existing methods yielding an accuracy of 98.82%, 97.95%, and 99.98% on three datasets i.e. Multi-Camera Fall (MCF) using four postures, UR Fall detection (URFD) using four postures, and UP-Fall detection (UPFD) using four postures respectively. It is important to mention that the existing methods achieve accuracies of 97.9%, 97.33%, and 95.64% on the MCF, URDF and UPFD datasets, respectively. Moreover, we achieved 100% accuracy on the UPFD two-posture task. The URFD and MCF datasets have been utilized to assess the fall detection performance of our method under a realistic environment (e.g. camouflage, occlusion, and variation in lighting conditions due to day/night lighting variation). For comparison purposes, we have also performed experiments using six state-of-the-art deep learning networks, namely; ResNet-50, ResNet-101, VGG-19, InceptionV3, MobileNet, and Xception. The results demonstrate that the proposed approach outperforms other network models both in terms of accuracy and time efficiency. We also compared the performance of SVM with Naive Bayes, Decision Tree, Random Forest, KNN, AdaBoost, and MLP used at the classifier layer and found that SVM outperforms or is on par with other classifiers.
在过去十年中,人体姿势识别领域取得了许多进展。在为解决此问题而提出的多种方法中,基于深度学习的方法已显示出有前景的结果。朝着这个方向更进一步,本文分析了基于深度学习的混合架构在跌倒检测方面的性能。在这方面,已经考虑了在分类层将残差网络(ResNet - 50)的深度特征与支持向量机(SVM)进行融合。所提出的方法优于现有方法,在三个数据集上分别产生了98.82%、97.95%和99.98%的准确率,这三个数据集分别是使用四种姿势的多摄像头跌倒(MCF)数据集、使用四种姿势的UR跌倒检测(URFD)数据集以及使用四种姿势的UP - 跌倒检测(UPFD)数据集。需要指出的是,现有方法在MCF、URDF和UPFD数据集上分别达到了97.9%、97.33%和95.64%的准确率。此外,我们在UPFD双姿势任务上实现了100%的准确率。URFD和MCF数据集已被用于评估我们的方法在现实环境(例如伪装、遮挡以及由于昼夜光照变化导致的光照条件变化)下的跌倒检测性能。为了进行比较,我们还使用了六个最先进的深度学习网络进行实验,即ResNet - 50、ResNet - 101、VGG - 19、InceptionV3、MobileNet和Xception。结果表明,所提出的方法在准确率和时间效率方面均优于其他网络模型。我们还比较了在分类器层使用的支持向量机与朴素贝叶斯、决策树、随机森林、KNN、AdaBoost和MLP的性能,发现支持向量机优于或与其他分类器相当。