• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

分层学习方法在人体动作识别中的应用。

A Hierarchical Learning Approach for Human Action Recognition.

机构信息

Electrical Engineering Department, École de Technologies Supérieure, Montreal, QC H3C 1K3, Canada.

出版信息

Sensors (Basel). 2020 Sep 1;20(17):4946. doi: 10.3390/s20174946.

DOI:10.3390/s20174946
PMID:32882894
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC7506581/
Abstract

In the domain of human action recognition, existing works mainly focus on using RGB, depth, skeleton and infrared data for analysis. While these methods have the benefit of being non-invasive, they can only be used within limited setups, are prone to issues such as occlusion and often need substantial computational resources. In this work, we address human action recognition through inertial sensor signals, which have a vast quantity of practical applications in fields such as sports analysis and human-machine interfaces. For that purpose, we propose a new learning framework built around a 1D-CNN architecture, which we validated by achieving very competitive results on the publicly available UTD-MHAD dataset. Moreover, the proposed method provides some answers to two of the greatest challenges currently faced by action recognition algorithms, which are (1) the recognition of high-level activities and (2) the reduction of their computational cost in order to make them accessible to embedded devices. Finally, this paper also investigates the tractability of the features throughout the proposed framework, both in time and duration, as we believe it could play an important role in future works in order to make the solution more intelligible, hardware-friendly and accurate.

摘要

在人类动作识别领域,现有工作主要集中在使用 RGB、深度、骨骼和红外数据进行分析。虽然这些方法具有非侵入性的优点,但它们只能在有限的设置中使用,容易出现遮挡等问题,并且通常需要大量的计算资源。在这项工作中,我们通过惯性传感器信号来解决人类动作识别问题,这些信号在运动分析和人机接口等领域有大量的实际应用。为此,我们提出了一个新的学习框架,该框架围绕 1D-CNN 架构构建,我们在公开的 UTD-MHAD 数据集上验证了该框架,取得了非常有竞争力的结果。此外,该方法为动作识别算法目前面临的两个最大挑战提供了一些解决方案,这两个挑战是:(1)高级活动的识别,(2)降低其计算成本,以便使其可用于嵌入式设备。最后,本文还研究了整个框架中特征的可处理性,包括时间和持续时间,我们认为这在未来的工作中可能会发挥重要作用,以使解决方案更加易于理解、硬件友好和准确。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3569/7506581/75bf56a48591/sensors-20-04946-g011.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3569/7506581/2861bb4d5354/sensors-20-04946-g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3569/7506581/839cccd12765/sensors-20-04946-g002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3569/7506581/115246a8df65/sensors-20-04946-g003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3569/7506581/5023b84e3bf9/sensors-20-04946-g004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3569/7506581/281ffdee7f85/sensors-20-04946-g005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3569/7506581/2d1f74c309b4/sensors-20-04946-g006.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3569/7506581/12b3d57a2f3e/sensors-20-04946-g007.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3569/7506581/155f4997d9b3/sensors-20-04946-g008.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3569/7506581/d79bdcb2a666/sensors-20-04946-g009.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3569/7506581/c74fcd0efdc2/sensors-20-04946-g010.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3569/7506581/75bf56a48591/sensors-20-04946-g011.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3569/7506581/2861bb4d5354/sensors-20-04946-g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3569/7506581/839cccd12765/sensors-20-04946-g002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3569/7506581/115246a8df65/sensors-20-04946-g003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3569/7506581/5023b84e3bf9/sensors-20-04946-g004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3569/7506581/281ffdee7f85/sensors-20-04946-g005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3569/7506581/2d1f74c309b4/sensors-20-04946-g006.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3569/7506581/12b3d57a2f3e/sensors-20-04946-g007.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3569/7506581/155f4997d9b3/sensors-20-04946-g008.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3569/7506581/d79bdcb2a666/sensors-20-04946-g009.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3569/7506581/c74fcd0efdc2/sensors-20-04946-g010.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3569/7506581/75bf56a48591/sensors-20-04946-g011.jpg

相似文献

1
A Hierarchical Learning Approach for Human Action Recognition.分层学习方法在人体动作识别中的应用。
Sensors (Basel). 2020 Sep 1;20(17):4946. doi: 10.3390/s20174946.
2
Enhancing Human Activity Recognition through Integrated Multimodal Analysis: A Focus on RGB Imaging, Skeletal Tracking, and Pose Estimation.通过集成多模态分析增强人类活动识别:重点关注 RGB 成像、骨骼跟踪和姿势估计。
Sensors (Basel). 2024 Jul 17;24(14):4646. doi: 10.3390/s24144646.
3
A union of deep learning and swarm-based optimization for 3D human action recognition.基于深度学习和群体智能优化的三维人体动作识别方法。
Sci Rep. 2022 Mar 31;12(1):5494. doi: 10.1038/s41598-022-09293-8.
4
Fusion of Video and Inertial Sensing for Deep Learning-Based Human Action Recognition.视频与惯性传感器融合的深度学习人体动作识别
Sensors (Basel). 2019 Aug 24;19(17):3680. doi: 10.3390/s19173680.
5
Dynamic Edge Convolutional Neural Network for Skeleton-Based Human Action Recognition.基于骨架的人体动作识别的动态边缘卷积神经网络。
Sensors (Basel). 2023 Jan 10;23(2):778. doi: 10.3390/s23020778.
6
Human Activity Recognition via Hybrid Deep Learning Based Model.基于混合深度学习的人体活动识别。
Sensors (Basel). 2022 Jan 1;22(1):323. doi: 10.3390/s22010323.
7
A Robust Deep Learning Approach for Position-Independent Smartphone-Based Human Activity Recognition.一种稳健的基于深度学习的智能手机位置无关的人体活动识别方法。
Sensors (Basel). 2018 Nov 1;18(11):3726. doi: 10.3390/s18113726.
8
w-HAR: An Activity Recognition Dataset and Framework Using Low-Power Wearable Devices.w-HAR:一个使用低功耗可穿戴设备的活动识别数据集和框架。
Sensors (Basel). 2020 Sep 18;20(18):5356. doi: 10.3390/s20185356.
9
Activity Recognition for Ambient Assisted Living with Videos, Inertial Units and Ambient Sensors.利用视频、惯性单元和环境传感器进行安养环境活动识别。
Sensors (Basel). 2021 Jan 24;21(3):768. doi: 10.3390/s21030768.
10
Low-Cost and Device-Free Human Activity Recognition Based on Hierarchical Learning Model.基于分层学习模型的低成本、无设备人体活动识别。
Sensors (Basel). 2021 Mar 28;21(7):2359. doi: 10.3390/s21072359.

引用本文的文献

1
A Low-Resolution Infrared Array for Unobtrusive Human Activity Recognition That Preserves Privacy.用于隐私保护的非侵入式人体活动识别的低分辨率红外阵列。
Sensors (Basel). 2024 Jan 31;24(3):926. doi: 10.3390/s24030926.
2
Clinical human activity recognition based on a wearable patch of combined tri-axial ACC and ECG sensors.基于可穿戴式三轴加速度计和心电图传感器组合贴片的临床人体活动识别
Digit Health. 2024 Jan 4;10:20552076231223804. doi: 10.1177/20552076231223804. eCollection 2024 Jan-Dec.
3
ConMLP: MLP-Based Self-Supervised Contrastive Learning for Skeleton Data Analysis and Action Recognition.

本文引用的文献

1
Fusion of Video and Inertial Sensing for Deep Learning-Based Human Action Recognition.视频与惯性传感器融合的深度学习人体动作识别
Sensors (Basel). 2019 Aug 24;19(17):3680. doi: 10.3390/s19173680.
2
NTU RGB+D 120: A Large-Scale Benchmark for 3D Human Activity Understanding.NTU RGB+D 120:用于三维人体活动理解的大规模基准测试。
IEEE Trans Pattern Anal Mach Intell. 2020 Oct;42(10):2684-2701. doi: 10.1109/TPAMI.2019.2916873. Epub 2019 May 14.
3
Deep Recurrent Neural Networks for Human Activity Recognition.深度递归神经网络在人体活动识别中的应用。
ConMLP:基于 MLP 的自监督对比学习在骨骼数据分析和动作识别中的应用。
Sensors (Basel). 2023 Feb 22;23(5):2452. doi: 10.3390/s23052452.
4
A Deep Learning and Clustering Extraction Mechanism for Recognizing the Actions of Athletes in Sports.运动员运动动作识别的深度学习与聚类提取机制
Comput Intell Neurosci. 2022 Mar 24;2022:2663834. doi: 10.1155/2022/2663834. eCollection 2022.
5
Exploring 3D Human Action Recognition Using STACOG on Multi-View Depth Motion Maps Sequences.基于多视角深度运动图序列的 STACOG 探索三维人体动作识别。
Sensors (Basel). 2021 May 24;21(11):3642. doi: 10.3390/s21113642.
Sensors (Basel). 2017 Nov 6;17(11):2556. doi: 10.3390/s17112556.
4
Deep Convolutional and LSTM Recurrent Neural Networks for Multimodal Wearable Activity Recognition.用于多模态可穿戴活动识别的深度卷积和长短期记忆循环神经网络
Sensors (Basel). 2016 Jan 18;16(1):115. doi: 10.3390/s16010115.