• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

基于 MediaPipe 可注册系统的实时手部姿态监测模型。

Real-Time Hand Gesture Monitoring Model Based on MediaPipe's Registerable System.

机构信息

College of Mechanical Engineering, North University of China, Taiyuan 030051, China.

SIMITECH Co., Xi'an 710086, China.

出版信息

Sensors (Basel). 2024 Sep 27;24(19):6262. doi: 10.3390/s24196262.

DOI:10.3390/s24196262
PMID:39409300
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC11478756/
Abstract

Hand gesture recognition plays a significant role in human-to-human and human-to-machine interactions. Currently, most hand gesture detection methods rely on fixed hand gesture recognition. However, with the diversity and variability of hand gestures in daily life, this paper proposes a registerable hand gesture recognition approach based on Triple Loss. By learning the differences between different hand gestures, it can cluster them and identify newly added gestures. This paper constructs a registerable gesture dataset (RGDS) for training registerable hand gesture recognition models. Additionally, it proposes a normalization method for transforming hand gesture data and a FingerComb block for combining and extracting hand gesture data to enhance features and accelerate model convergence. It also improves ResNet and introduces FingerNet for registerable single-hand gesture recognition. The proposed model performs well on the RGDS dataset. The system is registerable, allowing users to flexibly register their own hand gestures for personalized gesture recognition.

摘要

手势识别在人与人以及人与机器的交互中起着重要作用。目前,大多数手势检测方法都依赖于固定的手势识别。然而,日常生活中手势的多样性和可变性,本文提出了一种基于三重损失的可注册手势识别方法。通过学习不同手势之间的差异,它可以对其进行聚类并识别新添加的手势。本文构建了一个可注册手势数据集(RGDS),用于训练可注册手势识别模型。此外,它提出了一种用于转换手势数据的归一化方法和一个 FingerComb 块,用于组合和提取手势数据,以增强特征并加速模型收敛。它还改进了 ResNet 并引入了 FingerNet 用于可注册单手手势识别。所提出的模型在 RGDS 数据集上表现良好。该系统是可注册的,允许用户灵活地注册自己的手势,实现个性化的手势识别。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7178/11478756/9dd5cb2b1dee/sensors-24-06262-g008.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7178/11478756/7ebea3ae2d53/sensors-24-06262-g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7178/11478756/86fd5c082815/sensors-24-06262-g002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7178/11478756/b9acc288b0f2/sensors-24-06262-g003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7178/11478756/1d0b1243f1a6/sensors-24-06262-g004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7178/11478756/d1fb135e0b64/sensors-24-06262-g005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7178/11478756/0478fa20cdfc/sensors-24-06262-g006.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7178/11478756/2dac9f50ff4a/sensors-24-06262-g007.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7178/11478756/9dd5cb2b1dee/sensors-24-06262-g008.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7178/11478756/7ebea3ae2d53/sensors-24-06262-g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7178/11478756/86fd5c082815/sensors-24-06262-g002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7178/11478756/b9acc288b0f2/sensors-24-06262-g003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7178/11478756/1d0b1243f1a6/sensors-24-06262-g004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7178/11478756/d1fb135e0b64/sensors-24-06262-g005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7178/11478756/0478fa20cdfc/sensors-24-06262-g006.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7178/11478756/2dac9f50ff4a/sensors-24-06262-g007.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/7178/11478756/9dd5cb2b1dee/sensors-24-06262-g008.jpg

相似文献

1
Real-Time Hand Gesture Monitoring Model Based on MediaPipe's Registerable System.基于 MediaPipe 可注册系统的实时手部姿态监测模型。
Sensors (Basel). 2024 Sep 27;24(19):6262. doi: 10.3390/s24196262.
2
Static Hand Gesture Recognition Using Capacitive Sensing and Machine Learning.基于电容式感应和机器学习的静态手势识别。
Sensors (Basel). 2023 Mar 24;23(7):3419. doi: 10.3390/s23073419.
3
Real-Time Surface EMG Pattern Recognition for Hand Gestures Based on an Artificial Neural Network.基于人工神经网络的手势实时表面肌电模式识别。
Sensors (Basel). 2019 Jul 18;19(14):3170. doi: 10.3390/s19143170.
4
TMMF: Temporal Multi-Modal Fusion for Single-Stage Continuous Gesture Recognition.TMMF:用于单阶段连续手势识别的时频多模态融合。
IEEE Trans Image Process. 2021;30:7689-7701. doi: 10.1109/TIP.2021.3108349. Epub 2021 Sep 10.
5
Semi-Supervised Joint Learning for Hand Gesture Recognition from a Single Color Image.基于单彩色图像的手势识别的半监督联合学习。
Sensors (Basel). 2021 Feb 2;21(3):1007. doi: 10.3390/s21031007.
6
Real-time human pose estimation and gesture recognition from depth images using superpixels and SVM classifier.使用超像素和支持向量机分类器从深度图像中进行实时人体姿态估计和手势识别。
Sensors (Basel). 2015 May 26;15(6):12410-27. doi: 10.3390/s150612410.
7
Exploiting domain transformation and deep learning for hand gesture recognition using a low-cost dataglove.利用领域变换和深度学习,使用低成本数据手套进行手势识别。
Sci Rep. 2022 Dec 12;12(1):21446. doi: 10.1038/s41598-022-25108-2.
8
Classification Algorithm for Person Identification and Gesture Recognition Based on Hand Gestures with Small Training Sets.基于小训练集的手势的人员身份识别和手势识别分类算法。
Sensors (Basel). 2020 Dec 18;20(24):7279. doi: 10.3390/s20247279.
9
Gyroscope-Based Continuous Human Hand Gesture Recognition for Multi-Modal Wearable Input Device for Human Machine Interaction.基于陀螺仪的连续人体手势识别,用于人机交互的多模式可穿戴输入设备。
Sensors (Basel). 2019 Jun 5;19(11):2562. doi: 10.3390/s19112562.
10
Study on Gesture Recognition Method with Two-Stream Residual Network Fusing sEMG Signals and Acceleration Signals.基于双通道残差网络融合表面肌电信号和加速度信号的手势识别方法研究。
Sensors (Basel). 2024 Apr 24;24(9):2702. doi: 10.3390/s24092702.

本文引用的文献

1
Audio-Visual Speech and Gesture Recognition by Sensors of Mobile Devices.基于移动设备传感器的视听语音和手势识别。
Sensors (Basel). 2023 Feb 17;23(4):2284. doi: 10.3390/s23042284.
2
Recognizing gestures by learning local motion signatures of HOG descriptors.通过学习 HOG 描述符的局部运动特征来识别手势。
IEEE Trans Pattern Anal Mach Intell. 2012 Nov;34(11):2247-58. doi: 10.1109/TPAMI.2012.19.