• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

一种使用眼动追踪和手势检测的多模态虚拟键盘。

A multimodal virtual keyboard using eye-tracking and hand gesture detection.

作者信息

Cecotti H, Meena Y K, Prasad G

出版信息

Annu Int Conf IEEE Eng Med Biol Soc. 2018 Jul;2018:3330-3333. doi: 10.1109/EMBC.2018.8512909.

DOI:10.1109/EMBC.2018.8512909
PMID:30441101
Abstract

A large number of people with disabilities rely on assistive technologies to communicate with their families, to use social media, and have a social life. Despite a significant increase of novel assitive technologies, robust, non-invasive, and inexpensive solutions should be proposed and optimized in relation to the physical abilities of the users. A reliable and robust identification of intentional visual commands is an important issue in the development of eye-movements based user interfaces. The detection of a command with an eyetracking system can be achieved with a dwell time. Yet, a large number of people can use simple hand gestures as a switch to select a command. We propose a new virtual keyboard based on the detection of ten commands. The keyboard includes all the letters of the Latin script (upper and lower case), punctuation marks, digits, and a delete button. To select a command in the keyboard, the user points the desired item with the gaze, and select it with hand gesture. The system has been evaluated across eight healthy subjects with five predefined hand gestures, and a button for the selection. The results support the conclusion that the performance of a subject, in terms of speed and information transfer rate (ITR), depends on the choice of the hand gesture. The best gesture for each subject provides a mean performance of $8 . 77 \pm 2 .90$ letters per minute, which corresponds to an ITR of $57 . 04 \pm 14 .55$ bits per minute. The results highlight that the hand gesture assigned for the selection of an item is inter-subject dependent.

摘要

大量残疾人依靠辅助技术与家人交流、使用社交媒体并拥有社交生活。尽管新型辅助技术有了显著增加,但仍应根据用户的身体能力提出并优化强大、非侵入性且价格低廉的解决方案。在基于眼动的用户界面开发中,可靠且强大的有意视觉命令识别是一个重要问题。使用眼动追踪系统检测命令可以通过停留时间来实现。然而,许多人可以使用简单的手势作为选择命令的开关。我们提出了一种基于十种命令检测的新型虚拟键盘。该键盘包括拉丁字母表的所有字母(大写和小写)、标点符号、数字以及一个删除按钮。要在键盘中选择一个命令,用户用目光指向所需项目,并用手势进行选择。该系统已通过五个预定义的手势和一个选择按钮,在八名健康受试者身上进行了评估。结果支持这样的结论:受试者在速度和信息传输率(ITR)方面的表现取决于手势的选择。每个受试者的最佳手势每分钟平均能输入$8.77 \pm 2.90$个字母,这对应着每分钟$57.04 \pm 14.55$比特的信息传输率。结果突出表明,用于选择项目的手势因受试者而异。

相似文献

1
A multimodal virtual keyboard using eye-tracking and hand gesture detection.一种使用眼动追踪和手势检测的多模态虚拟键盘。
Annu Int Conf IEEE Eng Med Biol Soc. 2018 Jul;2018:3330-3333. doi: 10.1109/EMBC.2018.8512909.
2
A multiscript gaze-based assistive virtual keyboard.一种基于多脚本注视的辅助虚拟键盘。
Annu Int Conf IEEE Eng Med Biol Soc. 2019 Jul;2019:1306-1309. doi: 10.1109/EMBC.2019.8856446.
3
Toward Optimization of Gaze-Controlled Human-Computer Interaction: Application to Hindi Virtual Keyboard for Stroke Patients.朝向注视控制人机交互的优化:应用于中风患者的印地语虚拟键盘。
IEEE Trans Neural Syst Rehabil Eng. 2018 Apr;26(4):911-922. doi: 10.1109/TNSRE.2018.2814826.
4
A Gaze-Based Virtual Keyboard Using a Mouth Switch for Command Selection.一种使用口控开关进行命令选择的基于注视的虚拟键盘。
Annu Int Conf IEEE Eng Med Biol Soc. 2018 Jul;2018:3334-3337. doi: 10.1109/EMBC.2018.8512929.
5
Towards Optimization of Gaze-Controlled Human-Computer Interaction: Application to Hindi Virtual Keyboard for Stroke Patients.迈向注视控制人机交互的优化:在中风患者印地语虚拟键盘中的应用。
IEEE Trans Neural Syst Rehabil Eng. 2018 Mar 12. doi: 10.1109/TNSRE.2018.2814826.
6
Improving gesture-based interaction between an assistive bathing robot and older adults via user training on the gestural commands.通过对老年人进行手势命令的用户培训,改善辅助沐浴机器人与老年人之间基于手势的交互。
Arch Gerontol Geriatr. 2020 Mar-Apr;87:103996. doi: 10.1016/j.archger.2019.103996. Epub 2019 Dec 13.
7
BackSwipe: Back-of-device Word-Gesture Interaction on Smartphones.BackSwipe:智能手机上基于设备背部的单词手势交互
Proc SIGCHI Conf Hum Factor Comput Syst. 2021 May;2021. doi: 10.1145/3411764.3445081. Epub 2021 May 7.
8
Self-Powered Gesture Recognition Wristband Enabled by Machine Learning for Full Keyboard and Multicommand Input.通过机器学习实现全键盘和多命令输入的自供电手势识别腕带。
Adv Mater. 2022 May;34(21):e2200793. doi: 10.1002/adma.202200793. Epub 2022 Apr 27.
9
Hands-Free User Interface for VR Headsets Based on In Situ Facial Gesture Sensing.基于原位面部手势感应的 VR 头戴式设备免提用户界面。
Sensors (Basel). 2020 Dec 16;20(24):7206. doi: 10.3390/s20247206.
10
Depth camera-based 3D hand gesture controls with immersive tactile feedback for natural mid-air gesture interactions.基于深度摄像头的3D手势控制,具备沉浸式触觉反馈,用于自然的空中手势交互。
Sensors (Basel). 2015 Jan 8;15(1):1022-46. doi: 10.3390/s150101022.