• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

基于混合注视-脑机接口的半自主机器人手臂伸展

Semi-Autonomous Robotic Arm Reaching With Hybrid Gaze-Brain Machine Interface.

作者信息

Zeng Hong, Shen Yitao, Hu Xuhui, Song Aiguo, Xu Baoguo, Li Huijun, Wang Yanxin, Wen Pengcheng

机构信息

School of Instrument Science and Engineering, Southeast University, Nanjing, China.

State Key Laboratory of Bioelectronics, School of Instrument Science and Engineering, Southeast University, Nanjing, China.

出版信息

Front Neurorobot. 2020 Jan 24;13:111. doi: 10.3389/fnbot.2019.00111. eCollection 2019.

DOI:10.3389/fnbot.2019.00111
PMID:32038219
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC6992643/
Abstract

Recent developments in the non-muscular human-robot interface (HRI) and shared control strategies have shown potential for controlling the assistive robotic arm by people with no residual movement or muscular activity in upper limbs. However, most non-muscular HRIs only produce discrete-valued commands, resulting in non-intuitive and less effective control of the dexterous assistive robotic arm. Furthermore, the user commands and the robot autonomy commands usually switch in the shared control strategies of such applications. This characteristic has been found to yield a reduced sense of agency as well as frustration for the user according to previous user studies. In this study, we firstly propose an intuitive and easy-to-learn-and-use hybrid HRI by combing the Brain-machine interface (BMI) and the gaze-tracking interface. For the proposed hybrid gaze-BMI, the continuous modulation of the movement speed via the motor intention occurs seamlessly and simultaneously to the unconstrained movement direction control with the gaze signals. We then propose a shared control paradigm that always combines user input and the autonomy with the dynamic combination regulation. The proposed hybrid gaze-BMI and shared control paradigm were validated for a robotic arm reaching task performed with healthy subjects. All the users were able to employ the hybrid gaze-BMI for moving the end-effector sequentially to reach the target across the horizontal plane while also avoiding collisions with obstacles. The shared control paradigm maintained as much volitional control as possible, while providing the assistance for the most difficult parts of the task. The presented semi-autonomous robotic system yielded continuous, smooth, and collision-free motion trajectories for the end effector approaching the target. Compared to a system without assistances from robot autonomy, it significantly reduces the rate of failure as well as the time and effort spent by the user to complete the tasks.

摘要

非肌肉人机接口(HRI)和共享控制策略的最新进展表明,对于上肢没有残余运动或肌肉活动的人来说,控制辅助机器人手臂具有潜力。然而,大多数非肌肉HRI只产生离散值命令,导致对灵巧辅助机器人手臂的控制不直观且效果不佳。此外,在这类应用的共享控制策略中,用户命令和机器人自主命令通常会切换。根据之前的用户研究,发现这一特性会降低用户的能动感以及导致用户产生挫败感。在本研究中,我们首先通过结合脑机接口(BMI)和注视跟踪接口,提出了一种直观且易于学习和使用的混合HRI。对于所提出的混合注视-BMI,通过运动意图对运动速度进行连续调制,与利用注视信号进行无约束运动方向控制无缝且同时地发生。然后,我们提出一种共享控制范式,该范式始终通过动态组合调节将用户输入和自主性结合起来。所提出的混合注视-BMI和共享控制范式在健康受试者执行的机器人手臂伸展任务中得到了验证。所有用户都能够使用混合注视-BMI,将末端执行器依次移动以在水平面上到达目标,同时还能避免与障碍物碰撞。共享控制范式在为任务中最困难的部分提供协助的同时,尽可能保持了大量的意志控制。所呈现的半自主机器人系统为末端执行器接近目标产生了连续、平滑且无碰撞的运动轨迹。与没有机器人自主协助的系统相比,它显著降低了失败率以及用户完成任务所花费的时间和精力。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/cf2f/6992643/1888ef91187b/fnbot-13-00111-g013.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/cf2f/6992643/883ebeacf40e/fnbot-13-00111-g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/cf2f/6992643/e518de78173f/fnbot-13-00111-g002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/cf2f/6992643/b00da61db6e6/fnbot-13-00111-g003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/cf2f/6992643/1f4fdad40e99/fnbot-13-00111-g004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/cf2f/6992643/bcfd7ba23557/fnbot-13-00111-g005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/cf2f/6992643/fe0378d946cb/fnbot-13-00111-g006.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/cf2f/6992643/c491cfd540b0/fnbot-13-00111-g007.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/cf2f/6992643/ef01e88e799e/fnbot-13-00111-g008.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/cf2f/6992643/afa41c23f6e8/fnbot-13-00111-g009.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/cf2f/6992643/70ef34a3d55c/fnbot-13-00111-g010.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/cf2f/6992643/fa61fa9fb4d5/fnbot-13-00111-g011.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/cf2f/6992643/36aca9e4d77b/fnbot-13-00111-g012.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/cf2f/6992643/1888ef91187b/fnbot-13-00111-g013.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/cf2f/6992643/883ebeacf40e/fnbot-13-00111-g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/cf2f/6992643/e518de78173f/fnbot-13-00111-g002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/cf2f/6992643/b00da61db6e6/fnbot-13-00111-g003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/cf2f/6992643/1f4fdad40e99/fnbot-13-00111-g004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/cf2f/6992643/bcfd7ba23557/fnbot-13-00111-g005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/cf2f/6992643/fe0378d946cb/fnbot-13-00111-g006.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/cf2f/6992643/c491cfd540b0/fnbot-13-00111-g007.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/cf2f/6992643/ef01e88e799e/fnbot-13-00111-g008.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/cf2f/6992643/afa41c23f6e8/fnbot-13-00111-g009.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/cf2f/6992643/70ef34a3d55c/fnbot-13-00111-g010.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/cf2f/6992643/fa61fa9fb4d5/fnbot-13-00111-g011.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/cf2f/6992643/36aca9e4d77b/fnbot-13-00111-g012.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/cf2f/6992643/1888ef91187b/fnbot-13-00111-g013.jpg

相似文献

1
Semi-Autonomous Robotic Arm Reaching With Hybrid Gaze-Brain Machine Interface.基于混合注视-脑机接口的半自主机器人手臂伸展
Front Neurorobot. 2020 Jan 24;13:111. doi: 10.3389/fnbot.2019.00111. eCollection 2019.
2
Closed-Loop Hybrid Gaze Brain-Machine Interface Based Robotic Arm Control with Augmented Reality Feedback.基于闭环混合注视脑机接口并带有增强现实反馈的机器人手臂控制
Front Neurorobot. 2017 Oct 31;11:60. doi: 10.3389/fnbot.2017.00060. eCollection 2017.
3
Blending of brain-machine interface and vision-guided autonomous robotics improves neuroprosthetic arm performance during grasping.脑机接口与视觉引导自主机器人技术的融合可提高抓握过程中神经假肢手臂的性能。
J Neuroeng Rehabil. 2016 Mar 18;13:28. doi: 10.1186/s12984-016-0134-9.
4
A brain-actuated robotic arm system using non-invasive hybrid brain-computer interface and shared control strategy.使用非侵入式混合脑机接口和共享控制策略的脑控机械臂系统。
J Neural Eng. 2021 May 5;18(4). doi: 10.1088/1741-2552/abf8cb.
5
Assistive Robotic Manipulation through Shared Autonomy and a Body-Machine Interface.通过共享自主性和人机接口实现的辅助机器人操作
IEEE Int Conf Rehabil Robot. 2015 Aug;2015:526-531. doi: 10.1109/ICORR.2015.7281253.
6
Performance evaluation of 3D vision-based semi-autonomous control method for assistive robotic manipulator.基于3D视觉的辅助机器人操纵器半自动控制方法的性能评估
Disabil Rehabil Assist Technol. 2018 Feb;13(2):140-145. doi: 10.1080/17483107.2017.1299804. Epub 2017 Mar 22.
7
Shared Control of Bimanual Robotic Limbs With a Brain-Machine Interface for Self-Feeding.通过脑机接口实现双手机器人肢体的共享控制以进行自主进食
Front Neurorobot. 2022 Jun 28;16:918001. doi: 10.3389/fnbot.2022.918001. eCollection 2022.
8
Soft brain-machine interfaces for assistive robotics: A novel control approach.用于辅助机器人技术的柔性脑机接口:一种新型控制方法。
IEEE Int Conf Rehabil Robot. 2017 Jul;2017:863-869. doi: 10.1109/ICORR.2017.8009357.
9
Shared Three-Dimensional Robotic Arm Control Based on Asynchronous BCI and Computer Vision.基于异步脑机接口和计算机视觉的共享三维机械臂控制。
IEEE Trans Neural Syst Rehabil Eng. 2023;31:3163-3175. doi: 10.1109/TNSRE.2023.3299350. Epub 2023 Aug 7.
10
Robot Learning of Assistive Manipulation Tasks by Demonstration via Head Gesture-based Interface.通过基于头部手势的界面进行演示实现机器人对辅助操作任务的学习。
IEEE Int Conf Rehabil Robot. 2019 Jun;2019:1139-1146. doi: 10.1109/ICORR.2019.8779379.

引用本文的文献

1
A robotic arm control system with simultaneous and sequential modes combining eye-tracking with steady-state visual evoked potential in virtual reality environment.一种在虚拟现实环境中结合眼动追踪与稳态视觉诱发电位的具有同步和顺序模式的机器人手臂控制系统。
Front Neurorobot. 2023 Mar 27;17:1146415. doi: 10.3389/fnbot.2023.1146415. eCollection 2023.
2
Face-Computer Interface (FCI): Intent Recognition Based on Facial Electromyography (fEMG) and Online Human-Computer Interface With Audiovisual Feedback.面部-计算机接口(FCI):基于面部肌电图(fEMG)的意图识别以及带有视听反馈的在线人机接口
Front Neurorobot. 2021 Jul 16;15:692562. doi: 10.3389/fnbot.2021.692562. eCollection 2021.
3

本文引用的文献

1
BMI control of a third arm for multitasking.用于多任务处理的第三条手臂的 BMI 控制。
Sci Robot. 2018 Jul 25;3(20). doi: 10.1126/scirobotics.aat1228.
2
Quadcopter Flight Control Using a Non-invasive Multi-Modal Brain Computer Interface.使用非侵入式多模态脑机接口的四旋翼飞行控制
Front Neurorobot. 2019 May 31;13:23. doi: 10.3389/fnbot.2019.00023. eCollection 2019.
3
Combination of high-frequency SSVEP-based BCI and computer vision for controlling a robotic arm.基于高频 SSVEP 的脑机接口与计算机视觉相结合,以控制机械臂。
Gaze-Based Intention Estimation for Shared Autonomy in Pick-and-Place Tasks.
用于抓取和放置任务中共享自主性的基于注视的意图估计
Front Neurorobot. 2021 Apr 16;15:647930. doi: 10.3389/fnbot.2021.647930. eCollection 2021.
4
Toward Shared Autonomy Control Schemes for Human-Robot Systems: Action Primitive Recognition Using Eye Gaze Features.迈向人机系统的共享自主控制方案:利用目光特征进行动作原语识别
Front Neurorobot. 2020 Oct 15;14:567571. doi: 10.3389/fnbot.2020.567571. eCollection 2020.
J Neural Eng. 2019 Apr;16(2):026012. doi: 10.1088/1741-2552/aaf594. Epub 2018 Dec 3.
4
Decoding Imagined 3D Hand Movement Trajectories From EEG: Evidence to Support the Use of Mu, Beta, and Low Gamma Oscillations.从脑电图中解码想象的三维手部运动轨迹:支持使用μ、β和低伽马振荡的证据
Front Neurosci. 2018 Mar 20;12:130. doi: 10.3389/fnins.2018.00130. eCollection 2018.
5
Robust feedback linearization for nonlinear processes control.鲁棒反馈线性化在非线性过程控制中的应用。
ISA Trans. 2018 Mar;74:155-164. doi: 10.1016/j.isatra.2018.01.017. Epub 2018 Feb 3.
6
Closed-Loop Hybrid Gaze Brain-Machine Interface Based Robotic Arm Control with Augmented Reality Feedback.基于闭环混合注视脑机接口并带有增强现实反馈的机器人手臂控制
Front Neurorobot. 2017 Oct 31;11:60. doi: 10.3389/fnbot.2017.00060. eCollection 2017.
7
A binary motor imagery tasks based brain-computer interface for two-dimensional movement control.基于二进制运动想象任务的脑-机接口用于二维运动控制。
J Neural Eng. 2017 Dec;14(6):066009. doi: 10.1088/1741-2552/aa7ee9.
8
An Intention-Driven Semi-autonomous Intelligent Robotic System for Drinking.一种用于饮水的意图驱动半自主智能机器人系统。
Front Neurorobot. 2017 Sep 8;11:48. doi: 10.3389/fnbot.2017.00048. eCollection 2017.
9
Soft brain-machine interfaces for assistive robotics: A novel control approach.用于辅助机器人技术的柔性脑机接口:一种新型控制方法。
IEEE Int Conf Rehabil Robot. 2017 Jul;2017:863-869. doi: 10.1109/ICORR.2017.8009357.
10
Hybrid Brain-Computer Interface Techniques for Improved Classification Accuracy and Increased Number of Commands: A Review.用于提高分类准确率和增加命令数量的混合脑机接口技术:综述
Front Neurorobot. 2017 Jul 24;11:35. doi: 10.3389/fnbot.2017.00035. eCollection 2017.