School of Mechanical and Aerospace Engineering, Nanyang Technological University, Singapore 639798, Singapore.
Rehabilitation Research Institute of Singapore (RRIS), Nanyang Technological University, Singapore 308232, Singapore.
Sensors (Basel). 2023 Mar 10;23(6):2998. doi: 10.3390/s23062998.
The lack of intuitive and active human-robot interaction makes it difficult to use upper-limb-assistive devices. In this paper, we propose a novel learning-based controller that intuitively uses onset motion to predict the desired end-point position for an assistive robot. A multi-modal sensing system comprising inertial measurement units (IMUs), electromyographic (EMG) sensors, and mechanomyography (MMG) sensors was implemented. This system was used to acquire kinematic and physiological signals during reaching and placing tasks performed by five healthy subjects. The onset motion data of each motion trial were extracted to input into traditional regression models and deep learning models for training and testing. The models can predict the position of the hand in planar space, which is the reference position for low-level position controllers. The results show that using IMU sensor with the proposed prediction model is sufficient for motion intention detection, which can provide almost the same prediction performance compared with adding EMG or MMG. Additionally, recurrent neural network (RNN)-based models can predict target positions over a short onset time window for reaching motions and are suitable for predicting targets over a longer horizon for placing tasks. This study's detailed analysis can improve the usability of the assistive/rehabilitation robots.
缺乏直观和主动的人机交互使得上肢辅助设备难以使用。在本文中,我们提出了一种新颖的基于学习的控制器,该控制器直观地使用起始运动来预测辅助机器人的期望末端位置。实现了一个由惯性测量单元 (IMU)、肌电图 (EMG) 传感器和肌动描记术 (MMG) 传感器组成的多模态感测系统。该系统用于在五个健康受试者执行的伸手和放置任务期间获取运动学和生理信号。提取每个运动试验的起始运动数据,将其输入到传统回归模型和深度学习模型中进行训练和测试。这些模型可以预测手在平面空间中的位置,这是低级位置控制器的参考位置。结果表明,使用带有提出的预测模型的 IMU 传感器对于运动意图检测是足够的,与添加 EMG 或 MMG 相比,它可以提供几乎相同的预测性能。此外,基于递归神经网络 (RNN) 的模型可以在较短的起始时间窗口内预测伸手运动的目标位置,并且适合预测放置任务中较长时间的目标位置。本研究的详细分析可以提高辅助/康复机器人的可用性。