Neuro-Information Technology, Otto-von-Guericke-University Magdeburg, 39106 Magdeburg, Germany.
Sensors (Basel). 2022 Jan 25;22(3):923. doi: 10.3390/s22030923.
This paper presents an implementation of RoSA, a Robot System Assistant, for safe and intuitive human-machine interaction. The interaction modalities were chosen and previously reviewed using a Wizard of Oz study emphasizing a strong propensity for speech and pointing gestures. Based on these findings, we design and implement a new multi-modal system for contactless human-machine interaction based on speech, facial, and gesture recognition. We evaluate our proposed system in an extensive study with multiple subjects to examine the user experience and interaction efficiency. It reports that our method achieves similar usability scores compared to the entirely human remote-controlled robot interaction in our Wizard of Oz study. Furthermore, our framework's implementation is based on the Robot Operating System (ROS), allowing modularity and extendability for our multi-device and multi-user method.
本文提出了一种机器人系统助手 RoSA 的实现，用于安全和直观的人机交互。交互方式是使用强调强烈倾向于语音和指点手势的“巫师”研究选择和预先审查的。基于这些发现，我们设计并实现了一种新的基于语音、面部和手势识别的非接触式人机交互多模态系统。我们在一项广泛的研究中对我们提出的系统进行了评估，以研究用户体验和交互效率。研究报告表明，与我们在“巫师”研究中完全由人远程控制的机器人交互相比，我们的方法具有相似的可用性得分。此外，我们的框架实现基于机器人操作系统 (ROS)，允许我们的多设备和多用户方法具有模块化和可扩展性。
