Institute of Robotics and Mechatronics, German Aerospace Center (DLR), Münchener Str. 20, 82234 Wessling, Germany.
Technical University of Munich (TUM), 80333 München, Germany.
Sci Robot. 2024 Aug 21;9(93):eadn4008. doi: 10.1126/scirobotics.adn4008.
The sense of touch is a property that allows humans to interact delicately with their physical environment. This article reports on a technological advancement in intuitive human-robot interaction that enables an intrinsic robotic sense of touch without the use of artificial skin or tactile instrumentation. On the basis of high-resolution joint-force-torque sensing in a redundant arrangement, we were able to let the robot sensitively feel the surrounding environment and accurately localize touch trajectories in space and time that were applied on its surface by a human. Through an intertwined combination of manifold learning techniques and artificial neural networks, the robot identified and interpreted those touch trajectories as machine-readable letters, symbols, or numbers. This opens up unexplored opportunities in terms of intuitive and flexible interaction between human and robot. Furthermore, we showed that our concept of so-called virtual buttons can be used to straightforwardly implement a tactile communication link, including switches and slider bars, which are complementary to speech, hardware buttons, and control panels. These interaction elements could be freely placed, moved, and configured in arbitrary locations on the robot structure. The intrinsic sense of touch we proposed in this work can serve as the basis for an advanced category of physical human-robot interaction that has not been possible yet, enabling a shift from conventional modalities toward adaptability, flexibility, and intuitive handling.
触觉是一种使人类能够与物理环境进行精细交互的特性。本文报道了一项在直观的人机交互技术方面的进展,它实现了内在的机器人触觉,而无需使用人工皮肤或触觉仪器。基于冗余布置中的高分辨率关节力-扭矩感测,我们能够使机器人灵敏地感知周围环境,并准确地定位在其表面上由人类施加的触摸轨迹的空间和时间位置。通过流形学习技术和人工神经网络的交织组合,机器人将这些触摸轨迹识别并解释为机器可读的字母、符号或数字。这为人类和机器人之间直观和灵活的交互开辟了尚未探索的机会。此外,我们还表明,我们所谓的虚拟按钮的概念可用于直接实现触觉通信链路,包括开关和滑动条,它们是对语音、硬件按钮和控制面板的补充。这些交互元素可以在机器人结构上的任意位置自由放置、移动和配置。我们在这项工作中提出的内在触觉可以作为尚未实现的高级物理人机交互类别的基础,从而使人们从传统模式转向适应性、灵活性和直观操作。