Welte Edgar, Rayyes Rania
AI and Robotics (AIR), Institute of Material Handling and Logistics (IFL), Karlsruhe Institute of Technology (KIT), Karlsruhe, Germany.
Front Robot AI. 2025 Dec 19;12:1682437. doi: 10.3389/frobt.2025.1682437. eCollection 2025.
Dexterous manipulation is a crucial yet highly complex challenge in humanoid robotics, demanding precise, adaptable, and sample-efficient learning methods. As humanoid robots are usually designed to operate in human-centric environments and interact with everyday objects, mastering dexterous manipulation is critical for real-world deployment. Traditional approaches, such as reinforcement learning and imitation learning, have made significant strides, but they often struggle due to the unique challenges of real-world dexterous manipulation, including high-dimensional control, limited training data, and covariate shift. This survey provides a comprehensive overview of these challenges and reviews existing learning-based methods for real-world dexterous manipulation, spanning imitation learning, reinforcement learning, and hybrid approaches. A promising yet underexplored direction is interactive imitation learning, where human feedback actively refines a robot's behavior during training. While interactive imitation learning has shown success in various robotic tasks, its application to dexterous manipulation remains limited. To address this gap, we examine current interactive imitation learning techniques applied to other robotic tasks and discuss how these methods can be adapted to enhance dexterous manipulation. By synthesizing state-of-the-art research, this paper highlights key challenges, identifies gaps in current methodologies, and outlines potential directions for leveraging interactive imitation learning to improve dexterous robotic skills.
灵巧操作是类人机器人领域中一项至关重要但极具挑战性的任务,它需要精确、适应性强且样本高效的学习方法。由于类人机器人通常设计为在以人类为中心的环境中运行并与日常物体进行交互,因此掌握灵巧操作对于其在现实世界中的部署至关重要。传统方法,如强化学习和模仿学习,已经取得了显著进展,但由于现实世界中灵巧操作面临的独特挑战,包括高维控制、有限的训练数据和协变量偏移,它们往往难以应对。本综述全面概述了这些挑战,并回顾了现有的基于学习的现实世界灵巧操作方法,涵盖模仿学习、强化学习和混合方法。一个有前景但尚未充分探索的方向是交互式模仿学习,即在训练过程中,人类反馈能够积极优化机器人的行为。虽然交互式模仿学习在各种机器人任务中已取得成功,但其在灵巧操作中的应用仍然有限。为了弥补这一差距,我们研究了当前应用于其他机器人任务的交互式模仿学习技术,并讨论了如何调整这些方法以增强灵巧操作能力。通过综合最先进的研究成果,本文突出了关键挑战,识别了当前方法中的差距,并概述了利用交互式模仿学习来提高机器人灵巧技能的潜在方向。