Computer Vision and Robotics Research Institute (VICOROB), University of Girona, 17003 Girona, Spain.
Sensors (Basel). 2022 Jul 18;22(14):5354. doi: 10.3390/s22145354.
Exploration of marine habitats is one of the key pillars of underwater science, which often involves collecting images at close range. As acquiring imagery close to the seabed involves multiple hazards, the safety of underwater vehicles, such as remotely operated vehicles (ROVs) and autonomous underwater vehicles (AUVs), is often compromised. Common applications for obstacle avoidance in underwater environments are often conducted with acoustic sensors, which cannot be used reliably at very short distances, thus requiring a high level of attention from the operator to avoid damaging the robot. Therefore, developing capabilities such as advanced assisted mapping, spatial awareness and safety, and user immersion in confined environments is an important research area for human-operated underwater robotics. In this paper, we present a novel approach that provides an ROV with capabilities for navigation in complex environments. By leveraging the ability of omnidirectional multi-camera systems to provide a comprehensive view of the environment, we create a 360° real-time point cloud of nearby objects or structures within a visual SLAM framework. We also develop a strategy to assess the risk of obstacles in the vicinity. We show that the system can use the risk information to generate warnings that the robot can use to perform evasive maneuvers when approaching dangerous obstacles in real-world scenarios. This system is a first step towards a comprehensive pilot assistance system that will enable inexperienced pilots to operate vehicles in complex and cluttered environments.
探索海洋栖息地是水下科学的关键支柱之一,通常涉及近距离采集图像。由于在靠近海底的地方获取图像涉及多种危险,因此水下车辆(如遥控潜水器 (ROV) 和自主水下车辆 (AUV))的安全性往往受到影响。水下环境中常用的障碍物回避应用通常使用声纳传感器,但在非常短的距离内无法可靠使用,因此需要操作人员高度注意,以避免损坏机器人。因此,开发高级辅助绘图、空间感知和安全以及用户在受限环境中的沉浸感等功能是有人操作水下机器人的一个重要研究领域。在本文中,我们提出了一种新方法,为 ROV 提供在复杂环境中导航的能力。通过利用全向多相机系统提供环境全景视图的能力,我们在视觉 SLAM 框架内创建了一个 360°实时附近物体或结构的点云。我们还开发了一种评估附近障碍物风险的策略。我们表明,该系统可以使用风险信息生成警告,机器人可以在接近现实场景中的危险障碍物时使用这些警告来执行规避动作。该系统是迈向全面飞行员辅助系统的第一步,该系统将使经验不足的飞行员能够在复杂和杂乱的环境中操作车辆。