Centre for Robotics & Intelligent Systems, University of Limerick, Limerick V94 T9PX, Ireland.
School of Computing, Engineering, and Physical Sciences, University of the West of Scotland, Glasgow G72 0AG, UK.
Sensors (Basel). 2018 Nov 14;18(11):3936. doi: 10.3390/s18113936.
Many current and future applications of underwater robotics require real-time sensing and interpretation of the environment. As the vast majority of robots are equipped with cameras, computer vision is playing an increasingly important role it this field. This paper presents the implementation and experimental results of underwater StereoFusion, an algorithm for real-time 3D dense reconstruction and camera tracking. Unlike KinectFusion on which it is based, StereoFusion relies on a stereo camera as its main sensor. The algorithm uses the depth map obtained from the stereo camera to incrementally build a volumetric 3D model of the environment, while simultaneously using the model for camera tracking. It has been successfully tested both in a lake and in the ocean, using two different state-of-the-art underwater Remotely Operated Vehicles (ROVs). Ongoing work focuses on applying the same algorithm to acoustic sensors, and on the implementation of a vision based monocular system with the same capabilities.
许多当前和未来的水下机器人应用都需要实时感知和解释环境。由于绝大多数机器人都配备了摄像头,因此计算机视觉在这个领域中的作用越来越重要。本文介绍了水下 StereoFusion 的实现和实验结果,这是一种用于实时 3D 密集重建和相机跟踪的算法。与它所基于的 KinectFusion 不同,StereoFusion 依赖于立体相机作为其主要传感器。该算法使用从立体相机获得的深度图来增量式地构建环境的体积 3D 模型,同时使用模型进行相机跟踪。它已经成功地在湖泊和海洋中进行了测试,使用了两种不同的最先进的水下遥控潜水器(ROV)。目前的工作重点是将相同的算法应用于声纳传感器,并实现具有相同功能的基于视觉的单目系统。