Guangdong Provincial Key Lab of Robotics and Intelligent System, Shenzhen Institute of Advanced Technology (SIAT), Chinese Academy of Sciences (CAS), Shenzhen 518055, China.
Shandong Institute of Advanced Technology, CAS, Jinan 250102, China.
Sensors (Basel). 2023 May 18;23(10):4862. doi: 10.3390/s23104862.
This paper focuses on moving-target detection and tracking in a three-dimensional (3D) space, and proposes a visual target tracking system only using a two-dimensional (2D) camera. To quickly detect moving targets, an improved optical flow method with detailed modifications in the pyramid, warping, and cost volume network (PWC-Net) is applied. Meanwhile, a clustering algorithm is used to accurately extract the moving target from a noisy background. Then, the target position is estimated using a proposed geometrical pinhole imaging algorithm and cubature Kalman filter (CKF). Specifically, the camera's installation position and inner parameters are applied to calculate the azimuth, elevation angles, and depth of the target while only using 2D measurements. The proposed geometrical solution has a simple structure and fast computational speed. Different simulations and experiments verify the effectiveness of the proposed method.
本文专注于三维空间中的动目标检测和跟踪,并提出了一种仅使用二维(2D)相机的视觉目标跟踪系统。为了快速检测运动目标,应用了一种改进的光流方法,在金字塔、变形和代价体网络(PWC-Net)中进行了详细的修改。同时,使用聚类算法从嘈杂的背景中准确提取运动目标。然后,使用提出的几何针孔成像算法和容积卡尔曼滤波器(CKF)来估计目标位置。具体来说,应用摄像机的安装位置和内部参数来计算目标的方位角、仰角和深度,而仅使用二维测量。所提出的几何解决方案具有结构简单和计算速度快的特点。不同的模拟和实验验证了所提出方法的有效性。