Zhao Jiannan, Xie Quansheng, Shuang Feng, Yue Shigang
Guangxi Key Laboratory of Intelligent Control and Maintenance of Power Equipment, School of Electrical Engineering, Guangxi University, Nanning 530004, China.
School of Computing and Mathematical Sciences, University of Leicester, Leicester LE1 7RH, UK.
Biomimetics (Basel). 2024 Jan 2;9(1):0. doi: 10.3390/biomimetics9010022.
Visual perception equips unmanned aerial vehicles (UAVs) with increasingly comprehensive and instant environmental perception, rendering it a crucial technology in intelligent UAV obstacle avoidance. However, the rapid movements of UAVs cause significant changes in the field of view, affecting the algorithms' ability to extract the visual features of collisions accurately. As a result, algorithms suffer from a high rate of false alarms and a delay in warning time. During the study of visual field angle curves of different orders, it was found that the peak times of the curves of higher-order information on the angular size of looming objects are linearly related to the time to collision (TTC) and occur before collisions. This discovery implies that encoding higher-order information on the angular size could resolve the issue of response lag. Furthermore, the fact that the image of a looming object adjusts to meet several looming visual cues compared to the background interference implies that integrating various field-of-view characteristics will likely enhance the model's resistance to motion interference. Therefore, this paper presents a concise A-LGMD model for detecting looming objects. The model is based on image angular acceleration and addresses problems related to imprecise feature extraction and insufficient time series modeling to enhance the model's ability to rapidly and precisely detect looming objects during the rapid self-motion of UAVs. The model draws inspiration from the lobula giant movement detector (LGMD), which shows high sensitivity to acceleration information. In the proposed model, higher-order information on the angular size is abstracted by the network and fused with multiple visual field angle characteristics to promote the selective response to looming objects. Experiments carried out on synthetic and real-world datasets reveal that the model can efficiently detect the angular acceleration of an image, filter out insignificant background motion, and provide early warnings. These findings indicate that the model could have significant potential in embedded collision detection systems of micro or small UAVs.
视觉感知为无人机配备了日益全面和即时的环境感知能力,使其成为智能无人机避障中的一项关键技术。然而,无人机的快速移动会导致视野发生显著变化,影响算法准确提取碰撞视觉特征的能力。结果,算法存在误报率高和预警时间延迟的问题。在研究不同阶数的视野角度曲线时发现,关于逼近物体角尺寸的高阶信息曲线的峰值时间与碰撞时间(TTC)呈线性相关,且在碰撞前出现。这一发现意味着对角尺寸进行高阶信息编码可以解决响应滞后的问题。此外,与背景干扰相比,逼近物体的图像会调整以满足多个逼近视觉线索,这一事实意味着整合各种视野特征可能会增强模型对运动干扰的抵抗力。因此,本文提出了一种用于检测逼近物体的简洁A-LGMD模型。该模型基于图像角加速度,解决了特征提取不精确和时间序列建模不足的问题,以增强模型在无人机快速自主运动期间快速准确检测逼近物体的能力。该模型的灵感来自小叶巨运动探测器(LGMD),它对加速度信息表现出高灵敏度。在所提出的模型中,角尺寸的高阶信息由网络抽象出来,并与多个视野角度特征融合,以促进对逼近物体的选择性响应。在合成数据集和真实世界数据集上进行的实验表明,该模型可以有效地检测图像的角加速度,滤除无关的背景运动,并提供早期预警。这些发现表明,该模型在微型或小型无人机的嵌入式碰撞检测系统中可能具有巨大潜力。