Xie Ming, Lai Tingfeng, Fang Yuhui
School of Mechanical and Aerospace Engineering, Nanyang Technological University, Singapore 639798, Singapore.
Biomimetics (Basel). 2023 Jul 2;8(3):285. doi: 10.3390/biomimetics8030285.
Visual signals are the upmost important source for robots, vehicles or machines to achieve human-like intelligence. Human beings heavily depend on binocular vision to understand the dynamically changing world. Similarly, intelligent robots or machines must also have the innate capabilities of perceiving knowledge from visual signals. Until today, one of the biggest challenges faced by intelligent robots or machines is the matching in stereovision. In this paper, we present the details of a new principle toward achieving a robust matching solution which leverages on the use and integration of top-down image sampling strategy, hybrid feature extraction, and Restricted Coulomb Energy (RCE) neural network for incremental learning (i.e., cognition) as well as robust match-maker (i.e., recognition). A preliminary version of the proposed solution has been implemented and tested with data from Maritime RobotX Challenge. The contribution of this paper is to attract more research interest and effort toward this new direction which may eventually lead to the development of robust solutions expected by future stereovision systems in intelligent robots, vehicles, and machines.
视觉信号是机器人、车辆或机器实现类人智能的最重要来源。人类严重依赖双目视觉来理解动态变化的世界。同样,智能机器人或机器也必须具备从视觉信号中感知知识的内在能力。直到今天,智能机器人或机器面临的最大挑战之一是立体视觉中的匹配。在本文中,我们详细介绍了一种实现鲁棒匹配解决方案的新原理,该原理利用自上而下的图像采样策略、混合特征提取以及受限库仑能量(RCE)神经网络进行增量学习(即认知)以及鲁棒匹配器(即识别)。所提出解决方案的初步版本已经实现,并使用来自海事机器人X挑战赛的数据进行了测试。本文的贡献在于吸引更多针对这一新方向的研究兴趣和努力,这最终可能会促成智能机器人、车辆和机器中未来立体视觉系统所期望的鲁棒解决方案的发展。