Machine Perception Research Laboratory (MPLab), Institute for Computer Science and Control (SZTAKI), Eötvös Loránd Research Network (ELKH), Kende u. 13-17, 1111 Budapest, Hungary.
Sensors (Basel). 2022 Aug 23;22(17):6342. doi: 10.3390/s22176342.
This paper presents a real-time object-based 3D change detection method that is built around the concept of semantic object maps. The algorithm is able to maintain an object-oriented metric-semantic map of the environment and can detect object-level changes between consecutive patrol routes. The proposed 3D change detection method exploits the capabilities of the novel ZED 2 stereo camera, which integrates stereo vision and artificial intelligence (AI) to enable the development of spatial AI applications. To design the change detection algorithm and set its parameters, an extensive evaluation of the ZED 2 camera was carried out with respect to depth accuracy and consistency, visual tracking and relocalization accuracy and object detection performance. The outcomes of these findings are reported in the paper. Moreover, the utility of the proposed object-based 3D change detection is shown in real-world indoor and outdoor experiments.
本文提出了一种基于实时对象的 3D 变化检测方法,该方法基于语义对象图的概念。该算法能够维护环境的面向对象的度量语义图,并能够检测连续巡逻路线之间的对象级变化。所提出的 3D 变化检测方法利用新型 ZED 2 立体相机的功能,该相机集成了立体视觉和人工智能 (AI),从而能够开发空间 AI 应用。为了设计变化检测算法并设置其参数,对 ZED 2 相机的深度精度和一致性、视觉跟踪和重新定位精度以及对象检测性能进行了广泛评估。本文报告了这些研究结果。此外,还展示了所提出的基于对象的 3D 变化检测在真实室内和室外实验中的实用性。