• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

基于图像块相似性差异的闭环检测方法

Loop Closure Detection Method Based on Similarity Differences between Image Blocks.

作者信息

Huang Yizhe, Huang Bin, Zhang Zhifu, Shi Yuanyuan, Yuan Yizhao, Sun Jinfeng

机构信息

Hubei Key Laboratory of Modern Manufacturing Quality Engineering, School of Mechanical Engineering, Hubei University of Technology, Wuhan 430068, China.

State Key Laboratory of Digital Manufacturing Equipment and Technology, Huazhong University of Science and Technology, Wuhan 430074, China.

出版信息

Sensors (Basel). 2023 Oct 22;23(20):8632. doi: 10.3390/s23208632.

DOI:10.3390/s23208632
PMID:37896726
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC10610740/
Abstract

Variations with respect to perspective, lighting, weather, and interference from dynamic objects may all have an impact on the accuracy of the entire system during autonomous positioning and during the navigation of mobile visual simultaneous localization and mapping (SLAM) robots. As it is an essential element of visual SLAM systems, loop closure detection plays a vital role in eradicating front-end-induced accumulated errors and guaranteeing the map's general consistency. Presently, deep-learning-based loop closure detection techniques place more emphasis on enhancing the robustness of image descriptors while neglecting similarity calculations or the connections within the internal regions of the image. In response to this issue, this article proposes a loop closure detection method based on similarity differences between image blocks. Firstly, image descriptors are extracted using a lightweight convolutional neural network (CNN) model with effective loop closure detection. Subsequently, the image pairs with the greatest degree of similarity are evenly divided into blocks, and the level of similarity among the blocks is used to recalculate the degree of the overall similarity of the image pairs. The block similarity calculation module can effectively reduce the similarity of incorrect loop closure image pairs, which makes it easier to identify the correct loopback. Finally, the approach proposed in this article is compared with loop closure detection methods based on four distinct CNN models with a recall rate of 100% accuracy; said approach performs significantly superiorly. The application of the block similarity calculation module proposed in this article to the aforementioned four CNN models can increase the recall rate's accuracy to 100%; this proves that the proposed method can successfully improve the loop closure detection effect, and the similarity calculation module in the algorithm has a certain degree of universality.

摘要

视角、光照、天气的变化以及动态物体的干扰,在移动视觉同步定位与建图(SLAM)机器人自主定位和导航过程中,都可能对整个系统的精度产生影响。作为视觉SLAM系统的关键要素,回环检测在消除前端累积误差和保证地图整体一致性方面发挥着至关重要的作用。目前,基于深度学习的回环检测技术更侧重于增强图像描述符的鲁棒性,而忽视了相似性计算或图像内部区域之间的联系。针对这一问题,本文提出了一种基于图像块相似性差异的回环检测方法。首先,使用具有有效回环检测功能的轻量级卷积神经网络(CNN)模型提取图像描述符。随后,将相似度最高的图像对均匀划分为图像块,并利用图像块之间的相似度重新计算图像对的整体相似度。块相似度计算模块能够有效降低错误回环闭合图像对的相似度,从而更易于识别正确的回环。最后,将本文提出的方法与基于四种不同CNN模型的回环检测方法进行比较,召回率准确率达100%;该方法表现显著更优。将本文提出的块相似度计算模块应用于上述四种CNN模型,可将召回率准确率提高到100%;这证明了所提方法能够成功提高回环检测效果,且算法中的相似度计算模块具有一定的通用性。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/6ea9/10610740/e0574d38d160/sensors-23-08632-g011.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/6ea9/10610740/b7929bed65d6/sensors-23-08632-g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/6ea9/10610740/4212630ce316/sensors-23-08632-g002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/6ea9/10610740/a24018d9fd9b/sensors-23-08632-g003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/6ea9/10610740/164e2a002cdf/sensors-23-08632-g004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/6ea9/10610740/7f68c8fa3c3e/sensors-23-08632-g005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/6ea9/10610740/186e1011e914/sensors-23-08632-g006.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/6ea9/10610740/7d9e5b1f1779/sensors-23-08632-g007.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/6ea9/10610740/31a81afae353/sensors-23-08632-g008.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/6ea9/10610740/ab497cd50277/sensors-23-08632-g009.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/6ea9/10610740/8998bdffbe75/sensors-23-08632-g010.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/6ea9/10610740/e0574d38d160/sensors-23-08632-g011.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/6ea9/10610740/b7929bed65d6/sensors-23-08632-g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/6ea9/10610740/4212630ce316/sensors-23-08632-g002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/6ea9/10610740/a24018d9fd9b/sensors-23-08632-g003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/6ea9/10610740/164e2a002cdf/sensors-23-08632-g004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/6ea9/10610740/7f68c8fa3c3e/sensors-23-08632-g005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/6ea9/10610740/186e1011e914/sensors-23-08632-g006.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/6ea9/10610740/7d9e5b1f1779/sensors-23-08632-g007.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/6ea9/10610740/31a81afae353/sensors-23-08632-g008.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/6ea9/10610740/ab497cd50277/sensors-23-08632-g009.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/6ea9/10610740/8998bdffbe75/sensors-23-08632-g010.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/6ea9/10610740/e0574d38d160/sensors-23-08632-g011.jpg

相似文献

1
Loop Closure Detection Method Based on Similarity Differences between Image Blocks.基于图像块相似性差异的闭环检测方法
Sensors (Basel). 2023 Oct 22;23(20):8632. doi: 10.3390/s23208632.
2
Loop Closure Detection Based on Residual Network and Capsule Network for Mobile Robot.基于残差网络和胶囊网络的移动机器人闭环检测。
Sensors (Basel). 2022 Sep 21;22(19):7137. doi: 10.3390/s22197137.
3
A Semantic Topology Graph to Detect Re-Localization and Loop Closure of the Visual Simultaneous Localization and Mapping System in a Dynamic Environment.一种用于在动态环境中检测视觉同步定位与地图构建系统的重新定位和回环闭合的语义拓扑图。
Sensors (Basel). 2023 Oct 13;23(20):8445. doi: 10.3390/s23208445.
4
Loop closure detection of visual SLAM based on variational autoencoder.基于变分自编码器的视觉同步定位与地图构建中的回环检测
Front Neurorobot. 2024 Jan 19;17:1301785. doi: 10.3389/fnbot.2023.1301785. eCollection 2023.
5
Role of Deep Learning in Loop Closure Detection for Visual and Lidar SLAM: A Survey.深度学习在视觉和激光雷达 SLAM 中的闭环检测中的作用:综述。
Sensors (Basel). 2021 Feb 10;21(4):1243. doi: 10.3390/s21041243.
6
LFM: A Lightweight LCD Algorithm Based on Feature Matching between Similar Key Frames.LFM:一种基于相似关键帧之间特征匹配的轻量级 LCD 算法。
Sensors (Basel). 2021 Jun 30;21(13):4499. doi: 10.3390/s21134499.
7
TS-LCD: Two-Stage Loop-Closure Detection Based on Heterogeneous Data Fusion.TS-LCD:基于异构数据融合的两阶段闭环检测
Sensors (Basel). 2024 Jun 7;24(12):3702. doi: 10.3390/s24123702.
8
2D LiDAR SLAM Back-End Optimization with Control Network Constraint for Mobile Mapping.二维激光雷达 SLAM 后端优化与移动测绘的控制网络约束
Sensors (Basel). 2018 Oct 29;18(11):3668. doi: 10.3390/s18113668.
9
Matching-range-constrained real-time loop closure detection with CNNs features.基于卷积神经网络特征的匹配范围受限实时回环检测
Robotics Biomim. 2016;3(1):15. doi: 10.1186/s40638-016-0047-x. Epub 2016 Sep 19.
10
LFVB-BioSLAM: A Bionic SLAM System with a Light-Weight LiDAR Front End and a Bio-Inspired Visual Back End.LFVB-BioSLAM:一种具有轻量级激光雷达前端和生物启发式视觉后端的仿生同步定位与地图构建系统。
Biomimetics (Basel). 2023 Sep 5;8(5):410. doi: 10.3390/biomimetics8050410.

本文引用的文献

1
An Instance Segmentation Model Based on Deep Learning for Intelligent Diagnosis of Uterine Myomas in MRI.基于深度学习的子宫肌瘤MRI智能诊断实例分割模型
Diagnostics (Basel). 2023 Apr 24;13(9):1525. doi: 10.3390/diagnostics13091525.
2
Deep Learning and Entropy-Based Texture Features for Color Image Classification.用于彩色图像分类的深度学习和基于熵的纹理特征
Entropy (Basel). 2022 Oct 31;24(11):1577. doi: 10.3390/e24111577.
3
Loop Closure Detection Based on Residual Network and Capsule Network for Mobile Robot.基于残差网络和胶囊网络的移动机器人闭环检测。
Sensors (Basel). 2022 Sep 21;22(19):7137. doi: 10.3390/s22197137.
4
Loop Closure Detection by Using Global and Local Features With Photometric and Viewpoint Invariance.基于具有光度和视角不变性的全局与局部特征的闭环检测
IEEE Trans Image Process. 2021;30:8873-8885. doi: 10.1109/TIP.2021.3116898. Epub 2021 Oct 28.
5
NetVLAD: CNN Architecture for Weakly Supervised Place Recognition.NetVLAD:用于弱监督场景识别的卷积神经网络架构。
IEEE Trans Pattern Anal Mach Intell. 2018 Jun;40(6):1437-1451. doi: 10.1109/TPAMI.2017.2711011. Epub 2017 Jun 1.
6
Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition.空间金字塔池化在深度卷积网络中的视觉识别。
IEEE Trans Pattern Anal Mach Intell. 2015 Sep;37(9):1904-16. doi: 10.1109/TPAMI.2015.2389824.
7
Aggregating local image descriptors into compact codes.将局部图像描述符聚合到紧凑代码中。
IEEE Trans Pattern Anal Mach Intell. 2012 Sep;34(9):1704-16. doi: 10.1109/TPAMI.2011.235.