• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

基于体素网络的三维测量传感器在线自标定

Online Self-Calibration of 3D Measurement Sensors Using a Voxel-Based Network.

机构信息

Department of Industrial Engineering, Chonnam National University, 77 Yongbong-ro, Buk-gu, Gwangju 61186, Korea.

出版信息

Sensors (Basel). 2022 Aug 26;22(17):6447. doi: 10.3390/s22176447.

DOI:10.3390/s22176447
PMID:36080905
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC9460808/
Abstract

Multi-sensor fusion is important in the field of autonomous driving. A basic prerequisite for multi-sensor fusion is calibration between sensors. Such calibrations must be accurate and need to be performed online. Traditional calibration methods have strict rules. In contrast, the latest online calibration methods based on convolutional neural networks (CNNs) have gone beyond the limits of the conventional methods. We propose a novel algorithm for online self-calibration between sensors using voxels and three-dimensional (3D) convolution kernels. The proposed approach has the following features: (1) it is intended for calibration between sensors that measure 3D space; (2) the proposed network is capable of end-to-end learning; (3) the input 3D point cloud is converted to voxel information; (4) it uses five networks that process voxel information, and it improves calibration accuracy through iterative refinement of the output of the five networks and temporal filtering. We use the KITTI and Oxford datasets to evaluate the calibration performance of the proposed method. The proposed method achieves a rotation error of less than 0.1° and a translation error of less than 1 cm on both the KITTI and Oxford datasets.

摘要

多传感器融合在自动驾驶领域非常重要。多传感器融合的一个基本前提是传感器之间的校准。这种校准必须准确,并需要在线进行。传统的校准方法有严格的规则。相比之下,基于卷积神经网络 (CNN) 的最新在线校准方法已经超越了传统方法的限制。我们提出了一种使用体素和三维 (3D) 卷积核进行传感器在线自校准的新算法。所提出的方法具有以下特点:(1) 它旨在校准测量 3D 空间的传感器;(2) 所提出的网络能够进行端到端学习;(3) 将输入的 3D 点云转换为体素信息;(4) 使用五个处理体素信息的网络,并通过迭代细化五个网络的输出和时间滤波来提高校准精度。我们使用 KITTI 和牛津数据集来评估所提出方法的校准性能。所提出的方法在 KITTI 和牛津数据集上的旋转误差小于 0.1°,平移误差小于 1cm。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/516b/9460808/d146f76a6a04/sensors-22-06447-g008a.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/516b/9460808/d2f14311cf7d/sensors-22-06447-g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/516b/9460808/7deeaba1a0b2/sensors-22-06447-g002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/516b/9460808/9178b7440d18/sensors-22-06447-g003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/516b/9460808/55d32af6c703/sensors-22-06447-g004a.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/516b/9460808/a2e3cb10ebd4/sensors-22-06447-g005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/516b/9460808/7a7d911f3760/sensors-22-06447-g006.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/516b/9460808/f064a7ba8f0b/sensors-22-06447-g007a.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/516b/9460808/d146f76a6a04/sensors-22-06447-g008a.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/516b/9460808/d2f14311cf7d/sensors-22-06447-g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/516b/9460808/7deeaba1a0b2/sensors-22-06447-g002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/516b/9460808/9178b7440d18/sensors-22-06447-g003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/516b/9460808/55d32af6c703/sensors-22-06447-g004a.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/516b/9460808/a2e3cb10ebd4/sensors-22-06447-g005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/516b/9460808/7a7d911f3760/sensors-22-06447-g006.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/516b/9460808/f064a7ba8f0b/sensors-22-06447-g007a.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/516b/9460808/d146f76a6a04/sensors-22-06447-g008a.jpg

相似文献

1
Online Self-Calibration of 3D Measurement Sensors Using a Voxel-Based Network.基于体素网络的三维测量传感器在线自标定
Sensors (Basel). 2022 Aug 26;22(17):6447. doi: 10.3390/s22176447.
2
One-Stage Multi-Sensor Data Fusion Convolutional Neural Network for 3D Object Detection.基于单阶段多传感器数据融合卷积神经网络的三维目标检测
Sensors (Basel). 2019 Mar 23;19(6):1434. doi: 10.3390/s19061434.
3
CFNet: LiDAR-Camera Registration Using Calibration Flow Network.CFNet:基于标定流网络的激光雷达-相机标定
Sensors (Basel). 2021 Dec 4;21(23):8112. doi: 10.3390/s21238112.
4
PVNAS: 3D Neural Architecture Search With Point-Voxel Convolution.《PNAS》:基于点-体素卷积的 3D 神经结构搜索。
IEEE Trans Pattern Anal Mach Intell. 2022 Nov;44(11):8552-8568. doi: 10.1109/TPAMI.2021.3109025. Epub 2022 Oct 4.
5
A LiDAR-Camera Joint Calibration Algorithm Based on Deep Learning.一种基于深度学习的激光雷达-相机联合校准算法
Sensors (Basel). 2024 Sep 18;24(18):6033. doi: 10.3390/s24186033.
6
GC-MLP: Graph Convolution MLP for Point Cloud Analysis.GC-MLP:用于点云分析的图卷积 MLP。
Sensors (Basel). 2022 Dec 5;22(23):9488. doi: 10.3390/s22239488.
7
Optimizing 3D Convolution Kernels on Stereo Matching for Resource Efficient Computations.优化立体匹配中的 3D 卷积核以实现资源高效计算。
Sensors (Basel). 2021 Oct 13;21(20):6808. doi: 10.3390/s21206808.
8
OBELISK-Net: Fewer layers to solve 3D multi-organ segmentation with sparse deformable convolutions.OBELISK-Net:稀疏可变形卷积解决三维多器官分割问题,所需层数更少。
Med Image Anal. 2019 May;54:1-9. doi: 10.1016/j.media.2019.02.006. Epub 2019 Feb 13.
9
PyraPVConv: Efficient 3D Point Cloud Perception with Pyramid Voxel Convolution and Sharable Attention.PyraPVConv:基于金字塔体素卷积和可共享注意力的高效 3D 点云感知。
Comput Intell Neurosci. 2022 May 13;2022:2286818. doi: 10.1155/2022/2286818. eCollection 2022.
10
Confidence Propagation through CNNs for Guided Sparse Depth Regression.通过卷积神经网络进行置信传播以实现引导式稀疏深度回归
IEEE Trans Pattern Anal Mach Intell. 2020 Oct;42(10):2423-2436. doi: 10.1109/TPAMI.2019.2929170. Epub 2019 Jul 17.

引用本文的文献

1
HP3D-V2V: High-Precision 3D Object Detection Vehicle-to-Vehicle Cooperative Perception Algorithm.HP3D-V2V:高精度3D目标检测车对车协同感知算法
Sensors (Basel). 2024 Mar 28;24(7):2170. doi: 10.3390/s24072170.
2
Computer Vision and Machine Learning for Intelligent Sensing Systems.计算机视觉与机器学习在智能传感系统中的应用。
Sensors (Basel). 2023 Apr 23;23(9):4214. doi: 10.3390/s23094214.

本文引用的文献

1
Extrinsic Calibration between Camera and LiDAR Sensors by Matching Multiple 3D Planes.相机和激光雷达传感器的外部校准通过匹配多个 3D 平面。
Sensors (Basel). 2019 Dec 20;20(1):52. doi: 10.3390/s20010052.
2
Dynamic Multi-LiDAR Based Multiple Object Detection and Tracking.基于动态多激光雷达的多目标检测与跟踪。
Sensors (Basel). 2019 Mar 26;19(6):1474. doi: 10.3390/s19061474.
3
Behavioral Pedestrian Tracking Using a Camera and LiDAR Sensors on a Moving Vehicle.基于车载相机和激光雷达传感器的行人行为跟踪
Sensors (Basel). 2019 Jan 18;19(2):391. doi: 10.3390/s19020391.
4
SECOND: Sparsely Embedded Convolutional Detection.第二:稀疏嵌入卷积检测。
Sensors (Basel). 2018 Oct 6;18(10):3337. doi: 10.3390/s18103337.
5
Calibration between color camera and 3D LIDAR instruments with a polygonal planar board.使用多边形平面板实现彩色相机与三维激光雷达仪器之间的校准。
Sensors (Basel). 2014 Mar 17;14(3):5333-53. doi: 10.3390/s140305333.