• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

用于单目图像几何估计的自适应表面法线约束

Adaptive Surface Normal Constraint for Geometric Estimation From Monocular Images.

作者信息

Long Xiaoxiao, Zheng Yuhang, Zheng Yupeng, Tian Beiwen, Lin Cheng, Liu Lingjie, Zhao Hao, Zhou Guyue, Wang Wenping

出版信息

IEEE Trans Pattern Anal Mach Intell. 2024 Sep;46(9):6263-6279. doi: 10.1109/TPAMI.2024.3381710. Epub 2024 Aug 6.

DOI:10.1109/TPAMI.2024.3381710
PMID:38536694
Abstract

We introduce a novel approach to learn geometries such as depth and surface normal from images while incorporating geometric context. The difficulty of reliably capturing geometric context in existing methods impedes their ability to accurately enforce the consistency between the different geometric properties, thereby leading to a bottleneck of geometric estimation quality. We therefore propose the Adaptive Surface Normal (ASN) constraint, a simple yet efficient method. Our approach extracts geometric context that encodes the geometric variations present in the input image and correlates depth estimation with geometric constraints. By dynamically determining reliable local geometry from randomly sampled candidates, we establish a surface normal constraint, where the validity of these candidates is evaluated using the geometric context. Furthermore, our normal estimation leverages the geometric context to prioritize regions that exhibit significant geometric variations, which makes the predicted normals accurately capture intricate and detailed geometric information. Through the integration of geometric context, our method unifies depth and surface normal estimations within a cohesive framework, which enables the generation of high-quality 3D geometry from images. We validate the superiority of our approach over state-of-the-art methods through extensive evaluations and comparisons on diverse indoor and outdoor datasets, showcasing its efficiency and robustness.

摘要

我们引入了一种新颖的方法,可在纳入几何上下文的同时从图像中学习诸如深度和表面法线等几何信息。现有方法中可靠捕捉几何上下文的困难阻碍了它们准确强制不同几何属性之间一致性的能力,从而导致几何估计质量的瓶颈。因此,我们提出了自适应表面法线(ASN)约束,这是一种简单而有效的方法。我们的方法提取对输入图像中存在的几何变化进行编码的几何上下文,并将深度估计与几何约束相关联。通过从随机采样的候选中动态确定可靠的局部几何,我们建立了一个表面法线约束,其中使用几何上下文评估这些候选的有效性。此外,我们的法线估计利用几何上下文对呈现显著几何变化的区域进行优先级排序,这使得预测的法线能够准确捕捉复杂而详细的几何信息。通过整合几何上下文,我们的方法在一个连贯的框架内统一了深度和表面法线估计,从而能够从图像生成高质量的3D几何信息。我们通过在各种室内和室外数据集上进行广泛的评估和比较,验证了我们的方法相对于现有方法的优越性,展示了其效率和鲁棒性。

相似文献

1
Adaptive Surface Normal Constraint for Geometric Estimation From Monocular Images.用于单目图像几何估计的自适应表面法线约束
IEEE Trans Pattern Anal Mach Intell. 2024 Sep;46(9):6263-6279. doi: 10.1109/TPAMI.2024.3381710. Epub 2024 Aug 6.
2
Metric3D v2: A Versatile Monocular Geometric Foundation Model for Zero-Shot Metric Depth and Surface Normal Estimation.Metric3D v2:一种用于零样本度量深度和表面法线估计的通用单目几何基础模型。
IEEE Trans Pattern Anal Mach Intell. 2024 Dec;46(12):10579-10596. doi: 10.1109/TPAMI.2024.3444912. Epub 2024 Nov 6.
3
Virtual Normal: Enforcing Geometric Constraints for Accurate and Robust Depth Prediction.虚拟法线:为准确且稳健的深度预测实施几何约束
IEEE Trans Pattern Anal Mach Intell. 2022 Oct;44(10):7282-7295. doi: 10.1109/TPAMI.2021.3097396. Epub 2022 Sep 14.
4
SRNSD: Structure-Regularized Night-Time Self-Supervised Monocular Depth Estimation for Outdoor Scenes.SRNSD:用于室外场景的结构正则化夜间自监督单目深度估计
IEEE Trans Image Process. 2024;33:5538-5550. doi: 10.1109/TIP.2024.3465034. Epub 2024 Oct 4.
5
GeoNet++: Iterative Geometric Neural Network with Edge-Aware Refinement for Joint Depth and Surface Normal Estimation.GeoNet++:具有边缘感知细化的迭代几何神经网络,用于联合深度和表面法线估计。
IEEE Trans Pattern Anal Mach Intell. 2022 Feb;44(2):969-984. doi: 10.1109/TPAMI.2020.3020800. Epub 2022 Jan 7.
6
NDDepth: Normal-Distance Assisted Monocular Depth Estimation and Completion.NDDepth:法线距离辅助单目深度估计与补全
IEEE Trans Pattern Anal Mach Intell. 2024 Dec;46(12):8883-8899. doi: 10.1109/TPAMI.2024.3411571. Epub 2024 Nov 6.
7
Superb Monocular Depth Estimation Based on Transfer Learning and Surface Normal Guidance.基于迁移学习和表面法向导引的卓越单目深度估计。
Sensors (Basel). 2020 Aug 27;20(17):4856. doi: 10.3390/s20174856.
8
Monocular Depth Estimation for Glass Walls With Context: A New Dataset and Method.
IEEE Trans Pattern Anal Mach Intell. 2023 Dec;45(12):15081-15097. doi: 10.1109/TPAMI.2023.3308551. Epub 2023 Nov 3.
9
Monocular endoscopy images depth estimation with multi-scale residual fusion.单目内窥镜图像的多尺度残差融合深度估计。
Comput Biol Med. 2024 Feb;169:107850. doi: 10.1016/j.compbiomed.2023.107850. Epub 2023 Dec 17.
10
Progressive Hard-Mining Network for Monocular Depth Estimation.渐进式硬挖掘网络的单目深度估计。
IEEE Trans Image Process. 2018 Aug;27(8):3691-3702. doi: 10.1109/TIP.2018.2821979.

引用本文的文献

1
A simple monocular depth estimation network for balancing complexity and accuracy.一种用于平衡复杂度和准确性的简单单目深度估计网络。
Sci Rep. 2025 Apr 15;15(1):12860. doi: 10.1038/s41598-025-97568-1.