• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

基于生成对抗网络的单幅图像深度推断。

Single-Image Depth Inference Using Generative Adversarial Networks.

机构信息

Department of Computer Science and Information Engineering, National Taiwan University of Science and Technology, Taipei 10607, Taiwan.

Software Technology Department, De La Salle University, Manila 1004, Philippines.

出版信息

Sensors (Basel). 2019 Apr 10;19(7):1708. doi: 10.3390/s19071708.

DOI:10.3390/s19071708
PMID:30974774
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC6480060/
Abstract

Depth has been a valuable piece of information for perception tasks such as robot grasping, obstacle avoidance, and navigation, which are essential tasks for developing smart homes and smart cities. However, not all applications have the luxury of using depth sensors or multiple cameras to obtain depth information. In this paper, we tackle the problem of estimating the per-pixel depths from a single image. Inspired by the recent works on generative neural network models, we formulate the task of depth estimation as a generative task where we synthesize an image of the depth map from a single Red, Green, and Blue (RGB) input image. We propose a novel generative adversarial network that has an encoder-decoder type generator with residual transposed convolution blocks trained with an adversarial loss. Quantitative and qualitative experimental results demonstrate the effectiveness of our approach over several depth estimation works.

摘要

深度一直是机器人抓取、障碍物回避和导航等感知任务的重要信息,这些任务对于开发智能家居和智慧城市至关重要。然而,并非所有应用都有使用深度传感器或多个相机来获取深度信息的奢侈条件。在本文中,我们解决了从单张图像估计逐像素深度的问题。受最近关于生成神经网模型的工作的启发,我们将深度估计任务表述为生成任务,即从单个红绿蓝(RGB)输入图像合成深度图的图像。我们提出了一种新颖的生成对抗网络,它具有一个带有残差转置卷积块的编解码器类型生成器,使用对抗性损失进行训练。定量和定性实验结果表明,我们的方法在多个深度估计工作中都具有有效性。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/6552/6480060/e1b24bb8872e/sensors-19-01708-g005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/6552/6480060/a2422c8c761c/sensors-19-01708-g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/6552/6480060/e48d0887ded3/sensors-19-01708-g002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/6552/6480060/360cb9291532/sensors-19-01708-g003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/6552/6480060/7dec60445f51/sensors-19-01708-g004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/6552/6480060/e1b24bb8872e/sensors-19-01708-g005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/6552/6480060/a2422c8c761c/sensors-19-01708-g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/6552/6480060/e48d0887ded3/sensors-19-01708-g002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/6552/6480060/360cb9291532/sensors-19-01708-g003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/6552/6480060/7dec60445f51/sensors-19-01708-g004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/6552/6480060/e1b24bb8872e/sensors-19-01708-g005.jpg

相似文献

1
Single-Image Depth Inference Using Generative Adversarial Networks.基于生成对抗网络的单幅图像深度推断。
Sensors (Basel). 2019 Apr 10;19(7):1708. doi: 10.3390/s19071708.
2
Generative adversarial networks with decoder-encoder output noises.生成对抗网络与解码器编码器输出噪声。
Neural Netw. 2020 Jul;127:19-28. doi: 10.1016/j.neunet.2020.04.005. Epub 2020 Apr 9.
3
Depth Map Upsampling via Multi-Modal Generative Adversarial Network.通过多模态生成对抗网络进行深度图上采样
Sensors (Basel). 2019 Apr 2;19(7):1587. doi: 10.3390/s19071587.
4
Multiscale Attention Fusion for Depth Map Super-Resolution Generative Adversarial Networks.用于深度图超分辨率生成对抗网络的多尺度注意力融合
Entropy (Basel). 2023 May 23;25(6):836. doi: 10.3390/e25060836.
5
Nighttime road scene image enhancement based on cycle-consistent generative adversarial network.基于循环一致生成对抗网络的夜间道路场景图像增强
Sci Rep. 2024 Jun 22;14(1):14375. doi: 10.1038/s41598-024-65270-3.
6
Unsupervised Generative Adversarial Network for Plantar Pressure Image-to-Image Translation.基于无监督生成对抗网络的足底压力图像-图像转换。
Annu Int Conf IEEE Eng Med Biol Soc. 2021 Nov;2021:2580-2583. doi: 10.1109/EMBC46164.2021.9629684.
7
HAG-NET: Hiding Data and Adversarial Attacking with Generative Adversarial Network.HAG-NET:利用生成对抗网络隐藏数据与对抗攻击
Entropy (Basel). 2024 Mar 19;26(3):269. doi: 10.3390/e26030269.
8
Fractional Wavelet-Based Generative Scattering Networks.基于分数小波的生成散射网络
Front Neurorobot. 2021 Oct 26;15:752752. doi: 10.3389/fnbot.2021.752752. eCollection 2021.
9
Encoder-decoder with densely convolutional networks for monocular depth estimation.用于单目深度估计的带密集卷积网络的编码器-解码器
J Opt Soc Am A Opt Image Sci Vis. 2019 Oct 1;36(10):1709-1718. doi: 10.1364/JOSAA.36.001709.
10
3D conditional generative adversarial networks for high-quality PET image estimation at low dose.基于三维条件生成对抗网络的低剂量 PET 图像高质量估计。
Neuroimage. 2018 Jul 1;174:550-562. doi: 10.1016/j.neuroimage.2018.03.045. Epub 2018 Mar 20.

引用本文的文献

1
Recognizing Trained and Untrained Obstacles around a Port Transfer Crane Using an Image Segmentation Model and Coordinate Mapping between the Ground and Image.利用图像分割模型和地面与图像之间的坐标映射识别港口搬运起重机的训练有素和未经训练的障碍物。
Sensors (Basel). 2023 Jun 27;23(13):5982. doi: 10.3390/s23135982.

本文引用的文献

1
StackGAN++: Realistic Image Synthesis with Stacked Generative Adversarial Networks.StackGAN++:基于堆叠生成对抗网络的逼真图像合成
IEEE Trans Pattern Anal Mach Intell. 2019 Aug;41(8):1947-1962. doi: 10.1109/TPAMI.2018.2856256. Epub 2018 Jul 16.
2
Depth Estimation Using a Sliding Camera.使用滑动相机进行深度估计。
IEEE Trans Image Process. 2016 Feb;25(2):726-39. doi: 10.1109/TIP.2015.2507984. Epub 2015 Dec 11.
3
Learning Depth from Single Monocular Images Using Deep Convolutional Neural Fields.利用深度卷积神经场从单目图像中学习深度。
IEEE Trans Pattern Anal Mach Intell. 2016 Oct;38(10):2024-39. doi: 10.1109/TPAMI.2015.2505283. Epub 2015 Dec 3.
4
Continuous Depth Map Reconstruction From Light Fields.基于光场的连续深度图重建。
IEEE Trans Image Process. 2015 Nov;24(11):3257-65. doi: 10.1109/TIP.2015.2440760. Epub 2015 Jun 3.
5
Depth reconstruction from sparse samples: representation, algorithm, and sampling.从稀疏样本中进行深度重建:表示、算法和采样。
IEEE Trans Image Process. 2015 Jun;24(6):1983-96. doi: 10.1109/TIP.2015.2409551. Epub 2015 Mar 6.
6
Depth from water reflection.基于水面反射的深度估计。
IEEE Trans Image Process. 2015 Apr;24(4):1235-43. doi: 10.1109/TIP.2015.2397591. Epub 2015 Jan 28.
7
Spherical blurred shape model for 3-D object and pose recognition: quantitative analysis and HCI applications in smart environments.球形模糊形状模型用于三维物体和姿态识别:智能环境中的定量分析和人机交互应用。
IEEE Trans Cybern. 2014 Dec;44(12):2379-90. doi: 10.1109/TCYB.2014.2307121.
8
Consistent depth video segmentation using adaptive surface models.基于自适应表面模型的一致深度视频分割。
IEEE Trans Cybern. 2015 Feb;45(2):266-78. doi: 10.1109/TCYB.2014.2324815. Epub 2014 Jun 2.
9
3-D Human Action Recognition by Shape Analysis of Motion Trajectories on Riemannian Manifold.基于黎曼流形上运动轨迹形状分析的 3-D 人体动作识别。
IEEE Trans Cybern. 2015 Jul;45(7):1340-52. doi: 10.1109/TCYB.2014.2350774. Epub 2014 Sep 9.
10
Multipe/single-view human action recognition via part-induced multitask structural learning.基于部件诱导多任务结构学习的多/单视图人体动作识别。
IEEE Trans Cybern. 2015 Jun;45(6):1194-208. doi: 10.1109/TCYB.2014.2347057. Epub 2014 Aug 27.