• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

三维宽面(3DWF):基于新 RGB⁻D 多摄像机数据集的面部地标检测和 3D 重建。

Three-D Wide Faces (3DWF): Facial Landmark Detection and 3D Reconstruction over a New RGB⁻D Multi-Camera Dataset.

机构信息

Grupo de Aplicación de Telecomunicaciones Visuales, Universidad Politecnica de Madrid, 28040 Madrid, Spain.

Computer Vision Lab, University of Amsterdam, 1098 XH Amsterdam, The Netherlands.

出版信息

Sensors (Basel). 2019 Mar 4;19(5):1103. doi: 10.3390/s19051103.

DOI:10.3390/s19051103
PMID:30836714
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC6427725/
Abstract

Latest advances of deep learning paradigm and 3D imaging systems have raised the necessity for more complete datasets that allow exploitation of facial features such as pose, gender or age. In our work, we propose a new facial dataset collected with an innovative RGB⁻D multi-camera setup whose optimization is presented and validated. 3DWF includes 3D raw and registered data collection for 92 persons from low-cost RGB⁻D sensing devices to commercial scanners with great accuracy. 3DWF provides a complete dataset with relevant and accurate visual information for different tasks related to facial properties such as face tracking or 3D face reconstruction by means of annotated density normalized 2K clouds and RGB⁻D streams. In addition, we validate the reliability of our proposal by an original data augmentation method from a massive set of face meshes for facial landmark detection in 2D domain, and by head pose classification through common Machine Learning techniques directed towards proving alignment of collected data.

摘要

深度学习范式和 3D 成像系统的最新进展提出了对更完整数据集的需求,这些数据集允许利用面部特征,如姿势、性别或年龄。在我们的工作中,我们提出了一个新的面部数据集,该数据集是使用创新的 RGB⁻D 多摄像机设置收集的,我们对其进行了优化并进行了验证。3DWF 包括 92 个人的 3D 原始和注册数据采集,这些数据来自低成本的 RGB⁻D 感应设备和具有高精度的商业扫描仪。3DWF 提供了一个完整的数据集,其中包含与面部属性相关的相关和准确的视觉信息,例如通过注释密度归一化的 2K 云以及 RGB⁻D 流进行面部跟踪或 3D 面部重建。此外,我们通过一种原始的数据增强方法从大量的面部网格中验证了我们的提议的可靠性,用于 2D 域中的面部地标检测,并且通过常见的机器学习技术进行头部姿势分类,旨在证明所收集数据的对齐。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/0ace/6427725/ae7bc79677d9/sensors-19-01103-g010.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/0ace/6427725/213e2811fbd9/sensors-19-01103-g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/0ace/6427725/73d1324229d0/sensors-19-01103-g002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/0ace/6427725/3e66e8d75962/sensors-19-01103-g003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/0ace/6427725/3da6d3695b1a/sensors-19-01103-g004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/0ace/6427725/9400fa259a81/sensors-19-01103-g005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/0ace/6427725/a0775d75004d/sensors-19-01103-g006.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/0ace/6427725/ad53f7ab85ac/sensors-19-01103-g007.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/0ace/6427725/ffdf32d76a28/sensors-19-01103-g008.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/0ace/6427725/def5c5c35791/sensors-19-01103-g009.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/0ace/6427725/ae7bc79677d9/sensors-19-01103-g010.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/0ace/6427725/213e2811fbd9/sensors-19-01103-g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/0ace/6427725/73d1324229d0/sensors-19-01103-g002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/0ace/6427725/3e66e8d75962/sensors-19-01103-g003.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/0ace/6427725/3da6d3695b1a/sensors-19-01103-g004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/0ace/6427725/9400fa259a81/sensors-19-01103-g005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/0ace/6427725/a0775d75004d/sensors-19-01103-g006.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/0ace/6427725/ad53f7ab85ac/sensors-19-01103-g007.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/0ace/6427725/ffdf32d76a28/sensors-19-01103-g008.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/0ace/6427725/def5c5c35791/sensors-19-01103-g009.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/0ace/6427725/ae7bc79677d9/sensors-19-01103-g010.jpg

相似文献

1
Three-D Wide Faces (3DWF): Facial Landmark Detection and 3D Reconstruction over a New RGB⁻D Multi-Camera Dataset.三维宽面(3DWF):基于新 RGB⁻D 多摄像机数据集的面部地标检测和 3D 重建。
Sensors (Basel). 2019 Mar 4;19(5):1103. doi: 10.3390/s19051103.
2
Multitask Learning Strategy with Pseudo-Labeling: Face Recognition, Facial Landmark Detection, and Head Pose Estimation.多任务学习策略与伪标签:人脸识别、面部地标检测和头部姿势估计。
Sensors (Basel). 2024 May 18;24(10):3212. doi: 10.3390/s24103212.
3
3D Face Point Cloud Reconstruction and Recognition Using Depth Sensor.基于深度传感器的 3D 人脸点云重建与识别
Sensors (Basel). 2021 Apr 7;21(8):2587. doi: 10.3390/s21082587.
4
FaceWarehouse: a 3D facial expression database for visual computing.面部数据库:一个用于视觉计算的3D面部表情数据库。
IEEE Trans Vis Comput Graph. 2014 Mar;20(3):413-25. doi: 10.1109/TVCG.2013.249.
5
3D real-time human reconstruction with a single RGBD camera.使用单个RGBD相机进行3D实时人体重建。
Appl Intell (Dordr). 2023;53(8):8735-8745. doi: 10.1007/s10489-022-03969-4. Epub 2022 Aug 2.
6
2DHeadPose: A simple and effective annotation method for the head pose in RGB images and its dataset.2DHeadPose:一种简单有效的 RGB 图像中头部姿势标注方法及其数据集。
Neural Netw. 2023 Mar;160:50-62. doi: 10.1016/j.neunet.2022.12.021. Epub 2023 Jan 2.
7
Head Pose Estimation through Keypoints Matching between Reconstructed 3D Face Model and 2D Image.基于重建 3D 人脸模型和 2D 图像关键点匹配的头部姿势估计
Sensors (Basel). 2021 Mar 6;21(5):1841. doi: 10.3390/s21051841.
8
Faces in Event Streams (FES): An Annotated Face Dataset for Event Cameras.事件流中的人脸(FES):用于事件相机的带注释人脸数据集
Sensors (Basel). 2024 Feb 22;24(5):1409. doi: 10.3390/s24051409.
9
Robust 3D Face Reconstruction Using One/Two Facial Images.使用一张/两张面部图像进行稳健的3D面部重建。
J Imaging. 2021 Aug 30;7(9):169. doi: 10.3390/jimaging7090169.
10
Real-Time 3D Eye Performance Reconstruction for RGBD Cameras.基于 RGBD 相机的实时 3D 眼部性能重建。
IEEE Trans Vis Comput Graph. 2017 Dec;23(12):2586-2598. doi: 10.1109/TVCG.2016.2641442. Epub 2016 Dec 19.

引用本文的文献

1
Detection of Aerobics Action Based on Convolutional Neural Network.基于卷积神经网络的有氧运动动作检测。
Comput Intell Neurosci. 2022 Jan 5;2022:1857406. doi: 10.1155/2022/1857406. eCollection 2022.

本文引用的文献

1
Facial Landmark Detection with Tweaked Convolutional Neural Networks.基于微调卷积神经网络的面部地标检测
IEEE Trans Pattern Anal Mach Intell. 2018 Dec;40(12):3067-3074. doi: 10.1109/TPAMI.2017.2787130. Epub 2017 Dec 25.
2
Describable Visual Attributes for Face Verification and Image Search.可描述的人脸验证和图像搜索视觉属性。
IEEE Trans Pattern Anal Mach Intell. 2011 Oct;33(10):1962-77. doi: 10.1109/TPAMI.2011.48. Epub 2011 Mar 10.
3
Multiperson visual focus of attention from head pose and meeting contextual cues.
基于头部姿势和会议上下文线索的多人视觉焦点关注。
IEEE Trans Pattern Anal Mach Intell. 2011 Jan;33(1):101-16. doi: 10.1109/TPAMI.2010.69.
4
Multi-PIE.多姿态、光照和表情数据库
Proc Int Conf Autom Face Gesture Recognit. 2010 May 1;28(5):807-813. doi: 10.1016/j.imavis.2009.08.002.