• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

一种基于模糊长短时记忆算法的三维动画场景重建方法

A proposed reconstruction method of a 3D animation scene based on a fuzzy long and short-term memory algorithm.

作者信息

Zhou Ming

机构信息

Zhou Ming Anhui Sanlian College, Hefei, China.

出版信息

PeerJ Comput Sci. 2024 Feb 29;10:e1864. doi: 10.7717/peerj-cs.1864. eCollection 2024.

DOI:10.7717/peerj-cs.1864
PMID:38435586
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC10909237/
Abstract

With the development of computer technology leading to a broad range of virtual technology implementations, the construction of virtual tasks has become highly demanded and has increased rapidly, especially in animation scenes. Constructing three-dimensional (3D) animation characters utilizing properties of actual characters could provide users with immersive experiences. However, a 3D face reconstruction (3DFR) utilizing a single image is a very demanding operation in computer graphics and vision. In addition, limited 3D face data sets reduce the performance improvement of the proposed approaches, causing a lack of robustness. When datasets are large, face recognition, transformation, and animation implementations are relatively practical. However, some reconstruction methods only consider the one-to-one processes without considering the correlations or differences in the input images, resulting in models lacking information related to face identity or being overly sensitive to face pose. A face model composed of a convolutional neural network (CNN) regresses 3D deformable model coefficients for 3DFR and alignment tasks. The manuscript proposes a reconstruction method for 3D animation scenes employing fuzzy LSMT-CNN (FLSMT-CNN). Multiple collected images are employed to reconstruct 3D animation characters. First, the serialized images are processed by the proposed method to extract the features of face parameters and then improve the conventional deformable face modeling (3DFDM). Afterward, the 3DFDM is utilized to reconstruct animation characters, and finally, high-precision reconstructions of 3D faces are achieved. The FLSMT-CNN has enhanced both the precision and strength of the reconstructed 3D animation characters, which provides more opportunities to be applied to other animation scenes.

摘要

随着计算机技术的发展带来了广泛的虚拟技术应用,虚拟任务的构建需求大增且迅速发展,尤其是在动画场景中。利用真实角色的属性构建三维(3D)动画角色可为用户提供沉浸式体验。然而,利用单张图像进行3D面部重建(3DFR)在计算机图形学和视觉领域是一项极具挑战性的操作。此外,有限的3D面部数据集降低了所提方法的性能提升,导致缺乏鲁棒性。当数据集较大时,人脸识别、变换和动画实现相对可行。然而,一些重建方法只考虑一对一的过程,而不考虑输入图像之间的相关性或差异,导致模型缺乏与面部身份相关的信息或对面部姿态过于敏感。由卷积神经网络(CNN)组成的面部模型回归用于3DFR和对齐任务的3D可变形模型系数。本文提出了一种采用模糊最小二乘支持向量机 - 卷积神经网络(FLSMT - CNN)的3D动画场景重建方法。使用多个采集的图像来重建3D动画角色。首先,通过所提方法处理序列化图像以提取面部参数特征,然后改进传统的可变形面部建模(3DFDM)。之后,利用3DFDM重建动画角色,最终实现3D面部的高精度重建。FLSMT - CNN提高了重建的3D动画角色的精度和强度,为应用于其他动画场景提供了更多机会。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/2c21/10909237/b777ae9c1f35/peerj-cs-10-1864-g008.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/2c21/10909237/97e8733763d9/peerj-cs-10-1864-g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/2c21/10909237/f902072ac9fa/peerj-cs-10-1864-g002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/2c21/10909237/06d5362b59d3/peerj-cs-10-1864-g006.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/2c21/10909237/b777ae9c1f35/peerj-cs-10-1864-g008.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/2c21/10909237/97e8733763d9/peerj-cs-10-1864-g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/2c21/10909237/f902072ac9fa/peerj-cs-10-1864-g002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/2c21/10909237/06d5362b59d3/peerj-cs-10-1864-g006.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/2c21/10909237/b777ae9c1f35/peerj-cs-10-1864-g008.jpg

相似文献

1
A proposed reconstruction method of a 3D animation scene based on a fuzzy long and short-term memory algorithm.一种基于模糊长短时记忆算法的三维动画场景重建方法
PeerJ Comput Sci. 2024 Feb 29;10:e1864. doi: 10.7717/peerj-cs.1864. eCollection 2024.
2
Robust 3D Face Reconstruction Using One/Two Facial Images.使用一张/两张面部图像进行稳健的3D面部重建。
J Imaging. 2021 Aug 30;7(9):169. doi: 10.3390/jimaging7090169.
3
An Animation Model Generation Method Based on Gaussian Mutation Genetic Algorithm to Optimize Neural Network.基于高斯变异遗传算法优化神经网络的动画模型生成方法。
Comput Intell Neurosci. 2022 Jun 3;2022:5106942. doi: 10.1155/2022/5106942. eCollection 2022.
4
Construction and 3D Simulation of Virtual Animation Instant Network Communication System Based on Convolution Neural Networks.基于卷积神经网络的虚拟动画即时网络通信系统的构建与三维仿真。
Comput Intell Neurosci. 2021 Aug 28;2021:7277733. doi: 10.1155/2021/7277733. eCollection 2021.
5
Deep learning-based motion compensation for four-dimensional cone-beam computed tomography (4D-CBCT) reconstruction.基于深度学习的四维锥形束 CT(4D-CBCT)重建的运动补偿。
Med Phys. 2023 Feb;50(2):808-820. doi: 10.1002/mp.16103. Epub 2022 Dec 3.
6
Computationally efficient deep neural network for computed tomography image reconstruction.用于计算机断层扫描图像重建的计算效率高的深度神经网络。
Med Phys. 2019 Nov;46(11):4763-4776. doi: 10.1002/mp.13627. Epub 2019 Sep 21.
7
3D Animation Automatic Generation System Design Based on Deep Learning.基于深度学习的3D动画自动生成系统设计
Comput Intell Neurosci. 2022 Jun 9;2022:1434599. doi: 10.1155/2022/1434599. eCollection 2022.
8
Virtual reality and 3D animation in forensic visualization.法医学可视化中的虚拟现实与3D动画
J Forensic Sci. 2010 Sep;55(5):1227-31. doi: 10.1111/j.1556-4029.2010.01453.x. Epub 2010 Jun 8.
9
Learning Inverse Rig Mappings by Nonlinear Regression.通过非线性回归学习逆刚体映射。
IEEE Trans Vis Comput Graph. 2017 Mar;23(3):1167-1178. doi: 10.1109/TVCG.2016.2628036. Epub 2016 Nov 11.
10
Three-Dimensional Virtual Reconstruction of External Nasal Defects Based on Facial Mesh Generation Network.基于面部网格生成网络的外鼻缺损三维虚拟重建
Diagnostics (Basel). 2024 Mar 12;14(6):603. doi: 10.3390/diagnostics14060603.

本文引用的文献

1
Robust 3D Face Reconstruction Using One/Two Facial Images.使用一张/两张面部图像进行稳健的3D面部重建。
J Imaging. 2021 Aug 30;7(9):169. doi: 10.3390/jimaging7090169.
2
Joint Face Alignment and 3D Face Reconstruction with Application to Face Recognition.联合人脸对齐和 3D 人脸重建及其在人脸识别中的应用。
IEEE Trans Pattern Anal Mach Intell. 2020 Mar;42(3):664-678. doi: 10.1109/TPAMI.2018.2885995. Epub 2018 Dec 10.
3
CNN-Based Real-Time Dense Face Reconstruction with Inverse-Rendered Photo-Realistic Face Images.基于卷积神经网络的实时密集人脸重建与逆渲染逼真人脸图像
IEEE Trans Pattern Anal Mach Intell. 2019 Jun;41(6):1294-1307. doi: 10.1109/TPAMI.2018.2837742. Epub 2018 May 17.
4
On the Reconstruction of Face Images from Deep Face Templates.从深度人脸模板重建人脸图像。
IEEE Trans Pattern Anal Mach Intell. 2019 May;41(5):1188-1202. doi: 10.1109/TPAMI.2018.2827389. Epub 2018 Apr 16.
5
Face Alignment in Full Pose Range: A 3D Total Solution.全姿态范围内的面部对齐:一种三维整体解决方案。
IEEE Trans Pattern Anal Mach Intell. 2019 Jan;41(1):78-92. doi: 10.1109/TPAMI.2017.2778152. Epub 2017 Nov 28.
6
The Impact of Animation Deformity on Quality of Life in Post-Mastectomy Reconstruction Patients.乳房切除术后重建患者中动画畸形对生活质量的影响。
Aesthet Surg J. 2017 May 1;37(5):531-536. doi: 10.1093/asj/sjw264.
7
Long short-term memory.长短期记忆
Neural Comput. 1997 Nov 15;9(8):1735-80. doi: 10.1162/neco.1997.9.8.1735.