Suppr超能文献

基于样本的3D人像风格化

Exemplar-Based 3D Portrait Stylization.

作者信息

Han Fangzhou, Ye Shuquan, He Mingming, Chai Menglei, Liao Jing

出版信息

IEEE Trans Vis Comput Graph. 2023 Feb;29(2):1371-1383. doi: 10.1109/TVCG.2021.3114308. Epub 2022 Dec 29.

Abstract

Exemplar-based portrait stylization is widely attractive and highly desired. Despite recent successes, it remains challenging, especially when considering both texture and geometric styles. In this article, we present the first framework for one-shot 3D portrait style transfer, which can generate 3D face models with both the geometry exaggerated and the texture stylized while preserving the identity from the original content. It requires only one arbitrary style image instead of a large set of training examples for a particular style, provides geometry and texture outputs that are fully parameterized and disentangled, and enables further graphics applications with the 3D representations. The framework consists of two stages. In the first geometric style transfer stage, we use facial landmark translation to capture the coarse geometry style and guide the deformation of the dense 3D face geometry. In the second texture style transfer stage, we focus on performing style transfer on the canonical texture by adopting a differentiable renderer to optimize the texture in a multi-view framework. Experiments show that our method achieves robustly good results on different artistic styles and outperforms existing methods. We also demonstrate the advantages of our method via various 2D and 3D graphics applications.

摘要

基于样本的人像风格化极具吸引力且备受期待。尽管近期取得了一些成功,但它仍然具有挑战性,尤其是在同时考虑纹理和几何风格时。在本文中,我们提出了首个用于一次性3D人像风格迁移的框架,该框架能够生成几何形状夸张且纹理风格化的3D面部模型,同时保留原始内容的身份特征。它仅需一张任意风格的图像,而非针对特定风格的大量训练示例,提供完全参数化且解耦的几何形状和纹理输出,并能够利用3D表示进行进一步的图形应用。该框架由两个阶段组成。在第一个几何风格迁移阶段,我们使用面部地标平移来捕捉粗略的几何风格,并引导密集3D面部几何形状的变形。在第二个纹理风格迁移阶段,我们通过采用可微渲染器在多视图框架中优化纹理,专注于对规范纹理进行风格迁移。实验表明,我们的方法在不同艺术风格上均取得了稳健的良好效果,并且优于现有方法。我们还通过各种2D和3D图形应用展示了我们方法的优势。

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验