Liu Xinqi, Li Jituo, Lu Guodong
IEEE Trans Vis Comput Graph. 2025 Apr;31(4):2142-2154. doi: 10.1109/TVCG.2024.3381937. Epub 2025 Feb 27.
Single-view clothing reconstruction usually relies on topologically fixed clothing templates to reduce the problem complexity, but this strategy also makes the reconstructed clothing shape contours simple and lack diversity. In this article, we propose a novel clothing reconstruction method to generate complex shape contours and open clothing mesh from a single image. At the heart of our work is an implicit unsigned distance field condition on clothing-oriented and pose-stable spatial shape features to represent the clothing from the image. This feature can provide spatially aligned clothing shape priors to improve the pose robustness. It is based on a type-generic clothing template derived from the mainstream clothing generative model to avoid tedious template design and switching. To output open clothing mesh results from noisy clothing unsigned distance fields, we develop a two-stage clothing mesh extraction method. It takes the point clouds as an intermediate representation and produces smooth, plausible and editable clothing mesh results. To provide effective supervision, we construct a pose-rich and shape-complete clothing scan dataset by enhancing clothing pose diversity and complementing missing clothing geometry caused by occlusion. Extensive experiments demonstrate that our method achieves state-of-the-art levels. More importantly, we provide a simple but effective, and low-cost way to reconstruct complex shape contours clothing from a single image.
单视图服装重建通常依赖于拓扑固定的服装模板来降低问题的复杂性,但这种策略也使得重建的服装形状轮廓简单且缺乏多样性。在本文中,我们提出了一种新颖的服装重建方法,可从单张图像生成复杂的形状轮廓和开放的服装网格。我们工作的核心是对面向服装且姿态稳定的空间形状特征施加隐式无符号距离场条件,以从图像中表示服装。此特征可提供空间对齐的服装形状先验信息,以提高姿态鲁棒性。它基于从主流服装生成模型派生的类型通用服装模板,以避免繁琐的模板设计和切换。为了从有噪声的服装无符号距离场输出开放的服装网格结果,我们开发了一种两阶段服装网格提取方法。该方法将点云作为中间表示,并生成平滑、合理且可编辑的服装网格结果。为了提供有效的监督,我们通过增强服装姿态多样性和补充由遮挡导致的缺失服装几何形状,构建了一个姿态丰富且形状完整的服装扫描数据集。大量实验表明,我们的方法达到了当前的先进水平。更重要的是,我们提供了一种简单但有效且低成本的方法,可从单张图像重建复杂形状轮廓的服装。