Zhang Congyi, Yang Lei, Chen Nenglun, Vining Nicholas, Sheffer Alla, Lau Francis C M, Wang Guoping, Wang Wenping
IEEE Trans Vis Comput Graph. 2023 Dec;29(12):4874-4890. doi: 10.1109/TVCG.2022.3197560. Epub 2023 Nov 10.
Creating 3D shapes from 2D drawings is an important problem with applications in content creation for computer animation and virtual reality. We introduce a new sketch-based system, CreatureShop, that enables amateurs to create high-quality textured 3D character models from 2D drawings with ease and efficiency. CreatureShop takes an input bitmap drawing of a character (such as an animal or other creature), depicted from an arbitrary descriptive pose and viewpoint, and creates a 3D shape with plausible geometric details and textures from a small number of user annotations on the 2D drawing. Our key contributions are a novel oblique view modeling method, a set of systematic approaches for producing plausible textures on the invisible or occluded parts of the 3D character (as viewed from the direction of the input drawing), and a user-friendly interactive system. We validate our system and methods by creating numerous 3D characters from various drawings, and compare our results with related works to show the advantages of our method. We perform a user study to evaluate the usability of our system, which demonstrates that our system is a practical and efficient approach to create fully-textured 3D character models for novice users.
从二维图纸创建三维形状是一个重要问题,在计算机动画和虚拟现实的内容创作中有应用。我们引入了一个新的基于草图的系统——生物模型创建工具(CreatureShop),它能让业余爱好者轻松高效地从二维图纸创建高质量的带纹理三维角色模型。生物模型创建工具接受一个角色的输入位图绘图(如动物或其他生物),该绘图以任意描述性姿势和视角描绘,并根据二维绘图上的少量用户注释创建一个具有合理几何细节和纹理的三维形状。我们的主要贡献是一种新颖的斜视图建模方法、一组用于在三维角色不可见或被遮挡部分(从输入绘图方向看)生成合理纹理的系统方法,以及一个用户友好的交互系统。我们通过从各种绘图创建大量三维角色来验证我们的系统和方法,并将我们的结果与相关工作进行比较以展示我们方法的优势。我们进行了一项用户研究来评估我们系统的可用性,结果表明我们的系统是为新手用户创建全纹理三维角色模型的实用且高效的方法。