School of Computer Science and Technology, Beijing Institute of Technology, Beijing 100081, P.R. China.
IEEE Trans Vis Comput Graph. 2012 Jul;18(7):1156-69. doi: 10.1109/TVCG.2011.111.
We introduce the EXtract-and-COmplete Layering method (EXCOL)--a novel cartoon animation processing technique to convert a traditional animated cartoon video into multiple semantically meaningful layers. Our technique is inspired by vision-based layering techniques but focuses on shape cues in both the extraction and completion steps to reflect the unique characteristics of cartoon animation. For layer extraction, we define a novel similarity measure incorporating both shape and color of automatically segmented regions within individual frames and propagate a small set of user-specified layer labels among similar regions across frames. By clustering regions with the same labels, each frame is appropriately partitioned into different layers, with each layer containing semantically meaningful content. Then, a warping-based approach is used to fill missing parts caused by occlusion within the extracted layers to achieve a complete representation. EXCOL provides a flexible way to effectively reuse traditional cartoon animations with only a small amount of user interaction. It is demonstrated that our EXCOL method is effective and robust, and the layered representation benefits a variety of applications in cartoon animation processing.
我们引入了 EXtract-and-COmplete Layering 方法（EXCOL）——一种新颖的卡通动画处理技术，可将传统的卡通动画视频转换为多个具有语义意义的层。我们的技术受到基于视觉的分层技术的启发，但在提取和完成步骤中侧重于形状线索，以反映卡通动画的独特特征。对于层提取，我们定义了一种新颖的相似性度量，该度量结合了自动分割区域的形状和颜色，在帧内和帧间的相似区域中传播一小部分用户指定的层标签。通过对具有相同标签的区域进行聚类，每帧被适当地划分为不同的层，其中每个层包含具有语义意义的内容。然后，使用基于变形的方法来填充提取层中遮挡造成的缺失部分，以实现完整的表示。EXCOL 提供了一种灵活的方法，可以仅通过少量用户交互来有效地重用传统的卡通动画。实验结果表明，我们的 EXCOL 方法是有效和鲁棒的，分层表示有益于卡通动画处理中的各种应用。
