Dong Qiujie, Wang Zixiong, Li Manyi, Gao Junjie, Chen Shuangmin, Shu Zhenyu, Xin Shiqing, Tu Changhe, Wang Wenping
IEEE Trans Vis Comput Graph. 2024 Jul;30(7):4349-4361. doi: 10.1109/TVCG.2023.3259044. Epub 2024 Jun 27.
Geometric deep learning has sparked a rising interest in computer graphics to perform shape understanding tasks, such as shape classification and semantic segmentation. When the input is a polygonal surface, one has to suffer from the irregular mesh structure. Motivated by the geometric spectral theory, we introduce Laplacian2Mesh, a novel and flexible convolutional neural network (CNN) framework for coping with irregular triangle meshes (vertices may have any valence). By mapping the input mesh surface to the multi-dimensional Laplacian-Beltrami space, Laplacian2Mesh enables one to perform shape analysis tasks directly using the mature CNNs, without the need to deal with the irregular connectivity of the mesh structure. We further define a mesh pooling operation such that the receptive field of the network can be expanded while retaining the original vertex set as well as the connections between them. Besides, we introduce a channel-wise self-attention block to learn the individual importance of feature ingredients. Laplacian2Mesh not only decouples the geometry from the irregular connectivity of the mesh structure but also better captures the global features that are central to shape classification and segmentation. Extensive tests on various datasets demonstrate the effectiveness and efficiency of Laplacian2Mesh, particularly in terms of the capability of being vulnerable to noise to fulfill various learning tasks.
几何深度学习引发了计算机图形学领域对执行形状理解任务(如形状分类和语义分割)日益增长的兴趣。当输入是多边形表面时,人们不得不面对不规则的网格结构。受几何谱理论的启发,我们引入了Laplacian2Mesh,这是一种新颖且灵活的卷积神经网络(CNN)框架,用于处理不规则三角形网格(顶点可以具有任意价)。通过将输入网格表面映射到多维拉普拉斯 - 贝尔特拉米空间,Laplacian2Mesh使人们能够直接使用成熟的CNN执行形状分析任务,而无需处理网格结构的不规则连通性。我们进一步定义了一种网格池化操作,以便在保留原始顶点集及其之间连接的同时扩展网络的感受野。此外,我们引入了一个通道自注意力块来学习特征成分的个体重要性。Laplacian2Mesh不仅将几何与网格结构的不规则连通性解耦,而且更好地捕捉了对形状分类和分割至关重要的全局特征。在各种数据集上的广泛测试证明了Laplacian2Mesh的有效性和效率,特别是在易受噪声影响以完成各种学习任务的能力方面。