Zhou Yuchen, Huo Hongtao, Hou Zhiwen, Bu Lingbin, Mao Jingyi, Wang Yifan, Lv Xiaojun, Bu Fanliang
People's Public Security University of China, Beijing, 100038, China.
China Academy of Railway Sciences Corporation Limited, Beijing, 100081, China.
Sci Rep. 2023 Oct 8;13(1):16966. doi: 10.1038/s41598-023-44224-1.
Graph neural networks (GNNs) have significant advantages in dealing with non-Euclidean data and have been widely used in various fields. However, most of the existing GNN models face two main challenges: (1) Most GNN models built upon the message-passing framework exhibit a shallow structure, which hampers their ability to efficiently transmit information between distant nodes. To address this, we aim to propose a novel message-passing framework, enabling the construction of GNN models with deep architectures akin to convolutional neural networks (CNNs), potentially comprising dozens or even hundreds of layers. (2) Existing models often approach the learning of edge and node features as separate tasks. To overcome this limitation, we aspire to develop a deep graph convolutional neural network learning framework capable of simultaneously acquiring edge embeddings and node embeddings. By utilizing the learned multi-dimensional edge feature matrix, we construct multi-channel filters to more effectively capture accurate node features. To address these challenges, we propose the Co-embedding of Edges and Nodes with Deep Graph Convolutional Neural Networks (CEN-DGCNN). In our approach, we propose a novel message-passing framework that can fully integrate and utilize both node features and multi-dimensional edge features. Based on this framework, we develop a deep graph convolutional neural network model that prevents over-smoothing and obtains node non-local structural features and refined high-order node features by extracting long-distance dependencies between nodes and utilizing multi-dimensional edge features. Moreover, we propose a novel graph convolutional layer that can learn node embeddings and multi-dimensional edge embeddings simultaneously. The layer updates multi-dimensional edge embeddings across layers based on node features and an attention mechanism, which enables efficient utilization and fusion of both node and edge features. Additionally, we propose a multi-dimensional edge feature encoding method based on directed edges, and use the resulting multi-dimensional edge feature matrix to construct a multi-channel filter to filter the node information. Lastly, extensive experiments show that CEN-DGCNN outperforms a large number of graph neural network baseline methods, demonstrating the effectiveness of our proposed method.
图神经网络(GNN)在处理非欧几里得数据方面具有显著优势,并已在各个领域中广泛应用。然而,现有的大多数GNN模型面临两个主要挑战:(1)大多数基于消息传递框架构建的GNN模型呈现出浅层结构,这阻碍了它们在远距离节点之间有效传输信息的能力。为了解决这个问题,我们旨在提出一种新颖的消息传递框架,能够构建类似于卷积神经网络(CNN)的具有深度架构的GNN模型,可能包含数十甚至数百层。(2)现有模型通常将边和节点特征的学习视为单独的任务。为了克服这一限制,我们希望开发一种深度图卷积神经网络学习框架,能够同时获取边嵌入和节点嵌入。通过利用学习到的多维度边特征矩阵,我们构建多通道滤波器以更有效地捕获准确的节点特征。为了应对这些挑战,我们提出了深度图卷积神经网络的边和节点协同嵌入(CEN-DGCNN)。在我们的方法中,我们提出了一种新颖的消息传递框架,该框架可以充分整合和利用节点特征和多维度边特征。基于此框架,我们开发了一个深度图卷积神经网络模型,该模型可防止过度平滑,并通过提取节点之间的长距离依赖关系并利用多维度边特征来获得节点非局部结构特征和精细的高阶节点特征。此外,我们提出了一种新颖的图卷积层,该层可以同时学习节点嵌入和多维度边嵌入。该层基于节点特征和注意力机制跨层更新多维度边嵌入,这使得能够有效利用和融合节点和边特征。此外,我们提出了一种基于有向边的多维度边特征编码方法,并使用所得的多维度边特征矩阵构建多通道滤波器来过滤节点信息。最后,大量实验表明CEN-DGCNN优于大量图神经网络基线方法,证明了我们所提出方法的有效性。