Suppr超能文献

带交叉熵的图自适应注意力网络

Graph Adaptive Attention Network with Cross-Entropy.

作者信息

Chen Zhao

机构信息

School of Remote Sensing and Information Engineering, Wuhan University, Wuhan 430081, China.

出版信息

Entropy (Basel). 2024 Jul 4;26(7):576. doi: 10.3390/e26070576.

Abstract

Non-Euclidean data, such as social networks and citation relationships between documents, have node and structural information. The Graph Convolutional Network (GCN) can automatically learn node features and association information between nodes. The core ideology of the Graph Convolutional Network is to aggregate node information by using edge information, thereby generating a new node feature. In updating node features, there are two core influencing factors. One is the number of neighboring nodes of the central node; the other is the contribution of the neighboring nodes to the central node. Due to the previous GCN methods not simultaneously considering the numbers and different contributions of neighboring nodes to the central node, we design the adaptive attention mechanism (AAM). To further enhance the representational capability of the model, we utilize Multi-Head Graph Convolution (MHGC). Finally, we adopt the cross-entropy (CE) loss function to describe the difference between the predicted results of node categories and the ground truth (GT). Combined with backpropagation, this ultimately achieves accurate node classification. Based on the AAM, MHGC, and CE, we contrive the novel Graph Adaptive Attention Network (GAAN). The experiments show that classification accuracy achieves outstanding performances on Cora, Citeseer, and Pubmed datasets.

摘要

非欧几里得数据,如社交网络和文档之间的引用关系,具有节点和结构信息。图卷积网络(GCN)可以自动学习节点特征以及节点之间的关联信息。图卷积网络的核心思想是利用边信息聚合节点信息,从而生成新的节点特征。在更新节点特征时,有两个核心影响因素。一个是中心节点的相邻节点数量;另一个是相邻节点对中心节点的贡献。由于先前的GCN方法没有同时考虑相邻节点对中心节点的数量和不同贡献,我们设计了自适应注意力机制(AAM)。为了进一步增强模型的表示能力,我们使用多头图卷积(MHGC)。最后,我们采用交叉熵(CE)损失函数来描述节点类别预测结果与真实值(GT)之间的差异。结合反向传播,这最终实现了准确的节点分类。基于AAM、MHGC和CE,我们设计了新颖的图自适应注意力网络(GAAN)。实验表明,在Cora、Citeseer和Pubmed数据集上,分类准确率取得了优异的性能。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/3bfa/11276322/c5e1d48284e6/entropy-26-00576-g001.jpg

文献AI研究员

20分钟写一篇综述,助力文献阅读效率提升50倍。

立即体验

用中文搜PubMed

大模型驱动的PubMed中文搜索引擎

马上搜索

文档翻译

学术文献翻译模型,支持多种主流文档格式。

立即体验