Chen Runze, Lin Kaibiao, Hong Binsheng, Zhang Shandan, Yang Fan
Department of Computer Science and Technology, Xiamen University of Technology, Xiamen, 361024, China.
Department of Automation, Xiamen University, Xiamen, 361005, China.
Heliyon. 2024 Aug 8;10(16):e35938. doi: 10.1016/j.heliyon.2024.e35938. eCollection 2024 Aug 30.
In previous research, the prevailing assumption was that Graph Neural Networks (GNNs) precisely depicted the interconnections among nodes within the graph's architecture. Nonetheless, real-world graph datasets are often rife with noise, elements that can disseminate through the network and ultimately affect the outcome of the downstream tasks. Facing the complex fabric of real-world graphs and the myriad potential disturbances, we introduce the Sparse Graph Dynamic Attention Networks (SDGAT) in this research. SDGAT employs the regularization technique to achieve a sparse representation of the graph structure, which eliminates noise and generates a more concise sparse graph. Building upon this foundation, the model integrates a dynamic attention mechanism, allowing it to selectively focus on key nodes and edges, filter out irrelevant data, and simultaneously facilitate effective feature aggregation with important neighbors. To evaluate the performance of SDGAT, we conducted experiments on three citation datasets and compared its performance against commonly employed models. The outcomes indicate that SDGAT excels in node classification tasks, notably on the Cora dataset, with an accuracy rate of 85.29%, marking a roughly 3% enhancement over the majority of baseline models. The experimental findings provide evidence that SDGAT delivers effective performance on all three citation datasets, underscoring the efficacy of the dynamic attention network built upon a sparse graph.
在先前的研究中,普遍的假设是图神经网络(GNNs)精确地描绘了图结构中节点之间的互连关系。然而,现实世界中的图数据集往往充斥着噪声,这些噪声元素可以在网络中传播并最终影响下游任务的结果。面对现实世界图的复杂结构和众多潜在干扰,我们在本研究中引入了稀疏图动态注意力网络(SDGAT)。SDGAT采用正则化技术来实现图结构的稀疏表示,从而消除噪声并生成更简洁的稀疏图。在此基础上,该模型集成了动态注意力机制,使其能够有选择地关注关键节点和边,过滤掉无关数据,并同时促进与重要邻居的有效特征聚合。为了评估SDGAT的性能,我们在三个引用数据集上进行了实验,并将其性能与常用模型进行了比较。结果表明,SDGAT在节点分类任务中表现出色,特别是在Cora数据集上,准确率达到85.29%,比大多数基线模型提高了约3%。实验结果证明,SDGAT在所有三个引用数据集上都具有有效的性能,突出了基于稀疏图构建的动态注意力网络的有效性。