Suppr超能文献

基于稀疏图的动态注意力网络。

Sparse graphs-based dynamic attention networks.

作者信息

Chen Runze, Lin Kaibiao, Hong Binsheng, Zhang Shandan, Yang Fan

机构信息

Department of Computer Science and Technology, Xiamen University of Technology, Xiamen, 361024, China.

Department of Automation, Xiamen University, Xiamen, 361005, China.

出版信息

Heliyon. 2024 Aug 8;10(16):e35938. doi: 10.1016/j.heliyon.2024.e35938. eCollection 2024 Aug 30.

Abstract

In previous research, the prevailing assumption was that Graph Neural Networks (GNNs) precisely depicted the interconnections among nodes within the graph's architecture. Nonetheless, real-world graph datasets are often rife with noise, elements that can disseminate through the network and ultimately affect the outcome of the downstream tasks. Facing the complex fabric of real-world graphs and the myriad potential disturbances, we introduce the Sparse Graph Dynamic Attention Networks (SDGAT) in this research. SDGAT employs the regularization technique to achieve a sparse representation of the graph structure, which eliminates noise and generates a more concise sparse graph. Building upon this foundation, the model integrates a dynamic attention mechanism, allowing it to selectively focus on key nodes and edges, filter out irrelevant data, and simultaneously facilitate effective feature aggregation with important neighbors. To evaluate the performance of SDGAT, we conducted experiments on three citation datasets and compared its performance against commonly employed models. The outcomes indicate that SDGAT excels in node classification tasks, notably on the Cora dataset, with an accuracy rate of 85.29%, marking a roughly 3% enhancement over the majority of baseline models. The experimental findings provide evidence that SDGAT delivers effective performance on all three citation datasets, underscoring the efficacy of the dynamic attention network built upon a sparse graph.

摘要

在先前的研究中,普遍的假设是图神经网络(GNNs)精确地描绘了图结构中节点之间的互连关系。然而,现实世界中的图数据集往往充斥着噪声,这些噪声元素可以在网络中传播并最终影响下游任务的结果。面对现实世界图的复杂结构和众多潜在干扰,我们在本研究中引入了稀疏图动态注意力网络(SDGAT)。SDGAT采用正则化技术来实现图结构的稀疏表示,从而消除噪声并生成更简洁的稀疏图。在此基础上,该模型集成了动态注意力机制,使其能够有选择地关注关键节点和边,过滤掉无关数据,并同时促进与重要邻居的有效特征聚合。为了评估SDGAT的性能,我们在三个引用数据集上进行了实验,并将其性能与常用模型进行了比较。结果表明,SDGAT在节点分类任务中表现出色,特别是在Cora数据集上,准确率达到85.29%,比大多数基线模型提高了约3%。实验结果证明,SDGAT在所有三个引用数据集上都具有有效的性能,突出了基于稀疏图构建的动态注意力网络的有效性。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/5ed5/11647946/e61c8e408903/gr001.jpg

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验