Suppr超能文献

基于数据驱动的图神经网络几何散射模块学习

DATA-DRIVEN LEARNING OF GEOMETRIC SCATTERING MODULES FOR GNNS.

作者信息

Tong Alexander, Wenkel Frederick, Macdonald Kincaid, Krishnaswamy Smita, Wolf Guy

机构信息

Yale University, Dept. of Comp. Sci., New Haven, CT, USA.

Université de Montréal, Dept. of Math. & Stat.; Mila - Quebec AI Institute, Montreal, QC, Canada.

出版信息

IEEE Int Workshop Mach Learn Signal Process. 2021 Oct;2021. doi: 10.1109/mlsp52302.2021.9596169. Epub 2021 Nov 15.

Abstract

We propose a new graph neural network (GNN) module, based on relaxations of recently proposed geometric scattering transforms, which consist of a cascade of graph wavelet filters. Our learnable geometric scattering (LEGS) module enables adaptive tuning of the wavelets to encourage band-pass features to emerge in learned representations. The incorporation of our LEGS-module in GNNs enables the learning of longer-range graph relations compared to many popular GNNs, which often rely on encoding graph structure via smoothness or similarity between neighbors. Further, its wavelet priors result in simplified architectures with significantly fewer learned parameters compared to competing GNNs. We demonstrate the predictive performance of LEGS-based networks on graph classification benchmarks, as well as the descriptive quality of their learned features in biochemical graph data exploration tasks.

摘要

我们提出了一种新的图神经网络(GNN)模块,该模块基于最近提出的几何散射变换的松弛形式,它由一系列图小波滤波器组成。我们的可学习几何散射(LEGS)模块能够对小波进行自适应调谐,以促使带通特征出现在学习到的表示中。与许多常用的GNN相比,将我们的LEGS模块整合到GNN中能够学习到更长距离的图关系,常用的GNN通常依靠通过邻居之间的平滑度或相似性来编码图结构。此外,与竞争的GNN相比,其小波先验导致架构简化,学习参数显著减少。我们展示了基于LEGS的网络在图分类基准上的预测性能,以及它们在生化图数据探索任务中学习到的特征的描述质量。

相似文献

1
DATA-DRIVEN LEARNING OF GEOMETRIC SCATTERING MODULES FOR GNNS.基于数据驱动的图神经网络几何散射模块学习
IEEE Int Workshop Mach Learn Signal Process. 2021 Oct;2021. doi: 10.1109/mlsp52302.2021.9596169. Epub 2021 Nov 15.
2
GEOMETRIC SCATTERING ATTENTION NETWORKS.几何散射注意力网络
Proc IEEE Int Conf Acoust Speech Signal Process. 2021 Jun;2021:8518-8522. doi: 10.1109/icassp39728.2021.9414557. Epub 2021 May 13.
5
SP-GNN: Learning structure and position information from graphs.SP-GNN:从图中学习结构和位置信息。
Neural Netw. 2023 Apr;161:505-514. doi: 10.1016/j.neunet.2023.01.051. Epub 2023 Feb 4.
6
Motif Graph Neural Network.基序图神经网络
IEEE Trans Neural Netw Learn Syst. 2024 Oct;35(10):14833-14847. doi: 10.1109/TNNLS.2023.3281716. Epub 2024 Oct 7.
8
CCP-GNN: Competitive Covariance Pooling for Improving Graph Neural Networks.CCP-GNN:用于改进图神经网络的竞争协方差池化
IEEE Trans Neural Netw Learn Syst. 2025 Apr;36(4):6395-6406. doi: 10.1109/TNNLS.2024.3390249. Epub 2025 Apr 4.
9
Fast Haar Transforms for Graph Neural Networks.快速 Haar 变换用于图神经网络。
Neural Netw. 2020 Aug;128:188-198. doi: 10.1016/j.neunet.2020.04.028. Epub 2020 May 4.

文献AI研究员

20分钟写一篇综述,助力文献阅读效率提升50倍。

立即体验

用中文搜PubMed

大模型驱动的PubMed中文搜索引擎

马上搜索

文档翻译

学术文献翻译模型,支持多种主流文档格式。

立即体验