Gao Hongyang, Liu Yi, Ji Shuiwang
IEEE Trans Pattern Anal Mach Intell. 2021 Dec;43(12):4512-4518. doi: 10.1109/TPAMI.2021.3062794. Epub 2021 Nov 3.
Pooling operations have shown to be effective on computer vision and natural language processing tasks. One challenge of performing pooling operations on graph data is the lack of locality that is not well-defined on graphs. Previous studies used global ranking methods to sample some of the important nodes, but most of them are not able to incorporate graph topology. In this work, we propose the topology-aware pooling (TAP) layer that explicitly considers graph topology. Our TAP layer is a two-stage voting process that selects more important nodes in a graph. It first performs local voting to generate scores for each node by attending each node to its neighboring nodes. The scores are generated locally such that topology information is explicitly considered. In addition, graph topology is incorporated in global voting to compute the importance score of each node globally in the entire graph. Altogether, the final ranking score for each node is computed by combining its local and global voting scores. To encourage better graph connectivity in the sampled graph, we propose to add a graph connectivity term to the computation of ranking scores. Results on graph classification tasks demonstrate that our methods achieve consistently better performance than previous methods.
池化操作已被证明在计算机视觉和自然语言处理任务中是有效的。在图数据上执行池化操作的一个挑战是缺乏在图上定义不明确的局部性。先前的研究使用全局排序方法对一些重要节点进行采样,但其中大多数无法纳入图拓扑结构。在这项工作中,我们提出了显式考虑图拓扑结构的拓扑感知池化(TAP)层。我们的TAP层是一个两阶段投票过程,用于在图中选择更重要的节点。它首先执行局部投票,通过让每个节点关注其相邻节点来为每个节点生成分数。分数是在局部生成的,从而明确考虑了拓扑信息。此外,图拓扑结构被纳入全局投票,以在整个图中全局计算每个节点的重要性分数。总之,每个节点的最终排名分数是通过结合其局部和全局投票分数来计算的。为了鼓励在采样图中具有更好的图连通性,我们建议在排名分数的计算中添加一个图连通性项。图分类分类任务的结果表明,我们的方法始终比以前的方法取得更好的性能。