National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences, Beijing, 100190, China; School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, 100049, China.
School of Computer Science and Technology, Beijing Institute of Technology, Beijing, 100081, China.
Neural Netw. 2023 Aug;165:909-924. doi: 10.1016/j.neunet.2023.06.034. Epub 2023 Jun 30.
Graph Convolutional Networks (GCNs) with naive message passing mechanisms have limited performance due to the isotropic aggregation strategy. To remedy this drawback, some recent works focus on how to design anisotropic aggregation strategies with tricks on feature mapping or structure mining. However, these models still suffer from the low ability of expressiveness and long-range modeling for the needs of high performance in practice. To this end, this paper proposes a tree-guided anisotropic GCN, which applies an anisotropic aggregation strategy with competitive expressiveness and a large receptive field. Specifically, the anisotropic aggregation is decoupled into two stages. The first stage is to establish the path of the message passing on a tree-like hypergraph consisting of substructures. The second one is to aggregate the messages with constrained intensities by employing an effective gating mechanism. In addition, a novel anisotropic readout mechanism is constructed to generate representative and discriminative graph-level features for downstream tasks. Our model outperforms baseline methods and recent works on several synthetic benchmarks and datasets from different real-world tasks. In addition, extensive ablation studies and theoretical analyses indicate the effectiveness of our proposed method.
基于朴素消息传递机制的图卷积网络 (GCN) 由于各向同性聚合策略,其性能受到限制。为了弥补这一缺陷,一些最近的工作侧重于如何设计各向异性聚合策略,通过特征映射或结构挖掘来实现。然而,这些模型仍然受到表达能力和长程建模能力的限制,无法满足实际应用中高性能的需求。为此,本文提出了一种树引导的各向异性 GCN,它应用了具有竞争力的表达能力和大感受野的各向异性聚合策略。具体来说,各向异性聚合被解耦为两个阶段。第一阶段是在由子结构组成的树状超图上建立消息传递的路径。第二阶段是通过使用有效的门控机制,以受约束的强度聚合消息。此外,构建了一种新颖的各向异性读取机制,为下游任务生成具有代表性和区分性的图级特征。我们的模型在几个合成基准和来自不同现实任务的数据集上优于基线方法和最近的工作。此外,大量的消融研究和理论分析表明了我们所提出的方法的有效性。