Deezer Research, Paris, France; LIX, École Polytechnique, Institut Polytechnique de Paris, Palaiseau, France.
LIX, École Polytechnique, Institut Polytechnique de Paris, Palaiseau, France.
Neural Netw. 2022 Sep;153:474-495. doi: 10.1016/j.neunet.2022.06.021. Epub 2022 Jun 22.
Graph autoencoders (GAE) and variational graph autoencoders (VGAE) emerged as powerful methods for link prediction. Their performances are less impressive on community detection problems where, according to recent and concurring experimental evaluations, they are often outperformed by simpler alternatives such as the Louvain method. It is currently still unclear to which extent one can improve community detection with GAE and VGAE, especially in the absence of node features. It is moreover uncertain whether one could do so while simultaneously preserving good performances on link prediction. In this paper, we show that jointly addressing these two tasks with high accuracy is possible. For this purpose, we introduce and theoretically study a community-preserving message passing scheme, doping our GAE and VGAE encoders by considering both the initial graph structure and modularity-based prior communities when computing embedding spaces. We also propose novel training and optimization strategies, including the introduction of a modularity-inspired regularizer complementing the existing reconstruction losses for joint link prediction and community detection. We demonstrate the empirical effectiveness of our approach, referred to as Modularity-Aware GAE and VGAE, through in-depth experimental validation on various real-world graphs.
图自动编码器(GAE)和变分图自动编码器(VGAE)已经成为链路预测的强大方法。然而,在社区检测问题上,它们的性能并不那么令人印象深刻,根据最近的和一致的实验评估,它们往往被更简单的替代方法(如 Louvain 方法)所超越。目前还不清楚在没有节点特征的情况下,GAE 和 VGAE 可以在多大程度上改进社区检测,而且还不确定是否可以在同时保持链路预测的良好性能的情况下做到这一点。在本文中,我们表明,通过高精度地同时解决这两个任务是可能的。为此,我们引入并从理论上研究了一种社区保持的消息传递方案,在计算嵌入空间时,我们通过考虑初始图结构和基于模块性的先验社区,对我们的 GAE 和 VGAE 编码器进行了改进。我们还提出了新的训练和优化策略,包括引入一个基于模块性的正则化项,该正则化项补充了现有的用于联合链路预测和社区检测的重构损失。我们通过在各种真实世界图上进行深入的实验验证,证明了我们的方法(称为模块化感知 GAE 和 VGAE)的有效性。