School of Computer Science and Engineering, Yantai University, Shandong, China.
Institute of Network Technology (Yantai), Shandong, China.
Neural Netw. 2024 Jan;169:143-153. doi: 10.1016/j.neunet.2023.10.024. Epub 2023 Oct 18.
The development of the Industrial Internet of Things (IIoT) in recent years has resulted in an increase in the amount of data generated by connected devices, creating new opportunities to enhance the quality of service for machine learning in the IIoT through data sharing. Graph neural networks (GNNs) are the most popular technique in machine learning at the moment because they can learn extremely precise node representations from graph-structured data. Due to privacy issues and legal restrictions of clients in industrial IoT, it is not permissible to directly concentrate vast real-world graph-structured datasets for training on GNNs. To resolve the aforementioned difficulties, this paper proposes a federal graph learning framework based on Bayesian inference (BI-FedGNN) that performs effectively in the presence of noisy graph structure information or missing strong relational edges. BI-FedGNN extends Bayesian Inference (BI) to the process of Federal Graph Learning (FGL), adding random samples with weights and biases to the client-side local model training process, improving the accuracy and generalization ability of FGL in the training process by rendering the graph structure data involved in GNNs training more similar to the graph structure data existing in the real world. Through extensive experimental tests, the results show that BI-FedGNN has about 0.5%-5.0% accuracy improvement over other baselines of federal graph learning. In order to expand the applicability of BI-FedGNN, experiments are carried out on heterogeneous graph datasets, and the results indicate that BI-FedGNN can also have at least 1.4% improvement in classification accuracy.
近年来,工业物联网(IIoT)的发展导致联网设备生成的数据量增加,通过数据共享为 IIoT 中的机器学习提供更好的服务质量创造了新的机会。图神经网络(GNN)是目前机器学习中最流行的技术,因为它们可以从图结构数据中学习到非常精确的节点表示。由于工业物联网中客户端的隐私问题和法律限制,不允许直接将大量真实世界的图结构数据集集中用于 GNN 训练。为了解决上述困难,本文提出了一种基于贝叶斯推理(BI)的联邦图学习框架(BI-FedGNN),该框架在存在噪声图结构信息或缺失强关系边的情况下表现良好。BI-FedGNN 将贝叶斯推理(BI)扩展到联邦图学习(FGL)过程中,在客户端本地模型训练过程中添加带有权重和偏差的随机样本,通过使 GNN 训练中涉及的图结构数据更接近现实世界中存在的图结构数据,提高 FGL 在训练过程中的准确性和泛化能力。通过广泛的实验测试,结果表明 BI-FedGNN 相对于联邦图学习的其他基线具有约 0.5%-5.0%的准确性提高。为了扩展 BI-FedGNN 的适用性,在异构图数据集上进行了实验,结果表明 BI-FedGNN 还可以至少提高 1.4%的分类准确性。