Wen Jie, Zhang Zhixia, Lan Yang, Cui Zhihua, Cai Jianghui, Zhang Wensheng
School of Electronic Information Engineering, Taiyuan University of Science and Technology, Taiyuan, China.
School of Computer Science and Technology, Taiyuan University of Science and Technology, Taiyuan, China.
Int J Mach Learn Cybern. 2023;14(2):513-535. doi: 10.1007/s13042-022-01647-y. Epub 2022 Nov 11.
Federated learning (FL) is a secure distributed machine learning paradigm that addresses the issue of data silos in building a joint model. Its unique distributed training mode and the advantages of security aggregation mechanism are very suitable for various practical applications with strict privacy requirements. However, with the deployment of FL mode into practical application, some bottlenecks appear in the FL training process, which affects the performance and efficiency of the FL model in practical applications. Therefore, more researchers have paid attention to the challenges of FL and sought for various effective research methods to solve these current bottlenecks. And various research achievements of FL have been made to promote the intelligent development of all application areas with privacy restriction. This paper systematically introduces the current researches in FL from five aspects: the basics knowledge of FL, privacy and security protection mechanisms in FL, communication overhead challenges and heterogeneity problems of FL. Furthermore, we make a comprehensive summary of the research in practical applications and prospect the future research directions of FL.
联邦学习(FL)是一种安全的分布式机器学习范式,它解决了构建联合模型时的数据孤岛问题。其独特的分布式训练模式和安全聚合机制的优势非常适合各种有严格隐私要求的实际应用。然而,随着FL模式在实际应用中的部署,FL训练过程中出现了一些瓶颈,这影响了FL模型在实际应用中的性能和效率。因此,越来越多的研究人员关注FL的挑战,并寻求各种有效的研究方法来解决当前的这些瓶颈。并且已经取得了各种FL研究成果,以促进所有有隐私限制的应用领域的智能发展。本文从五个方面系统地介绍了FL的当前研究:FL的基础知识、FL中的隐私和安全保护机制、FL的通信开销挑战和异构性问题。此外,我们对实际应用中的研究进行了全面总结,并展望了FL未来的研究方向。