Suppr超能文献

适应适应性:跨孤岛联邦学习的个性化学习

Adapt to Adaptation: Learning Personalization for Cross-Silo Federated Learning.

作者信息

Luo Jun, Wu Shandong

机构信息

Intelligent Systems Program, University of Pittsburgh.

Department of Radiology, University of Pittsburgh.

出版信息

IJCAI (U S). 2022 Jul;2022:2166-2173. doi: 10.24963/ijcai.2022/301.

Abstract

Conventional federated learning (FL) trains one global model for a federation of clients with decentralized data, reducing the privacy risk of centralized training. However, the distribution shift across non-IID datasets, often poses a challenge to this one-model-fits-all solution. Personalized FL aims to mitigate this issue systematically. In this work, we propose APPLE, a personalized cross-silo FL framework that adaptively learns how much each client can benefit from other clients' models. We also introduce a method to flexibly control the focus of training APPLE between global and local objectives. We empirically evaluate our method's convergence and generalization behaviors, and perform extensive experiments on two benchmark datasets and two medical imaging datasets under two non-IID settings. The results show that the proposed personalized FL framework, APPLE, achieves state-of-the-art performance compared to several other personalized FL approaches in the literature. The code is publicly available at https://github.com/ljaiverson/pFL-APPLE.

摘要

传统联邦学习(FL)为拥有分散数据的客户端联盟训练一个全局模型,降低了集中式训练的隐私风险。然而,非独立同分布(non-IID)数据集之间的分布偏移,常常给这种一刀切的解决方案带来挑战。个性化联邦学习旨在系统地缓解这一问题。在这项工作中,我们提出了APPLE,这是一个个性化的跨边缘设备联邦学习框架,它能自适应地学习每个客户端能从其他客户端模型中受益多少。我们还引入了一种方法,以灵活控制APPLE在全局目标和局部目标之间的训练重点。我们通过实验评估了我们方法的收敛性和泛化行为,并在两种非IID设置下,在两个基准数据集和两个医学成像数据集上进行了广泛实验。结果表明,与文献中的其他几种个性化联邦学习方法相比,所提出的个性化联邦学习框架APPLE取得了最优性能。代码可在https://github.com/ljaiverson/pFL-APPLE上公开获取。

相似文献

2
PGFed: Personalize Each Client's Global Objective for Federated Learning.PGFed:为联邦学习个性化每个客户端的全局目标。
Proc IEEE Int Conf Comput Vis. 2023 Oct;2023:3923-3933. doi: 10.1109/iccv51070.2023.00365. Epub 2024 Jan 15.
3
Federated Noisy Client Learning.联邦噪声客户端学习
IEEE Trans Neural Netw Learn Syst. 2025 Jan;36(1):1799-1812. doi: 10.1109/TNNLS.2023.3336050. Epub 2025 Jan 7.
4
FedTP: Federated Learning by Transformer Personalization.FedTP:基于Transformer个性化的联邦学习
IEEE Trans Neural Netw Learn Syst. 2024 Oct;35(10):13426-13440. doi: 10.1109/TNNLS.2023.3269062. Epub 2024 Oct 7.
7
Personalized Federated Few-Shot Learning.个性化联邦少样本学习
IEEE Trans Neural Netw Learn Syst. 2024 Feb;35(2):2534-2544. doi: 10.1109/TNNLS.2022.3190359. Epub 2024 Feb 5.

本文引用的文献

1
The future of digital health with federated learning.联合学习助力数字健康的未来。
NPJ Digit Med. 2020 Sep 14;3:119. doi: 10.1038/s41746-020-00323-1. eCollection 2020.

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验