Suppr超能文献

激励模型共享市场中的包容性贡献。

Incentivizing inclusive contributions in model sharing markets.

作者信息

Zhang Enpei, Chai Jingyi, Ye Rui, Wang Yanfeng, Chen Siheng

机构信息

Cooperative Medianet Innovation Center, Shanghai Jiao Tong University, Shanghai, China.

School of Artificial Intelligence, Shanghai Jiao Tong University, Shanghai, China.

出版信息

Nat Commun. 2025 Aug 25;16(1):7923. doi: 10.1038/s41467-025-62959-5.

Abstract

Data plays a crucial role in training contemporary AI models, but much of the available public data will be exhausted in a few years, directing the world's attention toward the massive decentralized private data. However, the privacy-sensitive nature of raw data and lack of incentive mechanism prevent these valuable data from being fully exploited. Here we propose inclusive and incentivized personalized federated learning (iPFL), which incentivizes data holders with diverse purposes to collaboratively train personalized models without revealing raw data. iPFL constructs a model-sharing market by solving a graph-based training optimization and incorporates an incentive mechanism based on game theory principles. Theoretical analysis shows that iPFL adheres to two key incentive properties: individual rationality and Incentive compatibility. Empirical studies on eleven AI tasks (e.g., large language models' instruction-following tasks) demonstrate that iPFL consistently achieves the highest economic utility, and better or comparable model performance compared to baseline methods.

摘要

数据在训练当代人工智能模型中起着至关重要的作用,但现有的许多公共数据将在几年内耗尽,这使得全球的注意力转向了大量分散的私人数据。然而,原始数据对隐私敏感的特性以及缺乏激励机制,阻碍了这些宝贵数据的充分利用。在此,我们提出了包容性和激励性的个性化联邦学习(iPFL),它激励具有不同目的的数据持有者在不泄露原始数据的情况下协作训练个性化模型。iPFL通过解决基于图的训练优化问题构建了一个模型共享市场,并纳入了基于博弈论原则的激励机制。理论分析表明,iPFL具有两个关键的激励特性:个体理性和激励相容性。对十一项人工智能任务(例如,大语言模型的指令跟随任务)的实证研究表明,iPFL始终能实现最高的经济效用,并且与基线方法相比,模型性能更好或相当。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/8816/12379655/23f137176526/41467_2025_62959_Fig1_HTML.jpg

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验