• 文献检索
  • 文档翻译
  • 深度研究
  • 学术资讯
  • Suppr Zotero 插件Zotero 插件
  • 邀请有礼
  • 套餐&价格
  • 历史记录
应用&插件
Suppr Zotero 插件Zotero 插件浏览器插件Mac 客户端Windows 客户端微信小程序
定价
高级版会员购买积分包购买API积分包
服务
文献检索文档翻译深度研究API 文档MCP 服务
关于我们
关于 Suppr公司介绍联系我们用户协议隐私条款
关注我们

Suppr 超能文献

核心技术专利:CN118964589B侵权必究
粤ICP备2023148730 号-1Suppr @ 2026

文献检索

告别复杂PubMed语法,用中文像聊天一样搜索,搜遍4000万医学文献。AI智能推荐,让科研检索更轻松。

立即免费搜索

文件翻译

保留排版,准确专业,支持PDF/Word/PPT等文件格式,支持 12+语言互译。

免费翻译文档

深度研究

AI帮你快速写综述,25分钟生成高质量综述,智能提取关键信息,辅助科研写作。

立即免费体验

扩展与收缩:使用聚类的无标签数据联邦学习

Expand and Shrink: Federated Learning with Unlabeled Data Using Clustering.

作者信息

Kumar Ajit, Singh Ankit Kumar, Ali Syed Saqib, Choi Bong Jun

机构信息

School of Computer Science and Engineering, Soongsil University, Seoul 06978, Republic of Korea.

出版信息

Sensors (Basel). 2023 Nov 25;23(23):9404. doi: 10.3390/s23239404.

DOI:10.3390/s23239404
PMID:38067775
原文链接:https://pmc.ncbi.nlm.nih.gov/articles/PMC10708646/
Abstract

The amalgamation of the Internet of Things (IoT) and federated learning (FL) is leading the next generation of data usage due to the possibility of deep learning with data privacy preservation. The FL architecture currently assumes labeled data samples from a client for supervised classification, which is unrealistic. Most research works in the literature focus on local training, update receiving, and global model updates. However, by principle, the labeling must be performed on the client side because the data samples cannot leave the source under the FL principle. In the literature, a few works have proposed methods for unlabeled data for FL using "class-prior probabilities" or "pseudo-labeling". However, these methods make either unrealistic or uncommon assumptions, such as knowing class-prior probabilities are impractical or unavailable for each classification task and even more challenging in the IoT ecosystem. Considering these limitations, we explored the possibility of performing federated learning with unlabeled data by providing a clustering-based method of labeling the sample before training or federation. The proposed work will be suitable for every type of classification task. We performed different experiments on the client by varying the labeled data ratio, the number of clusters, and the client participation ratio. We achieved accuracy rates of 87% and 90% by using 0.01 and 0.03 of the truth labels, respectively.

摘要

由于在保护数据隐私的同时进行深度学习具有可能性,物联网(IoT)与联邦学习(FL)的融合正引领着下一代数据使用方式。当前的联邦学习架构假设客户端有带标签的数据样本用于监督分类,这并不现实。文献中的大多数研究工作都集中在本地训练、更新接收和全局模型更新上。然而,从原则上讲,标签必须在客户端进行,因为根据联邦学习原则,数据样本不能离开其来源。在文献中,一些工作提出了使用“类先验概率”或“伪标签”对联邦学习的无标签数据进行处理的方法。然而,这些方法做出了不现实或不常见的假设,比如知道类先验概率对于每个分类任务来说不切实际或无法获取,在物联网生态系统中更是具有挑战性。考虑到这些局限性,我们通过提供一种在训练或联合之前对样本进行基于聚类的标记方法,探索了对无标签数据进行联邦学习的可能性。所提出的工作将适用于每种类型的分类任务。我们在客户端通过改变带标签数据比例、聚类数量和客户端参与比例进行了不同的实验。我们分别使用0.01和0.03的真实标签,实现了87%和90%的准确率。

https://cdn.ncbi.nlm.nih.gov/pmc/blobs/5c83/10708646/9cb73bf5f881/sensors-23-09404-g009.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/5c83/10708646/71289a65bac1/sensors-23-09404-g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/5c83/10708646/2ac597c10357/sensors-23-09404-g002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/5c83/10708646/5af06f5b160e/sensors-23-09404-g003a.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/5c83/10708646/8f3d7c31e953/sensors-23-09404-g004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/5c83/10708646/aa0a79d43426/sensors-23-09404-g005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/5c83/10708646/b0f9df03b62b/sensors-23-09404-g006.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/5c83/10708646/d596d0f263ec/sensors-23-09404-g007.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/5c83/10708646/00e8c637c2b5/sensors-23-09404-g008.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/5c83/10708646/9cb73bf5f881/sensors-23-09404-g009.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/5c83/10708646/71289a65bac1/sensors-23-09404-g001.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/5c83/10708646/2ac597c10357/sensors-23-09404-g002.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/5c83/10708646/5af06f5b160e/sensors-23-09404-g003a.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/5c83/10708646/8f3d7c31e953/sensors-23-09404-g004.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/5c83/10708646/aa0a79d43426/sensors-23-09404-g005.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/5c83/10708646/b0f9df03b62b/sensors-23-09404-g006.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/5c83/10708646/d596d0f263ec/sensors-23-09404-g007.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/5c83/10708646/00e8c637c2b5/sensors-23-09404-g008.jpg
https://cdn.ncbi.nlm.nih.gov/pmc/blobs/5c83/10708646/9cb73bf5f881/sensors-23-09404-g009.jpg

相似文献

1
Expand and Shrink: Federated Learning with Unlabeled Data Using Clustering.扩展与收缩:使用聚类的无标签数据联邦学习
Sensors (Basel). 2023 Nov 25;23(23):9404. doi: 10.3390/s23239404.
2
Contrastive encoder pre-training-based clustered federated learning for heterogeneous data.基于对比编码器预训练的聚类联邦学习用于异构数据。
Neural Netw. 2023 Aug;165:689-704. doi: 10.1016/j.neunet.2023.06.010. Epub 2023 Jun 10.
3
Dynamic Semi-Supervised Federated Learning Fault Diagnosis Method Based on an Attention Mechanism.基于注意力机制的动态半监督联邦学习故障诊断方法
Entropy (Basel). 2023 Oct 21;25(10):1470. doi: 10.3390/e25101470.
4
PSA-FL-CDM: A Novel Federated Learning-Based Consensus Model for Post-Stroke Assessment.PSA-FL-CDM:一种基于联邦学习的新型脑卒中评估共识模型。
Sensors (Basel). 2024 Aug 6;24(16):5095. doi: 10.3390/s24165095.
5
Extension of physical activity recognition with 3D CNN using encrypted multiple sensory data to federated learning based on multi-key homomorphic encryption.基于多密钥同态加密的联邦学习,利用加密多源传感器数据的 3D CNN 扩展身体活动识别。
Comput Methods Programs Biomed. 2024 Jan;243:107854. doi: 10.1016/j.cmpb.2023.107854. Epub 2023 Oct 16.
6
Boosted federated learning based on improved Particle Swarm Optimization for healthcare IoT devices.基于改进粒子群优化算法的联邦学习在医疗保健物联网设备中的应用。
Comput Biol Med. 2023 Sep;163:107195. doi: 10.1016/j.compbiomed.2023.107195. Epub 2023 Jun 22.
7
A Comprehensive Overview of IoT-Based Federated Learning: Focusing on Client Selection Methods.基于物联网的联邦学习综述:聚焦客户端选择方法
Sensors (Basel). 2023 Aug 17;23(16):7235. doi: 10.3390/s23167235.
8
Personalized Federated Learning Algorithm with Adaptive Clustering for Non-IID IoT Data Incorporating Multi-Task Learning and Neural Network Model Characteristics.具有自适应聚类的个性化联邦学习算法,用于融合多任务学习和神经网络模型特征的非独立同分布物联网数据
Sensors (Basel). 2023 Nov 7;23(22):9016. doi: 10.3390/s23229016.
9
FedDdrl: Federated Double Deep Reinforcement Learning for Heterogeneous IoT with Adaptive Early Client Termination and Local Epoch Adjustment.FedDdrl:具有自适应早期客户端终止和本地 epoch 调整的异构物联网联邦双深度强化学习。
Sensors (Basel). 2023 Feb 23;23(5):2494. doi: 10.3390/s23052494.
10
Semi Supervised Learning with Deep Embedded Clustering for Image Classification and Segmentation.用于图像分类和分割的深度嵌入聚类半监督学习
IEEE Access. 2019;7:11093-11104. doi: 10.1109/ACCESS.2019.2891970. Epub 2019 Jan 9.

本文引用的文献

1
Label-Efficient Self-Supervised Federated Learning for Tackling Data Heterogeneity in Medical Imaging.基于标签高效的自监督联邦学习的医学影像数据异质性处理方法。
IEEE Trans Med Imaging. 2023 Jul;42(7):1932-1943. doi: 10.1109/TMI.2022.3233574. Epub 2023 Jun 30.
2
Federated learning: a collaborative effort to achieve better medical imaging models for individual sites that have small labelled datasets.联邦学习:为拥有少量标注数据集的各个站点构建更好的医学成像模型而进行的协作努力。
Quant Imaging Med Surg. 2021 Feb;11(2):852-857. doi: 10.21037/qims-20-595.