Kumar Ajit, Singh Ankit Kumar, Ali Syed Saqib, Choi Bong Jun
School of Computer Science and Engineering, Soongsil University, Seoul 06978, Republic of Korea.
Sensors (Basel). 2023 Nov 25;23(23):9404. doi: 10.3390/s23239404.
The amalgamation of the Internet of Things (IoT) and federated learning (FL) is leading the next generation of data usage due to the possibility of deep learning with data privacy preservation. The FL architecture currently assumes labeled data samples from a client for supervised classification, which is unrealistic. Most research works in the literature focus on local training, update receiving, and global model updates. However, by principle, the labeling must be performed on the client side because the data samples cannot leave the source under the FL principle. In the literature, a few works have proposed methods for unlabeled data for FL using "class-prior probabilities" or "pseudo-labeling". However, these methods make either unrealistic or uncommon assumptions, such as knowing class-prior probabilities are impractical or unavailable for each classification task and even more challenging in the IoT ecosystem. Considering these limitations, we explored the possibility of performing federated learning with unlabeled data by providing a clustering-based method of labeling the sample before training or federation. The proposed work will be suitable for every type of classification task. We performed different experiments on the client by varying the labeled data ratio, the number of clusters, and the client participation ratio. We achieved accuracy rates of 87% and 90% by using 0.01 and 0.03 of the truth labels, respectively.
由于在保护数据隐私的同时进行深度学习具有可能性,物联网(IoT)与联邦学习(FL)的融合正引领着下一代数据使用方式。当前的联邦学习架构假设客户端有带标签的数据样本用于监督分类,这并不现实。文献中的大多数研究工作都集中在本地训练、更新接收和全局模型更新上。然而,从原则上讲,标签必须在客户端进行,因为根据联邦学习原则,数据样本不能离开其来源。在文献中,一些工作提出了使用“类先验概率”或“伪标签”对联邦学习的无标签数据进行处理的方法。然而,这些方法做出了不现实或不常见的假设,比如知道类先验概率对于每个分类任务来说不切实际或无法获取,在物联网生态系统中更是具有挑战性。考虑到这些局限性,我们通过提供一种在训练或联合之前对样本进行基于聚类的标记方法,探索了对无标签数据进行联邦学习的可能性。所提出的工作将适用于每种类型的分类任务。我们在客户端通过改变带标签数据比例、聚类数量和客户端参与比例进行了不同的实验。我们分别使用0.01和0.03的真实标签,实现了87%和90%的准确率。