Qin Zixuan, Yang Liu, Gao Fei, Hu Qinghua, Shen Chenyang
IEEE Trans Neural Netw Learn Syst. 2024 Jun;35(6):7548-7562. doi: 10.1109/TNNLS.2022.3214930. Epub 2024 Jun 3.
Open set domain adaptation (OSDA) methods have been proposed to leverage the difference between the source and target domains, as well as to recognize the known and unknown classes in the target domain. Such methods typically require the entire source and target data simultaneously to train the target model. However, in real scenarios, data are distributed and stored in various clients. They cannot be exchanged among clients because of privacy protection. Federated learning (FL) is a decentralized approach for training an effective global model with the training data distributed among the clients. Despite its potential in addressing the privacy concerns of data sharing, FL methods for OSDA that can handle unknown classes is not yet available. To tackle this problem, we have developed a novel federated OSDA (FOSDA) algorithm. More specifically, FOSDA adopts an uncertainty-aware mechanism to generate a global model from all client models. It reduces the uncertainty of the federated aggregation by focusing on the contribution of source clients with high uncertainty while retaining those with high consistency. Moreover, a federated class-based weighted strategy is also implemented in FOSDA to maintain the category information of the source clients. We have conducted comprehensive experiments on three benchmark datasets to evaluate the performance of the proposed method, and the results demonstrate the effectiveness of FOSDA.
开放集域适应(OSDA)方法已被提出,以利用源域和目标域之间的差异,以及识别目标域中的已知和未知类别。此类方法通常需要同时使用整个源数据和目标数据来训练目标模型。然而,在实际场景中,数据分布并存储在各个客户端。由于隐私保护,它们无法在客户端之间交换。联邦学习(FL)是一种分散式方法,用于利用分布在客户端的训练数据训练有效的全局模型。尽管FL在解决数据共享的隐私问题方面具有潜力,但尚未有可处理未知类别的用于OSDA的FL方法。为了解决这个问题,我们开发了一种新颖的联邦OSDA(FOSDA)算法。更具体地说,FOSDA采用一种不确定性感知机制,从所有客户端模型生成一个全局模型。它通过关注具有高不确定性的源客户端的贡献,同时保留具有高一致性的客户端,来降低联邦聚合的不确定性。此外,FOSDA还实施了一种基于联邦类别的加权策略,以维护源客户端的类别信息。我们在三个基准数据集上进行了全面实验,以评估所提出方法的性能,结果证明了FOSDA的有效性。