Kurniawan Hendra, Mambo Masahiro
Graduate School of Natural Science and Technology, Kanazawa University, Kanazawa 920-1192, Japan.
Institute of Science and Engineering, Kanazawa University, Kanazawa 920-1192, Japan.
Entropy (Basel). 2022 Oct 27;24(11):1545. doi: 10.3390/e24111545.
Active learning is a technique for maximizing performance of machine learning with minimal labeling effort and letting the machine automatically and adaptively select the most informative data for labeling. Since the labels on records may contain sensitive information, privacy-preserving mechanisms should be integrated into active learning. We propose a privacy-preservation scheme for active learning using homomorphic encryption-based federated learning. Federated learning provides distributed computation from multiple clients, and homomorphic encryption enhances the privacy preservation of user data with a strong security level. The experimental result shows that the proposed homomorphic encryption-based federated learning scheme can preserve privacy in active learning while maintaining model accuracy. Furthermore, we also provide a Deep Leakage Gradient comparison. The proposed scheme has no gradient leakage compared to the related schemes that have more than 74% gradient leakage.
主动学习是一种通过最小化标注工作量来最大化机器学习性能,并让机器自动且自适应地选择最具信息性的数据进行标注的技术。由于记录上的标签可能包含敏感信息,因此应将隐私保护机制集成到主动学习中。我们提出了一种使用基于同态加密的联邦学习的主动学习隐私保护方案。联邦学习提供来自多个客户端的分布式计算,同态加密以高安全级别增强了用户数据的隐私保护。实验结果表明,所提出的基于同态加密的联邦学习方案能够在主动学习中保护隐私,同时保持模型准确性。此外,我们还提供了深度泄漏梯度比较。与梯度泄漏超过74%的相关方案相比,所提出的方案没有梯度泄漏。