Arcolezi Héber Hwang, Couchot Jean-François, Renaud Denis, Al Bouna Bechara, Xiao Xiaokui
Inria and École Polytechnique (IPP), Palaiseau, France.
Femto-ST Institute, Univ. Bourg. Franche-Comté, UBFC, CNRS, Belfort, France.
Neural Comput Appl. 2022;34(16):13355-13369. doi: 10.1007/s00521-022-07393-0. Epub 2022 Jun 3.
This paper investigates the problem of forecasting multivariate aggregated human mobility while preserving the privacy of the individuals concerned. Differential privacy, a state-of-the-art formal notion, has been used as the privacy guarantee in two different and independent steps when training deep learning models. On one hand, we considered , which uses the differentially private stochastic gradient descent algorithm to guarantee the privacy of each time series sample in the learning stage. On the other hand, we considered , which adds differential privacy guarantees in each sample of the series before applying any learning. We compared four state-of-the-art recurrent neural networks: Long Short-Term Memory, Gated Recurrent Unit, and their Bidirectional architectures, i.e., Bidirectional-LSTM and Bidirectional-GRU. Extensive experiments were conducted with a real-world multivariate mobility dataset, which we published openly along with this paper. As shown in the results, differentially private deep learning models trained under gradient or input perturbation achieve nearly the same performance as non-private deep learning models, with loss in performance varying between and . The contribution of this paper is significant for those involved in urban planning and decision-making, providing a solution to the human mobility multivariate forecast problem through differentially private deep learning models.
本文研究了在保护相关个人隐私的同时预测多变量聚合人类移动性的问题。差分隐私是一种先进的形式化概念,在训练深度学习模型时,已在两个不同且独立的步骤中用作隐私保障。一方面,我们考虑了[具体内容缺失],它使用差分隐私随机梯度下降算法在学习阶段保障每个时间序列样本的隐私。另一方面,我们考虑了[具体内容缺失],它在应用任何学习之前,在序列的每个样本中添加差分隐私保障。我们比较了四种先进的循环神经网络:长短期记忆网络、门控循环单元及其双向架构,即双向长短期记忆网络和双向门控循环单元。我们使用一个真实世界的多变量移动性数据集进行了广泛实验,该数据集与本文一同公开发布。结果表明,在梯度或输入扰动下训练的差分隐私深度学习模型实现了与非隐私深度学习模型几乎相同的性能,性能损失在[具体范围缺失]之间变化。本文的贡献对于参与城市规划和决策的人员具有重要意义,通过差分隐私深度学习模型为人类移动性多变量预测问题提供了一种解决方案。