Predicting Human Mobility with Federated Learning

In recent years, location prediction has become an important task and has gained significant attention. Existing location prediction methods rely on centralized storage of user mobility data for model training, which may lead to privacy concerns and risks due to the privacy-sensitive nature of user behaviors. In this work, we propose a privacy-preserving method for mobility prediction model training based on federated learning, which can leverage the useful information in the behaviors of massive users to train accurate mobility prediction models and meanwhile remove the need to centralized storage of them. Firstly, we propose a novel network named STSAN (Spatial-Temporal Self-Attention Network) on each user device, which can integrate spatiotemporal information with the self-attention for location prediction and a new personalized federated learning model named AMF (Adaptive Model Fusion Federated Learning), which is a mixture of local and global model. Finally, the results are superior to various baselines on four real-world check-ins datasets, verifying the effectiveness of the method.

[1]  Cecilia Mascolo,et al.  Mining User Mobility Features for Next Place Prediction in Location-Based Services , 2012, 2012 IEEE 12th International Conference on Data Mining.

[2]  Farzin Haddadpour,et al.  On the Convergence of Local Descent Methods in Federated Learning , 2019, ArXiv.

[3]  Chang Zhou,et al.  ATRank: An Attention-Based User Behavior Modeling Framework for Recommendation , 2017, AAAI.

[4]  Gao Cong,et al.  An Experimental Evaluation of Point-of-interest Recommendation in Location-based Social Networks , 2017, Proc. VLDB Endow..

[5]  Luming Zhang,et al.  GMove: Group-Level Mobility Modeling Using Geo-Tagged Social Media , 2016, KDD.

[6]  Yoshua Bengio,et al.  Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling , 2014, ArXiv.

[7]  Tieniu Tan,et al.  Predicting the Next Location: A Recurrent Model with Spatial and Temporal Contexts , 2016, AAAI.

[8]  Fei Wu,et al.  HST-LSTM: A Hierarchical Spatial-Temporal Long-Short Term Memory Network for Location Prediction , 2018, IJCAI.

[9]  Blaise Agüera y Arcas,et al.  Communication-Efficient Learning of Deep Networks from Decentralized Data , 2016, AISTATS.

[10]  Chao Zhang,et al.  DeepMove: Predicting Human Mobility with Attentional Recurrent Networks , 2018, WWW.

[11]  Qiang Gao,et al.  Predicting Human Mobility via Variational Attention , 2019, WWW.

[12]  Jing Li,et al.  Predicting Activity and Location with Multi-task Context Aware Recurrent Neural Network , 2018, IJCAI.

[13]  Daqing Zhang,et al.  Modeling User Activity Preference by Leveraging User Spatial Temporal Characteristics in LBSNs , 2015, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[14]  Filip Hanzely,et al.  Federated Learning of a Mixture of Global and Local Models , 2020, ArXiv.

[15]  Anit Kumar Sahu,et al.  FedDANE: A Federated Newton-Type Method , 2019, 2019 53rd Asilomar Conference on Signals, Systems, and Computers.

[16]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[17]  Mehrdad Mahdavi,et al.  Adaptive Personalized Federated Learning , 2020, ArXiv.