Federated Representation Learning With Data Heterogeneity for Human Mobility Prediction

The advancement of smart wearable devices and location-based smart services has enabled a new paradigm for smart human mobility prediction (HMP), which has a broad range of applications in smart healthcare and smart cities. Due to the privacy concerns and rigorous data regulations, federated learning provides a distributed learning framework to collaboratively train the HMP model without sharing the highly sensitive location data with others. However, in real-world scenarios, federated human mobility prediction suffers from data heterogeneity challenge, which includes two main aspects: heterogeneity mobility patterns, and data scarcity. In this paper, we propose an end-to-end federated representation learning framework for human mobility prediction, named FR-HMP, to overcome all the above obstacles. Specially, in order to enhance the representation abilities of data-scarcity clients, a two-phase learning process is proposed. The clustering module could cluster similar clients together on the parameter server to address the heterogeneous mobility patterns, and the representation learning module learns the enhanced representations of each client through the graph learning layer and graph convolution layer on the third-part server. Finally, extensive experiments are conducted using two diverse real-world HMP datasets to show the advantages of FR-HMP over state-of-the-art methods.

[1]  Fuzhen Zhuang,et al.  FedHAR: Semi-Supervised Online Learning for Personalized Federated Human Activity Recognition , 2023, IEEE Transactions on Mobile Computing.

[2]  Chuan Zhou,et al.  Predicting Human Mobility via Graph Convolutional Dual-attentive Networks , 2022, WSDM.

[3]  Xiuzhen Cheng,et al.  Learning Graph Structures With Transformer for Multivariate Time-Series Anomaly Detection in IoT , 2021, IEEE Internet of Things Journal.

[4]  Chuhan Wu,et al.  A federated graph neural network framework for privacy-preserving personalization , 2021, Nature Communications.

[5]  Hui Xiong,et al.  Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecasting , 2020, AAAI.

[6]  Anliang Li,et al.  Predicting Human Mobility with Federated Learning , 2020, SIGSPATIAL/GIS.

[7]  Paolo Rosso,et al.  Location Prediction over Sparse User Mobility Traces Using RNNs: Flashback in Hidden States! , 2020, IJCAI.

[8]  Luca Pappalardo,et al.  Measuring objective and subjective well-being: dimensions and data sources , 2020, International Journal of Data Science and Analytics.

[9]  Nguyen H. Tran,et al.  Personalized Federated Learning with Moreau Envelopes , 2020, NeurIPS.

[10]  Xiaojun Chang,et al.  Connecting the Dots: Multivariate Time Series Forecasting with Graph Neural Networks , 2020, KDD.

[11]  Yong Li,et al.  PMF: A Privacy-preserving Human Mobility Prediction Framework via Federated Learning , 2020 .

[12]  Xiao-Yong Yan,et al.  A universal opportunity model for human mobility , 2020, Scientific Reports.

[13]  Yang Liu,et al.  Federated Learning , 2019, Synthesis Lectures on Artificial Intelligence and Machine Learning.

[14]  Ryosuke Shibasaki,et al.  Decentralized Attention-based Personalized Human Mobility Prediction , 2019, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[15]  Sunav Choudhary,et al.  Federated Learning with Personalization Layers , 2019, ArXiv.

[16]  Haoran Feng,et al.  A Survey of Hybrid Deep Learning Methods for Traffic Flow Prediction , 2019, ICAIP.

[17]  Wojciech Samek,et al.  Clustered Federated Learning: Model-Agnostic Distributed Multitask Optimization Under Privacy Constraints , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[18]  Ramesh Raskar,et al.  Detailed comparison of communication efficiency of split learning and federated learning , 2019, ArXiv.

[19]  Anit Kumar Sahu,et al.  Federated Learning: Challenges, Methods, and Future Directions , 2019, IEEE Signal Processing Magazine.

[20]  Anit Kumar Sahu,et al.  Federated Optimization in Heterogeneous Networks , 2018, MLSys.

[21]  Yue Zhao,et al.  Federated Learning with Non-IID Data , 2018, ArXiv.

[22]  Chao Zhang,et al.  DeepMove: Predicting Human Mobility with Attentional Recurrent Networks , 2018, WWW.

[23]  Xuan Song,et al.  Deep ROI-Based Modeling for Urban Human Mobility Prediction , 2018, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[24]  Zhongwei Si,et al.  A hybrid Markov-based model for human mobility prediction , 2018, Neurocomputing.

[25]  Abhinav Mehrotra,et al.  Are you getting sick? Predicting influenza-like symptoms using human mobility behaviors , 2017, EPJ Data Science.

[26]  Lukasz Kaiser,et al.  Attention is All you Need , 2017, NIPS.

[27]  Aixin Sun,et al.  A Survey of Location Prediction on Twitter , 2017, IEEE Transactions on Knowledge and Data Engineering.

[28]  Max Welling,et al.  Semi-Supervised Classification with Graph Convolutional Networks , 2016, ICLR.

[29]  Blaise Agüera y Arcas,et al.  Communication-Efficient Learning of Deep Networks from Decentralized Data , 2016, AISTATS.

[30]  Wen-Chih Peng,et al.  Modeling User Mobility for Location Promotion in Location-based Social Networks , 2015, KDD.

[31]  Daniel Gatica-Perez,et al.  A probabilistic kernel method for human mobility prediction with smartphones , 2015, Pervasive Mob. Comput..

[32]  Quoc V. Le,et al.  Sequence to Sequence Learning with Neural Networks , 2014, NIPS.

[33]  Daniel Gatica-Perez,et al.  Contextual conditional models for smartphone-based human mobility prediction , 2012, UbiComp.

[34]  Zhaohui Wu,et al.  Prediction of urban human mobility using large-scale taxi traces and its applications , 2012, Frontiers of Computer Science.

[35]  S. Hochreiter,et al.  Long Short-Term Memory , 1997, Neural Computation.

[36]  Jan Philipp Albrecht,et al.  How the GDPR Will Change the World , 2016 .