Gossip Learning of Personalized Models for Vehicle Trajectory Prediction

Gossip Learning (GL) is a peer-to-peer machine learning protocol based on direct, opportunistic exchange of models among nodes via wireless D2D communications, and on collaborative model training, which has recently proven to scale efficiently to large numbers of nodes, and to offer better privacy guarantees than traditional centralized learning architectures. Existing approaches to GL are however limited to scenarios in which nodes are static, or in which the node connectivity graph is fully connected, and they are fragile to node churn as well as to any change in network configuration. To overcome this limitation, we present a new decentralized architecture for GL suitable for setups with dynamic nodes, which benefits from node mobility instead of being hampered by it. In our approach, nodes improve their personalized model instance by sharing it with neighbors, and by weighting neighbors’ contributions according to an estimate of their marginal utility. We apply our GL algorithm to short-term vehicular trajectory estimation in realistic urban scenarios. We propose a new strategy for the estimation of the neighbors’ instances marginal utility, which yields satisfactory trajectory estimation accuracy for nodes with long enough sojourn times.

[1]  Ingmar Posner,et al.  Deep Tracking: Seeing Beyond Seeing Using Recurrent Neural Networks , 2016, AAAI.

[2]  Monica Nicoli,et al.  Federated Learning With Cooperating Devices: A Consensus Approach for Massive IoT Networks , 2019, IEEE Internet of Things Journal.

[3]  R. Stephenson A and V , 1962, The British journal of ophthalmology.

[4]  Jingyan Jiang,et al.  Decentralized Federated Learning: A Segmented Gossip Approach , 2019, ArXiv.

[5]  Florent Altché,et al.  An LSTM network for highway trajectory prediction , 2017, 2017 IEEE 20th International Conference on Intelligent Transportation Systems (ITSC).

[6]  Chung Choo Chung,et al.  Probabilistic vehicle trajectory prediction over occupancy grid map via recurrent neural network , 2017, 2017 IEEE 20th International Conference on Intelligent Transportation Systems (ITSC).

[7]  Mohammad Reza Nakhai,et al.  An Online Mirror-Prox Optimization Approach to Proactive Resource Allocation in MEC , 2020, ICC 2020 - 2020 IEEE International Conference on Communications (ICC).

[8]  Blaise Agüera y Arcas,et al.  Communication-Efficient Learning of Deep Networks from Decentralized Data , 2016, AISTATS.

[9]  Matthieu Cord,et al.  Gossip training for deep learning , 2016, ArXiv.

[10]  Carlo Luschi,et al.  Revisiting Small Batch Training for Deep Neural Networks , 2018, ArXiv.

[11]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[12]  W. Marsden I and J , 2012 .

[13]  Mathias Perrollaz,et al.  Learning-based approach for online lane change intention prediction , 2013, 2013 IEEE Intelligent Vehicles Symposium (IV).

[14]  Yoshua Bengio,et al.  Practical Recommendations for Gradient-Based Training of Deep Architectures , 2012, Neural Networks: Tricks of the Trade.

[15]  D. Cox The Regression Analysis of Binary Sequences , 1958 .

[16]  Vincenzo Mancuso,et al.  Modeling D2D communications with LTE and WiFi , 2014, PERV.

[17]  Hatem Ben Sta,et al.  Quality and the efficiency of data in "Smart-Cities" , 2017, Future Gener. Comput. Syst..

[18]  Nadeem Javaid,et al.  Intelligence in IoT-Based 5G Networks: Opportunities and Challenges , 2018, IEEE Communications Magazine.

[19]  Aurélien Géron,et al.  Hands-On Machine Learning with Scikit-Learn and TensorFlow: Concepts, Tools, and Techniques to Build Intelligent Systems , 2017 .

[20]  István Hegedüs,et al.  Gossip learning with linear models on fully distributed data , 2011, Concurr. Comput. Pract. Exp..

[21]  Aaas News,et al.  Book Reviews , 1893, Buffalo Medical and Surgical Journal.

[22]  Weihua Zhuang,et al.  Interworking of DSRC and Cellular Network Technologies for V2X Communications: A Survey , 2016, IEEE Transactions on Vehicular Technology.

[23]  Bin Cheng,et al.  Building a Big Data Platform for Smart Cities: Experience and Lessons from Santander , 2015, 2015 IEEE International Congress on Big Data.

[24]  Tim Kraska,et al.  MLbase: A Distributed Machine-learning System , 2013, CIDR.

[25]  Keqin Li,et al.  GOI: A Novel Design for Vehicle Positioning and Trajectory Prediction Under Urban Environments , 2018, IEEE Sensors Journal.

[26]  F. Borrelli,et al.  Stochastic Predictive Control of Autonomous Vehicles in Uncertain Environments , 2014 .