Learning to Route via Theory-Guided Residual Network

The heavy traffic and related issues have always been concerns for modern cities. With the help of deep learning and reinforcement learning, people have proposed various policies to solve these traffic-related problems, such as smart traffic signal control systems and taxi dispatching systems. People usually validate these policies in a city simulator, since directly applying them in the real city introduces real cost. However, these policies validated in the city simulator may fail in the real city if the simulator is significantly different from the real world. To tackle this problem, we need to build a real-like traffic simulation system. Therefore, in this paper, we propose to learn the human routing model, which is one of the most essential part in the traffic simulator. This problem has two major challenges. First, human routing decisions are determined by multiple factors, besides the common time and distance factor. Second, current historical routes data usually covers just a small portion of vehicles, due to privacy and device availability issues. To address these problems, we propose a theory-guided residual network model, where the theoretical part can emphasize the general principles for human routing decisions (e.g., fastest route), and the residual part can capture drivable condition preferences (e.g., local road or highway). Since the theoretical part is composed of traditional shortest path algorithms that do not need data to train, our residual network can learn human routing models from limited data. We have conducted extensive experiments on multiple real-world datasets to show the superior performance of our model, especially with small data. Besides, we have also illustrated why our model is better at recovering real routes through case studies.

[1]  Anind K. Dey,et al.  Maximum Entropy Inverse Reinforcement Learning , 2008, AAAI.

[2]  Jean-Loup Farges,et al.  Optimization of traffic dynamic route guidance with drivers' reactions in a queue-based model , 1995, IEEE Trans. Syst. Man Cybern..

[3]  Jinlong Wu,et al.  Physics-informed machine learning approach for reconstructing Reynolds stress modeling discrepancies based on DNS data , 2016, 1606.07987.

[4]  Jie Cao,et al.  Pick-Up Tree Based Route Recommendation from Taxi Trajectories , 2012, WAIM.

[5]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[6]  Han Su,et al.  CrowdPlanner: A Crowd-Based Route Recommendation System , 2013, ArXiv.

[7]  Li Jie,et al.  Exploring Personalized Travel Route Using POIs , 2015 .

[8]  Yuhan Dong,et al.  Recommend a profitable cruising route for taxi drivers , 2014, 17th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[9]  Brett Browning,et al.  A survey of robot learning from demonstration , 2009, Robotics Auton. Syst..

[10]  Chelsea C. White,et al.  Optimal vehicle routing with real-time traffic information , 2005, IEEE Transactions on Intelligent Transportation Systems.

[11]  Hao Wu,et al.  R3: A Real-Time Route Recommendation System , 2014, Proc. VLDB Endow..

[12]  Pierre Baldi,et al.  Synergies Between Quantum Mechanics and Machine Learning in Reaction Prediction , 2016, J. Chem. Inf. Model..

[13]  Christian S. Jensen,et al.  Learning to Route with Sparse Trajectory Sets , 2018, 2018 IEEE 34th International Conference on Data Engineering (ICDE).

[14]  Shinsuke Nakajima,et al.  Route Recommendation Method Based on Driver's Intention Estimation Considering the Route Selection When Using the Car Navigation , 2014 .

[15]  Michael G.H. Bell Hyperstar: A multi-path Astar algorithm for risk averse vehicle navigation , 2009 .

[16]  Dongwoo Kim,et al.  PathRec: Visual Analysis of Travel Route Recommendations , 2017, RecSys.

[17]  Lin Zhang,et al.  One-month beijing taxi GPS trajectory dataset with taxi IDs and vehicle status , 2018, DATA@SenSys.

[18]  Xi Chen,et al.  Global Monitoring of Inland Water Dynamics: State-of-the-Art, Challenges, and Opportunities , 2016, Computational Sustainability.

[19]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[20]  James M. Rondinelli,et al.  Theory-Guided Machine Learning in Materials Science , 2016, Front. Mater..

[21]  Nagiza F. Samatova,et al.  Theory-Guided Data Science: A New Paradigm for Scientific Discovery from Data , 2016, IEEE Transactions on Knowledge and Data Engineering.

[22]  S. Parthasarathy,et al.  Automated Decision Tree Classification of Corneal Shape , 2005, Optometry and Vision Science.

[23]  Spyros Antonatos,et al.  Traffic Measurement and Route Recommendation System for Mass Rapid Transit (MRT) , 2015, KDD.

[24]  Jiajun Wu,et al.  Combining Physical Simulators and Object-Based Networks for Control , 2019, 2019 International Conference on Robotics and Automation (ICRA).

[25]  João Gama,et al.  Predicting Taxi–Passenger Demand Using Streaming Data , 2013, IEEE Transactions on Intelligent Transportation Systems.

[26]  Dietmar Bauer,et al.  Personalized and Situation-Aware Multimodal Route Recommendations: The FAVOUR Algorithm , 2016, IEEE Transactions on Intelligent Transportation Systems.

[27]  Yanmin Zhu,et al.  A Survey on Trajectory Data Mining: Techniques and Applications , 2016, IEEE Access.

[28]  Keith R. Matthews,et al.  Elementary Linear Algebra , 1998 .

[29]  H. Shimizu,et al.  A route guidance system of a traffic network , 1995, SICE '95. Proceedings of the 34th SICE Annual Conference. International Session Papers.

[30]  Zihan Zhou,et al.  CityFlow: A Multi-Agent Reinforcement Learning Environment for Large Scale City Traffic Scenario , 2019, WWW.

[31]  Gerbrand Ceder,et al.  Predicting crystal structure by merging data mining with quantum mechanics , 2006, Nature materials.

[32]  Ge Cui,et al.  Profitable Taxi Travel Route Recommendation Based on Big Taxi Trajectory Data , 2020, IEEE Transactions on Intelligent Transportation Systems.

[33]  Anuj Karpatne,et al.  BHPMF – a hierarchical Bayesian approach to gap-filling and trait prediction for macroecology and functional biogeography , 2015 .

[34]  Shinsuke Nakajima,et al.  Route recommendation method for car navigation system based on estimation of driver's intent , 2012, 2012 IEEE International Conference on Vehicular Electronics and Safety (ICVES 2012).

[35]  G. Evensen Data Assimilation: The Ensemble Kalman Filter , 2006 .

[36]  Dhanashri Mali Survey on Travel Recommendation Using POI of User , 2018 .

[37]  Jun Fang,et al.  Context-aware Route Recommendation with Weight Learning through Deep Neural Networks , 2020, 2020 American Control Conference (ACC).

[38]  Jian Dai,et al.  Personalized route recommendation using big trajectory data , 2015, 2015 IEEE 31st International Conference on Data Engineering.

[39]  Seung-won Hwang,et al.  Efficient Keyword-Aware Representative Travel Route Recommendation , 2017, IEEE Transactions on Knowledge and Data Engineering.

[40]  Lihong Li,et al.  An Empirical Evaluation of Thompson Sampling , 2011, NIPS.

[41]  Richard Werner Nelem Pazzi,et al.  Context-Aware Vehicle Route Recommendation Platform: Exploring Open and Crowdsourced Data , 2018, 2018 IEEE International Conference on Communications (ICC).

[42]  Tianqi Chen,et al.  XGBoost: A Scalable Tree Boosting System , 2016, KDD.