Context-aware multi-modal traffic management in ITS: A Q-learning based algorithm

Multi-modal traffic management in Intelligent Transportation Systems (ITS) aims to provide a more efficient traffic regulation to passengers and reduce congestion and obstruction in the roads. In spite of the outstanding progress made in this research filed; traffic management still a very challenging problem regarding the multiple factors that have to be taken into account in any proposed solution. To tackle this problem, this paper introduces a collaborative model based context awareness multi-modal traffic management aiming at providing an efficient way to manage the traffic inside a transportation station. In this model (Multi-Layers Stations: the stations that have different intersections for different means of transport), the traffic management is based on a Q-learning technique that takes into account the context awareness parameters to provide more potent decisions. The learning technique offers the opportunity to the system (transportation station) to adapt dynamically its decision (choice of the best transportation mean) based on feedbacks provided by the passengers traveling from that specified station and thus optimize their journey through the transportation network. The efficacy of our proposed technique is validated through extensive simulations for different layers of transport means like metros, trains, and buses. Our proposal holds for any ITS system decisions provided the availability of real-time traces about the passengers passing by any station.

[1]  Monireh Abdoos,et al.  Traffic light control in non-stationary environments based on multi agent Q-learning , 2011, 2011 14th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[2]  Zhao Jin,et al.  Implementing traffic signal optimal control by multiagent reinforcement learning , 2011, Proceedings of 2011 International Conference on Computer Science and Network Technology.

[3]  Jesuk Ko,et al.  Towards automated road information framework - A case study of Tanzania , 2013, 2013 13th International Conference on Control, Automation and Systems (ICCAS 2013).

[4]  Vinny Cahill,et al.  Soilse: A decentralized approach to optimization of fluctuating urban traffic using Reinforcement Learning , 2010, 13th International IEEE Conference on Intelligent Transportation Systems.

[5]  Baher Abdulhai,et al.  Multi-Agent Reinforcement Learning for Integrated Network of Adaptive Traffic Signal Controllers (MARLIN-ATSC) , 2012, 2012 15th International IEEE Conference on Intelligent Transportation Systems.

[6]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .

[7]  Baher Abdulhai,et al.  An agent-based learning towards decentralized and coordinated traffic signal control , 2010, 13th International IEEE Conference on Intelligent Transportation Systems.

[8]  Derek Fagan,et al.  Intelligent time of arrival estimation , 2011, 2011 IEEE Forum on Integrated and Sustainable Transportation Systems.

[9]  Vinny Cahill,et al.  Distributed W-Learning: Multi-Policy Optimization in Self-Organizing Systems , 2009, 2009 Third IEEE International Conference on Self-Adaptive and Self-Organizing Systems.

[10]  Fei-Yue Wang,et al.  Data-Driven Intelligent Transportation Systems: A Survey , 2011, IEEE Transactions on Intelligent Transportation Systems.

[11]  Baher Abdulhai,et al.  Multiagent Reinforcement Learning for Integrated Network of Adaptive Traffic Signal Controllers (MARLIN-ATSC): Methodology and Large-Scale Application on Downtown Toronto , 2013, IEEE Transactions on Intelligent Transportation Systems.

[12]  Zhao Jin,et al.  Q-learning based multi-intersection traffic signal control model , 2011, 2011 International Conference on System science, Engineering design and Manufacturing informatization.

[13]  Vinny Cahill,et al.  Towards Delivering Context-Aware Transportation User Services , 2006, 2006 IEEE Intelligent Transportation Systems Conference.