Safe and Time-Optimal Control for Railway Games

Railway scheduling is a complex and safety critical problem that has recently attracted attention in the formal verification community. We provide a formal model of railway scheduling as a stochastic timed game and using the tool Uppaal Stratego, we synthesise the most permissive control strategy for operating the lights and points at the railway scenario such that we guarantee system’s safety (avoidance of train collisions). Among all such safe strategies, we then select (with the help of reinforcement learning) a concrete strategy that minimizes the time needed to move all trains to their target locations. This optimizes the speed and capacity of a railway system and advances the current state-of-the-art where the optimality criteria were not considered yet. We successfully demonstrate our approach on the models of two Danish railway stations, and discuss the applicability and scalability of our approach.

[1]  Kim G. Larsen,et al.  Uppaal Stratego , 2015, TACAS.

[2]  Michael R. Hansen,et al.  Synthesis of Railway-Signaling Plans using Reachability Games , 2016, IFL 2016.

[3]  Anne Elisabeth Haxthausen Automated generation of formal safety conditions from railway interlocking tables , 2013, International Journal on Software Tools for Technology Transfer.

[4]  Kim G. Larsen,et al.  A Tutorial on Uppaal , 2004, SFM.

[5]  Rajeev Alur,et al.  A Theory of Timed Automata , 1994, Theor. Comput. Sci..

[6]  Fausto Giunchiglia,et al.  Formal Verification of a Railway Interlocking System using Model Checking , 1998, Formal Aspects of Computing.

[7]  Marco Muñiz,et al.  Uppaal Stratego for Intelligent Traffic Lights , 2017 .

[8]  Jakob Lyng Petersen,et al.  Automatic verification of railway interlocking systems: a case study , 1998, FMSP '98.

[9]  Kim G. Larsen,et al.  Uppaal SMC tutorial , 2015, International Journal on Software Tools for Technology Transfer.

[10]  Kim G. Larsen,et al.  Safe and Optimal Adaptive Cruise Control , 2015, Correct System Design.

[11]  Y.Y. Nazaruddin,et al.  Model Checking-based Safety Verification of a Petri Net Representation of Train Interlocking Systems , 2018, 2018 57th Annual Conference of the Society of Instrument and Control Engineers of Japan (SICE).

[12]  Peter Dayan,et al.  Technical Note: Q-Learning , 2004, Machine Learning.

[13]  Kirsten Winter,et al.  Model Checking Railway Interlocking Systems , 2002, ACSC.

[14]  Alessandro Giua,et al.  Modeling and Supervisory Control of Railway Networks Using Petri Nets , 2008, IEEE Transactions on Automation Science and Engineering.