Solving periodic timetabling problems with SAT and machine learning

In this research work we address periodic timetabling, namely the optimisation of public transport timetables with respect to travel time using Boolean Satisfiability Problem (SAT) and reinforcement learning approaches. Some works already done in the field of railway timetabling propose solutions to the optimisation problem using Mixed Integer Linear Programming (MILP), genetic algorithms, SAT, the modulo network simplex, among other techniques. In this work, we propose a novel approach based on reinforcement learning and multiagents which also uses a SAT solver to get optimised solutions with respect to the travel time, a combination of techniques which (to our knowledge) has never been applied in this field. Finally, we present promising results which show that our approach applied to real world data performs better than existing SAT approaches and even outperforms the current state-of-the-art algorithms (based on the modulo network simplex, mixed integer programming and heuristics) on some problems.

[1]  Ricardo L. Saldanha,et al.  Optimisation of Periodic Train Timetables , 2018 .

[2]  Anita Schöbel,et al.  Integrating Passengers' Routes in Periodic Timetabling: A SAT approach , 2016, ATMOS.

[3]  Peter Auer,et al.  Finite-time Analysis of the Multiarmed Bandit Problem , 2002, Machine Learning.

[4]  Karl Nachtigall,et al.  A genetic algorithm approach to periodic railway synchronization , 1996, Comput. Oper. Res..

[5]  Peter Dayan,et al.  Technical Note: Q-Learning , 2004, Machine Learning.

[6]  Christian Liebchen,et al.  An Improved Algorithm for the Periodic Timetabling Problem , 2017, ATMOS.

[7]  Peter Dayan,et al.  Q-learning , 1992, Machine Learning.

[8]  Vasco M. Manquinho,et al.  Open-WBO: A Modular MaxSAT Solver, , 2014, SAT.

[9]  Christian Liebchen,et al.  The First Optimized Railway Timetable in Practice , 2008, Transp. Sci..

[10]  Peter Steinke,et al.  Polynomial Reduction from PESP to SAT , 2011 .

[11]  Ernesto M. Morgado,et al.  Optimising Cyclic Timetables with a SAT Approach - EPIA 2017 , 2017, EPIA.

[12]  K. Nachtigall,et al.  Minimizing waiting times in integrated fixed interval timetables by upgrading railway tracks , 1997 .

[13]  Longxin Lin Self-Improving Reactive Agents Based on Reinforcement Learning, Planning and Teaching , 2004, Machine Learning.

[14]  Karl Nachtigall,et al.  A state-of-the-art realization of cyclic railway timetable computation , 2015, Public Transp..

[15]  Miguel A. Salido,et al.  New Heuristics to Solve the "CSOP" Railway Timetabling Problem , 2006, IEA/AIE.

[16]  Walter Ukovich,et al.  A Mathematical Model for Periodic Scheduling Problems , 1989, SIAM J. Discret. Math..

[17]  Anita Schöbel,et al.  Improving the modulo simplex algorithm for large-scale periodic timetabling , 2013, Comput. Oper. Res..

[18]  K. Nachtigall,et al.  Solving Public Railway Transport Networks with SAT , 2011 .

[19]  Christian Liebchen,et al.  Periodic Timetable Optimization in Public Transport , 2006, OR.

[20]  Stephen A. Cook,et al.  The complexity of theorem-proving procedures , 1971, STOC.

[21]  Steffen Hölldobler,et al.  Solving Periodic Event Scheduling Problems with SAT , 2012, IEA/AIE.

[22]  K. Nachtigall,et al.  AUTOMATED GENERATION AND OPTIMIZATION OF PUBLIC RAILWAY AND RAIL FREIGHT TRANSPORT TIME TABLES , 2012 .

[23]  Sharad Malik,et al.  On Solving the Partial MAX-SAT Problem , 2006, SAT.

[24]  Leon W P Peeters,et al.  Cyclic Railway Timetable Optimization , 2003 .

[25]  Rolf H. Möhring,et al.  The modeling power of the periodic event scheduling problem: railway timetables-and beyond , 2004 .

[26]  Long-Ji Lin,et al.  Reinforcement learning for robots using neural networks , 1992 .

[27]  Dennis Huisman,et al.  The New Dutch Timetable: The OR Revolution , 2008, Interfaces.