Dynamic delay management at railways: a Semi-Markovian Decision approach

At railways the capacity is scarce. An increasing demand challenges policy makers to think of innovative ways in which the current infrastructure might be used. The Program for High-Frequency Railway Transport (in Dutch: Programma Hoogfrequent Spoorvervoer), which has been launched recently by the Dutch government, is an example of such innovative movement. This program sets aside the traditional timetables, which characterize the railways nowadays, and paves the way for timetable-free railway operation. This new approach will result in a dynamic environment which requires conflict resolution methods that are dynamic and robust. But even in today’s railway system, the need for such resolution methods is evident. This thesis presents an innovative approach based on the theory of the Semi-Markovian Decision Processes and examines its potential as a dynamic delay management mechanism. The approach is compared to the resolution method used nowadays by ProRail (the Dutch railway infrastructure manager) and to a number of other heuristics. The research presented in this thesis shows promising results that reveal the potential of the approach.

[1]  Jan A. Persson,et al.  Train Traffic Deviation Handling Using Tabu Search and Simulated Annealing , 2005, Proceedings of the 38th Annual Hawaii International Conference on System Sciences.

[2]  Paolo Toth,et al.  A Lagrangian heuristic algorithm for a real-world train timetabling problem , 2006, Discret. Appl. Math..

[3]  Yu Cheng.  Hybrid simulation for resolving resource conflict in train traffic rescheduling , 1998 .

[4]  Joaquin Rodriguez,et al.  A constraint programming model for real-time train scheduling at junctions , 2007 .

[5]  T. Daniëls.  Rationalised Panics. The Consequences of Strategic Uncertainty during Financial Crises , 2004 .

[6]  Jacques Desrosiers,et al.  AN OPTIMIZATION MODEL FOR A REAL-TIME FLIGHT SCHEDULING PROBLEM , 2002 .

[7]  Ahmed F. Abdelghany,et al.  An integrated decision support tool for airlines schedule recovery during irregular operations , 2008, Eur. J. Oper. Res..

[8]  Richard J. Boucherie,et al.  Running times on railway sections with heterogeneous train traffic , 1998 .

[9]  Dirk Van Oudheusden,et al.  Developing railway timetables which guarantee a better service , 2004, Eur. J. Oper. Res..

[10]  Malachy Carey,et al.  Extending a train pathing model from one-way to two-way track , 1994 .

[11]  Leo G. Kroon,et al.  Routing Trains Through Railway Stations: Model Formulation and Algorithms , 1996, Transp. Sci..

[12]  Richard J. Anderson,et al.  An international comparison of urban rail boarding and alighting rates , 2007 .

[13]  Dennis Huisman,et al.  Solving Large Scale Crew Scheduling Problems by using Iterative Partitioning , 2008, ATMOS.

[14]  Ennio Ottaviani,et al.  A Traffic Management System for Real-time Traffic Optimisation in Railways , 2007 .

[15]  S Savio,et al.  THE EUROPEAN PROJECT COMBINE 2 TO IMPROVE KNOWLEDGE ON FUTURE RAIL TRAFFIC MANAGEMENT SYSTEMS , 2004 .

[16]  A. D. Middelkoop,et al.  Simulation Of Traffic Management With FRISO , 2006 .

[17]  Ho-fung Leung,et al.  A Constraint-Based Interactive Train Rescheduling Tool , 1996, Constraints.

[18]  J. S. Hooghiemstra.  Design Of Regular Interval Timetables For StrategicAnd Tactical Railway Planning , 1970 .

[19]  Peter Pudney,et al.  Generating Train Plans with Problem Space Search , 2008 .

[20]  Wulf Schwanhäußer,et al.  Rechnerunterstützte analytische Ermittlung der Kapazität von Eisenbahnnetzen , 2002 .

[21]  Xuesong Zhou,et al.  Single-Track Train Timetabling with Guaranteed Optimality: Branch-and-Bound Algorithms with Enhanced Lower Bounds , 2007 .

[22]  Malachy Carey,et al.  Stochastic approximation to the effects of headways on knock-on delays of trains , 1994 .

[23]  Leo G. Kroon,et al.  Reinventing Crew Scheduling at Netherlands Railways , 2004, Interfaces.

[24]  M. J. Soomer,et al.  Scheduling aircraft landings using airlines' preferences , 2008, Eur. J. Oper. Res..

[25]  Te-Wei Chiang,et al.  Knowledge-Based System for Railway Scheduling , 1998, Data Knowl. Eng..

[26]  Belarmino Adenso-Díaz,et al.  On-line timetable re-scheduling in regional train services , 1999 .

[27]  S Savio,et al.  Traffic Management In Moving Block Railway Systems: The Results Of The EU Project COMBINE , 2002 .

[28]  Patrick T. Harker,et al.  Optimal Pacing of Trains in Freight Railroads: Model Formulation and Solution , 1991, Oper. Res..

[29]  Miguel A. Salido,et al.  An Efficient Method to Schedule New Trains on a Heavily Loaded Railway Network , 2004, IBERAMIA.

[30]  Miguel A. Salido,et al.  Domain-dependent distributed models for railway scheduling , 2007, Knowl. Based Syst..

[31]  Patrick T. Harker,et al.  Tactical Scheduling of Rail Operations: The SCAN I System , 1991, Transp. Sci..

[32]  David Abramson,et al.  Scheduling Aircraft Landings - The Static Case , 2000, Transp. Sci..

[33]  Malachy Carey,et al.  Scheduling Trains on a Network of Busy Complex Stations , 2007 .

[34]  Xavier Gandibleux,et al.  Stability evaluation of a railway timetable at station level , 2009, Eur. J. Oper. Res..

[35]  Rolf H. Möhring,et al.  A Case Study in Periodic Timetabling , 2002, ATMOS.

[36]  Johanna Törnquist,et al.  Computer-based decision support for railway traffic scheduling and dispatching: A review of models and algorithms , 2005, ATMOS.

[37]  Arjang A. Assad,et al.  MODELS FOR RAIL TRANSPORTATION , 1980 .

[38]  Malachy Carey,et al.  Scheduling and Platforming Trains at Busy Complex Stations , 2003 .

[39]  I. A. Hansen,et al.  State-of-the-Art of Railway Operations Research , 2006 .

[40]  Rodolfo Zunino,et al.  A distributed intelligence methodology for railway traffic control , 1990 .

[41]  M. V. Riel,et al.  Crew Scheduling for Netherlands Railways “ Destination : Customer ” , 2000 .

[42]  Evelina Lamma,et al.  Extending constraint logic programming for temporal reasoning , 1998, Annals of Mathematics and Artificial Intelligence.

[43]  Malachy Carey,et al.  A Model, Algorithms and Strategy for Train Pathing , 1995 .

[44]  Leo G. Kroon,et al.  Shunting of Passenger Train Units: An Integrated Approach , 2006, Transp. Sci..

[45]  Leo Kroon,et al.  Applying Operations Research techniques to planning of train shunting , 2003 .

[46]  M. A. Odijk,et al.  DONS: Computer Aided Design Of RegularService Timetables , 1970 .

[47]  Jan A. Persson,et al.  N-tracked railway traffic re-scheduling during disturbances , 2007 .

[48]  Patrick T. Harker,et al.  A DECISION SUPPORT SYSTEM FOR TRAIN DISPATCHING: AN OPTIMIZATION-BASED METHODOLOGY , 1990 .

[49]  Jianxin Yuan,et al.  Stochastic modelling of train delays and delay propagation in stations , 2006 .

[50]  Xiaoqiang Cai,et al.  Greedy heuristics for rapid scheduling of trains on a single track , 1998 .

[51]  Patrick T. Harker,et al.  Improving railroad on-time performance: models, algorithms and applications , 1989 .

[52]  Ziyou Gao,et al.  Efficient scheduling of railway traffic based on global information of train , 2008 .

[53]  Rob M.P. Goverde,et al.  PERFORMANCE EVALUATION OF NETWORK TIMETABLES USING PETER , 2002 .

[54]  Hayriye Ayhan,et al.  A probabilistic (max, +) approach for determining railway infrastructure capacity , 2003, Eur. J. Oper. Res..

[55]  Per Olov Lindberg,et al.  Railway Timetabling Using Lagrangian Relaxation , 1998, Transp. Sci..

[56]  J. V. Medanic,et al.  ENERGY EFFICIENT STRATEGIES FOR SCHEDULING TRAINS ON A LINE , 2002 .

[57]  Michiel A. Odijk,et al.  A CONSTRAINT GENERATION ALGORITHM FOR THE CONSTRUCTION OF PERIODIC RAILWAY TIMETABLES , 1996 .

[58]  Christian Liebchen,et al.  Symmetry for Periodic Railway Timetables , 2004, ATMOS.

[59]  Richard J. Boucherie,et al.  A solvable queueing network model for railway networks and its validation and applications for the Netherlands , 2002, Eur. J. Oper. Res..

[60]  M Giuliari,et al.  MOVING BLOCK AND TRAFFIC MANAGEMENT IN RAILWAY APPLICATIONS: THE EU PROJECT COMBINE , 2000 .

[61]  David S. Johnson,et al.  Computers and Intractability: A Guide to the Theory of NP-Completeness , 1978 .

[62]  Andrea D'Ariano,et al.  Improving real-time train dispatching: Models, algorithms and applications , 2008 .

[63]  Miguel A. Salido,et al.  Distributed search in railway scheduling problems , 2008, Eng. Appl. Artif. Intell..

[64]  Jan van der Wal,et al.  An Application of the Semi Markovian Decision Approach for Train Conflict Resolution on a Vital Dutch Railway Section , 2009 .

[65]  Erhan Kozan,et al.  Optimal scheduling of trains on a single line track , 1996 .

[66]  Casey A. Volino,et al.  A First Course in Stochastic Models , 2005, Technometrics.

[67]  G. Olsder,et al.  THE MAX-PLUS ALGEBRA APPROACH TO TRANSPORTATION PROBLEMS , 1999 .

[68]  S. Araya,et al.  An optimal rescheduling for online train traffic control in disturbed situations , 1983, The 22nd IEEE Conference on Decision and Control.

[69]  M. J Dorfman,et al.  Scheduling trains on a railway network using a discrete event model of railway traffic , 2004 .

[70]  E Wendler.  The scheduled waiting time on railway lines , 2007 .

[71]  Leo G. Kroon,et al.  Cyclic Railway Timetabling: A Stochastic Optimization Approach , 2004, ATMOS.

[72]  Lucio Bianco,et al.  Scheduling models for air traffic control in terminal areas , 2006, J. Sched..

[73]  Marc Schoenauer,et al.  On the benefits of inoculation, an example in train scheduling , 2006, GECCO '06.

[74]  Ming Zhong,et al.  Bicriteria train scheduling for high-speed passenger railroad planning applications , 2005, Eur. J. Oper. Res..

[75]  Malachy Carey,et al.  Testing schedule performance and reliability for train stations , 2000, J. Oper. Res. Soc..

[76]  G. Hertel,et al.  Die maximale Verkehrsleistung und die minimale Fahrplanempflindlichkeit auf Eisenbahnstrecken , 1992 .

[77]  Ismail Sahin,et al.  Railway traffic control and train scheduling based oninter-train conflict management , 1999 .

[78]  J. van der Wal,et al.  A semi Markov decision approach for train conflict resolution , 2007 .

[79]  Ferenc Szidarovszky,et al.  A multi-objective train scheduling model and solution , 2004 .

[80]  Elias Silva Oliveira.  Solving Single-Track Railway Scheduling Problem Using Constraint Programming , 2001 .

[81]  Leo G. Kroon,et al.  A rolling stock circulation model for combining and splitting of passenger trains , 2006, Eur. J. Oper. Res..

[82]  Scott Mackenzie.  Train timetabling on complex networks , 2000 .

[83]  Martin L. Puterman,et al.  Markov Decision Processes: Discrete Stochastic Dynamic Programming , 1994 .

[84]  M. Schoenauer,et al.  An efficient memetic, permutation-based evolutionary algorithm for real-world train timetabling , 2005, 2005 IEEE Congress on Evolutionary Computation.

[85]  Dario Pacciarelli,et al.  A branch and bound algorithm for scheduling trains in a railway network , 2007, Eur. J. Oper. Res..

[86]  Averill M. Law,et al.  Simulation Modeling and Analysis , 1982 .

[87]  Michiel Vromans,et al.  Reliability of Railway Systems , 2005 .

[88]  Moshe Haviv,et al.  Externalities, Tangible Externalities, and Queue Disciplines , 1998 .

[89]  Rob M.P. Goverde,et al.  TNV-PREPARE: ANALYSIS OF DUTCH RAILWAY OPERATIONS BASED ON TRAIN DETECTION DATA , 2000 .

[90]  Dick Middelkoop,et al.  Simone: Large scale train network simulations , 2001, Proceeding of the 2001 Winter Simulation Conference (Cat. No.01CH37304).

[91]  Evelina Lamma,et al.  A distributed constraint-based scheduler , 1997, Artif. Intell. Eng..