Calibration of disturbance parameters in railway operational simulation based on reinforcement learning

In railway operations, delays are used as one of most important factors to quantify and evaluate the quality of the railway services. However, data about stochastic disturbances and the causes of the delays are hard to be collected and measured. The efforts to manually estimate these disturbances are also considerably high. In this paper, a method for the automatic calibration of disturbance parameters, which are used to generate stochastic disturbances in simulation tools, is developed with the support of the reinforcement learning technique. Simulation and application results show that the efforts for calibrating parameters can be significantly reduced with ensured consistency between simulation models and the actual railway operations.

[1]  Rob M.P. Goverde,et al.  Punctuality of railway operations and timetable stability analysis , 2005 .

[2]  Giovanni Longo,et al.  A method for using stochastic blocking times to improve timetable planning , 2011, J. Rail Transp. Plan. Manag..

[3]  Christine Schmidt,et al.  Erhöhung der Effektivität und Transparenz bei Leistungsuntersuchungen mit Simulationsverfahren , 2010 .

[4]  Martin A. Riedmiller,et al.  A direct adaptive method for faster backpropagation learning: the RPROP algorithm , 1993, IEEE International Conference on Neural Networks.

[5]  Carlos Alberto Brebbia Computers in Railways XIV Special Contributions , 2015 .

[6]  Rob M.P. Goverde,et al.  Non-Discriminatory Automatic Registration of Knock-On Train Delays , 2009 .

[7]  Rob M.P. Goverde,et al.  Process mining of train describer event data and automatic conflict identification , 2012 .

[8]  Rob M.P. Goverde,et al.  Automatic Identification of Route Conflict Occurrences and Their Consequences , 2008 .

[9]  Thorsten Büker,et al.  Stochastic modelling of delay propagation in large networks , 2012, J. Rail Transp. Plan. Manag..

[10]  Jianxin Yuan,et al.  Stochastic modelling of train delays and delay propagation in stations , 2006 .

[11]  Egidio Quaglietta,et al.  A simulation-based optimization approach for the calibration of dynamic train speed profiles , 2013, J. Rail Transp. Plan. Manag..

[12]  Andrew W. Moore,et al.  Reinforcement Learning: A Survey , 1996, J. Artif. Intell. Res..

[13]  Giovanni Longo,et al.  Automated Analysis of Train Event Recorder Data to Improve Micro-Simulation Models , 2008 .

[14]  Pavle Kecman,et al.  Predictive modelling of running and dwell times in railway traffic , 2015, Public Transp..

[15]  Paul Schonfeld,et al.  Analyzing passenger train arrival delays with support vector regression , 2015 .