In this paper a new reinforcement learning system for generating marshaling plan of freight cars in a train is designed. In the proposed method, the total transfer distance of a locomotive is minimized to obtain the desired layout of freight cars for an outbound train. The order of movements of freight cars, the position for each removed car, the layout of cars in a train and the number of cars to be moved are simultaneously optimized to achieve the desired layout of an outbound train. Initially, freight cars are located in a freight yard by the random layout, and they are moved and lined into a main track in a certain desired order in order to assemble an out bound train. A layout and movements of freight cars are used to describe a state of marshaling yard, and the state transitions are defined based on the Markov Decision Process (MDP). Q-Learning is applied to reflect the transfer distance as well as the number of movements of the locomotive that are used to achieve one of the desired layouts into evaluation values. After adequate autonomous learning, the optimum schedule can be obtained by selecting a series of movements of freight cars that has the best evaluation.
[1]
Sohail S. Chaudhry,et al.
Fuzzy dispatching model and genetic algorithms for railyards operations
,
2000,
Eur. J. Oper. Res..
[2]
Gerhard J. Woeginger,et al.
The hardness of train rearrangements
,
2009,
Oper. Res. Lett..
[3]
Elias Dahlhaus,et al.
Algorithms for Combinatorial Problems Relatedto Train MarshallingElias DahlhausDept
,
2011
.
[4]
Peter Dayan,et al.
Q-learning
,
1992,
Machine Learning.
[5]
Yoichi Hirashima.
A New Rearrangement Plan for Freight Cars in a Train
,
2011
.
[6]
Locomotive Yoichi Hirashima.
A New Reinforcement Learning Method for Train Marshaling Based on the Transfer Distance of
,
2011
.
[7]
Michael R. Bussieck,et al.
Scheduling trams in the morning
,
1999,
Math. Methods Oper. Res..
[8]
Leo G. Kroon,et al.
Shunting of Passenger Train Units: An Integrated Approach
,
2006,
Transp. Sci..
[9]
Riko Jacob,et al.
Multistage methods for freight train classification
,
2007,
Networks.