Using Markov decision processes to solve stochastic gate assignment problem

Airport traffic often undergoes some random disruptions, which have to be considered to ensure operational flight-gate assignments. Inadequate assignment of gates may result in flight delays that happen in airport operations and must be taken into account. Here, we are using the original algorithm, based on Markov decision process (MDP) to solve the gate assignment problem (GAP) under uncertainty; we include stochastic parameters that depend on probabilities to express fluctuations in flight operations. The use of MDP for modeling will provide for airport controllers a robust solution for the GAP that takes in consideration possible flight delays. This paper gives the corresponding model, which includes strict constraints of the GAP and other soft constraints like choice preferences of gates. We give experimental results on a sample of real data to demonstrate the feasibility and efficiency of our approach.

[1]  Erwin Pesch,et al.  Modelling Robust Flight-Gate Scheduling as a Clique Partitioning Problem , 2008, Transp. Sci..

[2]  Timothy I. Matis,et al.  Multi-commodity flow network model of the flight gate assignment problem , 2012, Comput. Ind. Eng..

[3]  Nilay Noyan,et al.  Stochastic optimization models for the airport gate assignment problem , 2012 .

[4]  Shangyao Yan,et al.  A heuristic approach for airport gate assignments for stochastic flight delays , 2007, Eur. J. Oper. Res..

[5]  Shangyao Yan,et al.  Optimization of multiple objective gate assignments , 2001 .

[6]  Leslie Pack Kaelbling,et al.  Planning and Acting in Partially Observable Stochastic Domains , 1998, Artif. Intell..

[7]  Chun Hung Cheng,et al.  The use of meta-heuristics for airport gate assignment , 2012, Expert Syst. Appl..

[8]  Robert Givan,et al.  Bounded Parameter Markov Decision Processes , 1997, ECP.

[9]  T. Glenn Bailey,et al.  The airport gate assignment problem: mathematical model and a tabu search algorithm , 2001, Proceedings of the 34th Annual Hawaii International Conference on System Sciences.

[10]  Dušan Teodorović,et al.  Optimal dispatching strategy on an airline network after a schedule perturbation , 1984 .

[11]  Chia-Ming Chang,et al.  A network model for gate assignment , 1998 .

[12]  Ching Chang,et al.  FLIGHT SEQUENCING AND GATE ASSIGNMENTS AT AIRPORT HUBS. , 1994 .

[13]  R. Bellman,et al.  Dynamic Programming and Markov Processes , 1960 .

[14]  Jérôme Morio,et al.  Conflict probability estimation between aircraft with dynamic importance splitting , 2013 .

[15]  René Schott,et al.  APPLICATION OF MARKOV DECISION PROCESSES TO THE FREQUENCY ASSIGNMENT PROBLEM , 2004, Appl. Artif. Intell..

[16]  Gerald N. Steuart,et al.  DEMAND FOR AIRCRAFT GATES , 1993 .

[17]  Andrew Lim,et al.  Robust airport gate assignment , 2005, 17th IEEE International Conference on Tools with Artificial Intelligence (ICTAI'05).

[18]  Yury Nikulin,et al.  Multicriteria airport gate assignment and Pareto simulated annealing , 2008 .