Flight-connection Prediction for Airline Crew Scheduling to Construct Initial Clusters for OR Optimizer

We present a case study of using machine learning classification algorithms to initialize a large scale commercial operations research solver (GENCOL) in the context of the airline crew pairing problem, where small savings of as little as 1% translate to increasing annual revenue by millions of dollars in a large airline. We focus on the problem of predicting the next connecting flight of a crew, framed as a multiclass classification problem trained from historical data, and design an adapted neural network approach that achieves high accuracy (99.7% overall or 82.5% on harder instances). We demonstrate the usefulness of our approach by using simple heuristics to combine the flight-connection predictions to form initial crew-pairing clusters that can be fed in the GENCOL solver, yielding a 10x speed improvement and up to 0.2% cost saving.

[1]  Ellis L. Johnson,et al.  A Global Approach to Crew-Pairing Optimization , 1992, IBM Syst. J..

[2]  L. Bianco,et al.  A heursitic procedure for the crew rostering problem , 1992 .

[3]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[4]  François Soumis,et al.  Dynamic constraint and variable aggregation in column generation , 2014, Eur. J. Oper. Res..

[5]  Kilian Q. Weinberger,et al.  On Calibration of Modern Neural Networks , 2017, ICML.

[6]  Jacques Desrosiers,et al.  Chapter 2 Time constrained routing and scheduling , 1995 .

[7]  Shengli Qiu,et al.  Airline crew pairing optimization problems and capacitated vehicle routing problems , 2012 .

[8]  Fabio Roli,et al.  Reject option with multiple thresholds , 2000, Pattern Recognit..

[9]  Silvano Martello,et al.  Meta-Heuristics: Advances and Trends in Local Search Paradigms for Optimization , 2012 .

[10]  Sander Bohte,et al.  Conditional Time Series Forecasting with Convolutional Neural Networks , 2017, 1703.04691.

[11]  Albert P. M. Wagelmans,et al.  Erim Report Series Research in Management a Decision Support System for Crew Planning in Passenger Transportation Using a Flexible Branch-and- Price Algorithm Bibliographic Data and Classifications , 2022 .

[12]  Guy Desaulniers,et al.  Integrated Airline Crew Pairing and Crew Assignment by Dynamic Constraint Aggregation , 2010, Transp. Sci..

[13]  Franck Dernoncourt,et al.  Optimizing neural network hyperparameters with Gaussian processes for dialog act classification , 2016, 2016 IEEE Spoken Language Technology Workshop (SLT).

[14]  Nima Hatami,et al.  Classification of time-series images using deep convolutional neural networks , 2017, International Conference on Machine Vision.

[15]  Antonio Sassano,et al.  A Lagrangian-based heuristic for large-scale set covering problems , 1998, Math. Program..

[16]  Martin Desrochers,et al.  A Column Generation Approach to the Urban Transit Crew Scheduling Problem , 1987, Transp. Sci..

[17]  Edward K. Baker,et al.  Efficient heuristic algorithms for the weighted set covering problem , 1981, Comput. Oper. Res..

[18]  Marc H. J. Romanycia,et al.  What is a heuristic? , 1985 .

[19]  Muhammet Deveci,et al.  A survey of the literature on airline crew scheduling , 2018, Eng. Appl. Artif. Intell..

[20]  Sven de Vries,et al.  A Branch-and-Price Algorithm and New Test Problems for Spectrum Auctions , 2005, Manag. Sci..

[21]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[22]  Jacques Desrosiers,et al.  Crew Pairing at Air France , 1993 .

[23]  Jesper Larsen,et al.  A column generation approach for solving the patient admission scheduling problem , 2014, Eur. J. Oper. Res..

[24]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[25]  Jonathan F. Bard,et al.  Flexible weekly tour scheduling for postal service workers using a branch and price , 2013, J. Sched..

[26]  Kevin Leyton-Brown,et al.  Sequential Model-Based Optimization for General Algorithm Configuration , 2011, LION.

[27]  John R. Birge,et al.  A Stochastic Programming Approach to the Airline Crew Scheduling Problem , 2006, Transp. Sci..

[28]  Peng Wang,et al.  Applying back-propagation neural network to predict bus traffic , 2016, 2016 12th International Conference on Natural Computation, Fuzzy Systems and Knowledge Discovery (ICNC-FSKD).

[29]  Alberto Gómez,et al.  Dynamic scheduling of manufacturing systems using machine learning: An updated review , 2014, Artificial Intelligence for Engineering Design, Analysis and Manufacturing.

[30]  Guy Desaulniers,et al.  Dynamic Aggregation of Set-Partitioning Constraints in Column Generation , 2003, Oper. Res..

[31]  Zoubin Ghahramani,et al.  Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learning , 2015, ICML.

[32]  Kevin Gimpel,et al.  A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networks , 2016, ICLR.

[33]  Guy Desaulniers,et al.  Multi-phase dynamic constraint aggregation for set partitioning type problems , 2010, Math. Program..

[34]  Ruslan Sadykov,et al.  Recent results for column generation based diving heuristics , 2016 .

[35]  Denis Borenstein,et al.  A Lagrangian Heuristic for the Real-Time Vehicle Rescheduling Problem , 2009 .

[36]  Cynthia Barnhart,et al.  Improving Crew Scheduling by Incorporating Key Maintenance Routing Decisions , 2003, Oper. Res..

[37]  Yoshua Bengio,et al.  Random Search for Hyper-Parameter Optimization , 2012, J. Mach. Learn. Res..

[38]  Abolfazl Mohammadian,et al.  Application of Artificial Neural Network Models to Activity Scheduling Time Horizon , 2003 .

[39]  Jacques Desrosiers,et al.  Routing with time windows by column generation , 1983, Networks.

[40]  Jeffrey Dean,et al.  Distributed Representations of Words and Phrases and their Compositionality , 2013, NIPS.

[41]  Jacques Desrosiers,et al.  Stabilized dynamic constraint aggregation for solving set partitioning problems , 2011, Eur. J. Oper. Res..

[42]  Blaise Hanczar,et al.  Accuracy-Rejection Curves (ARCs) for Comparing Classification Methods with a Reject Option , 2009, MLSB.

[43]  Matteo Fischetti,et al.  A Heuristic Method for the Set Covering Problem , 1999, Oper. Res..

[44]  François Soumis,et al.  Airline crew scheduling: models, algorithms, and data sets , 2014, EURO J. Transp. Logist..