Neural Combinatorial Optimization for Production Scheduling with Sequence-Dependent Setup Waste

One of the main objectives of production planning is to minimize the usage of resources and manufacturing-related costs while meeting the customer’s requirements, such as delivery dates and quality. Production planners deal with various scheduling problems that are often NP-hard and can not be optimally solved by humans. Solving such problems often relies on methods from the Operations Research (OR) field. Recently, Neural Combinatorial Optimization (NCO) has emerged as a promising field of research that aims at tackling different optimization tasks using the latest advancements in machine learning, including deep reinforcement learning. These methods can be successfully used for short-term production planning because of their flexibility and speed. In this paper, we examine the applicability and scalability of neural combinatorial optimization methods in the context of production planning. We define an evaluation metric to investigate the stability and quality of the solutions. Furthermore, we develop an experimental setup allowing to compare various approaches for production scheduling with sequence-dependent setup costs under real-world production conditions. Although an optimality gap is observed when compared to established OR methods, our experiments demonstrate the superiority of NCO in terms of scheduling time.

[1]  Eugene L. Lawler,et al.  Chapter 9 Sequencing and scheduling: Algorithms and complexity , 1993, Logistics of Production and Inventory.

[2]  Mei-Shiang Chang,et al.  Production scheduling and vehicle routing with time windows for perishable food products , 2009, Comput. Oper. Res..

[3]  Peter Henderson,et al.  An Introduction to Deep Reinforcement Learning , 2018, Found. Trends Mach. Learn..

[4]  Kenneth R. Baker,et al.  Principles of Sequencing and Scheduling , 2018 .

[5]  Kate Smith-Miles,et al.  Neural Networks for Combinatorial Optimization: A Review of More Than a Decade of Research , 1999, INFORMS J. Comput..

[6]  Mohamed Ali Aloulou,et al.  Integrated production scheduling and vehicle routing problem with job splitting and delivery time windows , 2017, Int. J. Prod. Res..

[7]  Stephen C. Graves,et al.  A Review of Production Scheduling , 1981, Oper. Res..

[8]  Lixin Tang,et al.  A multiple traveling salesman problem model for hot rolling scheduling in Shanghai Baoshan Iron & Steel Complex , 2000, Eur. J. Oper. Res..

[9]  Lawrence V. Snyder,et al.  Reinforcement Learning for Solving the Vehicle Routing Problem , 2018, NeurIPS.

[10]  L. Shapley A Value for n-person Games , 1988 .

[11]  Lia Purpura On Tools , 2012 .

[12]  Yoshua Bengio,et al.  Machine Learning for Combinatorial Optimization: a Methodological Tour d'Horizon , 2018, Eur. J. Oper. Res..

[13]  Scott Lundberg,et al.  A Unified Approach to Interpreting Model Predictions , 2017, NIPS.

[14]  Ali Allahverdi,et al.  The significance of reducing setup times/setup costs , 2008, Eur. J. Oper. Res..

[15]  Ronald J. Williams,et al.  Simple Statistical Gradient-Following Algorithms for Connectionist Reinforcement Learning , 2004, Machine Learning.

[16]  Max Welling,et al.  Attention, Learn to Solve Routing Problems! , 2018, ICLR.

[17]  Xiong Chen,et al.  Modeling rolling batch planning as vehicle routing problem with time windows , 1998, Comput. Oper. Res..

[18]  Carlos Guestrin,et al.  "Why Should I Trust You?": Explaining the Predictions of Any Classifier , 2016, ArXiv.

[19]  Navdeep Jaitly,et al.  Pointer Networks , 2015, NIPS.

[20]  Hugh Chen,et al.  From local explanations to global understanding with explainable AI for trees , 2020, Nature Machine Intelligence.

[21]  Lior Wolf,et al.  Learning the Multiple Traveling Salesmen Problem with Permutation Invariant Pooling Networks , 2018, ArXiv.

[22]  Tobias Meisen,et al.  More Machine Learning for Less: Comparing Data Generation Strategies in Mechanical Engineering and Manufacturing , 2019, 2019 IEEE Symposium Series on Computational Intelligence (SSCI).

[23]  Samy Bengio,et al.  Neural Combinatorial Optimization with Reinforcement Learning , 2016, ICLR.

[24]  Tie-Yan Liu,et al.  LightGBM: A Highly Efficient Gradient Boosting Decision Tree , 2017, NIPS.

[25]  T. Bektaş The multiple traveling salesman problem: an overview of formulations and solution procedures , 2006 .

[26]  Jatinder N. D. Gupta,et al.  A review of scheduling research involving setup considerations , 1999 .