Flowshop scheduling with artificial neural networks

Abstract For effective modelling of flowshop scheduling problems, artificial neural networks (ANNs), due to their robustness, parallelism and predictive ability have been successfully used by researchers. These studies reveal that the ANNs trained with conventional back propagation (CBP) algorithm utilising the gradient descent method are commonly applied to model and solve flowshop scheduling problems. However, the existing scheduling literature has not explored the suitability of some improved neural network training algorithms, such as gradient descent with adaptive learning (GDAL), Boyden, Fletcher, Goldfarb and Shanno updated Quasi-Newton (UQ-N), and Levenberg-Marquardt (L-M) algorithms to solve the flowshop scheduling problem. In this article, we investigate the use of these training algorithms as competitive neural network learning tools to minimise makepsan in a flowshop. Based on training and testing measures, overall results from extensive computational experiments demonstrate that, in terms of the solution quality and computational effort required, the L-M algorithm performs the best followed by the UQ-N algorithm, GDAL algorithm, and the CBP algorithm. These computational results also reveal that the average percent deviation of the makespan from its best solution obtained by using the ANN trained with the L-M algorithm is the least among all examined approaches for the benchmark problem instances.

[1]  Rasoul Shafaei,et al.  An adaptive neuro fuzzy inference system for makespan estimation in multiprocessor no-wait two stage flow shop , 2011, Int. J. Comput. Integr. Manuf..

[2]  R. A. Dudek,et al.  A Heuristic Algorithm for the n Job, m Machine Sequencing Problem , 1970 .

[3]  Arindam Majumder,et al.  A new cuckoo search algorithm for 2-machine robotic cell scheduling problem with sequence-dependent setup times , 2016, Swarm Evol. Comput..

[4]  Uday Kumar Chakraborty,et al.  An efficient stochastic hybrid heuristic for flowshop scheduling , 2007, Eng. Appl. Artif. Intell..

[5]  C. G. Broyden The Convergence of a Class of Double-rank Minimization Algorithms 1. General Considerations , 1970 .

[6]  J.-B. Wang,et al.  Flow-shop scheduling with a learning effect , 2005, J. Oper. Res. Soc..

[7]  Mohammad Bagher Menhaj,et al.  Training feedforward networks with the Marquardt algorithm , 1994, IEEE Trans. Neural Networks.

[8]  Jatinder N. D. Gupta,et al.  Neural networks in business: techniques and applications for the operations researcher , 2000, Comput. Oper. Res..

[9]  Fuminori Oba,et al.  A robust scheduling rule using a Neural Network in dynamically changing job-shop environments , 2008, Int. J. Manuf. Technol. Manag..

[10]  R. Fletcher,et al.  A New Approach to Variable Metric Algorithms , 1970, Comput. J..

[11]  Roberto Battiti,et al.  First- and Second-Order Methods for Learning: Between Steepest Descent and Newton's Method , 1992, Neural Computation.

[12]  Mohammad Hossein Fazel Zarandi,et al.  Two-machine robotic cell scheduling problem with sequence-dependent setup times , 2013, Comput. Oper. Res..

[13]  Jatinder N. D. Gupta,et al.  A penalty-shift-insertion-based algorithm to minimize total flow time in no-wait flow shops , 2014, J. Oper. Res. Soc..

[14]  A. Noorul Haq,et al.  A bicriterian flow shop scheduling using artificial neural network , 2006 .

[15]  Jatinder N. D. Gupta,et al.  A penalty-based heuristic algorithm for the permutation flowshop scheduling problem with sequence-dependent set-up times , 2006, J. Oper. Res. Soc..

[16]  Arun Kumar Sangaiah,et al.  Metaheuristic Algorithms: A Comprehensive Review , 2018 .

[17]  Inyong Ham,et al.  A heuristic algorithm for the m-machine, n-job flow-shop sequencing problem , 1983 .

[18]  D. Shanno Conditioning of Quasi-Newton Methods for Function Minimization , 1970 .

[19]  Ping Chen,et al.  An improved NEH-based heuristic for the permutation flowshop problem , 2008, Comput. Oper. Res..

[20]  Andreas Stafylopatis,et al.  Training the random neural network using quasi-Newton methods , 2000, Eur. J. Oper. Res..

[21]  Subramaniam Balakrishnan,et al.  Sequencing jobs on a single machine: A neural network approach , 2000, Eur. J. Oper. Res..

[22]  Dipak Laha,et al.  A heuristic for no-wait flow shop scheduling , 2013 .

[23]  M. K. Soni,et al.  Artificial neural network based peak load forecasting using Levenberg-Marquardt and quasi-Newton methods , 2002 .

[24]  Luís B. Almeida,et al.  Acceleration Techniques for the Backpropagation Algorithm , 1990, EURASIP Workshop.

[25]  Chang-Xue Jack Feng,et al.  Threefold vs. fivefold cross validation in one-hidden-layer and two-hidden-layer predictive neural network modeling of machining surface roughness data , 2005 .

[26]  Marcelo Seido Nagano,et al.  Evaluating the performance for makespan minimisation in no-wait flowshop sequencing , 2008 .

[27]  Jatinder N. D. Gupta,et al.  A Hungarian penalty-based construction algorithm to minimize makespan and total flow time in no-wait flow shops , 2016, Comput. Ind. Eng..

[28]  Yuri N. Sotskov,et al.  A neural network algorithm for servicing jobs with sequential and parallel machines , 2014, Autom. Remote. Control..

[29]  Roger Fletcher,et al.  A Rapidly Convergent Descent Method for Minimization , 1963, Comput. J..

[30]  Jose M. Framiñan,et al.  A review and classification of heuristics for permutation flow-shop scheduling with makespan objective , 2004, J. Oper. Res. Soc..

[31]  Jatinder N. D. Gupta,et al.  Flowshop scheduling research after five decades , 2006, Eur. J. Oper. Res..

[32]  D. S. Palmer Sequencing Jobs Through a Multi-Stage Process in the Minimum Total Time—A Quick Method of Obtaining a Near Optimum , 1965 .

[33]  R. Sridharan,et al.  An artificial neural network based heuristic for flow shop scheduling problems , 2011, J. Intell. Manuf..

[34]  Ethel Mokotoff,et al.  Production , Manufacturing and Logistics An exact algorithm for the identical parallel machine scheduling problem , 2003 .

[35]  Gary R. Weckman,et al.  A neural network job-shop scheduler , 2008, J. Intell. Manuf..

[36]  H. Wang,et al.  Design of efficient hybrid neural networks for flexible flow shop scheduling , 2003, Expert Syst. J. Knowl. Eng..

[37]  Subramaniam Balakrishnan,et al.  A neural network to enhance local search in the permutation flowshop , 2005, Comput. Ind. Eng..

[38]  Yan Jin,et al.  A new improved NEH heuristic for permutation flowshop scheduling problems , 2017 .

[39]  Éric D. Taillard,et al.  Benchmarks for basic scheduling problems , 1993 .

[40]  L. Shawn Matott,et al.  Application of MATLAB and Python optimizers to two case studies involving groundwater flow and contaminant transport modeling , 2011, Comput. Geosci..

[41]  Derya Eren Akyol,et al.  A review on evolution of production scheduling with neural networks , 2007, Comput. Ind. Eng..

[42]  Mehmet Bayram Yildirim,et al.  A neuro-genetic approach to design and planning of a manufacturing cell , 2005, J. Intell. Manuf..

[43]  Wenxin Liu,et al.  A neural network model and algorithm for the hybrid flow shop scheduling problem in a dynamic environment , 2005, J. Intell. Manuf..

[44]  Frank Fallside,et al.  An adaptive training algorithm for back propagation networks , 1987 .

[45]  Harendra Kumar Computational Intelligence Approach for Flow Shop Scheduling Problem , 2018 .

[46]  Derya Eren Akyol,et al.  Application of neural networks to heuristic scheduling algorithms , 2004, Comput. Ind. Eng..

[47]  Tilak Raj,et al.  An adaptive neuro-fuzzy inference system for makespan estimation of flexible manufacturing system assembly shop: a case study , 2018, Int. J. Syst. Assur. Eng. Manag..

[48]  A. K. Rigler,et al.  Accelerating the convergence of the back-propagation method , 1988, Biological Cybernetics.

[49]  D. Goldfarb A family of variable-metric methods derived by variational means , 1970 .

[50]  Robert A. Jacobs,et al.  Increased rates of convergence through learning rate adaptation , 1987, Neural Networks.

[51]  Jung Woo Jung,et al.  Flowshop-scheduling problems with makespan criterion: a review , 2005 .

[52]  Tom Tollenaere,et al.  SuperSAB: Fast adaptive back propagation with good scaling properties , 1990, Neural Networks.

[53]  George D. Magoulas,et al.  Nonmonotone BFGS-trained recurrent neural networks for temporal sequence processing , 2011, Appl. Math. Comput..

[54]  Ponnuthurai N. Suganthan,et al.  Modeling of steelmaking process with effective machine learning techniques , 2015, Expert Syst. Appl..

[55]  Mohamed Abdel-Basset,et al.  A hybrid whale optimization algorithm based on local search strategy for the permutation flow shop scheduling problem , 2018, Future Gener. Comput. Syst..

[56]  Uday K. Chakraborty,et al.  An efficient hybrid heuristic for makespan minimization in permutation flow shop scheduling , 2009 .

[57]  Dipak Laha,et al.  An improved heuristic to minimize total flow time for scheduling in the m-machine no-wait flow shop , 2014, Comput. Ind. Eng..

[58]  Liang Gong,et al.  Training Feed-forward Neural Networks Using the Gradient Descent Method with the Optimal Stepsize , 2012 .

[59]  Jatinder N. D. Gupta,et al.  Selecting Scheduling Heuristics Using Neural Networks , 2000, INFORMS J. Comput..

[60]  Ling-Huey Su,et al.  Scheduling parallel machines with resource-dependent processing times , 2009 .

[61]  H. Mokhtari,et al.  A multi-objective flow shop scheduling with resource-dependent processing times: trade-off between makespan and cost of resources , 2011 .

[62]  George D. Magoulas,et al.  Effective Backpropagation Training with Variable Stepsize , 1997, Neural Networks.

[63]  Dilip Sarkar,et al.  Methods to speed up error back-propagation learning algorithm , 1995, CSUR.

[64]  M. Tahar Kechadi,et al.  Recurrent neural network approach for cyclic job shop scheduling problem , 2013, ArXiv.

[65]  George D. Magoulas,et al.  Learning Rate Adaptation in Stochastic Gradient Descent , 2001 .

[66]  Jatinder N. D. Gupta,et al.  A Functional Heuristic Algorithm for the Flowshop Scheduling Problem , 1971 .

[67]  Jose M. Framiñan,et al.  New hard benchmark for flowshop scheduling problems minimising makespan , 2015, Eur. J. Oper. Res..

[68]  Michael J. Shaw,et al.  A neural-net approach to real time flow-shop sequencing , 2000 .

[69]  Varghese S. Jacob,et al.  An Improved Augmented Neural-Network Approach for Scheduling Problems , 2006, INFORMS J. Comput..

[70]  Indrajit Mukherjee,et al.  Comparing the performance of neural networks developed by using Levenberg-Marquardt and Quasi-Newton with the gradient descent algorithm for modelling a multiple response grinding process , 2012, Expert Syst. Appl..

[71]  Ahmed A. Abusnaina,et al.  Modified Global Flower Pollination Algorithm and its Application for Optimization Problems , 2018, Interdisciplinary Sciences: Computational Life Sciences.

[72]  George D. Magoulas,et al.  Nonmonotone Levenberg–Marquardt training of recurrent neural architectures for processing symbolic sequences , 2011, Neural Computing and Applications.

[73]  R. Sridharan,et al.  A hybrid neural network–genetic algorithm approach for permutation flow shop scheduling , 2010 .