Lagrangian relaxation neural networks for job shop scheduling

Manufacturing scheduling is an important but difficult task. In order to effectively solve such combinatorial optimization problems, the paper presents a Lagrangian relaxation neural network (LRNN) for separable optimization problems by combining recurrent neural network optimization ideas with Lagrangian relaxation (LR) for constraint handling. The convergence of the network is proved, and a general framework for neural implementation is established, allowing creative variations. When applying the network to job shop scheduling, the separability of problem formulation is fully exploited, and a new neuron-based dynamic programming is developed making innovative use of the subproblem structure. Testing results obtained by software simulation demonstrate that the method is able to provide near-optimal solutions for practical job shop scheduling problems, and the results are superior to what have been reported in the neural network scheduling literature. In fact, the digital implementation of LRNN for job shop scheduling is similar to the traditional LR approaches. The method, however, has the potential to be implemented in hardware with much improved quality and speed.

[1]  Yoshiyasu Takefuji,et al.  Stochastic neural networks for solving job-shop scheduling. I. Problem representation , 1988, IEEE 1988 International Conference on Neural Networks.

[2]  Peter B. Luh,et al.  An optimization-based algorithm for job shop scheduling , 1997 .

[3]  B. V. Dean,et al.  Studies in Linear and Non-Linear Programming. , 1959 .

[4]  Ihsan Sabuncuoglu,et al.  A neural network model for scheduling problems , 1996 .

[5]  Dimitri P. Bertsekas,et al.  Nonlinear Programming , 1997 .

[6]  Vladimir Cherkassky,et al.  A neural network approach to job-shop scheduling , 1991, IEEE Trans. Neural Networks.

[7]  Stan Z. Li,et al.  Improving convergence and solution quality of Hopfield-type neural networks with augmented Lagrange multipliers , 1996, IEEE Trans. Neural Networks.

[8]  R. Bellman,et al.  Linear Programming and Economic Analysis. , 1960 .

[9]  Peter B. Luh,et al.  Architectural Design of Neural Network Hardware for Job Shop Scheduling , 1999 .

[10]  X. Zhao,et al.  Surrogate Gradient Algorithm for Lagrangian Relaxation , 1999 .

[11]  M. Caramanis,et al.  Efficient Lagrangian relaxation algorithms for industry size job-shop scheduling problems , 1998 .

[12]  Yoshiyasu Takefuji,et al.  Integer linear programming neural networks for job-shop scheduling , 1988, IEEE 1988 International Conference on Neural Networks.

[13]  T. M. Willems,et al.  Implementing heuristics as an optimization criterion in neural networks for job-shop scheduling , 1995, J. Intell. Manuf..

[14]  John N. Tsitsiklis,et al.  Neuro-Dynamic Programming , 1996, Encyclopedia of Machine Learning.

[15]  Laurence A. Wolsey,et al.  Integer and Combinatorial Optimization , 1988 .

[16]  Krishna R. Pattipati,et al.  A practical approach to job-shop scheduling problems , 1993, IEEE Trans. Robotics Autom..

[17]  Laurence A. Wolsey,et al.  Integer and Combinatorial Optimization , 1988, Wiley interscience series in discrete mathematics and optimization.

[18]  Katsumi Morikawa,et al.  Neural network approach for minimizing the makespan of the general job-shop , 1994 .

[19]  Michael Pinedo,et al.  Scheduling: Theory, Algorithms, and Systems , 1994 .