A review on evolution of production scheduling with neural networks

The production scheduling problem allocates limited resources to tasks over time and determines the sequence of operations so that the constraints of the system are met and the performance criteria are optimized. One approach to this problem is the use of artificial neural networks (ANNs) stand alone or in conjunction with other methods. Artificial neural networks are computational structures that implement simplified models of biological processes, and are preferred for their robustness, massive parallelism, and learning ability. In this paper, we give a comprehensive overview on ANN approaches for solution of production scheduling problems, discuss both theoretical developments and practical experiences, and identify research trends. More than 50 major production and operations management journals published in years 1988-2005 have been reviewed. Existing approaches are classified into four groups, and additionally a historical progression in this field was emphasized. Finally, recommendations for future research are suggested in this paper.

[1]  Wenny H. M. Raaymakers,et al.  Makespan estimation in batch process industries: A comparison between regression analysis and neural networks , 2003, Eur. J. Oper. Res..

[2]  David de la Fuente,et al.  Dynamic scheduling of flexible manufacturing systems using neural networks and inductive learning , 2003 .

[3]  George Chryssolouris,et al.  The use of neural networks in determining operational policies for manufacturing systems , 1991 .

[4]  Xin Yao,et al.  Evolving artificial neural networks , 1999, Proc. IEEE.

[5]  Albert T. Jones,et al.  Intelligent scheduling for flexible manufacturing systems , 1993, [1993] Proceedings IEEE International Conference on Robotics and Automation.

[6]  Yoshiyasu Takefuji,et al.  Stochastic neural networks for solving job-shop scheduling. II. architecture and simulations , 1988, IEEE 1988 International Conference on Neural Networks.

[7]  Bahram Alidaee,et al.  Global optimization for artificial neural networks: A tabu search application , 1998, Eur. J. Oper. Res..

[8]  Shiro Usui,et al.  Evolution and adaptation of neural networks , 2003, Proceedings of the International Joint Conference on Neural Networks, 2003..

[9]  Chee-Kit Looi,et al.  Neural network methods in combinatorial optimization , 1992, Comput. Oper. Res..

[10]  Der-Chiang Li,et al.  Using an Unsupervized Neural Network and Decision Tree as Knowledge Acquisition Tools for Fms Scheduling , 1997, Int. J. Syst. Sci..

[11]  K. Preston White,et al.  A recent survey of production scheduling , 1988, IEEE Trans. Syst. Man Cybern..

[12]  Haibin Yu,et al.  Neural network and genetic algorithm-based hybrid approach to expanded job-shop scheduling , 2001 .

[13]  Subramaniam Balakrishnan,et al.  Sequencing jobs on a single machine: A neural network approach , 2000, Eur. J. Oper. Res..

[14]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[15]  Stephen Grossberg,et al.  Neural expectation: cerebellar and retinal analogs of cells fired by learnable or unlearned pattern classes , 2004, Kybernetik.

[16]  Yoshiyasu Takefuji,et al.  Scaling properties of neural networks for job-shop scheduling , 1995, Neurocomputing.

[17]  Cihan H. Dagli,et al.  A parallel genetic-neuro scheduler for job-shop scheduling problems , 1997 .

[18]  Laurene V. Fausett,et al.  Fundamentals Of Neural Networks , 1994 .

[19]  Ihsan Sabuncuoglu,et al.  Simulation metamodelling with neural networks: An experimental investigation , 2002 .

[20]  Éric D. Taillard,et al.  Benchmarks for basic scheduling problems , 1993 .

[21]  Stephen Grossberg,et al.  Adaptive pattern classification and universal recoding: II. Feedback, expectation, olfaction, illusions , 1976, Biological Cybernetics.

[22]  T Çakar,et al.  Artificial neural networks for design of manufacturing systems and selection of priority rules , 2004, Int. J. Comput. Integr. Manuf..

[23]  M. Chen,et al.  Applications of neural networks to solving SMT scheduling problems a case study , 1999 .

[24]  Kate Smith-Miles,et al.  Neural Networks for Combinatorial Optimization: A Review of More Than a Decade of Research , 1999, INFORMS J. Comput..

[25]  R Bäuerle.  [Vibrotactile information transfer using sequences of binary signals]. , 1974, Kybernetik.

[26]  Yuehwern Yih,et al.  A competitive neural network approach to multi-objective FMS scheduling , 1998 .

[27]  Kate A. Smith,et al.  Neural Networks for Combinatorial Optimization: a Review of More Than a Decade of Research , 1999 .

[28]  Y.-R. Shine,et al.  Attribute Selection for Neural Network-Based Adaptive Scheduling Systems in Flexible Manufacturing Systems , 2002 .

[29]  William B. Levy,et al.  Determination of parameters in a Hopfield/Tank computational network , 1988, IEEE 1988 International Conference on Neural Networks.

[30]  Vladimir Cherkassky,et al.  A neural network approach to job-shop scheduling , 1991, IEEE Trans. Neural Networks.

[31]  Geoffrey E. Hinton,et al.  Learning and relearning in Boltzmann machines , 1986 .

[32]  Min-Jea Tahk,et al.  Acceleration of the convergence speed of evolutionary algorithms using multi-layer neural networks , 2003 .

[33]  Mohamed Ben-Daya,et al.  A tabu search approach for the flow shop scheduling problem , 1998, Eur. J. Oper. Res..

[34]  Gao Liansheng,et al.  Intelligent scheduling model and algorithm for manufacturing , 2000 .

[35]  Patrick R. McMullen,et al.  A Kohonen self-organizing map approach to addressing a multiple objective, mixed-model JIT sequencing problem , 2001 .

[36]  David E. van den Bout,et al.  A traveling salesman objective function that works , 1988, IEEE 1988 International Conference on Neural Networks.

[37]  Yoshiyasu Takefuji,et al.  Stochastic neural networks for solving job-shop scheduling. I. Problem representation , 1988, IEEE 1988 International Conference on Neural Networks.

[38]  Ling Li,et al.  Using MLP networks to design a production scheduling system , 2003, Comput. Oper. Res..

[39]  Ihsan Sabuncuoglu.  Scheduling with neural networks : A review of the literature and new research directtions , 1998 .

[40]  W. Pitts,et al.  A Logical Calculus of the Ideas Immanent in Nervous Activity (1943) , 2021, Ideas That Created the Future.

[41]  A. S. Jain,et al.  Job-shop scheduling using neural networks , 1998 .

[42]  Emile H. L. Aarts,et al.  Simulated annealing and Boltzmann machines - a stochastic approach to combinatorial optimization and neural computing , 1990, Wiley-Interscience series in discrete mathematics and optimization.

[43]  K. Dejong,et al.  An analysis of the behavior of a class of genetic adaptive systems , 1975 .

[44]  R. A. Dudek,et al.  A Heuristic Algorithm for the n Job, m Machine Sequencing Problem , 1970 .

[45]  MuDer Jeng,et al.  Non-energy based neural networks for job-shop scheduling , 1997 .

[46]  T. Kohonen.  Self-organized formation of topographically correct feature maps , 1982 .

[47]  Derya Eren Akyol,et al.  Application of neural networks to heuristic scheduling algorithms , 2004, Comput. Ind. Eng..

[48]  Ching Y. Suen,et al.  Developing a neural network approach for intelligent scheduling in GUESS , 2000, Expert Syst. J. Knowl. Eng..

[49]  James P. Ignizio,et al.  A stochastic neural network for resource constrained scheduling , 1992, Comput. Oper. Res..

[50]  Carsten Peterson,et al.  A Mean Field Theory Learning Algorithm for Neural Networks , 1987, Complex Syst..

[51]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[52]  Marc M. Van Hulle.  A goal programming network for linear programming , 2004, Biological Cybernetics.

[53]  Teuvo Kohonen,et al.  Self-organized formation of topologically correct feature maps , 2004, Biological Cybernetics.

[54]  Tao Li,et al.  Design of Competition-Based Neural Networks for Combinatorial Optimization , 1990, Int. J. Neural Syst..

[55]  Shengxiang Yang,et al.  Constraint satisfaction adaptive neural network and heuristics combined approaches for generalized job-shop scheduling , 2000, IEEE Trans. Neural Networks Learn. Syst..

[56]  Michael J. Shaw,et al.  A neural-net approach to real time flow-shop sequencing , 2000 .

[57]  J. D. Schaffer,et al.  Combinations of genetic algorithms and neural networks: a survey of the state of the art , 1992, [Proceedings] COGANN-92: International Workshop on Combinations of Genetic Algorithms and Neural Networks.

[58]  Yuehwern Yih,et al.  Integration of inductive learning and neural networks for multi-objective FMS scheduling , 1998 .

[59]  Chao-Ton Su,et al.  An enhanced knowledge representation for decision-tree based learning adaptive scheduling , 2003, Int. J. Comput. Integr. Manuf..

[60]  Varghese S. Jacob,et al.  Augmented neural networks for task scheduling , 2003, Eur. J. Oper. Res..

[61]  Nabil A. Kartam,et al.  An artificial neural network for resource leveling problems , 1998, Artificial Intelligence for Engineering Design, Analysis and Manufacturing.

[62]  J J Hopfield,et al.  Neurons with graded response have collective computational properties like those of two-state neurons. , 1984, Proceedings of the National Academy of Sciences of the United States of America.

[63]  Mooyoung Jung,et al.  Satisfaction assessment of multi-objective schedules using neural fuzzy methodology , 2003 .

[64]  Shengxiang Yang,et al.  A new adaptive neural network and heuristics hybrid approach for job-shop scheduling , 2001, Comput. Oper. Res..

[65]  Loren Paul Rees,et al.  Using Neural Networks to Determine Internally-Set Due-Date Assignments for Shop Scheduling* , 1994 .

[66]  Ravi Shankar,et al.  A neuro-tabu search heuristic for the flow shop scheduling problem , 2004, Comput. Oper. Res..

[67]  Stephen Grossberg,et al.  Art 2: Self-Organization Of Stable Category Recognition Codes For Analog Input Patterns , 1988, Other Conferences.

[68]  B. Kamgar-Parsi.  Dynamical stability and parameter selection in neural optimization , 1992, [Proceedings 1992] IJCNN International Joint Conference on Neural Networks.

[69]  Shaharuddin Salleh,et al.  A Neural Network Model For The Common Due Date Job Scheduling On Unrelated Parallel Machines , 2003, Int. J. Comput. Math..

[70]  C. McDiarmid.  SIMULATED ANNEALING AND BOLTZMANN MACHINES A Stochastic Approach to Combinatorial Optimization and Neural Computing , 1991 .

[71]  K. T. Yeo,et al.  An expert neural network system for dynamic job shop scheduling , 1994 .

[72]  H. Wang,et al.  Design of efficient hybrid neural networks for flexible flow shop scheduling , 2003, Expert Syst. J. Knowl. Eng..

[73]  Kunihiko Fukushima,et al.  Cognitron: A self-organizing multilayered neural network , 1975, Biological Cybernetics.

[74]  W. Chen,et al.  An action strategy generation framework for an on-line scheduling and control system in batch processes with neural networks , 1997 .

[75]  J. J. Hopfield,et al.  “Neural” computation of decisions in optimization problems , 1985, Biological Cybernetics.

[76]  Yoshiyasu Takefuji,et al.  Integer linear programming neural networks for job-shop scheduling , 1988, IEEE 1988 International Conference on Neural Networks.

[77]  Takashi Kido,et al.  Analysis And Comparisons of Genetic Algorithm, Simulated Annealing, Tabu Search, and Evolutionary Combination Algorithm , 1994, Informatica.

[78]  Derya Eren Akyol,et al.  A Coupled Gradient Network Approach for the Multi Machine Earliness and Tardiness Scheduling Problem , 2005, ICCSA.

[79]  Xin Yao,et al.  Global optimisation by evolutionary algorithms , 1997, Proceedings of IEEE International Symposium on Parallel Algorithms Architecture Synthesis.

[80]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[81]  Sanjit K. Mitra,et al.  Alternative networks for solving the traveling salesman problem and the list-matching problem , 1988, IEEE 1988 International Conference on Neural Networks.

[82]  Wu Zhiming,et al.  Job shop scheduling in real-time cases , 2004 .

[83]  Egon Balas,et al.  The Shifting Bottleneck Procedure for Job Shop Scheduling , 1988 .

[84]  Cihan H. Dagli,et al.  Genetic neuro-scheduler for job shop scheduling , 1993 .

[85]  Yueh-Min Huang,et al.  Scheduling multiprocessor job with resource and timing constraints using neural networks , 1999, IEEE Trans. Syst. Man Cybern. Part B.

[86]  P. Werbos,et al.  Beyond Regression : "New Tools for Prediction and Analysis in the Behavioral Sciences , 1974 .

[87]  G. G. Coghill,et al.  Genetic breeding of control parameters for the Hopfield/Tank neural net , 1992, [Proceedings 1992] IJCNN International Joint Conference on Neural Networks.

[88]  Young Hoon Lee,et al.  Scheduling jobs on parallel machines applying neural network and heuristic rules , 2000 .

[89]  Peter B. Luh,et al.  Lagrangian relaxation neural networks for job shop scheduling , 2000, IEEE Trans. Robotics Autom..

[90]  Mahesan Niranjan,et al.  A theoretical investigation into the performance of the Hopfield model , 1990, IEEE Trans. Neural Networks.

[91]  Katsumi Morikawa,et al.  Neural network approach for minimizing the makespan of the general job-shop , 1994 .

[92]  Lawrence J. Fogel,et al.  Artificial Intelligence through Simulated Evolution , 1966 .

[93]  Sung-Bae Cho,et al.  Evolutionary Learning of Modular Neural Networks with Genetic Programming , 1998, Applied Intelligence.

[94]  Y. Akiyama,et al.  Combinatorial optimization with Gaussian machines , 1989, International 1989 Joint Conference on Neural Networks.

[95]  John J. Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities , 1999 .

[96]  Heinz Mühlenbein,et al.  The parallel genetic algorithm as function optimizer , 1991, Parallel Comput..

[97]  Sema E. Alptekin,et al.  Adaptive scheduling and control using artificial neural networks and expert systems for a hierarchical/distributed FMS architecture , 1990, [1990] Proceedings. Rensselaer's Second International Conference on Computer Integrated Manufacturing.

[98]  Hans-Paul Schwefel,et al.  Evolution and optimum seeking , 1995, Sixth-generation computer technology series.

[99]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[100]  Sweet.  Determination of parameters in a Hopfield/Tank computational network , 1988 .

[101]  Young Hoon Lee,et al.  A hybrid approach to sequencing jobs using heuristic rules and neural networks , 1995 .

[102]  Inyong Ham,et al.  A heuristic algorithm for the m-machine, n-job flow-shop sequencing problem , 1983 .

[103]  Hans-Paul Schwefel,et al.  Numerical Optimization of Computer Models , 1982 .

[104]  Ibrahim H. Osman.  Preface: focused issue on applied meta-heuristics , 2003 .

[105]  Xin Yao,et al.  Towards designing artificial neural networks by evolution , 1998 .

[106]  F. Frank Chen,et al.  Intelligent scheduling and control of rail-guided vehicles and load/unload operations in a flexible manufacturing system , 1999, J. Intell. Manuf..

[107]  Akio Yamamoto,et al.  Scheduling for minimizing total actual flow time by neural networks , 1992 .

[108]  Daniel J. Fonseca,et al.  Artificial neural networks for job shop simulation , 2002, Adv. Eng. Informatics.

[109]  Kenneth Alan De Jong,et al.  An analysis of the behavior of a class of genetic adaptive systems. , 1975 .

[110]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[111]  Marc M. Van Hulle.  A Goal Programming Network for Mixed Integer Linear Programming: a CaseStudy for the Job-Shop Scheduling Problem , 1991, Int. J. Neural Syst..

[112]  Yohanan Arzi,et al.  Neural network-based adaptive production control system for a flexible manufacturing cell under a random environment , 1999 .

[113]  C. Malsburg,et al.  How patterned neural connections can be set up by self-organization , 1976, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[114]  Fred W. Glover,et al.  Future paths for integer programming and links to artificial intelligence , 1986, Comput. Oper. Res..

[115]  Ihsan Sabuncuoglu,et al.  A neural network model for scheduling problems , 1996 .

[116]  Yueh-Min Huang,et al.  Multiprocessor Task Assignment with Fuzzy Hopfield Neural Network Clustering Technique , 2001, Neural Computing & Applications.

[117]  Zhen-Ping Lo,et al.  Multiple job scheduling with artificial neural networks , 1993 .

[118]  Long-Sheng Chen,et al.  Using Functional Virtual Population as assistance to learn scheduling knowledge in dynamic manufacturing environments , 2003 .

[119]  C. Malsburg.  Self-organization of orientation sensitive cells in the striate cortex , 2004, Kybernetik.

[120]  S. Grossberg,et al.  Adaptive pattern classification and universal recoding: I. Parallel development and coding of neural feature detectors , 1976, Biological Cybernetics.

[121]  Stan Z. Li,et al.  Improving convergence and solution quality of Hopfield-type neural networks with augmented Lagrange multipliers , 1996, IEEE Trans. Neural Networks.

[122]  Michael Pinedo,et al.  A heuristic to minimize the total weighted tardiness with sequence-dependent setups , 1997 .

[123]  Yueh-Min Huang,et al.  Competitive neural network to solve scheduling problems , 2001, Neurocomputing.

[124]  Alberto Alvarez,et al.  A Neural Network with Evolutionary Neurons , 2002, Neural Processing Letters.

[125]  Xin Yao,et al.  Optimization by Genetic Annealing , 1991 .

[126]  Heng Li,et al.  A production rescheduling expert simulation system , 2000, Eur. J. Oper. Res..

[127]  Jay Liebowitz,et al.  Intelligent Scheduling with GUESS (Generically Used Expert Scheduling System): Development and Testing Results , 1997 .

[128]  Kate Smith-Miles,et al.  Artificial Neural Networks for Combinatorial Optimization , 2003, Handbook of Metaheuristics.

[129]  Yuehwern Yih,et al.  Selection of dispatching rules on multiple dispatching decision points in real-time scheduling of a semiconductor wafer fabrication system , 2003 .

[130]  Charles R. Standridge,et al.  Modeling and Analysis of Manufacturing Systems , 1993 .

[131]  T. M. Willems,et al.  Implementing heuristics as an optimization criterion in neural networks for job-shop scheduling , 1995, J. Intell. Manuf..

[132]  Fong-Yuen Ding,et al.  Heuristics for scheduling flexible flow lines , 1994 .