Optimization of manufacturing systems using a neural network metamodel with a new training approach

In this study, two manufacturing systems, a kanban-controlled system and a multi-stage, multi-server production line in a diamond tool production system, are optimized utilizing neural network metamodels (tst_NNM) trained via tabu search (TS) which was developed previously by the authors. The most widely used training algorithm for neural networks has been back propagation which is based on a gradient technique that requires significant computational effort. To deal with the major shortcomings of back propagation (BP) such as the tendency to converge to a local optimal and a slow convergence rate, the TS metaheuristic method is used for the training of artificial neural networks to improve the performance of the metamodelling approach. The metamodels are analysed based on their ability to predict simulation results versus traditional neural network metamodels that have been trained by BP algorithm (bp_NNM). Computational results show that tst_NNM is superior to bp_NNM for both of the manufacturing systems.

[1]  M. Laguna,et al.  Neural network prediction in a system for optimizing simulations , 2002 .

[2]  K. K. Chan,et al.  On-line optimization of quality in a manufacturing system , 2001 .

[3]  Noureddine Zerhouni,et al.  Control of Manufacturing Systems Using Neural Networks , 1995, EUROSIM.

[4]  Taho Yang,et al.  Design of manufacturing systems by a hybrid approach with neural network metamodelling and stochastic local search , 2002 .

[5]  B. W. Saunders.  Design of manufacturing systems , 1962 .

[6]  László Monostori,et al.  Hybrid, AI- and simulation-supported optimisation of process chains and production plants , 2001 .

[7]  Fulya Altiparmak,et al.  A comparison of the performance of artificial intelligence techniques for optimizing the number of kanbans , 2002, J. Oper. Res. Soc..

[8]  Fulya Altiparmak,et al.  Buffer allocation and performance modeling in asynchronous assembly system operations: An artificial neural network metamodeling approach , 2007, Appl. Soft Comput..

[9]  Kai Yang,et al.  Application of artificial neural network to identify non-random variation patterns on the run chart in automotive assembly process , 2003 .

[10]  Mansooreh Mollaghasemi,et al.  Application of Neural Networks and Simulation Modeling in Manufacturing System Design , 1998, Interfaces.

[11]  Hemant K. Bhargava,et al.  Repairing Misbehaving Mathematical Programming Models: Concepts and a Gams-Based Approach , 1998 .

[12]  Fred W. Glover,et al.  Tabu Search - Part I , 1989, INFORMS J. Comput..

[13]  M. Stone.  Cross‐Validatory Choice and Assessment of Statistical Predictions , 1976 .

[14]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[15]  Young Hoon Lee,et al.  Scheduling jobs on parallel machines applying neural network and heuristic rules , 2000 .

[16]  J. Nazuno.  Haykin, Simon. Neural networks: A comprehensive foundation, Prentice Hall, Inc. Segunda Edición, 1999 , 2000 .

[17]  Don R. Hush,et al.  Training a Sigmoidal Node Is Hard , 1999, Neural Computation.

[18]  Ihsan Sabuncuoglu,et al.  Simulation metamodelling with neural networks: An experimental investigation , 2002 .

[19]  Orhan Dengiz,et al.  A tabu search algorithm for the training of neural networks , 2009, J. Oper. Res. Soc..

[20]  Haldun Aytug,et al.  Determining the Number of Kanbans: A Simulation Metamodeling Approach , 1996, Simul..

[21]  Yutaka Fukuoka,et al.  A modified back-propagation method to avoid false local minima , 1998, Neural Networks.

[22]  R. D. Hurrion,et al.  An example of simulation optimisation using a neural network metamodel: finding the optimum number of kanbans in a manufacturing system , 1997 .

[23]  Tolga Bektas,et al.  Simulation optimization based DSS application: A diamond tool production line in industry , 2006, Simul. Model. Pract. Theory.

[24]  Michael J. Shaw,et al.  A neural-net approach to real time flow-shop sequencing , 2000 .

[25]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[26]  Henri Pierreval,et al.  An investigation on neural network capabilities as simulation metamodels , 1992 .

[27]  Fred Glover,et al.  Tabu Search - Part II , 1989, INFORMS J. Comput..

[28]  Ken R. McNaught,et al.  A comparison of experimental designs in the development of a neural network simulation metamodel , 2004, Simul. Model. Pract. Theory.

[29]  Daniel J. Fonseca,et al.  Simulation metamodeling through artificial neural networks , 2003 .

[30]  Robert W. Blanning,et al.  The construction and implementation of metamodels , 1975 .

[31]  Clark A. Mount-Campbell,et al.  Process optimization via neural network metamodeling , 2002 .

[32]  R. D. Hurrion,et al.  Using a Neural Network to Enhance the Decision Making Quality of a Visual Interactive Simulation Model , 1992 .

[33]  R. D. Hurrion,et al.  A comparison of factorial and random experimental design methods for the development of regression and neural network simulation metamodels , 1999, J. Oper. Res. Soc..

[34]  Taho Yang,et al.  Simulation metamodel development using uniform design and neural networks for automated material handling systems in semiconductor wafer fabrication , 2007, Simul. Model. Pract. Theory.