Design of manufacturing systems by a hybrid approach with neural network metamodelling and stochastic local search

Metamodels are models of simulation models. Metamodels are able to estimate the simulation responses corresponding to a given combination of input variables. A simulation metamodel is easier to manage and provides more insights than simulation alone. Traditionally, the multiple regression analysis is utilized to develop the metamodel from a set of simulation experiments. Simulation can consequentially benefit from the metamodelling in post-simulation analysis. A backpropagation (BP) neural network is a proven tool in providing excellent response predictions in many application areas and it outperforms regression analysis for a wide array of applications. In this paper, a BP neural network is used to generate metamodels for simulated manufacturing systems. For the purpose of optimal manufacturing systems design, mathematical models can be formulated by using the mapping functions generated from the neural network metamodels. The optimization model is then solved by a stochastic local search approach, simulated annealing (SA), to obtain an optimal configuration with respect to the objective of the systems design. Instead of triggering the detailed simulation programs, the SA-based optimization procedure evaluates the simulation outputs by the neural network metamodels. By using the SA-based optimization algorithm, the solution space of the studied problem is extensively exploited to escape the entrapment of local optima while the number of time consuming simulation runs is reduced. The proposed methodology is illustrated to be both effective and efficient in solving a manufacturing systems design problem through an example.

[1]  Averill M. Law,et al.  Simulation Modeling and Analysis , 1982 .

[2]  Jack P. C. Kleijnen,et al.  Regression metamodels for generalizing simulation results. , 1979 .

[3]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[4]  Richard D. De Veaux,et al.  [Neural Networks in Applied Statistics]: Discussion , 1996 .

[5]  Chao-Ton Su,et al.  Neural network procedures for experimental analysis with censored data , 1998 .

[6]  Linda Weiser Friedman,et al.  The Metamodel in Simulation Analysis: Can It Be Trusted? , 1988 .

[7]  Richard W. Eglese,et al.  Simulated annealing: A tool for operational research , 1990 .

[8]  Douglas C. Montgomery,et al.  Multiple response surface methods in computer simulation , 1977 .

[9]  V. Barnett,et al.  Applied Linear Statistical Models , 1975 .

[10]  Hal S. Stern,et al.  Neural networks in applied statistics , 1996 .

[11]  Jan Karel Lenstra,et al.  Job Shop Scheduling by Simulated Annealing , 1992, Oper. Res..

[12]  Du-Ming Tsai,et al.  A simulated annealing approach for optimization of multi-pass turning operations , 1996 .

[13]  Christos Koulamas,et al.  A survey of simulated annealing applications to operations research problems , 1994 .

[14]  Henri Pierreval,et al.  Distributed evolutionary algorithms for simulation optimization , 2000, IEEE Trans. Syst. Man Cybern. Part A.

[15]  Jack P. C. Kleijnen,et al.  Experimental Design for Sensitivity Analysis, Optimization and Validation of Simulation Models , 1997 .

[16]  Alfredo Vellido,et al.  Neural networks in business: a survey of applications (1992–1998) , 1999 .

[17]  S. H. Huang,et al.  Applications of neural networks in manufacturing: a state-of-the-art survey , 1995 .

[18]  Murray Smith,et al.  Neural Networks for Statistical Modeling , 1993 .

[19]  R. D. Hurrion,et al.  A comparison of factorial and random experimental design methods for the development of regression and neural network simulation metamodels , 1999, J. Oper. Res. Soc..

[20]  Christian N. Madu,et al.  A regression metamodel of a maintenance float problem with Erlang-2 failure distribution , 1992 .

[21]  Charles Leave Neural Networks: Algorithms, Applications and Programming Techniques , 1992 .

[22]  R. Deal Simulation Modeling and Analysis (2nd Ed.) , 1994 .

[23]  M. F. Franklin Constructing Tables of Minimum Aberration pn-m Designs , 1984 .

[24]  Douglas C. Montgomery,et al.  Second-order response surface designs in computer simulation , 1975 .

[25]  B. Yu,et al.  Metamodels in manufacturing: a review , 1994 .

[26]  Linet Özdamar,et al.  Experiments with new stochastic global optimization search techniques , 2000, Comput. Oper. Res..

[27]  Pandu R. Tadikamalla,et al.  Multicriteria design and control of a cellular manufacturing system through simulation and optimization , 1998 .

[28]  Sandro Ridella,et al.  Minimizing multimodal functions of continuous variables with the “simulated annealing” algorithmCorrigenda for this article is available here , 1987, TOMS.

[29]  Pandu R. Tadikamalla,et al.  Output maximization of a CIM system: simulation and statistical approach , 1993 .

[30]  George Harhalakis,et al.  CLASS: Computerized LAyout Solutions using Simulated annealing , 1992 .