Improving response surface methodology by using artificial neural network and simulated annealing

Highlights? We apply neural networks to improve response surface methodology. ? We use simulated annealing algorithm to optimize the RS function obtained by ANN. ? We examine the performance of using neural network in RSM by using three test problems. Response surface methodology (RSM) explores the relationships between several explanatory variables and one or more response variables. The main idea of RSM is to use a set of designed experiments to obtain an optimal response. RSM tries to simplify the original problem through some polynomial estimation over small sections of the feasible area, elaborating on optimum provision through a well known optimization technique, say Gradient Method.As the real world problems are usually very complicated, polynomial estimation may not perform well in providing a good representation of the objective function. Also, the main problem of the Gradient Method, getting trapped in local minimum (maximum), makes RSM at a disadvantage, while defining sub-sections of the feasible area is also a problem faced by analyst.In this article, neural networks are used as a means to improve the estimation in the RSM context. This approach leads to reducing the calculations. Furthermore, it is proposed to use simulated annealing in maximizing the estimated objective function in reaching a suitable point. Three examples of different complexities are solved to shed light on the merits of the proposed method. The comparison results indicate that the proposed algorithm outperforms the classical method.

[1]  Martin Pincus,et al.  Letter to the Editor - A Monte Carlo Method for the Approximate Solution of Certain Types of Constrained Optimization Problems , 1970, Oper. Res..

[2]  Özgür Yalçinkaya,et al.  Modelling and optimization of average travel time for a metro line by simulation and response surface methodology , 2009, Eur. J. Oper. Res..

[3]  Abdel-Moez E. Bayoumi,et al.  Prediction of flank wear and engagements from force measurements in end milling operations , 1993 .

[4]  Hanif D. Sherali,et al.  An enhanced response surface methodology (RSM) algorithm using gradient deflection and second-order search strategies , 1998, Comput. Oper. Res..

[5]  George E. P. Box,et al.  Empirical Model‐Building and Response Surfaces , 1988 .

[6]  Li Pheng Khoo,et al.  Integration of Response Surface Methodology with Genetic Algorithms , 2001 .

[7]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[8]  H. Su,et al.  Yield optimization of analog MOS integrated circuits including transistor mismatch , 1993, 1993 IEEE International Symposium on Circuits and Systems.

[9]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[10]  Heekuck Oh,et al.  Neural Networks for Pattern Recognition , 1993, Adv. Comput..

[11]  Douglas C. Montgomery,et al.  Response Surface Methodology: Process and Product Optimization Using Designed Experiments , 1995 .

[12]  Qianfeng Li,et al.  Optimization of on-line microwave flow injection analysis system by artificial neural networks for the determination of ruthenium , 2001 .

[13]  Pandu R. Tadikamalla,et al.  Output maximization of a CIM system: simulation and statistical approach , 1993 .

[14]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[15]  Sachiko Sukigara,et al.  Regeneration of Bombyx mori silk by electrospinning. Part 2. Process optimization and empirical modeling using response surface methodology , 2004 .

[16]  M. Bezerra,et al.  Response surface methodology (RSM) as a tool for optimization in analytical chemistry. , 2008, Talanta.

[17]  B. R. Gupta,et al.  Performance optimization of a counter rotating twin screw extruder for recycling natural rubber vulcanizates using response surface methodology , 2004 .

[18]  Peter Kemper,et al.  Combining Response Surface Methodology with Numerical Methods for Optimization of Markovian Models , 2006, IEEE Transactions on Dependable and Secure Computing.

[19]  G. Box,et al.  On the Experimental Attainment of Optimum Conditions , 1951 .

[20]  Derek J. Pike,et al.  Empirical Model‐building and Response Surfaces. , 1988 .

[21]  Jack P. C. Kleijnen,et al.  Response surface methodology's steepest ascent and step size revisited , 2004, Eur. J. Oper. Res..

[22]  R. H. Myers,et al.  Response Surface Methodology: Process and Product Optimization Using Designed Experiments , 1995 .