A prior-knowledge input LSSVR metamodeling method with tuning based on cellular particle swarm optimization for engineering design

Engineering design is usually a daunting optimization task which often involving time-consuming, even computation-prohibitive process. To reduce the computational expense, metamodels are commonly used to replace the actual expensive simulations or experiments. In this paper, a new and efficient metamodeling method named prior-knowledge input least square support vector regression (PKI-LSSVR) is developed, in which samples from different levels of fidelity are incorporated to gain an accurate approximation with limited times of the high-fidelity (HF) expensive simulations. The low-fidelity (LF) output serves as a prior-knowledge of the real response function, and then is used as the input variables of least square support vector regression (LSSVR). When the corresponding HF response is gained, a function that maps the LF outputs to HF outputs is constructed via LSSVR. The predictive accuracy of LSSVR models is highly dependent on their learning parameters. Therefore, a novel optimization method, cellular particle swarm optimization (CPSO), is exploited to seek the optimal hyper-parameters for PKI-LSSVR in order to improve its generalization capability. To get a better optimization performance, a new neighborhood function is developed for CPSO where the global and local search is efficiently balanced by adaptively varied neighbor radius. Several numerical experiments and one engineering case verify the efficiency of the proposed PKI-LSSVR method. Sample quality merits including sample sizes and noise, and metamodel performance evaluation measures incorporating accuracy, robustness, and efficiency are considered.

[1]  Guangyao Li,et al.  Multi-fidelity optimization for sheet metal forming process , 2011 .

[2]  Achille Messac,et al.  A computationally efficient metamodeling approach for expensive multiobjective optimization , 2008 .

[3]  P. A. Newman,et al.  Optimization with variable-fidelity models applied to wing design , 1999 .

[4]  Ali Akbar Ramezanianpour,et al.  Hybrid support vector regression – Particle swarm optimization for prediction of compressive strength and RCPT of concretes containing metakaolin , 2012 .

[5]  Jean-Yves Trépanier,et al.  Variable-fidelity optimization: Efficiency and robustness , 2006 .

[6]  Shawn E. Gano,et al.  Hybrid Variable Fidelity Optimization by Using a Kriging-Based Scaling Function , 2005 .

[7]  Chih-Jen Lin,et al.  Asymptotic Behaviors of Support Vector Machines with Gaussian Kernel , 2003, Neural Computation.

[8]  G. Gary Wang,et al.  Review of Metamodeling Techniques in Support of Engineering Design Optimization , 2007, DAC 2006.

[9]  Hu Wang,et al.  Adaptive MLS-HDMR metamodeling techniques for high dimensional problems , 2011, Expert Syst. Appl..

[10]  Fang Wang,et al.  Knowledge based neural models for microwave design , 1997, IMS 1997.

[11]  Hu Wang,et al.  Probability-based least square support vector regression metamodeling technique for crashworthiness optimization problems , 2011 .

[12]  Liang Gao,et al.  Cellular particle swarm optimization , 2011, Inf. Sci..

[13]  Desheng Dash Wu,et al.  Power load forecasting using support vector machine and ant colony optimization , 2010, Expert Syst. Appl..

[14]  J. Renaud,et al.  Trust region model management in multidisciplinary design optimization , 2000 .

[15]  T. Simpson,et al.  A Study on the Use of Kriging Models to Approximate Deterministic Computer Models , 2003, DAC 2003.

[16]  Leandro dos Santos Coelho,et al.  Least squares support vector machines with tuning based on chaotic differential evolution approach applied to the identification of a thermal process , 2012, Expert Syst. Appl..

[17]  Robert Hewson,et al.  Multifidelity metamodel building as a route to aeroelastic optimization of flexible wings , 2011 .

[18]  Andy J. Keane,et al.  Recent advances in surrogate-based optimization , 2009 .

[19]  Xu Chang,et al.  Notice of RetractionLS-SVR with tuned hyperparameters in dam crack forecasting , 2010, 2010 2nd International Conference on Advanced Computer Control.

[20]  T. Simpson,et al.  Comparative studies of metamodelling techniques under multiple modelling criteria , 2001 .

[21]  Timothy W. Simpson,et al.  Metamodels for Computer-based Engineering Design: Survey and recommendations , 2001, Engineering with Computers.

[22]  Kin Keung Lai,et al.  Measuring financial risk with generalized asymmetric least squares regression , 2011, Appl. Soft Comput..

[23]  Vassili Toropov,et al.  Metamodel-based collaborative optimization framework , 2009 .

[24]  Michael S. Eldred,et al.  Second-Order Corrections for Surrogate-Based Optimization with Model Hierarchies , 2004 .

[25]  Ying Zhang,et al.  Application of Least Squares Support Vector Regression Trained by Genetic Algorithm in Reliability Prediction of LAN/WLAN Integration Network , 2012 .

[26]  G. Gary Wang,et al.  Survey of modeling and optimization strategies to solve high-dimensional design problems with computationally-expensive black-box functions , 2010 .

[27]  Ping Zhu,et al.  Metamodel-based lightweight design of B-pillar with TWB structure via support vector regression , 2010 .

[28]  Timothy W. Simpson,et al.  Analysis of support vector regression for approximation of complex engineering analyses , 2003, DAC 2003.

[29]  Liang Gao,et al.  An effective cellular particle swarm optimization for parameters optimization of a multi-pass milling process , 2012, Appl. Soft Comput..

[30]  Liang Gao,et al.  A hybrid variable-fidelity global approximation modelling method combining tuned radial basis function base and kriging correction , 2013 .

[31]  John E. Renaud,et al.  Variable Fidelity Optimization Using a Kriging Based Scaling Function , 2004 .

[32]  Andy J. Keane,et al.  A Knowledge-Based Approach To Response Surface Modelling in Multifidelity Optimization , 2003, J. Glob. Optim..

[33]  N. M. Alexandrov,et al.  A trust-region framework for managing the use of approximation models in optimization , 1997 .

[34]  Wei Chen,et al.  A New Variable-Fidelity Optimization Framework Based on Model Fusion and Objective-Oriented Sequential Sampling , 2007, DAC 2007.

[35]  Dong Zhao,et al.  A comparative study of metamodeling methods considering sample quality merits , 2010 .

[36]  Yongbin Lee,et al.  Design optimization using support vector regression , 2008 .

[37]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[38]  Guangyao Li,et al.  Variable fidelity design based surrogate and artificial bee colony algorithm for sheet metal forming process , 2012 .

[39]  Jun Zheng,et al.  The Variable Fidelity Optimization for simulation-based design: A review , 2012, Proceedings of the 2012 IEEE 16th International Conference on Computer Supported Cooperative Work in Design (CSCWD).

[40]  Carolyn Conner Seepersad,et al.  A comparative study of the scalability of alternative metamodelling techniques , 2012 .

[41]  Johan A. K. Suykens,et al.  Least Squares Support Vector Machine Classifiers , 1999, Neural Processing Letters.

[42]  Timothy W. Simpson,et al.  Design and Analysis of Computer Experiments in Multidisciplinary Design Optimization: A Review of How Far We Have Come - Or Not , 2008 .

[43]  P. A. Newman,et al.  Approximation and Model Management in Aerodynamic Optimization with Variable-Fidelity Models , 2001 .

[44]  Agus Sudjianto,et al.  Blind Kriging: A New Method for Developing Metamodels , 2008 .

[45]  Ping-Feng Pai,et al.  Revenue forecasting using a least-squares support vector regression model in a fuzzy environment , 2013, Inf. Sci..

[46]  Vassili Toropov,et al.  Optimum blank design for sheet metal forming based on the interaction of high- and low-fidelity FE models , 2006 .

[47]  Lijun Yang,et al.  Particle swarm optimization-least squares support vector regression based forecasting model on dissolved gases in oil-filled power transformers , 2011 .

[48]  Qian Liu,et al.  Weighted least squares support vector machine local region method for nonlinear time series prediction , 2010, Appl. Soft Comput..