High-low level support vector regression prediction approach (HL-SVR) for data modeling with input parameters of unequal sample sizes

Support vector regression (SVR) has been widely used to reduce the high computational cost of computer simulation. SVR assumes the input parameters have equal sample sizes, but unequal sample sizes are often encountered in engineering practices. To solve this issue, a new prediction approach based on SVR, namely as high-low-level SVR approach (HL-SVR) is proposed for data modeling of input parameters of unequal sample sizes in this paper. The proposed approach is consisted of low-level SVR models for the input parameters of larger sample sizes and high-level SVR model for the input parameters of smaller sample sizes. For each training point of the input parameters of smaller sample sizes, one low-level SVR model is built based on its corresponding input parameters of larger sample sizes and their responses of interest. The high-level SVR model is built based on the obtained responses from the low-level SVR models and the input parameters of smaller sample sizes. Several numerical examples are used to validate the performance of HL-SVR. The experimental results indicate that HL-SVR can produce more accurate prediction results than conventional SVR. The proposed approach is applied on the stress analysis of dental implant, which the structural parameters have massive samples but the material of implant can only be selected from several Ti and its alloys. The prediction performance of the proposed approach is much better than the conventional SVR. The proposed approach can be used for the design, optimization and analysis of engineering systems with input parameters of unequal sample sizes.

[1]  J. Sacks,et al.  Analysis of protein activity data by Gaussian stochastic process models. , 1999, Journal of biopharmaceutical statistics.

[2]  Maolin Shi,et al.  Multidisciplinary design optimization of dental implant based on finite element method and surrogate models , 2017 .

[3]  José María Manero,et al.  Mechanical Characterisation and Biomechanical and Biological Behaviours of Ti-Zr Binary-Alloy Dental Implants , 2017, BioMed research international.

[4]  Sancho Salcedo-Sanz,et al.  Efficient aerodynamic design through evolutionary programming and support vector regression algorithms , 2012, Expert Syst. Appl..

[5]  Richard J. Beckman,et al.  A Comparison of Three Methods for Selecting Values of Input Variables in the Analysis of Output From a Computer Code , 2000, Technometrics.

[6]  Funda Bayindir,et al.  Effect of Implant Diameter and Length on Stress Distribution for Titanium and Zirconia Implants by Using Finite Element Analysis (FEA) , 2015 .

[7]  Peter Z. G. Qian,et al.  Sliced space-filling designs , 2009 .

[8]  V. Roshan Joseph,et al.  Functionally Induced Priors for the Analysis of Experiments , 2007, Technometrics.

[9]  Liang Gao,et al.  Difference mapping method using least square support vector regression for variable-fidelity metamodelling , 2015 .

[10]  Bernhard Schölkopf,et al.  A tutorial on support vector regression , 2004, Stat. Comput..

[11]  H. Yılmaz,et al.  Evaluation of stress distributions occurring on zirconia and titanium implant-supported prostheses: A three-dimensional finite element analysis. , 2016, The Journal of prosthetic dentistry.

[12]  Alexander I. J. Forrester,et al.  Multi-fidelity optimization via surrogate modelling , 2007, Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[13]  Pijush Samui,et al.  Utilization of a least square support vector machine (LSSVM) for slope stability analysis , 2011 .

[14]  Tsuyoshi Murata,et al.  {m , 1934, ACML.

[15]  Yulei Zhang,et al.  Computer Experiments with Qualitative and Quantitative Variables: A Review and Reexamination , 2015 .

[16]  Ping Zhu,et al.  Metamodel-based lightweight design of B-pillar with TWB structure via support vector regression , 2010 .

[17]  Wei Chen,et al.  Use of support vector regression in structural optimization: Application to vehicle crashworthiness design , 2012, Math. Comput. Simul..

[18]  Fernando Sánchez-Lasheras,et al.  Biomechanical Consequences of the Elastic Properties of Dental Implant Alloys on the Supporting Bone: Finite Element Analysis , 2016, BioMed research international.

[19]  Raphael T. Haftka,et al.  Surrogate-based Analysis and Optimization , 2005 .

[20]  Denni Kurniawan,et al.  Stress Distribution Due to Loading on Premolar Teeth Implant: A Three Dimensional Finite Element Analysis☆ , 2015 .

[21]  Konstantinos C. Gryllias,et al.  A Support Vector Machine approach based on physical model training for rolling element bearing fault detection in industrial environments , 2012, Eng. Appl. Artif. Intell..

[22]  Martin Rücker,et al.  Influence of lubricant on screw preload and stresses in a finite element model for a dental implant. , 2014, The Journal of prosthetic dentistry.

[23]  Amit B Nehete,et al.  Stress Evaluation of Titanium-gold and Titanium-aluminum-vanadium Alloy for Orthodontic Implants: A Comparative Finite Element Model Study , 2017 .

[24]  Damiano Pasini,et al.  A comparative study of metamodeling methods for the design optimization of variable stiffness composites , 2014 .

[25]  Atin Roy,et al.  Support vector regression based metamodeling for seismic reliability analysis of structures , 2018, Applied Mathematical Modelling.

[26]  Daniele Peri,et al.  High-Fidelity Models and Multiobjective Global Optimization Algorithms in Simulation-Based Design , 2005 .

[27]  W. Müller,et al.  Finite element analysis of the biomechanical effects of PEEK dental implants on the peri-implant bone. , 2015, Journal of biomechanics.

[28]  Stefan Ihde,et al.  The use of finite element analysis to model bone-implant contact with basal implants. , 2008, Oral surgery, oral medicine, oral pathology, oral radiology, and endodontics.

[29]  Piet Demeester,et al.  A Surrogate Modeling and Adaptive Sampling Toolbox for Computer Based Design , 2010, J. Mach. Learn. Res..

[30]  Zheng O'Neill,et al.  A methodology for meta-model based optimization in building energy models , 2012 .

[31]  João Paulo Mendes Tribst,et al.  Comparative three-dimensional finite element analysis of implant-supported fixed complete arch mandibular prostheses in two materials , 2017, Journal of Indian Prosthodontic Society.

[32]  Timothy W. Simpson,et al.  Analysis of support vector regression for approximation of complex engineering analyses , 2003, DAC 2003.

[33]  P. Dechow,et al.  Variations in cortical material properties throughout the human dentate mandible. , 2003, American journal of physical anthropology.