Function Prediction at One Inaccessible Point Using Converging Lines

The focus of this paper is a strategy for making a prediction at a point where a function cannot be evaluated. The key idea is to take advantage of the fact that prediction is needed at one point and not in the entire domain. This paper explores the possibility of predicting a multidimensional function using multiple one-dimensional lines converging on the inaccessible point. The multidimensional approximation is thus transformed into several one-dimensional approximations, which provide multiple estimates at the inaccessible point. The Kriging model is adopted in this paper for the one-dimensional approximation, estimating not only the function value but also the uncertainty of the estimate at the inaccessible point. Bayesian inference is then used to combine multiple predictions along lines. We evaluated the numerical performance of the proposed approach using eight-dimensional and 100-dimensional functions in order to illustrate the usefulness of the method for mitigating the curse of dimensionality in surrogate-based predictions. Finally, we applied the method of converging lines to approximate a twodimensional drag coefficient function. The method of converging lines proved to be more accurate, robust, and reliable than a multidimensional Kriging surrogate for single-point prediction. [DOI: 10.1115/1.4036130]

[1]  A. Haselbacher,et al.  Improved Drag Correlation for Spheres and Application to Shock-Tube Experiments , 2010 .

[2]  Guofu Zhou,et al.  Forecasting Stock Returns , 2013 .

[3]  Holger Dette,et al.  Generalized Latin Hypercube Design for Computer Experiments , 2010, Technometrics.

[4]  Raphael T. Haftka,et al.  Surrogate-based Analysis and Optimization , 2005 .

[5]  L.F.A. Wessels,et al.  Extrapolation and interpolation in neural network classifiers , 1992, IEEE Control Systems.

[6]  Dawn An,et al.  Practical options for selecting data-driven or physics-based prognostics algorithms with reviews , 2015, Reliab. Eng. Syst. Saf..

[7]  Andrew Gordon Wilson,et al.  Gaussian Process Kernels for Pattern Discovery and Extrapolation , 2013, ICML.

[8]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[9]  G. G. Wang,et al.  Metamodeling for High Dimensional Simulation-Based Design Problems , 2010 .

[10]  Patrick J. Roache,et al.  Verification and Validation in Computational Science and Engineering , 1998 .

[11]  Bryan Glaz,et al.  Application of a Weighted Average Surrogate Approach to Helicopter Rotor Blade Vibration Reduction , 2007 .

[12]  Jerome H. Friedman,et al.  Diagnostics and extrapolation in machine learning , 2004 .

[13]  R. Haftka,et al.  Ensemble of surrogates , 2007 .

[14]  K. Rajaiah,et al.  Quasi-Square Hole with Optimum Shape in an Infinite Plate Subjected to In-Plane Loading. Optimization of Inner and Outer Boundaries of Beams and Plates with Holes, , 1981 .

[15]  William A. Verdini,et al.  Characterizing the Domain of a Regression Model , 1988 .

[16]  Giles Hooker,et al.  Prediction-based regularization using data augmented regression , 2012, Stat. Comput..

[17]  B. M. Hill,et al.  Bayesian Inference in Statistical Analysis , 1974 .

[18]  Carolyn Conner Seepersad,et al.  Building Surrogate Models Based on Detailed and Approximate Simulations , 2004, DAC 2004.

[19]  Reducing Error of Polynomial Approximation Outside of Designated Design Space for Practical Problems , 2014 .

[20]  Avram Sidi,et al.  Practical Extrapolation Methods - Theory and Applications , 2003, Cambridge monographs on applied and computational mathematics.

[21]  R. Haftka,et al.  Multiple surrogates: how cross-validation errors can help us to obtain the best predictor , 2009 .

[22]  Joseph J. George,et al.  Weather Forecasting for Aeronautics , 2014 .

[23]  M. Stein Large sample properties of simulations using latin hypercube sampling , 1987 .

[24]  R. Haftka,et al.  Optimistic Bias in Surrogate Prediction near Surrogate Optima , 2014 .