Confidence Interval Assessment for Charpy Impact Energy Predictions – A Gaussian Mixture Model (GMM)-Based Approach

Abstract One of the obstacles of applying data-driven models in industry is the lack of confidence in the accuracy of the model predictions. One way of overcoming this is by adding a confidence interval on the predictions. In this paper, we propose a new approach for the confidence interval assessment for model predictions based on a Gaussian Mixture Model (GMM) framework. The advantages of the presented approach include its capability to handle complicated non-white noise sequences, the ability to provide an accurate confidence interval, and its independence to the type of the data model to be assessed. The proposed approach is applied to an industrial case study: the Charpy impact energy prediction, which includes real industrial data containing a significant noise component and with an inherited sparse data distribution. The resulting confidence intervals reflect the prediction uncertainty against the test data. Furthermore, the GMM-based approach can also be used for model bias correction. The GMM-based confidence interval assessment for data driven models represents a valuable contribution especially in the case of critical applications.

[1]  Michael I. Jordan,et al.  Hierarchical Mixtures of Experts and the EM Algorithm , 1994, Neural Computation.

[2]  Daniel Graupe,et al.  Principles of Artificial Neural Networks - 2nd Edition , 2007, Advanced Series in Circuits and Systems.

[3]  Daniel Graupe,et al.  Principles of Artificial Neural Networks , 2018, Advanced Series in Circuits and Systems.

[4]  George Panoutsos,et al.  A neural-fuzzy modelling framework based on granular computing: Concepts and applications , 2010, Fuzzy Sets Syst..

[5]  Tomi Kinnunen,et al.  Comparative evaluation of maximum a Posteriori vector quantization and gaussian mixture models in speaker verification , 2009, Pattern Recognit. Lett..

[6]  D. N. Geary Mixture Models: Inference and Applications to Clustering , 1989 .

[7]  I. Jolliffe Principal Component Analysis , 2002 .

[8]  Michael I. Jordan,et al.  Hierarchical Mixtures of Experts and the EM Algorithm , 1994 .

[9]  Mahdi Mahfouf,et al.  Modelling Charpy Impact Energy of Heat-Treated-Steel using Efficient Neural-Networks & Genetic-Algorithms , 2009 .

[10]  Anthony J. Hayter,et al.  Probability and statistics for engineers and scientists , 1996 .

[11]  Heekuck Oh,et al.  Neural Networks for Pattern Recognition , 1993, Adv. Comput..

[12]  A. J. Morris,et al.  Confidence bounds for neural network representations , 1997 .

[13]  Mahdi Mahfouf,et al.  Tensile Strength Prediction for Hot Rolled Steels by Bayesian Neural Network Model , 2009 .

[14]  David H. Wolpert,et al.  Stacked generalization , 1992, Neural Networks.

[15]  Heikki Mannila,et al.  Principles of Data Mining , 2001, Undergraduate Topics in Computer Science.

[16]  Lutz Hamel,et al.  Knowledge Discovery with Support Vector Machines , 2009 .

[17]  Ian T. Jolliffe,et al.  Principal Component Analysis , 2002, International Encyclopedia of Statistical Science.

[18]  Mahdi Mahfouf,et al.  Characterisation of Model Error for Charpy Impact Energy of Heat Treated Steels Using Probabilistic Reasoning and a Gaussian Mixture Model , 2009 .

[19]  Derek A. Linkens,et al.  Ensemble neural network model for steel properties prediction , 2000 .

[20]  L. Zhang,et al.  Energy Clearing Price Prediction and Confidence Interval Estimation with Cascaded Neural Networks , 2002, IEEE Power Engineering Review.

[21]  Minyou Chen,et al.  A fuzzy predictive model with confidence interval estimation for alloy property assessment , 2008, 2008 Chinese Control and Decision Conference.

[22]  Kwok-Wing Chau,et al.  A new image thresholding method based on Gaussian mixture model , 2008, Appl. Math. Comput..