Gaussian Process Regression (GPR) Representation in Predictive Model Markup Language (PMML).

This paper describes Gaussian process regression (GPR) models presented in predictive model markup language (PMML). PMML is an extensible-markup-language (XML) -based standard language used to represent data-mining and predictive analytic models, as well as pre- and post-processed data. The previous PMML version, PMML 4.2, did not provide capabilities for representing probabilistic (stochastic) machine-learning algorithms that are widely used for constructing predictive models taking the associated uncertainties into consideration. The newly released PMML version 4.3, which includes the GPR model, provides new features: confidence bounds and distribution for the predictive estimations. Both features are needed to establish the foundation for uncertainty quantification analysis. Among various probabilistic machine-learning algorithms, GPR has been widely used for approximating a target function because of its capability of representing complex input and output relationships without predefining a set of basis functions, and predicting a target output with uncertainty quantification. GPR is being employed to various manufacturing data-analytics applications, which necessitates representing this model in a standardized form for easy and rapid employment. In this paper, we present a GPR model and its representation in PMML. Furthermore, we demonstrate a prototype using a real data set in the manufacturing domain.

[1]  Klaus-Dieter Thoben,et al.  Machine learning in manufacturing: advantages, challenges, and applications , 2016 .

[2]  Carl E. Rasmussen,et al.  A Unifying View of Sparse Approximate Gaussian Process Regression , 2005, J. Mach. Learn. Res..

[3]  Amiya R Mohanty,et al.  Estimation of tool wear during CNC milling using neural network-based sensor fusion , 2007 .

[4]  Kincho H. Law,et al.  An intelligent machine monitoring system for energy prediction using a Gaussian Process regression , 2014, 2014 IEEE International Conference on Big Data (Big Data).

[5]  Sudarsan Rachuri,et al.  A Generalized Data-Driven Energy Prediction Model With Uncertainty for a Milling Machine Tool Using Gaussian Process , 2015 .

[6]  S. G. Deshmukh,et al.  A genetic algorithmic approach for optimization of surface roughness prediction model , 2002 .

[7]  Jay Lee,et al.  Degradation Assessment and Fault Modes Classification Using Logistic Regression , 2005 .

[8]  Sudarsan Rachuri,et al.  Performance evaluation of a manufacturing process under uncertainty using Bayesian networks , 2016 .

[9]  Duy Nguyen-Tuong,et al.  Local Gaussian Process Regression for Real Time Online Model Learning , 2008, NIPS.

[10]  Michael I. Jordan,et al.  Machine learning: Trends, perspectives, and prospects , 2015, Science.

[11]  Michael Zeller,et al.  Efficient deployment of predictive analytics through open standards and cloud computing , 2009, SKDD.

[12]  Kevin P. Murphy,et al.  Machine learning - a probabilistic perspective , 2012, Adaptive computation and machine learning series.

[13]  Zoubin Ghahramani,et al.  Sparse Gaussian Processes using Pseudo-inputs , 2005, NIPS.

[14]  Roderick Murray-Smith,et al.  Hierarchical Gaussian process mixtures for regression , 2005, Stat. Comput..

[15]  Kincho H. Law,et al.  Evaluation of a PMML-based GPR scoring engine on a cloud platform and microcomputer board for smart manufacturing , 2016, 2016 IEEE International Conference on Big Data (Big Data).

[16]  Wen-Ching Lin,et al.  PMML in Action: Unleashing the Power of Open Standards for Data Mining and Predictive Analytics , 2010 .

[17]  Marc Cohen,et al.  Google Compute Engine , 2014 .

[18]  Graham J. Williams,et al.  PMML: An Open Standard for Sharing Models , 2009, R J..

[19]  Neil D. Lawrence,et al.  Gaussian Processes for Big Data , 2013, UAI.

[20]  Sudarsan Rachuri,et al.  Ensemble Neural Network Model for Predicting the Energy Consumption of a Milling Machine | NIST , 2015 .

[21]  Ming-Hsuan Yang,et al.  Online Sparse Gaussian Process Regression and Its Applications , 2011, IEEE Transactions on Image Processing.

[22]  Shin-ichi Maeda,et al.  Gaussian Process Regression for Rendering Music Performance , 2008 .

[23]  Yee Whye Teh,et al.  Bayesian Nonparametric Models , 2010, Encyclopedia of Machine Learning.

[24]  Michalis K. Titsias,et al.  Variational Learning of Inducing Variables in Sparse Gaussian Processes , 2009, AISTATS.

[25]  Rustam M. Vahidov,et al.  Application of machine learning techniques for supply chain demand forecasting , 2008, Eur. J. Oper. Res..

[26]  Carl E. Rasmussen,et al.  Gaussian Processes for Machine Learning (GPML) Toolbox , 2010, J. Mach. Learn. Res..

[27]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.