Real-Time Regression with Dividing Local Gaussian Processes

The increased demand for online prediction and the growing availability of large data sets drives the need for computationally efficient models. While exact Gaussian process regression shows various favorable theoretical properties (uncertainty estimate, unlimited expressive power), the poor scaling with respect to the training set size prohibits its application in big data regimes in real-time. Therefore, this paper proposes dividing local Gaussian processes, which are a novel, computationally efficient modeling approach based on Gaussian process regression. Due to an iterative, data-driven division of the input space, they achieve a sublinear computational complexity in the total number of training points in practice, while providing excellent predictive distributions. A numerical evaluation on real-world data sets shows their advantages over other state-of-the-art methods in terms of accuracy as well as prediction and update speed.

[1]  Michel Verhaegen,et al.  System identification through online sparse Gaussian process regression with input noise , 2016, IFAC J. Syst. Control..

[2]  Jan Peters,et al.  Learning inverse dynamics models in O(n) time with LSTM networks , 2017, 2017 IEEE-RAS 17th International Conference on Humanoid Robotics (Humanoids).

[3]  Sandra Hirche,et al.  Feedback Linearization Based on Gaussian Processes With Event-Triggered Online Learning , 2019, IEEE Transactions on Automatic Control.

[4]  Giorgio Metta,et al.  Real-time model learning using Incremental Sparse Spectrum Gaussian Process Regression. , 2013, Neural networks : the official journal of the International Neural Network Society.

[5]  Patrick Doherty,et al.  Deep Learning Quadcopter Control via Risk-Aware Active Learning , 2017, AAAI.

[6]  Richard E. Turner,et al.  Improving the Gaussian Process Sparse Spectrum Approximation by Representing Uncertainty in Frequency Inputs , 2015, ICML.

[7]  Jan Peters,et al.  Incremental Sparsification for Real-time Online Model Learning , 2010, AISTATS.

[8]  Stefan Schaal,et al.  Incremental Local Gaussian Regression , 2014, NIPS.

[9]  Jan Peters,et al.  Model learning for robot control: a survey , 2011, Cognitive Processing.

[10]  Pierre E. Dupont,et al.  Adaptive nonparametric kinematic modeling of concentric tube robots , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[11]  Torsten Koller,et al.  Learning-based Model Predictive Control for Safe Exploration and Reinforcement Learning , 2019, ArXiv.

[12]  Alec Koppel,et al.  Consistent online Gaussian process regression without the sample complexity bottleneck , 2019, Statistics and Computing.

[13]  Haitao Liu,et al.  When Gaussian Process Meets Big Data: A Review of Scalable GPs , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[14]  Francesco Borrelli,et al.  Kinematic and dynamic vehicle models for autonomous driving control design , 2015, 2015 IEEE Intelligent Vehicles Symposium (IV).

[15]  Jianbin Qiu,et al.  A Locally Weighted Project Regression Approach-Aided Nonlinear Constrained Tracking Control , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[16]  Stefan Schaal,et al.  A Library for Locally Weighted Projection Regression , 2008, J. Mach. Learn. Res..

[17]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[18]  Seung-Hyun Lee,et al.  Reduction of engine emissions via a real-time engine combustion control with an egr rate estimation model , 2017 .

[19]  Duy Nguyen-Tuong,et al.  Computed torque control with nonparametric regression models , 2008, 2008 American Control Conference.

[20]  Marc Toussaint,et al.  Efficient sparsification for Gaussian process regression , 2016, Neurocomputing.

[21]  Andrew Gordon Wilson,et al.  GPyTorch: Blackbox Matrix-Matrix Gaussian Process Inference with GPU Acceleration , 2018, NeurIPS.

[22]  Rolf Isermann,et al.  Fast neural networks for diesel engine control design , 1999 .

[23]  Jan Peters,et al.  Model Learning with Local Gaussian Process Regression , 2009, Adv. Robotics.

[24]  Benjamin Recht,et al.  Random Features for Large-Scale Kernel Machines , 2007, NIPS.

[25]  M. Wand,et al.  Real-Time Semiparametric Regression , 2012, 1209.3550.

[26]  Stefan Schaal,et al.  Drifting Gaussian processes with varying neighborhood sizes for online model learning , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[27]  Stephen Tyree,et al.  Exact Gaussian Processes on a Million Data Points , 2019, NeurIPS.

[28]  Richard E. Turner,et al.  Streaming Sparse Gaussian Process Approximations , 2017, NIPS.

[29]  Ruben Grandia,et al.  Contact Invariant Model Learning for Legged Robot Locomotion , 2018, IEEE Robotics and Automation Letters.

[30]  Duy Nguyen-Tuong,et al.  Local Gaussian Process Regression for Real Time Online Model Learning , 2008, NIPS.

[31]  Stefan Schaal,et al.  Efficient Bayesian local model learning for control , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[32]  Claudia Eckert,et al.  Lazy Gaussian Process Committee for Real-Time Online Regression , 2013, AAAI.

[33]  Lehel Csató,et al.  Sparse On-Line Gaussian Processes , 2002, Neural Computation.

[34]  Marco F. Huber.  Recursive Gaussian process: On-line regression and learning , 2014, Pattern Recognit. Lett..

[35]  Stefan Schaal,et al.  Locally Weighted Projection Regression : An O(n) Algorithm for Incremental Real Time Learning in High Dimensional Space , 2000 .

[36]  Mark van der Wilk.  Sparse Gaussian process approximations and applications , 2019 .

[37]  Stefan Schaal,et al.  Incremental Online Learning in High Dimensions , 2005, Neural Computation.

[38]  Byron Boots,et al.  Incremental Variational Sparse Gaussian Process Regression , 2016, NIPS.

[39]  Ming-Hsuan Yang,et al.  Online Sparse Gaussian Process Regression and Its Applications , 2011, IEEE Transactions on Image Processing.

[40]  James Theiler,et al.  Accurate On-line Support Vector Regression , 2003, Neural Computation.

[41]  Giorgio Metta,et al.  Incremental semiparametric inverse dynamics learning , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[42]  Zoubin Ghahramani,et al.  Local and global sparse Gaussian process approximations , 2007, AISTATS.

[43]  Trung Le,et al.  GoGP: Fast Online Regression with Gaussian Processes , 2017, 2017 IEEE International Conference on Data Mining (ICDM).

[44]  Carl E. Rasmussen,et al.  A Unifying View of Sparse Approximate Gaussian Process Regression , 2005, J. Mach. Learn. Res..

[45]  Marco Pavone,et al.  Meta-Learning Priors for Efficient Online Bayesian Regression , 2018, WAFR.