On-line Bayesian regression mixture model for robot model learning

The performance of a robot system heavily relies on its model. The present paper proposes an efficient online Bayesian regression algorithm based on Gaussian Mixture Model. By using the mixture model of local Gaussian experts, the algorithm decouples global correlation of data and achieves linear computational cost to the size of the local model set. The proposed algorithm also realizes on-line implementation. To manage the size of local model on-the-fly, a strategy of adding and pruning local model based on a probabilistic criteria is proposed. Additionally, a forgetting strategy to treat outliers and non-stationary system is suggested. In the end, the algorithm achieved comparable results to other on-line regression algorithms.

[1]  Neil D. Lawrence,et al.  Overlapping Mixtures of Gaussian Processes for the Data Association Problem , 2011, Pattern Recognit..

[2]  Andrew Y. Ng,et al.  Fast Gaussian Process Regression using KD-Trees , 2005, NIPS.

[3]  Stefan Schaal,et al.  Incremental Local Gaussian Regression , 2014, NIPS.

[4]  Jan Peters,et al.  Local Gaussian process regression for real-time model-based robot control , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[5]  B. Ripley,et al.  Pattern Recognition , 1968, Nature.

[6]  Carl E. Rasmussen,et al.  Infinite Mixtures of Gaussian Process Experts , 2001, NIPS.

[7]  Lehel Csató,et al.  Sparse On-Line Gaussian Processes , 2002, Neural Computation.

[8]  Stefan Schaal,et al.  Real-time robot learning with locally weighted statistical learning , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[9]  Kenji Shimada,et al.  Learning-based robot control with localized sparse online Gaussian process , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[10]  Stefan Schaal,et al.  Efficient Bayesian local model learning for control , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[11]  M. Opper Sparse Online Gaussian Processes , 2008 .

[12]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[13]  Jennifer G. Dy,et al.  Nonparametric Mixture of Gaussian Processes with Constraints , 2013, ICML.

[14]  Chao Yuan,et al.  Variational Mixture of Gaussian Process Experts , 2008, NIPS.

[15]  Volker Tresp,et al.  Mixtures of Gaussian Processes , 2000, NIPS.