Nonparametric Density Estimation for Learning Noise Distributions in Mobile Robotics

By admitting an explicit representation of the uncertainty associated with sensing and actuation in the real world, the probabilistic robotics paradigm has led to remarkable improvements in the robustness and performance of autonomous systems. However, this approach generally requires that the sensing and actuation noise acting upon an autonomous system be specified in the form of probability density functions, thus necessitating that these densities themselves be estimated. To that end, in this paper we present a general framework for directly estimating the probability density function of a noise distribution given only a set of observations sampled from that distribution. Our approach is based upon Dirichlet process mixture models (DPMMs), a class of infinite mixture models commonly used in Bayesian nonparametric statistics. These models are very expressive and enjoy good posterior consistency properties when used in density estimation, but the density estimates that they produce are often too computationally complex to be used in mobile robotics applications, where computational resources are limited and speed is crucial. We derive a straightforward yet principled approximation method for simplifying the densities learned by DPMMs in order to produce computationally tractable density estimates. When implemented using the infinite Gaussian mixture model (a specific class of DPMMs that is particularly well-suited for mobile robotics applications), our approach is capable of approximating any continuous distribution on R arbitrarily well in total variation distance, and produces C∞, bounded, everywhere positive, and efficiently computable density estimates suitable for use in real-time inference algorithms on mobile robotic platforms.

[1]  Emin Orhan Dirichlet Processes , 2012 .

[2]  Yuefeng Wu,et al.  The L1-consistency of Dirichlet mixtures in multivariate Bayesian density estimation , 2010, J. Multivar. Anal..

[3]  Sebastian Thrun,et al.  Probabilistic robotics , 2002, CACM.

[4]  T. Ferguson A Bayesian Analysis of Some Nonparametric Problems , 1973 .

[5]  David R. Anderson,et al.  Model selection and multimodel inference : a practical information-theoretic approach , 2003 .

[6]  M. Escobar,et al.  Bayesian Density Estimation and Inference Using Mixtures , 1995 .

[7]  Yee Whye Teh,et al.  Dirichlet Process , 2017, Encyclopedia of Machine Learning and Data Mining.

[8]  Radford M. Neal Pattern Recognition and Machine Learning , 2007, Technometrics.

[9]  Nando de Freitas,et al.  An Introduction to MCMC for Machine Learning , 2004, Machine Learning.

[10]  John J. Leonard,et al.  Robust incremental online inference over sparse factor graphs: Beyond the Gaussian case , 2013, 2013 IEEE International Conference on Robotics and Automation.

[11]  T. Ferguson A Course in Large Sample Theory , 1996 .

[12]  John K Kruschke,et al.  Bayesian data analysis. , 2010, Wiley interdisciplinary reviews. Cognitive science.

[13]  Andrew W. Fitzgibbon,et al.  Bundle Adjustment - A Modern Synthesis , 1999, Workshop on Vision Algorithms.

[14]  J. Ghosh,et al.  POSTERIOR CONSISTENCY OF DIRICHLET MIXTURES IN DENSITY ESTIMATION , 1999 .

[15]  Sebastian Thrun,et al.  Robotic mapping: a survey , 2003 .

[16]  Nir Friedman,et al.  Probabilistic Graphical Models - Principles and Techniques , 2009 .

[17]  Qing Wang,et al.  Divergence estimation of continuous distributions based on data-dependent partitions , 2005, IEEE Transactions on Information Theory.

[18]  Michael I. Jordan,et al.  Variational inference for Dirichlet process mixtures , 2006 .

[19]  S. Ghosal,et al.  2 The Dirichlet process , related priors and posterior asymptotics , 2009 .

[20]  Edwin Olson,et al.  Inference on networks of mixtures for robust robot mapping , 2013, Int. J. Robotics Res..

[21]  H. Akaike A new look at the statistical model identification , 1974 .

[22]  Radford M. Neal Markov Chain Sampling Methods for Dirichlet Process Mixture Models , 2000 .

[23]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[24]  G. Schwarz Estimating the Dimension of a Model , 1978 .

[25]  P. Deb Finite Mixture Models , 2008 .

[26]  Carl E. Rasmussen,et al.  The Infinite Gaussian Mixture Model , 1999, NIPS.