Compressed Streaming Importance Sampling for Efficient Representations of Localization Distributions

Importance sampling (IS) is the standard Monte Carlo tool to compute integrals involving random variables such as their mean or higher-order moments. This procedure permits localizing a source signal corrupted by observation noise whose distribution is arbitrary, in contrast to typical Gaussian assumptions. We note that IS is asymptotically consistent as the number of Monte Carlo samples, and hence Dirac deltas (particles) that parameterize the density estimate, go to infinity. Unfortunately, allowing the number of particles in the density approximation to go to infinity is computationally intractable. Here we present a methodology for only keeping a finite representative subset of particles and their augmented importance weights that is nearly statistically consistent. To do so, we approximate importance sampling in two ways: we (1) replace the deltas by kernels, yielding kernel density estimates; (2) and sequentially project the kernel density estimates onto nearby lower-dimensional subspaces. Theoretically, the asymptotic bias of this scheme is characterized by a compression parameter and the kernel bandwidth, which yields a tunable trade-off between statistical consistency and memory. We then evaluate the validity of the proposed approach for a localization problem in wireless systems, and observed that the proposed algorithm and yields a favorable trade-off between memory and accuracy.

[1]  David Luengo,et al.  Generalized Multiple Importance Sampling , 2015, Statistical Science.

[2]  Robert E. Kass,et al.  Importance sampling: a review , 2010 .

[3]  R.L. Moses,et al.  Locating the nodes: cooperative localization in wireless sensor networks , 2005, IEEE Signal Processing Magazine.

[4]  Gunjan Verma,et al.  Direction of Arrival Estimation With the Received Signal Strength Gradient , 2018, IEEE Transactions on Vehicular Technology.

[5]  Matthew P. Wand,et al.  Kernel Smoothing , 1995 .

[6]  Simo Särkkä,et al.  Bayesian Filtering and Smoothing , 2013, Institute of Mathematical Statistics textbooks.

[7]  Luca Martino,et al.  Improving population Monte Carlo: Alternative weighting and resampling schemes , 2016, Signal Process..

[8]  Stephen J. Roberts,et al.  A tutorial on variational Bayesian inference , 2012, Artificial Intelligence Review.

[9]  P. Bickel,et al.  Curse-of-dimensionality revisited : Collapse of importance sampling in very large scale systems , 2005 .

[10]  Joel A. Tropp,et al.  Signal Recovery From Random Measurements Via Orthogonal Matching Pursuit , 2007, IEEE Transactions on Information Theory.

[11]  Wei Dai,et al.  Fast variational Bayesian learning for channel estimation with prior statistical information , 2015, 2015 IEEE 16th International Workshop on Signal Processing Advances in Wireless Communications (SPAWC).

[12]  David Ruppert,et al.  Semiparametric regression during 2003-2007. , 2009, Electronic journal of statistics.

[13]  Alec Koppel,et al.  Consistent online Gaussian process regression without the sample complexity bottleneck , 2019, Statistics and Computing.

[14]  J. L. Roux An Introduction to the Kalman Filter , 2003 .

[15]  O. Papaspiliopoulos,et al.  Importance Sampling: Intrinsic Dimension and Computational Cost , 2015, 1511.06196.

[16]  Simo Srkk,et al.  Bayesian Filtering and Smoothing , 2013 .

[17]  Brian M. Sadler,et al.  Geolocation Performance With Biased Range Measurements , 2012, IEEE Transactions on Signal Processing.

[18]  Nando de Freitas,et al.  An Introduction to MCMC for Machine Learning , 2004, Machine Learning.

[19]  Byoung-Tak Zhang,et al.  Stock Trading by Modelling Price Trend with Dynamic Bayesian Networks , 2004, IDEAL.

[20]  Andreas M. Ali,et al.  An Empirical Study of Collaborative Acoustic Source Localization , 2007, 2007 6th International Symposium on Information Processing in Sensor Networks.

[21]  Pascal Vincent,et al.  Kernel Matching Pursuit , 2002, Machine Learning.

[22]  A. V. D. Vaart,et al.  Convergence rates of posterior distributions , 2000 .

[23]  Y. C. Pati,et al.  Orthogonal matching pursuit: recursive function approximation with applications to wavelet decomposition , 1993, Proceedings of 27th Asilomar Conference on Signals, Systems and Computers.

[24]  R. Rockafellar Monotone Operators and the Proximal Point Algorithm , 1976 .

[25]  Hugh F. Durrant-Whyte,et al.  Simultaneous localization and mapping: part I , 2006, IEEE Robotics & Automation Magazine.

[26]  Alejandro Ribeiro,et al.  Parsimonious Online Learning with Kernels via sparse projections in function space , 2016, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[27]  Deanna Needell,et al.  Greedy signal recovery review , 2008, 2008 42nd Asilomar Conference on Signals, Systems and Computers.

[28]  Petar M. Djuric,et al.  Adaptive Importance Sampling: The past, the present, and the future , 2017, IEEE Signal Processing Magazine.