Sparse Dynamic Filtering via Earth Mover's Distance Regularization

Tracking time-varying signals is an important task for practical systems working with large discretized domains. Under such settings, sparsity-based approaches improve tracking accuracy since typically few targets appear in the scene (i.e. few locations in the discretized space are occupied). Discretization introduces a unique challenge: the traditional $\ell_{p}$ -norm dynamic constraints produce significant errors when there is even a small spatial mismatch between the predicted and true state. To overcome this, we present a tracking algorithm leveraging concepts from optimal transport, namely utilizing the earth-movers distance (EMD) as a dynamic regularizer to the $\ell_{1}$ -regularized inference problem (i.e., LASSO [1], or BPDN [2]). We extend the problem formulation to complex valued signals and modify the optimization program to reduce the computational burden. We demonstrate the efficacy of our approach in imaging and frequency tracking applications.

[1]  Marco F. Duarte,et al.  Compressive parameter estimation with earth mover's distance via K-median clustering , 2013, Optics & Photonics - Optical Engineering + Applications.

[2]  R. McCann,et al.  Free boundaries in optimal transport and Monge-Ampere obstacle problems , 2010 .

[3]  Christopher J. Rozell,et al.  Convergence of basis pursuit de-noising with dynamic filtering , 2014, 2014 IEEE Global Conference on Signal and Information Processing (GlobalSIP).

[4]  R. Tibshirani Regression Shrinkage and Selection via the Lasso , 1996 .

[5]  Christopher J. Rozell,et al.  Spectral Superresolution of Hyperspectral Imagery Using Reweighted $\ell_{1}$ Spatial Filtering , 2014, IEEE Geoscience and Remote Sensing Letters.

[6]  Rebecca Willett,et al.  Dynamical Models and tracking regret in online convex programming , 2013, ICML.

[7]  M. Salman Asif,et al.  Motion‐adaptive spatio‐temporal regularization for accelerated dynamic MRI , 2013, Magnetic resonance in medicine.

[8]  Bhaskar D. Rao,et al.  Sparse Signal Recovery With Temporally Correlated Source Vectors Using Sparse Bayesian Learning , 2011, IEEE Journal of Selected Topics in Signal Processing.

[9]  Piotr Indyk,et al.  The Constrained Earth Mover Distance Model, with Applications to Compressive Sensing , 2013 .

[10]  Piotr Indyk,et al.  Sparse recovery for Earth Mover Distance , 2010, 2010 48th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[11]  Michael Werman,et al.  Fast and robust Earth Mover's Distances , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[12]  Justin K. Romberg,et al.  Sparsity penalties in dynamical system estimation , 2011, 2011 45th Annual Conference on Information Sciences and Systems.

[13]  Christopher J. Rozell,et al.  Earth-Mover's distance as a tracking regularizer , 2017, 2017 IEEE 7th International Workshop on Computational Advances in Multi-Sensor Adaptive Processing (CAMSAP).

[14]  B. Piccoli,et al.  Generalized Wasserstein Distance and its Application to Transport Equations with Source , 2012, 1206.3219.

[15]  Namrata Vaswani,et al.  Kalman filtered Compressed Sensing , 2008, 2008 15th IEEE International Conference on Image Processing.

[16]  Philip Schniter,et al.  Dynamic Compressive Sensing of Time-Varying Signals Via Approximate Message Passing , 2012, IEEE Transactions on Signal Processing.

[17]  Bruno A. Olshausen,et al.  Group Sparse Coding with a Laplacian Scale Mixture Prior , 2010, NIPS.

[18]  Leonidas J. Guibas,et al.  The Earth Mover's Distance as a Metric for Image Retrieval , 2000, International Journal of Computer Vision.

[19]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[20]  R.G. Baraniuk,et al.  Compressive Sensing [Lecture Notes] , 2007, IEEE Signal Processing Magazine.

[21]  Christopher J. Rozell,et al.  Dynamic Filtering of Time-Varying Sparse Signals via $\ell _1$ Minimization , 2015, IEEE Transactions on Signal Processing.