Adaptive-Rate Compressive Sensing Using Side Information

We provide two novel adaptive-rate compressive sensing (CS) strategies for sparse, time-varying signals using side information. The first method uses extra cross-validation measurements, and the second one exploits extra low-resolution measurements. Unlike the majority of current CS techniques, we do not assume that we know an upper bound on the number of significant coefficients that comprises the images in the video sequence. Instead, we use the side information to predict the number of significant coefficients in the signal at the next time instant. We develop our techniques in the specific context of background subtraction using a spatially multiplexing CS camera such as the single-pixel camera. For each image in the video sequence, the proposed techniques specify a fixed number of CS measurements to acquire and adjust this quantity from image to image. We experimentally validate the proposed methods on real surveillance video sequences.

[1]  M. Salman Asif,et al.  Compressive Sensing for streaming signals using the Streaming Greedy Pursuit , 2010, 2010 - MILCOM 2010 MILITARY COMMUNICATIONS CONFERENCE.

[2]  Yaakov Tsaig,et al.  Extensions of compressed sensing , 2006, Signal Process..

[3]  Michael P. Friedlander,et al.  Probing the Pareto Frontier for Basis Pursuit Solutions , 2008, SIAM J. Sci. Comput..

[4]  David L. Donoho,et al.  Precise Undersampling Theorems , 2010, Proceedings of the IEEE.

[5]  J. Rissanen,et al.  Modeling By Shortest Data Description* , 1978, Autom..

[6]  Michael B. Wakin,et al.  A multiscale framework for Compressive Sensing of video , 2009, 2009 Picture Coding Symposium.

[7]  W. B. Johnson,et al.  Extensions of Lipschitz mappings into Hilbert space , 1984 .

[8]  R. Kashyap A Bayesian comparison of different classes of dynamic models using empirical data , 1977 .

[9]  Aswin C. Sankaranarayanan,et al.  CS-MUVI: Video compressive sensing for spatial-multiplexing cameras , 2012, 2012 IEEE International Conference on Computational Photography (ICCP).

[10]  Morteza Mardani,et al.  Dynamic Anomalography: Tracking Network Anomalies Via Sparsity and Low Rank , 2012, IEEE Journal of Selected Topics in Signal Processing.

[11]  Ting Sun,et al.  Single-pixel imaging via compressive sampling , 2008, IEEE Signal Process. Mag..

[12]  Justin K. Romberg,et al.  Sparse Recovery of Streaming Signals Using $\ell_1$-Homotopy , 2013, IEEE Transactions on Signal Processing.

[13]  Wen Hu,et al.  Energy efficient information collection in wireless sensor networks using adaptive compressive sensing , 2009, 2009 IEEE 34th Conference on Local Computer Networks.

[14]  Emmanuel J. Candès,et al.  Near-Optimal Signal Recovery From Random Projections: Universal Encoding Strategies? , 2004, IEEE Transactions on Information Theory.

[15]  Robert D. Nowak,et al.  Sequentially designed compressed sensing , 2012, 2012 IEEE Statistical Signal Processing Workshop (SSP).

[16]  G. Schwarz Estimating the Dimension of a Model , 1978 .

[17]  Samuel Cheng,et al.  Compressive image sampling with side information , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[18]  Dmitry M. Malioutov,et al.  Sequential Compressed Sensing , 2010, IEEE Journal of Selected Topics in Signal Processing.

[19]  Rama Chellappa,et al.  P2C2: Programmable pixel compressive camera for high speed imaging , 2011, CVPR 2011.

[20]  R.G. Baraniuk,et al.  Compressive Sensing [Lecture Notes] , 2007, IEEE Signal Processing Magazine.

[21]  Rama Chellappa,et al.  Adaptive rate compressive sensing for background subtraction , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[22]  Namrata Vaswani,et al.  LS-CS-Residual (LS-CS): Compressive Sensing on Least Squares Residual , 2009, IEEE Transactions on Signal Processing.

[23]  Guillermo Sapiro,et al.  Ieee Transactions on Signal Processing Task-driven Adaptive Statistical Compressive Sensing of Gaussian Mixture Models Ieee Transactions on Signal Processing 2 , 2022 .

[24]  Emmanuel J. Candès,et al.  Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information , 2004, IEEE Transactions on Information Theory.

[25]  Richard G. Baraniuk,et al.  Sparse Signal Reconstruction from Noisy Compressive Measurements using Cross Validation , 2007, 2007 IEEE/SP 14th Workshop on Statistical Signal Processing.

[26]  Max Lu,et al.  Acquiring Multi-Scale Images by Pan-Tilt-Zoom Control and Automatic Multi-Camera Calibration , 2005, 2005 Seventh IEEE Workshops on Applications of Computer Vision (WACV/MOTION'05) - Volume 1.

[27]  Namrata Vaswani,et al.  Kalman filtered Compressed Sensing , 2008, 2008 15th IEEE International Conference on Image Processing.

[28]  Stefano Tubaro,et al.  Joint Compressive Video Coding and Analysis , 2010, IEEE Transactions on Multimedia.

[29]  Dikpal Reddy,et al.  Streaming Compressive Sensing for high-speed periodic videos , 2010, 2010 IEEE International Conference on Image Processing.

[30]  Namrata Vaswani,et al.  Modified-CS: Modifying compressive sensing for problems with partially known support , 2009, ISIT.

[31]  Richard G. Baraniuk,et al.  The STONE Transform: Multi-Resolution Image Enhancement and Real-Time Compressive Video , 2013, ArXiv.

[32]  Hassan Mansour,et al.  Adaptive compressed sensing for video acquisition , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[33]  Ramesh Raskar,et al.  Coded Strobing Photography: Compressive Sensing of High Speed Periodic Videos , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[34]  Rachel Ward,et al.  Compressed Sensing With Cross Validation , 2008, IEEE Transactions on Information Theory.

[35]  Namrata Vaswani,et al.  Separating sparse and low-dimensional signal sequences from time-varying undersampled projections of their sums , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[36]  E.J. Candes Compressive Sampling , 2022 .

[37]  R. DeVore,et al.  A Simple Proof of the Restricted Isometry Property for Random Matrices , 2008 .

[38]  Marco Righero,et al.  An introduction to compressive sensing , 2009 .

[39]  R. M. Willett,et al.  Compressed sensing for practical optical imaging systems: A tutorial , 2011, IEEE Photonics Conference 2012.

[40]  Jamie S. Evans,et al.  Compressed Sensing With Prior Information: Information-Theoretic Limits and Practical Decoders , 2013, IEEE Transactions on Signal Processing.

[41]  Richard G. Baraniuk,et al.  Compressive imaging for video representation and coding , 2006 .

[42]  David L Donoho,et al.  Compressed sensing , 2006, IEEE Transactions on Information Theory.

[43]  Amir Averbuch,et al.  Adaptive Compressed Image Sensing Using Dictionaries , 2012, SIAM J. Imaging Sci..

[44]  Philippe Martinet,et al.  Object tracking with a pan-tilt-zoom camera: application to car driving assistance , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[45]  Guillermo Sapiro,et al.  Adaptive temporal compressive sensing for video , 2013, 2013 IEEE International Conference on Image Processing.

[46]  Volkan Cevher,et al.  Compressive Sensing for Background Subtraction , 2008, ECCV.

[47]  Lawrence Carin,et al.  Bayesian Compressive Sensing , 2008, IEEE Transactions on Signal Processing.

[48]  Rama Chellappa,et al.  Compressive Acquisition of Linear Dynamical Systems , 2013, SIAM J. Imaging Sci..

[49]  H.F. Durrant-Whyte,et al.  A new approach for filtering nonlinear systems , 1995, Proceedings of 1995 American Control Conference - ACC'95.

[50]  Yi Yang,et al.  Real-Time Adaptive Video Compression , 2015, SIAM J. Sci. Comput..

[51]  Samuel Cheng,et al.  Sparse signal recovery with side information , 2009, 2009 17th European Signal Processing Conference.

[52]  Amit Ashok,et al.  Compressive imaging system design using task-specific information. , 2008, Applied optics.

[53]  Georgios B. Giannakis,et al.  Online Adaptive Estimation of Sparse Signals: Where RLS Meets the $\ell_1$ -Norm , 2010, IEEE Transactions on Signal Processing.

[54]  J. Romberg,et al.  Imaging via Compressive Sampling , 2008, IEEE Signal Processing Magazine.