Adaptive temporal compressive sensing for video

This paper introduces the concept of adaptive temporal compressive sensing (CS) for video. We propose a CS algorithm to adapt the compression ratio based on the scene's temporal complexity, computed from the compressed data, without compromising the quality of the reconstructed video. The temporal adaptivity is manifested by manipulating the integration time of the camera, opening the possibility to realtime implementation. The proposed algorithm is a generalized temporal CS approach that can be incorporated with a diverse set of existing hardware systems.

[1]  Lawrence Carin,et al.  Bayesian Compressive Sensing , 2008, IEEE Transactions on Signal Processing.

[2]  Yonina C. Eldar,et al.  Sensing Matrix Optimization for Block-Sparse Decoding , 2010, IEEE Transactions on Signal Processing.

[3]  José M. Bioucas-Dias,et al.  A New TwIST: Two-Step Iterative Shrinkage/Thresholding Algorithms for Image Restoration , 2007, IEEE Transactions on Image Processing.

[4]  Bernard Rougé,et al.  The Flutter Shutter Paradox , 2013, SIAM J. Imaging Sci..

[5]  Ting Sun,et al.  Single-pixel imaging via compressive sampling , 2008, IEEE Signal Process. Mag..

[6]  Mohammad Aghagolzadeh,et al.  Compressed video sensing using adaptive sampling rate , 2010, 2010 5th International Symposium on Telecommunications.

[7]  Shree K. Nayar,et al.  Video from a single coded exposure photograph using a learned over-complete dictionary , 2011, 2011 International Conference on Computer Vision.

[8]  Michael B. Wakin,et al.  A multiscale framework for Compressive Sensing of video , 2009, 2009 Picture Coding Symposium.

[9]  Didier J. Le Gall,et al.  The MPEG video compression algorithm , 1992, Signal Process. Image Commun..

[10]  Rama Chellappa,et al.  P2C2: Programmable pixel compressive camera for high speed imaging , 2011, CVPR 2011.

[11]  Guillermo Sapiro,et al.  Coded aperture compressive temporal imaging , 2013, Optics express.

[12]  Lai-Man Po,et al.  A novel cross-diamond search algorithm for fast block motion estimation , 2002, IEEE Trans. Circuits Syst. Video Technol..

[13]  Rama Chellappa,et al.  Compressive Acquisition of Dynamic Scenes , 2010, ECCV.

[14]  Ramesh Raskar,et al.  Coded Strobing Photography: Compressive Sensing of High Speed Periodic Videos , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  James E. Fowler,et al.  Block-Based Compressed Sensing of Images and Video , 2012, Found. Trends Signal Process..

[16]  Hui Li,et al.  Generalized Alternating Projection for Weighted-퓁2, 1 Minimization with Applications to Model-Based Compressive Sensing , 2014, SIAM J. Imaging Sci..

[17]  Aswin C. Sankaranarayanan,et al.  CS-MUVI: Video compressive sensing for spatial-multiplexing cameras , 2012, 2012 IEEE International Conference on Computational Photography (ICCP).

[18]  Joel A. Tropp,et al.  Signal Recovery From Random Measurements Via Orthogonal Matching Pursuit , 2007, IEEE Transactions on Information Theory.

[19]  Michael Elad,et al.  Optimized Projections for Compressed Sensing , 2007, IEEE Transactions on Signal Processing.

[20]  Chaur-Heh Hsieh,et al.  VLSI architecture for block-matching motion estimation algorithm , 1992, IEEE Trans. Circuits Syst. Video Technol..

[21]  Richard G. Baraniuk,et al.  Compressive imaging for video representation and coding , 2006 .

[22]  Guillermo Sapiro,et al.  Ieee Transactions on Signal Processing Task-driven Adaptive Statistical Compressive Sensing of Gaussian Mixture Models Ieee Transactions on Signal Processing 2 , 2022 .

[23]  Abdulhakem Y. Elezzabi,et al.  Maximum Frame Rate Video Acquisition Using Adaptive Compressed Sensing , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[24]  M. Ezhilarasan,et al.  Simplified Block Matching Algorithm for Fast Motion Estimation in Video Compression , 2008 .

[25]  A. Robert Calderbank,et al.  Communications-Inspired Projection Design with Application to Compressive Sensing , 2012, SIAM J. Imaging Sci..

[26]  Guillermo Sapiro,et al.  Gaussian mixture model for video compressive sensing , 2013, 2013 IEEE International Conference on Image Processing.

[27]  L. Carin,et al.  Compressive Sensing for Video Using a Passive Coding Element , 2013 .

[28]  Ramesh Raskar,et al.  Coded exposure photography: motion deblurring using fluttered shutter , 2006, SIGGRAPH '06.

[29]  Abdulhakem Y. Elezzabi,et al.  Block-based adaptive compressed sensing for video , 2010, 2010 IEEE International Conference on Image Processing.