Low-complexity video compression and compressive sensing

Compressive sensing (CS) provides a general signal acquisition framework that enables the reconstruction of sparse signals from a small number of linear measurements. To reduce video-encoder complexity, we present a CS-based video compression scheme. Modern video-encoder complexity arises mainly from the transform-coding and motion-estimation blocks. In our proposed scheme, we eliminate these blocks from the encoder, which achieves compression by merely taking a few linear measurements of each image in a video sequence. To guarantee stable reconstruction of the video sequence from only a few measurements, the decoder must effectively exploit the inherent spatial and temporal redundancies in a video sequence. To leverage these redundancies, we consider a motion-adaptive linear dynamical model for videos. Recovery process involves solving an l1-regularized optimization problem, which iteratively updates estimates for the video frames and motion within adjacent frames. To evaluate the performance of our proposed scheme we performed experiments on various standard test sequences.

[1]  E.J. Candes Compressive Sampling , 2022 .

[2]  Gary J. Sullivan,et al.  Video Compression - From Concepts to the H.264/AVC Standard , 2005, Proceedings of the IEEE.

[3]  Julian Magarey,et al.  Motion estimation using a complex-valued wavelet transform , 1998, IEEE Trans. Signal Process..

[4]  J. Romberg,et al.  Imaging via Compressive Sampling , 2008, IEEE Signal Processing Magazine.

[5]  J. Romberg Imaging via Compressive Sampling [Introduction to compressive sampling and recovery via convex programming] , 2008 .

[6]  E. Candès,et al.  Sparsity and incoherence in compressive sampling , 2006, math/0611957.

[7]  Kannan Ramchandran,et al.  PRISM: A Video Coding Paradigm With Motion Estimation at the Decoder , 2007, IEEE Transactions on Image Processing.

[8]  Richard G. Baraniuk,et al.  An Architecture for Compressive Imaging , 2006, 2006 International Conference on Image Processing.

[9]  Jong Chul Ye,et al.  k‐t FOCUSS: A general compressed sensing framework for high resolution dynamic MRI , 2009, Magnetic resonance in medicine.

[10]  Rebecca Willett,et al.  Compressive coded aperture video reconstruction , 2008, 2008 16th European Signal Processing Conference.

[11]  Ce Liu,et al.  Exploring new representations and applications for motion analysis , 2009 .

[12]  Emmanuel J. Candès,et al.  NESTA: A Fast and Accurate First-Order Method for Sparse Recovery , 2009, SIAM J. Imaging Sci..

[13]  Michael B. Wakin,et al.  A multiscale framework for Compressive Sensing of video , 2009, 2009 Picture Coding Symposium.

[14]  Rama Chellappa,et al.  P2C2: Programmable pixel compressive camera for high speed imaging , 2011, CVPR 2011.

[15]  Richard Baraniuk,et al.  The Dual-tree Complex Wavelet Transform , 2007 .

[16]  James E. Fowler,et al.  Residual Reconstruction for Block-Based Compressed Sensing of Video , 2011, 2011 Data Compression Conference.