A two-stage multi-hypothesis reconstruction scheme in compressed video sensing

Existing multi-hypothesis (MH) prediction algorithms in compressed video sensing (CVS) are all deployed in measurement domain, which restricts the flexibility of block partitioning in the reconstruction process and decreases the reconstruction accuracy. To address this issue, this paper proposes a two-stage multi-hypothesis reconstruction (2sMHR) scheme which deploys the MH prediction in measurement domain and pixel domain successively. Two implementation schemes, GOP-wise and frame-wise scheme, are developed for the 2sMHR. Furthermore, a new weighted metric combining the Euclidean distance and correlation coefficient is designed for the Tikhonov-regularized MH prediction model. Simulation results show that the proposed two-stage MH reconstruction scheme obtains higher reconstruction accuracy than the state-of-the-art CVS prediction methods.

[1]  Lu Gan Block Compressed Sensing of Natural Images , 2007, 2007 15th International Conference on Digital Signal Processing.

[2]  Ming Li,et al.  Motion-Aware Decoding of Compressed-Sensed Video , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[3]  Jian Chen,et al.  A scheme for distributed compressed video sensing based on hypothesis set optimization techniques , 2015, Multidimensional Systems and Signal Processing.

[4]  James E. Fowler,et al.  Video Compressed Sensing with Multihypothesis , 2011, 2011 Data Compression Conference.

[5]  Wen Gao,et al.  Image Compressive Sensing Recovery via Collaborative Sparsity , 2012, IEEE Journal on Emerging and Selected Topics in Circuits and Systems.

[6]  James E. Fowler,et al.  Residual Reconstruction for Block-Based Compressed Sensing of Video , 2011, 2011 Data Compression Conference.

[7]  Farrokh Marvasti,et al.  Multihypothesis Compressed Video Sensing Technique , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[8]  Bin Song,et al.  Joint Sampling Rate and Bit-Depth Optimization in Compressive Video Sampling , 2014, IEEE Transactions on Multimedia.

[9]  James E. Fowler,et al.  Block Compressed Sensing of Images Using Directional Transforms , 2010, 2010 Data Compression Conference.

[10]  Guillermo Sapiro,et al.  Video Compressive Sensing Using Gaussian Mixture Models , 2014, IEEE Transactions on Image Processing.

[11]  S. Frick,et al.  Compressed Sensing , 2014, Computer Vision, A Reference Guide.

[12]  Wen Gao,et al.  Video compressive sensing via structured Laplacian modelling , 2014, 2014 IEEE Visual Communications and Image Processing Conference.

[13]  Emmanuel J. Candès,et al.  Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information , 2004, IEEE Transactions on Information Theory.

[14]  Konstantinos N. Plataniotis,et al.  High-Accuracy Total Variation With Application to Compressed Video Sensing , 2013, IEEE Transactions on Image Processing.