Image Compression Based on Compressive Sensing: End-to-End Comparison With JPEG

We present an end-to-end image compression system based on compressive sensing. The presented system integrates the conventional scheme of compressive sampling (on the entire image) and reconstruction with quantization and entropy coding. The compression performance, in terms of decoded image quality versus data rate, is shown to be comparable with JPEG and significantly better at the low rate range. We study the parameters that influence the system performance, including (i) the choice of sensing matrix, (ii) the trade-off between quantization and compression ratio, and (iii) the reconstruction algorithms. We propose an effective method to select, among all possible combinations of quantization step and compression ratio, the ones that yield the near-best quality at any given bit rate. Furthermore, our proposed image compression system can be directly used in the compressive sensing camera, e.g., the single pixel camera, to construct a hardware compressive sampling system.

[1]  Miska M. Hannuksela,et al.  HEVC still image coding and high efficiency image file format , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[2]  Vinayak A. Rao,et al.  Hierarchical Infinite Divisibility for Multiscale Shrinkage , 2014, IEEE Transactions on Signal Processing.

[3]  Yin Zhang,et al.  An efficient augmented Lagrangian method with applications to total variation minimization , 2013, Computational Optimization and Applications.

[4]  A. Robert Calderbank,et al.  Collaborative compressive X-ray image reconstruction , 2015, 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[5]  Robert D. Nowak,et al.  Majorization–Minimization Algorithms for Wavelet-Based Image Restoration , 2007, IEEE Transactions on Image Processing.

[6]  L. Carin,et al.  Applying compressive sensing to TEM video: a substantial frame rate increase on any camera , 2015, Advanced Structural and Chemical Imaging.

[7]  Aggelos K. Katsaggelos,et al.  Using Deep Neural Networks for Inverse Problems in Imaging: Beyond Analytical Methods , 2018, IEEE Signal Processing Magazine.

[8]  Xin Yuan,et al.  Efficient patch-based approach for compressive depth imaging. , 2016, Applied optics.

[9]  Olgica Milenkovic,et al.  Distortion-rate functions for quantized compressive sensing , 2009, 2009 IEEE Information Theory Workshop on Networking and Information Theory.

[10]  Stephen P. Boyd,et al.  Compressed Sensing With Quantized Measurements , 2010, IEEE Signal Processing Letters.

[11]  Jan Vybíral,et al.  Compressed Sensing and its Applications , 2015 .

[12]  Paul A. Wilford,et al.  Block-wise lensless compressive camera , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[13]  Pavan K. Turaga,et al.  ReconNet: Non-Iterative Reconstruction of Images from Compressively Sensed Measurements , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Miska M. Hannuksela,et al.  The High Efficiency Image File Format Standard [Standards in a Nutshell] , 2015, IEEE Signal Processing Magazine.

[15]  Richard G. Baraniuk,et al.  Democracy in Action: Quantization, Saturation, and Compressive Sensing , 2011 .

[16]  Guillermo Sapiro,et al.  Low-Cost Compressive Sensing for Color Video and Depth , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[17]  Jitendra Malik,et al.  A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[18]  Glen G. Langdon,et al.  Arithmetic Coding , 1979 .

[19]  Xin Yuan,et al.  Tree-Structure Bayesian Compressive Sensing for Video , 2014, ArXiv.

[20]  Xin Yuan,et al.  Snapshot Compressed Sensing: Performance Bounds and Algorithms , 2018, IEEE Transactions on Information Theory.

[21]  Miska Hannuksela,et al.  The High efficiency image file format standard , 2015 .

[22]  Xin Yuan,et al.  Compressive dynamic range imaging via Bayesian shrinkage dictionary learning , 2016 .

[23]  Xin Yuan,et al.  Parallel lensless compressive imaging via deep convolutional neural networks. , 2018, Optics express.

[24]  V.K. Goyal,et al.  Compressive Sampling and Lossy Compression , 2008, IEEE Signal Processing Magazine.

[25]  Xin Yuan,et al.  Generalized alternating projection based total variation minimization for compressive sensing , 2015, 2016 IEEE International Conference on Image Processing (ICIP).

[26]  Emmanuel J. Candès,et al.  Near-Optimal Signal Recovery From Random Projections: Universal Encoding Strategies? , 2004, IEEE Transactions on Information Theory.

[27]  A. Bruckstein,et al.  K-SVD : An Algorithm for Designing of Overcomplete Dictionaries for Sparse Representation , 2005 .

[28]  Xin Yuan,et al.  Compressive Temporal RGB-D Imaging , 2017 .

[29]  Ting Sun,et al.  Single-pixel imaging via compressive sampling , 2008, IEEE Signal Process. Mag..

[30]  Daniele D. Giusto,et al.  Objective assessment of the WebP image coding algorithm , 2012, Signal Process. Image Commun..

[31]  Junfeng Yang,et al.  A New Alternating Minimization Algorithm for Total Variation Image Reconstruction , 2008, SIAM J. Imaging Sci..

[32]  Yonina C. Eldar,et al.  Fundamental Distortion Limits of Analog-to-Digital Compression , 2016, IEEE Transactions on Information Theory.

[33]  S. Frick,et al.  Compressed Sensing , 2014, Computer Vision, A Reference Guide.

[34]  Guillermo Sapiro,et al.  Compressive Sensing by Learning a Gaussian Mixture Model From Measurements , 2015, IEEE Transactions on Image Processing.

[35]  A. Robert Calderbank,et al.  Signal Recovery and System Calibration from Multiple Compressive Poisson Measurements , 2015, SIAM J. Imaging Sci..

[36]  Xin Yuan,et al.  Convolutional factor analysis inspired compressive sensing , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[37]  Wen Gao,et al.  Globally Variance-Constrained Sparse Representation and Its Application in Image Set Coding , 2016, IEEE Transactions on Image Processing.

[38]  Wuzhen Shi,et al.  Deep networks for compressed image sensing , 2017, 2017 IEEE International Conference on Multimedia and Expo (ICME).

[39]  Allen Gersho,et al.  Vector quantization and signal compression , 1991, The Kluwer international series in engineering and computer science.

[40]  Emmanuel J. Candès,et al.  A Probabilistic and RIPless Theory of Compressed Sensing , 2010, IEEE Transactions on Information Theory.

[41]  Jiantao Zhou,et al.  From Rank Estimation to Rank Approximation: Rank Residual Constraint for Image Restoration , 2020, IEEE Transactions on Image Processing.

[42]  H. Andrews,et al.  Hadamard transform image coding , 1969 .

[43]  Paul A. Wilford,et al.  Lensless imaging by compressive sensing , 2013, 2013 IEEE International Conference on Image Processing.

[44]  Jong-Hoon Ahn,et al.  Compressive Sensing and Recovery for Binary Images , 2016, IEEE Transactions on Image Processing.

[45]  A. Robert Calderbank,et al.  Classification and Reconstruction of High-Dimensional Signals From Low-Dimensional Features in the Presence of Side Information , 2014, IEEE Transactions on Information Theory.

[46]  Olgica Milenkovic,et al.  A comparative study of quantized compressive sensing schemes , 2009, 2009 IEEE International Symposium on Information Theory.

[47]  Kwok-Wo Wong,et al.  Bi-level Protected Compressive Sampling , 2016, IEEE Transactions on Multimedia.

[48]  Bu-Sung Lee,et al.  Robust Image Coding Based Upon Compressive Sensing , 2012, IEEE Transactions on Multimedia.

[49]  Xin Yuan,et al.  Structured illumination temporal compressive microscopy. , 2016, Biomedical optics express.

[50]  M. Elad,et al.  $rm K$-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation , 2006, IEEE Transactions on Signal Processing.

[51]  Dimitris A. Pados,et al.  Compressed-Sensed-Domain L1-PCA Video Surveillance , 2016, IEEE Transactions on Multimedia.

[52]  Xin Yuan,et al.  Adaptive step-size iterative algorithm for sparse signal recovery , 2018, Signal Process..

[53]  Guangming Shi,et al.  Distributed Compressive Sensing for Cloud-Based Wireless Image Transmission , 2017, IEEE Transactions on Multimedia.

[54]  Marc Teboulle,et al.  Fast Gradient-Based Algorithms for Constrained Total Variation Image Denoising and Deblurring Problems , 2009, IEEE Transactions on Image Processing.

[55]  Xin Yuan,et al.  Compressive high-speed stereo imaging. , 2017, Optics express.

[56]  Wen Gao,et al.  Globally Variance-Constrained Sparse Representation for Rate-Distortion Optimized Image Representation , 2017, 2017 Data Compression Conference (DCC).

[57]  Xin Yuan,et al.  Compressive Hyperspectral Imaging With Side Information , 2015, IEEE Journal of Selected Topics in Signal Processing.

[58]  Paul A. Wilford,et al.  Compressive Sensing via Low-Rank Gaussian Mixture Models , 2015, ArXiv.

[59]  Feng Jiang,et al.  An Efficient Deep Quantized Compressed Sensing Coding Framework of Natural Images , 2018, ACM Multimedia.

[60]  Paul A. Wilford,et al.  Lensless Compressive Imaging , 2015, ArXiv.

[61]  Richard G. Baraniuk,et al.  Kronecker Compressive Sensing , 2012, IEEE Transactions on Image Processing.

[62]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[63]  Lawrence Carin,et al.  Bayesian Compressive Sensing , 2008, IEEE Transactions on Signal Processing.

[64]  Stephen Lin,et al.  Computational Snapshot Multispectral Cameras: Toward dynamic capture of the spectral world , 2016, IEEE Signal Processing Magazine.

[65]  Stephen P. Boyd,et al.  Enhancing Sparsity by Reweighted ℓ1 Minimization , 2007, 0711.1612.

[66]  V. Ralph Algazi,et al.  Unified Matrix Treatment of the Fast Walsh-Hadamard Transform , 1976, IEEE Transactions on Computers.

[67]  Xin Yuan,et al.  SLOPE: Shrinkage of Local Overlapping Patches Estimator for Lensless Compressive Imaging , 2016, IEEE Sensors Journal.

[68]  Raziel Haimi-Cohen,et al.  Compressive measurements generated by structurally random matrices: Asymptotic normality and quantization , 2016, Signal Process..

[69]  Wotao Yin,et al.  Trust, But Verify: Fast and Accurate Signal Recovery From 1-Bit Compressive Measurements , 2011, IEEE Transactions on Signal Processing.

[70]  Guangming Shi,et al.  Compressive Sensing via Nonlocal Low-Rank Regularization , 2014, IEEE Transactions on Image Processing.

[71]  J. P. Lewis,et al.  Quantization effects on Compressed Sensing Video , 2010, 2010 17th International Conference on Telecommunications.

[72]  Mário A. T. Figueiredo,et al.  Gradient Projection for Sparse Reconstruction: Application to Compressed Sensing and Other Inverse Problems , 2007, IEEE Journal of Selected Topics in Signal Processing.

[73]  Guillermo Sapiro,et al.  Video Compressive Sensing Using Gaussian Mixture Models , 2014, IEEE Transactions on Image Processing.

[74]  Xueming Qian,et al.  Efficient and Robust Image Coding and Transmission Based on Scrambled Block Compressive Sensing , 2018, IEEE Transactions on Multimedia.

[75]  Trac D. Tran,et al.  Fast compressive sampling with structurally random matrices , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[76]  Jianhua Lu,et al.  Compressibility Constrained Sparse Representation With Learnt Dictionary for Low Bit-Rate Image Compression , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[77]  Xinyuan Zhang,et al.  Nonlocal Low-Rank Tensor Factor Analysis for Image Restoration , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[78]  Trac D. Tran,et al.  Fast and Efficient Compressive Sensing Using Structurally Random Matrices , 2011, IEEE Transactions on Signal Processing.

[79]  Guillermo Sapiro,et al.  Adaptive temporal compressive sensing for video , 2013, 2013 IEEE International Conference on Image Processing.

[80]  A. Robert Calderbank,et al.  Multi-scale Bayesian reconstruction of compressive X-ray image , 2015, 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[81]  Xin Yuan,et al.  Compressive video microscope via structured illumination , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[82]  Bin Song,et al.  Joint Sampling Rate and Bit-Depth Optimization in Compressive Video Sampling , 2014, IEEE Transactions on Multimedia.

[83]  Anamitra Makur,et al.  A compressive sensing approach to object-based surveillance video coding , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[84]  Zheng Shou,et al.  Deep Tensor ADMM-Net for Snapshot Compressive Imaging , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[85]  Hui Li,et al.  Generalized Alternating Projection for Weighted-퓁2, 1 Minimization with Applications to Model-Based Compressive Sensing , 2014, SIAM J. Imaging Sci..

[86]  Emmanuel J. Candès,et al.  Decoding by linear programming , 2005, IEEE Transactions on Information Theory.

[87]  Yonina C. Eldar,et al.  Compressed sensing under optimal quantization , 2017, 2017 IEEE International Symposium on Information Theory (ISIT).

[88]  Jian Weng,et al.  Enabling Secure and Fast Indexing for Privacy-Assured Healthcare Monitoring via Compressive Sensing , 2016, IEEE Transactions on Multimedia.

[89]  Yonina C. Eldar,et al.  Distortion Rate Function of Sub-Nyquist Sampled Gaussian Sources , 2016, IEEE Trans. Inf. Theory.

[90]  Guillermo Sapiro,et al.  Coded aperture compressive temporal imaging , 2013, Optics express.

[91]  Emmanuel J. Candès,et al.  Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information , 2004, IEEE Transactions on Information Theory.

[92]  Michael Elad,et al.  Sparse and Redundant Representations - From Theory to Applications in Signal and Image Processing , 2010 .

[93]  Qionghai Dai,et al.  Rank Minimization for Snapshot Compressive Imaging , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[94]  Richard G. Baraniuk,et al.  Regime Change: Bit-Depth Versus Measurement-Rate in Compressive Sensing , 2011, IEEE Transactions on Signal Processing.

[95]  Xin Yuan,et al.  High-speed compressive range imaging based on active illumination. , 2016, Optics express.

[96]  J. Romberg,et al.  Imaging via Compressive Sampling , 2008, IEEE Signal Processing Magazine.

[97]  Wen Gao,et al.  Group-Based Sparse Representation for Image Restoration , 2014, IEEE Transactions on Image Processing.

[98]  Alessandro Foi,et al.  Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering , 2007, IEEE Transactions on Image Processing.

[99]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[100]  Vassilis Athitsos,et al.  lambda-Net: Reconstruct Hyperspectral Images From a Snapshot Measurement , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[101]  Andrea Montanari,et al.  Message-passing algorithms for compressed sensing , 2009, Proceedings of the National Academy of Sciences.

[102]  Richard G. Baraniuk,et al.  From Denoising to Compressed Sensing , 2014, IEEE Transactions on Information Theory.

[103]  José M. Bioucas-Dias,et al.  A New TwIST: Two-Step Iterative Shrinkage/Thresholding Algorithms for Image Restoration , 2007, IEEE Transactions on Image Processing.