Prior-Based Quantization Bin Matching for Cloud Storage of JPEG Images

Millions of user-generated images are uploaded to social media sites like Facebook daily, which translate to a large storage cost. However, there exists an asymmetry in upload and download data: only a fraction of the uploaded images are subsequently retrieved for viewing. In this paper, we propose a cloud storage system that reduces the storage cost of all uploaded JPEG photos, at the expense of a controlled increase in computation mainly during download of requested image subset. Specifically, the system first selectively re-encodes code blocks of uploaded JPEG images using coarser quantization parameters for smaller storage sizes. Then during download, the system exploits known signal priors—sparsity prior and graph-signal smoothness prior—for reverse mapping to recover original fine quantization bin indices, with either deterministic guarantee (lossless mode) or statistical guarantee (near-lossless mode). For fast reverse mapping, we use small dictionaries and sparse graphs that are tailored for specific clusters of similar blocks, which are classified via tree-structured vector quantizer. During image upload, cluster indices identifying the appropriate dictionaries and graphs for the re-quantized blocks are encoded as side information using a differential distributed source coding scheme to facilitate reverse mapping during image download. Experimental results show that our system can reap significant storage savings (up to 12.05%) at roughly the same image PSNR (within 0.18 dB).

[1]  S. P. Lloyd,et al.  Least squares quantization in PCM , 1982, IEEE Trans. Inf. Theory.

[2]  Philip A. Chou,et al.  Optimal pruning with applications to tree-structured source coding and modeling , 1989, IEEE Trans. Inf. Theory.

[3]  Allen Gersho,et al.  Vector quantization and signal compression , 1991, The Kluwer international series in engineering and computer science.

[4]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[5]  K Ramchandran,et al.  Best wavelet packet bases in a rate-distortion sense , 1993, IEEE Trans. Image Process..

[6]  Ronald Arps,et al.  JBIG2-the ultimate bi-level image coding standard , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[7]  Jacques Froment,et al.  Adapted Total Variation for Artifact Free Decompression of JPEG Images , 2005, Journal of Mathematical Imaging and Vision.

[8]  Minh N. Do,et al.  Rate-distortion optimized tree-structured compression algorithms for piecewise polynomial images , 2005, IEEE Transactions on Image Processing.

[9]  A. Bruckstein,et al.  K-SVD : An Algorithm for Designing of Overcomplete Dictionaries for Sparse Representation , 2005 .

[10]  M. Elad,et al.  $rm K$-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation , 2006, IEEE Transactions on Signal Processing.

[11]  Michael Elad,et al.  Image Denoising Via Sparse and Redundant Representations Over Learned Dictionaries , 2006, IEEE Transactions on Image Processing.

[12]  John William Strutt Scientific Papers: On the Character of the Complete Radiation at a Given Temperature , 2009 .

[13]  Michael Elad,et al.  On the Role of Sparse and Redundant Representations in Image Processing , 2010, Proceedings of the IEEE.

[14]  Allen Y. Yang,et al.  Fast L1-Minimization Algorithms For Robust Face Recognition , 2010 .

[15]  Lei Zhang,et al.  Image Deblurring and Super-Resolution by Adaptive Sparse Domain Selection and Adaptive Regularization , 2010, IEEE Transactions on Image Processing.

[16]  Kristian Bredies,et al.  A Total Variation-Based JPEG Decompression Model , 2012, SIAM J. Imaging Sci..

[17]  Wei Dai,et al.  Digital photo album compression based on Global Motion Compensation and Intra/Inter prediction , 2012, 2012 International Conference on Audio, Language and Image Processing.

[18]  Xiaoyan Sun,et al.  Cloud-Based Image Coding for Mobile Devices—Toward Thousands to One Compression , 2013, IEEE Transactions on Multimedia.

[19]  Pascal Frossard,et al.  The emerging field of signal processing on graphs: Extending high-dimensional data analysis to networks and other irregular domains , 2012, IEEE Signal Processing Magazine.

[20]  Oscar C. Au,et al.  Personal photo album compression and management , 2013, 2013 IEEE International Symposium on Circuits and Systems (ISCAS2013).

[21]  Allen Y. Yang,et al.  Fast L1-Minimization Algorithms For Robust Face Recognition , 2010, 1007.3753.

[22]  Feng Wu,et al.  Cloud-based distributed image coding , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[23]  Michael K. Ng,et al.  Reducing Artifacts in JPEG Decompression Via a Learned Dictionary , 2014, IEEE Transactions on Signal Processing.

[24]  Jan-Michael Frahm,et al.  Cloud-scale Image Compression Through Content Deduplication , 2014, BMVC.

[25]  D. Levitin The Organized Mind: Thinking Straight in the Age of Information Overload , 2014 .

[26]  Xiaoyan Sun,et al.  Photo Album Compression for Cloud Storage Using Local Features , 2014, IEEE Journal on Emerging and Selected Topics in Circuits and Systems.

[27]  Xianming Liu,et al.  Inter-block consistent soft decoding of JPEG images with sparsity and graph-signal smoothness priors , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[28]  Wen Gao,et al.  Thousand to one: An image compression system via cloud search , 2015, 2015 IEEE 17th International Workshop on Multimedia Signal Processing (MMSP).

[29]  Xianming Liu,et al.  Data-driven sparsity-based restoration of JPEG-compressed images in dual transform-pixel domain , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[30]  Antonio Ortega,et al.  Designing sparse graphs via structure tensor for block transform coding of images , 2015, 2015 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA).

[31]  Gary J. Sullivan,et al.  Introduction to the Special Issue on HEVC Extensions and Efficient HEVC Implementations , 2016, IEEE Trans. Circuits Syst. Video Technol..

[32]  Leevan Ling,et al.  A Fast Block-Greedy Algorithm for Quasi-optimal Meshless Trial Subspace Selection , 2016, SIAM J. Sci. Comput..

[33]  Xiaoyan Sun,et al.  DAC-Mobi: Data-Assisted Communications of Mobile Images with Cloud Computing Support , 2016, IEEE Transactions on Multimedia.

[34]  Gene Cheung,et al.  Graph-based Dequantization of Block-Compressed Piecewise Smooth Images , 2016, IEEE Signal Processing Letters.

[35]  Xianming Liu,et al.  Random Walk Graph Laplacian-Based Smoothness Prior for Soft Decoding of JPEG Images , 2016, IEEE Transactions on Image Processing.

[36]  Gene Cheung,et al.  Graph Laplacian Regularization for Image Denoising: Analysis in the Continuous Domain , 2016, IEEE Transactions on Image Processing.

[37]  Wen Gao,et al.  A Joint Compression Scheme of Video Feature Descriptors and Visual Content , 2017, IEEE Transactions on Image Processing.