Block compressed sampling of image signals by saliency based adaptive partitioning

In recent years, block compressed sampling (BCS) has emerged as a considerable attractive sampling technology for image acquisition. However, the general BCS approaches ignore the information distribution in the same image sub-block, and may lead to unfair allocation of sampling resources. In this paper, we propose a novel compressed sampling scheme by employing the idea of adaptive partition. In the proposed scheme, images are adaptively partitioned based on their saliency information through clustering, and pixels with similar saliency are gathered in the same sub-blocks. Sampling rates for those blocks, in turn, are computed on the basis of their saliency values, respectively. Therefore the sampling resources are allocated with fairer and more equitable sharing by all sub-blocks. Experimental results show that the proposed scheme has better visual effect and obtains higher image reconstruction accuracy than existing ones.

[1]  Cheng Wang,et al.  Energy-Sharing Model With Price-Based Demand Response for Microgrids of Peer-to-Peer Prosumers , 2017, IEEE Transactions on Power Systems.

[2]  Shih-Fu Chang,et al.  Exploiting Feature and Class Relationships in Video Categorization with Regularized Deep Neural Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Dimitrios Pendarakis,et al.  ContainerLeaks: Emerging Security Threats of Information Leakages in Container Clouds , 2017, 2017 47th Annual IEEE/IFIP International Conference on Dependable Systems and Networks (DSN).

[4]  James E. Fowler,et al.  Multiscale block compressed sensing with smoothed projected Landweber reconstruction , 2011, 2011 19th European Signal Processing Conference.

[5]  James E. Fowler,et al.  Block-Based Compressed Sensing of Images and Video , 2012, Found. Trends Signal Process..

[6]  Junguo Zhang,et al.  Adaptive compressed sensing for wireless image sensor networks , 2017, Multimedia Tools and Applications.

[7]  Jinhui Tang,et al.  Weakly Supervised Deep Matrix Factorization for Social Image Understanding , 2017, IEEE Transactions on Image Processing.

[8]  Yongdong Zhang,et al.  Instant Mobile Video Search With Layered Audio-Video Indexing and Progressive Transmission , 2014, IEEE Transactions on Multimedia.

[9]  E FowlerJames,et al.  Block-Based Compressed Sensing of Images and Video , 2012 .

[10]  Fei Li,et al.  Detection of Suspicious Lesions by Adaptive Thresholding Based on Multiresolution Analysis in Mammograms , 2011, IEEE Transactions on Instrumentation and Measurement.

[11]  Yongdong Zhang,et al.  Multi-task deep visual-semantic embedding for video thumbnail selection , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Jitendra Malik,et al.  Normalized cuts and image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[13]  Jean-Luc Starck,et al.  Sparse Solution of Underdetermined Systems of Linear Equations by Stagewise Orthogonal Matching Pursuit , 2012, IEEE Transactions on Information Theory.

[14]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[15]  Emmanuel J. Candès,et al.  Near-Optimal Signal Recovery From Random Projections: Universal Encoding Strategies? , 2004, IEEE Transactions on Information Theory.

[16]  Yanning Zhang,et al.  Effective Image Block Compressed Sensing , 2014, 2014 22nd International Conference on Pattern Recognition.

[17]  James E. Fowler,et al.  Block Compressed Sensing of Images Using Directional Transforms , 2010, 2010 Data Compression Conference.

[18]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[19]  Lu Gan Block Compressed Sensing of Natural Images , 2007, 2007 15th International Conference on Digital Signal Processing.

[20]  David L Donoho,et al.  Compressed sensing , 2006, IEEE Transactions on Information Theory.

[21]  Yanning Zhang,et al.  Effective Image Block Compressed Sensing with Quantized Measurement , 2014, 2014 Data Compression Conference.

[22]  David G. Stork,et al.  Pattern Classification , 1973 .

[23]  Chen Chen,et al.  Compressed-sensing recovery of images and video using multihypothesis predictions , 2011, 2011 Conference Record of the Forty Fifth Asilomar Conference on Signals, Systems and Computers (ASILOMAR).

[24]  Maoguo Gong,et al.  Fuzzy C-Means Clustering With Local Information and Kernel Metric for Image Segmentation , 2013, IEEE Transactions on Image Processing.

[25]  Yang Shuyuan,et al.  Block-Based Adaptive Compressed Sensing of Image Using Texture Information , 2013 .

[26]  Wei Yang,et al.  Microcalcification diagnosis in digital mammography using extreme learning machine based on hidden Markov tree model of dual-tree complex wavelet transform , 2017, Expert Syst. Appl..

[27]  Ying Yu,et al.  Saliency-Based Compressive Sampling for Image Signals , 2010, IEEE Signal Processing Letters.

[28]  Enrique Mallada,et al.  Sparse Recovery With Graph Constraints , 2012, IEEE Transactions on Information Theory.