Significance Evaluation of Video Data Over Media Cloud Based on Compressed Sensing

Given the varying communication environment between the media cloud and users, there is a need to ensure the most significant part of a video will be successfully transmitted. Although there exist some techniques to evaluate the significance of video data in traditional video coding methods, such as H.264, the evaluation algorithms are often simple and inaccurate. This paper presents a novel significance evaluation method for video data based on compressed sensing. Specifically, we propose a method to obtain a trained dictionary directly by using the measurements of the video data, and then keep the sparse components and generate a saliency map. Since the sparse components can reflect the essential parts of videos, we discuss how to analyze the area and distribution of salient regions. At last, we present a computing method that gives the degree of significance of a frame. Experimental results show that the proposed saliency map reflects the focus points of humans. The method can be used in the distribution of video data over “wireless” transmissions and provide good video quality to mobile users.

[1]  Trac D. Tran,et al.  Distributed Compressed Video Sensing , 2009, 2009 43rd Annual Conference on Information Sciences and Systems.

[2]  Sanghoon Sull,et al.  A VBR Video Encoding for Locally Consistent Picture Quality With Small Buffering Delay Under Limited Bandwidth , 2012, IEEE Transactions on Broadcasting.

[3]  Dewen Hu,et al.  Salient Region Detection via Integrating Diffusion-Based Compactness and Local Contrast , 2015, IEEE Transactions on Image Processing.

[4]  Joel A. Tropp,et al.  Signal Recovery From Random Measurements Via Orthogonal Matching Pursuit , 2007, IEEE Transactions on Information Theory.

[5]  Abdulhakem Y. Elezzabi,et al.  Block-based adaptive compressed sensing for video , 2010, 2010 IEEE International Conference on Image Processing.

[6]  Kate Ching-Ju Lin,et al.  Quality-Differentiated Video Multicast in Multirate Wireless Networks , 2013, IEEE Transactions on Mobile Computing.

[7]  Yonggang Wen,et al.  Optimal Transcoding and Caching for Adaptive Streaming in Media Cloud: an Analytical Approach , 2015, IEEE Transactions on Circuits and Systems for Video Technology.

[8]  Chia-Wen Lin,et al.  Prioritized retransmission for error protection of video streaming over WLANs , 2004, 2004 IEEE International Symposium on Circuits and Systems (IEEE Cat. No.04CH37512).

[9]  Yen-Jen Oyang,et al.  A Priority Selected Cache Algorithm for Video Relay in Streaming Applications , 2007, IEEE Transactions on Broadcasting.

[10]  Tim Moors,et al.  Deferred discard for improving the quality of video sent across congested networks , 2013, 38th Annual IEEE Conference on Local Computer Networks.

[11]  M. Elad,et al.  $rm K$-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation , 2006, IEEE Transactions on Signal Processing.

[12]  Junggab Son,et al.  Media cloud: A secure and efficient virtualization framework for media service , 2014, 2014 IEEE International Conference on Consumer Electronics (ICCE).

[13]  Junchi Yan,et al.  Visual Saliency Detection via Sparsity Pursuit , 2010, IEEE Signal Processing Letters.

[14]  Ali Borji,et al.  CAT2000: A Large Scale Fixation Dataset for Boosting Saliency Research , 2015, ArXiv.

[15]  Shannon M. Hughes,et al.  Compressive K-SVD , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[16]  A. Bruckstein,et al.  K-SVD : An Algorithm for Designing of Overcomplete Dictionaries for Sparse Representation , 2005 .

[17]  Yonggang Wen,et al.  Cost optimal video transcoding in media cloud: Insights from user viewing pattern , 2014, 2014 IEEE International Conference on Multimedia and Expo (ICME).

[18]  Hayder Radha,et al.  Adaptive dictionaries for compressive imaging , 2013, 2013 IEEE Global Conference on Signal and Information Processing.

[19]  David L Donoho,et al.  Compressed sensing , 2006, IEEE Transactions on Information Theory.

[20]  Andrés Marín López,et al.  Media cloud: an open cloud computing middleware for content management , 2011, IEEE Transactions on Consumer Electronics.

[21]  Hayder Radha,et al.  Delay Constraint Error Control Protocol for Real-Time Video Communication , 2009, IEEE Transactions on Multimedia.

[22]  Emmanuel J. Candès,et al.  Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information , 2004, IEEE Transactions on Information Theory.

[23]  Li Song,et al.  Foreground Estimation Based on Linear Regression Model With Fused Sparsity on Outliers , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[24]  Michael A. Saunders,et al.  Atomic Decomposition by Basis Pursuit , 1998, SIAM J. Sci. Comput..