Improved seam carving for semantic video cod

Traditional video codecs like H.264/AVC encode video sequences to minimize the Mean Squared Error (MSE)at a given bitrate. Seam carving is a content-aware resizing method. In this paper, we propose a semantic video compression scheme based on seam carving. Its principle is to suppress non salient parts of the video by seam carving. The reduced sequence is then encoded with H.264/AVC and the seams are represented and encoded with our proposed approach. The main idea is to encode the seams by regrouping them. Compared to our earlier work, the main contributions of this paper are: a new energy map with better temporal robustness, a new way to define groups of seams using k-median clustering, and an improved background synthesis. Experiments show that, compared to a traditional H.264/AVC encoding, we reach a bitrate saving between 10% and 24% % with the same quality of the salient objects.

[1]  Linus Svärm,et al.  Shift-map Image Registration , 2010, 2010 20th International Conference on Pattern Recognition.

[2]  Esa Rahtu,et al.  A Simple and efficient saliency detector for background subtraction , 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops.

[3]  Ariel Shamir,et al.  Seam Carving for Content-Aware Image Resizing , 2007, ACM Trans. Graph..

[4]  Truong Q. Nguyen,et al.  Selective Data Pruning-Based Compression Using High-Order Edge-Directed Interpolation , 2009, IEEE Transactions on Image Processing.

[5]  Jianfei Cai,et al.  Content-Based Image Compression for Arbitrary-Resolution Display Devices , 2011, ICC.

[6]  Kiichi Urahama,et al.  Cartesian resizing of image and video for data compression , 2010, TENCON 2010 - 2010 IEEE Region 10 Conference.

[7]  Yong-Jin Liu,et al.  Image Retargeting Quality Assessment , 2011, Comput. Graph. Forum.

[8]  Shigeo Kato,et al.  Generalized selective data pruning for video sequence , 2011, 2011 18th IEEE International Conference on Image Processing.

[9]  Igor Chueshov,et al.  Navier-Stokes, Fluid Dynamics, and Image and Video Inpainting , 2001 .

[10]  Miki Tetsuya,et al.  Professional Carrier Education using Project Based Learning in Engineering University , 2010 .

[11]  Ajay Luthra,et al.  Overview of the H.264/AVC video coding standard , 2003, IEEE Trans. Circuits Syst. Video Technol..

[12]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[13]  Pierre Vandergheynst,et al.  Stream carving: An adaptive seam carving algorithm , 2010, 2010 IEEE International Conference on Image Processing.

[14]  Wenxian Yang,et al.  Seam carving extension: a compression perspective , 2009, MM '09.

[15]  E. Renan,et al.  Seam carving for semantic video coding , 2011, Optical Engineering + Applications.

[16]  Guillermo Sapiro,et al.  Navier-stokes, fluid dynamics, and image and video inpainting , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[17]  Frédéric Dufaux,et al.  A new object based quality metric based on SIFT and SSIM , 2012, 2012 19th IEEE International Conference on Image Processing.

[18]  Ariel Shamir,et al.  Improved seam carving for video retargeting , 2008, SIGGRAPH 2008.

[19]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[20]  Gary J. Sullivan,et al.  Rate-constrained coder control and comparison of video coding standards , 2003, IEEE Trans. Circuits Syst. Video Technol..

[21]  Shigeo Kato,et al.  Image coding using concentration and dilution based on seam carving with hierarchical search , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[22]  Tanaka Yuichi,et al.  SSIM Based Image Quality Assessment Applicable to Resized Images , 2011 .

[23]  ShamirAriel,et al.  Improved seam carving for video retargeting , 2008 .