Adaptive image retargeting using saliency-based continuous seam carving

This paper presents an adaptive image retargeting approach using saliency-based continuous seam carving to efficiently display im- ages on small screens. A multiscale contrast-based saliency map is first generated and used as the energy map for conventional discrete seam carving, and a reasonable number of seams are adaptively extracted. Then the reduced dimensions allocated to continuous seam carving CSC and possible scaling are determined by the analysis of the energy curve of the extracted seams. The proposed CSC assigns to each ex- tracted seam a reserving ratio in accordance with the corresponding seam energy and the reduced dimension, and the retargeted image is generated using an efficient scheme of mapping and resampling based on the reserving ratio map. Experimental results demonstrate better re- targeting performance of the proposed approach under different reduc- tion ratios. © 2010 Society of Photo-Optical Instrumentation Engineers.

[1]  Shao-Yi Chien,et al.  Content-aware image resizing using perceptual seam carving with human attention model , 2008, 2008 IEEE International Conference on Multimedia and Expo.

[2]  Ariel Shamir,et al.  Improved seam carving for video retargeting , 2008, SIGGRAPH 2008.

[3]  S. Avidan,et al.  Seam carving for content-aware image resizing , 2007, SIGGRAPH 2007.

[4]  Raimondo Schettini,et al.  Self-Adaptive Image Cropping for Small Displays , 2007, IEEE Transactions on Consumer Electronics.

[5]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[6]  Vidya Setlur,et al.  Retargeting Images and Video for Preserving Information Saliency , 2007, IEEE Computer Graphics and Applications.

[7]  Benjamin B. Bederson,et al.  Automatic thumbnail cropping and its effectiveness , 2003, UIST '03.

[8]  Michael Gleicher,et al.  Automatic image retargeting with fisheye-view warping , 2005, UIST.

[9]  J.-L. Wu,et al.  Video Adaptation for Small Display Based on Content Recomposition , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[10]  Xing Xie,et al.  A visual attention model for adapting images on small displays , 2003, Multimedia Systems.

[11]  William T. Freeman,et al.  The patch transform and its applications to image editing , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[12]  Denis Simakov,et al.  Summarizing visual data using bidirectional similarity , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[13]  Wen Gao,et al.  Generating Video Sequence from Photo Image for Mobile Screens by Content Analysis , 2007, 2007 IEEE International Conference on Multimedia and Expo.

[14]  Daniel Cohen-Or,et al.  Non-homogeneous Content-driven Video-retargeting , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[15]  Ramesh Raskar,et al.  Automatic image retargeting , 2005, MUM '05.

[16]  O. Sorkine,et al.  Optimized scale-and-stretch for image resizing , 2008, SIGGRAPH 2008.