Adaptive image and video retargeting technique based on Fourier analysis

An adaptive image and video retargeting algorithm based on Fourier analysis is proposed in this work. We first divide an input image into several strips using the gradient information so that each strip consists of textures of similar complexities. Then, we scale each strip adaptively according to its importance measure. More specifically, the distortions, generated by the scaling procedure, are formulated in the frequency domain using the Fourier transform. Then, the objective is to determine the sizes of scaled strips to minimize the sum of distortions, subject to the constraint that the sum of their sizes should equal the size of the target output image. We solve this constrained optimization problem using the Lagrangian multiplier technique. Moreover, we extend the approach to the retargeting of video sequences. Simulation results demonstrate that the proposed algorithm provides reliable retargeting performance efficiently.

[1]  Narendra Ahuja,et al.  Detecting Faces in Images: A Survey , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Xing Xie,et al.  A visual attention model for adapting images on small displays , 2003, Multimedia Systems.

[3]  Benjamin B. Bederson,et al.  Automatic thumbnail cropping and its effectiveness , 2003, UIST '03.

[4]  Fabrice Labeau,et al.  Discrete Time Signal Processing , 2004 .

[5]  Ramesh Raskar,et al.  Automatic image retargeting , 2005, MUM '05.

[6]  Michael Gleicher,et al.  Automatic image retargeting with fisheye-view warping , 2005, UIST.

[7]  Michael Gleicher,et al.  Video retargeting: automating pan and scan , 2006, MM '06.

[8]  Vidya Setlur,et al.  Retargeting Images and Video for Preserving Information Saliency , 2007, IEEE Computer Graphics and Applications.

[9]  S. Avidan,et al.  Seam carving for content-aware image resizing , 2007, SIGGRAPH 2007.

[10]  Daniel Cohen-Or,et al.  Non-homogeneous Content-driven Video-retargeting , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[11]  Jiaya Jia,et al.  Active Window Oriented Dynamic Video Retargeting , 2007 .

[12]  Ariel Shamir,et al.  Improved seam carving for video retargeting , 2008, ACM Trans. Graph..

[13]  Denis Simakov,et al.  Summarizing visual data using bidirectional similarity , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[14]  Hermann Ney,et al.  Pan, zoom, scan — Time-coherent, trained automatic video cropping , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[15]  Shao-Yi Chien,et al.  Content-aware image resizing using perceptual seam carving with human attention model , 2008, 2008 IEEE International Conference on Multimedia and Expo.

[16]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .