Content-aware image and video resizing based on frequency domain analysis

An adaptive image and video resizing algorithm based on the frequency domain analysis is proposed in this work. Given an image, we first construct an importance map by combining the gradient and the saliency information. We partition the image into several strips so that each strip contains pixels of similar importance levels. We model the distortion, which is caused by scaling a strip, in the frequency domain. Then, we scale each strip adaptively to minimize the overall distortion of the whole image. Moreover, we extend the proposed algorithm for video resizing. We add the motion term to construct the importance map, and suppress excessive parameter variations to achieve jitter-free video resizing. Simulation results show that the proposed algorithm provides higher quality resizing results than conventional algorithms, although it requires lower computational complexity.

[1]  Chang-Su Kim,et al.  Adaptive image and video retargeting technique based on Fourier analysis , 2009, CVPR.

[2]  Ariel Shamir,et al.  Cropping Scaling Seam carving Warping Multi-operator , 2009 .

[3]  Yair Shoham,et al.  Efficient bit allocation for an arbitrary set of quantizers [speech coding] , 1988, IEEE Trans. Acoust. Speech Signal Process..

[4]  H. Seidel,et al.  Motion-aware temporal coherence for video resizing , 2009, SIGGRAPH 2009.

[5]  Narendra Ahuja,et al.  Detecting Faces in Images: A Survey , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Daniel Cohen-Or,et al.  Non-homogeneous Content-driven Video-retargeting , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[7]  Sung-Jea Ko,et al.  Fast content-aware image resizing scheme in the compressed domain , 2009, IEEE Transactions on Consumer Electronics.

[8]  Benjamin B. Bederson,et al.  Automatic thumbnail cropping and its effectiveness , 2003, UIST '03.

[9]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[10]  Ariel Shamir,et al.  Seam Carving for Content-Aware Image Resizing , 2007, ACM Trans. Graph..

[11]  O. Sorkine,et al.  Optimized scale-and-stretch for image resizing , 2008, SIGGRAPH 2008.

[12]  Daniel Cohen-Or,et al.  Feature-aware texturing , 2006, EGSR '06.

[13]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[14]  Ariel Shamir,et al.  Improved seam carving for video retargeting , 2008, SIGGRAPH 2008.

[15]  Sung-Jea Ko,et al.  Low complexity content-aware video retargeting for mobile devices , 2010, IEEE Transactions on Consumer Electronics.

[16]  Xing Xie,et al.  A visual attention model for adapting images on small displays , 2003, Multimedia Systems.