Similarity measure for image resizing using SIFT feature

On the basis of the Scale Invariant Feature Transform (SIFT) feature, we research the distance measure in the process of image resizing. Through extracting SIFT features from the original image and the resized one, respectively, we match the SIFT features between two images, and calculate the distance for SIFT feature vectors to evaluate the degree of similarity between the original and the resized image. On the basis of the Euclidean distance measure, an effective image resizing algorithm combining Seam Carving with Scaling is proposed. We first resize an image using Seam Carving, and calculate the similarity distance between the original image and its resized one. Before the salient object and content are damaged obviously, we stop Seam Carving and transfer residual task to Scaling. Experiments show that our algorithm is able to avoid the damage and distortion of image content and preserve both the local structure and the global visual effect of the image graciously.

[1]  Shao-Yi Chien,et al.  Content-aware image resizing using perceptual seam carving with human attention model , 2008, 2008 IEEE International Conference on Multimedia and Expo.

[2]  Jian Shi,et al.  Image Retargeting Using Mesh Parametrization , 2009, IEEE Transactions on Multimedia.

[3]  Luc Van Gool,et al.  Visibility Maps for Improving Seam Carving , 2010, ECCV Workshops.

[4]  Xiaoxiao Li,et al.  Similarity criterion for image resizing , 2011, EURASIP J. Adv. Signal Process..

[5]  Radomír Mech,et al.  Optimizing Structure Preserving Embedded Deformation for Resizing Images and Vector Art , 2009, Comput. Graph. Forum.

[6]  Weiming Dong,et al.  Optimized image resizing using seam carving and scaling , 2009, SIGGRAPH 2009.

[7]  Markus H. Gross,et al.  A system for retargeting of streaming video , 2009, ACM Trans. Graph..

[8]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[9]  Wolfgang Effelsberg,et al.  Algorithms for video retargeting , 2010, Multimedia Tools and Applications.

[10]  Ralph R. Martin,et al.  A Shape‐Preserving Approach to Image Resizing , 2009, Comput. Graph. Forum.

[11]  Ariel Shamir,et al.  Seam Carving for Content-Aware Image Resizing , 2007, ACM Trans. Graph..

[12]  Aldo Maalouf,et al.  Image retargeting using a bandelet-based similarity measure , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[13]  Ariel Shamir,et al.  Improved seam carving for video retargeting , 2008, SIGGRAPH 2008.

[14]  Yael Pritch,et al.  Shift-map image editing , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[15]  Luc Van Gool,et al.  Scene Carving: Scene Consistent Image Retargeting , 2010, ECCV.

[16]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[17]  Wolfgang Effelsberg,et al.  FSCAV: fast seam carving for size adaptation of videos , 2009, ACM Multimedia.

[18]  Edoardo Ardizzone,et al.  Real-time content-aware image resizing using reduced linear model , 2010, 2010 IEEE International Conference on Image Processing.

[19]  Pierre Vandergheynst,et al.  Stream carving: An adaptive seam carving algorithm , 2010, 2010 IEEE International Conference on Image Processing.

[20]  Denis Simakov,et al.  Summarizing visual data using bidirectional similarity , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[21]  Daniel Cohen-Or,et al.  Non-homogeneous Content-driven Video-retargeting , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[22]  Duan-Yu Chen,et al.  Content-aware video resizing based on salient visual cubes , 2011, J. Vis. Commun. Image Represent..

[23]  Adam Finkelstein,et al.  PatchMatch: a randomized correspondence algorithm for structural image editing , 2009, SIGGRAPH 2009.

[24]  William T. Freeman,et al.  The patch transform and its applications to image editing , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[25]  Ralph R. Martin,et al.  Shrinkability Maps for Content‐Aware Video Resizing , 2008, Comput. Graph. Forum.

[26]  Antonio Torralba,et al.  SIFT Flow: Dense Correspondence across Different Scenes , 2008, ECCV.

[27]  Olga Sorkine-Hornung,et al.  A comparative study of image retargeting , 2010, ACM Trans. Graph..

[28]  Sung-Jea Ko,et al.  Improved seam carving using a modified energy function based on wavelet decomposition , 2009, 2009 IEEE 13th International Symposium on Consumer Electronics.

[29]  Mei Han,et al.  Discontinuous seam-carving for video retargeting , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[30]  O. Sorkine,et al.  Optimized scale-and-stretch for image resizing , 2008, SIGGRAPH 2008.

[31]  Michael Werman,et al.  Fast and robust Earth Mover's Distances , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[32]  Ariel Shamir,et al.  Cropping Scaling Seam carving Warping Multi-operator , 2009 .