A survey for image resizing

Image resizing is a key technique for displaying images on different devices, and has attracted much attention in the past few years. This paper reviews the image resizing methods proposed in recent years, gives a detailed comparison on their performance, and reveals the main challenges raised in several important issues such as preserving an important region, minimizing distortions, and improving efficiency. Furthermore, this paper discusses the research trends and points out the possible hotspots in this field. We believe this survey can give some guidance for researchers from relevant research areas, offering them an overall and novel view.

[1]  Xueqing Li,et al.  Warp propagation for video resizing , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[2]  J. A. Faulkner.  Paul , 1928 .

[3]  Kun Liu,et al.  Online recognition of people recurrences with bag-of-features representation and automatic new-class labeling , 2010 .

[4]  Bohyung Han,et al.  Seam carving with forward gradient difference maps , 2012, ACM Multimedia.

[5]  Qian Zhang,et al.  Multi-operator image retargeting with automatic integration of direct and indirect seam carving , 2012, Image Vis. Comput..

[6]  Wen Gao,et al.  Video retargeting with multi-scale trajectory optimization , 2010, MIR '10.

[7]  Ralph R. Martin,et al.  Internet visual media processing: a survey with graphics and vision applications , 2013, The Visual Computer.

[8]  Nanning Zheng,et al.  Learning to Detect a Salient Object , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Mishiba Kazu,et al.  Seam Carving in Wavelet Transform Domain , 2011 .

[10]  Daniel Cohen-Or,et al.  Non-homogeneous Content-driven Video-retargeting , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[11]  S. Avidan,et al.  Seam carving for content-aware image resizing , 2007, SIGGRAPH 2007.

[12]  Min Xu,et al.  Context-Aware Video Retargeting via Graph Model , 2013, IEEE Transactions on Multimedia.

[13]  Eli Shechtman,et al.  PatchMatch: a randomized correspondence algorithm for structural image editing , 2009, ACM Trans. Graph..

[14]  Lizhuang Ma,et al.  Temporally Coherent Video Saliency Using Regional Dynamic Contrast , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[15]  Duan-Yu Chen,et al.  Preserving Motion-Tolerant Contextual Visual Saliency for Video Resizing , 2013, IEEE Transactions on Multimedia.

[16]  ShamirAriel,et al.  Improved seam carving for video retargeting , 2008 .

[17]  Daniel Cohen-Or,et al.  Combining color and depth for enhanced image segmentation and retargeting , 2011, The Visual Computer.

[18]  Yu Liu,et al.  Image Resizing Based on Geometry Preservation with Seam Carving , 2012, 2012 IEEE 11th International Conference on Trust, Security and Privacy in Computing and Communications.

[19]  Xing Xie,et al.  A visual attention model for adapting images on small displays , 2003, Multimedia Systems.

[20]  Xing Xie,et al.  Looking into video frames on small displays , 2003, ACM Multimedia.

[21]  William T. Freeman,et al.  The patch transform and its applications to image editing , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[22]  King Ngi Ngan,et al.  Adaptive image retargeting using saliency-based continuous seam carving , 2010 .

[23]  Wei-Ying Ma,et al.  Auto cropping for digital photographs , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[24]  Andrew G. Glen,et al.  APPL , 2001 .

[25]  T.S. Perry,et al.  Consumer electronics , 1990, IEEE Spectrum.

[26]  Xing Xie,et al.  Visual attention based image browsing on mobile devices , 2003, 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698).

[27]  Lei Yang,et al.  Optimal Bi-directional Seam Carving for Content-Aware Image Resizing , 2010, Edutainment.

[28]  Yoichi Sato,et al.  Sensation-based photo cropping , 2009, ACM Multimedia.

[29]  Fan Zhang,et al.  Making stereo photo cropping easy , 2013, 2013 IEEE International Conference on Multimedia and Expo (ICME).

[30]  Bo Yan,et al.  Effective Video Retargeting With Jittery Assessment , 2014, IEEE Transactions on Multimedia.

[31]  Weiming Dong,et al.  Optimized image resizing using seam carving and scaling , 2009, SIGGRAPH 2009.

[32]  Wei Luo,et al.  Content-Based Photo Quality Assessment , 2013, IEEE Trans. Multim..

[33]  Ligang Liu,et al.  Nonhomogeneous scaling optimization for realtime image resizing , 2010, The Visual Computer.

[34]  Ramesh Raskar,et al.  Automatic image retargeting , 2004, SIGGRAPH '04.

[35]  Wolfgang Effelsberg,et al.  GPU video retargeting with parallelized SeamCrop , 2014, MMSys '14.

[36]  Yuan Zhou,et al.  Improved seam carving for stereo image resizing , 2013, EURASIP J. Wirel. Commun. Netw..

[37]  A. Abdel-Dayem,et al.  Integrated Content-aware Image Retargeting System , 2012 .

[38]  Min Xu,et al.  Fusing Warping, Cropping, and Scaling for Optimal Image Thumbnail Generation , 2012, ACCV.

[39]  Yan Zhang,et al.  On the Euclidean distance of images , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[40]  Xueqing Li,et al.  Non-uniform Mesh Warping for Content-Aware Image Retargeting , 2011, ICIAR.

[41]  Mrityunjay Kumar,et al.  Generalized multiscale seam carving , 2010, 2010 IEEE International Workshop on Multimedia Signal Processing.

[42]  Chang-Su Kim,et al.  Content-aware image and video resizing based on frequency domain analysis , 2011, IEEE Transactions on Consumer Electronics.

[43]  Yasuyuki Matsushita,et al.  Image retargeting using importance diffusion , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[44]  O. Sorkine,et al.  Optimized scale-and-stretch for image resizing , 2008, SIGGRAPH 2008.

[45]  Markus Gross,et al.  A system for retargeting of streaming video , 2009, SIGGRAPH 2009.

[46]  Christof Koch,et al.  Modeling attention to salient proto-objects , 2006, Neural Networks.

[47]  Lihi Zelnik-Manor,et al.  Context-Aware Saliency Detection , 2012, IEEE Trans. Pattern Anal. Mach. Intell..

[48]  ShamirAriel,et al.  Seam carving for content-aware image resizing , 2007 .

[49]  Chang-Su Kim,et al.  Adaptive image and video retargeting technique based on Fourier analysis , 2009, CVPR.

[50]  Yan Liu,et al.  Image retargeting using multi-map constrained region warping , 2009, ACM Multimedia.

[51]  Hermann Ney,et al.  Pan, zoom, scan — Time-coherent, trained automatic video cropping , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[52]  Jiaya Jia,et al.  Active Window Oriented Dynamic Video Retargeting , 2007 .

[53]  Shi-Min Hu,et al.  Global contrast based salient region detection , 2011, CVPR 2011.

[54]  Tong-Yee Lee,et al.  Scalable and coherent video resizing with per-frame optimization , 2011, SIGGRAPH 2011.

[55]  Xuhong Tian,et al.  Saliency-driven Shape Preservation for Image Resizing , 2010 .

[56]  Weiming Dong,et al.  Fast Multi-Operator Image Resizing and Evaluation , 2012, Journal of Computer Science and Technology.

[57]  Pierre Vandergheynst,et al.  Stream carving: An adaptive seam carving algorithm , 2010, 2010 IEEE International Conference on Image Processing.

[58]  Hideaki Kimata,et al.  Multi-layered image retargeting , 2012, 2012 19th IEEE International Conference on Image Processing.

[59]  Sabine Süsstrunk,et al.  Saliency detection for content-aware image resizing , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[60]  P. Heng,et al.  Resizing by symmetry-summarization , 2010, SIGGRAPH 2010.

[61]  Ralph R. Martin,et al.  A Shape‐Preserving Approach to Image Resizing , 2009, Comput. Graph. Forum.

[62]  Chao-Hung Lin,et al.  Patch-Based Image Warping for Content-Aware Retargeting , 2013, IEEE Transactions on Multimedia.

[63]  Masaaki Ikehara,et al.  Seam carving in wavelet transform domain , 2011 .

[64]  Michael Gleicher,et al.  Video retargeting: automating pan and scan , 2006, MM '06.

[65]  Yan Gao,et al.  Video composition by optimized 3D mean‐value coordinates , 2012, Comput. Animat. Virtual Worlds.

[66]  Craig Gotsman,et al.  Energy‐Based Image Deformation , 2009, Comput. Graph. Forum.

[67]  Lizhuang Ma,et al.  Seamlet carving for shape-aware image resizing , 2012, Science China Information Sciences.

[68]  Lizhuang Ma,et al.  A Customized Framework to Recompress Massive Internet Images , 2012, Journal of Computer Science and Technology.

[69]  Xueqing Li,et al.  Image resizing via non-homogeneous warping , 2010, Multimedia Tools and Applications.

[70]  Jian-Jiun Ding,et al.  Coarse-to-fine temporal optimization for video retargeting based on seam carving , 2011, 2011 IEEE International Conference on Multimedia and Expo.

[71]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[72]  Olga Sorkine-Hornung,et al.  Visual media retargeting , 2009, SIGGRAPH ASIA Courses.

[73]  Shai Avidan,et al.  Stereo Seam Carving a Geometrically Consistent Approach , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[74]  Truong Q. Nguyen,et al.  Combined image plus depth seam carving for multiview 3D images , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[75]  Thomas S. Huang,et al.  Image processing , 1971 .

[76]  Lifang Wu,et al.  Fast and improved seam carving with strip partition and neighboring probability constraints , 2013, 2013 IEEE International Symposium on Circuits and Systems (ISCAS2013).

[77]  C.-C. Jay Kuo,et al.  Compressed-Domain Video Retargeting , 2014, IEEE Transactions on Image Processing.

[78]  Sung-Jea Ko,et al.  Improved seam carving using a modified energy function based on wavelet decomposition , 2009, 2009 IEEE 13th International Symposium on Consumer Electronics.

[79]  Masaaki Ikehara,et al.  Block-based seam carving , 2011, 2011 1st International Symposium on Access Spaces (ISAS).

[80]  Ralph R. Martin,et al.  Shrinkability Maps for Content‐Aware Video Resizing , 2008, Comput. Graph. Forum.

[81]  S. Karthikeyan,et al.  Optimized Image Resizing using Piecewise Seam Carving , 2012 .

[82]  Olga Sorkine-Hornung,et al.  A comparative study of image retargeting , 2010, ACM Trans. Graph..

[83]  Mei Han,et al.  Discontinuous seam-carving for video retargeting , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[84]  Jiebo Luo,et al.  Subject Content-Based Intelligent Cropping of Digital Photos , 2007, 2007 IEEE International Conference on Multimedia and Expo.

[85]  Alexander Wong,et al.  Enhanced Seam Carving via Integration of Energy Gradient Functionals , 2011, IEEE Signal Processing Letters.

[86]  Kang-Sun Choi,et al.  Content-aware three-dimensional image retargeting for mobile devices , 2012 .

[87]  Lifang Wu,et al.  Fast seam carving with strip constraints , 2012, ICIMCS '12.

[88]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[89]  David Salesin,et al.  Gaze-based interaction for semi-automatic photo cropping , 2006, CHI.

[90]  Dong Wang,et al.  Saliency-driven scaling optimization for image retargeting , 2011, The Visual Computer.

[91]  Wen Gao,et al.  Spatiotemporal Grid Flow for Video Retargeting , 2014, IEEE Transactions on Image Processing.

[92]  Yael Pritch,et al.  Shift-map image editing , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[93]  Luc Van Gool,et al.  Scene Carving: Scene Consistent Image Retargeting , 2010, ECCV.

[94]  Ariel Shamir,et al.  Seam carving for media retargeting , 2009, CACM.

[95]  Stephen Lin,et al.  Learning the Change for Automatic Image Cropping , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[96]  Chang Wen Chen,et al.  Deformable Shape Preserving Video Retargeting With Salient Curve Matching , 2014, IEEE Journal on Emerging and Selected Topics in Circuits and Systems.

[97]  Li Xu,et al.  Hierarchical Saliency Detection , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[98]  Xiaodong Wu,et al.  Optimal multiple surfaces searching for video/image resizing - a graph-theoretic approach , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[99]  Ariel Shamir,et al.  Improved seam carving for video retargeting , 2008, ACM Trans. Graph..

[100]  Takeshi Naemura,et al.  Proportional constraint for seam carving , 2009, SIGGRAPH '09.

[101]  Lixia Zhang,et al.  Image retargeting with multifocus fisheye transformation , 2012, The Visual Computer.

[102]  Mrityunjay Kumar,et al.  A Distortion-Sensitive Seam Carving Algorithm for Content-Aware Image Resizing , 2011, J. Signal Process. Syst..

[103]  José Eustáquio Rangel de Queiroz,et al.  Combining Multiple Image Features to Guide Automatic Portrait Cropping for Rendering Different Aspect Ratios , 2010, 2010 Sixth International Conference on Signal-Image Technology and Internet Based Systems.

[104]  Sung-Jea Ko,et al.  Wavelet based seam carving for content-aware image resizing , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[105]  Tong-Yee Lee,et al.  Summarization-Based Image Resizing by Intelligent Object Carving , 2014, IEEE Transactions on Visualization and Computer Graphics.

[106]  Bo Yan,et al.  Matching-Area-Based Seam Carving for Video Retargeting , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[107]  Masaaki Ikehara,et al.  Improved Seam Merging for Content-Aware Image Resizing , 2013, IEICE Trans. Inf. Syst..

[108]  Raimondo Schettini,et al.  Self-Adaptive Image Cropping for Small Displays , 2007, IEEE Transactions on Consumer Electronics.

[109]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[110]  Dr. S. Karthikeyan,et al.  An Efficient Method for Content Aware Image Resizing Using PSC , 2011 .

[111]  Olga Sorkine-Hornung,et al.  Robust Image Retargeting via Axis‐Aligned Deformation , 2012, Comput. Graph. Forum.

[112]  Wolfgang Effelsberg,et al.  FSCAV: fast seam carving for size adaptation of videos , 2009, ACM Multimedia.

[113]  Daniel Cohen-Or,et al.  Feature-aware texturing , 2006, EGSR '06.

[114]  Tong-Yee Lee,et al.  Motion-based video retargeting with optimized crop-and-warp , 2010, SIGGRAPH 2010.

[115]  Benjamin B. Bederson,et al.  Automatic thumbnail cropping and its effectiveness , 2003, UIST '03.

[116]  Liqing Zhang,et al.  Saliency Detection: A Spectral Residual Approach , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[117]  K. N. Balasubramanya Murthy,et al.  A smart automatic thumbnail cropping based on attention driven regions of interest extraction , 2009, ICIS.

[118]  Xing Xie,et al.  Automatic browsing of large pictures on mobile devices , 2003, MULTIMEDIA '03.

[119]  Natasha Gelfand,et al.  A survey of image retargeting techniques , 2010, Optical Engineering + Applications.

[120]  Hua Huang,et al.  Real-time content-aware image resizing , 2009, Science in China Series F: Information Sciences.

[121]  Chia-Wen Lin,et al.  Maintaining Temporal Coherence in Video Retargeting Using Mosaic-Guided Scaling , 2011, IEEE Transactions on Image Processing.

[122]  Masaaki Ikehara,et al.  Image resizing using improved seam merging , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[123]  Michael Gleicher,et al.  Automatic image retargeting with fisheye-view warping , 2005, UIST.

[124]  Pietro Perona,et al.  Graph-Based Visual Saliency , 2006, NIPS.

[125]  Jeffrey Ho,et al.  Seam Segment Carving: Retargeting Images to Irregularly-Shaped Image Domains , 2012, ECCV.

[126]  Shai Avidan,et al.  Geometrically consistent stereo seam carving , 2011, 2011 International Conference on Computer Vision.

[127]  Masaaki Ikehara,et al.  Seam merging for image resizing with structure preservation , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[128]  Ariel Shamir,et al.  Cropping Scaling Seam carving Warping Multi-operator , 2009 .

[129]  Qing Zhang,et al.  Video retargeting combining warping and summarizing optimization , 2013, The Visual Computer.

[130]  Hans-Peter Seidel,et al.  Motion-aware temporal coherence for video resizing , 2009, ACM Trans. Graph..

[131]  Shao-Yi Chien,et al.  Content-aware image resizing using perceptual seam carving with human attention model , 2008, 2008 IEEE International Conference on Multimedia and Expo.

[132]  Susanto Rahardja,et al.  Perceptually relevant energy function for seam carving , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[133]  Takeshi Naemura,et al.  Seam carving for stereo images , 2010, 2010 3DTV-Conference: The True Vision - Capture, Transmission and Display of 3D Video.

[134]  Chao-Hung Lin,et al.  Content-Aware Video Retargeting Using Object-Preserving Warping , 2013 .

[135]  Jian Shi,et al.  Image Retargeting Using Mesh Parametrization , 2009, IEEE Transactions on Multimedia.

[136]  Luc Van Gool,et al.  Visibility Maps for Improving Seam Carving , 2010, ECCV Workshops.