Combination of saliency histogram equalisation and seam carving for image resizing

This study presents a novel approach to content-aware image sizing by combining the continuous approach using saliency histogram equalisation (SHE) and the discrete approach using seam carving (SC). It constructs a non-uniform quad mesh to represent an image by equalising its saliency histogram (SH), and changes the mesh size to represent the resized image by carving seams of insignificant quads in the SH domain. As SHE is simple to implement, and SC can be obtained via dynamic programming, the proposed SHE combined with SC (SHE-SC) algorithm is computationally efficient. Experimental results show that SHE-SC is preferable to other existing algorithms.

[1]  Sung-Jea Ko,et al.  Improved seam carving using a modified energy function based on wavelet decomposition , 2009, 2009 IEEE 13th International Symposium on Consumer Electronics.

[2]  Edoardo Ardizzone,et al.  Real-time content-aware image resizing using reduced linear model , 2010, 2010 IEEE International Conference on Image Processing.

[3]  Ligang Liu,et al.  Content-aware image resizing by quadratic programming , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops.

[4]  Hsi-Chin Hsin.  Saliency histogram equalisation and its application to image resizing , 2016, IET Image Process..

[5]  Wolfgang Effelsberg,et al.  Seam carving with improved edge preservation , 2010, Electronic Imaging.

[6]  Jianfei Cai,et al.  Content-Based Image Compression for Arbitrary-Resolution Display Devices , 2011, ICC.

[7]  Naila Murray,et al.  Saliency estimation using a non-parametric low-level vision model , 2011, CVPR 2011.

[8]  Tong-Yee Lee,et al.  Summarization-Based Image Resizing by Intelligent Object Carving. , 2013, IEEE transactions on visualization and computer graphics.

[9]  O. Sorkine,et al.  Optimized scale-and-stretch for image resizing , 2008, SIGGRAPH 2008.

[10]  Wenxian Yang,et al.  Seam carving extension: a compression perspective , 2009, MM '09.

[11]  Andrew K. Chan,et al.  Fundamentals of Wavelets: Theory, Algorithms, and Applications , 2011 .

[12]  Ariel Shamir,et al.  Cropping Scaling Seam carving Warping Multi-operator , 2009 .

[13]  Mishiba Kazu,et al.  Seam Carving in Wavelet Transform Domain , 2011 .

[14]  Daniel Cohen-Or,et al.  Non-homogeneous Content-driven Video-retargeting , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[15]  Rafika Harrabi,et al.  Color image segmentation using multi-level thresholding approach and data fusion techniques: application in the breast cancer cells images , 2012, EURASIP Journal on Image and Video Processing.

[16]  Daniel Cohen-Or,et al.  Feature-aware texturing , 2006, EGSR '06.

[17]  Masaaki Ikehara,et al.  Wavelet-based content-aware image coding with rate-dependent seam carving , 2012, 2012 19th IEEE International Conference on Image Processing.

[18]  S. Avidan,et al.  Seam carving for content-aware image resizing , 2007, SIGGRAPH 2007.

[19]  Giovanni Maria Farinella,et al.  Saliency-Based Selection of Gradient Vector Flow Paths for Content Aware Image Resizing , 2014, IEEE Transactions on Image Processing.

[20]  Ali Borji,et al.  Salient Object Detection: A Benchmark , 2015, IEEE Transactions on Image Processing.

[21]  Olga Sorkine-Hornung,et al.  Visual media retargeting , 2009, SIGGRAPH ASIA Courses.

[22]  Mrityunjay Kumar,et al.  Multi-seam carving via seamlets , 2011, Electronic Imaging.

[23]  Shao-Yi Chien,et al.  Content-aware image resizing using perceptual seam carving with human attention model , 2008, 2008 IEEE International Conference on Multimedia and Expo.

[24]  Shungang Hua,et al.  Similarity measure for image resizing using SIFT feature , 2012, EURASIP J. Image Video Process..

[25]  Jingdong Wang,et al.  Salient Object Detection: A Discriminative Regional Feature Integration Approach , 2013, International Journal of Computer Vision.

[26]  Olga Sorkine-Hornung,et al.  A comparative study of image retargeting , 2010, ACM Trans. Graph..