Multi-operator Image Retargeting Based on Automatic Quality Assessment

Image retargeting aims to avoid visual distortion while retaining important image content in resizing. However, no single image retargeting method can handle all cases. In this paper, we propose a novel multi-operator image retargeting approach, which utilizes an efficient and human perception based automatic quality assessment in operator selection. First, we calculate the importance map and distortion map for quality assessment. Then, we construct the resizing space and assess the performance of each operator in iterative width and/or height reduction. Finally, we select the optimal operator sequence by dynamic programming and generate the target image. Experiments demonstrate the effectiveness of the proposed approach.

[1]  Daniel Cohen-Or,et al.  Non-homogeneous Content-driven Video-retargeting , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[2]  Ramesh Raskar,et al.  Automatic image retargeting , 2005, MUM '05.

[3]  O. Sorkine,et al.  Optimized scale-and-stretch for image resizing , 2008, SIGGRAPH 2008.

[4]  Markus Gross,et al.  A system for retargeting of streaming video , 2009, SIGGRAPH 2009.

[5]  Aaas News,et al.  Book Reviews , 1893, Buffalo Medical and Surgical Journal.

[6]  Ling-Yu Duan,et al.  Consumer video retargeting: context assisted spatial-temporal grid optimization , 2009, ACM Multimedia.

[7]  Yael Pritch,et al.  Shift-map image editing , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[8]  Jun Wang,et al.  Image retargeting assessment based on salient region similarity , 2012, ICIMCS '12.

[9]  Ariel Shamir,et al.  Cropping Scaling Seam carving Warping Multi-operator , 2009 .

[10]  S. Avidan,et al.  Seam carving for content-aware image resizing , 2007, SIGGRAPH 2007.

[11]  King Ngi Ngan,et al.  Study of subjective and objective quality assessment of retargeted images , 2012, 2012 IEEE International Symposium on Circuits and Systems.

[12]  Ariel Shamir,et al.  Seam Carving for Content-Aware Image Resizing , 2007, ACM Trans. Graph..

[13]  Hua Huang,et al.  Real-time content-aware image resizing , 2009, Science in China Series F: Information Sciences.

[14]  Wen Gao,et al.  Fast retargeting with adaptive grid optimization , 2011, 2011 IEEE International Conference on Multimedia and Expo.

[15]  Gangshan Wu,et al.  Automatic image retargeting evaluation based on user perception , 2010, 2010 IEEE International Conference on Image Processing.

[16]  Michael Gleicher,et al.  Automatic image retargeting with fisheye-view warping , 2005, UIST.

[17]  Diego Gutierrez,et al.  Using eye-tracking to assess different image retargeting methods , 2011, APGV '11.

[18]  Yong-Jin Liu,et al.  Image Retargeting Quality Assessment , 2011, Comput. Graph. Forum.

[19]  Yan Liu,et al.  Image retargeting using multi-map constrained region warping , 2009, ACM Multimedia.

[20]  Olga Sorkine-Hornung,et al.  A comparative study of image retargeting , 2010, ACM Trans. Graph..

[21]  Xing Xie,et al.  A visual attention model for adapting images on small displays , 2003, Multimedia Systems.

[22]  Shungang Hua,et al.  Similarity measure for image resizing using SIFT feature , 2012, EURASIP J. Image Video Process..

[23]  S. Süsstrunk,et al.  Frequency-tuned salient region detection , 2009, CVPR 2009.