Objective quality assessment of image retargeting based on line distortion

With the proliferation of mobile devices, research on image retargeting is becoming ever more important. However, there is little work on image retargeting quality assessment despite its importance. In this work, we focus on evaluating retargeting quality based on line distortion. Generally, image retargeting results in content loss and shape distortion. Line segments, which are fundamental image structures, are hence discarded or distorted in retargeted images. As a result, we formulate a retargeting quality index consisted of three line distortion measures: line loss, line artifact and line rotation. To test its performance, we have validated it on the public dataset RetargetMe. Experimental results demonstrate that our method outperforms many existent ones and line distortion is a good indicator of retargeting quality.

[1]  Antonio Torralba,et al.  Modeling the Shape of the Scene: A Holistic Representation of the Spatial Envelope , 2001, International Journal of Computer Vision.

[2]  Kai Zeng,et al.  Objective Quality Assessment for Image Retargeting Based on Structural Similarity , 2014, IEEE Journal on Emerging and Selected Topics in Circuits and Systems.

[3]  Antonio Torralba,et al.  SIFT Flow: Dense Correspondence across Different Scenes , 2008, ECCV.

[4]  Akio Yamada,et al.  The MPEG-7 color layout descriptor: a compact image feature description for high-speed image/video segment retrieval , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[5]  Rafael Grompone von Gioi,et al.  LSD: A Fast Line Segment Detector with a False Detection Control , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  B. S. Manjunath,et al.  Color and texture descriptors , 2001, IEEE Trans. Circuits Syst. Video Technol..

[7]  Weisi Lin,et al.  Objective Quality Assessment for Image Retargeting Based on Perceptual Geometric Distortion and Information Loss , 2014, IEEE Journal of Selected Topics in Signal Processing.

[8]  Yael Pritch,et al.  Shift-map image editing , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[9]  Olga Sorkine-Hornung,et al.  A comparative study of image retargeting , 2010, ACM Trans. Graph..

[10]  King Ngi Ngan,et al.  How does the shape descriptor measure the perceptual quality of the retargeting image? , 2014, 2014 IEEE International Conference on Multimedia and Expo Workshops (ICMEW).

[11]  King Ngi Ngan,et al.  Image Retargeting Quality Assessment: A Study of Subjective Scores and Objective Metrics , 2012, IEEE Journal of Selected Topics in Signal Processing.

[12]  Leonidas J. Guibas,et al.  The Earth Mover's Distance as a Metric for Image Retrieval , 2000, International Journal of Computer Vision.

[13]  Ariel Shamir,et al.  Seam Carving for Content-Aware Image Resizing , 2007, ACM Trans. Graph..

[14]  King Ngi Ngan,et al.  Rank Learning Based No-Reference Quality Assessment of Retargeted Images , 2015, 2015 IEEE International Conference on Systems, Man, and Cybernetics.

[15]  Ariel Shamir,et al.  Cropping Scaling Seam carving Warping Multi-operator , 2009 .

[16]  Denis Simakov,et al.  Summarizing visual data using bidirectional similarity , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[17]  Daniel Cohen-Or,et al.  Non-homogeneous Content-driven Video-retargeting , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[18]  O. Sorkine,et al.  Optimized scale-and-stretch for image resizing , 2008, SIGGRAPH 2008.

[19]  Markus Gross,et al.  A system for retargeting of streaming video , 2009, SIGGRAPH 2009.

[20]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[21]  Pietro Perona,et al.  Graph-Based Visual Saliency , 2006, NIPS.