Reflection symmetry aware image retargeting

Abstract Reflection symmetry is one of the most commonly occurring and prominent visual attributes present in the real world. With an increase in the display devices of different sizes and aspect ratios, the images captured from the real world need to be resized to fit to the display device. In this paper, we propose a novel image retargeting approach which preserves the reflection symmetry present in the image during the image retargeting process. We detect the symmetry region present in the image using symmetry axis detection and object proposals. We propose a novel framework for finding an optimized reflected seam for the least energy seam defined by the seam carving approach. The symmetry axis and the symmetric object are preserved by adding or removing a seam and its reflected counterpart together. We show better preservation of symmetry axis, preservation of shape of the symmetric object, and quality of image retargeting when compared to the existing methods using three quantitative measures along with the qualitative results.

[1]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[2]  Tae-Hyun Oh,et al.  Weakly- and Self-Supervised Learning for Content-Aware Deep Image Retargeting , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[3]  Feiniu Yuan,et al.  Optimized Multioperator Image Retargeting Based on Perceptual Similarity Measure , 2017, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[4]  Michal Irani,et al.  Internal Distribution Matching for Natural Image Retargeting , 2018, ArXiv.

[5]  Lei Yang,et al.  A content-aware image resizing method with prominent object size adjusted , 2010, VRST '10.

[6]  Xiang Bai,et al.  DeepSkeleton: Learning Multi-Task Scale-Associated Deep Side Outputs for Object Skeleton Extraction in Natural Images , 2016, IEEE Transactions on Image Processing.

[7]  Ralph R. Martin,et al.  A Shape‐Preserving Approach to Image Resizing , 2009, Comput. Graph. Forum.

[8]  Qiang Lu,et al.  RETRACTED ARTICLE: Image retargeting based on self-learning 3D saliency for content-aware data analysis , 2017, Multimedia Tools and Applications.

[9]  Weisi Lin,et al.  Saliency Detection in the Compressed Domain for Adaptive Image Retargeting , 2012, IEEE Transactions on Image Processing.

[10]  Lok Ming Lui,et al.  Image Retargeting via Beltrami Representation , 2018, IEEE Transactions on Image Processing.

[11]  P. Heng,et al.  Resizing by symmetry-summarization , 2010, SIGGRAPH 2010.

[12]  Weiming Dong,et al.  Optimized image resizing using seam carving and scaling , 2009, SIGGRAPH 2009.

[13]  Cécile Barat,et al.  Wavelet-Based Reflection Symmetry Detection via Textural and Color Histograms , 2017, 2017 IEEE International Conference on Computer Vision Workshops (ICCVW).

[14]  Chao-Hung Lin,et al.  Patch-Based Image Warping for Content-Aware Retargeting , 2013, IEEE Transactions on Multimedia.

[15]  Jing Xiao,et al.  Importance filtering for image retargeting , 2011, CVPR 2011.

[16]  Markus Gross,et al.  A system for retargeting of streaming video , 2009, SIGGRAPH 2009.

[17]  Tong-Yee Lee,et al.  Photo Squarization by Deep Multi-Operator Retargeting , 2018, ACM Multimedia.

[18]  Yanxi Liu,et al.  Symmetry Detection from RealWorld Images Competition 2013: Summary and Results , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[19]  Daniel Cohen-Or,et al.  Non-homogeneous Content-driven Video-retargeting , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[20]  Shanmuganathan Raman,et al.  SymmMap: Estimation of the 2-D Reflection Symmetry Map and Its Applications , 2017, 2017 IEEE International Conference on Computer Vision Workshops (ICCVW).

[21]  Luc Van Gool,et al.  Computational Symmetry in Computer Vision and Computer Graphics , 2010, Found. Trends Comput. Graph. Vis..

[22]  Ariel Shamir,et al.  A comparative study of image retargeting , 2010, SIGGRAPH 2010.

[23]  Shanmuganathan Raman,et al.  Detecting Approximate Reflection Symmetry in a Point Set Using Optimization on Manifold , 2017, IEEE Transactions on Signal Processing.

[24]  Ariel Shamir,et al.  Improved seam carving for video retargeting , 2008, SIGGRAPH 2008.

[25]  S. Avidan,et al.  Seam carving for content-aware image resizing , 2007, SIGGRAPH 2007.

[26]  Jan-Olof Eklundh,et al.  Detecting Symmetry and Symmetric Constellations of Features , 2006, ECCV.

[27]  Yung-Yu Chuang,et al.  A line-structure-preserving approach to image resizing , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[28]  David Grant Colburn Hildebrand,et al.  Finding Mirror Symmetry via Registration and Optimal Symmetric Pairwise Assignment of Curves , 2017, 2017 IEEE International Conference on Computer Vision Workshops (ICCVW).

[29]  Bo Yan,et al.  Seam Searching-Based Pixel Fusion for Image Retargeting , 2015, IEEE Transactions on Circuits and Systems for Video Technology.

[30]  Jian Shi,et al.  Image Retargeting Using Mesh Parametrization , 2009, IEEE Transactions on Multimedia.

[31]  Aditi Majumder,et al.  Seam carving based aesthetics enhancement for photos , 2015, Signal Process. Image Commun..

[32]  Xuelong Li,et al.  Depth-Aware Image Seam Carving , 2013, IEEE Transactions on Cybernetics.

[33]  Sven J. Dickinson,et al.  2017 ICCV Challenge: Detecting Symmetry in the Wild , 2017, 2017 IEEE International Conference on Computer Vision Workshops (ICCVW).

[34]  Niloy J. Mitra,et al.  Symmetry in 3D Geometry: Extraction and Applications , 2013, Comput. Graph. Forum.

[35]  Xinfeng Zhang,et al.  Multiple-Level Feature-Based Measure for Retargeted Image Quality , 2018, IEEE Transactions on Image Processing.

[36]  Jeffrey Ho,et al.  CASAIR: Content and Shape-Aware Image Retargeting and Its Applications , 2016, IEEE Transactions on Image Processing.

[37]  Tong-Yee Lee,et al.  Summarization-Based Image Resizing by Intelligent Object Carving , 2014, IEEE Transactions on Visualization and Computer Graphics.

[38]  Ligang Liu,et al.  Content-aware image resizing by quadratic programming , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops.

[39]  S. Avidan,et al.  Multi-operator media retargeting , 2009, SIGGRAPH 2009.

[40]  Zihao Hu,et al.  Multiple instance subspace learning via partial random projection tree for local reflection symmetry in natural images , 2016, Pattern Recognit..

[41]  Chanho Jung,et al.  A structure-aware axis-aligned grid deformation approach for robust image retargeting , 2018, Multimedia Tools and Applications.

[42]  Yael Pritch,et al.  Shift-map image editing , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[43]  Haibin Ling,et al.  Scale and object aware image retargeting for thumbnail browsing , 2011, 2011 International Conference on Computer Vision.

[44]  Vladlen Koltun,et al.  Geodesic Object Proposals , 2014, ECCV.

[45]  Iasonas Kokkinos,et al.  Learning-Based Symmetry Detection in Natural Images , 2012, ECCV.

[46]  Craig Gotsman,et al.  Energy‐Based Image Deformation , 2009, Comput. Graph. Forum.

[47]  Seungkyu Lee,et al.  Reflection Symmetry Detection via Appearance of Structure Descriptor , 2016, ECCV.