Structure preservation of image using an efficient content-aware image retargeting technique

The presence of a wide range of high- and low-resolution devices renders the images to experience changes in respect to aspect ratio and size for better adaptability. This paper proposes a novel and effective technique that vanquishes the problems encountered in the conventional seam carving method. To achieve minimum distortion in salient objects of the image, the proposed technique restricts intersection or overlapping of multiple seams in the horizontal and vertical direction and bypasses them to the neighboring low energy pixel. The proposed technique hinders the pixel selection from a single row or column beyond the defined threshold so as to save the image information and reduce distortion at a single location. To justify the effectiveness of the proposed technique, results have been presented in comparison with the five state-of-the-art image retargeting techniques. Compared with the conventional techniques, this technique shows remarkable results in terms of low distortion percentage. The proposed technique also produces excellent results for shrinkage and enlargement of a single image multiple times.

[1]  Kun Liu,et al.  Online recognition of people recurrences with bag-of-features representation and automatic new-class labeling , 2010 .

[2]  Xiao Liu,et al.  Probabilistic Graphlet Transfer for Photo Cropping , 2013, IEEE Transactions on Image Processing.

[3]  Yabin Zhang,et al.  Multiple-Level Feature-Based Measure for Retargeted Image Quality. , 2018, IEEE transactions on image processing : a publication of the IEEE Signal Processing Society.

[4]  Raimondo Schettini,et al.  Self-Adaptive Image Cropping for Small Displays , 2007, IEEE Transactions on Consumer Electronics.

[5]  Jun Li,et al.  Learning quality assessment of retargeted images , 2017, Signal Process. Image Commun..

[6]  David Salesin,et al.  Gaze-based interaction for semi-automatic photo cropping , 2006, CHI.

[7]  King Ngi Ngan,et al.  Adaptive image retargeting using saliency-based continuous seam carving , 2010 .

[8]  Denis Simakov,et al.  Summarizing visual data using bidirectional similarity , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  Aditi Majumder,et al.  Seam carving based aesthetics enhancement for photos , 2015, Signal Process. Image Commun..

[10]  Daniel Cohen-Or,et al.  Non-homogeneous Content-driven Video-retargeting , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[11]  Xuelong Li,et al.  Depth-Aware Image Seam Carving , 2013, IEEE Transactions on Cybernetics.

[12]  S. Avidan,et al.  Multi-operator media retargeting , 2009, SIGGRAPH 2009.

[13]  William T. Freeman,et al.  The patch transform and its applications to image editing , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[14]  Chia-Hung Yeh,et al.  Content-aware Image Retargeting for Image Display on Foldable Mobile Devices , 2015, FNC/MobiSPC.

[15]  Diego Gutierrez,et al.  Objective Quality Prediction of Image Retargeting Algorithms , 2017, IEEE Transactions on Visualization and Computer Graphics.

[16]  Yonghuai Liu,et al.  Human consistency evaluation of static video summaries , 2018, Multimedia Tools and Applications.

[17]  Xinfeng Zhang,et al.  Multiple-Level Feature-Based Measure for Retargeted Image Quality , 2018, IEEE Transactions on Image Processing.

[18]  Jeffrey Ho,et al.  CASAIR: Content and Shape-Aware Image Retargeting and Its Applications , 2016, IEEE Transactions on Image Processing.

[19]  Gangyi Jiang,et al.  Transformation-Aware Similarity Measurement for Image Retargeting Quality Assessment via Bidirectional Rewarping , 2019 .

[20]  Daniel Cohen-Or,et al.  Image resizing by reconstruction from deep features , 2019, Computational Visual Media.

[21]  Tae-Hyun Oh,et al.  Weakly- and Self-Supervised Learning for Content-Aware Deep Image Retargeting , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[22]  Wallapak Tavanapong,et al.  CMAIR: content and mask-aware image retargeting , 2019, Multimedia Tools and Applications.

[23]  Weiming Dong,et al.  Optimized image resizing using seam carving and scaling , 2009, SIGGRAPH 2009.

[24]  O. Sorkine,et al.  Optimized scale-and-stretch for image resizing , 2008, SIGGRAPH 2008.

[25]  Leif Kobbelt,et al.  Two‐Colored Pixels , 2010, Comput. Graph. Forum.

[26]  Ariel Shamir,et al.  A comparative study of image retargeting , 2010, SIGGRAPH 2010.

[27]  Benjamin B. Bederson,et al.  Automatic thumbnail cropping and its effectiveness , 2003, UIST '03.

[28]  Lihi Zelnik-Manor,et al.  Context-Aware Saliency Detection , 2012, IEEE Trans. Pattern Anal. Mach. Intell..

[29]  Xuelong Li,et al.  Perceptually Aware Image Retargeting for Mobile Devices , 2018, IEEE Transactions on Image Processing.

[30]  Yael Pritch,et al.  Shift-map image editing , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[31]  Adam Finkelstein,et al.  PatchMatch: a randomized correspondence algorithm for structural image editing , 2009, SIGGRAPH 2009.

[32]  Shanmuganathan Raman,et al.  Accelerated seam carving for image retargeting , 2019, IET Image Process..

[33]  Michael Gleicher,et al.  Automatic image retargeting with fisheye-view warping , 2005, UIST.

[34]  Zhou Yiran,et al.  ネットワーク適応イントラリフレッシュおよび参照選択リフレッシュに基づくH.264/VACの誤り耐性ビデオ符号化 , 2010 .

[35]  S. Avidan,et al.  Seam carving for content-aware image resizing , 2007, SIGGRAPH 2007.

[36]  Ralph R. Martin,et al.  Shrinkability Maps for Content‐Aware Video Resizing , 2008, Comput. Graph. Forum.