An improved content aware image resizing algorithm based on a novel adaptive seam detection technique

An image can be considered to be a combination of both significant (foreground) objects and some less significant (background) objects. Content aware image resizing (CAIR) algorithm uses the different edge detection methods to segregate the useful objects from the background. When applied to an image, CAIR can resize the image to a very different aspect ratio without destroying the aspect ratio of the useful objects in the image. However, this method fails when the useful objects in the image are very closely situated. To take care of this, this paper proposes and develops a modified version of the algorithm. Instead of merely finding the edges, the important objects are detected by drawing contours around them with the help of level set based Chan Vese Image Segmentation algorithm and constant convergence rate Modified Delta Bar Delta learning algorithm. Then Seam Carving algorithm is applied which uses Dynamic Programming. A seam which is a 8 connected curved path from top to bottom (vertical seam) or left to right (horizontal seam) is drawn on the unnoticeable pixels of the lesser significant portions by the process of seam carving which helps to resize the image to a new size. The optimum path of the seam is defined by an image energy function which protects the content of the image. If the seams are continuously removed and inserted then the size of an image can be expanded and contracted respectively in both directions.

[1]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[2]  QU Jian-jian,et al.  Conjugate gradient algorithm for Chan-Vese model , 2013 .

[3]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[4]  Tony F. Chan,et al.  Active contours without edges , 2001, IEEE Trans. Image Process..

[5]  Junaed Sattar Snakes , Shapes and Gradient Vector Flow , 2022 .

[6]  Amitava Chatterjee,et al.  Improved Chan-Vese Image Segmentation Model Using Delta-Bar-Delta Algorithm , 2014 .

[7]  Tai Sing Lee,et al.  Region competition: unifying snakes, region growing, energy/Bayes/MDL for multi-band image segmentation , 1995, Proceedings of IEEE International Conference on Computer Vision.

[8]  J. Sethian,et al.  Fronts propagating with curvature-dependent speed: algorithms based on Hamilton-Jacobi formulations , 1988 .

[9]  Ariel Shamir,et al.  Seam Carving for Content-Aware Image Resizing , 2007, ACM Trans. Graph..

[10]  Anthony J. Yezzi,et al.  Gradient flows and geometric active contour models , 1995, Proceedings of IEEE International Conference on Computer Vision.

[11]  O. P. Verma,et al.  Newtonian Gravitational Edge Detection Using Gravitational Search Algorithm , 2012, 2012 International Conference on Communication Systems and Network Technologies.

[12]  Xing Xie,et al.  A visual attention model for adapting images on small displays , 2003, Multimedia Systems.

[13]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[14]  Daniel Cohen-Or,et al.  Feature-aware texturing , 2006, EGSR '06.

[15]  Christian Callegari,et al.  Advances in Computing, Communications and Informatics (ICACCI) , 2015 .

[16]  Kaleem Siddiqi,et al.  Area and length minimizing flows for shape segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[17]  Vitoantonio Bevilacqua,et al.  Improving a genetic algorithm segmentation by means of a fast edge detection technique , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[18]  Harry Shum,et al.  To appear in the ACM SIGGRAPH conference proceedings Drag-and-Drop Pasting , 2022 .

[19]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[20]  David Salesin,et al.  Gaze-based interaction for semi-automatic photo cropping , 2006, CHI.

[21]  Marie-Pierre Jolly,et al.  Interactive graph cuts for optimal boundary & region segmentation of objects in N-D images , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[22]  Reiner Lenz,et al.  Modified Gradient Search for Level Set Based Image Segmentation , 2013, IEEE Transactions on Image Processing.

[23]  Michael Gleicher,et al.  Automatic image retargeting with fisheye-view warping , 2005, UIST.