Direction Selective Contour Detection for Salient Objects

The active contour model is a widely used technique for automatic object contour extraction. Existing methods based on this model can perform with high accuracy, even in the case of complex contours, but challenging issues remain, like the need for precise contour initialization for high curvature boundary segments or the handling of cluttered backgrounds. To deal with such issues, this paper presents a salient object extraction method, the first step of which is the introduction of an improved edge map that incorporates edge direction as a feature. The direction information in the small neighborhoods of image feature points is extracted, and the images’ prominent orientations are defined for direction-selective edge extraction. Using such improved edge information, we provide a highly accurate shape contour representation, which we also combine with texture features. The principle of the paper is to interpret an object as the fusion of its components: its extracted contour and its inner texture. Our goal in fusing textural and structural information is twofold: it is applied for automatic contour initialization, and it is also used to establish an improved external force field. This fusion then produces highly accurate salient object extractions. We performed extensive evaluations, which confirm that the presented object extraction method outperforms parametric active contour models and achieves higher efficiency than the majority of the evaluated automatic saliency methods.

[1]  Ali Borji,et al.  Salient Object Detection: A Benchmark , 2015, IEEE Transactions on Image Processing.

[2]  Tony F. Chan,et al.  Active contours without edges , 2001, IEEE Trans. Image Process..

[3]  Guopu Zhu,et al.  Gradient vector flow active contours with prior directional information , 2010, Pattern Recognit. Lett..

[4]  Xuelong Li,et al.  Two-Stage Learning to Predict Human Eye Fixations via SDAEs , 2016, IEEE Transactions on Cybernetics.

[5]  Tamás Szirányi,et al.  Improved Harris Feature Point Set for Orientation-Sensitive Urban-Area Detection in Aerial Images , 2013, IEEE Geoscience and Remote Sensing Letters.

[6]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[7]  Huchuan Lu,et al.  Graph-Regularized Saliency Detection With Convex-Hull-Based Center Prior , 2013, IEEE Signal Processing Letters.

[8]  Nanning Zheng,et al.  Learning to Detect a Salient Object , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Lei Guo,et al.  An Object-Oriented Visual Saliency Detection Framework Based on Sparse Coding Representations , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[10]  Junsong Yuan,et al.  Discovering Primary Objects in Videos by Saliency Fusion and Iterative Appearance Estimation , 2016, IEEE Transactions on Circuits and Systems for Video Technology.

[11]  Nanning Zheng,et al.  Automatic salient object segmentation based on context and shape prior , 2011, BMVC.

[12]  Huchuan Lu,et al.  Saliency Detection via Dense and Sparse Reconstruction , 2013, 2013 IEEE International Conference on Computer Vision.

[13]  Anthony J. Yezzi,et al.  Global Regularizing Flows With Topology Preservation for Active Contours and Polygons , 2007, IEEE Transactions on Image Processing.

[14]  Huchuan Lu,et al.  Bayesian Saliency via Low and mid Level Cues , 2022 .

[15]  Ronen Basri,et al.  Image Segmentation by Probabilistic Bottom-Up Aggregation and Cue Integration , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[16]  Esa Rahtu,et al.  Segmenting Salient Objects from Images and Videos , 2010, ECCV.

[17]  Hamid Krim,et al.  A Shearlet Approach to Edge Analysis and Detection , 2009, IEEE Transactions on Image Processing.

[18]  Ali Borji,et al.  What is a Salient Object? A Dataset and a Baseline Model for Salient Object Detection , 2014, IEEE Transactions on Image Processing.

[19]  David A. Clausi,et al.  Hybrid structural and texture distinctiveness vector field convolution for region segmentation , 2014, Comput. Vis. Image Underst..

[20]  David A. Clausi,et al.  Decoupled Active Contour (DAC) for Boundary Detection , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  David A. Clausi,et al.  Statistical Textural Distinctiveness for Salient Region Detection in Natural Images , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[22]  David P. Dobkin,et al.  The quickhull algorithm for convex hulls , 1996, TOMS.

[23]  Bing Li,et al.  Active Contour External Force Using Vector Field Convolution for Image Segmentation , 2007, IEEE Transactions on Image Processing.

[24]  Yizhou Yu,et al.  Visual saliency based on multiscale deep features , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[25]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[26]  Martial Hebert,et al.  Man-made structure detection in natural images using a causal multiscale random field , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[27]  D. Mumford,et al.  Optimal approximations by piecewise smooth functions and associated variational problems , 1989 .

[28]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  Dietmar Saupe,et al.  A morphological approach for distinguishing texture and individual features in images , 2014, Pattern Recognit. Lett..

[30]  Say Wei Foo,et al.  Dynamic directional gradient vector flow for snakes , 2006, IEEE Transactions on Image Processing.

[31]  Christof Koch,et al.  Image Signature: Highlighting Sparse Salient Regions , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[32]  Hui Li,et al.  A Unified Framework for Salient Structure Detection by Contour-Guided Visual Search , 2015, IEEE Transactions on Image Processing.

[33]  Chengke Wu,et al.  NGVF: An improved external force field for active contour model , 2007, Pattern Recognit. Lett..

[34]  Ling Shao,et al.  Consistent Video Saliency Using Local Gradient Flow Optimization and Global Refinement , 2015, IEEE Transactions on Image Processing.

[35]  S. Osher,et al.  Algorithms Based on Hamilton-Jacobi Formulations , 1988 .

[36]  David A. Clausi,et al.  Enhanced Decoupled Active Contour Using Structural and Textural Variation Energy Functionals , 2014, IEEE Transactions on Image Processing.

[37]  Bo Du,et al.  Saliency-Guided Unsupervised Feature Learning for Scene Classification , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[38]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[39]  Yizhou Yu,et al.  Deep Contrast Learning for Salient Object Detection , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[40]  Tamás Szirányi,et al.  Harris function based active contour external force for image segmentation , 2012, Pattern Recognit. Lett..

[41]  Honglak Lee,et al.  Object Contour Detection with a Fully Convolutional Encoder-Decoder Network , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[42]  Tamás Szirányi,et al.  Orientation-selective building detection in aerial images , 2015 .

[43]  Josiane Zerubia,et al.  Building Development Monitoring in Multitemporal Remotely Sensed Image Pairs with Stochastic Birth-Death Dynamics , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[44]  Sigurd B. Angenent,et al.  Finsler Active Contours , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[45]  Yu-Wing Tai,et al.  Salient Region Detection via High-Dimensional Color Transform and Local Spatial Support , 2014, IEEE Transactions on Image Processing.

[46]  James M. Rehg,et al.  The Secrets of Salient Object Segmentation , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[47]  Yao Lu,et al.  Salient Object Detection using concavity context , 2011, 2011 International Conference on Computer Vision.

[48]  Andrea Manno-Kovacs,et al.  Direction selective vector field convolution for contour detection , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[49]  Yan Wang,et al.  DeepContour: A deep convolutional feature learned by positive-sharing loss for contour detection , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[50]  Shi-Min Hu,et al.  Global contrast based salient region detection , 2011, CVPR 2011.

[51]  Hadj Batatia,et al.  Quasi-automatic initialization for parametric active contours , 2010, Pattern Recognit. Lett..

[52]  Tamás Szirányi,et al.  Improved force field for vector field convolution method , 2011, 2011 18th IEEE International Conference on Image Processing.

[53]  Tadashi Shibata,et al.  Unsupervised Object Extraction by Contour Delineation and Texture Discrimination Based on Oriented Edge Features , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[54]  Yuting Zhang,et al.  Sketch-Based Image Retrieval by Salient Contour Reinforcement , 2016, IEEE Transactions on Multimedia.

[55]  Feng Wu,et al.  Background Prior-Based Salient Object Detection via Deep Reconstruction Residual , 2015, IEEE Transactions on Circuits and Systems for Video Technology.

[56]  Rudolf Mester,et al.  Orientation estimation: Conventional techniques and a new non-differential approach , 2000, 2000 10th European Signal Processing Conference.

[57]  Vibhav Vineet,et al.  Efficient Salient Region Detection with Soft Image Abstraction , 2013, 2013 IEEE International Conference on Computer Vision.

[58]  Levente Kovács,et al.  Focus Area Extraction by Blind Deconvolution for Defining Regions of Interest , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[59]  Sabine Süsstrunk,et al.  Frequency-tuned salient region detection , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[60]  Guillermo Sapiro,et al.  Geodesic Active Contours , 1995, International Journal of Computer Vision.

[61]  J. Sethian,et al.  Fronts propagating with curvature-dependent speed: algorithms based on Hamilton-Jacobi formulations , 1988 .

[62]  Jingdong Wang,et al.  Salient Object Detection: A Discriminative Regional Feature Integration Approach , 2013, International Journal of Computer Vision.

[63]  Ling Shao,et al.  Cosaliency Detection Based on Intrasaliency Prior Transfer and Deep Intersaliency Mining , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[64]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[65]  Li Xu,et al.  Hierarchical Saliency Detection , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[66]  Jerry L. Prince,et al.  Gradient vector flow: a new external force for snakes , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.