RTS-ELM: an approach for saliency-directed image segmentation with ripplet transform

In spite of great advancements in the field of computer vision in recent times, efficient identification of salient regions in an image/scene and applying the results to image segmentation are a fertile area to be explored by researchers. This paper deals with a novel approach for image segmentation called RTS-ELM which uses cues from salient region identification. Initially, salient regions of an image are identified using ripplet transform. Based on the saliency map, a trimap is generated for an image which highlights the dominant regions of an image. Using histogram analysis, the dominant pixels of foreground and background are grouped together to produce the positive and negative groups of training data. The salient regions are then segmented using the trained ELM classifier. After a rigmarole process of comparing with eleven extant approaches using three benchmark datasets, RTS-ELM is found to be an efficient method for reifying effective segmentation in different types of images with only a few errors.

[1]  Q. M. Jonathan Wu,et al.  Human action recognition using extreme learning machine based on visual vocabularies , 2010, Neurocomputing.

[2]  Jin-Jang Leou,et al.  Saliency-directed color image segmentation using modified particle swarm optimization , 2012, Signal Process..

[3]  Srinivas S. Kruthiventi,et al.  Saliency Unified: A Deep Architecture for simultaneous Eye Fixation Prediction and Salient Object Segmentation , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  Brejesh Lall,et al.  Saliency and KAZE features assisted object segmentation , 2017, Image Vis. Comput..

[5]  Shih-Fu Chang,et al.  Segmentation using superpixels: A bipartite graph partitioning approach , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Esa Rahtu,et al.  Segmenting Salient Objects from Images and Videos , 2010, ECCV.

[7]  Ran Ju,et al.  Saliency cuts based on adaptive triple thresholding , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[8]  Kaiming He,et al.  Mask R-CNN , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[9]  Peter Auer,et al.  Object recognition using segmentation for feature detection , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[10]  Wenbing Tao,et al.  Interactively multiphase image segmentation based on variational formulation and graph cuts , 2010, Pattern Recognit..

[11]  Anil K. Jain,et al.  Data clustering: a review , 1999, CSUR.

[12]  Wenbing Tao,et al.  Image segmentation by iterative optimization of multiphase multiple piecewise constant model and Four-Color relabeling , 2011, Pattern Recognit..

[13]  Nicu Sebe,et al.  Image saliency by isocentric curvedness and color , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[14]  Zhen Yang,et al.  Saliency motivated improved simplified PCNN model for object segmentation , 2018, Neurocomputing.

[15]  Hong-Bin Shen,et al.  Saliency driven region-edge-based top down level set evolution reveals the asynchronous focus in image segmentation , 2018, Pattern Recognit..

[16]  Zhiwen Yu,et al.  A modified support vector machine and its application to image segmentation , 2011, Image Vis. Comput..

[17]  R. Thangarajan,et al.  An efficient visual saliency detection model based on Ripplet transform , 2017 .

[18]  Jinkai Cui,et al.  Retinal vessel segmentation in colour fundus images using Extreme Learning Machine , 2017, Comput. Medical Imaging Graph..

[19]  Shui Linlin APTIVE IMAGE SEGMENTATION BASED ON SALIENCY DETECTION , 2015 .

[20]  Wei Wang,et al.  Liver vessel segmentation based on extreme learning machine. , 2016, Physica medica : PM : an international journal devoted to the applications of physics to medicine and biology : official journal of the Italian Association of Biomedical Physics.

[21]  Zhi Liu,et al.  Segmentation Driven Low-rank Matrix Recovery for Saliency Detection , 2013, BMVC.

[22]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Chee Kheong Siew,et al.  Extreme learning machine: Theory and applications , 2006, Neurocomputing.

[24]  William A. Barrett,et al.  Object-based image editing , 2002, ACM Trans. Graph..

[25]  Jie Chen,et al.  Hierarchical Contour Closure-Based Holistic Salient Object Detection , 2017, IEEE Transactions on Image Processing.

[26]  Nanning Zheng,et al.  Learning to Detect a Salient Object , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  Ming-Huwi Horng,et al.  Multilevel thresholding selection based on the artificial bee colony algorithm for image segmentation , 2011, Expert Syst. Appl..

[28]  Qi Wang,et al.  Tag-Saliency: Combining bottom-up and top-down information for saliency detection , 2014, Comput. Vis. Image Underst..

[29]  Jitendra Malik,et al.  Normalized cuts and image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[30]  Martial Hebert,et al.  Toward Objective Evaluation of Image Segmentation Algorithms , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  Wenjian Wang,et al.  Saliency-SVM: An automatic approach for image segmentation , 2014, Neurocomputing.

[32]  Manuel Graña,et al.  Spatially regularized semisupervised Ensembles of Extreme Learning Machines for hyperspectral image segmentation , 2015, Neurocomputing.

[33]  Jeffrey Mark Siskind,et al.  Image Segmentation with Ratio Cut , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[34]  Jan-Mark Geusebroek,et al.  Salient object detection: From pixels to segments , 2013, Image Vis. Comput..

[35]  Hanqing Lu,et al.  Saliency Cuts: An automatic approach to object segmentation , 2008, 2008 19th International Conference on Pattern Recognition.

[36]  Wenbing Tao,et al.  Integration of the saliency-based seed extraction and random walks for image segmentation , 2014, Neurocomputing.

[37]  Jie Yang,et al.  Saliency based image segmentation , 2011, 2011 International Conference on Multimedia Technology.

[38]  Wenbing Tao,et al.  Automatic image segmentation using salient key point extraction and star shape prior , 2014, Signal Process..

[39]  James H. Elder,et al.  Design and perceptual validation of performance measures for salient object segmentation , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops.

[40]  Yan Song,et al.  Side scan sonar image segmentation and synthesis based on extreme learning machine , 2019, Applied Acoustics.

[41]  Oscar C. Au,et al.  An adaptive unsupervised approach toward pixel clustering and color image segmentation , 2010, Pattern Recognit..

[42]  Baojun Zhao,et al.  Compressed-Domain Ship Detection on Spaceborne Optical Image Using Deep Neural Network and Extreme Learning Machine , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[43]  Guoliang Xu,et al.  Geometric Flow Approach for Region-Based Image Segmentation , 2012, IEEE Transactions on Image Processing.

[44]  Gueesang Lee,et al.  Small Object Segmentation Based on Visual Saliency in Natural Images , 2013, J. Inf. Process. Syst..

[45]  Yoshinori Hara,et al.  On image segmentation for object-based image retrieval , 2002, Object recognition supported by user interaction for service robots.