Side scan sonar image segmentation and synthesis based on extreme learning machine

Abstract This paper presents side scan sonar (SSS) image segmentation and synthesis methods based on extreme learning machine (ELM). As an algorithm derived from single-hidden layer feedforward neural networks (SLFNs), ELM has superior performance and fast learning speed with randomly generated hidden layer parameters. The SSS image segmentation uses ELM as a classifier with features generated by convolutional neural network (CNN) of multiple pathways. The CNN of multiple pathways can learn local and global features from SSS images adaptively. Taking these features as input, ELM assigns the central pixel of each input image patch of CNN to one class. Moreover, the presented SSS image synthesis method utilizes ELM as a regression algorithm, in which the non-parametric sampling algorithm is used first to synthesize coarse SSS images according to segmentation maps and sample images for each class. Then ELM trained with the coarse synthesis images and their ground truth maps (the Gaussian-filtered SSS images) synthesizes fine SSS images. Furthermore, peak signal to noise ratio (PSNR) of the synthetic SSS images with the Gaussian-filtered SSS images as ref is used as one evaluation metric for segmentation performance. Experimental results demonstrate that the SSS image segmentation method combining convolutional features with ELM outperforms typical CNN and support vector machine (SVM), and the presented SSS image synthesis method and the evaluation metric are applicable.

[1]  S. Malarkkan,et al.  Study of Object Detection in Sonar Image using Image Segmentation and Edge Detection Methods , 2016 .

[2]  Chee Kheong Siew,et al.  Extreme learning machine: Theory and applications , 2006, Neurocomputing.

[3]  G.R. Elston,et al.  Pseudospectral time-domain modeling of non-Rayleigh reverberation: synthesis and statistical analysis of a sidescan sonar image of sand ripples , 2004, IEEE Journal of Oceanic Engineering.

[4]  Geoffrey E. Hinton,et al.  Rectified Linear Units Improve Restricted Boltzmann Machines , 2010, ICML.

[5]  Yong Peng,et al.  Discriminative extreme learning machine with supervised sparsity preserving for image classification , 2017, Neurocomputing.

[6]  Robert Hecht-Nielsen,et al.  Theory of the backpropagation neural network , 1989, International 1989 Joint Conference on Neural Networks.

[7]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[8]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[9]  Christopher Joseph Pal,et al.  Brain tumor segmentation with Deep Neural Networks , 2015, Medical Image Anal..

[10]  Fang Liu,et al.  SAR Image segmentation based on convolutional-wavelet neural network and markov random field , 2017, Pattern Recognit..

[11]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[12]  N. Pace,et al.  Swathe seabed classification , 1988 .

[13]  Hongming Zhou,et al.  Extreme Learning Machine for Regression and Multiclass Classification , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[14]  Yvan R. Petillot,et al.  The fusion of large scale classified side-scan sonar image mosaics , 2006, IEEE Transactions on Image Processing.

[15]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[17]  Fuchun Sun,et al.  Optimization-Based Extreme Learning Machine with Multi-kernel Learning Approach for Classification , 2014, 2014 22nd International Conference on Pattern Recognition.

[18]  Alexei A. Efros,et al.  Texture synthesis by non-parametric sampling , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[19]  Lawrence D. Jackel,et al.  Handwritten Digit Recognition with a Back-Propagation Network , 1989, NIPS.

[20]  Patrick Pérez,et al.  Three-Class Markovian Segmentation of High-Resolution Sonar Images , 1999, Comput. Vis. Image Underst..

[21]  Dayong Shen,et al.  Traffic Sign Recognition Using Kernel Extreme Learning Machines With Deep Perceptual Features , 2017, IEEE Transactions on Intelligent Transportation Systems.

[22]  Wei Shen,et al.  Multi-scale Convolutional Neural Networks for Lung Nodule Classification , 2015, IPMI.

[23]  Patrick Pérez,et al.  Sonar image segmentation using an unsupervised hierarchical MRF model , 2000, IEEE Trans. Image Process..

[24]  Guang-Bin Huang,et al.  Extreme Learning Machine for Multilayer Perceptron , 2016, IEEE Transactions on Neural Networks and Learning Systems.