An Improved Deep Clustering Model for Underwater Acoustical Targets

Hand-craft features and clustering algorithms constitute the main parts of the unsupervised clustering system. Performance of the clustering deteriorates when the assumed probabilistic distribution of the data differs from the true one. This paper introduces a novel method that combines systematically the deep Boltzmann machine (DBM) with the Dirichlet process based Gaussian mixture model (DP-GMM) to bypass the problem of distribution mismatch. DBM is firstly used to extract the deep complex data features. By tactfully designing the distributions of different layers in DBM to make them compatible to that of the DP-GMM, we build a distribution consistent clustering system. The system is then jointly optimized by Markov chain Monte Carlo method with succinct updating formulations. The experimental results on two real databases of underwater acoustical target show the effectiveness and the robustness of the proposed clustering method.

[1]  Patricio A. Vela,et al.  A Comparative Study of Efficient Initialization Methods for the K-Means Clustering Algorithm , 2012, Expert Syst. Appl..

[2]  Geoffrey E. Hinton.  A Practical Guide to Training Restricted Boltzmann Machines , 2012, Neural Networks: Tricks of the Trade.

[3]  Fei Gao,et al.  Deep Multimodal Distance Metric Learning Using Click Constraints for Image Ranking , 2017, IEEE Transactions on Cybernetics.

[4]  Sergei Vassilvitskii,et al.  k-means++: the advantages of careful seeding , 2007, SODA '07.

[5]  M. Escobar,et al.  Markov Chain Sampling Methods for Dirichlet Process Mixture Models , 2000 .

[6]  Geoffrey E. Hinton,et al.  Deep Boltzmann Machines , 2009, AISTATS.

[7]  Ya Su,et al.  Robust Video Face Recognition Under Pose Variation , 2018, Neural Processing Letters.

[8]  Xuelong Li,et al.  Detection of Co-salient Objects by Looking Deep and Wide , 2016, International Journal of Computer Vision.

[9]  Jian Liu,et al.  Underwater Target Recognition Based on Line Spectrum and Support Vector Machine , 2014 .

[10]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[11]  Geoffrey E. Hinton,et al.  An Efficient Learning Procedure for Deep Boltzmann Machines , 2012, Neural Computation.

[12]  Lu Wang,et al.  Novel Wideband DOA Estimation Based on Sparse Bayesian Learning With Dirichlet Process Priors , 2016, IEEE Transactions on Signal Processing.

[13]  Peter F. Driessen,et al.  Multi-class acoustic event classification of hydrophone data , 2015, 2015 IEEE Pacific Rim Conference on Communications, Computers and Signal Processing (PACRIM).

[14]  Xueming Qian,et al.  Semantic Annotation of High-Resolution Satellite Images via Weakly Supervised Learning , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[15]  Meng Wang,et al.  Image-Based Three-Dimensional Human Pose Recovery by Multiview Locality-Sensitive Sparse Retrieval , 2015, IEEE Transactions on Industrial Electronics.

[16]  Radford M. Neal.  Pattern Recognition and Machine Learning , 2007, Technometrics.

[17]  Carl E. Rasmussen,et al.  The Infinite Gaussian Mixture Model , 1999, NIPS.

[18]  M. H. Supriya,et al.  Novel class detection of underwater targets using Self-Organizing neural networks , 2015, 2015 IEEE Underwater Technology (UT).

[19]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[20]  Xiaojun Chang,et al.  Revealing Event Saliency in Unconstrained Video Collection , 2017, IEEE Transactions on Image Processing.

[21]  Ling Shao,et al.  Cosaliency Detection Based on Intrasaliency Prior Transfer and Deep Intersaliency Mining , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[22]  Peter Glöckner,et al.  Why Does Unsupervised Pre-training Help Deep Learning? , 2013 .

[23]  Jianping Fan,et al.  iPrivacy: Image Privacy Protection by Identifying Sensitive Objects via Deep Multi-Task Learning , 2017, IEEE Transactions on Information Forensics and Security.

[24]  Andreas Krause,et al.  Approximate K-Means++ in Sublinear Time , 2016, AAAI.

[25]  Camille Roth,et al.  Natural Scales in Geographical Patterns , 2017, Scientific Reports.

[26]  Meng Wang,et al.  Multimodal Deep Autoencoder for Human Pose Recovery , 2015, IEEE Transactions on Image Processing.

[27]  Gérard Govaert,et al.  Assessing a Mixture Model for Clustering with the Integrated Completed Likelihood , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[28]  Joshua B. Tenenbaum,et al.  Learning with Hierarchical-Deep Models , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  William M. Rand,et al.  Objective Criteria for the Evaluation of Clustering Methods , 1971 .