A Review on Deep Learning-Based Approaches for Automatic Sonar Target Recognition

Underwater acoustics has been implemented mostly in the field of sound navigation and ranging (SONAR) procedures for submarine communication, the examination of maritime assets and environment surveying, target and object recognition, and measurement and study of acoustic sources in the underwater atmosphere. With the rapid development in science and technology, the advancement in sonar systems has increased, resulting in a decrement in underwater casualties. The sonar signal processing and automatic target recognition using sonar signals or imagery is itself a challenging process. Meanwhile, highly advanced data-driven machine-learning and deep learning-based methods are being implemented for acquiring several types of information from underwater sound data. This paper reviews the recent sonar automatic target recognition, tracking, or detection works using deep learning algorithms. A thorough study of the available works is done, and the operating procedure, results, and other necessary details regarding the data acquisition process, the dataset used, and the information regarding hyper-parameters is presented in this article. This paper will be of great assistance for upcoming scholars to start their work on sonar automatic target recognition.

[1]  B Eswara Reddy,et al.  Semi-supervised learning: a brief review , 2018 .

[2]  Son-Cheol Yu,et al.  Imaging sonar based real-time underwater object detection utilizing AdaBoost method , 2017, 2017 IEEE Underwater Technology (UT).

[3]  B. B. Bauer,et al.  Fundamentals of acoustics , 1963 .

[4]  B. Miller.  Real-time tracking of blue whales using DIFAR sonobuoys , 2012 .

[5]  Yan Pailhas,et al.  High-Resolution Sonars: What Resolution Do We Need for Target Recognition? , 2010, EURASIP J. Adv. Signal Process..

[6]  Manhar Dhanak,et al.  A Deep Learning Approach to Target Recognition in Side-Scan Sonar Imagery , 2018, OCEANS 2018 MTS/IEEE Charleston.

[7]  Pawel Forczmanski,et al.  Sonar Image Simulation by Means of Ray Tracing and Image Processing , 2005, Enhanced Methods in Computer Security, Biometric and Artificial Intelligence Systems.

[8]  Laurie M. Linnett,et al.  Fourier extension and hough transform for multiple component FM signal analysis , 2015, Digit. Signal Process..

[9]  Matias Valdenegro-Toro,et al.  End-to-end object detection and recognition in forward-looking sonar images with convolutional neural networks , 2016, 2016 IEEE/OES Autonomous Underwater Vehicles (AUV).

[10]  Qin Yu,et al.  Underwater target feature extraction using Hilbert-Huang transform , 2009 .

[11]  Gavriel Salomon,et al.  T RANSFER OF LEARNING , 1992 .

[12]  Steven Euijong Whang,et al.  A Survey on Data Collection for Machine Learning: A Big Data - AI Integration Perspective , 2018, IEEE Transactions on Knowledge and Data Engineering.

[13]  Onur Avci,et al.  1D Convolutional Neural Networks and Applications: A Survey , 2019, Mechanical Systems and Signal Processing.

[14]  Kookhyun Kim,et al.  Underwater Acoustic Research Trends with Machine Learning: General Background , 2020, Journal of Ocean Engineering and Technology.

[15]  Shin Sugiyama,et al.  Underwater Ice Terrace Observed at the Front of Glaciar Grey, a Freshwater Calving Glacier in Patagonia , 2019, Geophysical Research Letters.

[16]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.

[17]  Robert D. Christ,et al.  Chapter 15 – Sonar , 2014 .

[18]  Hua Zhao,et al.  Deep Belief Networks and deep learning , 2015, Proceedings of 2015 International Conference on Intelligent Computing and Internet of Things.

[19]  José Manoel de Seixas,et al.  Principal component analysis for classifying passive sonar signals , 2001, ISCAS 2001. The 2001 IEEE International Symposium on Circuits and Systems (Cat. No.01CH37196).

[20]  Zhe Chen,et al.  Feature Extraction of Ship-Radiated Noise Based on Intrinsic Time-Scale Decomposition and a Statistical Complexity Measure , 2019, Entropy.

[21]  Koji Tsuda,et al.  Integration of sonar and optical camera images using deep neural network for fish monitoring , 2019, Aquacultural Engineering.

[22]  Ying Cheng,et al.  Automatic Detection Technology of Sonar Image Target Based on the Three-Dimensional Imaging , 2017, J. Sensors.

[23]  Shahzad A. Malik,et al.  Comparative Analysis of Primary Transmitter Detection Based Spectrum Sensing Techniques in Cognitive Radio Systems , 2010 .

[24]  Mohd Salman Leong,et al.  Challenges and Opportunities of Deep Learning Models for Machinery Fault Detection and Diagnosis: A Review , 2019, IEEE Access.

[25]  Natanael Nunes de Moura,et al.  Novelty detection in passive SONAR systems using support vector machines , 2015 .

[26]  R. Sathya,et al.  Comparison of Supervised and Unsupervised Learning Algorithms for Pattern Classification , 2013 .

[27]  Hongping Cai,et al.  Detecting People in Artwork with CNNs , 2016, ECCV Workshops.

[28]  Hassan Farsi,et al.  Passive Sonar Target Detection Using Statistical Classifier and Adaptive Threshold , 2018 .

[30]  Liling Li,et al.  An underwater observation dataset for fish classification and fishery assessment , 2018, Scientific data.

[31]  Jongwon Seok,et al.  Bearing Fault Detection and Diagnosis Using Case Western Reserve University Dataset With Deep Learning Approaches: A Review , 2020, IEEE Access.

[32]  Laurence T. Yang,et al.  A survey on deep learning for big data , 2018, Inf. Fusion.

[33]  Reshma Rajan,et al.  Cyclostationarity Based Sonar Signal Processing , 2016 .

[34]  Sung-Joon Park,et al.  SONAR Systems and Underwater Signal Processing: Classic and Modern Approaches , 2011 .

[35]  Sejin Lee,et al.  Deep Learning from Shallow Dives: Sonar Image Generation and Training for Underwater Object Detection , 2018, ArXiv.

[36]  José Manoel de Seixas,et al.  Novelty Detection in Passive Sonar Systems using Stacked AutoEncoders , 2018, 2018 International Joint Conference on Neural Networks (IJCNN).

[37]  S LewMichael,et al.  Deep learning for visual understanding , 2016 .

[38]  Song Aigu.  Nonlinear feature analysis and, extraction of ship noise signal based on limit cycle , 1999 .

[39]  David Berthelot,et al.  BEGAN: Boundary Equilibrium Generative Adversarial Networks , 2017, ArXiv.

[40]  Fei Yuan,et al.  Underwater Acoustic Target Recognition Based on Supervised Feature-Separation Algorithm , 2018, Sensors.

[41]  Qi Wang,et al.  ECNet: Efficient Convolutional Networks for Side Scan Sonar Image Segmentation , 2019, Sensors.

[42]  R. Garello,et al.  Sonar Data Simulation based on Tube Tracing , 2007, OCEANS 2007 - Europe.

[43]  Joydeep Ghosh,et al.  A neural network based hybrid system for detection, characterization, and classification of short-duration oceanic signals , 1992 .

[44]  Mei Wang,et al.  Deep Visual Domain Adaptation: A Survey , 2018, Neurocomputing.

[45]  Xiaoliang Zhang,et al.  Ship Radiated Noise Recognition Using Resonance-Based Sparse Signal Decomposition , 2017 .

[46]  Chiya Saeidi,et al.  New tube-based shooting and bouncing ray tracing method , 2009, 2009 International Conference on Advanced Technologies for Communications.

[47]  Marija Jegorova,et al.  Full-Scale Continuous Synthetic Sonar Data Generation with Markov Conditional Generative Adversarial Networks* , 2020, 2020 IEEE International Conference on Robotics and Automation (ICRA).

[48]  Terrence J. Sejnowski,et al.  Analysis of hidden units in a layered network trained to classify sonar targets , 1988, Neural Networks.

[49]  Alexander Sutin,et al.  DEMON Acoustic Ship Signature Measurements in an Urban Harbor , 2011 .

[50]  Eon-Ho Lee,et al.  Study on the Classification Performance of Underwater Sonar Image Classification Based on Convolutional Neural Networks for Detecting a Submerged Human Body † , 2019, Sensors.

[51]  Michael Zuba,et al.  Challenges and Opportunities of Underwater Cognitive Acoustic Networks , 2014, IEEE Transactions on Emerging Topics in Computing.

[52]  Divas Karimanzira,et al.  Object Detection in Sonar Images , 2020 .

[53]  James P. Coughlin,et al.  A neural network for target classification using passive sonar , 1991, ANNA '91.

[54]  Léon Bottou,et al.  Wasserstein Generative Adversarial Networks , 2017, ICML.

[55]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[56]  Li Yujian,et al.  A comparative study of fine-tuning deep learning models for plant disease identification , 2019, Comput. Electron. Agric..

[57]  Ashley David Waite,et al.  Sonar for Practising Engineers , 1996 .

[58]  Mérouane Debbah,et al.  Wireless Networks Design in the Era of Deep Learning: Model-Based, AI-Based, or Both? , 2019, IEEE Transactions on Communications.

[59]  Moncef Gabbouj,et al.  Convolutional Neural Networks for patient-specific ECG classification , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[60]  Luciano Oliveira,et al.  A novel GPU-based sonar simulator for real-time applications , 2017, Comput. Graph..

[61]  Matias Valdenegro-Toro,et al.  Object recognition in forward-looking sonar images with Convolutional Neural Networks , 2016, OCEANS 2016 MTS/IEEE Monterey.

[62]  Roee Diamant,et al.  Combining Denoising Autoencoders and Dynamic Programming for Acoustic Detection and Tracking of Underwater Moving Targets , 2020, Sensors.

[63]  Son-Cheol Yu,et al.  Denoising auto-encoder based image enhancement for high resolution sonar image , 2017, 2017 IEEE Underwater Technology (UT).

[64]  Zhang Xiaoming.  Researches on Chaotic Phenomena of Noises Radiated from Ships , 1998 .

[65]  J. Seok,et al.  Deep Learning-Based Bearing Fault Detection Using 2-D Illustration of Time Sequence , 2020, 2020 International Conference on Information and Communication Technology Convergence (ICTC).

[66]  G.R. Elston,et al.  Pseudospectral time-domain modeling of non-Rayleigh reverberation: synthesis and statistical analysis of a sidescan sonar image of sand ripples , 2004, IEEE Journal of Oceanic Engineering.

[67]  Quoc V. Le,et al.  Learning Data Augmentation Strategies for Object Detection , 2019, ECCV.

[68]  Jihun Park,et al.  Identifying Tonal Frequencies in a Lofargram with Convolutional Neural Networks , 2019, 2019 19th International Conference on Control, Automation and Systems (ICCAS).

[69]  Kookhyun Kim,et al.  Underwater Acoustic Research Trends with Machine Learning: Passive SONAR Applications , 2020 .

[70]  Esther Dura.  Image Processing Techniques For the Detection and Classification of Man Made Objects in Side-Scan Sonar Images , 2011 .

[71]  Nanfeng Xiao,et al.  Improved Boundary Equilibrium Generative Adversarial Networks , 2018, IEEE Access.

[72]  Gang Hu,et al.  Deep Learning Methods for Underwater Target Feature Extraction and Recognition , 2018, Comput. Intell. Neurosci..

[73]  Ayon Dey,et al.  Machine Learning Algorithms: A Review , 2022, International Journal of Science and Research (IJSR).

[74]  Christophe Sintes,et al.  Sonar Data Simulation , 2011 .

[75]  Nitesh V. Chawla,et al.  SMOTE: Synthetic Minority Over-sampling Technique , 2002, J. Artif. Intell. Res..

[76]  Jian Li,et al.  Applications of Array Signal Processing , 2014 .

[77]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[78]  Christer Larsson,et al.  Deep learning based technique for enhanced sonar imaging , 2019 .

[79]  Håkon Gimse,et al.  Classification of Marine Vessels using Sonar Data and a Neural Network , 2017 .

[80]  Chao Yang,et al.  A Survey on Deep Transfer Learning , 2018, ICANN.

[81]  Sheida Anya Danesh.  Real time active sonar simulation in a deep ocean environment , 2013 .

[82]  Huu Thu Nguyen,et al.  Multiple Object Detection Based on Clustering and Deep Learning Methods , 2020, Sensors.

[83]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[84]  Toshiaki Kikuchi,et al.  Finite Difference Time Domain Analysis for a Sound Field Including a Plate in Water , 2004 .

[85]  J. M. de Seixas,et al.  Passive Sonar Signal Detection and Classification Based on Independent Component Analysis , 2011 .

[86]  Michael S. Lew,et al.  Deep learning for visual understanding: A review , 2016, Neurocomputing.

[87]  Nikolaos Doulamis,et al.  Deep Learning for Computer Vision: A Brief Review , 2018, Comput. Intell. Neurosci..

[88]  M. Stevenson,et al.  Sonar signal detection and classification using artificial neural networks , 2000, 2000 Canadian Conference on Electrical and Computer Engineering. Conference Proceedings. Navigating to a New Era (Cat. No.00TH8492).

[89]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[90]  R. P. Goddard,et al.  The Sonar Simulation Toolset , 1989, Proceedings OCEANS.

[91]  Chen Wang,et al.  Competitive Deep-Belief Networks for Underwater Acoustic Target Recognition , 2018, Sensors.

[92]  J. Seok.  Active Sonar Target Classification Using Multi-aspect Sensing and Deep Belief Networks , 2018 .

[93]  S.W. Perry,et al.  A recurrent neural network for detecting objects in sequences of sector-scan sonar images , 2004, IEEE Journal of Oceanic Engineering.

[94]  Son-Cheol Yu,et al.  Realistic Sonar Image Simulation Using Generative Adversarial Network , 2019, IFAC-PapersOnLine.

[95]  Salvatore Tabbone,et al.  Detection of Lofar Lines , 1995, ICIAP.

[96]  M. Walsh.  SONAR , 2020, Clinical Journal of the American Society of Nephrology.

[97]  Antti Ilari Karjalainen,et al.  Training and Validation of Automatic Target Recognition Systems using Generative Adversarial Networks , 2019, 2019 Sensor Signal Processing for Defence Conference (SSPD).

[98]  James M. Keller,et al.  Deep convolutional neural network target classification for underwater synthetic aperture sonar imagery , 2019, Defense + Commercial Sensing.

[99]  Tao Wang,et al.  Research on Analyzing and Processing Methods of Ocean Sonar Signals , 2019, Journal of Coastal Research.

[100]  James Keller,et al.  Comparison of possibilistic fuzzy local information C-means and possibilistic K-nearest neighbors for synthetic aperture sonar image segmentation , 2019, Defense + Commercial Sensing.

[101]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[102]  Bruce G. Terrell,et al.  National Oceanic and Atmospheric Administration , 2020, Federal Regulatory Guide.