Nonlinear Intensity Underwater Sonar Image Matching Method Based on Phase Information and Deep Convolution Features

In the field of deep-sea exploration, sonar is presently the only efficient long-distance sensing device. The complicated underwater environment, such as noise interference, low target intensity or background dynamics, has brought many negative effects on sonar imaging. Among them, the problem of nonlinear intensity is extremely prevalent. It is also known as the anisotropy of acoustic sensor imaging, that is, when autonomous underwater vehicles (AUVs) carry sonar to detect the same target from different angles, the intensity variation between image pairs is sometimes very large, which makes the traditional matching algorithm almost ineffective. However, image matching is the basis of comprehensive tasks such as navigation, positioning, and mapping. Therefore, it is very valuable to obtain robust and accurate matching results. This paper proposes a combined matching method based on phase information and deep convolution features. It has two outstanding advantages: one is that the deep convolution features could be used to measure the similarity of the local and global positions of the sonar image; the other is that local feature matching could be performed at the key target position of the sonar image. This method does not need complex manual designs, and completes the matching task of nonlinear intensity sonar images in a close end-to-end manner. Feature matching experiments are carried out on the deep-sea sonar images captured by AUVs, and the results show that our proposal has preeminent matching accuracy and robustness.

[1]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[2]  Nikos Komodakis,et al.  Learning to compare image patches via convolutional neural networks , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  Nicola Neretti,et al.  Mosaicing of acoustic camera images , 2005 .

[4]  Gary R. Bradski,et al.  ORB: An efficient alternative to SIFT or SURF , 2011, 2011 International Conference on Computer Vision.

[5]  Roland Siegwart,et al.  BRISK: Binary Robust invariant scalable keypoints , 2011, 2011 International Conference on Computer Vision.

[6]  Marc Pinto,et al.  Sonar image registration for swarm AUVs navigation: Results from SWARMs project , 2019, J. Comput. Sci..

[7]  Matias Valdenegro-Toro Improving sonar image patch matching via deep learning , 2017, 2017 European Conference on Mobile Robots (ECMR).

[8]  Chirag I. Patel,et al.  CNN Variants for Computer Vision: History, Architecture, Application, Challenges and Future Scope , 2021, Electronics.

[9]  P. Woock,et al.  Deep-sea AUV navigation using side-scan sonar images and SLAM , 2010, OCEANS'10 IEEE SYDNEY.

[10]  Peter King,et al.  Autonomous Underwater Vehicle Navigation Using Sonar Image Matching based on Convolutional Neural Network , 2019, IFAC-PapersOnLine.

[11]  Didier Gueriot,et al.  Guided block-matching for sonar image registration using unsupervised Kohonen neural networks , 2013, 2013 OCEANS - San Diego.

[12]  Christopher Hunt,et al.  Notes on the OpenSURF Library , 2009 .

[13]  Hujun Bao,et al.  LoFTR: Detector-Free Local Feature Matching with Transformers , 2021, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Tomasz Malisiewicz,et al.  SuperPoint: Self-Supervised Interest Point Detection and Description , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[15]  Peter King,et al.  Comparison of feature detection techniques for AUV navigation along a trained route , 2013, 2013 OCEANS - San Diego.

[16]  J. Griffin,et al.  Inter-calibrating multi-source, multi-platform backscatter data sets to assist in compiling regional sediment type maps : Bay of Fundy , 2008 .

[17]  A. Vardy,et al.  Side-scan sonar image registration for AUV navigation , 2010, 2011 IEEE Symposium on Underwater Technology and Workshop on Scientific Use of Submarine Cables and Related Technologies.

[18]  Qingwu Hu,et al.  RIFT: Multi-Modal Image Matching Based on Radiation-Variation Insensitive Feature Transform , 2019, IEEE Transactions on Image Processing.

[19]  Robyn A. Owens,et al.  Feature detection from local energy , 1987, Pattern Recognit. Lett..