Visual Recognition Based on Deep Learning for Navigation Mark Classification

Recognizing objects from camera images is an important field for researching smart ships and intelligent navigation. In sea transportation, navigation marks indicating the features of navigational environments (e.g. channels, special areas, wrecks, etc.) are focused in this paper. A fine-grained classification model named RMA (ResNet-Multiscale-Attention) based on deep learning is proposed to analyse the subtle and local differences among navigation mark types for the recognition of navigation marks. In the RMA model, an attention mechanism based on the fusion of feature maps with three scales is proposed to locate attention regions and capture discriminative characters that are important to distinguish the slight differences among similar navigation marks. Experimental results on a dataset with 10260 navigation mark images showed that the RMA has an accuracy about 96% to classify 42 types of navigation marks, and the RMA is better than ResNet-50 model with which the accuracy is about 94%. The visualization analyses showed that the RMA model can extract the attention regions and the characters of navigation marks.

[1]  Lipo Wang,et al.  Deep Learning Applications in Medical Image Analysis , 2018, IEEE Access.

[2]  Guang-Zhong Yang,et al.  Reliable Label-Efficient Learning for Biomedical Image Recognition , 2019, IEEE Transactions on Biomedical Engineering.

[3]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[4]  Hyeon-Cheol Shin,et al.  Classification Maritime Vessel Image utilizing a Region of Interest Extracted and Convolution Neural Network , 2019 .

[5]  Yan Liu,et al.  Discriminative deep belief networks for visual data classification , 2011, Pattern Recognit..

[6]  Roberto Paredes,et al.  Local Deep Neural Networks for gender recognition , 2016, Pattern Recognit. Lett..

[7]  Hong Zhang,et al.  Fine-grained ship classification based on deep residual learning for high-resolution SAR images , 2019, Remote Sensing Letters.

[8]  Yue Gao,et al.  Hypergraph-Induced Convolutional Networks for Visual Classification , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[9]  Jianwei Li,et al.  Ship classification for unbalanced SAR dataset based on convolutional neural network , 2018, Journal of Applied Remote Sensing.

[10]  Lixin Zheng,et al.  Combining Convolutional Neural Network With Recursive Neural Network for Blood Cell Image Classification , 2018, IEEE Access.

[11]  Alejandro Garcia-Dominguez.  Mobile applications, cloud and bigdata on ships and shore stations for increased safety on marine traffic; a smart ship project , 2015, 2015 IEEE International Conference on Industrial Technology (ICIT).

[12]  Hao Chen,et al.  Automated Melanoma Recognition in Dermoscopy Images via Very Deep Residual Networks , 2017, IEEE Transactions on Medical Imaging.

[13]  A. Aydin Alatan,et al.  Fine-grained recognition of maritime vessels and land vehicles by deep feature embedding , 2018, IET Comput. Vis..

[14]  Hao Chen,et al.  Automatic Detection of Cerebral Microbleeds From MR Images via 3D Convolutional Neural Networks , 2016, IEEE Transactions on Medical Imaging.

[15]  Gisela Müller-Plath.  How Does Digital Navigation on Sailboats Affect Spatial Abilities at Sea , 2019 .

[16]  Hyewon Lee,et al.  Image-Based Ship Detection and Classification for Unmanned Surface Vehicle Using Real-Time Object Detection Neural Networks , 2018 .

[17]  Trevor Darrell,et al.  Long-term recurrent convolutional networks for visual recognition and description , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Yuxin Peng,et al.  Fine-Grained Image Classification via Combining Vision and Language , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[19]  Kazuhiko Hasegawa,et al.  Autonomous navigation of catamaran surface vessel , 2017, 2017 IEEE Underwater Technology (UT).

[20]  Jiwen Lu,et al.  PCANet: A Simple Deep Learning Baseline for Image Classification? , 2014, IEEE Transactions on Image Processing.

[21]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[22]  You-lin Tang,et al.  Design and research of integrated information platform for smart ship , 2017, 2017 4th International Conference on Transportation Information and Safety (ICTIS).

[23]  Trevor Darrell,et al.  Part-Based R-CNNs for Fine-Grained Category Detection , 2014, ECCV.

[24]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[25]  Jonathan Li,et al.  Ship Detection Using a Fully Convolutional Network with Compact Polarimetric SAR Images , 2019, Remote. Sens..

[26]  Yuxin Peng,et al.  The application of two-level attention models in deep convolutional neural network for fine-grained image classification , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[27]  Quentin Oliveau,et al.  From Transductive to Inductive Semi-Supervised Attributes for Ship Category Recognition , 2018, IGARSS 2018 - 2018 IEEE International Geoscience and Remote Sensing Symposium.

[28]  Jongpil Jeong,et al.  Components for Smart Autonomous Ship Architecture Based on Intelligent Information Technology , 2018, FNC/MobiSPC.

[29]  Bo Wang,et al.  Radar-based collision avoidance for unmanned surface vehicles , 2016 .

[30]  Mingzhe Jiang,et al.  Ship Classification Based on Superstructure Scattering Features in SAR Images , 2016, IEEE Geoscience and Remote Sensing Letters.

[31]  Xiu-Shen Wei,et al.  Mask-CNN: Localizing Parts and Selecting Descriptors for Fine-Grained Image Recognition , 2016, ArXiv.

[32]  Fouad Bousetouane,et al.  Fast CNN surveillance pipeline for fine-grained vessel classification and detection in maritime scenarios , 2016, 2016 13th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS).

[33]  Peng Li,et al.  Maritime Ship Targets Recognition with Deep Learning , 2018, 2018 37th Chinese Control Conference (CCC).

[34]  Pietro Perona,et al.  Improved Bird Species Recognition Using Pose Normalized Deep Convolutional Nets , 2014, BMVC.

[35]  Fan Zhang,et al.  Deep Convolutional Neural Networks for Hyperspectral Image Classification , 2015, J. Sensors.

[36]  Lianru Gao,et al.  Deep CNN With Multi-Scale Rotation Invariance Features for Ship Classification , 2018, IEEE Access.

[37]  Marcel Simon,et al.  Neural Activation Constellations: Unsupervised Part Model Discovery with Convolutional Networks , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[38]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[39]  Bolei Zhou,et al.  Learning Deep Features for Discriminative Localization , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[40]  Phillip M. Cheng,et al.  Transfer Learning with Convolutional Neural Networks for Classification of Abdominal Ultrasound Images , 2017, Journal of Digital Imaging.