Real-World ISAR Object Recognition and Relation Discovery Using Deep Relation Graph Learning

Real-world inverse synthetic aperture radar (ISAR) object recognition is the most critical and challenging problem in computer vision tasks. In this paper, an efficient real-world ISAR object recognition and relation discovery method are proposed, based on deep relation graph learning. It not only handles the real-world object recognition problem efficiently, but also exploits the inter-modal relationships among features, attributes, and classes with semantic knowledge. First, dilated deformable convolutional neural network, including dilated deformable convolution and dilated deformable location-aware RoI pooling, is introduced to greatly improve CNNs’ sampling and transformation ability, and increase the output feature maps’ resolutions significantly. And a related multi-modal regions ranking strategy is proposed. Second, deep graph attribute-association learning is proposed to jointly estimate a large number of multi-heterogeneous attributes, and leverage features, attributes, and semantic knowledge to learn their relations. Third, multi-scale relational-regularized convolutional sparse learning is proposed to further improve the accuracy and speed of the whole system. The extensive experiments are performed on two real-world ISAR datasets, showing our proposed method outperforms the state-of-the-art methods.

[1]  Xiao Huang,et al.  Accelerated Attributed Network Embedding , 2017, SDM.

[2]  Xin Xu,et al.  DIOD: Fast, Semi-Supervised Deep ISAR Object Detection , 2019, IEEE Sensors Journal.

[3]  Ehab Salahat,et al.  Recent advances in features extraction and description algorithms: A comprehensive survey , 2017, 2017 IEEE International Conference on Industrial Technology (ICIT).

[4]  Witold Pedrycz,et al.  Online Feature Transformation Learning for Cross-Domain Object Category Recognition , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[5]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.

[6]  Jitendra Malik,et al.  Region-Based Convolutional Networks for Accurate Object Detection and Segmentation , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Rob A. Rutenbar,et al.  Video-Rate Stereo Matching Using Markov Random Field TRW-S Inference on a Hybrid CPU+FPGA Computing Platform , 2016, IEEE Transactions on Circuits and Systems for Video Technology.

[8]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Jonathan Rossiter,et al.  Euglenoid-Inspired Giant Shape Change for Highly Deformable Soft Robots , 2017, IEEE Robotics and Automation Letters.

[10]  Suhad Lateef Al-khafaji,et al.  Spectral-Spatial Scale Invariant Feature Transform for Hyperspectral Images , 2018, IEEE Transactions on Image Processing.

[11]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[12]  Antonio Criminisi,et al.  Image Quality Transfer via Random Forest Regression: Applications in Diffusion MRI , 2014, MICCAI.

[13]  Marios Anthimopoulos,et al.  Lung Pattern Classification for Interstitial Lung Diseases Using a Deep Convolutional Neural Network , 2016, IEEE Transactions on Medical Imaging.

[14]  Carlos Angel Iglesias,et al.  Sematch: Semantic similarity framework for Knowledge Graphs , 2017, Knowl. Based Syst..

[15]  Hon-Cheng Wong,et al.  Multiple Object Detection by a Deformable Part-Based Model and an R-CNN , 2018, IEEE Signal Processing Letters.

[16]  Michel J. G. Weber,et al.  ON SERIES OF DILATED FUNCTIONS , 2012, 1205.1326.

[17]  Ningning Tong,et al.  DIOD: Fast and Efficient Weakly Semi-Supervised Deep Complex ISAR Object Detection , 2019, IEEE Transactions on Cybernetics.

[18]  Noh Hoon Myung,et al.  Automatic algorithm for estimating the jet engine blade number from the radar target signature of aircraft targets , 2015, IEEE Aerospace and Electronic Systems Magazine.

[19]  Emre Eftelioglu Geometric Median , 2017, Encyclopedia of GIS.

[20]  Yoshihiko Nakamura,et al.  A New Trajectory Deformation Algorithm Based on Affine Transformations , 2013, IEEE Transactions on Robotics.

[21]  Kaiming He,et al.  Mask R-CNN , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[22]  Yuanyuan Qin,et al.  RoI Pooling Based Fast Multi-Domain Convolutional Neural Networks for Visual Tracking , 2016 .

[23]  Peng Yang,et al.  Robust Online Multi-Task Learning with Correlative and Personalized Structures , 2017, IEEE Transactions on Knowledge and Data Engineering.

[24]  Yi Li,et al.  R-FCN: Object Detection via Region-based Fully Convolutional Networks , 2016, NIPS.

[25]  Thomas A. Funkhouser,et al.  Dilated Residual Networks , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).