Aircraft Type Recognition in Remote Sensing Images: Bilinear Discriminative Extreme Learning Machine Framework

Small inter-class and massive intra-class changes are important challenges in aircraft model recognition in the field of remote sensing. Although the aircraft model recognition algorithm based on the convolutional neural network (CNN) has excellent recognition performance, it is limited by sample sets and computing resources. To solve the above problems, we propose the bilinear discriminative extreme learning machine (ELM) network (BD-ELMNet), which integrates the advantages of the CNN, autoencoder (AE), and ELM. Specifically, the BD-ELMNet first executes the convolution and pooling operations to form a convolutional ELM (ELMConvNet) to extract shallow features. Furthermore, the manifold regularized ELM-AE (MRELM-AE), which can simultaneously consider the geometrical structure and discriminative information of aircraft data, is developed to extract discriminative features. The bilinear pooling model uses the feature association information for feature fusion to enhance the substantial distinction of features. Compared with the backpropagation (BP) optimization method, BD-ELMNet adopts a layer-by-layer training method without repeated adjustments to effectively learn discriminant features. Experiments involving the application of several methods, including the proposed method, to the MTARSI benchmark demonstrate that the proposed aircraft type recognition method outperforms the state-of-the-art methods.

[1]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[2]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[3]  Hongyi Zhang,et al.  mixup: Beyond Empirical Risk Minimization , 2017, ICLR.

[4]  Shuicheng Yan,et al.  Graph Embedding and Extensions: A General Framework for Dimensionality Reduction , 2007 .

[5]  Wei Dai,et al.  MultiCAM: Multiple Class Activation Mapping for Aircraft Recognition in Remote Sensing Images , 2019, Remote. Sens..

[6]  Tony Lindeberg,et al.  Scale Invariant Feature Transform , 2012, Scholarpedia.

[7]  Gabriela Csurka,et al.  Visual categorization with bags of keypoints , 2002, eccv 2004.

[8]  Menglong Yan,et al.  Object recognition in remote sensing images using sparse deep belief networks , 2015 .

[9]  Zhihua Wei,et al.  Mixed Pooling for Convolutional Neural Networks , 2014, RSKT.

[10]  Hiroshi Inoue,et al.  Data Augmentation by Pairing Samples for Images Classification , 2018, ArXiv.

[11]  Baojun Zhao,et al.  Spatial-Temporal Context-Aware Tracking , 2019, IEEE Signal Processing Letters.

[12]  Amit Verma,et al.  Deep learning based enhanced tumor segmentation approach for MR brain images , 2019, Appl. Soft Comput..

[13]  Yao Yao,et al.  Stacked Denoising Extreme Learning Machine Autoencoder Based on Graph Embedding for Feature Representation , 2019, IEEE Access.

[14]  Tingfa Xu,et al.  A Reliable and Real-Time Tracking Method with Color Distribution , 2017, Sensors.

[15]  Jiao Jiao,et al.  An End-to-End Neural Network for Road Extraction From Remote Sensing Imagery by Multiple Feature Pyramid Network , 2018, IEEE Access.

[16]  陳建銘,et al.  衛星影像中飛機機型之辨識; Aircraft Type Recognition in Satellite Images , 2003 .

[17]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Yao Lu,et al.  Graph regularized discriminant analysis and its application to face recognition , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[19]  Chi-Man Vong,et al.  Local Receptive Fields Based Extreme Learning Machine , 2015, IEEE Computational Intelligence Magazine.

[20]  Gustavo Carneiro,et al.  A Bayesian Data Augmentation Approach for Learning Deep Models , 2017, NIPS.

[21]  L. C. Kasun,et al.  Representational Learning with Extreme Learning Machine for Big Data Liyanaarachchi , 2022 .

[22]  Marko Heikkilä,et al.  Description of interest regions with local binary patterns , 2009, Pattern Recognit..

[23]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[24]  Yan Chen,et al.  A benchmark data set for aircraft type recognition from remote sensing images , 2020, Appl. Soft Comput..

[25]  Jean Ponce,et al.  A Theoretical Analysis of Feature Pooling in Visual Recognition , 2010, ICML.

[26]  Bo Chen,et al.  MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications , 2017, ArXiv.

[27]  Mikhail Belkin,et al.  Laplacian Eigenmaps and Spectral Techniques for Embedding and Clustering , 2001, NIPS.

[28]  Haibin Duan,et al.  Artificial bee colony (ABC) optimized edge potential function (EPF) approach to target recognition for low-altitude aircraft , 2010, Pattern Recognit. Lett..

[29]  Jiwen Lu,et al.  PCANet: A Simple Deep Learning Baseline for Image Classification? , 2014, IEEE Transactions on Image Processing.

[30]  Pietro Perona,et al.  Microsoft COCO: Common Objects in Context , 2014, ECCV.

[31]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[32]  Guang-Bin Huang,et al.  Extreme learning machine: a new learning scheme of feedforward neural networks , 2004, 2004 IEEE International Joint Conference on Neural Networks (IEEE Cat. No.04CH37541).

[33]  Biao Leng,et al.  Data augmentation for unbalanced face recognition training sets , 2017, Neurocomputing.

[34]  Trevor Darrell,et al.  Multimodal Compact Bilinear Pooling for Visual Question Answering and Visual Grounding , 2016, EMNLP.

[35]  Razvan Pascanu,et al.  Learned-Norm Pooling for Deep Feedforward and Recurrent Neural Networks , 2013, ECML/PKDD.

[36]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[37]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[38]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[39]  Arun Kumar Sangaiah,et al.  UAV based wilt detection system via convolutional neural networks , 2020, Sustain. Comput. Informatics Syst..

[40]  Nitish Srivastava,et al.  Improving neural networks by preventing co-adaptation of feature detectors , 2012, ArXiv.

[41]  Yong Peng,et al.  Discriminative extreme learning machine with supervised sparsity preserving for image classification , 2017, Neurocomputing.

[42]  Guangluan Xu,et al.  Aircraft Type Recognition in Remote Sensing Images Based on Feature Learning with Conditional Generative Adversarial Networks , 2018, Remote. Sens..

[43]  Peter Corcoran,et al.  Smart Augmentation Learning an Optimal Data Augmentation Strategy , 2017, IEEE Access.

[44]  Chunxia Zhang,et al.  Generalized extreme learning machine autoencoder and a new deep neural network , 2017, Neurocomputing.

[45]  Guangluan Xu,et al.  Aircraft Type Recognition Based on Segmentation With Deep Convolutional Neural Networks , 2018, IEEE Geoscience and Remote Sensing Letters.

[46]  Deqin Yan,et al.  Information discriminative extreme learning machine , 2018, Soft Comput..

[47]  Forrest N. Iandola,et al.  SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <1MB model size , 2016, ArXiv.

[48]  José García Rodríguez,et al.  A Review on Deep Learning Techniques Applied to Semantic Segmentation , 2017, ArXiv.

[49]  Shuicheng Yan,et al.  An HOG-LBP human detector with partial occlusion handling , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[50]  Christopher Ré,et al.  Learning to Compose Domain-Specific Transformations for Data Augmentation , 2017, NIPS.

[51]  Joshua B. Tenenbaum,et al.  Separating Style and Content with Bilinear Models , 2000, Neural Computation.

[52]  Moumita Roy,et al.  A neural approach under transfer learning for domain adaptation in land-cover classification using two-level cluster mapping , 2018, Appl. Soft Comput..

[53]  Moses Charikar,et al.  Finding frequent items in data streams , 2004, Theor. Comput. Sci..

[54]  Zhuowen Tu,et al.  Generalizing Pooling Functions in Convolutional Neural Networks: Mixed, Gated, and Tree , 2015, AISTATS.

[55]  Quoc V. Le,et al.  AutoAugment: Learning Augmentation Strategies From Data , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[56]  Chee Kheong Siew,et al.  Universal Approximation using Incremental Constructive Feedforward Networks with Random Hidden Nodes , 2006, IEEE Transactions on Neural Networks.

[57]  Hayit Greenspan,et al.  GAN-based Synthetic Medical Image Augmentation for increased CNN Performance in Liver Lesion Classification , 2018, Neurocomputing.

[58]  Menglong Yan,et al.  Automatic Ship Detection in Remote Sensing Images from Google Earth of Complex Scenes Based on Multiscale Rotation Dense Feature Pyramid Networks , 2018, Remote. Sens..

[59]  Jun Miao,et al.  Hierarchical Extreme Learning Machine for unsupervised representation learning , 2015, 2015 International Joint Conference on Neural Networks (IJCNN).

[60]  Xian Sun,et al.  Aircraft Recognition in High-Resolution Optical Satellite Remote Sensing Images , 2015, IEEE Geoscience and Remote Sensing Letters.

[61]  Tian Zhang,et al.  Understanding Mixup Training Methods , 2018, IEEE Access.

[62]  Hai-Jun Rong,et al.  Aircraft recognition using modular extreme learning machine , 2014, Neurocomputing.

[63]  Baojun Zhao,et al.  Adaptive feature representation for visual tracking , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[64]  Yiqiang Chen,et al.  Weighted extreme learning machine for imbalance learning , 2013, Neurocomputing.

[65]  Bineng Zhong,et al.  CNNTracker: Online discriminative object tracking via deep convolutional neural network , 2016, Appl. Soft Comput..

[66]  Daniel L. Rubin,et al.  Differential Data Augmentation Techniques for Medical Imaging Classification Tasks , 2017, AMIA.

[67]  Yanfeng Hu,et al.  Aircraft Recognition Based on Landmark Detection in Remote Sensing Images , 2017, IEEE Geoscience and Remote Sensing Letters.

[68]  Baojun Zhao,et al.  State-Aware Anti-Drift Object Tracking , 2018, IEEE Transactions on Image Processing.

[69]  Qing Fei,et al.  Convolutional Neural Network Based on Extreme Learning Machine for Maritime Ships Recognition in Infrared Images , 2018, Sensors.

[70]  Hongming Zhou,et al.  Extreme Learning Machines [Trends & Controversies] , 2013 .

[71]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.