Automatic and Fast PCM Generation for Occluded Object Detection in High-Resolution Remote Sensing Images

Partial configuration model (PCM) is an occluded object detection method in high-resolution remote sensing images (HR-RSIs) based on the deformable part-based model (DPM). However, it needs extra category predefinition, considerable part-level annotation, and repeated multimodel training. In this letter, an automatic and fast PCM generation method is proposed based on a novel part sharing mechanism. We propose to share parts from one trained DPM model (tDPM) among different models of partial configurations (PCs) to address the above problems. PCs are first designed according to part anchors of tDPM. The model is then generated through corresponding parts selection, root coverage cropping, and elements reweighing. This method avoids the need for manual category predefinition and part-level annotation, while largely reducing the computation of PCM training. Experimental results on three HR-RSI data sets show that the proposed method obtains a training speedup of <inline-formula> <tex-math notation="LaTeX">$6.7\times $ </tex-math></inline-formula> and <inline-formula> <tex-math notation="LaTeX">$2\times $ </tex-math></inline-formula> for each PC of airplane and ship categories, while achieving a comparable accuracy compared with PCM.

[1]  Xiaogang Wang,et al.  A discriminative deep model for pedestrian detection with occlusion handling , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[3]  Junwei Han,et al.  Object detection in remote sensing imagery using a discriminatively trained mixture model , 2013 .

[4]  Aoxue Li,et al.  Global and Local Saliency Analysis for the Extraction of Residential Areas in High-Spatial-Resolution Remote Sensing Image , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[5]  Seiichi Mita,et al.  Occlusion handling using discriminative model of trained part templates and conditional random field , 2013, 2013 IEEE Intelligent Vehicles Symposium (IV).

[6]  Rogério Schmidt Feris,et al.  A Unified Multi-scale Deep Convolutional Neural Network for Fast Object Detection , 2016, ECCV.

[7]  Alexei A. Efros,et al.  Ensemble of exemplar-SVMs for object detection and beyond , 2011, 2011 International Conference on Computer Vision.

[8]  Luc Van Gool,et al.  The Pascal Visual Object Classes (VOC) Challenge , 2010, International Journal of Computer Vision.

[9]  Qing Liu,et al.  Accurate Object Localization in Remote Sensing Images Based on Convolutional Neural Networks , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[10]  Bo Du,et al.  Weakly Supervised Learning Based on Coupled Convolutional Neural Networks for Aircraft Detection , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[11]  Xinwei Zheng,et al.  A New Method on Inshore Ship Detection in High-Resolution Satellite Images Using Shape and Context Information , 2014, IEEE Geoscience and Remote Sensing Letters.

[12]  Igor Sevo,et al.  Convolutional Neural Network Based Automatic Object Detection on Aerial Images , 2016, IEEE Geoscience and Remote Sensing Letters.

[13]  Konrad Schindler,et al.  Explicit Occlusion Modeling for 3D Object Class Representations , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[14]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Junwei Han,et al.  Multi-class geospatial object detection and geographic image classification based on collection of part detectors , 2014 .

[16]  Shiming Xiang,et al.  Vehicle Detection in Satellite Images by Hybrid Deep Convolutional Neural Networks , 2014, IEEE Geoscience and Remote Sensing Letters.

[17]  Junwei Han,et al.  Learning Rotation-Invariant Convolutional Neural Networks for Object Detection in VHR Optical Remote Sensing Images , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[18]  Gongjian Wen,et al.  Occluded Object Detection in High-Resolution Remote Sensing Images Using Partial Configuration Object Model , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[19]  David A. McAllester,et al.  Object Detection with Discriminatively Trained Part Based Models , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.