Aircraft Type Recognition Based on Segmentation With Deep Convolutional Neural Networks

Aircraft type recognition in remote sensing images is a meaningful task. It remains challenging due to the difficulty of obtaining appropriate representation of aircrafts for recognition. To solve this problem, we propose a novel aircraft type recognition framework based on deep convolutional neural networks. First, an aircraft segmentation network is designed to obtain refined aircraft segmentation results which provide significant details to distinguish different aircrafts. Then, a keypoints’ detection network is proposed to acquire aircrafts’ directions and bounding boxes, which are used to align the segmentation results. A new multirotation refinement method is carefully designed to further improve the keypoints’ precision. At last, we apply a template matching method to identify aircrafts, and the intersection over union is adopted to evaluate the similarity between segmentation results and templates. The proposed framework takes advantage of both shape and scale information of aircrafts for recognition. Experiments show that the proposed method outperforms the state-of-the-art methods and can achieve 95.6% accuracy on the challenging data set.