Local Pixel Attack Based on Sensitive Pixel Location for Remote Sensing Images

As deep neural networks (DNNs) are widely used in the field of remote sensing image recognition, there is a model security issue that cannot be ignored. DNNs have been shown to be vulnerable to small perturbations in a large number of studies in the past, and this security risk naturally exists in remote sensing object detection models based on DNNs. The complexity of remote sensing object detection models makes it difficult to implement adversarial attacks on them, resulting in the current lack of systematic research on adversarial examples in the field of remote sensing image recognition. In order to better deal with the adversarial threats that remote sensing image recognition models may confront and to provide an effective means for evaluating the robustness of the models, this paper takes the adversarial examples for remote sensing image recognition as the research goal and systematically studies vanishing attacks against a remote sensing image object detection model. To solve the problem of difficult attack implementation on remote sensing image object detection, adversarial attack adaptation methods based on interpolation scaling and patch perturbation stacking are proposed in this paper, which realizes the adaptation of classical attack algorithms. We propose a hot restart perturbation update strategy and the joint attack of the first and second stages of the two-stage remote sensing object detection model is realized through the design of the attack loss function. For the problem of the modification cost of global pixel attack being too large, a local pixel attack algorithm based on sensitive pixel location is proposed in this paper. By searching the location of the sensitive pixels and constructing the mask of attack area, good local pixel attack effect is achieved. Experimental results show that the average pixel modification rate of the proposed attack method decreases to less than 4% and the vanishing rate can still be maintained above 80%, which effectively achieves the balance between attack effect and attack cost.

[1]  Pedram Ghamisi,et al.  Universal Adversarial Examples in Remote Sensing: Methodology and Benchmark , 2022, IEEE Transactions on Geoscience and Remote Sensing.

[2]  Teng Huang,et al.  Adversarial perturbation in remote sensing image recognition , 2021, Appl. Soft Comput..

[3]  Nils Jansen,et al.  Adversarial Patch Camouflage against Aerial Detection , 2020, Artificial Intelligence and Machine Learning in Defense Applications II.

[4]  Nicolas Courty,et al.  Generating Natural Adversarial Remote Sensing Images , 2020, IEEE Transactions on Geoscience and Remote Sensing.

[5]  Guisong Xia,et al.  Gliding Vertex on the Horizontal Bounding Box for Multi-Oriented Object Detection , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Xue Yang,et al.  Learning Modulated Loss for Rotated Object Detection , 2019, AAAI.

[7]  Junchi Yan,et al.  R3Det: Refined Single-Stage Detector with Feature Refinement for Rotating Object , 2019, AAAI.

[8]  Wojciech Czaja,et al.  Adversarial examples in remote sensing , 2018, SIGSPATIAL/GIS.

[9]  Lei Guo,et al.  When Deep Learning Meets Metric Learning: Remote Sensing Image Scene Classification via Learning Discriminative CNNs , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[10]  Xiuping Jia,et al.  Deep Feature Extraction and Classification of Hyperspectral Images Based on Convolutional Neural Networks , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[11]  Bo Du,et al.  Scene Classification via a Gradient Boosting Random Convolutional Network Framework , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[12]  Gui-Song Xia,et al.  Transferring Deep Convolutional Neural Networks for the Scene Classification of High-Resolution Remote Sensing Imagery , 2015, Remote. Sens..

[13]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Thomas Gärtner,et al.  Machine Learning and Knowledge Discovery in Databases , 2018, Lecture Notes in Computer Science.