Effect of Attention Mechanism in Deep Learning-Based Remote Sensing Image Processing: A Systematic Literature Review

Machine learning, particularly deep learning (DL), has become a central and state-of-theart method for several computer vision applications and remote sensing (RS) image processing. Researchers are continually trying to improve the performance of the DL methods by developing new architectural designs of the networks and/or developing new techniques, such as attention mechanisms. Since the attention mechanism has been proposed, regardless of its type, it has been increasingly used for diverse RS applications to improve the performances of the existing DL methods. However, these methods are scattered over different studies impeding the selection and application of the feasible approaches. This study provides an overview of the developed attention mechanisms and how to integrate them with different deep learning neural network architectures. In addition, it aims to investigate the effect of the attention mechanism on deep learning-based RS image processing. We identified and analyzed the advances in the corresponding attention mechanism-based deep learning (At-DL) methods. A systematic literature review was performed to identify the trends in publications, publishers, improved DL methods, data types used, attention types used, overall accuracies achieved using At-DL methods, and extracted the current research directions, weaknesses, and open problems to provide insights and recommendations for future studies. For this, five main research questions were formulated to extract the required data and information from the literature. Furthermore, we categorized the papers regarding the addressed RS image processing tasks (e.g., image classification, object detection, and change detection) and discussed the results within each group. In total, 270 papers were retrieved, of which 176 papers were selected according to the defined exclusion criteria for further analysis and detailed review. The results reveal that most of the papers reported an increase in overall accuracy when using the attention mechanism within the DL methods for image classification, image segmentation, change detection, and object detection using remote

[1]  Norman Kerle,et al.  Post-Disaster Recovery Monitoring with Google Earth Engine , 2020 .

[2]  Jin Xing,et al.  Integrating Weighted Feature Fusion and the Spatial Attention Module with Convolutional Neural Networks for Automatic Aircraft Detection from SAR Images , 2021, Remote. Sens..

[3]  Pearl Brereton,et al.  Systematic literature reviews in software engineering - A systematic literature review , 2009, Inf. Softw. Technol..

[4]  Min Zhou,et al.  Local Attention Networks for Occluded Airplane Detection in Remote Sensing Images , 2020, IEEE Geoscience and Remote Sensing Letters.

[5]  Siyu Tan,et al.  Geospatial Contextual Attention Mechanism for Automatic and Fast Airport Detection in SAR Imagery , 2020, IEEE Access.

[6]  Weile Li,et al.  Landslide detection from an open satellite imagery and digital elevation model dataset using attention boosted convolutional neural networks , 2020, Landslides.

[7]  Yongjun Zhang,et al.  Multi-Label Remote Sensing Image Scene Classification by Combining a Convolutional Neural Network and a Graph Neural Network , 2020, Remote. Sens..

[8]  Meng Wang,et al.  Research on Change Detection Method of High-Resolution Remote Sensing Images Based on Subpixel Convolution , 2021, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[9]  Hong Huo,et al.  Global-Local Attention Network for Aerial Scene Classification , 2019, IEEE Access.

[10]  Jun Huang,et al.  Spectral-Spatial Attention Networks for Hyperspectral Image Classification , 2019, Remote. Sens..

[11]  Li Yan,et al.  Single Remote Sensing Image Dehazing Using a Prior-Based Dense Attentive Network , 2019, Remote Sensing.

[12]  Cong Liu,et al.  Inception residual attention network for remote sensing image super-resolution , 2020 .

[13]  Hao Zhang,et al.  NDVI-Net: A fusion network for generating high-resolution normalized difference vegetation index in remote sensing , 2020 .

[14]  M. Weiss,et al.  Remote sensing for agricultural applications: A meta-review , 2020 .

[15]  Biao Wang,et al.  Building Extraction in Very High Resolution Imagery by Dense-Attention Networks , 2018, Remote. Sens..

[16]  Stefan Hinz,et al.  Review on Convolutional Neural Networks (CNN) in vegetation remote sensing , 2021, ISPRS Journal of Photogrammetry and Remote Sensing.

[17]  Licheng Jiao,et al.  Multiscale CNN With Autoencoder Regularization Joint Contextual Attention Network for SAR Image Classification , 2020, IEEE Transactions on Geoscience and Remote Sensing.

[18]  Lianru Gao,et al.  Building Extraction from High-Resolution Aerial Imagery Using a Generative Adversarial Network with Spatial and Channel Attention Mechanisms , 2019, Remote. Sens..

[19]  Yunsong Li,et al.  Hyperspectral Image Super-Resolution with 1D-2D Attentional Convolutional Neural Network , 2019, Remote. Sens..

[20]  Yoshua Bengio,et al.  Show, Attend and Tell: Neural Image Caption Generation with Visual Attention , 2015, ICML.

[21]  Fei Gao,et al.  Attention Graph Convolution Network for Image Segmentation in Big SAR Imagery Data , 2019, Remote. Sens..

[22]  Zhenhong Du,et al.  EMMCNN: An ETPS-Based Multi-Scale and Multi-Feature Method Using CNN for High Spatial Resolution Image Land-Cover Classification , 2019, Remote. Sens..

[23]  Qiming Qin,et al.  Global Prototypical Network for Few-Shot Hyperspectral Image Classification , 2020, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[24]  Min Wang,et al.  Context Aggregation Network for Semantic Labeling in Aerial Images , 2019, Remote. Sens..

[25]  Jing Zhang,et al.  Object Detection Based on Global-Local Saliency Constraint in Aerial Images , 2020, Remote. Sens..

[26]  Long Chen,et al.  Change Detection of Remote Sensing Images Based on Attention Mechanism , 2020, Comput. Intell. Neurosci..

[27]  Peng Zhang,et al.  A Multi-Scale Deep Neural Network for Water Detection from SAR Images in the Mountainous Areas , 2020, Remote Sensing.

[28]  Ying Xia,et al.  Scene Classification of Remote Sensing Images Based on Saliency Dual Attention Residual Network , 2020, IEEE Access.

[29]  Rui Li,et al.  SAR Target Recognition Based on Efficient Fully Convolutional Attention Block CNN , 2022, IEEE Geoscience and Remote Sensing Letters.

[30]  Dilkushi A. de Alwis Pitts,et al.  Enhanced change detection index for disaster response, recovery assessment and monitoring of accessibility and open spaces (camp sites) , 2017, Int. J. Appl. Earth Obs. Geoinformation.

[31]  Hao Guo,et al.  Deep Collaborative Attention Network for Hyperspectral Image Classification by Combining 2-D CNN and 3-D CNN , 2020, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[32]  Xiaoqiang Lu,et al.  Remote Sensing Image Scene Classification: Benchmark and State of the Art , 2017, Proceedings of the IEEE.

[33]  Tianxu Zhang,et al.  Temporal Attention Networks for Multitemporal Multisensor Crop Classification , 2019, IEEE Access.

[34]  Tao Shen,et al.  DiSAN: Directional Self-Attention Network for RNN/CNN-free Language Understanding , 2017, AAAI.

[35]  Y. Zhong,et al.  Attention-Mechanism-Containing Neural Networks for High-Resolution Remote Sensing Image Classification , 2018, Remote Sensing.

[36]  Hao Gao,et al.  Semantic Segmentation of Marine Remote Sensing Based on a Cross Direction Attention Mechanism , 2020, IEEE Access.

[37]  M. Anouncia,et al.  Agriculture change detection model using remote sensing images and GIS: Study area Vellore , 2012, 2012 International Conference on Radar, Communication and Computing (ICRCC).

[38]  Shailender Kumar,et al.  Deep Learning Methods for Land Cover and Land Use Classification in Remote Sensing: A Review , 2020, 2020 8th International Conference on Reliability, Infocom Technologies and Optimization (Trends and Future Directions) (ICRITO).

[39]  Fei Cheng,et al.  Object detection based on an adaptive attention mechanism , 2020, Scientific Reports.

[40]  Licheng Jiao,et al.  A Spatial-Channel Collaborative Attention Network for Enhancement of Multiresolution Classification , 2020, Remote. Sens..

[41]  Dino Ienco,et al.  Weakly Supervised Learning for Land Cover Mapping of Satellite Image Time Series via Attention-Based CNN , 2020, IEEE Access.

[42]  Hongfeng You,et al.  Pixel-Level Remote Sensing Image Recognition Based on Bidirectional Word Vectors , 2020, IEEE Transactions on Geoscience and Remote Sensing.

[43]  Weiwei Sun,et al.  Spatial-Spectral Squeeze-and-Excitation Residual Network for Hyperspectral Image Classification , 2019, Remote. Sens..

[44]  Feng Xu,et al.  A Remote-Sensing Image Pan-Sharpening Method Based on Multi-Scale Channel Attention Residual Network , 2020, IEEE Access.

[45]  Li Chen,et al.  DASNet: Dual Attentive Fully Convolutional Siamese Networks for Change Detection in High-Resolution Satellite Images , 2020, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[46]  Xianzhi Li,et al.  Attention GANs: Unsupervised Deep Feature Learning for Aerial Scene Classification , 2020, IEEE Transactions on Geoscience and Remote Sensing.

[47]  Baoguo Li,et al.  Multi-Temporal Unmanned Aerial Vehicle Remote Sensing for Vegetable Mapping Using an Attention-Based Recurrent Convolutional Neural Network , 2020, Remote. Sens..

[48]  Jun Zhang,et al.  Learning Slimming SAR Ship Object Detector Through Network Pruning and Knowledge Distillation , 2021, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[49]  Saeid Homayouni,et al.  A Meta-Analysis of Convolutional Neural Networks for Remote Sensing Applications , 2021, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[50]  Mariana Belgiu,et al.  Random forest in remote sensing: A review of applications and future directions , 2016 .

[51]  Yurong Qian,et al.  MCNet: Multi-Scale Feature Extraction and Content-Aware Reassembly Cloud Detection Model for Remote Sensing Images , 2020, Symmetry.

[52]  Nanjun He,et al.  Hybrid first and second order attention Unet for building segmentation in remote sensing images , 2020, Science China Information Sciences.

[53]  Hui Yu,et al.  A review on the attention mechanism of deep learning , 2021, Neurocomputing.

[54]  Lizhe Wang,et al.  Channel-Attention-Based DenseNet Network for Remote Sensing Image Scene Classification , 2020, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[55]  Xiao Xiang Zhu,et al.  Deep Learning in Remote Sensing: A Comprehensive Review and List of Resources , 2017, IEEE Geoscience and Remote Sensing Magazine.

[56]  Xueliang Zhang,et al.  Deep learning in remote sensing applications: A meta-analysis and review , 2019, ISPRS Journal of Photogrammetry and Remote Sensing.

[57]  Xiaoyu Dong,et al.  Remote Sensing Image Super-Resolution via Enhanced Back-Projection Networks , 2020, IGARSS 2020 - 2020 IEEE International Geoscience and Remote Sensing Symposium.

[58]  Yueming Wang,et al.  HSI-IPNet: Hyperspectral Imagery Inpainting by Deep Learning With Adaptive Spectral Extraction , 2020, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[59]  Dino Ienco,et al.  Attentive Spatial Temporal Graph CNN for Land Cover Mapping From Multi Temporal Remote Sensing Data , 2021, IEEE Access.

[60]  Peijun Du,et al.  A review of supervised object-based land-cover image classification , 2017 .

[61]  Selim Aksoy,et al.  Multisource Region Attention Network for Fine-Grained Object Recognition in Remote Sensing Imagery , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[62]  Ruochen Liu,et al.  Remote Sensing Image Change Detection Based on Information Transmission and Attention Mechanism , 2019, IEEE Access.

[63]  M. Carrasco.  Visual attention: The past 25 years , 2011, Vision Research.

[64]  Fei Wang,et al.  Multi-Scale Semantic Segmentation and Spatial Relationship Recognition of Remote Sensing Images Based on an Attention Model , 2019, Remote. Sens..

[65]  Huiyu Zhou,et al.  Anchor-free Convolutional Network with Dense Attention Feature Aggregation for Ship Detection in SAR Images , 2020, Remote. Sens..

[66]  Jun Li,et al.  Self-Attentive Generative Adversarial Network for Cloud Detection in High Resolution Remote Sensing Images , 2020, IEEE Geoscience and Remote Sensing Letters.

[67]  Konstantinos Gavriil,et al.  Void Filling of Digital Elevation Models With Deep Generative Models , 2018, IEEE Geoscience and Remote Sensing Letters.

[68]  Pedram Ghamisi,et al.  Support Vector Machine Versus Random Forest for Remote Sensing Image Classification: A Meta-Analysis and Systematic Review , 2020, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[69]  Licheng Jiao,et al.  Attention Multibranch Convolutional Neural Network for Hyperspectral Image Classification Based on Adaptive Region Search , 2021, IEEE Transactions on Geoscience and Remote Sensing.

[70]  Jiasen Lu,et al.  Hierarchical Question-Image Co-Attention for Visual Question Answering , 2016, NIPS.

[71]  Cui Zou,et al.  Small Sample Classification of Hyperspectral Remote Sensing Images Based on Sequential Joint Deeping Learning Model , 2020, IEEE Access.

[72]  Rong Chen,et al.  Attentive generative adversarial network for removing thin cloud from a single remote sensing image , 2021, IET Image Process..

[73]  Edoardo Pasolli,et al.  Post-Disaster Building Database Updating Using Automated Deep Learning: An Integration of Pre-Disaster OpenStreetMap and Multi-Temporal Satellite Data , 2019, Remote. Sens..

[74]  Naif Alajlan,et al.  Deep Attention Neural Network for Multi-Label Classification in Unmanned Aerial Vehicle Imagery , 2019, IEEE Access.

[75]  Licheng Jiao,et al.  Hyperspectral Image Classification Based on 3-D Octave Convolution With Spatial–Spectral Attention Network , 2021, IEEE Transactions on Geoscience and Remote Sensing.

[76]  Bo Du,et al.  Deep Learning for Remote Sensing Data: A Technical Tutorial on the State of the Art , 2016, IEEE Geoscience and Remote Sensing Magazine.

[77]  Andy Way,et al.  Multi-Level Structured Self-Attentions for Distantly Supervised Relation Extraction , 2018, EMNLP.

[78]  Haiyan Guan,et al.  DA-CapsUNet: A Dual-Attention Capsule U-Net for Road Extraction from Remote Sensing Imagery , 2020, Remote Sensing.

[79]  Saman Ghaffarian,et al.  Automatic building detection based on Purposive FastICA (PFICA) algorithm using monocular high resolution Google Earth images , 2014 .

[80]  Pedram Ghamisi,et al.  Heterogeneous Transfer Learning for Hyperspectral Image Classification Based on Convolutional Neural Network , 2020, IEEE Transactions on Geoscience and Remote Sensing.

[81]  Xiangyun Hu,et al.  PGA-SiamNet: Pyramid Feature-Based Attention-Guided Siamese Network for Remote Sensing Orthoimagery Building Change Detection , 2020, Remote. Sens..

[82]  Enhua Wu,et al.  Squeeze-and-Excitation Networks , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[83]  Yanlan Wu,et al.  Identifying Pine Wood Nematode Disease Using UAV Images and Deep Learning Algorithms , 2021, Remote Sensing.

[84]  Xiangtao Zheng,et al.  Spectral–Spatial Attention Network for Hyperspectral Image Classification , 2020, IEEE Transactions on Geoscience and Remote Sensing.

[85]  Le Liang,et al.  Efficient recurrent attention network for remote sensing scene classification , 2021, IET Image Processing.

[86]  Honglin Wu,et al.  Self-Attention Network With Joint Loss for Remote Sensing Image Scene Classification , 2020, IEEE Access.

[87]  Guoyun Zhang,et al.  Compact Band Weighting Module Based on Attention-Driven for Hyperspectral Image Classification , 2021, IEEE Transactions on Geoscience and Remote Sensing.

[88]  Xiaofeng Li,et al.  Development of a Dual-Attention U-Net Model for Sea Ice and Open Water Classification on SAR Images , 2021, IEEE Geoscience and Remote Sensing Letters.

[89]  Man-On Pun,et al.  Semi-Supervised Multi-Temporal Deep Representation Fusion Network for Landslide Mapping from Aerial Orthophotos , 2021, Remote. Sens..

[90]  Kun Fu,et al.  An Anchor-Free Method Based on Feature Balancing and Refinement Network for Multiscale Ship Detection in SAR Images , 2021, IEEE Transactions on Geoscience and Remote Sensing.

[91]  Xuelong Li,et al.  Scene Classification With Recurrent Attention of VHR Remote Sensing Images , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[92]  Yiliang Zeng,et al.  Attention-Based Residual Network with Scattering Transform Features for Hyperspectral Unmixing with Limited Training Samples , 2020, Remote. Sens..

[93]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[94]  Antonio Plaza,et al.  High-Order Self-Attention Network for Remote Sensing Scene Classification , 2019, IGARSS 2019 - 2019 IEEE International Geoscience and Remote Sensing Symposium.

[95]  Zhengzhou Li,et al.  Structured Object-Level Relational Reasoning CNN-Based Target Detection Algorithm in a Remote Sensing Image , 2021, Remote. Sens..

[96]  Xingqun Qi,et al.  Deep Attention and Multi-Scale Networks for Accurate Remote Sensing Image Segmentation , 2020, IEEE Access.

[97]  João Valente,et al.  Orchard management with small unmanned aerial vehicles: a survey of sensing and analysis approaches , 2021, Precision Agriculture.

[98]  Henk Kramer,et al.  Automated crop plant counting from very high-resolution aerial imagery , 2020, Precision Agriculture.

[99]  Jie Li,et al.  SAR Image Despeckling Employing a Recursive Deep CNN Prior , 2021, IEEE Transactions on Geoscience and Remote Sensing.

[100]  Fred H. Hamker,et al.  A mechanistic cortical microcircuit of attention for amplification, normalization and suppression , 2015, Vision Research.

[101]  Fang Liu,et al.  Residual Spectral-Spatial Attention Network for Hyperspectral Image Classification , 2021, IEEE Trans. Geosci. Remote. Sens..

[102]  Shutao Li,et al.  Pixel-level image fusion: A survey of the state of the art , 2017, Inf. Fusion.

[103]  Jun Wu,et al.  A Cloud Detection Method Using Convolutional Neural Network Based on Gabor Transform and Attention Mechanism with Dark Channel Subnet for Remote Sensing Image , 2020, Remote. Sens..

[104]  Monjur Mourshed,et al.  Advances in remote sensing applications for urban sustainability , 2016, Euro-Mediterranean Journal for Environmental Integration.

[105]  Cong Bai,et al.  Hyperspectral Image Classification Using Mixed Convolutions and Covariance Pooling , 2020, IEEE Trans. Geosci. Remote. Sens..

[106]  Xianchuan Yu,et al.  Spectral–Spatial Graph Attention Network for Semisupervised Hyperspectral Image Classification , 2022, IEEE Geoscience and Remote Sensing Letters.

[107]  Jung-Woo Ha,et al.  StarGAN v2: Diverse Image Synthesis for Multiple Domains , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[108]  Yin Zhuang,et al.  FRF-Net: Land Cover Classification From Large-Scale VHR Optical Remote Sensing Images , 2020, IEEE Geoscience and Remote Sensing Letters.

[109]  Jiapeng Xiu,et al.  Dual Path Attention Net for Remote Sensing Semantic Image Segmentation , 2020, ISPRS Int. J. Geo Inf..

[110]  Norman Kerle,et al.  Remote Sensing-Based Proxies for Urban Disaster Risk Management and Resilience: A Review , 2018, Remote Sensing.

[111]  Chuanjian Wang,et al.  A method of water change monitoring in remote image time series based on long short time memory , 2021 .

[112]  Michael Meinild Nielsen,et al.  Remote sensing for urban planning and management: The use of window-independent context segmentation to extract urban features in Stockholm , 2015, Comput. Environ. Urban Syst..

[113]  Dino Ienco,et al.  Object-based multi-temporal and multi-source land cover mapping leveraging hierarchical class relationships , 2019, Remote. Sens..

[114]  Xian Sun,et al.  Terrain Segmentation in Polarimetric SAR Images Using Dual-Attention Fusion Network , 2022, IEEE Geoscience and Remote Sensing Letters.

[115]  Yakoub Bazi,et al.  SqueezeNet with Attention for Remote Sensing Scene Classification , 2020, 2020 3rd International Conference on Computer Applications & Information Security (ICCAIS).

[116]  Ran Cao,et al.  Self-Attention-Based Deep Feature Fusion for Remote Sensing Scene Classification , 2021, IEEE Geoscience and Remote Sensing Letters.

[117]  Jian Li,et al.  Multi-Head Attention with Disagreement Regularization , 2018, EMNLP.

[118]  Yang Wang,et al.  Deep Discriminative Representation Learning with Attention Map for Scene Classification , 2019, Remote. Sens..

[119]  Shuyuan Yang,et al.  NAS-Guided Lightweight Multiscale Attention Fusion Network for Hyperspectral Image Classification , 2021, IEEE Transactions on Geoscience and Remote Sensing.

[120]  Paolo Torroni,et al.  Attention in Natural Language Processing , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[121]  Shuvra S. Bhattacharyya,et al.  Hyperspectral Image Classification With Attention-Aided CNNs , 2020, IEEE Transactions on Geoscience and Remote Sensing.

[122]  Haokui Zhang,et al.  Deep learning for remote sensing image classification: A survey , 2018, WIREs Data Mining Knowl. Discov..

[123]  Lizhe Wang,et al.  High-Resolution Remote Sensing Image Scene Classification via Key Filter Bank Based on Convolutional Neural Network , 2020, IEEE Transactions on Geoscience and Remote Sensing.

[124]  Qian Hu,et al.  Non-Locally up-Down Convolutional Attention Network for Remote Sensing Image Super-Resolution , 2020, IEEE Access.

[125]  Min Yang,et al.  A graph convolutional neural network for classification of building patterns using spatial vector data , 2019, ISPRS Journal of Photogrammetry and Remote Sensing.

[126]  Licheng Jiao,et al.  Remote Sensing Scene Classification Based on Global and Local Consistent Network , 2020, IGARSS 2020 - 2020 IEEE International Geoscience and Remote Sensing Symposium.

[127]  Boli Xiong,et al.  Attention Receptive Pyramid Network for Ship Detection in SAR Images , 2020, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[128]  Lorenzo Bruzzone,et al.  LANet: Local Attention Embedding to Improve the Semantic Segmentation of Remote Sensing Images , 2021, IEEE Trans. Geosci. Remote. Sens..

[129]  Sina Mohammadi,et al.  Remote Sensing Image Classification via Improved Cross-Entropy Loss and Transfer Learning Strategy Based on Deep Convolutional Neural Networks , 2020, IEEE Geoscience and Remote Sensing Letters.

[130]  Saman Ghaffarian,et al.  An improved cluster-based snake model for automatic agricultural field boundary extraction from high spatial resolution imagery , 2019 .

[131]  Yoshua Bengio,et al.  Neural Machine Translation by Jointly Learning to Align and Translate , 2014, ICLR.

[132]  Yang Yang,et al.  Classification of Hyperspectral Image Based on Double-Branch Dual-Attention Mechanism Network , 2019, Remote. Sens..

[133]  Yuxin Peng,et al.  The application of two-level attention models in deep convolutional neural network for fine-grained image classification , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[134]  Yangyang Li,et al.  RADet: Refine Feature Pyramid Network and Multi-Layer Attention Network for Arbitrary-Oriented Object Detection of Remote Sensing Images , 2020, Remote. Sens..

[135]  Antonio Plaza,et al.  Remote Sensing Image Superresolution Using Deep Residual Channel Attention , 2019, IEEE Transactions on Geoscience and Remote Sensing.

[136]  Xiangyu Liu,et al.  Psgan: A Generative Adversarial Network for Remote Sensing Image Pan-Sharpening , 2018, 2018 25th IEEE International Conference on Image Processing (ICIP).

[137]  Haohuan Fu,et al.  Cross-regional oil palm tree counting and detection via multi-level attention domain adaptation network , 2020, ISPRS Journal of Photogrammetry and Remote Sensing.

[138]  Rohan Ramanath,et al.  An Attentive Survey of Attention Models , 2019, ACM Trans. Intell. Syst. Technol..

[139]  Saman Ghaffarian,et al.  Monitoring Urban Deprived Areas with Remote Sensing and Machine Learning in Case of Disaster Recovery , 2021, Climate.

[140]  Han Zhang,et al.  Self-Attention Generative Adversarial Networks , 2018, ICML.

[141]  Xiaoyu Dong,et al.  Remote Sensing Image Super-Resolution Using Novel Dense-Sampling Networks , 2021, IEEE Transactions on Geoscience and Remote Sensing.

[142]  Guojin He,et al.  Robust Building Extraction for High Spatial Resolution Remote Sensing Images with Self-Attention Network , 2020, Sensors.

[143]  Sven Lončarić,et al.  Attention-based Convolutional Neural Network for Computer Vision Color Constancy , 2019, 2019 11th International Symposium on Image and Signal Processing and Analysis (ISPA).

[144]  Yong Liu,et al.  Recurrent Shadow Attention Model (RSAM) for shadow removal in high-resolution urban land-cover mapping , 2020 .

[145]  Yanning Zhang,et al.  Coarse-to-Fine Satellite Images Change Detection Framework via Boundary-Aware Attentive Network , 2020, Sensors.