Compression Supports Spatial Deep Learning

In the last decades, the domain of spatial computing became more and more data driven, especially when using remote sensing-based images. Furthermore, the satellites provide huge amounts of images, so the number of available datasets is increasing. This leads to the need for large storage requirements and high computational costs when estimating the label scene classification problem using deep learning. This consumes and blocks important hardware recourses, energy, and time. In this article, the use of aggressive compression algorithms will be discussed to cut the wasted transmission and resources for selected land cover classification problems. To compare the different compression methods and the classification performance, the satellite image patches are compressed by two methods. The first method is the image quantization of the data to reduce the bit depth. Second is the lossy and lossless compression of images with the use of image file formats, such as JPEG and TIFF. The performance of the classification is evaluated with the use of convolutional neural networks (CNNs) like VGG16. The experiments indicated that not all remote sensing image classification problems improve their performance when taking the full available information into account. Moreover, compression can set the focus on specific image features, leading to fewer storage needs and a reduction in computing time with comparably small costs in terms of quality and accuracy. All in all, quantization and embedding into file formats do support CNNs to estimate the labels of images, by strengthening the features.

[1]  Xutao Li,et al.  Unsupervised deep hashing through learning soft pseudo label for remote sensing image retrieval , 2021, Knowl. Based Syst..

[2]  Xutao Li,et al.  Multisensor Fusion and Explicit Semantic Preserving-Based Deep Hashing for Cross-Modal Remote Sensing Image Retrieval , 2022, IEEE Transactions on Geoscience and Remote Sensing.

[3]  Qiangqiang Yuan,et al.  Combined deep prior with low-rank tensor SVD for thick cloud removal in multitemporal images , 2021, ISPRS Journal of Photogrammetry and Remote Sensing.

[4]  Begüm Demir,et al.  BigEarthNet-MM: A Large-Scale, Multimodal, Multilabel Benchmark Archive for Remote Sensing Image Classification and Retrieval [Software and Data Sets] , 2021, IEEE Geoscience and Remote Sensing Magazine.

[5]  Naoto Yokoya,et al.  More Diverse Means Better: Multimodal Deep Learning Meets Remote-Sensing Imagery Classification , 2020, IEEE Transactions on Geoscience and Remote Sensing.

[6]  Lianru Gao,et al.  Graph Convolutional Networks for Hyperspectral Image Classification , 2020, IEEE Transactions on Geoscience and Remote Sensing.

[7]  Jie Li,et al.  Deep spatio-spectral Bayesian posterior for hyperspectral image non-i.i.d. noise removal , 2020, ISPRS Journal of Photogrammetry and Remote Sensing.

[8]  Haifeng Li,et al.  RSI-CB: A Large Scale Remote Sensing Image Classification Benchmark via Crowdsource Data , 2017, ArXiv.

[9]  Martin Werner,et al.  Computational Challenges for Artificial Intelligence and Machine Learning in Environmental Research , 2020, GI-Jahrestagung.

[10]  Guojian Cheng,et al.  Color Quantization Application Based on K-Means in Remote Sensing Image Processing , 2019, Journal of Physics: Conference Series.

[11]  Begüm Demir,et al.  Bigearthnet: A Large-Scale Benchmark Archive for Remote Sensing Image Understanding , 2019, IGARSS 2019 - 2019 IEEE International Geoscience and Remote Sensing Symposium.

[12]  Andreas Dengel,et al.  EuroSAT: A Novel Dataset and Deep Learning Benchmark for Land Use and Land Cover Classification , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[13]  Jie Zheng,et al.  To Compress, or Not to Compress: Characterizing Deep Learning Model Compression for Embedded Inference , 2018, 2018 IEEE Intl Conf on Parallel & Distributed Processing with Applications, Ubiquitous Computing & Communications, Big Data & Cloud Computing, Social Computing & Networking, Sustainable Computing & Communications (ISPA/IUCC/BDCloud/SocialCom/SustainCom).

[14]  Alain Léger,et al.  JPEG-1 standard 25 years: past, present, and future reasons for a success , 2018, J. Electronic Imaging.

[15]  Olga Kurasova,et al.  IMAGE CLASSIFICATION FOR JPEG COMPRESSION , 2018, Advances in Science and Technology Research Journal.

[16]  Claire Mantel,et al.  High bit depth infrared image compression via low bit depth codecs , 2017, Optical Engineering + Applications.

[17]  Gui-Song Xia,et al.  AID: A Benchmark Data Set for Performance Evaluation of Aerial Scene Classification , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[18]  Sean Leonard,et al.  Windows Image Media Types , 2016, RFC.

[19]  Lina J. Karam,et al.  Understanding how image quality affects deep neural networks , 2016, 2016 Eighth International Conference on Quality of Multimedia Experience (QoMEX).

[20]  Lorenzo Bruzzone,et al.  Hashing-Based Scalable Remote Sensing Image Search and Retrieval in Large Archives , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[21]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[22]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[23]  David A. Bader,et al.  Hierarchical Data Format , 2011, Encyclopedia of Parallel Computing.

[24]  Shawn D. Newsam,et al.  Bag-of-visual-words and spatial extensions for land-use classification , 2010, GIS '10.

[25]  Bei Xie,et al.  A novel scheme for the compression and classification of hyperspectral images , 2009, 2009 First Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing.

[26]  Gregory K. Wallace,et al.  The JPEG still picture compression standard , 1991, CACM.