Big Remote Sensing Image Classification Based on Deep Learning Extraction Features and Distributed Spark Frameworks

Big data analysis assumes a significant role in Earth observation using remote sensing images, since the explosion of data images from multiple sensors is used in several fields. The traditional data analysis techniques have different limitations on storing and processing massive volumes of data. Besides, big remote sensing data analytics demand sophisticated algorithms based on specific techniques to store to process the data in real-time or in near real-time with high accuracy, efficiency, and high speed. In this paper, we present a method for storing a huge number of heterogeneous satellite images based on Hadoop distributed file system (HDFS) and Apache Spark. We also present how deep learning algorithms such as VGGNet and UNet can be beneficial to big remote sensing data processing for feature extraction and classification. The obtained results prove that our approach outperforms other methods.

[1]  Imed Riadh Farah,et al.  A BIG REMOTE SENSING DATA ANALYSIS USING DEEP LEARNING FRAMEWORK , 2019 .

[2]  Ameet Talwalkar,et al.  MLlib: Machine Learning in Apache Spark , 2015, J. Mach. Learn. Res..

[3]  P. Taheri Using Inclusive Language in the Applied-Science Academic Environments , 2020, Technium Social Sciences Journal.

[4]  Derek T. Anderson,et al.  Comprehensive survey of deep learning in remote sensing: theories, tools, and challenges for the community , 2017 .

[5]  Xueliang Zhang,et al.  Deep learning in remote sensing applications: A meta-analysis and review , 2019, ISPRS Journal of Photogrammetry and Remote Sensing.

[6]  Yao Yao,et al.  Sensing Urban Land-Use Patterns By Integrating Google Tensorflow And Scene-Classification Models , 2017, The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences.

[7]  Peter Goldsborough,et al.  A Tour of TensorFlow , 2016, ArXiv.

[8]  Gui-Song Xia,et al.  Dirichlet-Derived Multiple Topic Scene Classification Model for High Spatial Resolution Remote Sensing Imagery , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[9]  Luisa Verdoliva,et al.  Land Use Classification in Remote Sensing Images by Convolutional Neural Networks , 2015, ArXiv.

[10]  Jie Geng,et al.  High-Resolution SAR Image Classification via Deep Convolutional Autoencoders , 2015, IEEE Geoscience and Remote Sensing Letters.

[11]  Naoto Yokoya,et al.  More Diverse Means Better: Multimodal Deep Learning Meets Remote-Sensing Imagery Classification , 2020, IEEE Transactions on Geoscience and Remote Sensing.

[12]  Wei Huang,et al.  In-Memory Parallel Processing of Massive Remotely Sensed Data Using an Apache Spark on Hadoop YARN Model , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[13]  Gui-Song Xia,et al.  Transferring Deep Convolutional Neural Networks for the Scene Classification of High-Resolution Remote Sensing Imagery , 2015, Remote. Sens..

[14]  Dongmei Huang,et al.  EFFICIENT STORAGE METHOD FOR MASSIVE REMOTE SENSING IMAGE VIA SPARK-BASED PYRAMID MODEL , 2017 .

[15]  Xue-wen Chen,et al.  Big Data Deep Learning: Challenges and Perspectives , 2014, IEEE Access.

[16]  Bingsheng He,et al.  A Survey on Spark Ecosystem for Big Data Processing , 2018, ArXiv.

[17]  Bingsheng He,et al.  A Survey on Spark Ecosystem: Big Data Processing Infrastructure, Machine Learning, and Applications , 2022, IEEE Transactions on Knowledge and Data Engineering.

[18]  Kiran Adnan,et al.  An analytical study of information extraction from unstructured and multidimensional big data , 2019, Journal of Big Data.

[19]  Thao Nguyen,et al.  Satellite image classification using convolutional learning , 2013 .

[20]  Ali Mostafaeipour,et al.  Investigating the performance of Hadoop and Spark platforms on machine learning algorithms , 2020, The Journal of Supercomputing.

[21]  Martín Abadi,et al.  TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems , 2016, ArXiv.

[22]  Nataliia Kussul,et al.  Deep Learning Classification of Land Cover and Crop Types Using Remote Sensing Data , 2017, IEEE Geoscience and Remote Sensing Letters.

[23]  Dongyao Wu,et al.  Building Pipelines for Heterogeneous Execution Environments for Big Data Processing , 2016, IEEE Software.

[24]  Xiaohui Yuan,et al.  A review of deep learning methods for semantic segmentation of remote sensing imagery , 2021, Expert Syst. Appl..

[25]  Gui-Song Xia,et al.  AID: A Benchmark Data Set for Performance Evaluation of Aerial Scene Classification , 2016, IEEE Transactions on Geoscience and Remote Sensing.