Deep and machine learnings of remotely sensed imagery and its multi-band visual features for detecting oil palm plantation

Characterization of oil palm plantation is a crucial step toward many geographical based management strategies, ranging from determining regional planting and appropriate species to irrigation and logistics planning. Accurate and most updated plantation identification enables well informed and effective measures for such schemes. This paper proposes a computerized method for detecting oil-palm plantation from remotely sensed imagery. Unlike other existing approaches, where imaging features were retrieved from spectral data and then trained with a machine learning box for region of interest extraction, this paper employed 2-stage detection. Firstly, a deep learning network was employed to determine a presence of oil-palm plantation in a generic Google satellite image. With irrelevant samples being disregarded and thus the problem space being so contained, the images with detected oil-palm had their plantation delineated at higher accuracy by using a support vector machine, based on Gabor texture descriptor. The proposed coupled detection-delineation was benchmarked against different feature descriptors and state-of-the-art supervised and unsupervised machine learning techniques. The validation was made by comparing the extraction results with those ground surveyed by an authority. It was shown in the experiments that it could detect and delineate the plantations with an accuracy of 92.29% and precision, recall and Kappa of 91.16%, 84.97%, and 0.81, respectively.

[1]  Jürgen Böhner,et al.  A novel approach in monitoring land-cover change in the tropics: oil palm cultivation in the Niger Delta, Nigeria , 2016 .

[2]  Christoph Busch,et al.  Fingerprint Area Detection in Fingerprint Images Based on Enhanced Gabor Filtering , 2010, FGIT-DTA/BSBT.

[3]  Nikos Komodakis,et al.  Building detection in very high resolution multispectral data with deep learning features , 2015, 2015 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[4]  Lei Yu,et al.  Gabor texture representation method for face recognition using the Gamma and generalized Gaussian models , 2010, Image Vis. Comput..

[5]  Rui Xu,et al.  A New Method for Extraction of Residential Areas from Multispectral Satellite Imagery , 2016, ECC.

[6]  D. Gabor,et al.  Theory of communication. Part 1: The analysis of information , 1946 .

[7]  Lawrence D. Jackel,et al.  Backpropagation Applied to Handwritten Zip Code Recognition , 1989, Neural Computation.

[8]  Emmanuel Prouff,et al.  Breaking Cryptographic Implementations Using Deep Learning Techniques , 2016, SPACE.

[9]  Konstantinos Karantzalos,et al.  Deep Learning-Based Man-Made Object Detection from Hyperspectral Data , 2015, ISVC.

[10]  Xiaogang Wang,et al.  DeepFashion: Powering Robust Clothes Recognition and Retrieval with Rich Annotations , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  H. Tjandrasa,et al.  Identification of oil palm plantation in IKONOS images using radially averaged power spectrum values , 2015, 2015 International Conference on Information & Communication Technology and Systems (ICTS).

[12]  J. R. Landis,et al.  The measurement of observer agreement for categorical data. , 1977, Biometrics.

[13]  Hassan Ghassemian,et al.  Fast GLCM and Gabor Filters for Texture Classification of Very High Resolution Remote Sensing Images , 2015 .

[14]  Shiaofen Fang,et al.  Medical volume segmentation using bank of Gabor filters , 2009, SAC '09.

[15]  Kenneth Grogan,et al.  A Review of the Application of Optical and Radar Remote Sensing Data Fusion to Land Use Mapping and Monitoring , 2016, Remote. Sens..

[16]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  Edward Chung,et al.  Road Feature Extraction from High Resolution Aerial Images Upon Rural Regions Based on Multi-Resolution Image Analysis and Gabor Filters , 2012 .

[18]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[19]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[20]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.

[21]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[22]  Saman A. Zonouz,et al.  CloudID: Trustworthy cloud-based and cross-enterprise biometric identification , 2015, Expert Syst. Appl..

[23]  Amy Loutfi,et al.  Classification and Segmentation of Satellite Orthoimagery Using Convolutional Neural Networks , 2016, Remote. Sens..

[24]  Likhit Waranon,et al.  Development of automatic G/T measurement program for THAICHOTE ground station , 2016, 2016 International Symposium on Antennas and Propagation (ISAP).

[25]  Weijia Li,et al.  Deep Learning Based Oil Palm Tree Detection and Counting for High-Resolution Remote Sensing Images , 2016, Remote. Sens..

[26]  Soffiana Agustin,et al.  OIL PALM AGE CLASSIFICATION ON SATELLITE IMAGERY USING FRACTAL-BASED COMBINATION 1 , 2016 .

[27]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[28]  Scott F. Heron,et al.  Thermal and Radar Overview , 2013 .

[29]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.

[30]  Isaac Kwesi Nooni,et al.  Support vector machine to map oil palm in a heterogeneous environment , 2014 .

[31]  Asmala Ahmad,et al.  REMOTE SENSING TECHNIQUES FOR OIL PALM AGE CLASSIFICATION USING LANDSAT-5 TM SATELLITE , 2014 .

[32]  Morteza Zahedi,et al.  Combining Gabor filter and FFT for fingerprint enhancement based on a regional adaption method and automatic segmentation , 2015, Signal Image Video Process..

[33]  H. Carrão,et al.  Land cover classification in Portugal with multitemporal AWiFS images: a comparative study. , 2009 .

[34]  Li Li,et al.  Mapping Oil Palm Plantations in Cameroon Using PALSAR 50-m Orthorectified Mosaic Images , 2015, Remote. Sens..

[35]  Joanne C. White,et al.  Forest Monitoring Using Landsat Time Series Data: A Review , 2014 .

[36]  Dong Liang,et al.  Comparison and Fusion of Multispectral and Panchromatic IKONOS Images Using Different Algorithms , 2015, GRMSE.

[37]  I. Busu,et al.  Segmentation of oil palm area based on GLCM-SVM and NDVI , 2014, 2014 IEEE REGION 10 SYMPOSIUM.

[38]  Thomas Brox,et al.  Learning to Generate Chairs, Tables and Cars with Convolutional Networks , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[39]  Jianzhong Guo,et al.  Gabor-Filtering-Based Completed Local Binary Patterns for Land-Use Scene Classification , 2015, 2015 IEEE International Conference on Multimedia Big Data.

[40]  B. Griscom,et al.  Biomass estimations and carbon stock calculations in the oil palm plantations of African derived savannas using IKONOS data , 2004 .

[41]  Cem Unsalan,et al.  Urban area detection using gabor features and spatial voting , 2009, 2009 IEEE 17th Signal Processing and Communications Applications Conference.

[42]  Yichun Xie,et al.  Remote sensing imagery in vegetation mapping: a review , 2008 .

[43]  Manchun Li,et al.  River Detection in Remotely Sensed Imagery Using Gabor Filtering and Path Opening , 2015, Remote. Sens..

[44]  Preesan Rakwatin,et al.  Oil Palm Tree Detection with High Resolution Multi-Spectral Satellite Imagery , 2014, Remote. Sens..

[45]  Helmi Zulhaidi Mohd Shafri,et al.  Young and mature oil palm tree detection and counting using convolutional neural network deep learning method , 2019, International Journal of Remote Sensing.

[46]  William J. Christmas,et al.  When Face Recognition Meets with Deep Learning: An Evaluation of Convolutional Neural Networks for Face Recognition , 2015, 2015 IEEE International Conference on Computer Vision Workshop (ICCVW).

[47]  Lian Pin Koh,et al.  Detecting industrial oil palm plantations on Landsat images with Google Earth Engine , 2016 .

[48]  Tal Hassner,et al.  Age and gender classification using convolutional neural networks , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).