Accurate crop-type classification using multi-temporal optical and multi-polarization SAR data in an object-based image analysis framework

ABSTRACT Accurate crop-type classification is a challenging task due, primarily, to the high within-class spectral variations of individual crops during the growing season (phenological development) and, second, to the high between-class spectral similarity of crop types. Utilizing within-season multi-temporal optical and multi-polarization synthetic aperture radar (SAR) data, this study introduces a combined object- and pixel-based image classification methodology for accurate crop-type classification. Particularly, the study investigates the improvement of crop-type classification by using the least number of multi-temporal RapidEye (RE) images and multi-polarization Radarsat-2 (RS-2) data utilized in an object- and pixel-based image analysis framework. The method was tested on a study area in Manitoba, Canada, using three different classifiers including the standard Maximum Likelihood (ML), Decision Tree (DT), and Random Forest (RF) classifiers. Using only two RE images of July and August, the proposed method results in overall accuracies (OAs) of about 95%, 78%, and 93% for the ML, DT, and RF classifiers, respectively. Moreover, the use of only two quad-pol images of RS-2 of June and September resulted in OAs of 92%, 75%, and 90% for the ML, DT, and RF classifiers, respectively. The best classification results were achieved by the synergistic use of two RE and two RS-2 images. In this case, the overall classification accuracies were 97% for both ML and RF classifiers. In addition, the average producer’s accuracies of 95% and 96% were achieved by the ML and RF classifiers, respectively, whereas the average user accuracy was 94% for both classifiers. The results indicated promising potentials for rapid and cost-effective local-scale crop-type classification using a limited number of high-resolution optical and multi-polarization SAR images. Very accurate classification results can be considered as a replacement for sampling the agricultural fields at the local scale. The result of this very accurate classification at discrete locations (approximately 25 × 25 km frames) can be applied in a separate procedure to increase the accuracy of crop area estimation at the regional to provincial scale by linking these local very accurate spatially discrete results to national wall-to-wall continuous crop classification maps.

[1]  C. Brodley,et al.  Decision tree classification of land cover from remotely sensed data , 1997 .

[2]  Y. Ban Synergy of multitemporal ERS-1 SAR and Landsat TM data for classification of agricultural crops , 2003 .

[3]  Giles M. Foody,et al.  Crop classification from C-band polarimetric radar data , 1994 .

[4]  W. Feller,et al.  An Introduction to Probability Theory and Its Application. , 1951 .

[5]  Sue E. Nokes,et al.  Using High Spatial Resolution Multispectral Data to Classify Corn and Soybean Crops , 2000 .

[6]  Adam C. Winstanley,et al.  Segmentation performance evaluation for object-based remotely sensed image analysis , 2010 .

[7]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[8]  Gallego Pinilla Francisco Review of the Main Remote Sensing Methods for Crop Area Estimates , 2007 .

[9]  R. Touzi,et al.  Polarimetric decomposition with RADARSAT-2 for rice mapping and monitoring , 2012 .

[10]  F. J. Gallego Remote sensing and land cover area estimation , 2004 .

[11]  Russell G. Congalton,et al.  Assessing the accuracy of remotely sensed data : principles and practices , 1998 .

[12]  Heather McNairn,et al.  Integration of optical and Synthetic Aperture Radar (SAR) imagery for delivering operational annual crop inventories , 2009 .

[13]  M. Maloley,et al.  METHODOLOGY FOR A CANADIAN AGRICULTURAL LAND COVER CLASSIFICATION , 2006 .

[14]  Fisette AAFC Annual Crop Inventory Status and Challenges , 2013 .

[15]  P. Sivakumar,et al.  A REVIEW ON IMAGE SEGMENTATION TECHNIQUES , 2016 .

[16]  Yun Zhang,et al.  A Combined Object-and Pixel-Based Image Analysis Framework for Urban Land Cover Classification of VHR Imagery , 2013 .

[17]  Xavier Blaes,et al.  Efficiency of crop identification based on optical and SAR image time series , 2005 .

[18]  Henning Skriver,et al.  Crop Classification by Multitemporal C- and L-Band Single- and Dual-Polarization and Fully Polarimetric SAR , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[19]  Lucy Marshall,et al.  Object-oriented crop classification using multitemporal ETM+ SLC-off imagery and random forest , 2013 .

[20]  Arno Schäpe,et al.  Multiresolution Segmentation : an optimization approach for high quality multi-scale image segmentation , 2000 .

[21]  Dionys Forster,et al.  Mapping diversified peri-urban agriculture – potential of object-based versus per-field land cover/land use classification , 2010 .

[22]  J. Kovacs,et al.  Object-oriented crop mapping and monitoring using multi-temporal polarimetric RADARSAT-2 data , 2014 .

[23]  B. Brisco,et al.  Multidate SAR/TM synergism for crop classification in western Canada , 1995 .

[24]  Lena Vogler,et al.  Computer Processing Of Remotely Sensed Images An Introduction , 2016 .

[25]  Jong-Sen Lee,et al.  Polarimetric SAR speckle filtering and its implication for classification , 1999, IEEE Trans. Geosci. Remote. Sens..

[26]  Bahram Daneshfar,et al.  Annual space-based crop inventory for Canada: 2009–2014 , 2014, 2014 IEEE Geoscience and Remote Sensing Symposium.

[27]  Fabio Del Frate,et al.  Crop classification using multiconfiguration C-band SAR data , 2003, IEEE Trans. Geosci. Remote. Sens..

[28]  W. Cohen,et al.  Land cover mapping in an agricultural setting using multiseasonal Thematic Mapper data , 2001 .

[29]  John A. Richards,et al.  Remote Sensing Digital Image Analysis: An Introduction , 1999 .

[30]  G. F. Hughes,et al.  On the mean accuracy of statistical pattern recognizers , 1968, IEEE Trans. Inf. Theory.

[31]  Frieke Van Coillie,et al.  Synergy of very high resolution optical and radar data for object-based olive grove mapping , 2011, Int. J. Geogr. Inf. Sci..

[32]  William Feller,et al.  An Introduction to Probability Theory and Its Applications , 1967 .

[33]  H. Ewe,et al.  Agricultural crop-type classification of multi-polarization SAR images using a hybrid entropy decomposition and support vector machine technique , 2011 .

[34]  Mario Chica-Olmo,et al.  An assessment of the effectiveness of a random forest classifier for land-cover classification , 2012 .

[35]  M. J. Pringle,et al.  SUPPORT VECTOR MACHINE CLASSIFICATION OF OBJECT-BASED DATA FOR CROP MAPPING, USING MULTI-TEMPORAL LANDSAT IMAGERY , 2012 .

[36]  Jong-Min Yeom,et al.  Effect of red-edge and texture features for object-based paddy rice crop classification using RapidEye multi-spectral satellite image data , 2014 .

[37]  Paul M. Mather,et al.  An assessment of the effectiveness of decision tree methods for land cover classification , 2003 .

[38]  Dirk H. Hoekman,et al.  A new polarimetric classification approach evaluated for agricultural crops , 2003, IEEE Trans. Geosci. Remote. Sens..

[39]  M. Varshosaz,et al.  Projection Pursuit and Lowpass Filtering for Preprocessing of Hypespectral Images , 2008 .

[40]  E. Pottier,et al.  Polarimetric Radar Imaging: From Basics to Applications , 2009 .

[41]  V Dey Image Segmentation Techniques for Urban Land Cover Segmentation of VHR Imagery: Recent Developments and Future Prospects , 2013 .

[42]  Johannes R. Sveinsson,et al.  Random Forest Classification of Remote Sensing Data , 2006 .

[43]  Heather McNairn,et al.  Contribution of Multi-Frequency, Multi-Sensor, and Multi-Temporal Radar Data to Operational Annual Crop Mapping , 2008, IGARSS 2008 - 2008 IEEE International Geoscience and Remote Sensing Symposium.

[44]  Ming Zhong,et al.  Object-Based Classification of Urban Areas Using VHR Imagery and Height Points Ancillary Data , 2012, Remote. Sens..

[45]  R. J. Brown,et al.  Providing crop information using RADARSAT-1 and satellite optical imagery , 2002 .

[46]  U. Benz,et al.  Multi-resolution, object-oriented fuzzy analysis of remote sensing data for GIS-ready information , 2004 .

[47]  P. Mather,et al.  Crop discrimination using multi-temporal SAR imagery , 1999 .

[48]  Leo Breiman,et al.  Bagging Predictors , 1996, Machine Learning.

[49]  Jingfeng Huang,et al.  Fully Polarimetric Synthetic Aperture Radar (SAR) Processing for Crop Type Identification , 2015 .

[50]  Yong Pang,et al.  Quantitative Evaluation of Polarimetric Classification for Agricultural Crop Mapping , 2007 .

[51]  William J. Emery,et al.  Comparing Statistical and Neural Network Methods Applied to Very High Resolution Satellite Images Showing Changes in Man-Made Structures at Rocky Flats , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[52]  Bahram Salehi,et al.  A Review of the Effectiveness of Spatial Information used in Urban Land Cover Classification of VHR Imagery , 2012 .

[53]  V. Simonneaux,et al.  The use of high‐resolution image time series for crop classification and evapotranspiration estimate over an irrigated area in central Morocco , 2008 .

[54]  Heather McNairn,et al.  Towards operational radar-only crop type classification: comparison of a traditional decision tree with a random forest classifier , 2012 .

[55]  Christian Heipke,et al.  Conditional Random Fields for Multitemporal and Multiscale Classification of Optical Satellite Imagery , 2015, IEEE Transactions on Geoscience and Remote Sensing.