A Semiautomated Probabilistic Framework for Tree-Cover Delineation From 1-m NAIP Imagery Using a High-Performance Computing Architecture

Accurate tree-cover estimates are useful in deriving above-ground biomass density estimates from very high resolution (VHR) satellite imagery data. Numerous algorithms have been designed to perform tree-cover delineation in high-to-coarse-resolution satellite imagery, but most of them do not scale to terabytes of data, typical in these VHR data sets. In this paper, we present an automated probabilistic framework for the segmentation and classification of 1-m VHR data as obtained from the National Agriculture Imagery Program (NAIP) for deriving tree-cover estimates for the whole of Continental United States, using a high-performance computing architecture. The results from the classification and segmentation algorithms are then consolidated into a structured prediction framework using a discriminative undirected probabilistic graphical model based on conditional random field, which helps in capturing the higher order contextual dependence relations between neighboring pixels. Once the final probability maps are generated, the framework is updated and retrained by incorporating expert knowledge through the relabeling of misclassified image patches. This leads to a significant improvement in the true positive rates and reduction in false positive rates (FPRs). The tree-cover maps were generated for the state of California, which covers a total of 11 095 NAIP tiles and spans a total geographical area of 163 696 sq. miles. Our framework produced correct detection rates of around 88% for fragmented forests and 74% for urban tree-cover areas, with FPRs lower than 2% for both regions. Comparative studies with the National Land-Cover Data algorithm and the LiDAR high-resolution canopy height model showed the effectiveness of our algorithm for generating accurate high-resolution tree-cover maps.

[1]  Mihai Datcu,et al.  Deep learning in very high resolution remote sensing image information mining communication concept , 2012, 2012 Proceedings of the 20th European Signal Processing Conference (EUSIPCO).

[2]  Robert E. Schapire,et al.  The strength of weak learnability , 1990, Mach. Learn..

[3]  Thomas Hofmann,et al.  Predicting Structured Data (Neural Information Processing) , 2007 .

[4]  Jean Ponce,et al.  A Theoretical Analysis of Feature Pooling in Visual Recognition , 2010, ICML.

[5]  Shao-Yi Chien,et al.  Fast image segmentation based on K-Means clustering with histograms in HSV color space , 2008, 2008 IEEE 10th Workshop on Multimedia Signal Processing.

[6]  B. S. Manjunath,et al.  Modeling and Detection of Geospatial Objects Using Texture Motifs , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[7]  Horst Bischof,et al.  Semi-supervised boosting using visual similarity learning , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[8]  Ken-ichiro Muramoto,et al.  Delineation of tree crown in high resolution satellite image using circle expression and watershed algorithm , 2004, IGARSS 2004. 2004 IEEE International Geoscience and Remote Sensing Symposium.

[9]  Heekuck Oh,et al.  Neural Networks for Pattern Recognition , 1993, Adv. Comput..

[10]  Greg C. Liknes,et al.  Assessing tree cover in agricultural landscapes using high-resolution aerial imagery , 2010 .

[11]  Lawrence A. Corp,et al.  NASA Goddard's LiDAR, Hyperspectral and Thermal (G-LiHT) Airborne Imager , 2013, Remote. Sens..

[12]  A. Huete,et al.  Overview of the radiometric and biophysical performance of the MODIS vegetation indices , 2002 .

[13]  Damien Sulla-Menashe,et al.  MODIS Collection 5 global land cover: Algorithm refinements and characterization of new datasets , 2010 .

[14]  J. Wickham,et al.  Accuracy assessment of NLCD 2006 land cover and impervious surface , 2013 .

[15]  Geoffrey E. Hinton,et al.  Learning to Detect Roads in High-Resolution Aerial Images , 2010, ECCV.

[16]  Nitish Srivastava,et al.  Improving neural networks by preventing co-adaptation of feature detectors , 2012, ArXiv.

[17]  Hui Xiong,et al.  Under Consideration for Publication in Knowledge and Information Systems Object Discovery in High-resolution Remote Sensing Images: a Semantic Perspective , 2022 .

[18]  Pushmeet Kohli,et al.  Robust Higher Order Potentials for Enforcing Label Consistency , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[19]  Frank Nielsen,et al.  Statistical region merging , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  P. Gong,et al.  Object-based Detection and Classification of Vehicles from High-resolution Aerial Photography , 2009 .

[21]  D. Leckie.  Stand delineation and composition estimation using semi-automated individual tree crown analysis , 2003 .

[22]  J. Saydi,et al.  ارائه روشی سریع برای حذف اثر هوآویزها از تصاویر ماهوارهای MODIS , 2013, ISAAC 2013.

[23]  Bernard Widrow,et al.  Improving the learning speed of 2-layer neural networks by choosing initial values of the adaptive weights , 1990, 1990 IJCNN International Joint Conference on Neural Networks.

[24]  Andy Liaw,et al.  Classification and Regression by randomForest , 2007 .

[25]  Jitendra Malik,et al.  Normalized cuts and image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[26]  Douglas J. King,et al.  Automated tree crown detection and delineation in high-resolution digital camera imagery of coniferous forest regeneration , 2002 .

[27]  David A Clausi.  An analysis of co-occurrence texture statistics as a function of grey level quantization , 2002 .

[28]  Ronen Basri,et al.  Segmentation and boundary detection using multiscale intensity measurements , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[29]  George C. Hurtt,et al.  An efficient, multi-layered crown delineation algorithm for mapping individual tree structure across multiple ecosystems , 2014 .

[30]  Rick Archibald,et al.  Feature Selection and Classification of Hyperspectral Images With Support Vector Machines , 2007, IEEE Geoscience and Remote Sensing Letters.

[31]  Leo Grady,et al.  Random Walks for Image Segmentation , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[32]  Leen-Kiat Soh,et al.  Texture analysis of SAR sea ice imagery using gray level co-occurrence matrices , 1999, IEEE Trans. Geosci. Remote. Sens..

[33]  F. Gougeon.  A Crown-Following Approach to the Automatic Delineation of Individual Tree Crowns in High Spatial Resolution Aerial Images , 1995 .

[34]  Johannes R. Sveinsson,et al.  Random Forest classification of multisource remote sensing and geographic data , 2004, IGARSS 2004. 2004 IEEE International Geoscience and Remote Sensing Symposium.

[35]  J. A. Schell,et al.  Monitoring vegetation systems in the great plains with ERTS , 1973 .

[36]  Zhuowen Tu,et al.  Image Parsing: Unifying Segmentation, Detection, and Recognition , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[37]  Huseyin Gokhan Akcay,et al.  Automatic Detection of Geospatial Objects Using Multiple Hierarchical Segmentations , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[38]  Ramakant Nevatia,et al.  User assisted modeling of buildings from aerial images , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[39]  Didier Tanré,et al.  Atmospherically resistant vegetation index (ARVI) for EOS-MODIS , 1992, IEEE Trans. Geosci. Remote. Sens..

[40]  M. Pal,et al.  Random forests for land cover classification , 2003, IGARSS 2003. 2003 IEEE International Geoscience and Remote Sensing Symposium. Proceedings (IEEE Cat. No.03CH37477).

[41]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[42]  Olga Veksler,et al.  Fast Approximate Energy Minimization via Graph Cuts , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[43]  C. Tucker.  Red and photographic infrared linear combinations for monitoring vegetation , 1979 .

[44]  Christopher O. Justice,et al.  Special issue on the moderate resolution imaging spectroradiometer (MODIS): a new generation of land surface monitoring , 2002 .

[45]  S. Cornell,et al.  Random Forest characterization of upland vegetation and management burning from aerial imagery , 2009 .

[46]  J. Vogelmann,et al.  Regional Land Cover Characterization Using Landsat Thematic Mapper Data and Ancillary Data Sources , 1998 .

[47]  Andrew McCallum,et al.  Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data , 2001, ICML.

[48]  Xian Sun,et al.  Automatic Detection of Geospatial Objects Using Taxonomic Semantics , 2010, IEEE Geoscience and Remote Sensing Letters.