Fuzzification of a Crisp Near-Real-Time Operational Automatic Spectral-Rule-Based Decision-Tree Preliminary Classifier of Multisource Multispectral Remotely Sensed Images

Proposed in recent literature, a novel two-stage stratified hierarchical hybrid remote-sensing image understanding system (RS-IUS) architecture comprises the following: 1) a first-stage pixel-based application-independent top-down (physical-model-driven and prior-knowledge-based) preliminary classifier and 2) a second-stage battery of stratified hierarchical context-sensitive application-dependent modules for class-specific feature extraction and classification. The first-stage preliminary classifier is implemented as an operational automatic near-real-time per-pixel multisource multiresolution application-independent spectral-rule-based decision-tree classifier (SRC). To the best of the author's knowledge, SRC provides the first operational example of an automatic multisensor multiresolution Earth-observation (EO) system of systems envisaged under ongoing international research programs such as the Global Earth Observation System of Systems (GEOSS) and the Global Monitoring for the Environment and Security (GMES). For the sake of simplicity, the original SRC formulation adopts crisp (hard) membership functions unsuitable for dealing with component cover classes of mixed pixels (class mixture). In this paper, the crisp (hierarchical) SRC first stage of a two-stage hybrid RS-IUS is replaced by a fuzzy (horizontal) SRC. In operational terms, a relative comparison of the fuzzy SRC against its crisp counterpart reveals that the former features the following: 1) the same degree of automation which cannot be surpassed, i.e., they are both “fully automatic”; 2) a superior map information/knowledge representation where component cover classes of mixed pixels are modeled; 3) the same robustness to changes in the input multispectral imagery acquired across time, space, and sensors; 4) a superior maintainability/scalability/reusability guaranteed by an internal horizontal (flat) modular structure independent of hierarchy; and 5) a computation time increased by 30% in a single-process single-thread implementation. This computation overload would reduce to zero in a single-process multithread implementation. In line with theory, the conclusion of this work is that the operational qualities of the fuzzy and crisp SRCs differ, but both SRCs are suitable for the development of operational automatic near-real-time multisensor satellite-based measurement systems such as those conceived as a visionary goal by the ongoing GEOSS and GMES research initiatives.

[1]  Jon Atli Benediktsson,et al.  A new approach for the morphological segmentation of high-resolution satellite imagery , 2001, IEEE Trans. Geosci. Remote. Sens..

[2]  Palma Blonda,et al.  Corrections to "Automatic Spectral Rule-Based Preliminary Classification of Radiometrically Calibrated SPOT-4/-5/IRS, AVHRR/MSG, AATSR, IKONOS/QuickBird/OrbView/GeoEye, and DMC/SPOT-1/-2 Imagery" [Mar 10 1299-1325 and 1326-1354] , 2010, IEEE Trans. Geosci. Remote. Sens..

[3]  C. C. Lautenbacher,et al.  The global earth observation system of systems (GEOSS) , 2005, 2005 IEEE International Symposium on Mass Storage Systems and Technology.

[4]  Rui Seara,et al.  Image segmentation by histogram thresholding using fuzzy sets , 2002, IEEE Trans. Image Process..

[5]  L. Wald,et al.  Fusion of satellite images of different spatial resolutions: Assessing the quality of resulting images , 1997 .

[6]  A. D. Gregorio,et al.  Land Cover Classification System (LCCS): Classification Concepts and User Manual , 2000 .

[7]  Benjamin L Turner Land Change Science , 2004 .

[8]  A QUALITY ASSURANCE FRAMEWORK FOR EARTH OBSERVATION: OPERATIONAL GUIDELINES , 2009 .

[9]  Luciano Alparone,et al.  A global quality measurement of pan-sharpened multispectral imagery , 2004, IEEE Geoscience and Remote Sensing Letters.

[10]  J. Mollon Color vision. , 1982, Annual review of psychology.

[11]  Geoffrey J. Hay,et al.  Object-based Image Analysis : Strengths , Weaknesses , Opportunities and Threats ( Swot ) , 2006 .

[12]  Palma Blonda,et al.  Automatic Spectral-Rule-Based Preliminary Classification of Radiometrically Calibrated SPOT-4/-5/IRS, AVHRR/MSG, AATSR, IKONOS/QuickBird/OrbView/GeoEye, and DMC/SPOT-1/-2 Imagery—Part I: System Design and Implementation , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[13]  Fangju Wang,et al.  Fuzzy supervised classification of remote sensing images , 1990 .

[14]  Philip H. Swain,et al.  Remote Sensing: The Quantitative Approach , 1981, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Andrea Baraldi,et al.  Impact of Radiometric Calibration and Specifications of Spaceborne Optical Imaging Sensors on the Development of Operational Automatic Remote Sensing Image Understanding Systems , 2009, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[16]  S. M. Williams,et al.  Central Visual Pathways , 2001 .

[17]  Piero Zamperoni,et al.  Plus ça va, moins ça va , 1996, Pattern Recognit. Lett..

[18]  J. Bergen,et al.  A four mechanism model for threshold spatial vision , 1979, Vision Research.

[19]  David A. Clausi,et al.  SAR Sea-Ice Image Analysis Based on Iterative Region Growing Using Semantics , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[20]  Takashi Matsuyama,et al.  SIGMA: A Knowledge-Based Aerial Image Understanding System , 1990 .

[21]  Timothy F. Cootes,et al.  Statistical models of appearance for computer vision , 1999 .

[22]  Giles M. Foody,et al.  Status of land cover classification accuracy assessment , 2002 .

[23]  W. Kaydos,et al.  Operational Performance Measurement , 1998 .

[24]  Nikhil R. Pal,et al.  Land cover classification using fuzzy rules and aggregation of contextual information through evidence theory , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[25]  Isabelle Bloch,et al.  Fuzzy spatial relation ontology for image interpretation , 2008, Fuzzy Sets Syst..

[26]  Andrea Baraldi,et al.  Operational Two-Stage Stratified Topographic Correction of Spaceborne Multispectral Imagery Employing an Automatic Spectral-Rule-Based Decision-Tree Preliminary Classifier , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[27]  Jon Sticklen,et al.  Knowledge-based segmentation of Landsat images , 1991, IEEE Trans. Geosci. Remote. Sens..

[28]  Richard Geoffrey White,et al.  Comparing the performance of SAR image segmentation algorithms , 1992 .

[29]  Jon Atli Benediktsson,et al.  Classification of remote sensing images from urban areas using a fuzzy possibilistic model , 2006, IEEE Geoscience and Remote Sensing Letters.

[30]  Russell G. Congalton,et al.  Assessing the accuracy of remotely sensed data : principles and practices , 1998 .

[31]  Heinrich Niemann,et al.  Semantic Networks for Understanding Scenes , 1997, Advances in Computer Vision and Machine Intelligence.

[32]  Ozy Sjahputera,et al.  GeoCDX: An Automated Change Detection & Exploitation System for High Resolution Satelite Imagery , 2008, IGARSS 2008 - 2008 IEEE International Geoscience and Remote Sensing Symposium.

[33]  A. Strahler MODIS Land Cover Product Algorithm Theoretical Basis Document (ATBD) Version 5.0 , 1994 .

[34]  Curt H. Davis,et al.  A combined fuzzy pixel-based and object-based approach for classification of high-resolution multispectral data over urban areas , 2003, IEEE Trans. Geosci. Remote. Sens..

[35]  Andrea Baraldi,et al.  Operational Performance of an Automatic Preliminary Spectral Rule-Based Decision-Tree Classifier of Spaceborne Very High Resolution Optical Images , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[36]  Ursula C. Benz,et al.  Measures of classification accuracy based on fuzzy similarity , 2000, IEEE Trans. Geosci. Remote. Sens..

[37]  Robert A. Lordo,et al.  Learning from Data: Concepts, Theory, and Methods , 2001, Technometrics.

[38]  Lutz Prechelt,et al.  A quantitative study of experimental evaluations of neural network learning algorithms: Current research practice , 1996, Neural Networks.

[39]  Guoqing Zhou,et al.  Future intelligent Earth observing satellites , 2003, SPIE Optics + Photonics.

[40]  Palma Blonda,et al.  Automatic Spectral Rule-Based Preliminary Classification of Radiometrically Calibrated SPOT-4/-5/IRS, AVHRR/MSG, AATSR, IKONOS/QuickBird/OrbView/GeoEye, and DMC/SPOT-1/-2 Imagery—Part II: Classification Accuracy Assessment , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[41]  Leo Maurice Hurvich,et al.  Color vision , 1981 .

[42]  A. Bovik,et al.  A universal image quality index , 2002, IEEE Signal Processing Letters.

[43]  Anil K. Jain,et al.  Statistical Pattern Recognition: A Review , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[44]  Y. V. Venkatesh,et al.  On the classification of multispectral satellite images using the multilayer perceptron , 2003, Pattern Recognit..

[45]  T. M. Lillesand,et al.  Remote Sensing and Image Interpretation , 1980 .

[46]  Giles M. Foody,et al.  Approaches for the production and evaluation of fuzzy land cover classifications from remotely-sensed data , 1996 .

[47]  C. Woodcock,et al.  Theory and methods for accuracy assessment of thematic maps using fuzzy sets , 1994 .

[48]  IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, VOL. 34. NO. 4, JULY 1996 Universal Multifractal Scaling of Synthetic , 1996 .

[49]  Chi-Ren Shyu,et al.  GeoIRIS: Geospatial Information Retrieval and Indexing System—Content Mining, Semantics Modeling, and Complex Queries , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[50]  Meilir Page-Jones,et al.  The practical guide to structured systems design , 1980 .

[51]  Curt H. Davis,et al.  A hierarchical fuzzy classification approach for high-resolution multispectral data over urban areas , 2003, IEEE Trans. Geosci. Remote. Sens..

[52]  F. Nencini,et al.  A New Method for MS + Pan Image Fusion Assessment Without Reference , 2006, 2006 IEEE International Symposium on Geoscience and Remote Sensing.

[53]  Thomas Esch,et al.  Improvement of Image Segmentation Accuracy Based on Multiscale Optimization Procedure , 2008, IEEE Geoscience and Remote Sensing Letters.

[54]  John P. McDermott,et al.  Rule-Based Interpretation of Aerial Imagery , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[55]  Elisabetta Binaghi,et al.  A fuzzy set-based accuracy assessment of soft classification , 1999, Pattern Recognit. Lett..

[56]  George J. Klir,et al.  Fuzzy sets, uncertainty and information , 1988 .

[57]  Lawrence E. McGovern Global Earth Observation System of Systems , 2010 .

[58]  S. Liang Quantitative Remote Sensing of Land Surfaces , 2003 .

[59]  Lorenzo Bruzzone,et al.  Automatic Spectral Rule-Based Preliminary Mapping of Calibrated Landsat TM and ETM+ Images , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[60]  Isabelle Bloch Information combination operators for data fusion: a comparative review with classification , 1996, IEEE Trans. Syst. Man Cybern. Part A.

[61]  R. Lunetta,et al.  Remote Sensing Change Detection: Environmental Monitoring Methods and Applications , 1999 .

[62]  Ozy Sjahputera,et al.  GeoCDX: An Automated Change Detection and Exploitation System for High-Resolution Satellite Imagery , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[63]  Eric R. Kandel,et al.  Perception of motion, depth and form , 2000 .