Multisource Classification Using Support Vector Machines: An Empirical Comparison with Decision Tree and Neural Network Classifiers

Remote sensing image classification has proven to be attractive for extracting useful thematic information such as landcover. However, often for a given application, spectral information acquired by a remote sensing sensor may not be sufficient to derive accurate information. Incorporation of data from other sources such as a digital elevation model (DEM), and geophysical and geological data may assist in achieving more accurate land-cover classification from remote sensing images. Recently, support vector machines (SVM) have been proposed as an alternative for classification of remote sensing data, and the results are promising. In this paper, we employ the SVM algorithm to perform multisource classification. An IRS‐1C LISS III image along with normalized differenced vegetation index (NDVI) image and DEM are used to produce a land-cover classification for a region in the Himalayas. The accuracy of SVM-based multisource classification is compared with several other nonparametric algorithms namely a decision tree classifier, and back propagation and radial basis function neural network classifiers. The well-known kappa coefficient of agreement is used to assess classification accuracy. The differences in the kappa coefficient of classifiers have been statistically evaluated using a pairwise Z-test. The results show a significant increase in the accuracy of the SVM based classifier on incorporation of ancillary data over classification performed solely on the basis of spectral data from remote sensing sensors.

[1]  Lorenzo Bruzzone,et al.  A Novel Transductive SVM for Semisupervised Classification of Remote-Sensing Images , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[2]  Pramod K. Varshney,et al.  HYPERSPECTRAL IMAGE CLASSIFICATION USING SUPPORT VECTOR MACHINES: A COMPARISON WITH DECISION TREE AND NEURAL NETWORK CLASSIFIERS , 2005 .

[3]  Manoj K. Arora,et al.  Land Cover Classification Using IRS LISS III Image and DEM in a Rugged Terrain: A Case Study in Himalayas , 2005 .

[4]  Paul M. Mather,et al.  Support vector machines for classification in remote sensing , 2005 .

[5]  Giles M. Foody,et al.  Toward intelligent training of supervised image classifications: directing training data acquisition for SVM classification , 2004 .

[6]  Lorenzo Bruzzone,et al.  Classification of hyperspectral remote sensing images with support vector machines , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[7]  Giles M. Foody,et al.  A relative evaluation of multiclass image classification by support vector machines , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[8]  G. Foody Thematic map comparison: Evaluating the statistical significance of differences in classification accuracy , 2004 .

[9]  Johannes R. Sveinsson,et al.  Support vector machines in multisource classification , 2003, IGARSS 2003. 2003 IEEE International Geoscience and Remote Sensing Symposium. Proceedings (IEEE Cat. No.03CH37477).

[10]  Johannes R. Sveinsson,et al.  Multisource remote sensing data classification based on consensus and pruning , 2003, IEEE Trans. Geosci. Remote. Sens..

[11]  Lorenzo Bruzzone,et al.  Image fusion techniques for remote sensing applications , 2002, Inf. Fusion.

[12]  L. S. Davis,et al.  An assessment of support vector machines for land cover classi(cid:142) cation , 2002 .

[13]  P. Mather,et al.  Classification Methods for Remotely Sensed Data , 2001 .

[14]  Shashank Mathur,et al.  Multi-source Classification Using Artificial Neural Network in a Rugged Terrain , 2001 .

[15]  David R. Musicant,et al.  Lagrangian Support Vector Machines , 2001, J. Mach. Learn. Res..

[16]  Nello Cristianini,et al.  An Introduction to Support Vector Machines and Other Kernel-based Learning Methods , 2000 .

[17]  Robert E. Schapire,et al.  A Brief Introduction to Boosting , 1999, IJCAI.

[18]  Lorenzo Bruzzone,et al.  A neural-statistical approach to multitemporal and multisource remote-sensing image classification , 1999, IEEE Trans. Geosci. Remote. Sens..

[19]  Lorenzo Bruzzone,et al.  A technique for the selection of kernel-function parameters in RBF neural networks for classification of remote-sensing images , 1999, IEEE Trans. Geosci. Remote. Sens..

[20]  Russell G. Congalton,et al.  Assessing the accuracy of remotely sensed data : principles and practices , 1998 .

[21]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[22]  P. Atkinson,et al.  Introduction Neural networks in remote sensing , 1997 .

[23]  Giles M. Foody,et al.  An evaluation of some factors affecting the accuracy of classification by an artificial neural network , 1997 .

[24]  R. DeFries,et al.  Classification trees: an alternative to traditional land cover classifiers , 1996 .

[25]  Robert A. Schowengerdt,et al.  A review and analysis of backpropagation neural networks for classification of remotely-sensed multi-spectral imagery , 1995 .

[26]  Giles M. Foody,et al.  Land Cover Classification by an Artificial Neural Network with Ancillary Information , 1995, Int. J. Geogr. Inf. Sci..

[27]  金田 重郎,et al.  C4.5: Programs for Machine Learning (書評) , 1995 .

[28]  D. Peddle,et al.  Multi-Source Image Classification II: An Empirical Comparison of Evidential Reasoning and Neural Network Approaches , 1994 .

[29]  R. W. Fitzgerald,et al.  Assessing the classification accuracy of multisource remote sensing data , 1994 .

[30]  J. Ross Quinlan,et al.  C4.5: Programs for Machine Learning , 1992 .

[31]  David H. Wolpert,et al.  Stacked generalization , 1992, Neural Networks.

[32]  David A. Landgrebe,et al.  A survey of decision tree classifier methodology , 1991, IEEE Trans. Syst. Man Cybern..

[33]  John A. Richards,et al.  Knowledge-based techniques for multi-source classification , 1990 .

[34]  Roger G. Barry,et al.  Cloud classification from satellite data using a fuzzy sets algorithm - A polar example , 1989 .

[35]  J. D. Powell,et al.  Radial basis function approximations to polynomials , 1989 .

[36]  R. Fletcher Practical Methods of Optimization , 1988 .

[37]  William H. Anderson,et al.  EVALUATION OF FACTORS AFFECTING SUPPORT VECTOR MACHINES FOR HYPERSPECTRAL CLASSIFICATION , 2004 .

[38]  Raghuveer M. Rao,et al.  Overview of Image Processing , 2004 .

[39]  Manoj K. Arora,et al.  Support Vector Machines for Classification of Multi- and Hyperspectral Data , 2004 .

[40]  Livier,et al.  REMOTE SENSING CLASSIFICATION OF SPECTRAL , SPATIAL AND CONTEXTUAL DATA USING MULTIPLE CLASSIFIER SYSTEMS , 2001 .

[41]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[42]  G. E. Berrios,et al.  . New York: Cambridge , 2000 .

[43]  Robert F. Cromp,et al.  Support Vector Machine Classifiers as Applied to AVIRIS Data , 1999 .

[44]  John A. Richards,et al.  Remote Sensing Digital Image Analysis: An Introduction , 1999 .

[45]  Christine Pohl,et al.  Multisensor image fusion in remote sensing: concepts, methods and applications , 1998 .

[46]  J. D. Paola,et al.  The Effect of Neural-Network Structure on a Multispectral Land-Use/Land-Cover Classification , 1997 .

[47]  Vladimir Vapnik,et al.  The Nature of Statistical Learning , 1995 .

[48]  W. Light Ridge Functions, Sigmoidal Functions and Neural Networks , 1993 .

[49]  M. J. D. Powell,et al.  Radial basis functions for multivariable interpolation: a review , 1987 .

[50]  John R. Jensen,et al.  Introductory Digital Image Processing: A Remote Sensing Perspective , 1986 .

[51]  G. H. Rosenfield,et al.  A coefficient of agreement as a measure of thematic classification accuracy. , 1986 .