Partially supervised classification of remote sensing images using SVM-based probability density estimation

A general problem of supervised remotely. sensed image classification assumes prior knowledge to be available for all thematic classes that are present in the considered data set. However, the ground truth map representing this prior knowledge usually does not really, describe all the land cover typologies in the image and the generation of a complete training set represents a time-consuming, difficult and expensive task. This problem may play a relevant role in remote sensing data analysis, since it affects the classification performances of supervised classifiers, which erroneously assign each sample drawn from an unknown class to one of the known classes. In the present paper, a classification strategy is proposed, which allows the identification of samples drawn from unknown classes, through the application of a suitable Bayesian decision rule. The proposed approach is based on support vector machines (SVMs) for the estimation of probability density, functions and on a recursive procedure to generate prior probabilities estimates for both known and unknown classes. For experimental purposes, both a synthetic data set and two real data sets are employed.

[1]  Keinosuke Fukunaga,et al.  Introduction to Statistical Pattern Recognition , 1972 .

[2]  John A. Richards,et al.  Remote Sensing Digital Image Analysis , 1986 .

[3]  Alexander J. Smola,et al.  Support Vector Method for Function Approximation, Regression Estimation and Signal Processing , 1996, NIPS.

[4]  D. W. Scott,et al.  Biased and Unbiased Cross-Validation in Density Estimation , 1987 .

[5]  J. Weston,et al.  Support vector density estimation , 1999 .

[6]  Farid Dahdouh-Guebas,et al.  Remote Sensing Digital Image Analysis : an introduction, 1999, J.A. Richard & X. Jia, eds., Springer-Verlag, Berlin, Germany, 363 pp. , 2001 .

[7]  R. Redner,et al.  Mixture densities, maximum likelihood, and the EM algorithm , 1984 .

[8]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[9]  Mark L. G. Althouse,et al.  Least squares subspace projection approach to mixed pixel classification for hyperspectral images , 1998, IEEE Trans. Geosci. Remote. Sens..

[10]  C. K. Chow,et al.  On optimum recognition error and reject tradeoff , 1970, IEEE Trans. Inf. Theory.

[11]  David G. Stork,et al.  Pattern classification, 2nd Edition , 2000 .

[12]  Bernhard Schölkopf,et al.  A tutorial on support vector regression , 2004, Stat. Comput..

[13]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[14]  David A. Landgrebe,et al.  Partially supervised classification using weighted unsupervised clustering , 1999, IEEE Trans. Geosci. Remote. Sens..

[15]  Keinosuke Fukunaga,et al.  Introduction to statistical pattern recognition (2nd ed.) , 1990 .

[16]  E. Parzen On Estimation of a Probability Density Function and Mode , 1962 .

[17]  J. Mercer Functions of positive and negative type, and their connection with the theory of integral equations , 1909 .

[18]  J. Tinsley Oden,et al.  Applied functional analysis , 1996 .

[19]  Gabriele Moser,et al.  Supervised classification of remote sensing images with unknown classes , 2002, IEEE International Geoscience and Remote Sensing Symposium.

[20]  B. Gorte,et al.  Non-parametric classification algorithm with an unknown class , 1995, Proceedings of International Symposium on Computer Vision - ISCV.

[21]  Gilles Celeux,et al.  On Stochastic Versions of the EM Algorithm , 1995 .

[22]  Yee-Hong Yang,et al.  Classifier design with incomplete knowledge , 1998, Pattern Recognit..

[23]  Bernard Dubuisson,et al.  A statistical decision rule with incomplete knowledge about classes , 1993, Pattern Recognit..

[24]  Alfred Stein,et al.  Bayesian classification and class area estimation of satellite images using stratification , 1998, IEEE Trans. Geosci. Remote. Sens..

[25]  Julius T. Tou,et al.  Pattern Recognition Principles , 1974 .

[26]  New York Dover,et al.  ON THE CONVERGENCE PROPERTIES OF THE EM ALGORITHM , 1983 .

[27]  Anil K. Jain,et al.  Unsupervised Learning of Finite Mixture Models , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[28]  Gilles Celeux,et al.  A Component-Wise EM Algorithm for Mixtures , 2001, 1201.5913.

[29]  David G. Stork,et al.  Pattern Classification , 1973 .

[30]  David G. Stork,et al.  Pattern Classification (2nd ed.) , 1999 .

[31]  Nello Cristianini,et al.  An Introduction to Support Vector Machines and Other Kernel-based Learning Methods , 2000 .

[32]  Sebastiano B. Serpico,et al.  Multisource data classification with dependence trees , 2002, IEEE Trans. Geosci. Remote. Sens..