Evaluation of Neural Pattern Classifiers for a Remote Sensing Application

This paper evaluates the classification accuracy of three neural network classifiers on a satellite image-based pattern classification problem. The neural network classifiers used include two types of the Multi-Layer-Perceptron (MLP) and the Radial Basis Function Network. A normal (conventional) classifier is used as a benchmark to evaluate the performance of neural network classifiers. The satellite image consists of 2,460 pixels selected from a section (270 x 360) of a Landsat-5 TM scene from the city of Vienna and its northern surroundings. In addition to evaluation of classification accuracy, the neural classifiers are analysed for generalization capability and stability of results. Best overall results (in terms of accuracy and convergence time) are provided by the MLP-1 classifier with weight elimination. It has a small number of parameters and requires no problem-specific system of initial weight values. Its in-sample classification error is 7.87% and its out-of-sample classification error is 10.24% for the problem at hand. Four classes of simulations serve to illustrate the properties of the classifier in general and the stability of the result with respect to control parameters, and on the training time, the gradient descent control term, initial parameter conditions, and different training and testing sets.

[1]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[2]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[3]  H. White Some Asymptotic Results for Learning in Single Hidden-Layer Feedforward Network Models , 1989 .

[4]  John Scott Bridle,et al.  Probabilistic Interpretation of Feedforward Classification Network Outputs, with Relationships to Statistical Pattern Recognition , 1989, NATO Neurocomputing.

[5]  Jon Atli Benediktsson,et al.  Neural Network Approaches Versus Statistical Methods in Classification of Multisource Remote Sensing Data , 1989, 12th Canadian Symposium on Remote Sensing Geoscience and Remote Sensing Symposium,.

[6]  J. Key,et al.  Classification of merged AVHRR and SMMR Arctic data with neural networks , 1989 .

[7]  George F. Hepner,et al.  Artificial neural network classification using a minimal training set - Comparison to conventional supervised classification , 1990 .

[8]  Ronald M. Welch,et al.  A neural network approach to cloud classification , 1990 .

[9]  Anders Krogh,et al.  Introduction to the theory of neural computation , 1994, The advanced book program.

[10]  D. Rumelhart,et al.  Predicting sunspots and exchange rates with connectionist networks , 1991 .

[11]  P. D. Heermann,et al.  Classification of multispectral remote sensing data using a back-propagation neural network , 1992, IEEE Trans. Geosci. Remote. Sens..

[12]  Horst Bischof,et al.  Multispectral classification of Landsat-images using neural networks , 1992, IEEE Trans. Geosci. Remote. Sens..

[13]  Andreas S. Weigend,et al.  John A. Hertz, Anders S. Krogh, Richard G. Palmer, Introduction to the Theory of Neural Computation , 1993, Artif. Intell..

[14]  Daniel L. Civco,et al.  Artificial Neural Networks for Land-Cover Classification and Mapping , 1993, Int. J. Geogr. Inf. Sci..

[15]  Yehuda Salu,et al.  Classification of multispectral image data by the binary diamond neural network and by nonparametric, pixel-by-pixel methods , 1993, IEEE Trans. Geosci. Remote. Sens..

[16]  P. Dreyer Classification of land cover using optimized neural nets on SPOT data , 1993 .

[17]  Achilleas Zapranis,et al.  Stock performance modeling using neural networks: A comparative study with regression models , 1994, Neural Networks.

[18]  Andreas S. Weigend,et al.  Time Series Prediction: Forecasting the Future and Understanding the Past , 1994 .

[19]  Manfred M. Fischer,et al.  ARTIFICIAL NEURAL NETWORKS: A NEW APPROACH TO MODELING INTERREGIONAL TELECOMMUNICATION FLOWS* , 1994 .

[20]  Kanellopoulos Ioannis,et al.  Integration of Neural and Statistical Approaches in Spatial-Data Classification , 1995 .