A dynamic learning neural network for remote sensing applications

The neural network learning process is to adjust the network weights to the selected training data. Based on the multilayer feedforward perceptron neural network, a dynamic learning algorithm (DL) is proposed. The presented learning algorithm makes use of Kalman filtering technique to update the network weights, in the sense that the stochastic characteristics of incoming data sets are implicitly incorporated into the network. The Kalman gains which represent the learning rates of the network weights are updated and calculated through the U-D factorization. By concatenating all of the network weights at each layer to form a long vector such that it can be updated without propagating back, the proposed algorithm improves in convergence substantially over the backpropagation (BP) learning algorithm. Numerical illustrations are carried out using two types of problems: multispectral image classification and surface parameter retrieval. Results indicate that the use of the Kalman filtering algorithm not only substantially improves the convergence rate in the learning stage, but also enhances the separability for problems with highly nonlinear boundaries, as compared to BP algorithm, suggesting that the proposed DL neural network provides a practical and efficient tool for remote sensing applications.<<ETX>>

[1]  Michael T. Manry,et al.  Inversion of Surface Parameters Using Fast Learning Neural Networks , 1992, [Proceedings] IGARSS '92 International Geoscience and Remote Sensing Symposium.

[2]  Panos J. Antsaklis,et al.  A simple method to derive bounds on the size and to train multilayer neural networks , 1991, IEEE Trans. Neural Networks.

[3]  D.R. Hush,et al.  Progress in supervised neural networks , 1993, IEEE Signal Processing Magazine.

[4]  Simon Haykin,et al.  Classification of radar clutter in an air traffic control environment , 1991, Proc. IEEE.

[5]  Simon A. Barton,et al.  A Matrix Method for Optimizing a Neural Network , 1991, Neural Computation.

[6]  Horst Bischof,et al.  Multispectral classification of Landsat-images using neural networks , 1992, IEEE Trans. Geosci. Remote. Sens..

[7]  Farid U. Dowla,et al.  Ship wake-detection procedure using conjugate gradient trained artificial neural networks , 1991, IEEE Trans. Geosci. Remote. Sens..

[8]  Robert J. Marks,et al.  Inversion Of Snow Parameters From Passive Microwave Remote Sensing Measurements By A Neural Network Trained With A Multiple Scattering Model , 1991, [Proceedings] IGARSS'91 Remote Sensing: Global Monitoring for Earth Management.

[9]  Michael T. Manry,et al.  Backpropagation representation theorem using power series , 1990, 1990 IJCNN International Joint Conference on Neural Networks.

[10]  P. D. Heermann,et al.  Classification of multispectral remote sensing data using a back-propagation neural network , 1992, IEEE Trans. Geosci. Remote. Sens..