Feature Selection Using a Multilayer Perceptron

The problem of selecting the best set of features for target r ecognition using a multilayer perceptron is addressed in this paper. A technique has been developed which analyzes the weights in a multilayer perceptron to determine which features the network finds important and which are unimportant. A brief introduction to the use of multilayer perceptrons for classification and the training rules available is followed by the mathematical development of the saliency measure for multilayer perceptrons. The tec hnique is applied to two different image databases and is found to be consistent with statistical techniques and independent of the network initial conditions. The saliency measure is the n used to compare the results of two different training rules on a target recognition problem.

[1]  A. Barron,et al.  Statistical properties of artificial neural networks , 1989, Proceedings of the 28th IEEE Conference on Decision and Control,.

[2]  Sharad Singhal,et al.  Training Multilayer Perceptrons with the Extende Kalman Algorithm , 1988, NIPS.

[3]  Richard O. Duda,et al.  Pattern classification and scene analysis , 1974, A Wiley-Interscience publication.

[4]  Josef Kittler,et al.  Pattern recognition : a statistical approach , 1982 .

[5]  P. Werbos,et al.  Beyond Regression : "New Tools for Prediction and Analysis in the Behavioral Sciences , 1974 .

[6]  Robert B. McGhee,et al.  Aircraft Identification by Moment Invariants , 1977, IEEE Transactions on Computers.

[7]  J. P. Mills,et al.  Target recognition: Conventional and neural network approaches , 1989, International 1989 Joint Conference on Neural Networks.

[8]  George Cybenko,et al.  Approximation by superpositions of a sigmoidal function , 1989, Math. Control. Signals Syst..

[9]  Patrick K. Simpson,et al.  Artificial Neural Systems: Foundations, Paradigms, Applications, and Implementations , 1990 .

[10]  Donald H. Foley Considerations of sample and feature size , 1972, IEEE Trans. Inf. Theory.

[11]  Steven K. Rogers,et al.  An Approach To Multiple Sensor Target Detection , 1989, Defense, Security, and Sensing.