Probabilistic neural networks (PNN) are the instruments of choice when it comes to critical decision making. Indeed, their output is not a simple yes-or-no decision; they are able to produce the probability that the features received as their input correspond to an object of any one of many classes. In work reported elsewhere, we have devised such a network for the discrimination of aircrafts from their decoy flares. It is very efficient, consistently exhibiting a recognition success rate of the order of 98-99%. However, because these neural networks are based on the Parzen-windows method, they must contain a very large number of neurons in order to be efficient. This can represent a serious disadvantage when they are to be incorporated in a real time system. It is thus advantageous to be able to reduce their size, without affecting appreciably their performance. We report in this article on the success we have had with adapting and applying an Orthogonal Least Squares (OLS) reduction method to the probabilistic neural network we built previously. We show that this method allows for a reduction of the number of neurons by as much as 81.9% with a decrease in performance of only 0.6%. Even a drastic reduction of 97.7% of number of neurons still produces a network with a 93.5% success rate. A side benefit of the application of this method to PNNs, is an ordered list of the images that the neural network considers as the best representatives of their class of objects.
[1]
T. Bayes.
An essay towards solving a problem in the doctrine of chances
,
2003
.
[2]
Andre Morin,et al.
Adaptive spatial filtering techniques for the detection of targets in infrared imaging seekers
,
2000,
Defense, Security, and Sensing.
[3]
D. F. Specht,et al.
Probabilistic neural networks for classification, mapping, or associative memory
,
1988,
IEEE 1988 International Conference on Neural Networks.
[4]
Donald F. Specht,et al.
Probabilistic neural networks
,
1990,
Neural Networks.
[5]
E. Parzen.
On Estimation of a Probability Density Function and Mode
,
1962
.
[6]
Shang-Liang Chen,et al.
Orthogonal least squares learning algorithm for radial basis function networks
,
1991,
IEEE Trans. Neural Networks.
[7]
Patrice Cayouette,et al.
Probabilistic neural networks for infrared imaging target discrimination
,
2003,
SPIE Defense + Commercial Sensing.