A Comparison of Discriminant Analysis versus Artificial Neural Networks

Artificial Neural Network (ANN) techniques have recently been applied to many different fields and have demonstrated their capabilities in solving complex problems. In a business environment, the techniques have been applied to predict bond ratings and stock price performance. In these applications, ANN techniques outperformed widely-used multivariate statistical techniques. The purpose of this paper is to compare the ANN method with the Discriminant Analysis (DA) method in order to understand the merits of ANN that are responsible for the higher level of performance. The paper provides an overview of the basic concepts of ANN techniques in order to enhance the understanding of this emerging technique. The similarities and differences between ANN and DA techniques in representing their models are described. This study also proposes a method to overcome the limitations of the ANN approach, Finally, a case study using a data set in a business environment demonstrates the superiority of ANN over DA as a method of classification of observations.

[1]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[2]  D. W. Roncek,et al.  Discrete Discriminant Analysis. , 1979 .

[3]  Teuvo Kohonen,et al.  Self-Organization and Associative Memory , 1988 .

[4]  Stephen Grossberg,et al.  A massively parallel architecture for a self-organizing neural pattern recognition machine , 1988, Comput. Vis. Graph. Image Process..

[5]  Terrence J. Sejnowski,et al.  Analysis of hidden units in a layered network trained to classify sonar targets , 1988, Neural Networks.

[6]  Kenji Baba,et al.  Explicit representation of knowledge acquired from plant historical data using neural network , 1990, 1990 IJCNN International Joint Conference on Neural Networks.

[7]  Soumitra Dutta,et al.  Bond rating: A non-conservative application of neural networks , 1988 .

[8]  Dean A. Pomerleau,et al.  What's hidden in the hidden layers? , 1989 .

[9]  Geoffrey E. Hinton,et al.  A time-delay neural network architecture for isolated word recognition , 1990, Neural Networks.

[10]  Richard A. Johnson,et al.  Applied Multivariate Statistical Analysis , 1983 .

[11]  Gregory L. Murphy,et al.  Psychological concepts in a parallel system , 1986 .

[12]  B Kosko,et al.  Adaptive bidirectional associative memories. , 1987, Applied optics.

[13]  D. Treigueiros,et al.  The application of neural network based methods to the extraction of knowledge from accounting reports , 1991, Proceedings of the Twenty-Fourth Annual Hawaii International Conference on System Sciences.

[14]  Bernard Widrow,et al.  Adaptive switching circuits , 1988 .

[15]  D. Moore.  Evaluation of Five Discrimination Procedures for Binary Variables , 1973 .