Two-Group Classification Using Neural Networks*

Artificial neural networks are new methods for classification. We investigate two important issues in building neural network models; network architecture and size of training samples. Experiments were designed and carried out on two-group classification problems to find answers to these model building questions. The first experiment deals with selection of architecture and sample size for different classification problems. Results show that choice of architecture and choice of sample size depend on the objective: to maximize the classification rate of training samples, or to maximize the generalizability of neural networks. The second experiment compares neural network models with classical models such as linear discriminant analysis and quadratic discriminant analysis, and nonparametric methods such as k-nearest-neighbor and linear programming. Results show that neural networks are comparable to, if not better than, these other methods in terms of classification rates in the training samples but not in the test samples.

[1]  N. Capon.  Credit Scoring Systems: A Critical Analysis , 1982 .

[2]  S. M. Bajgier,et al.  AN EXPERIMENTAL COMPARISON OF STATISTICAL AND LINEAR PROGRAMMING APPROACHES TO THE DISCRIMINANT PROBLEM , 1982 .

[3]  Richard P. Lippmann,et al.  An introduction to computing with neural nets , 1987 .

[4]  Terrence J. Sejnowski,et al.  Analysis of hidden units in a layered network trained to classify sonar targets , 1988, Neural Networks.

[5]  R. Fisher.  THE STATISTICAL UTILIZATION OF MULTIPLE MEASUREMENTS , 1938 .

[6]  E. Joachimsthaler,et al.  Solving the Classification Problem in Discriminant Analysis Via Linear and Nonlinear Programming Methods , 1989 .

[7]  Venkat Subramanian,et al.  A GRG2-Based System for Training Neural Networks: Design and Computational Experience , 1993, INFORMS J. Comput..

[8]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[9]  Ralph A. Walkling,et al.  Predicting Tender Offer Success: A Logistic Analysis , 1985, Journal of Financial and Quantitative Analysis.

[10]  Ming-Tak Leung,et al.  Fingerprint processing using back propagation neural networks , 1990, 1990 IJCNN International Joint Conference on Neural Networks.

[11]  Ming S. Hung,et al.  A neural network approach to the classification problem , 1990 .

[12]  David M. Himmelblau,et al.  Incipient fault detection and diagnosis using artificial neural networks , 1990, 1990 IJCNN International Joint Conference on Neural Networks.

[13]  C. A. Smith.  Some examples of discrimination. , 1947, Annals of eugenics.

[14]  Fred Glover,et al.  Applications and Implementation , 1981 .

[15]  Edward P. Markowski,et al.  SOME DIFFICULTIES AND IMPROVEMENTS IN APPLYING LINEAR PROGRAMMING FORMULATIONS TO THE DISCRIMINANT PROBLEM , 1985 .

[16]  R. Y. Awh,et al.  A Discriminant Analysis of Economic, Demographic, and Attitudinal Characteristics of Bank Charge-Card Holders: A Case Study , 1974 .

[17]  P. Rubin.  A Comparison of Linear Programming and Parametric Approaches to the Two‐Group Discriminant Problem* , 1990 .

[18]  Ned Freed,et al.  EVALUATING ALTERNATIVE LINEAR PROGRAMMING MODELS TO SOLVE THE TWO-GROUP DISCRIMINANT PROBLEM , 1986 .

[19]  Michael Y. Hu,et al.  An experimental evaluation of neural networks for classification , 1993, Comput. Oper. Res..

[20]  W. Pitts,et al.  A Logical Calculus of the Ideas Immanent in Nervous Activity (1943) , 2021, Ideas That Created the Future.

[21]  W. Gehrlein.  General mathematical programming formulations for the statistical classification problem , 1986 .

[22]  Melody Y. Kiang,et al.  Managerial Applications of Neural Networks: The Case of Bank Failure Predictions , 1992 .

[23]  Patrick M. Shea,et al.  Operational experience with a neural network in the detection of explosives in checked airline luggage , 1990, 1990 IJCNN International Joint Conference on Neural Networks.