Using Neural Networks for Classification Tasks – Some Experiments on Datasets and Practical Advice

This paper gives a general introduction to neural networks, and then provides a more detailed description of one type of neural network, namely the multi-layer perceptron. Four experiments on datasets are then reported. These compare the performance of a multi-layer perceptron with induced decision trees, and show some of the strengths of neural networks. A further dataset is then used to demonstrate some of the problems which may occur if there are insufficient data. The paper concludes with some general practical advice.

[1]  Igor Aleksander,et al.  Introduction to Neural Computing , 1990 .

[2]  Lawrence D. Jackel,et al.  Large Automatic Learning, Rule Extraction, and Generalization , 1987, Complex Syst..

[3]  B. Irie,et al.  Capabilities of three-layered perceptrons , 1988, IEEE 1988 International Conference on Neural Networks.

[4]  Richard P. Lippmann,et al.  An introduction to computing with neural nets , 1987 .

[5]  R. M. Holdaway.  Enhancing supervised learning algorithms via self-organization , 1989, International 1989 Joint Conference on Neural Networks.

[6]  Patrick K. Simpson,et al.  Artificial Neural Systems: Foundations, Paradigms, Applications, and Implementations , 1990 .

[7]  John Mingers,et al.  Expert Systems—Rule Induction with Statistical Data , 1987 .

[8]  Leo Breiman,et al.  Classification and Regression Trees , 1984 .

[9]  Judith E. Dayhoff,et al.  Neural Network Architectures: An Introduction , 1989 .

[10]  Naftali Tishby,et al.  Consistent inference of probabilities in layered networks: predictions and generalizations , 1989, International 1989 Joint Conference on Neural Networks.

[11]  Philip D. Wasserman,et al.  Neural computing - theory and practice , 1989 .

[12]  Jeremy Wyatt,et al.  Connectionist models in medicine: an investigation of their potential , 1989, AIME.

[13]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[14]  John Mingers,et al.  Expert Systems—Experiments with Rule Induction , 1986 .

[15]  Thomas Jackson,et al.  Neural Computing - An Introduction , 1990 .

[16]  A Hart,et al.  Evaluating black-boxes as medical decision aids: issues arising from a study of neural networks. , 1990, Medical informatics = Medecine et informatique.

[17]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .