Dimensionality Reduction in Data Mining Using Artificial Neural Networks

The use of classic dimension reduction techniques can be considered customary practice within the context of data mining (DM). Nevertheless, although artificial neural networks (ANNs) are one of the most important DM techniques, specific ANN architectures for dimensionality reduction, such as the principal components analysis ANN (PCA-ANN) and the linear auto-associative ANN (LA-ANN), are used on far fewer occasions. In this study, categorical principal component analysis (CATPCA) and the two ANN procedures are studied and compared searching for uniqueness in an applied context relative to personality variables and drug consumption. A sample of 7,030 adolescents completed a personality test made up of 20 dichotomous items with a hypothesized four-factor latent model. Results point out that both ANN factor solutions converge to those obtained using CATPCA. Nevertheless, possible drawbacks of the ANN techniques lie in their relatively complex application, as well as in the need to use visual graphic analysi...

[1]  Sandro Nicole,et al.  Feedforward neural networks for principal components extraction , 2000 .

[2]  Garrison W. Cottrell,et al.  Image compression by back-propagation: An example of extensional programming , 1988 .

[3]  Kurt Hornik,et al.  Neural networks and principal component analysis: Learning from examples without local minima , 1989, Neural Networks.

[4]  Anders Krogh,et al.  Introduction to the theory of neural computation , 1994, The advanced book program.

[5]  Terence D. Sanger,et al.  Optimal unsupervised learning in a single-layer linear feedforward neural network , 1989, Neural Networks.

[6]  Albert Sesé,et al.  Psychometric Measurement Models and Artificial Neural Networks , 2004 .

[7]  Erkki Oja,et al.  Neural Networks, Principal Components, and Subspaces , 1989, Int. J. Neural Syst..

[8]  J. Ariel Sirat,et al.  A Fast Neural Algorithm for Principal Component Analysis and Singular Value Decomposition , 1991, Int. J. Neural Syst..

[9]  Albert Sesé,et al.  Designing an artificial neural network for forecasting tourism time series , 2006 .

[10]  V Krajca,et al.  Extraction of principal components from biosignals by neural net. , 1999, Technology and health care : official journal of the European Society for Engineering and Medicine.

[11]  Juha Karhunen,et al.  Generalizations of principal component analysis, optimization problems, and neural networks , 1995, Neural Networks.

[12]  K L White,et al.  Technology and health care. , 1972, The New England journal of medicine.

[13]  Jiawei Han,et al.  Data Mining: Concepts and Techniques , 2000 .

[14]  I. Jolliffe,et al.  Nonlinear Multivariate Analysis , 1992 .

[15]  Juan José,et al.  Redes neuronales artificiales aplicadas al análisis de datos , 2002 .

[16]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[17]  M. Hill,et al.  Nonlinear Multivariate Analysis. , 1990 .

[18]  Philipp Slusallek,et al.  Introduction to real-time ray tracing , 2005, SIGGRAPH Courses.

[19]  Xavier Calbet,et al.  Use of multilayer feedforward neural nets as a display method for multidimensional distributions , 1995, Int. J. Neural Syst..

[20]  Erkki Oja,et al.  Principal components, minor components, and linear neural networks , 1992, Neural Networks.

[21]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[22]  E. Oja.  Simplified neuron model as a principal component analyzer , 1982, Journal of mathematical biology.

[23]  Christopher M. Bishop,et al.  Neural networks for pattern recognition , 1995 .

[24]  N. E. Sharkey,et al.  Models of cognition : a review of cognitive science , 1989 .

[25]  Daniel T. Larose,et al.  Data mining methods and models , 2006 .

[26]  Akira Iwata,et al.  Performance evaluation of BP and PCA neural networks for ECG data compression , 1993, Proceedings of 1993 International Conference on Neural Networks (IJCNN-93-Nagoya, Japan).

[27]  Erkki Oja,et al.  Subspace methods of pattern recognition , 1983 .