Pattern Recognition Method Using Independent Components for Each Class

Applications of independent component analysis (ICA) to feature extraction have been a topic of research interest. However, the effectiveness of pattern features extracted by conventional ICA algorithms greatly depends on datasets in general. As one of the reasons, we have pointed out that conventional ICA features are obtained by increasing only their independence even if class information is available. In this paper, we propose a supervised learning approach to ICA to extract useful and robust features. The proposed method consists of several modules, each of which is responsible for extracting features for each class and identifying the class labels using the k nearest neighbor classifier. All the module outputs are combined to identify final results based on a majority rule. We evaluate the performance of the proposed method in several recognition tasks. From these results, we confirm the effectiveness of the recognition method using independent components for each class.

[1]  E. Oja,et al.  Independent Component Analysis , 2001 .

[2]  Marian Stewart Bartlett,et al.  Face recognition by independent component analysis , 2002, IEEE Trans. Neural Networks.

[3]  Manabu Kotani,et al.  Feature extraction using supervised independent component analysis by maximizing class distance , 2002, Proceedings of the 9th International Conference on Neural Information Processing, 2002. ICONIP '02..

[4]  Chong-Ho Choi,et al.  Feature Extraction Using ICA , 2001, ICANN.

[5]  Juha Karhunen,et al.  Local Linear Independent Component Analysis Based on Clustering , 2000, Int. J. Neural Syst..

[6]  Terrence J. Sejnowski,et al.  ICA Mixture Models for Unsupervised Classification of Non-Gaussian Classes and Automatic Context Switching in Blind Signal Separation , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Aapo Hyvärinen,et al.  Emergence of Phase- and Shift-Invariant Features by Decomposition of Natural Images into Independent Feature Subspaces , 2000, Neural Computation.

[8]  Manabu Kotani,et al.  Signal Processing of Speech Using Independent Component Analysis Based on Information Maximization Algorithm , 2000 .

[9]  Seiichi Ozawa,et al.  A Study of Feature Extraction and Selection Using Independent Component Analysis , 2000 .

[10]  J. Nazuno Haykin, Simon. Neural networks: A comprehensive foundation, Prentice Hall, Inc. Segunda Edición, 1999 , 2000 .

[11]  Norio Baba,et al.  Application of independent component analysis to handwritten Japanese character recognition , 1999, IJCNN'99. International Joint Conference on Neural Networks. Proceedings (Cat. No.99CH36339).

[12]  Mark A. Girolami,et al.  Self-Organising Neural Networks: Independent Component Analysis and Blind Source Separation , 1999 .

[13]  Kurt Hornik,et al.  Using independent component analysis for feature extraction and multivariate data projection , 1998 .

[14]  Terrence J. Sejnowski,et al.  The “independent components” of natural scenes are edge filters , 1997, Vision Research.

[15]  Terrence J. Sejnowski,et al.  Learning Nonlinear Overcomplete Representations for Efficient Coding , 1997, NIPS.

[16]  Andrew D. Back,et al.  A First Application of Independent Component Analysis to Extracting Structure from Stock Returns , 1997, Int. J. Neural Syst..

[17]  D. Chakrabarti,et al.  A fast fixed - point algorithm for independent component analysis , 1997 .

[18]  David J. Field,et al.  Emergence of simple-cell receptive field properties by learning a sparse code for natural images , 1996, Nature.

[19]  T J Sejnowski,et al.  Learning the higher-order structure of a natural sound. , 1996, Network.

[20]  Terrence J. Sejnowski,et al.  An Information-Maximization Approach to Blind Separation and Blind Deconvolution , 1995, Neural Computation.

[21]  Satosi Watanabe,et al.  Pattern Recognition: Human and Mechanical , 1985 .