Learning Optimal Kernel from Distance Metric in Twin Kernel Embedding for Dimensionality Reduction and Visualization of Fingerprints

Biometric data like fingerprints are often highly structured and of high dimension. The "curse of dimensionality" poses great challenge to subsequent pattern recognition algorithms including neural networks due to high computational complexity. A common approach is to apply dimensionality reduction (DR) to project the original data onto a lower dimensional space that preserves most of the useful information. Recently, we proposed Twin Kernel Embedding (TKE) that processes structured or non-vectorial data directly without vectorization. Here, we apply this method to clustering and visualizing fingerprints in a 2-dimensional space. It works by learning an optimal kernel in the latent space from a distance metric defined on the input fingerprints instead of a kernel. The outputs are the embeddings of the fingerprints and a kernel Gram matrix in the latent space that can be used in subsequent learning procedures like Support Vector Machine (SVM) for classification or recognition. Experimental results confirmed the usefulness of the proposed method.

[1]  Li Liao,et al.  Combining pairwise sequence similarity and support vector machines for remote protein homology detection , 2002, RECOMB '02.

[2]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[3]  Junbin Gao,et al.  Visualization of Non-vectorial Data Using Twin Kernel Embedding , 2006, 2006 International Workshop on Integrating AI and Data Mining.

[4]  Robert A. Lordo,et al.  Learning from Data: Concepts, Theory, and Methods , 2001, Technometrics.

[5]  Dexin Zhang,et al.  DCT-Based Iris Recognition , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  James M. Keller,et al.  Fuzzy Measures on the Gene Ontology for Gene Product Similarity , 2006, IEEE/ACM Transactions on Computational Biology and Bioinformatics.

[7]  Jian Yang,et al.  Globally Maximizing, Locally Minimizing: Unsupervised Discriminant Projection with Applications to Face and Palm Biometrics , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  N. Davey,et al.  Dimensionality reduction of face images for gender classification , 2004, 2004 2nd International IEEE Conference on 'Intelligent Systems'. Proceedings (IEEE Cat. No.04EX791).

[9]  Heng Tao Shen,et al.  Principal Component Analysis , 2009, Encyclopedia of Biometrics.

[10]  Junbin Gao,et al.  On a Class of Support Vector Kernels Based on Frames in Function Hilbert Spaces , 2001, Neural Computation.

[11]  Dexin Zhang,et al.  Correction to "DCT-Based Iris Recognition" , 2007, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  J. Tenenbaum,et al.  A global geometric framework for nonlinear dimensionality reduction. , 2000, Science.

[13]  Junbin Gao,et al.  A multi-step strategy for approximate similarity search in image databases , 2006, ADC.

[14]  Qiang Ji,et al.  Modeling and Predicting Face Recognition System Performance Based on Analysis of Similarity Scores , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Lydia E. Kavraki,et al.  A dimensionality reduction approach to modeling protein flexibility , 2002, RECOMB '02.

[16]  Fan Chung,et al.  Spectral Graph Theory , 1996 .

[17]  Mikhail Belkin,et al.  Laplacian Eigenmaps for Dimensionality Reduction and Data Representation , 2003, Neural Computation.

[18]  L Sirovich,et al.  Low-dimensional procedure for the characterization of human faces. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[19]  Junbin Gao,et al.  Fingerprint Matching using Enhanced Shape Context , 2006 .

[20]  Junbin Gao,et al.  Kernel Laplacian Eigenmaps for Visualization of Non-vectorial Data , 2006, Australian Conference on Artificial Intelligence.

[21]  Honggang Zhang,et al.  Comments on "Globally Maximizing, Locally Minimizing: Unsupervised Discriminant Projection with Application to Face and Palm Biometrics" , 2007, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  A. Atiya,et al.  Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond , 2005, IEEE Transactions on Neural Networks.

[23]  John K. Tsotsos,et al.  Face recognition with weighted locally linear embedding , 2005, The 2nd Canadian Conference on Computer and Robot Vision (CRV'05).

[24]  Vladimir Cherkassky,et al.  Learning from Data: Concepts, Theory, and Methods , 1998 .

[25]  Daniel D. Lee,et al.  Learning nonlinear appearance manifolds for robot localization , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[26]  Wei-Ying Ma,et al.  Learning an image manifold for retrieval , 2004, MULTIMEDIA '04.

[27]  Abdul Sattar,et al.  AI 2006: Advances in Artificial Intelligence, 19th Australian Joint Conference on Artificial Intelligence, Hobart, Australia, December 4-8, 2006, Proceedings , 2006, Australian Conference on Artificial Intelligence.

[28]  Horst Bunke,et al.  Edit distance-based kernel functions for structural pattern classification , 2006, Pattern Recognit..