AN IMPROVEMENT TO THE NEAREST NEIGHBOR CLASSIFIER AND F ACE RECOGNITION EXPERIMENTS

The conventional nearest neighbor classier (NNC) directly exploits the dis- tances between the test sample and training samples to perform classication. NNC independently evaluates the distance between the test sample and a training sample. In this paper, we propose to use the classication procedure of sparse representation to im- prove NNC. The proposed method has the following basic idea: the training samples are not uncorrelated and the \distance" between the test sample and a training sample should not be independently calculated and should take into account the relationship between dif- ferent training samples. The proposed methodrst uses a linear combination of all the training samples to represent the test sample and then exploits modied \distance" to classify the test sample. The method obtains the coefficients of the linear combination by solving a linear system. The method then calculates the distance between the test sample and the result of multiplying each training sample by the corresponding coefficient and assumes that the test sample is from the same class as the training sample that has the minimum distance. The method elaborately modies NNC and considers the relationship between different training samples, so it is able to produce a higher classication accu- racy. A large number of face recognition experiments on three face image databases show that the maximum difference between the accuracies of the proposed method and NNC is greater than 10%.

[1]  Wenming Zheng,et al.  Fuzzy two-dimensional local graph embedding discriminant analysis (F2DLGEDA) with its application to face and palm biometrics , 2013, Neural Computing and Applications.

[2]  Qi Zhu,et al.  A simple and fast representation-based face recognition method , 2013, Neural Computing and Applications.

[3]  Hui Li,et al.  IMPROVING THE B3LYP ABSORPTION ENERGIES BY USING THE NEURAL NETWORK ENSEMBLE AND K-NEAREST NEIGHBOR APPROACH , 2011 .

[4]  Guillermo Sapiro,et al.  Sparse Representation for Computer Vision and Pattern Recognition , 2010, Proceedings of the IEEE.

[5]  Hideyuki Imai,et al.  Probably correct k-nearest neighbor search in high dimensions , 2010, Pattern Recognit..

[6]  Sabah Jassim,et al.  Image-Quality-Based Adaptive Face Recognition , 2010, IEEE Transactions on Instrumentation and Measurement.

[7]  David Zhang,et al.  A feature extraction method for use with bimodal biometrics , 2010, Pattern Recognit..

[8]  David Zhang,et al.  Independent components extraction from image matrix , 2010, Pattern Recognit. Lett..

[9]  Guillermo Sapiro,et al.  Sparse Representation forComputerVision and Pattern Recognition A relatively small sample of computer vision and pattern recognition information in applications such as face recognition is often sufficient to reveal the meaning the user desires. , 2010 .

[10]  Takao Sato,et al.  Slope-Walking of a Biped Robot with K Nearest Neighbor method , 2009, 2009 Fourth International Conference on Innovative Computing, Information and Control (ICICIC).

[11]  Dao-Qing Dai,et al.  Sparse Representation by Adding Noisy Duplicates for Enhanced Face Recognition: An Elastic Net Regularization Approach , 2009, 2009 Chinese Conference on Pattern Recognition.

[12]  David Zhang,et al.  Improving the interest operator for face recognition , 2009, Expert Syst. Appl..

[13]  Chengjun Liu,et al.  ICA Color Space for Pattern Recognition , 2009, IEEE Transactions on Neural Networks.

[14]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  David Zhang,et al.  Advanced Pattern Recognition Technologies with Applications to Biometrics , 2008 .

[16]  Wankou Yang,et al.  Two-directional maximum scatter difference discriminant analysis for face recognition , 2008, Neurocomputing.

[17]  Chengjun Liu,et al.  Color Image Discriminant Models and Algorithms for Face Recognition , 2008, IEEE Transactions on Neural Networks.

[18]  Zhong Jin,et al.  Down-Sampling Face Images and Low-Resolution Face Recognition , 2008, 2008 3rd International Conference on Innovative Computing Information and Control.

[19]  Xuelong Li,et al.  Local face sketch synthesis learning , 2008, Neurocomputing.

[20]  Hanan Samet,et al.  K-Nearest Neighbor Finding Using MaxNearestDist , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Ales Leonardis,et al.  High-Dimensional Feature Matching: Employing the Concept of Meaningful Nearest Neighbors , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[22]  David Zhang,et al.  A Multiple Maximum Scatter Difference Discriminant Criterion for Facial Feature Extraction , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[23]  Jian-Gang Wang,et al.  Facial Feature Extraction in an Infrared Image by Proxy With a Visible Face Image , 2007, IEEE Transactions on Instrumentation and Measurement.

[24]  Yi-Ping Hung,et al.  Fast and versatile algorithm for nearest neighbor search based on a lower bound tree , 2007, Pattern Recognit..

[25]  Zheng-Zhi Wang,et al.  Center-based nearest neighbor classifier , 2007, Pattern Recognit..

[26]  David Zhang,et al.  Biometric Image Discrimination Technologies , 2006 .

[27]  Kilian Q. Weinberger,et al.  Distance Metric Learning for Large Margin Nearest Neighbor Classification , 2005, NIPS.

[28]  Shu-Chuan Chu,et al.  Equal-average Equal-variance Equal-norm Nearest Neighbor Codeword Search Algorithm Based on Ordered Hadamard Transform , 2005 .

[29]  Wenming Zheng,et al.  Locally nearest neighbor classifiers for pattern classification , 2004, Pattern Recognit..

[30]  Jian Yang,et al.  Two-dimensional PCA: a new approach to appearance-based face representation and recognition , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  James McNames,et al.  A Fast Nearest-Neighbor Algorithm Based on a Principal Axis Search Tree , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[32]  Hans-Peter Kriegel,et al.  Fast nearest neighbor search in high-dimensional space , 1998, Proceedings 14th International Conference on Data Engineering.

[33]  Sameer A. Nene,et al.  A simple algorithm for nearest neighbor search in high dimensions , 1997 .

[34]  Essaid Bouktache,et al.  A Fast Algorithm for the Nearest-Neighbor Classifier , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[35]  Yann LeCun,et al.  Efficient Pattern Recognition Using a New Transformation Distance , 1992, NIPS.

[36]  Alireza Khotanzad,et al.  Invariant Image Recognition by Zernike Moments , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[37]  Peter E. Hart,et al.  Nearest neighbor pattern classification , 1967, IEEE Trans. Inf. Theory.