Pattern classification based on k locally constrained line

A simple yet effective learning algorithm, k locally constrained line (k-LCL), is presented for pattern classification. In k-LCL, any two prototypes of the same class are extended to a constrained line (CL), through which the representational capacity of the training set is largely improved. Because each CL is adjustable in length, k-LCL can well avoid the “intersecting” of training subspaces in most traditional feature classifiers. Moreover, to speed up the calculation, k-LCL classifies an unknown sample focusing only on its local CLs in each class. Experimental results, obtained on both synthetic and real-world benchmark data sets, show that the proposed method has better accuracy and efficiency than most existing feature line methods.

[1]  Tieniu Tan,et al.  Iris recognition using circular symmetric filters , 2002, Object recognition supported by user interaction for service robots.

[2]  Mark A. Girolami,et al.  An empirical analysis of the probabilistic K-nearest neighbour classifier , 2007, Pattern Recognit. Lett..

[3]  Xuelong Li,et al.  Generalised nearest feature line for subspace learning , 2007 .

[4]  Jiun-Hung Chen,et al.  Object recognition based on image sequences by using inter-feature-line consistencies , 2004, Pattern Recognit..

[5]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[6]  Changshui Zhang,et al.  Classification of gene-expression data: The manifold-based metric learning way , 2006, Pattern Recognit..

[7]  Brian D. Ripley,et al.  Neural Networks and Related Methods for Classification , 1994 .

[8]  Chee Keong Kwoh,et al.  The Nearest Feature Midpoint - A Novel Approach for Pattern Classification , 2005 .

[9]  Robert P. W. Duin,et al.  A generalization of dissimilarity representations using feature lines and feature planes , 2009, Pattern Recognit. Lett..

[10]  Ran He,et al.  Nearest Feature Line: A Tangent Approximation , 2008, 2008 Chinese Conference on Pattern Recognition.

[11]  I. Jolliffe Principal Component Analysis , 2002 .

[13]  Ke Chen,et al.  On the use of nearest feature line for speaker identification , 2002, Pattern Recognit. Lett..

[14]  Jiun-Hung Chen,et al.  Reducing SVM classification time using multiple mirror classifiers , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[15]  Li Zhao,et al.  Content-based retrieval of video shot using the-improved nearest feature line method , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).

[16]  Andy Harter,et al.  Parameterisation of a stochastic model for human face identification , 1994, Proceedings of 1994 IEEE Workshop on Applications of Computer Vision.

[17]  Stan Z. Li,et al.  Face recognition using the nearest feature line method , 1999, IEEE Trans. Neural Networks.

[18]  Ron Kohavi,et al.  A Study of Cross-Validation and Bootstrap for Accuracy Estimation and Model Selection , 1995, IJCAI.

[19]  Xuelong Li,et al.  Iterative Subspace Analysis Based on Feature Line Distance , 2009, IEEE Trans. Image Process..

[20]  Stan Z. Li,et al.  Performance Evaluation of the Nearest Feature Line Method in Image Classification and Retrieval , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  Zheng-Zhi Wang,et al.  Center-based nearest neighbor classifier , 2007, Pattern Recognit..

[22]  Wenming Zheng,et al.  Locally nearest neighbor classifiers for pattern classification , 2004, Pattern Recognit..

[23]  Yan Qiu Chen,et al.  Rectified nearest feature line segment for pattern classification , 2007, Pattern Recognit..

[24]  Stan Z. Li,et al.  Content-based Classification and Retrieval of Audio Using the Nearest Feature Line Method , 2000 .

[25]  Changshui Zhang,et al.  Tunable Nearest Neighbor Classifier , 2004, DAGM-Symposium.

[26]  Keinosuke Fukunaga,et al.  Leave-One-Out Procedures for Nonparametric Error Estimates , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[27]  Stan Z. Li,et al.  Content-based audio classification and retrieval using the nearest feature line method , 2000, IEEE Trans. Speech Audio Process..

[28]  Zheng-Zhi Wang,et al.  Using Nearest Feature Line and Tunable Nearest Neighbor methods for prediction of protein subcellular locations , 2005, Comput. Biol. Chem..