A Variant of the Trace Quotient Formulation for Dimensionality Reduction

Due to its importance to classification and clustering, dimensionality reduction or distance metric learning has been studied in depth in recent years In this work, we demonstrate the weakness of a widely-used class separability criterion—trace quotient for dimensionality reduction—and propose new criteria for the dimensionality reduction problem The proposed optimization problem can be efficiently solved using semidefinite programming, similar to the technique in [1] Experiments on classification and clustering are performed to evaluate the proposed algorithm Results show the advantage of the our proposed algorithm.

[1]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[2]  Kim-Chuan Toh,et al.  Solving semidefinite-quadratic-linear programs using SDPT3 , 2003, Math. Program..

[3]  Tomer Hertz,et al.  Learning a Mahalanobis Metric from Equivalence Constraints , 2005, J. Mach. Learn. Res..

[4]  Hongdong Li,et al.  Supervised dimensionality reduction via sequential semidefinite programming , 2008, Pattern Recognit..

[5]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[6]  Michael I. Jordan,et al.  Distance Metric Learning with Application to Clustering with Side-Information , 2002, NIPS.

[7]  Shuicheng Yan,et al.  Trace Quotient Problems Revisited , 2006, ECCV.

[8]  Antti Oulasvirta,et al.  Computer Vision – ECCV 2006 , 2006, Lecture Notes in Computer Science.

[9]  Richard I. Hartley,et al.  Multiple-View Geometry Under the {$L_\infty$}-Norm , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.