A Multilabel Extension of LDA Based on the Gram-Schmidt Orthogonalization Procedure

Multilabel classification is a generalization of the traditional unidimensional classification problem, the goal of multilabel classification is to learn a function that maps instances into a set of relevant labels. This article proposes an extension to linear discriminant analysis in the context of multilabel classification. The new method is based on Gram-Schmidt orthogonalization procedure. The theoretical basis and underlying assumptions of the new model are described and the method is experimentally evaluated on the Emotions data set for multilabel classification. The analysis of the empirical results support that this new method is competitive and in some instances superior to the baseline.

[1]  Min-Ling Zhang,et al.  A Review on Multi-Label Learning Algorithms , 2014, IEEE Transactions on Knowledge and Data Engineering.

[2]  Å. Björck.  Numerics of Gram-Schmidt orthogonalization , 1994 .

[3]  Chris H. Q. Ding,et al.  Multi-label Linear Discriminant Analysis , 2010, ECCV.

[4]  Anastasios Tefas,et al.  Direct Multi-label Linear Discriminant Analysis , 2013, EANN.

[5]  A. Izenman.  Linear Discriminant Analysis , 2013 .

[6]  Aleix M. Martínez,et al.  Selecting Principal Components in a Two-Stage LDA Algorithm , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[7]  Hakan Cevikalp,et al.  Discriminative common vectors for face recognition , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  C. Zou,et al.  Real-time face recognition using Gram-Schmidt orthogonalization for LDA , 2004, ICPR 2004.

[9]  Grigorios Tsoumakas,et al.  Multi-Label Classification of Music into Emotions , 2008, ISMIR.

[10]  Aleix M. Martínez,et al.  Subclass discriminant analysis , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Grigorios Tsoumakas,et al.  Multi-Label Classification: An Overview , 2007, Int. J. Data Warehous. Min..

[12]  Hui Wang,et al.  Separability-Oriented Subclass Discriminant Analysis , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Sebastián Ventura,et al.  Multi‐label learning: a review of the state of the art and ongoing research , 2014, WIREs Data Mining Knowl. Discov..

[14]  J. Rodgers,et al.  Linearly Independent, Orthogonal, and Uncorrelated Variables , 1984 .

[15]  Jiawei Han,et al.  SRDA: An Efficient Algorithm for Large-Scale Discriminant Analysis , 2008, IEEE Transactions on Knowledge and Data Engineering.

[16]  Piotr Synak,et al.  Multi-Label Classification of Emotions in Music , 2006, Intelligent Information Systems.

[17]  Cheong Hee Park,et al.  On applying linear discriminant analysis for multi-labeled problems , 2008, Pattern Recognit. Lett..

[18]  Henri Cohen,et al.  A course in computational algebraic number theory , 1993, Graduate texts in mathematics.