Visual Classification by ℓ1-Hypergraph Modeling

Visual classification has attracted considerable research interests in the past decades. In this paper, a novel $\ell _1$ -hypergraph model for visual classification is proposed. Hypergraph learning, as a natural extension of graph model, has been widely used in many machine learning tasks. In previous work, hypergraph is usually constructed by attribute-based or neighborhood-based methods. That is, a hyperedge is generated by connecting a set of samples sharing a same feature attribute or in a neighborhood. However, these methods are unable to explore feature space globally or sensitive to noises. To address these problems, we propose a novel hypergraph construction approach that leverages sparse representation to generate hyperedges and learns the relationship among hyperedges and their vertices. First, for each sample, a hyperedge is generated by regarding it as the centroid and linking it as well as its nearest neighbors. Then, the sparse representation method is applied to represent the centroid vertex by other vertices within the same hyperedge. The vertices with zero coefficients are removed from the hyperedge. Finally, the representation coefficients are used to define the incidence relation between the hyperedge and the vertices. In our approach, we also optimize the hyperedge weights to modulate the effects of different hyperedges. We leverage the prior knowledge on the hyperedges so that the hyperedges sharing more vertices can have closer weights, where a graph Laplacian is used to regularize the optimization of the weights. Our approach is named $\ell _1$ -hypergraph since the $\ell _1$ sparse representation is employed in the hypergraph construction process. The method is evaluated on various visual classification tasks, and it demonstrates promising performance.

[1]  Liang-Tien Chia,et al.  Adaptive hierarchical multi-class SVM classifier for texture-based image classification , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[2]  Florent Perronnin,et al.  Fisher Kernels on Visual Vocabularies for Image Categorization , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[3]  Yihong Gong,et al.  Nonlinear Learning using Local Coordinate Coding , 2009, NIPS.

[4]  Michael K. Ng,et al.  Transductive Multilabel Learning via Label Set Propagation , 2013, IEEE Transactions on Knowledge and Data Engineering.

[5]  Gonzalo Navarro,et al.  Compressed representations for web and social graphs , 2013, Knowledge and Information Systems.

[6]  Choong-Ho Cho,et al.  Hierarchical reduction and partition of hypergraph , 1996, IEEE Trans. Syst. Man Cybern. Part B.

[7]  Edwin R. Hancock,et al.  3D Object Recognition Using Hyper-Graphs and Ranked Local Invariant Features , 2008, SSPR/SPR.

[8]  Shuicheng Yan,et al.  Autogrouped Sparse Representation for Visual Analysis , 2014, IEEE Transactions on Image Processing.

[9]  Zoubin Ghahramani,et al.  Combining active learning and semi-supervised learning using Gaussian fields and harmonic functions , 2003, ICML 2003.

[10]  Yi Yang,et al.  A Multimedia Retrieval Framework Based on Semi-Supervised Ranking and Relevance Feedback , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  José Eladio Medina-Pagola,et al.  A new proposal for graph-based image classification using frequent approximate subgraphs , 2014, Pattern Recognit..

[12]  G. Griffin,et al.  Caltech-256 Object Category Dataset , 2007 .

[13]  Bingbing Ni,et al.  Learning a Propagable Graph for Semisupervised Learning: Classification and Regression , 2012, IEEE Transactions on Knowledge and Data Engineering.

[14]  Lei Zhang,et al.  Log-Euclidean Kernels for Sparse Representation and Dictionary Learning , 2013, 2013 IEEE International Conference on Computer Vision.

[15]  Qihao Weng,et al.  A survey of image classification methods and techniques for improving classification performance , 2007 .

[16]  Sukumar Nandi,et al.  Effective data summarization for hierarchical clustering in large datasets , 2013, Knowledge and Information Systems.

[17]  Lorenzo Bruzzone,et al.  A Novel Transductive SVM for Semisupervised Classification of Remote-Sensing Images , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[18]  Meng Wang,et al.  Correlative Linear Neighborhood Propagation for Video Annotation , 2009, IEEE Trans. Syst. Man Cybern. Part B.

[19]  Liang-Tien Chia,et al.  Sparse Representation With Kernels , 2013, IEEE Transactions on Image Processing.

[20]  Meng Wang,et al.  Spectral Hashing With Semantically Consistent Graph for Image Indexing , 2013, IEEE Transactions on Multimedia.

[21]  Francisco Herrera,et al.  Integrating Instance Selection, Instance Weighting, and Feature Weighting for Nearest Neighbor Classifiers by Coevolutionary Algorithms , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[22]  Shuicheng Yan,et al.  Learning With $\ell ^{1}$-Graph for Image Analysis , 2010, IEEE Transactions on Image Processing.

[23]  Zhengtao Yu,et al.  Multiple graph regularized sparse coding and multiple hypergraph regularized sparse coding for image representation , 2015, Neurocomputing.

[24]  Jing Wang,et al.  Fast Neighborhood Graph Search Using Cartesian Concatenation , 2013, 2013 IEEE International Conference on Computer Vision.

[25]  NandiSukumar,et al.  Effective data summarization for hierarchical clustering in large datasets , 2015 .

[26]  Bernhard Schölkopf,et al.  Learning with Hypergraphs: Clustering, Classification, and Embedding , 2006, NIPS.

[27]  Fei Wang,et al.  Label Propagation through Linear Neighborhoods , 2006, IEEE Transactions on Knowledge and Data Engineering.

[28]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[29]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  TaeHyun Hwang,et al.  Learning on Weighted Hypergraphs to Integrate Protein Interactions and Gene Expressions for Cancer Outcome Prediction , 2008, 2008 Eighth IEEE International Conference on Data Mining.

[31]  Ken Lang,et al.  NewsWeeder: Learning to Filter Netnews , 1995, ICML.

[32]  Tamir Tassa,et al.  Anonymization of Centralized and Distributed Social Networks by Sequential Clustering , 2013, IEEE Transactions on Knowledge and Data Engineering.

[33]  Andrew Zisserman,et al.  Image Classification using Random Forests and Ferns , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[34]  Sameer A. Nene,et al.  Columbia Object Image Library (COIL100) , 1996 .

[35]  Eli Shechtman,et al.  In defense of Nearest-Neighbor based image classification , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[36]  Yuval Shahar,et al.  Fast time intervals mining using the transitivity of temporal relations , 2013, Knowledge and Information Systems.

[37]  Qingshan Liu,et al.  Image retrieval via probabilistic hypergraph ranking , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[38]  Jiann-Der Lee,et al.  Halftone Image Classification Using LMS Algorithm and Naive Bayes , 2011, IEEE Transactions on Image Processing.

[39]  Kristen Grauman,et al.  Watch, Listen & Learn: Co-training on Captioned Images and Videos , 2008, ECML/PKDD.

[40]  Xuelong Li,et al.  Modality Mixture Projections for Semantic Video Event Detection , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[41]  Shuicheng Yan,et al.  Large-scale multilabel propagation based on efficient sparse graph construction , 2013, ACM Trans. Multim. Comput. Commun. Appl..

[42]  Yue Gao,et al.  Tag-based social image search with visual-text joint hypergraph learning , 2011, ACM Multimedia.

[43]  Meng Wang,et al.  Multimodal Graph-Based Reranking for Web Image Search , 2012, IEEE Transactions on Image Processing.

[44]  Ronald A. Cole,et al.  Spoken Letter Recognition , 1990, HLT.

[45]  Yi Yang,et al.  Web and Personal Image Annotation by Mining Label Correlation With Relaxed Visual Graph Embedding , 2012, IEEE Transactions on Image Processing.

[46]  Hui Xiong,et al.  High-dimensional clustering: a clique-based hypergraph partitioning framework , 2012, Knowledge and Information Systems.

[47]  Shuicheng Yan,et al.  Auto-Grouped Sparse Representation for Visual Analysis , 2012, ECCV.

[48]  Meng Wang,et al.  Adaptive Hypergraph Learning and its Application in Image Classification , 2012, IEEE Transactions on Image Processing.

[49]  Chun Chen,et al.  Music recommendation by unified hypergraph: combining social media information and music content , 2010, ACM Multimedia.

[50]  Yihong Gong,et al.  Locality-constrained Linear Coding for image classification , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[51]  Helen C. Shen,et al.  Linear Neighborhood Propagation and Its Applications , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[52]  Mikhail Belkin,et al.  Laplacian Support Vector Machines Trained in the Primal , 2009, J. Mach. Learn. Res..

[53]  Shivani Agarwal,et al.  Ranking on graph data , 2006, ICML.

[54]  Feiping Nie,et al.  Efficient Image Classification via Multiple Rank Regression , 2013, IEEE Transactions on Image Processing.

[55]  Marc Rioux,et al.  Recognition and Shape Synthesis of 3-D Objects Based on Attributed Hypergraphs , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[56]  Katarzyna Musial,et al.  Multidimensional Social Network in the Social Recommender System , 2011, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[57]  Byron C. Wallace,et al.  Improving class probability estimates for imbalanced data , 2013, Knowledge and Information Systems.