Visual Clustering based on Kernel Sparse Representation on Grassmann Manifolds

Image sets and videos can be modeled as subspaces which are actually points on Grassmann manifolds. Clustering of such visual data lying on Grassmann manifolds is a hard issue based on the fact that the state-of-the-art methods are only applied to vector space instead of non-Euclidean geometry. In this paper, we propose a novel algorithm termed as kernel sparse subspace clustering on the Grassmann manifold (GKSSC) which embeds the Grassmann manifold into a Reproducing Kernel Hilbert Space (RKHS) by an appropriate Gaussian projection kernel. This kernel is applied to obtain kernel sparse representations of data on Grassmann manifolds utilizing the self-expressive property and exploiting the intrinsic Riemannian geometry within data. Although the Grassmann manifold is compact, the geodesic distances between Grassmann points are well measured by kernel sparse representations based on linear reconstruction. With the kernel sparse representations, experimental results of clustering accuracy on the prevalent public dataset outperform state-of-the-art algorithms by more than 90 percent and the robustness of our algorithm is demonstrated as well.

[1]  Hongdong Li,et al.  Optimizing over Radial Kernels on Compact Manifolds , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  Brian C. Lovell,et al.  Sparse Coding and Dictionary Learning for Symmetric Positive Definite Matrices: A Kernel Approach , 2012, ECCV.

[3]  Hongdong Li,et al.  Expanding the Family of Grassmannian Kernels: An Embedding Perspective , 2014, ECCV.

[4]  R. Vidal,et al.  Sparse Subspace Clustering: Algorithm, Theory, and Applications. , 2013, IEEE transactions on pattern analysis and machine intelligence.

[5]  Mehrtash Tafazzoli Harandi,et al.  From Manifold to Manifold: Geometry-Aware Dimensionality Reduction for SPD Matrices , 2014, ECCV.

[6]  Baba C. Vemuri,et al.  On A Nonlinear Generalization of Sparse Coding and Dictionary Learning , 2013, ICML.

[7]  Hongdong Li,et al.  Kernel Methods on the Riemannian Manifold of Symmetric Positive Definite Matrices , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[8]  Brian C. Lovell,et al.  Improved Image Set Classification via Joint Sparse Approximated Nearest Subspaces , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  Venu Madhav Govindu,et al.  Efficient Higher-Order Clustering on the Grassmann Manifold , 2013, 2013 IEEE International Conference on Computer Vision.

[10]  Tianci Liu,et al.  Visualization of the geometric transformation group based on the Riemannian metric , 2016, 2016 3rd International Conference on Systems and Informatics (ICSAI).

[11]  René Vidal,et al.  Latent Space Sparse Subspace Clustering , 2013, 2013 IEEE International Conference on Computer Vision.

[12]  René Vidal,et al.  Kernel sparse subspace clustering , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[13]  Yong Yu,et al.  Robust Subspace Segmentation by Low-Rank Representation , 2010, ICML.

[14]  Brian C. Lovell,et al.  Dictionary Learning and Sparse Coding on Grassmann Manifolds: An Extrinsic Solution , 2013, 2013 IEEE International Conference on Computer Vision.

[15]  Baojun Zhao,et al.  Visual Tracking Based on Extreme Learning Machine and Sparse Representation , 2015, Sensors.

[16]  Nello Cristianini,et al.  Kernel Methods for Pattern Analysis , 2004 .

[17]  Brian C. Lovell,et al.  Clustering on Grassmann manifolds via kernel embedding with application to action analysis , 2012, 2012 19th IEEE International Conference on Image Processing.

[18]  René Vidal,et al.  Sparse Manifold Clustering and Embedding , 2011, NIPS.

[19]  Hongdong Li,et al.  Kernel Methods on Riemannian Manifolds with Gaussian RBF Kernels , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Qi Peng,et al.  Moving Shadow Detection Based on Space Location Feature , 2012 .

[21]  Rama Chellappa,et al.  Statistical Computations on Grassmann and Stiefel Manifolds for Image and Video-Based Recognition , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Xiang Wang,et al.  Bearing Fault Diagnosis Based on Statistical Locally Linear Embedding , 2015, Sensors.

[23]  Michael I. Jordan,et al.  On Spectral Clustering: Analysis and an algorithm , 2001, NIPS.

[24]  Junbin Gao,et al.  Low Rank Representation on Grassmann Manifolds , 2014, ACCV.

[25]  Xilin Chen,et al.  Projection Metric Learning on Grassmann Manifold with Application to Video based Face Recognition , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[26]  René Vidal,et al.  Low rank subspace clustering (LRSC) , 2014, Pattern Recognit. Lett..

[27]  Chen Fu A Particle Filter Radar Target Tracking Algorithm Based on Novel Particle Swarm Optimization , 2012 .

[28]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[29]  Zelin Shi,et al.  Covariance Tracking via Geometric Particle Filtering , 2009, 2009 Second International Conference on Intelligent Computation Technology and Automation.

[30]  Zhong Chaoliang Multi-feature Fusion Based Particle Filter Algorithm for Object Tracking , 2012 .

[31]  Junbin Gao,et al.  Kernel Sparse Subspace Clustering on Symmetric Positive Definite Manifolds , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[32]  Frank Chongwoo Park,et al.  A Geometric Particle Filter for Template-Based Visual Tracking , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[33]  Wang Run-sheng Moving shadow detection method based on PCA , 2009 .

[34]  Brian C. Lovell,et al.  Graph embedding discriminant analysis on Grassmannian manifolds for improved image set matching , 2011, CVPR 2011.

[35]  H. Karcher Riemannian center of mass and mollifier smoothing , 1977 .

[36]  Venu Madhav Govindu,et al.  On Averaging Multiview Relations for 3D Scan Registration , 2014, IEEE Transactions on Image Processing.