Graph refining via iterative regularization framework

Graph-based methods have been widely applied in clustering problems. The mainstream pipeline for these methods is to build an affinity matrix first, and then use the spectral clustering methods to construct a graph. The existing studies about such a pipeline mainly focus on how to build a good affinity matrix, while the spectral method has only been considered as an end-up step to achieve the clustering tasks. However, the quality of the constructed graph has significant influences on the clustering results. Unlike most of the existing works, our studies in this paper focus on how to refine the original graph to construct a good graph by giving the number of clusters. We show that spectral clustering method has a good property of block structure preserving by giving the priori knowledge about number of clusters. Based on the property, we provide an iterative regularization framework to refine the original graph. The regularization framework is based on a well-designed reproducing kernel Hilbert spaces for vector-valued (RKHSvv) functions, which is in favor of doing kernel tricks on graph reconstruction. The elements in RKHSvv are multiple outputs affinity functions. We show that finding an optimal multiple outputs function is equivalent to construct a graph, and the associated affinity matrix of such a graph can be obtained in a form of multiplication between a kernel matrix and an unknown coefficient matrix.

[1]  Li Zhang,et al.  An efficient segmentation method based on dynamic graph merging , 2016, Int. J. Wavelets Multiresolution Inf. Process..

[2]  C. L. Philip Chen,et al.  A robust bi-sparsity model with non-local regularization for mixed noise reduction , 2016, Inf. Sci..

[3]  Yong Yu,et al.  Robust Subspace Segmentation by Low-Rank Representation , 2010, ICML.

[4]  Satu Elisa Schaeffer,et al.  Graph Clustering , 2017, Encyclopedia of Machine Learning and Data Mining.

[5]  Shuicheng Yan,et al.  Robust and Efficient Subspace Segmentation via Least Squares Regression , 2012, ECCV.

[6]  Wen-Sheng Chen,et al.  Geometric Distribution Weight Information Modeled Using Radial Basis Function with Fractional Order for Linear Discriminant Analysis Method , 2013 .

[7]  Binbin Pan,et al.  Supervised kernel nonnegative matrix factorization for face recognition , 2016, Neurocomputing.

[8]  Bernhard Schölkopf,et al.  A Generalized Representer Theorem , 2001, COLT/EuroCOLT.

[9]  Zhenyu He,et al.  Connected Component Model for Multi-Object Tracking , 2016, IEEE Transactions on Image Processing.

[10]  Zhenyu He,et al.  A multi-view model for visual tracking via correlation filters , 2016, Knowl. Based Syst..

[11]  Michael I. Jordan,et al.  On Spectral Clustering: Analysis and an algorithm , 2001, NIPS.

[12]  Baowen Xu,et al.  Super-resolution Person re-identification with semi-coupled low-rank discriminant dictionary learning , 2015, CVPR.

[13]  Zhenyu He,et al.  Particle filter re-detection for visual tracking via correlation filters , 2018, Multimedia Tools and Applications.

[14]  Vikas Sindhwani,et al.  On Manifold Regularization , 2005, AISTATS.

[15]  Yuan Yan Tang,et al.  Topological Coding and Its Application in the Refinement of SIFT , 2014, IEEE Transactions on Cybernetics.

[16]  Lei He,et al.  Block structure preserving model order reduction , 2005, BMAS 2005. Proceedings of the 2005 IEEE International Behavioral Modeling and Simulation Workshop, 2005..

[17]  Jia Cai.  An operator approach to analysis of conditional kernel canonical correlation , 2015, Int. J. Wavelets Multiresolution Inf. Process..

[18]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[19]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Qiao Liu,et al.  Object tracking based on online representative sample selection via non-negative least square , 2018, Multimedia Tools and Applications.

[21]  A. Martínez,et al.  The AR face databasae , 1998 .

[22]  Guanglin Li,et al.  Development of Sensory-Motor Fusion-Based Manipulation and Grasping Control for a Robotic Hand-Eye System , 2017, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[23]  Liang Xiao,et al.  Structure-Based Low-Rank Model With Graph Nuclear Norm Regularization for Noise Removal , 2017, IEEE Transactions on Image Processing.

[24]  Jing Huang,et al.  Rotation invariant iris feature extraction using Gaussian Markov random fields with non-separable wavelet , 2010, Neurocomputing.

[25]  Zhenyu He,et al.  Multiple feature fused for visual tracking via correlation filters , 2017, 2017 International Conference on Security, Pattern Analysis, and Cybernetics (SPAC).

[26]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[27]  Pong C. Yuen,et al.  Kernel machine-based rank-lifting regularized discriminant analysis method for face recognition , 2011, Neurocomputing.

[28]  Tomaso A. Poggio,et al.  Regularization Networks and Support Vector Machines , 2000, Adv. Comput. Math..

[29]  Mohsen Ebrahimi Moghaddam,et al.  A text-independent Persian writer identification based on feature relation graph (FRG) , 2010, Pattern Recognit..

[30]  Felipe Cucker,et al.  On the mathematical foundations of learning , 2001 .

[31]  Lorenzo Rosasco,et al.  Some Properties of Regularized Kernel Methods , 2004, J. Mach. Learn. Res..

[32]  Zhenyu He,et al.  Writer identification using fractal dimension of wavelet subbands in gabor domain , 2010, Integr. Comput. Aided Eng..

[33]  Feiping Nie,et al.  The Constrained Laplacian Rank Algorithm for Graph-Based Clustering , 2016, AAAI.

[34]  Yuan Yan Tang,et al.  A Hybrid of Local and Global Saliencies for Detecting Image Salient Region and Appearance , 2017, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[35]  A. Berlinet,et al.  Reproducing kernel Hilbert spaces in probability and statistics , 2004 .

[36]  N. Aronszajn.  Theory of Reproducing Kernels. , 1950 .

[37]  Erik B. Sudderth.  Graphical models for visual object recognition and tracking , 2006 .

[38]  Zhenyu He,et al.  Visual tracking via exemplar regression model , 2016, Knowl. Based Syst..

[39]  Xiao-Yuan Jing,et al.  Multi-spectral low-rank structured dictionary learning for face recognition , 2016, Pattern Recognit..

[40]  Zhenyu He,et al.  Writer identification of Chinese handwriting documents using hidden Markov tree model , 2008, Pattern Recognit..

[41]  Lorenzo Rosasco,et al.  Convex Learning of Multiple Tasks and their Structure , 2015, ICML.

[42]  Jinbo Li,et al.  Regional multifocus image fusion using sparse representation. , 2013, Optics express.

[43]  Zhenyu He,et al.  3-D B-spline Wavelet-Based Local Standard Deviation (BWLSD): Its Application to Edge Detection and Vascular Segmentation in Magnetic Resonance Angiography , 2009, International Journal of Computer Vision.

[44]  Peter V. Gehler,et al.  Learning Output Kernels with Block Coordinate Descent , 2011, ICML.

[45]  Charles A. Micchelli,et al.  Learning Multiple Tasks with Kernel Methods , 2005, J. Mach. Learn. Res..

[46]  C. L. Philip Chen,et al.  A Multiple-Kernel Fuzzy C-Means Algorithm for Image Segmentation , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[47]  René Vidal,et al.  Sparse subspace clustering , 2009, CVPR.

[48]  Jitendra Malik,et al.  Normalized Cuts and Image Segmentation , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[49]  Bernt Schiele,et al.  Efficient Output Kernel Learning for Multiple Tasks , 2015, NIPS.

[50]  Dong Yue,et al.  Multi-view low-rank dictionary learning for image classification , 2016, Pattern Recognit..