Ternary tree-based structural twin support tensor machine for clustering

Most of the real-life applications usually involve complex data, e.g., grayscale images, where information is distributed spatially in the form of two-dimensional matrices (elements of second-order tensor space). Traditional vector-based clustering models such as k -means and support vector clustering rely on low-dimensional features representations for identifying patterns and are prone to loss of useful information which is present in spatial structure of the data. To overcome this limitation, tensor-based clustering models can be utilized for identifying relevant patterns in matrix data as they take advantage of structural information present in multi-dimensional framework and reduce computational overheads as well. However, despite these numerous advantages, tensor clustering has still remained relatively unexplored research area. In this paper, we propose a novel clustering framework, termed as Ternary Tree-based Structural Least Squares Support Tensor Clustering (TT-SLSTWSTC), that builds a cluster model as a hierarchical ternary tree, where at each node non-ambiguous data are dealt separately from ambiguous data points using the proposed Ternary Structural Least Squares Support Tensor Machine (TS-LSTWSTM). The TS-LSTWSTM classifier considers the structural risk minimization of data alongside a symmetrical L2-norm loss function. Also, initialization framework based on tensor k -means has been used in order to overcome the instability disseminated by random initialization. To validate the efficacy of the proposed framework, computational experiments have been performed on human activity recognition and image recognition problems. Experimental results show that our method is not only fast but yields significantly better generalization performance and is comparatively more robust in order to handle heteroscedastic noise and outliers when compared to related methods.

[1]  Karen M. Daniels,et al.  Gaussian kernel width exploration and cone cluster labeling for support vector clustering , 2011, Pattern Analysis and Applications.

[2]  Anil K. Jain,et al.  Algorithms for Clustering Data , 1988 .

[3]  Reshma Khemchandani,et al.  Fuzzy least squares twin support vector clustering , 2016, Neural Computing and Applications.

[4]  Robert H. Riffenburgh,et al.  Linear Discriminant Analysis , 1960 .

[5]  Changming Zhu,et al.  Double-fold localized multiple matrix learning machine with Universum , 2017, Pattern Analysis and Applications.

[6]  Zhihua Zhang,et al.  Support Matrix Machines , 2015, ICML.

[7]  Zhao Zhang,et al.  Robust image recognition by L1-norm twin-projection support vector machine , 2017, Neurocomputing.

[8]  Min Chen,et al.  An adaptive deep Q-learning strategy for handwritten digit recognition , 2018, Neural Networks.

[9]  Florian Baumann,et al.  Recognizing human actions using novel space-time volume binary patterns , 2016, Neurocomputing.

[10]  Sweta Sharma,et al.  Tree-Based Structural Twin Support Tensor Clustering with Square Loss Function , 2017, PReMI.

[11]  Xiaoyun Wu,et al.  Support vector machines for text categorization , 2004 .

[12]  Heng Tao Shen,et al.  Principal Component Analysis , 2009, Encyclopedia of Biometrics.

[13]  Suresh Chandra,et al.  Robust Parametric Twin Support Vector Machine for Pattern Classification , 2018, Neural Processing Letters.

[14]  Ying Wang,et al.  TWin support tensor machines for MCs detection , 2009 .

[15]  E. B. Page Ordered Hypotheses for Multiple Treatments: A Significance Test for Linear Ranks , 1963 .

[16]  Paul S. Bradley,et al.  k-Plane Clustering , 2000, J. Glob. Optim..

[17]  Jianping Yin,et al.  Foreword to the special issue on recent advances on pattern recognition and artificial intelligence , 2018, Neural Computing and Applications.

[18]  Allan Aasbjerg Nielsen,et al.  Multiset canonical correlations analysis and multispectral, truly multitemporal remote sensing data , 2002, IEEE Trans. Image Process..

[19]  David G. Stork,et al.  Pattern Classification , 1973 .

[20]  Jian Yang,et al.  Two-dimensional PCA: a new approach to appearance-based face representation and recognition , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Ronen Basri,et al.  Actions as space-time shapes , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[22]  Reshma Khemchandani,et al.  Robust least squares twin support vector machine for human activity recognition , 2016, Appl. Soft Comput..

[23]  Sangram Ganguly,et al.  Learning Sparse Feature Representations Using Probabilistic Quadtrees and Deep Belief Nets , 2015, Neural Processing Letters.

[24]  Redha Touati,et al.  MDS-based Multi-axial Dimensionality Reduction Model for Human Action Recognition , 2014, 2014 Canadian Conference on Computer and Robot Vision.

[25]  Anil K. Jain Data clustering: 50 years beyond K-means , 2008, Pattern Recognit. Lett..

[26]  M. Raydan,et al.  Alternating Projection Methods , 2011 .

[27]  Dale Schuurmans,et al.  Maximum Margin Clustering , 2004, NIPS.

[28]  Hava T. Siegelmann,et al.  Support Vector Clustering , 2002, J. Mach. Learn. Res..

[29]  Yuan-Hai Shao,et al.  Local k-proximal plane clustering , 2014, Neural Computing and Applications.

[30]  Pheng-Ann Heng,et al.  Sparse Support Matrix Machine , 2018, Pattern Recognit..

[31]  Yangyang Xu,et al.  Proximal gradient method for huberized support vector machine , 2015, Pattern Analysis and Applications.

[32]  Reshma Khemchandani,et al.  Twin Support Vector Machines for Pattern Classification , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[33]  Ling Jing,et al.  Least Squares Twin Support Tensor Machine for Classification , 2014 .

[34]  Lan Bai,et al.  Twin Support Vector Machine for Clustering , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[35]  Wei-Ying Ma,et al.  Support Tensor Machines for Text Categorization ∗ , 2006 .

[36]  Jalal A. Nasiri,et al.  Energy-based model of least squares twin Support Vector Machines for human action recognition , 2014, Signal Process..

[37]  Ravi Kothari,et al.  MATHEMATICAL PROGRAMMING APPLICATIONS IN MACHINE LEARNING by RESHMA KHEMCHANDANI , 2013 .