Online video object classification using fast similarity network fusion

In this paper, we propose one online video object classification algorithm using fast Similarity Network Fusion (SNF). By constructing sample-similarity network for each data type and then efficiently fusing these networks into one single similarity network that represents the full spectrum of underlying data, SNF can efficiently identify subtypes among existing samples by clustering and predict labels for new samples based on the constructed network, which make it distinct in data integration or classification. The main problem of data online classification using SNF is its complexity. The proposed fast SNF (FSNF) in this work consists of two main steps: dividing the matrix into two parts and replacing the main part of testing matrix using the same part of training matrix. Since the main computation in SNF is to get the main part of matrix, this replacement can reduce most of the computation load. From the experiments based on online surveillance video object classification, it can be observed that: compared with SNF, the proposed FSNF can gain 16 times speed increasing with only 0.5%-0.6% accuracy losing; FSNF also significantly outperforms the existing traditional algorithms in classification accuracy.

[1]  Graham Robinson,et al.  Appraisal, Assessment and Equal Opportunity , 1977 .

[2]  Integrative clustering of multiple genomic data types using a joint latent variable model with application to breast and lung cancer subtype analysis , 2010, Bioinform..

[3]  Alan J. Lipton.  Local Application of Optic Flow to Analyse Rigid versus Non-Rigid Motion , 1999 .

[4]  Xavier Binefa,et al.  Robust Real-Time Periodic Motion Detection, Analysis, and Applications , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Arik Azran,et al.  The rendezvous algorithm: multiclass semi-supervised learning with Markov random walks , 2007, ICML '07.

[6]  Yi Peng,et al.  Unsupervised and Semi-supervised Support Vector Machines , 2011 .

[7]  Rong Jin,et al.  Semi-Supervised Boosting for Multi-Class Classification , 2008, ECML/PKDD.

[8]  Xiaokang Yang,et al.  Cross-Layered Hidden Markov Modeling for Surveillance Event Recognition , 2012, 2012 IEEE International Conference on Multimedia and Expo Workshops.

[9]  Mubarak Shah,et al.  Tracking and Object Classification for Automated Surveillance , 2002, ECCV.

[10]  D. Gildea,et al.  Self-training and Co-training for Semantic Role Labeling: Primary Report , 2006 .

[11]  Robert D. Nowak,et al.  Transduction with Matrix Completion: Three Birds with One Stone , 2010, NIPS.

[12]  Simon Rogers,et al.  Multi-class Semi-supervised Learning with the e-truncated Multinomial Probit Gaussian Process , 2007, Gaussian Processes in Practice.

[13]  Tshilidzi Marwala,et al.  Image Classification Using SVMs: One-against-One Vs One-against-All , 2007, ArXiv.

[14]  Christoph H. Lampert,et al.  Semi-supervised Laplacian Regularization of Kernel Canonical Correlation Analysis , 2008, ECML/PKDD.

[15]  Yifan Zhou,et al.  Vehicle Classification with Confidence by Classified Vector Quantization , 2013, IEEE Intelligent Transportation Systems Magazine.

[16]  Changshui Zhang,et al.  Graph Based Multi-class Semi-supervised Learning Using Gaussian Process , 2006, SSPR/SPR.

[17]  Dale Schuurmans,et al.  Unsupervised and Semi-Supervised Multi-Class Support Vector Machines , 2005, AAAI.

[18]  Hironobu Fujiyoshi,et al.  Moving target classification and tracking from real-time video , 1998, Proceedings Fourth IEEE Workshop on Applications of Computer Vision. WACV'98 (Cat. No.98EX201).

[19]  Zhuowen Tu,et al.  Similarity network fusion for aggregating data types on a genomic scale , 2014, Nature Methods.