Interpolating Deep Spatio-Temporal Inference Network features for image classification

This paper presents a novel approach for image classification, by integrating the concepts of deep machine learning and feature interpolation. In particular, a recently introduced learning architecture, the Deep Spatio-Temporal Inference Network (DeSTIN) [1] is employed to perform feature extraction for support vector machine (SVM) based image classification. Linear interpolation and Newton polynomial interpolation are each applied to support the classification. This approach converts feature sets of an originally low-dimensionality into those of a significantly higher dimensionality while gaining overall computational simplification. The work is tested against the popular MNIST dataset of handwritten digits [2]. Experimental results indicate that the proposed approach is highly promising.

[1]  Qiang Shen,et al.  Fuzzy Interpolation and Extrapolation: A Practical Approach , 2008, IEEE Transactions on Fuzzy Systems.

[2]  Jean-Cédric Chappelier,et al.  RST: A Connectionist Architecture to Deal with Spatiotemporal Relationships , 1998, Neural Computation.

[3]  Changjing Shang,et al.  Fuzzy-rough feature selection aided support vector machines for Mars image classification , 2013, Comput. Vis. Image Underst..

[4]  Ke Huang,et al.  Wavelet Feature Selection for Image Classification , 2008, IEEE Transactions on Image Processing.

[5]  Patrick Haffner,et al.  Support vector machines for histogram-based image classification , 1999, IEEE Trans. Neural Networks.

[6]  D. J. Felleman,et al.  Distributed hierarchical processing in the primate cerebral cortex. , 1991, Cerebral cortex.

[7]  Nello Cristianini,et al.  An Introduction to Support Vector Machines and Other Kernel-based Learning Methods , 2000 .

[8]  J. Platt Sequential Minimal Optimization : A Fast Algorithm for Training Support Vector Machines , 1998 .

[9]  Qiang Shen,et al.  New Approaches to Fuzzy-Rough Feature Selection , 2009, IEEE Transactions on Fuzzy Systems.

[10]  R. Douglas,et al.  Neuronal circuits of the neocortex. , 2004, Annual review of neuroscience.

[11]  T. Powell,et al.  The basic uniformity in structure of the neocortex. , 1980, Brain : a journal of neurology.

[12]  Steven R. Young,et al.  A Fast and Stable Incremental Clustering Algorithm , 2010, 2010 Seventh International Conference on Information Technology: New Generations.

[13]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[14]  Itamar Arel,et al.  DeSTIN: A Scalable Deep Learning Architecture with Application to High-Dimensional Robust Pattern Recognition , 2009, AAAI Fall Symposium: Biologically Inspired Cognitive Architectures.

[15]  Yoshua. Bengio,et al.  Learning Deep Architectures for AI , 2007, Found. Trends Mach. Learn..

[16]  John C. Platt,et al.  Fast training of support vector machines using sequential minimal optimization, advances in kernel methods , 1999 .

[17]  Yann LeCun,et al.  The mnist database of handwritten digits , 2005 .

[18]  Qiang Shen,et al.  Adaptive Fuzzy Interpolation , 2011, IEEE Transactions on Fuzzy Systems.

[19]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[20]  Qiang Shen,et al.  Feature Selection With Harmony Search , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).