Novel hybrid CNN-SVM model for recognition of functional magnetic resonance images

This paper proposes a novel hybrid model that integrates the synergy of two superior classifiers for functional magnetic resonance imaging (fMRI) recognition, namely, convolutional neural networks (CNNs) and support vector machines (SVMs), both of which have proven results in the field of image recognition. In the proposed model, the CNN functions as a trainable feature extractor and the SVM functions as a recognizer. This hybrid model extracts features from raw images and generates predictions for fMRI recognition. We conducted experiments on Haxby's 2001 fMRI dataset. Comparisons with Haxby's study using the same database indicated that the proposed fusion achieved superior recognition accuracy of 99.5% compared to the Haxby's approach. Further, when the CNN was used as a feature extractor, the SVM classifier was demonstrated to be the best combining counterpart, providing the best synergy effect in terms of accuracy. This is compared with other classifiers based on learning algorithms such as decision tree, neural network, K-nearest neighbor, random forest, and AdaBoost.

[1]  Vladimir Vapnik,et al.  The Nature of Statistical Learning , 1995 .

[2]  Chih-Jen Lin,et al.  A Comparison of Methods for Multi-class Support Vector Machines , 2015 .

[3]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[4]  Stephen José Hanson,et al.  Combinatorial codes in ventral temporal lobe for object recognition: Haxby (2001) revisited: is there a “face” area? , 2004, NeuroImage.

[5]  Ching Y. Suen,et al.  A trainable feature extractor for handwritten digit recognition , 2007, Pattern Recognit..

[6]  John Scott Bridle,et al.  Probabilistic Interpretation of Feedforward Classification Network Outputs, with Relationships to Statistical Pattern Recognition , 1989, NATO Neurocomputing.

[7]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[8]  Joshua Powell Pedestrian Detection with Convolutional Neural Networks , 2017 .

[9]  A. Ishai,et al.  Distributed and Overlapping Representations of Faces and Objects in Ventral Temporal Cortex , 2001, Science.

[10]  Chih-Jen Lin,et al.  A comparison of methods for multiclass support vector machines , 2002, IEEE Trans. Neural Networks.

[11]  Peter J. Ramadge,et al.  The Pairwise Elastic Net support vector machine for automatic fMRI feature selection , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[12]  Stefan Pollmann,et al.  Neuroinformatics Original Research Article Pymvpa: a Unifying Approach to the Analysis of Neuroscientifi C Data , 2022 .

[13]  Patrice Y. Simard,et al.  Best practices for convolutional neural networks applied to visual document analysis , 2003, Seventh International Conference on Document Analysis and Recognition, 2003. Proceedings..

[14]  Alice J. O'Toole,et al.  Partially Distributed Representations of Objects and Faces in Ventral Temporal Cortex , 2005, Journal of Cognitive Neuroscience.

[15]  Martin N. Hebart,et al.  The Decoding Toolbox (TDT): a versatile software package for multivariate analyses of functional imaging data , 2015, Front. Neuroinform..

[16]  Lei Li,et al.  Fuzzy Multi-class Support Vector Machine Based on Binary Tree in Network Intrusion Detection , 2010, 2010 International Conference on Electrical and Control Engineering.

[17]  Xiaomu Song,et al.  Resting state fMRI data analysis using support vector machines , 2013, 2013 IEEE Signal Processing in Medicine and Biology Symposium (SPMB).

[18]  Nan Zhang,et al.  A hybrid switching PSO algorithm and support vector machines for bankruptcy prediction , 2014, 2014 International Conference on Mechatronics and Control (ICMC).