A Survey of Spiking Neural Networks and Support Vector Machine Performance Byusinggpu's

In this paper we study the performance of Spiking Neural Networks (SNN)and Support Vector Machine (SVM) by using a GPU, model GeForce 6400M. Respect to applications of SNN, the methodology may be used for clustering, classification of databases, odor, speech and image recognition..In case of methodology SVM, is typically applied for clustering, regression and progression. According to particular characteristics of these methodologies,theycan be parallelizedin several grades. However, level of parallelism is limited to architecture of hardware. So, is very sure to get better results using other hardware with more computational resources. The different approaches are evaluated by the training speed and performance. On the other hand, some authors have coded algorithms SVM light, but nobody has programming QP SVM in a GPU. Algorithms were coded by authors in the hardware, like Nvidia card, FPGA or sequential circuits that depends on methodology used, to compare learning timewith between GPU and CPU. Also, in the survey we introduce a brief description of the types of ANN and its techniques of execution to be related with results of researching.

[1]  Stefan Philipp,et al.  Interconnecting VLSI Spiking Neural Networks Using Isochronous Connections , 2007, IWANN.

[2]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[3]  Murray Shanahan,et al.  NeMo: A Platform for Neural Modelling of Spiking Neurons Using GPUs , 2009, 2009 20th IEEE International Conference on Application-specific Systems, Architectures and Processors.

[4]  Zhongwen Luo,et al.  Artificial neural network computation on graphic process unit , 2005, Proceedings. 2005 IEEE International Joint Conference on Neural Networks, 2005..

[5]  Markos Papadonikolakis,et al.  A novel FPGA-based SVM classifier , 2010, 2010 International Conference on Field-Programmable Technology.

[6]  Wayne Luk,et al.  FPGA Accelerated Simulation of Biologically Plausible Spiking Neural Networks , 2009, 2009 17th IEEE Symposium on Field Programmable Custom Computing Machines.

[7]  Nikola B. Serbedzija.  Simulating Artificial Neural Networks on Parallel Architectures , 1996, Computer.

[8]  John R. Williams,et al.  Parallel multiclass classification using SVMs on GPUs , 2010, GPGPU-3.

[9]  Sander M. Bohte,et al.  Error-backpropagation in temporally encoded networks of spiking neurons , 2000, Neurocomputing.

[10]  Olaf Booij,et al.  Temporal Pattern Classification using Spiking Neural Networks , 2004 .

[11]  Qi Li,et al.  An intelligent system for accelerating parallel SVM classification problems on large datasets using GPU , 2010, 2010 10th International Conference on Intelligent Systems Design and Applications.

[12]  Jens Meiler,et al.  Poster: GPU-accelerated artificial neural network for QSAR modeling , 2011, 2011 IEEE 1st International Conference on Computational Advances in Bio and Medical Sciences (ICCABS).

[13]  Eugene M. Izhikevich,et al.  Simple model of spiking neurons , 2003, IEEE Trans. Neural Networks.

[14]  Shao-Yi Chien,et al.  Support Vector Machines on GPU with Sparse Matrix Format , 2010, 2010 Ninth International Conference on Machine Learning and Applications.

[15]  Nikil D. Dutt,et al.  Efficient simulation of large-scale Spiking Neural Networks using CUDA graphics processors , 2009, 2009 International Joint Conference on Neural Networks.

[16]  Pietro Laface,et al.  Parallel implementation of artificial neural network training , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[17]  Raghavendra D. Prabhu,et al.  SOMGPU: An unsupervised pattern classifier on Graphical Processing Unit , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[18]  Eugene M Izhikevich,et al.  Hybrid spiking models , 2010, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[19]  Federico Girosi,et al.  An improved training algorithm for support vector machines , 1997, Neural Networks for Signal Processing VII. Proceedings of the 1997 IEEE Signal Processing Society Workshop.

[20]  Vivek K. Pallipuram,et al.  Acceleration of spiking neural networks in emerging multi-core and GPU architectures , 2010, 2010 IEEE International Symposium on Parallel & Distributed Processing, Workshops and Phd Forum (IPDPSW).

[21]  Kurt Keutzer,et al.  Fast support vector machine training and classification on graphics processors , 2008, ICML '08.

[22]  Arash Ahmadi,et al.  A GPU based simulation of multilayer spiking neural networks , 2011, 2011 19th Iranian Conference on Electrical Engineering.

[23]  Christos-Savvas Bouganis,et al.  Performance comparison of GPU and FPGA architectures for the SVM training problem , 2009, 2009 International Conference on Field-Programmable Technology.

[24]  Wyeth Bair,et al.  Spiking neural network simulation: numerical integration with the Parker-Sochacki method , 2009, Journal of Computational Neuroscience.

[25]  Leon Reznik,et al.  GPU-based simulation of spiking neural networks with real-time performance & high accuracy , 2010, The 2010 International Joint Conference on Neural Networks (IJCNN).

[26]  David Atienza,et al.  Neural Network-Based Thermal Simulation of Integrated Circuits on GPUs , 2012, IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems.

[27]  A. Hodgkin,et al.  A quantitative description of membrane current and its application to conduction and excitation in nerve , 1952, The Journal of physiology.

[28]  Hojjat Adeli,et al.  Spiking Neural Networks , 2009, Int. J. Neural Syst..

[29]  Francisco Javier Díaz Pernas,et al.  Fuzzy ART Neural Network Parallel Computing on the GPU , 2007, IWANN.

[30]  Xin Jin,et al.  Parallel simulation of neural networks on SpiNNaker universal neuromorphic hardware , 2010 .