FAPNN: An FPGA based Approximate Probabilistic Neural Network Library

Due to their flexible architecture and inherent parallelism, FPGAs are ideal candidates for neural network implementations. Still they have not achieved wide-spread acceptance in this regard. One of the major roadblocks for FPGAs is the implementation of complex mathematical functions encountered in neural networks. Exact implementation of these functions consume large number of resources. In this paper we discuss an FPGA-based neural network prototyping platform and the approximate implementation of a probabilistic neural network (PNN) on a Xilinx 7-Series FPGA. The complex mathematical functions as replaced by approximations. Analysis shows that hardware performance is much higher than that of software counter parts and the error induced due to approximations is within tolerable limit.

[1]  Clay S. Gloster,et al.  Implementation of a probabilistic neural network for multi-spectral image classification on an FPGA based custom computing machine , 1998, Proceedings 5th Brazilian Symposium on Neural Networks (Cat. No.98EX209).

[2]  V. S. Shankar Sriram,et al.  A Hypergraph and Arithmetic Residue-based Probabilistic Neural Network for classification in Intrusion Detection Systems , 2017, Neural Networks.

[3]  Jonathan L. Ticknor.  A Bayesian regularized artificial neural network for stock market forecasting , 2013, Expert Syst. Appl..

[4]  Kapil Junjea.  A dynamic segment based statistical derived PNN model for noise robust Speech Recognition , 2015, 2015 Third International Conference on Image Information Processing (ICIIP).

[5]  Shucheng Yu,et al.  Privacy Preserving Back-Propagation Neural Network Learning Made Practical with Cloud Computing , 2014, IEEE Transactions on Parallel and Distributed Systems.

[6]  O. Fukuda,et al.  FPGA implementation of a probabilistic neural network for a bioelectric human interface , 2004, The 2004 47th Midwest Symposium on Circuits and Systems, 2004. MWSCAS '04..

[7]  D. F. Specht,et al.  Probabilistic neural networks for classification, mapping, or associative memory , 1988, IEEE 1988 International Conference on Neural Networks.

[8]  Donald F. Specht,et al.  Probabilistic neural networks , 1990, Neural Networks.

[9]  Brian Kingsbury,et al.  New types of deep neural network learning for speech recognition and related applications: an overview , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[10]  Yaowu Chen,et al.  Improved FPGA implementation of Probabilistic Neural Network for neural decoding , 2010, The 2010 International Conference on Apperceiving Computing and Intelligence Analysis Proceeding.

[11]  Kizheppatt Vipin,et al.  System-level FPGA device driver with high-level synthesis support , 2013, 2013 International Conference on Field-Programmable Technology (FPT).

[12]  Rafal Doroz,et al.  Using a Probabilistic Neural Network for lip-based biometric verification , 2017, Eng. Appl. Artif. Intell..

[13]  Houria Boumaaraf,et al.  A three-phase NPC grid-connected inverter for photovoltaic applications using neural network MPPT , 2015 .

[14]  Yu Cao,et al.  PNN for EEG-based Emotion Recognition , 2016, 2016 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[15]  Fan Zhou,et al.  Field-programmable gate array implementation of a probabilistic neural network for motor cortical decoding in rats , 2010, Journal of Neuroscience Methods.