Design environment for hardware generation of SLFF neural network topologies with ELM training capability

Extreme Learning Machine (ELM) is a noniterative training method suited for Single Layer Feed Forward Neural Networks (SLFF-NN). Typically, a hardware neural network is trained before implementation in order to avoid additional on-chip occupation, delay and performance degradation. However, ELM provides fixed-time learning capability and simplifies the process of re-training a neural network once implemented in hardware. This is an important issue in many applications where input data are continuously changing and a new training process must be launched very often, providing self-adaptation. This work describes a general SLFF-NN design environment to assist in the definition of neural network hardware implementation parameters including real-time ELM training. The software design environment uses initial user-provided input data with information about the type of problem: sample dataset and validated results, input fields, accuracy; and, together with simulation tools, recommends the optimum configuration for the neural topology and automatically generates synthesizable code for the hardware implementation tool. This is possible due to the design of parameter-dependent synthesis code and optimal hardware architecture design for both neural network and ELM training. Results show all the steps required to follow a successful design flow from the software tool to the final running device and, as an application example, the FPGA implementation for realtime detection of brain area in electrode positioning during a Deep Brain Stimulation (DBS) surgery is shown.

[1]  Jin Zhang,et al.  Image correlation analysis for biometric identification , 2011, Proceedings of the 2011 International Conference on Electrical Engineering and Informatics.

[2]  Rui Zhang,et al.  Real-time transient stability assessment model using extreme learning machine , 2011 .

[3]  Dianhui Wang,et al.  Extreme learning machines: a survey , 2011, Int. J. Mach. Learn. Cybern..

[4]  Kit Po Wong,et al.  Electricity Price Forecasting With Extreme Learning Machine and Bootstrapping , 2012, IEEE Transactions on Power Systems.

[5]  Yanwei Huang,et al.  Nonlinear internal model control with inverse model based on extreme learning machine , 2011, 2011 International Conference on Electric Information and Control Engineering.

[6]  Jaime S. Cardoso,et al.  A new linear parametrization for peak friction coefficient estimation in real time , 2010, 2010 IEEE Vehicle Power and Propulsion Conference.

[7]  K. S. Banerjee Generalized Inverse of Matrices and Its Applications , 1973 .

[8]  Emilio Soria-Olivas,et al.  Hardware implementation methods in Random Vector Functional-Link Networks , 2013, Applied Intelligence.

[9]  Waleed H. Abdulla,et al.  Hardware–Software Codesign of Automatic Speech Recognition System for Embedded Real-Time Applications , 2011, IEEE Transactions on Industrial Electronics.

[10]  Chee Kheong Siew,et al.  Extreme learning machine: Theory and applications , 2006, Neurocomputing.

[11]  Alan Pak Tao Lau,et al.  Fiber nonlinearity compensation using extreme learning machine for DSP-based coherent communication systems , 2011, 16th Opto-Electronics and Communications Conference.

[12]  Alan J. Mayne,et al.  Generalized Inverse of Matrices and its Applications , 1972 .

[13]  Luis Gómez-Chova,et al.  An IP Core and GUI for Implementing Multilayer Perceptron with a Fuzzy Activation Function on Configurable Logic Devices , 2008, J. Univers. Comput. Sci..

[14]  Guang-Bin Huang,et al.  An Insight into Extreme Learning Machines: Random Neurons, Random Features and Kernels , 2014, Cognitive Computation.

[15]  Q. M. Jonathan Wu,et al.  A fast recognition framework based on extreme learning machine using hybrid object information , 2010, Neurocomputing.

[16]  Heng Liu,et al.  The detection of solder joint defect and solar panel orientation based on ELM and robust least square fitting , 2011, 2011 Chinese Control and Decision Conference (CCDC).

[17]  Pietro Lio,et al.  Epileptic EEG Detection via a Novel Pattern Recognition Framework , 2011, 2011 5th International Conference on Bioinformatics and Biomedical Engineering.

[18]  Bo Meng,et al.  Day-ahead electricity price prediction based on multiple ELM , 2010, 2010 Chinese Control and Decision Conference.

[19]  Feilong Cao,et al.  A study on effectiveness of extreme learning machine , 2011, Neurocomputing.

[20]  Eric Monmasson,et al.  Hardware/Software Codesign Guidelines for System on Chip FPGA-Based Sensorless AC Drive Applications , 2013, IEEE Transactions on Industrial Informatics.

[21]  Piedad Brox Jiménez,et al.  CAD Tools for Hardware Implementation of Embedded Fuzzy Systems on FPGAs , 2013, IEEE Transactions on Industrial Informatics.