An intelligent embedded system for real-time adaptive extreme learning machine

Extreme learning machine (ELM) is an emerging approach that has attracted the attention of the research community because it outperforms conventional back-propagation feed-forward neural networks and support vector machines (SVM) in some aspects. ELM provides a robust learning algorithm, free of local minima, suitable for high speed computation, and less dependant on human intervention than the above methods. ELM is appropriate for the implementation of intelligent embedded systems with real-time learning capability. Moreover, a number of cutting-edge applications demanding a high performance solution could benefit from this approach. In this work, a scalable hardware/software architecture for ELM is presented, and the details of its implementation on a field programmable gate array (FPGA) are analyzed. The proposed solution provides high speed, small size, low power consumption, autonomy, and true capability for real-time adaptation (i.e. the learning stage is performed on-chip). The developed system is able to deal with highly demanding multiclass classification problems. Two real-world applications are presented, a benchmark problem of the Landsat images database, and a novel driver identification system for smart car applications. Experimental results that validate the proposal are provided.

[1]  Javier Echanobe,et al.  Fuzzy systems, neural networks and neuro-fuzzy systems: A vision on their hardware implementation and platforms over two decades , 2014, Eng. Appl. Artif. Intell..

[2]  Paulo Cortez,et al.  Evolutionary Design of Neural Networks for Classification and Regression , 2005 .

[3]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[4]  S.A. Al-Kazzaz,et al.  FPGA Implementation of Artificial Neurons: Comparison study , 2008, 2008 3rd International Conference on Information and Communication Technologies: From Theory to Applications.

[5]  Hongming Zhou,et al.  Extreme Learning Machine for Regression and Multiclass Classification , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[6]  Chee Kheong Siew,et al.  Extreme learning machine: Theory and applications , 2006, Neurocomputing.

[7]  Jürgen Teich,et al.  Hardware/Software Codesign: The Past, the Present, and Predicting the Future , 2012, Proceedings of the IEEE.

[8]  John H. L. Hansen,et al.  UTDrive: The Smart Vehicle Project , 2009 .

[9]  P. Cochat,et al.  Et al , 2008, Archives de pediatrie : organe officiel de la Societe francaise de pediatrie.

[10]  Emilio Soria-Olivas,et al.  Hardware implementation methods in Random Vector Functional-Link Networks , 2013, Applied Intelligence.

[11]  Paolo Gastaldo,et al.  Efficient Digital Implementation of Extreme Learning Machines for Classification , 2012, IEEE Transactions on Circuits and Systems II: Express Briefs.

[12]  Volkan Sezer,et al.  Data collection with "UYANIK": too much pain; but gains are coming , 2007 .

[13]  Kristin P. Bennett,et al.  Support vector machines: hype or hallelujah? , 2000, SKDD.

[14]  Fariba Sadri,et al.  Ambient intelligence: A survey , 2011, CSUR.

[15]  Faiyaz Doctor,et al.  A real-time driver identification system based on artificial neural networks and cepstral analysis , 2014, 2014 International Joint Conference on Neural Networks (IJCNN).

[16]  R. Stephenson A and V , 1962, The British journal of ophthalmology.

[17]  Kazuya Takeda,et al.  On-Going Data Collection of Driving Behavior Signals , 2009 .

[18]  D. J. Newman,et al.  UCI Repository of Machine Learning Database , 1998 .

[19]  Andres M. Gonzalez,et al.  Evolutionary Algorithms for Selecting the Architecture of a MLP Neural Network: A Credit Scoring Case , 2011, 2011 IEEE 11th International Conference on Data Mining Workshops.

[20]  W. Marsden I and J , 2012 .