Functional extreme learning machine for regression and classification.

Although Extreme Learning Machine (ELM) can learn thousands of times faster than traditional slow gradient algorithms for training neural networks, ELM fitting accuracy is limited. This paper develops Functional Extreme Learning Machine (FELM), which is a novel regression and classifier. It takes functional neurons as the basic computing units and uses functional equation-solving theory to guide the modeling process of functional extreme learning machines. The functional neuron function of FELM is not fixed, and its learning process refers to the process of estimating or adjusting the coefficients. It follows the spirit of extreme learning and solves the generalized inverse of the hidden layer neuron output matrix through the principle of minimum error, without iterating to obtain the optimal hidden layer coefficients. To verify the performance of the proposed FELM, it is compared with ELM, OP-ELM, SVM and LSSVM on several synthetic datasets, XOR problem, benchmark regression and classification datasets. The experimental results show that although the proposed FELM has the same learning speed as ELM, its generalization performance and stability are better than ELM.

[1]  Siyuan Lu,et al.  A review on extreme learning machine , 2021, Multimedia Tools and Applications.

[2]  Hualong Yu,et al.  Online sequential extreme learning machine with the increased classes , 2021, Comput. Electr. Eng..

[3]  M. Revan Özkale,et al.  LL-ELM: A regularized extreme learning machine based on L1\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$L_{1}$$\end{ , 2021, Neural Computing and Applications.

[4]  Mourad Zaied,et al.  Wavelet extreme learning machine and deep learning for data classification , 2021, Neurocomputing.

[5]  Jian Zhou,et al.  Proposing several hybrid PSO-extreme learning machine techniques to predict TBM performance , 2021, Engineering with Computers.

[6]  Bing Li,et al.  Group reduced kernel extreme learning machine for fault diagnosis of aircraft engine , 2020, Eng. Appl. Artif. Intell..

[7]  Wendong Xiao,et al.  Non-iterative and Fast Deep Learning: Multilayer Extreme Learning Machines , 2020, J. Frankl. Inst..

[8]  Jinde Cao,et al.  Robust regularized extreme learning machine for regression with non-convex loss function via DC program , 2020, J. Frankl. Inst..

[9]  Mahdi Shariati,et al.  A novel hybrid extreme learning machine–grey wolf optimizer (ELM-GWO) model to predict compressive strength of concrete with partial replacements for cement , 2020, Engineering with Computers.

[10]  Banshidhar Majhi,et al.  Automated breast cancer detection in digital mammograms: A moth flame optimization based ELM approach , 2020, Biomed. Signal Process. Control..

[11]  Xian-Bo Wang,et al.  Ensemble extreme learning machines for compound-fault diagnosis of rotating machinery , 2020, Knowl. Based Syst..

[12]  Miao Wang,et al.  An improved algorithm for incremental extreme learning machine , 2020 .

[13]  Sanyam Shukla,et al.  Online sequential class-specific extreme learning machine for binary imbalanced learning , 2019, Neural Networks.

[14]  Ozgur Kisi,et al.  Daily streamflow prediction using optimally pruned extreme learning machine , 2019, Journal of Hydrology.

[15]  Pijush Samui,et al.  A novel hybrid approach based on a swarm intelligence optimized extreme learning machine for flash flood susceptibility mapping , 2019, CATENA.

[16]  Zhixin Yang,et al.  Multilayer one-class extreme learning machine , 2019, Neural Networks.

[17]  Zhiqiang Ge,et al.  Distributed parallel deep learning of Hierarchical Extreme Learning Machine for multimode quality prediction with big process data , 2019, Eng. Appl. Artif. Intell..

[18]  Yongquan Zhou,et al.  Functional networks and applications: A survey , 2019, Neurocomputing.

[19]  Zaher Mundher Yaseen,et al.  An enhanced extreme learning machine model for river flow forecasting: State-of-the-art, practical applications in water resource engineering area and future research direction , 2019, Journal of Hydrology.

[20]  Jun Feng,et al.  Sex Determination of Three-Dimensional Skull Based on Improved Backpropagation Neural Network , 2019, Comput. Math. Methods Medicine.

[21]  Feng Lu,et al.  Aircraft engine degradation prognostics based on logistic regression and novel OS-ELM algorithm , 2019, Aerospace Science and Technology.

[22]  Senchun Chai,et al.  Modified bidirectional extreme learning machine with Gram-Schmidt orthogonalization method , 2018, Neurocomputing.

[23]  Aman Jantan,et al.  State-of-the-art in artificial neural network applications: A survey , 2018, Heliyon.

[24]  B. Majhi,et al.  A computer-aided diagnosis system using Tchebichef features and improved grey wolf optimized extreme learning machine , 2018, Applied Intelligence.

[25]  Yong-Ping Zhao,et al.  A robust extreme learning machine for modeling a small-scale turbojet engine , 2018 .

[26]  Zhiping Lin,et al.  Kernel based online learning for imbalance multiclass classification , 2018, Neurocomputing.

[27]  Badong Chen,et al.  Recursive least mean p-power Extreme Learning Machine , 2017, Neural Networks.

[28]  Dong Liu,et al.  Length-Changeable Incremental Extreme Learning Machine , 2017, Journal of Computer Science and Technology.

[29]  Lei Wang,et al.  Multiple kernel extreme learning machine , 2015, Neurocomputing.

[30]  Shifei Ding,et al.  An optimizing BP neural network algorithm based on genetic algorithm , 2011, Artificial Intelligence Review.

[31]  Zexuan Zhu,et al.  A fast pruned-extreme learning machine for classification problem , 2008, Neurocomputing.

[32]  Chee Kheong Siew,et al.  Extreme learning machine: Theory and applications , 2006, Neurocomputing.

[33]  Chee Kheong Siew,et al.  Universal Approximation using Incremental Constructive Feedforward Networks with Random Hidden Nodes , 2006, IEEE Transactions on Neural Networks.

[34]  A. Kai Qin,et al.  Evolutionary extreme learning machine , 2005, Pattern Recognit..

[35]  Anil K. Jain,et al.  Artificial Neural Networks: A Tutorial , 1996, Computer.

[36]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[37]  Özgür Kisi,et al.  Improving streamflow prediction using a new hybrid ELM model combined with hybrid particle swarm optimization and grey wolf optimization , 2021, Knowl. Based Syst..

[38]  Ashwini Sapkal,et al.  Modified Backpropagation with Added White Gaussian Noise in Weighted Sum for Convergence Improvement , 2018 .

[39]  E. A. Mohamed,et al.  Traffic Sign Recognition Based On Multi-feature Fusion and ELM Classifier , 2018 .

[40]  Chee Kheong Siew,et al.  Incremental extreme learning machine with fully complex hidden nodes , 2008, Neurocomputing.