Comparing of deep neural networks and extreme learning machines based on growing and pruning approach

Abstract Recently, the studies based on Deep Neural Networks and Extreme Learning Machines have become prominent. The models of parameters designed in these studies have been chosen randomly and the models have been designed in this direction. The main focus of this study is to determine the ideal parameters i.e. optimum hidden layer number, optimum hidden neuron number and activation function for Deep Neural Networks and Extreme Learning Machines architectures based on growing and pruning approach and to compare the performances of the models designed. The performances of the models are evaluated on two datasets; Parkinson and Self-Care Activities Dataset. Multi experiments have verified that the Deep Neural Networks architectures present a good prediction performance and this architecture outperforms the Extreme Learning Machines.

[1]  N. Hosseinioun,et al.  Forecasting Outlier Occurrence in Stock Market Time Series Based on Wavelet Transform and Adaptive ELM Algorithm , 2016 .

[2]  Korris Fu-Lai Chung,et al.  Positive and negative fuzzy rule system, extreme learning machine and image classification , 2011, Int. J. Mach. Learn. Cybern..

[3]  Q. M. Jonathan Wu,et al.  Human face recognition based on multidimensional PCA and extreme learning machine , 2011, Pattern Recognit..

[4]  Yan Xiong,et al.  Application of Extreme Learning Machine Combination Model for Dam Displacement Prediction , 2017 .

[5]  Himansu Sekhar Behera,et al.  A hybrid ETS-ANN model for time series forecasting , 2017, Eng. Appl. Artif. Intell..

[6]  Yan Shi,et al.  Comparison of SVM, RF and ELM on an Electronic Nose for the Intelligent Evaluation of Paraffin Samples , 2018, Sensors.

[7]  Mïmine Kaya Kele,et al.  Artificial Bee Colony Algorithm for Feature Selection on SCADI Dataset , 2018, 2018 3rd International Conference on Computer Science and Engineering (UBMK).

[8]  Juwon Kim,et al.  Deep neural network for estimating low density lipoprotein cholesterol. , 2019, Clinica chimica acta; international journal of clinical chemistry.

[9]  Sung Wook Baik,et al.  A Robust Framework for Self-Care Problem Identification for Children with Disability , 2019, Symmetry.

[10]  Jianping Yin,et al.  Boosting weighted ELM for imbalanced learning , 2014, Neurocomputing.

[11]  Jing J. Liang,et al.  Two-hidden-layer extreme learning machine for regression and classification , 2016, Neurocomputing.

[12]  El-Sayed M. El-Horbaty,et al.  Classification using deep learning neural networks for brain tumors , 2017, Future Computing and Informatics Journal.

[13]  Hamidullah Binol,et al.  Classification of molecular structure images by using ANN, RF, LBP, HOG, and size reduction methods for early stomach cancer detection , 2018 .

[14]  Giuseppe De Pietro,et al.  A deep learning approach for ECG-based heartbeat classification for arrhythmia detection , 2018, Future Gener. Comput. Syst..

[15]  Huiyu Zhou,et al.  Using deep neural network with small dataset to predict material defects , 2019, Materials & Design.

[16]  Yoram Singer,et al.  Adaptive Subgradient Methods for Online Learning and Stochastic Optimization , 2011, J. Mach. Learn. Res..

[17]  Wei Xiong,et al.  Learning structured and non-redundant representations with deep neural networks , 2019, Pattern Recognit..

[18]  Feng Lu,et al.  Time Series Prediction Based on Adaptive Weight Online Sequential Extreme Learning Machine , 2017 .

[19]  Fikret S. Gürgen,et al.  Collection and Analysis of a Parkinson Speech Dataset With Multiple Types of Sound Recordings , 2013, IEEE Journal of Biomedical and Health Informatics.

[20]  Yuan Lan,et al.  Two-stage extreme learning machine for regression , 2010, Neurocomputing.

[21]  Binu P. Chacko,et al.  Handwritten character recognition using wavelet energy and extreme learning machine , 2012, Int. J. Mach. Learn. Cybern..

[22]  Brian K. Smith,et al.  An optimum ANN-based breast cancer diagnosis: Bridging gaps between ANN learning and decision-making goals , 2018, Appl. Soft Comput..

[23]  Dong Xiao,et al.  A Multiple Hidden Layers Extreme Learning Machine Method and Its Application , 2017 .

[24]  Zhang Yi,et al.  Automated diagnosis of breast ultrasonography images using deep neural networks , 2019, Medical Image Anal..

[25]  Chee Kheong Siew,et al.  Extreme learning machine: Theory and applications , 2006, Neurocomputing.

[26]  Emilio Ferrara,et al.  Deep Neural Networks for Bot Detection , 2018, Inf. Sci..

[27]  Guang-Zhong Yang,et al.  Deep Learning for Health Informatics , 2017, IEEE Journal of Biomedical and Health Informatics.

[28]  Mohsen Sardari Zarchi,et al.  SCADI: A standard dataset for self-care problems classification of children with physical and motor disability , 2018, Int. J. Medical Informatics.

[29]  Qinghua Zheng,et al.  Real-Time Collaborative Filtering Using Extreme Learning Machine , 2009, 2009 IEEE/WIC/ACM International Joint Conference on Web Intelligence and Intelligent Agent Technology.

[30]  Keun-Chang Kwak,et al.  Short-Term Electricity-Load Forecasting Using a TSK-Based Extreme Learning Machine with Knowledge Representation , 2017 .