A novel classification approach based on Extreme Learning Machine and Wavelet Neural Networks

In this paper, we present a novel classification approach based on Extreme Learning Machine (ELM) and Wavelet Neural Networks. We introduce two novel contributions. The first is Extreme Learning Machine based on Fast Wavelet Transform (ELM-FWT) algorithm aiming to solve the problem of matrix inversion which represents several limitations to ELM method. The second contribution is dedicated to solving another problem of machine learning algorithms, i.e. the number of neurons in the hidden nodes. It consists in allocating automatically and efficiently the number of neurons in the hidden layer. To demonstrate the effectiveness of our proposal, we realized numerous experiments and comparisons using 19 algorithms from Breast Cancer Wisconsin database which are considered as references in machine learning. Experimental results clearly demonstrate the stability and robustness of the proposed approach.

[1]  Qinghua Zhang,et al.  Wavelet networks , 1992, IEEE Trans. Neural Networks.

[2]  Abien Fred Agarap.  On breast cancer detection: an application of machine learning algorithms on the wisconsin diagnostic dataset , 2017, ICMLSC '18.

[3]  José Neves,et al.  Direct Kernel Perceptron (DKP): Ultra-fast kernel ELM-based classification with non-iterative closed-form weight calculation , 2014, Neural Networks.

[4]  Guang-Bin Huang,et al.  Convex incremental extreme learning machine , 2007, Neurocomputing.

[5]  Hajar Mousannif,et al.  Using Machine Learning Algorithms for Breast Cancer Risk Prediction and Diagnosis , 2016, ANT/SEIT.

[6]  K. Sumangali,et al.  Prediction of breast cancer using voting classifier technique , 2017, 2017 IEEE International Conference on Smart Technologies and Management for Computing, Communication, Controls, Energy and Materials (ICSTM).

[7]  Musatafa Abbas Abbood Albadr,et al.  Extreme learning machine: A review , 2017 .

[8]  P. Hamsagayathri,et al.  PERFORMANCE ANALYSIS OF BREAST CANCER CLASSIFICATION USING DECISION TREE CLASSIFIERS , 2017 .

[9]  Lei Chen,et al.  Enhanced random search based incremental extreme learning machine , 2008, Neurocomputing.

[10]  Chee Kheong Siew,et al.  Universal Approximation using Incremental Constructive Feedforward Networks with Random Hidden Nodes , 2006, IEEE Transactions on Neural Networks.

[11]  Mohammad Ali Lotfollahi-Yaghin,et al.  Wavenet ability assessment in comparison to ANN for predicting the maximum surface settlement caused by tunneling , 2012 .

[12]  Han Zhao,et al.  Extreme learning machine: algorithm, theory and applications , 2013, Artificial Intelligence Review.

[13]  Chokri Ben Amar,et al.  FBWN: An architecture of fast beta wavelet networks for image classification , 2010, The 2010 International Joint Conference on Neural Networks (IJCNN).

[14]  Guang-Bin Huang,et al.  Extreme learning machine: a new learning scheme of feedforward neural networks , 2004, 2004 IEEE International Joint Conference on Neural Networks (IEEE Cat. No.04CH37541).

[15]  Chokri Ben Amar,et al.  Fast Learning Algorithm of Wavelet Network Based on Fast Wavelet Transform , 2011, Int. J. Pattern Recognit. Artif. Intell..

[16]  Jun Miao,et al.  One-Class Classification with Extreme Learning Machine , 2015 .

[17]  Guang-Bin Huang,et al.  An Insight into Extreme Learning Machines: Random Neurons, Random Features and Kernels , 2014, Cognitive Computation.

[18]  Anh Hoang,et al.  Supervised Classifier Performance on the Uci Database , 2007 .

[19]  William Nick Street,et al.  Breast Cancer Diagnosis and Prognosis Via Linear Programming , 1995, Oper. Res..

[20]  Aan Kardiana,et al.  Breast Cancer Diagnosis using Artificial Neural Networks with Extreme Learning Techniques , 2019 .

[21]  Chokri Ben Amar,et al.  A Novel Approach for Face Recognition Based on Fast Learning Algorithm and Wavelet Network Theory , 2011, Int. J. Wavelets Multiresolution Inf. Process..

[22]  Shankho Subhra Pal.  Grey Wolf Optimization Trained Feed Foreword Neural Network for Breast Cancer Classification , 2018 .

[23]  Ayman M. Eldeib,et al.  Breast cancer classification using deep belief networks , 2016, Expert Syst. Appl..

[24]  W. N. Street,et al.  Machine learning techniques to diagnose breast cancer from image-processed nuclear features of fine needle aspirates. , 1994, Cancer letters.

[25]  Shuai Li,et al.  Inverse-Free Extreme Learning Machine With Optimal Information Updating , 2016, IEEE Transactions on Cybernetics.

[26]  Alexandros Iosifidis,et al.  One-Class Classification Based on Extreme Learning and Geometric Class Information , 2016, Neural Processing Letters.

[27]  T. P. Latchoumi,et al.  Abnormality detection using weighed particle swarm optimization and smooth support vector machine , 2017 .

[28]  Ahmed Hamza Osman,et al.  An Enhanced Breast Cancer Diagnosis Scheme based on Two-Step-SVM Technique , 2017 .

[29]  Chokri Ben Amar,et al.  Comparison between extreme learning machine and wavelet neural networks in data classification , 2017, International Conference on Machine Vision.