FAF-DRVFL: Fuzzy activation function based deep random vector functional links network for early diagnosis of Alzheimer disease

Abstract Alzheimer’s disease (AD) is a degenerative neural condition marked by gradual memory loss and cognitive impairment. It is irreversible in nature and leads to progressive cerebral cortex atrophy. Therefore, structural Magnetic Resonance Imaging (sMRI) is an important tool that can be used for early-stage prediction of AD. Currently, deep learning networks are used for the diagnosis of AD, but it suffers from the limitations of gradient descent training of deep networks like local minima, slow learning speed, and overfitting. Also, there is a need to select hyperparameters like learning rate, momentum, number of epochs, and regularization coefficient. This paper proposes a deep non-iterative random vector functional link (RVFL) neural network. First, the MRI images’ features are extracted using transfer learning, and the classification of the extracted features is done using a non-iterative random vector initialized RVFL network. At the hidden layer of the RVFL classifier, the fuzzy activation function (FAF), is used to calculate the hidden layer’s output. The proposed algorithm has been evaluated and compared with the state-of-the-art methods on the ADNI dataset consisting of Cognitive Normal (CN), AD, converter Mild Cognitive Impairment (cMCI) and non-converter Mild Cognitive Impairment (ncMCI) MRI images. The performance achieved for CN vs AD diagnosis includes accuracy (86.67%), sensitivity (83.33%), specificity (88.89%), precision (83.33%), recall (83.33%) and F-score(86.07%) as well as Receiver Operating Characteristics shows that proposed method outperforms over several compared methods.

[1]  Ponnuthurai N. Suganthan,et al.  Ensemble incremental learning Random Vector Functional Link network for short-term electric load forecasting , 2018, Knowl. Based Syst..

[2]  Muhammad Imran Razzak,et al.  Deep Learning for Medical Image Processing: Overview, Challenges and Future , 2017, ArXiv.

[3]  Guang-Bin Huang,et al.  An Insight into Extreme Learning Machines: Random Neurons, Random Features and Kernels , 2014, Cognitive Computation.

[4]  Alejandro Pazos,et al.  Automatic assessment of Alzheimer's disease diagnosis based on deep learning techniques , 2020, Comput. Biol. Medicine.

[5]  J. Pariente,et al.  Early diagnosis of Alzheimer's disease using cortical thickness: impact of cognitive reserve , 2009, Brain : a journal of neurology.

[6]  Nick C Fox,et al.  The Alzheimer's disease neuroimaging initiative (ADNI): MRI methods , 2008, Journal of magnetic resonance imaging : JMRI.

[7]  Dejan J. Sobajic,et al.  Neural-net computing and the intelligent control of systems , 1992 .

[8]  Ponnuthurai N. Suganthan,et al.  On the origins of randomization-based feedforward neural networks , 2021, Appl. Soft Comput..

[9]  Muhammad Tanveer,et al.  Least squares projection twin support vector clustering (LSPTSVC) , 2020, Inf. Sci..

[10]  Philip S. Yu,et al.  An unsupervised parameter learning model for RVFL neural network , 2019, Neural Networks.

[11]  Jyoti Islam,et al.  Brain MRI analysis for Alzheimer’s disease diagnosis using an ensemble system of deep convolutional neural networks , 2018, Brain Informatics.

[12]  Seçkin Karasu,et al.  Recognition of COVID-19 disease from X-ray images by hybrid model consisting of 2D curvelet transform, chaotic salp swarm algorithm and deep learning technique , 2020, Chaos, Solitons & Fractals.

[13]  P. N. Suganthan,et al.  A comprehensive evaluation of random vector functional link networks , 2016, Inf. Sci..

[14]  Ponnuthurai N. Suganthan,et al.  Letter: On non-iterative learning algorithms with closed-form solution , 2018, Appl. Soft Comput..

[15]  Ayman El-Baz,et al.  Alzheimer's Disease Diagnostics by a Deeply Supervised Adaptable 3D Convolutional Network , 2016, ArXiv.

[16]  Aytaç Altan,et al.  THE EFFECT OF KERNEL VALUES IN SUPPORT VECTOR MACHINE TO FORECASTING PERFORMANCE OF FINANCIAL TIME SERIES , 2019 .

[17]  Dinggang Shen,et al.  Joint Classification and Regression via Deep Multi-Task Multi-Channel Learning for Alzheimer's Disease Diagnosis , 2019, IEEE Transactions on Biomedical Engineering.

[18]  Mona K. Beyer,et al.  MRI-Based Classification Models in Prediction of Mild Cognitive Impairment and Dementia in Late-Life Depression , 2017, Front. Aging Neurosci..

[19]  P. N. Suganthan,et al.  Random Vector Functional Link Neural Network based Ensemble Deep Learning , 2019, Pattern Recognit..

[20]  Muazzam Maqsood,et al.  Transfer Learning Assisted Classification and Detection of Alzheimer’s Disease Stages Using 3D MRI Scans , 2019, Sensors.

[21]  Ponnuthurai Nagaratnam Suganthan,et al.  Ensemble methods for wind and solar power forecasting—A state-of-the-art review , 2015 .

[22]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[23]  M. Prince,et al.  World Alzheimer Report 2015 - The Global Impact of Dementia: An analysis of prevalence, incidence, cost and trends , 2015 .

[24]  Dong Ni,et al.  Discriminative Learning for Alzheimer's Disease Diagnosis via Canonical Correlation Analysis and Multimodal Fusion , 2016, Front. Aging Neurosci..

[25]  Dong Ni,et al.  Relational-Regularized Discriminative Sparse Learning for Alzheimer’s Disease Diagnosis , 2017, IEEE Transactions on Cybernetics.

[26]  Yoshua Bengio,et al.  Understanding the difficulty of training deep feedforward neural networks , 2010, AISTATS.

[27]  Dejan J. Sobajic,et al.  Learning and generalization characteristics of the random vector Functional-link net , 1994, Neurocomputing.

[28]  Chee Kheong Siew,et al.  Extreme learning machine: Theory and applications , 2006, Neurocomputing.

[29]  Dinggang Shen,et al.  Deep ensemble learning of sparse regression models for brain disease diagnosis , 2017, Medical Image Anal..

[30]  Faouzi Benzarti,et al.  Diagnosis of Alzheimer Diseases in Early Step Using SVM (Support Vector Machine) , 2016, 2016 13th International Conference on Computer Graphics, Imaging and Visualization (CGiV).

[31]  P. N. Suganthan,et al.  Stacked Autoencoder Based Deep Random Vector Functional Link Neural Network for Classification , 2019, Appl. Soft Comput..

[32]  Asim M. Mubeen,et al.  Prediction of Incipient Alzheimer's Disease Dementia in Patients with Mild Cognitive Impairment. , 2016, Journal of Alzheimer's disease : JAD.

[33]  Aytaç Altan,et al.  Recognition Model for Solar Radiation Time Series based on Random Forest with Feature Selection Approach , 2019, 2019 11th International Conference on Electrical and Electronics Engineering (ELECO).

[34]  Stelios D. Bekiros,et al.  Digital currency forecasting with chaotic meta-heuristic bio-inspired signal processing techniques , 2019, Chaos, Solitons & Fractals.

[35]  Le Zhang,et al.  An ensemble of decision trees with random vector functional link networks for multi-class classification , 2017, Appl. Soft Comput..

[36]  Stefan Klein,et al.  Feature Selection Based on the SVM Weight Vector for Classification of Dementia , 2015, IEEE Journal of Biomedical and Health Informatics.

[37]  Junsheng Cheng,et al.  Discriminative manifold random vector functional link neural network for rolling bearing fault diagnosis , 2021, Knowl. Based Syst..

[38]  Daoqiang Zhang,et al.  Temporally Constrained Group Sparse Learning for Longitudinal Data Analysis in Alzheimer's Disease , 2017, IEEE Transactions on Biomedical Engineering.

[39]  Antonio J. Serrano,et al.  A low-complexity fuzzy activation function for artificial neural networks , 2003, IEEE Trans. Neural Networks.

[40]  Hubert Cecotti,et al.  Deep Random Vector Functional Link Network for handwritten character recognition , 2016, 2016 International Joint Conference on Neural Networks (IJCNN).

[41]  Jianping Yin,et al.  Multiple Kernel Learning in the Primal for Multimodal Alzheimer’s Disease Classification , 2013, IEEE Journal of Biomedical and Health Informatics.

[42]  Wasim Ahmad,et al.  A new forecasting model with wrapper-based feature selection approach using multi-objective optimization technique for chaotic crude oil time series , 2020 .

[43]  Ram Bilas Pachori,et al.  A novel method for the classification of Alzheimer's disease from normal controls using magnetic resonance imaging , 2020, Expert Syst. J. Knowl. Eng..

[44]  Dinggang Shen,et al.  Multi-Layer Multi-View Classification for Alzheimer's Disease Diagnosis , 2018, AAAI.

[45]  Muhammad Tanveer,et al.  Diagnosis of Alzheimer's disease using universum support vector machine based recursive feature elimination (USVM-RFE) , 2020, Biomed. Signal Process. Control..