Optimization Driven Adam-Cuckoo Search-Based Deep Belief Network Classifier for Data Classification

Data classification effectively classifies the data based on the labeled class distribution. To classify the data using the imbalanced distribution poses a significant challenge in the class inequity problem. Various data classification methods are developed in the learning framework, but proving better classification accuracy is a significant challenge in the application domain. Therefore, an effective classification method named Adam-Cuckoo search based Deep Belief Network (Adam-CS based DBN) is proposed to perform the classification process. At first, the input data is forwarded to the pre-processing stage, and then the feature selection stage. The wrapper-based feature selection model conducts the search in space with the possible parameters. The operators specify the connectivity between the states and select the features based on their state. The classification is performed using the Deep Belief Network (DBN) classifier such that the multilayer perceptron (MLP) layer of Deep Belief Network (DBN) is trained using the proposed Adam based Cuckoo search (Adam-CS) algorithm. The breeding behavior of cuckoos is integrated with the step size parameter to enhance the accuracy of the classification process. The adaptive learning rate parameter effectively estimates the moments using a sparse gradient. The proposed Adam based Cuckoo search (Adam-CS) algorithm attained better performance using the metrics, such as accuracy, specificity, and sensitivity, with 90% training data.

[1]  X. Yao Evolving Artificial Neural Networks , 1999 .

[2]  Xin-She Yang,et al.  Engineering optimisation by cuckoo search , 2010, Int. J. Math. Model. Numer. Optimisation.

[3]  Andrea Zanella,et al.  Cognition-Based Networks: A New Perspective on Network Optimization Using Learning and Distributed Intelligence , 2015, IEEE Access.

[4]  Zhou Guo,et al.  On combining multiscale deep learning features for the classification of hyperspectral remote sensing imagery , 2015 .

[5]  André Carlos Ponce de Leon Ferreira de Carvalho,et al.  Deep learning for biological image classification , 2017, Expert Syst. Appl..

[6]  Peng Li,et al.  An Adaptive Dropout Deep Computation Model for Industrial IoT Big Data Learning With Crowdsourcing to Cloud Computing , 2019, IEEE Transactions on Industrial Informatics.

[7]  Gang Wang,et al.  Deep Learning-Based Classification of Hyperspectral Data , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[8]  Zhenwei Shi,et al.  MugNet: Deep learning for hyperspectral image classification using limited samples , 2017, ISPRS Journal of Photogrammetry and Remote Sensing.

[9]  Stanislas Chambon,et al.  A Deep Learning Architecture for Temporal Sleep Stage Classification Using Multivariate and Multimodal Time Series , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[10]  Shutao Li,et al.  Learning to Diversify Deep Belief Networks for Hyperspectral Image Classification , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[11]  Vishal M. Patel,et al.  Learning Deep Features for One-Class Classification , 2018, IEEE Transactions on Image Processing.

[12]  Ning Zhang,et al.  Hyperspectral Image Classification Based on Nonlinear Spectral–Spatial Network , 2016, IEEE Geoscience and Remote Sensing Letters.

[13]  Padmavathi Kora,et al.  Hybrid Firefly and Particle Swarm Optimization algorithm for the detection of Bundle Branch Block , 2016 .

[14]  M. Siegel,et al.  Hyperspectral classification via deep networks and superpixel segmentation , 2015 .

[15]  T. Charles Clancy,et al.  Convolutional Radio Modulation Recognition Networks , 2016, EANN.

[16]  Ron Kohavi,et al.  Wrappers for Feature Subset Selection , 1997, Artif. Intell..

[17]  Poonam Yadav,et al.  Intelligent Information Retrieval in Data Mining , 2012 .

[18]  Fan Zhang,et al.  Deep Convolutional Neural Networks for Hyperspectral Image Classification , 2015, J. Sensors.

[19]  Ausif Mahmood,et al.  Convolutional Recurrent Deep Learning Model for Sentence Classification , 2018, IEEE Access.

[20]  Raymond Y. K. Lau,et al.  Hyperspectral Image Classification With Deep Learning Models , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[21]  C Yamini,et al.  Classification using Convolutional Neural Network for Heart and Diabetics Datasets , 2016 .

[22]  Yang Wang,et al.  Cost-sensitive boosting for classification of imbalanced data , 2007, Pattern Recognit..

[23]  Andrew K. C. Wong,et al.  Classification of Imbalanced Data: a Review , 2009, Int. J. Pattern Recognit. Artif. Intell..

[24]  Shiva Pirhadi,et al.  Biomarker Discovery Based on Hybrid Optimization Algorithm and Artificial Neural Networks on Microarray Data for Cancer Classification , 2015, Journal of medical signals and sensors.

[25]  Qi Wu,et al.  Medical image classification using synergic deep learning , 2019, Medical Image Anal..

[26]  Timothy J. O'Shea,et al.  Deep architectures for modulation recognition , 2017, 2017 IEEE International Symposium on Dynamic Spectrum Access Networks (DySPAN).

[27]  Nandkishor P. Karlekar,et al.  Ontology and Hybrid Optimization Based SVNN for Privacy Preserved Medical Data Classification in Cloud , 2019, Int. J. Artif. Intell. Tools.

[28]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[29]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[30]  Hang Zhou,et al.  Deep learning based multi-temporal crop classification , 2019, Remote Sensing of Environment.

[31]  Ana B. Porto-Pazos,et al.  Deep Artificial Neural Networks and Neuromorphic Chips for Big Data Analysis: Pharmaceutical and Bioinformatics Applications , 2016, International journal of molecular sciences.

[32]  El-Sayed M. El-Horbaty,et al.  Classification using deep learning neural networks for brain tumors , 2017, Future Computing and Informatics Journal.

[33]  Jun-Hai Zhai,et al.  Ensemble dropout extreme learning machine via fuzzy integral for data classification , 2018, Neurocomputing.

[34]  Philip S. Yu,et al.  Anonymizing Classification Data for Privacy Preservation , 2007, IEEE Transactions on Knowledge and Data Engineering.

[35]  Chongqing Kang,et al.  Deep Learning-Based Socio-Demographic Information Identification From Smart Meter Data , 2019, IEEE Transactions on Smart Grid.

[36]  M. Shamim Hossain,et al.  Environment Classification for Urban Big Data Using Deep Learning , 2018, IEEE Communications Magazine.

[37]  Jan Boehm,et al.  A review on deep learning techniques for 3D sensed data classification , 2019, Remote. Sens..