A New Neural Dynamic Classification Algorithm

The keys for the development of an effective classification algorithm are: 1) discovering feature spaces with large margins between clusters and close proximity of the classmates and 2) discovering the smallest number of the features to perform accurate classification. In this paper, a new supervised classification algorithm, called neural dynamic classification (NDC), is presented with the goal of: 1) discovering the most effective feature spaces and 2) finding the optimum number of features required for accurate classification using the patented robust neural dynamic optimization model of Adeli and Park. The new classification algorithm is compared with the probabilistic neural network (PNN), enhanced PNN (EPNN), and support vector machine using two sets of classification problems. The first set consists of five standard benchmark problems. The second set is a large benchmark problem called Mixed National Institute of Standards and Technology database of handwritten digits. In general, NDC yields the most accurate classification results followed by EPNN. A beauty of the new algorithm is the smoothness of convergence curves which is an indication of robustness and good performance of the algorithm. The main aim is to maximize the prediction accuracy.

[1]  Nazmul Siddique,et al.  Computational Intelligence: Synergies of Fuzzy Logic, Neural Networks and Evolutionary Computing , 2013 .

[2]  Eric P. Xing,et al.  Nonextensive Information Theoretic Kernels on Measures , 2009, J. Mach. Learn. Res..

[3]  Hojjat Adeli,et al.  Enhanced probabilistic neural network with local decision circles: A robust classifier , 2010, Integr. Comput. Aided Eng..

[4]  Christian Igel,et al.  Evolutionary tuning of multiple SVM parameters , 2005, ESANN.

[5]  Sami F. Masri,et al.  Studies into Computational Intelligence and Evolutionary Approaches for Model‐Free Identification of Hysteretic Systems , 2015, Comput. Aided Civ. Infrastructure Eng..

[6]  Yinan Yu,et al.  A robust subspace classification scheme based on empirical intersection removal and sparse approximation , 2015, Integr. Comput. Aided Eng..

[7]  Hojjat Adeli,et al.  RADIAL BASIS FUNCTION NEURAL NETWORK FOR WORK ZONE CAPACITY AND QUEUE ESTIMATION , 2003 .

[8]  Seungmin Rho,et al.  Classification and indexing scheme of large-scale image repository for spatio-temporal landmark recognition , 2015, Integr. Comput. Aided Eng..

[9]  Nicolás Marín,et al.  An Approach for the Automatic Classification of Work Descriptions in Construction Projects , 2015, Comput. Aided Civ. Infrastructure Eng..

[10]  Hojjat Adeli,et al.  A Novel Methodology for Extracting and Evaluating Therapeutic Movements in Game-Based Motion Capture Rehabilitation Systems , 2018, Journal of Medical Systems.

[11]  Hojjat Adeli,et al.  Resource Scheduling Using Neural Dynamics Model of Adeli and Park , 2001 .

[12]  U. Rajendra Acharya,et al.  Computer aided diagnosis of atrial arrhythmia using dimensionality reduction methods on transform domain representation , 2014, Biomed. Signal Process. Control..

[13]  David Arditi,et al.  An Advanced Stochastic Time‐Cost Tradeoff Analysis Based on a CPM‐Guided Genetic Algorithm , 2015, Comput. Aided Civ. Infrastructure Eng..

[14]  Hyo Seon Park,et al.  A neural dynamics model for structural optimization—Application to plastic design of structures , 1995 .

[15]  Alicia Troncoso Lora,et al.  Enhancing the scalability of a genetic algorithm to discover quantitative association rules in large-scale datasets , 2015, Integr. Comput. Aided Eng..

[16]  Hojjat Adeli,et al.  Computer-Aided Diagnosis of Parkinson’s Disease Using Enhanced Probabilistic Neural Network , 2015, Journal of Medical Systems.

[17]  Ambedkar Dukkipati,et al.  Learning With Jensen-Tsallis Kernels , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[18]  Weidong Zhou,et al.  Multifractal Analysis and Relevance Vector Machine-Based Automatic Seizure Detection in Intracranial EEG , 2015, Int. J. Neural Syst..

[19]  Hojjat Adeli,et al.  Distributed neural dynamics algorithms for optimization of large steel structures , 1997 .

[20]  Hojjat Adeli,et al.  Advances in optimization of highrise building structures , 2014 .

[21]  Hojjat Adeli,et al.  Comparison of fuzzy-wavelet radial basis function neural network freeway incident detection model with California algorithm , 2002 .

[22]  Raimondo Betti,et al.  A Hybrid Optimization Algorithm with Bayesian Inference for Probabilistic Model Updating , 2015, Comput. Aided Civ. Infrastructure Eng..

[23]  Min Zhang,et al.  A New Classification Algorithm Based on Emerging Patterns , 2016 .

[24]  Geoffrey E. Hinton,et al.  Speech recognition with deep recurrent neural networks , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[25]  Hojjat Adeli,et al.  Regularization neural network for construction cost estimation , 1998 .

[26]  Asim Karim,et al.  OO Information Model for Construction Project Management , 1999 .

[27]  Hojjat Adeli,et al.  Optimum cost design of reinforced concrete slabs using neural dynamics model , 2005, Eng. Appl. Artif. Intell..

[28]  Hojjat Adeli,et al.  Distributed Computer-Aided Engineering: For Analysis, Design, and Visualization , 1998 .

[29]  A. Tashakori,et al.  Optimum design of cold-formed steel space structures using neural dynamics model , 2002 .

[30]  Asim Karim,et al.  CONSCOM: An OO Construction Scheduling and Change Management System , 1999 .

[31]  H. Adeli,et al.  Wavelet-based EEG processing for computer-aided seizure detection and epilepsy diagnosis , 2015, Seizure.

[32]  Maria do Carmo Nicoletti,et al.  Automatic learning of image filters using Cartesian genetic programming , 2015, Integr. Comput. Aided Eng..

[33]  Chris Cornelis,et al.  Improving nearest neighbor classification using Ensembles of Evolutionary Generated Prototype Subsets , 2016, Appl. Soft Comput..

[34]  Hojjat Adeli,et al.  Optimization of space structures by neural dynamics , 1995, Neural Networks.

[35]  Hojjat Adeli,et al.  Probabilistic neural networks for diagnosis of Alzheimer's disease using conventional and wavelet coherence , 2011, Journal of Neuroscience Methods.

[36]  Hui Wang,et al.  Bayesian Modeling of External Corrosion in Underground Pipelines Based on the Integration of Markov Chain Monte Carlo Techniques and Clustered Inspection Data , 2015, Comput. Aided Civ. Infrastructure Eng..

[37]  Hojjat Adeli,et al.  Machine Learning: Neural Networks, Genetic Algorithms, and Fuzzy Systems , 1994 .

[38]  Hojjat Adeli,et al.  A neural dynamics model for structural optimization—Theory , 1995 .

[39]  C. M. Tam,et al.  Diagnosis of prestressed concrete pile defects using probabilistic neural networks , 2004 .

[40]  Francisco Herrera,et al.  Fuzzy nearest neighbor algorithms: Taxonomy, experimental analysis and prospects , 2014, Inf. Sci..

[41]  Hojjat Adeli,et al.  A probabilistic neural network for earthquake magnitude prediction , 2009, Neural Networks.

[42]  Hyo Seon Park,et al.  Neurocomputing for Design Automation , 2018 .

[43]  Jui-Sheng Chou,et al.  Smart Artificial Firefly Colony Algorithm‐Based Support Vector Regression for Enhanced Forecasting in Civil Engineering , 2015, Comput. Aided Civ. Infrastructure Eng..

[44]  Nafiz Arica,et al.  Classification of Obsessive Compulsive Disorder by EEG Complexity and Hemispheric Dependency Measurements , 2015, Int. J. Neural Syst..

[45]  Andreas Schulze-Bonhage,et al.  Early Seizure Detection Algorithm Based on Intracranial EEG and Random Forest Classification , 2015, Int. J. Neural Syst..

[46]  Enrique F. Castillo,et al.  Distributed One-Class Support Vector Machine , 2015, Int. J. Neural Syst..

[47]  Laura Diosan,et al.  Improving classification performance of Support Vector Machine by genetically optimising kernel shape and hyper-parameters , 2010, Applied Intelligence.

[48]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.