Ensembles of Neural Networks Based on the Alteration of Input Feature Values

An ensemble performs well when the component classifiers are diverse yet accurate, so that the failure of one is compensated for by others. A number of methods have been investigated for constructing ensemble in which some of them train classifiers with the generated patterns. This study investigates a new technique of training pattern generation. The method alters input feature values of some patterns using the values of other patterns to generate different patterns for different classifiers. The effectiveness of neural network ensemble based on the proposed technique was evaluated using a suite of 25 benchmark classification problems, and was found to achieve performance better than or competitive with related conventional methods. Experimental investigation of different input values alteration techniques finds that alteration with pattern values in the same class is better for generalization, although other alteration techniques may offer more diversity.

[1]  T. Martin McGinnity,et al.  An STDP Training Algorithm for a Spiking Neural Network with Dynamic Threshold Neurons , 2010, Int. J. Neural Syst..

[2]  U. Rajendra Acharya,et al.  Automatic Identification of Epileptic and Background EEG Signals Using Frequency Domain Parameters , 2010, Int. J. Neural Syst..

[3]  Alessandro E. P. Villa,et al.  Emergence of Preferred Firing Sequences in Large Spiking Neural Networks during Simulated Neuronal Development , 2008, Int. J. Neural Syst..

[4]  Kazuyuki Murase,et al.  A Comparative Study of Data Sampling Techniques for Constructing Neural Network Ensembles , 2009, Int. J. Neural Syst..

[5]  Hojjat Adeli,et al.  A probabilistic neural network for earthquake magnitude prediction , 2009, Neural Networks.

[6]  Eric Bauer,et al.  An Empirical Comparison of Voting Classification Algorithms: Bagging, Boosting, and Variants , 1999, Machine Learning.

[7]  Hojjat Adeli,et al.  A new supervised learning algorithm for multiple spiking neural networks with application in epilepsy and seizure detection , 2009, Neural Networks.

[8]  Mykola Pechenizkiy,et al.  Diversity in search strategies for ensemble feature selection , 2005, Inf. Fusion.

[9]  Snjezana Soltic,et al.  Knowledge Extraction from Evolving Spiking Neural Networks with Rank Order Population Coding , 2010, Int. J. Neural Syst..

[10]  Hojjat Adeli,et al.  Improved spiking neural networks for EEG classification and epilepsy and seizure detection , 2007, Integr. Comput. Aided Eng..

[11]  Michael Defoin-Platel,et al.  On the Probabilistic Optimization of Spiking Neural Networks , 2010, Int. J. Neural Syst..

[12]  Daniel Hernández-Lobato,et al.  Class-switching neural network ensembles , 2008, Neurocomputing.

[13]  Amanda J. C. Sharkey,et al.  On Combining Artificial Neural Nets , 1996, Connect. Sci..

[14]  Hojjat Adeli,et al.  Enhanced probabilistic neural network with local decision circles: A robust classifier , 2010, Integr. Comput. Aided Eng..

[15]  Guang-Bin Huang,et al.  Classification ability of single hidden layer feedforward neural networks , 2000, IEEE Trans. Neural Networks Learn. Syst..

[16]  Anila Jahangiri,et al.  Phase resetting Analysis of High potassium epileptiform Activity in CA3 Region of the rat Hippocampus , 2011, Int. J. Neural Syst..

[17]  Eric Nichols,et al.  Case Study on a Self-Organizing Spiking Neural Network for Robot Navigation , 2010, Int. J. Neural Syst..

[18]  Ezequiel López-Rubio,et al.  Foreground Detection in Video Sequences with Probabilistic Self-Organizing Maps , 2011, Int. J. Neural Syst..

[19]  Xin Yao,et al.  A constructive algorithm for training cooperative neural network ensembles , 2003, IEEE Trans. Neural Networks.

[20]  Tianyou Chai,et al.  Cascade Process Modeling with Mechanism-Based Hierarchical Neural Networks , 2010, Int. J. Neural Syst..

[21]  Anurag Pande,et al.  A Computing Approach Using Probabilistic Neural Networks for Instantaneous Appraisal of Rear‐End Crash Risk , 2008, Comput. Aided Civ. Infrastructure Eng..

[22]  D. Opitz,et al.  Popular Ensemble Methods: An Empirical Study , 1999, J. Artif. Intell. Res..

[23]  Patrick Henaff,et al.  Muscle Emulation with DC Motor and Neural Networks for Biped Robots , 2010, Int. J. Neural Syst..

[24]  Diego Andina,et al.  Artificial Metaplasticity Neural Network Applied to Credit Scoring , 2011, Int. J. Neural Syst..

[25]  Noel Lopes,et al.  An Evaluation of Multiple Feed-Forward Networks on GPUs , 2011, Int. J. Neural Syst..

[26]  Silvia Tolu,et al.  Adaptive cerebellar Spiking Model Embedded in the Control Loop: Context Switching and Robustness against noise , 2011, Int. J. Neural Syst..

[27]  Tin Kam Ho,et al.  The Random Subspace Method for Constructing Decision Forests , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[28]  Tshilidzi Marwala,et al.  Caller Behaviour Classification Using Computational Intelligence Methods , 2010, Int. J. Neural Syst..

[29]  Antoni Morro,et al.  Chaos-Based Mixed Signal Implementation of Spiking Neurons , 2009, Int. J. Neural Syst..

[30]  Hojjat Adeli,et al.  Spiking Neural Networks , 2009, Int. J. Neural Syst..

[31]  Raymond J. Mooney,et al.  Creating diversity in ensembles using artificial data , 2005, Inf. Fusion.

[32]  Adnan Khashman,et al.  A Neural Network Model for Credit Risk Evaluation , 2009, Int. J. Neural Syst..

[33]  Milos Borenovic,et al.  Space Partitioning Strategies for Indoor WLAN Positioning with Cascade-Connected ANN Structures , 2011, Int. J. Neural Syst..

[34]  Gonzalo Martínez-Muñoz,et al.  Switching class labels to generate classification ensembles , 2005, Pattern Recognit..

[35]  T. Martin McGinnity,et al.  An FPGA Hardware/Software Co-Design towards Evolvable Spiking Neural Networks for Robotics Application , 2010, Int. J. Neural Syst..

[36]  Berj L. Bardakjian,et al.  Responsive Neuromodulators Based on Artificial Neural Networks Used to Control Seizure-like Events in a Computational Model of Epilepsy , 2011, Int. J. Neural Syst..

[37]  Xin Yao,et al.  Ensemble learning via negative correlation , 1999, Neural Networks.

[38]  Alexander K. Vidybida,et al.  Testing of information condensation in a model reverberating spiking neural network , 2010, Int. J. Neural Syst..

[39]  Yonggwan Won,et al.  An Improvement of Extreme Learning Machine for Compact Single-Hidden-Layer Feedforward Neural Networks , 2008, Int. J. Neural Syst..

[40]  Tony R. Martinez,et al.  Improving Supervised Learning by Adapting the Problem to the Learner , 2009, Int. J. Neural Syst..