A reduced and comprehensible polynomial neural network for classification

It has been found that in solving classification task, the polynomial neural network (PNN) needs more computation time, as the partial descriptions (the heart of PNN) in each layer grow very fast. At the same time the complexity of the network also increases as the number of layers increases. In this context we propose a reduced and comprehensible polynomial neural network (RCPNN) for the task of classification for which partial descriptions have been developed only for a single layer of the PNN architecture and the output of these partial descriptions along with the features are fed to the output layer of the RCPNN having only one neuron. The weights between hidden layer and output layer have optimized by two different methods such as gradient descent and particle swarm optimization (PSO). A comparative performance in terms of computational cost and accuracy of PSO trained RCPNN and non-PSO (i.e. gradient descent) trained RCPNN with PNN has been given to prove the same. Our experimental results show that the performance in terms of cost and accuracy of the proposed RCPNN trained with PSO and gradient decent is more efficient than the PNN model.

[1]  J. Ross Quinlan,et al.  C4.5: Programs for Machine Learning , 1992 .

[2]  Stanley J. Farlow,et al.  Self-Organizing Methods in Modeling: Gmdh Type Algorithms , 1984 .

[3]  Russell C. Eberhart,et al.  Parameter Selection in Particle Swarm Optimization , 1998, Evolutionary Programming.

[4]  R. W. Dobbins,et al.  Computational intelligence PC tools , 1996 .

[5]  Hendrik Blockeel,et al.  Web mining research: a survey , 2000, SKDD.

[6]  David G. Stork,et al.  Pattern Classification , 1973 .

[7]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[8]  S. J. Farlow SEARCHING FOR STRUCTURE: THE GMDH ALGORITHM , 1984 .

[9]  Ivan Bratko,et al.  Machine Learning and Data Mining; Methods and Applications , 1998 .

[10]  G. Panda,et al.  Pattern Classification using Polynomial Neural Network , 2006, 2006 IEEE Conference on Cybernetics and Intelligent Systems.

[11]  G. Holton The new synthesis? , 1978 .

[12]  James Kennedy,et al.  The Behavior of Particles , 1998, Evolutionary Programming.

[13]  E. Wilson,et al.  Sociobiology: The New Synthesis , 1975 .

[14]  Mark M. Millonas,et al.  Swarms, Phase Transitions, and Collective Intelligence , 1993, adap-org/9306002.

[15]  Pradipta Kishore Dash,et al.  Particle Swarm Optimized Polynomials for Data Classification , 2006, Sixth International Conference on Intelligent Systems Design and Applications.

[16]  Ah Chung Tsoi,et al.  Comparison of Three Classification Techniques: CART, C4.5 and Multi-Layer Perceptrons , 1990, NIPS.

[17]  A. E. Eiben,et al.  Evolutionary Programming VII , 1998, Lecture Notes in Computer Science.

[18]  Gianna,et al.  Forecasting the Exchange Rate : A Comparison between Econometric and Neural Network Models , 2002 .

[19]  J. Ross Quinlan,et al.  Generating Production Rules from Decision Trees , 1987, IJCAI.

[20]  A. G. Ivakhnenko,et al.  Polynomial Theory of Complex Systems , 1971, IEEE Trans. Syst. Man Cybern..

[21]  Marimuthu Palaniswami,et al.  Computational Intelligence: A Dynamic System Perspective , 1995 .

[22]  Hermilson Velásquez Ceballos,et al.  Econometric and neural network model forecasts: the case of SURAMINV stock , 2009 .

[23]  F. Lemke,et al.  GMDH algorithms for complex systems modelling , 1998 .

[24]  Hannu Toivonen,et al.  Data Mining In Bioinformatics , 2005 .

[25]  Pierre Baldi,et al.  Bioinformatics - the machine learning approach (2. ed.) , 2000 .

[26]  Russell C. Eberhart,et al.  Comparison between Genetic Algorithms and Particle Swarm Optimization , 1998, Evolutionary Programming.

[27]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[28]  Peter J. Angeline,et al.  Evolutionary Optimization Versus Particle Swarm Optimization: Philosophy and Performance Differences , 1998, Evolutionary Programming.

[29]  Yue Shi,et al.  A modified particle swarm optimizer , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[30]  Krzysztof Ostaszewski,et al.  Fuzzy Techniques of Pattern Recognition in Risk and Claim Classification , 1995 .

[31]  Craig W. Reynolds Flocks, herds, and schools: a distributed behavioral model , 1998 .