Evolutionary feature selection applied to artificial neural networks for wood-veneer classification

This paper presents the application of FeaSANNT, an evolutionary algorithm for optimization of artificial neural networks, to the training of a multi-layer perceptron for identification of defects in wood veneer. Given a fixed artificial neural network structure, FeaSANNT concurrently evolves the input feature vector and the network weights. The novelty of the method lies in the implementation of the embedded approach in an evolutionary feature selection paradigm. Experimental tests show that the proposed algorithm produces high-performing solutions with robust learning results. A significant reduction of the set of veneer features is obtained. Experimental comparisons are made with a previous method based on statistical filtering of the input features and a standard genetic wrapper algorithm. In the first case, FeaSANNT greatly reduces the feature set with no degradation of the neural network accuracy. Moreover, FeaSANNT entails lower design costs, since feature selection is fully automated. In the second case, the proposed algorithm achieves superior results in terms of identification accuracy and reduction of the feature set. FeaSANNT involves also lower computational costs than the standard evolutionary wrapper approach and eases the algorithm design effort. Limited overlapping is observed between the patterns of features selected by the three algorithms. This result suggests that the full feature set contains mainly redundant attributes.

[1]  David B. Fogel,et al.  Evolutionary Computation: Towards a New Philosophy of Machine Intelligence , 1995 .

[2]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[3]  F. Aboitiz,et al.  Mechanisms of adaptive evolution. Darwinism and Lamarckism restated. , 1992, Medical hypotheses.

[4]  Kenneth DeJong,et al.  Genetic algorithms as a tool for restructuring feature space representations , 1995, Proceedings of 7th IEEE International Conference on Tools with Artificial Intelligence.

[5]  David B. Fogel,et al.  Evolutionary computation - toward a new philosophy of machine intelligence (3. ed.) , 1995 .

[6]  Michael Sylvester Packianather,et al.  Neural Networks for Classifying Images of Wood Veneer. Part 2 , 2000 .

[7]  Michael Sylvester Packianather,et al.  Optimizing the parameters of multilayered feedforward neural networks through Taguchi design of experiments , 2000 .

[8]  David B. Fogel,et al.  Evolutionary Computation: Toward a New Philosophy of Machine Intelligence (IEEE Press Series on Computational Intelligence) , 2006 .

[9]  James L. McClelland,et al.  James L. McClelland, David Rumelhart and the PDP Research Group, Parallel distributed processing: explorations in the microstructure of cognition . Vol. 1. Foundations . Vol. 2. Psychological and biological models . Cambridge MA: M.I.T. Press, 1987. , 1989, Journal of Child Language.

[10]  James L. McClelland Explorations In Parallel Distributed Processing , 1988 .

[11]  Charles W. McMillin,et al.  Lumber defect detection abilities of furniture rough mill employees , 1985 .

[12]  Duc Truong Pham,et al.  Neural Networks for Identification, Prediction and Control , 1995 .

[13]  Brijesh Verma,et al.  Neural vs. statistical classifier in conjunction with genetic algorithm based feature selection , 2005, Pattern Recognit. Lett..

[14]  Duc Truong Pham,et al.  Automatic Detection of Defects on Birch Wood Boards , 1996 .

[15]  W. Pölzleitner,et al.  Real-time surface grading of profiled wooden boards , 1992 .

[16]  Duc Truong Pham,et al.  Plywood image segmentation using hardware-based image processing functions , 1999 .

[17]  Michael Sylvester Packianather,et al.  A decision tree of neural networks for classifying images of wood veneer , 1998 .

[18]  Pat Langley,et al.  Selection of Relevant Features and Examples in Machine Learning , 1997, Artif. Intell..

[19]  X. Yao Evolving Artificial Neural Networks , 1999 .

[20]  Larry Bull,et al.  Feature Construction and Selection Using Genetic Programming and a Genetic Algorithm , 2003, EuroGP.

[21]  Johan A. K. Suykens,et al.  Genetic Weight Optimization of a Feedforward Neural Network Controller , 1993 .

[22]  Duc Truong Pham,et al.  Automated visual inspection of wood boards: Selection of features for defect classification by a neural network , 1999 .

[23]  Duc Truong Pham,et al.  Recent Developments in Automated Visual Inspection of Wood Boards , 1999 .

[24]  Jihoon Yang,et al.  Feature Subset Selection Using a Genetic Algorithm , 1998, IEEE Intell. Syst..

[25]  R. P.,et al.  Rdvanced manufacturing Technologu A Decision Tree of Neural Networks for Classifying Images of Wood Veneer , 2022 .