Exploratory data analysis with artificial immune systems

We use a modified version of the CLONALG algorithm to perform exploratory data analysis. Since we wish to compare results from a number of methods, we only report on linear projections which have unique solutions. We incorporate a type of Gram Schmidt orthogonalisation [15] into the affinity maturation process to capture multiple components. We combine the new algorithm with reinforcement learning [17, 20] and with cross entropy maximization [13, 19]. Finally we combine several different non-standard adaptation methods using bagging and show that we get reliable convergence to accurate filters.

[1]  Leo Breiman,et al.  Bagging Predictors , 1996, Machine Learning.

[2]  S. T. Buckland,et al.  An Introduction to the Bootstrap. , 1994 .

[3]  S. Roberts,et al.  Confidence Intervals and Prediction Intervals for Feed-Forward Neural Networks , 2001 .

[4]  C. Fyfe,et al.  Pre-processing using Topographic Mappings , 2005, 2005 International Conference on Neural Networks and Brain.

[5]  James Brian Quinn,et al.  Technology in services , 1987 .

[6]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[7]  Lai-Wan Chan,et al.  Dimension reduction as a deflation method in ICA , 2006, IEEE Signal Process. Lett..

[8]  E. Oja,et al.  Independent Component Analysis , 2013 .

[9]  Andrzej Cichocki,et al.  A New Learning Algorithm for Blind Signal Separation , 1995, NIPS.

[10]  Robert P. W. Duin,et al.  Bagging, Boosting and the Random Subspace Method for Linear Classifiers , 2002, Pattern Analysis & Applications.

[11]  Fernando José Von Zuben,et al.  Learning and optimization using the clonal selection principle , 2002, IEEE Trans. Evol. Comput..

[12]  G L Ada,et al.  The clonal-selection theory. , 1987, Scientific American.

[13]  I. Jolliffe.  Principal Component Analysis , 2002 .

[14]  Colin Fyfe,et al.  A neural implementation of canonical correlation analysis , 1999, Neural Networks.

[15]  F. Burnet.  The clonal selection theory of acquired immunity , 1959 .

[16]  Ying Wu,et al.  Stochastic Weights Reinforcement Learning for Exploratory Data Analysis , 2007, ICANN.

[17]  Baoqiang Wang,et al.  A New FastICA Algorithm with Symmetric Orthogonalization , 2006, 2006 International Conference on Communications, Circuits and Systems.