NVIS: an interactive visualization tool for neural networks

This paper presents NVIS, an interactive graphical tool used to examine the weights, topology, and activations of a single artificial neural networks (ANN), as well as the genealogical relationships between members of a population of ANNs as they evolve under an evolutionary algorithm. NVIS is unique in its depiction of nodal activation values, its usage of family tree diagrams to indicate the origin of individual networks, and the degree of interactivity it allows the user while the learning process takes place. The authors have made use of these feature to obtain insights into both the workings of single neural networks and the evolutionary process, based upon which we consider NVIS to be an effective visualization tool of value to designers, users, and students of ANNs.

[1]  D. Rubinfeld,et al.  Hedonic housing prices and the demand for clean air , 1978 .

[2]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[3]  George G. Robertson,et al.  Parallel Implementation of Genetic Algorithms in a Classifier Rystem , 1987, ICGA.

[4]  Peter M. Todd,et al.  Designing Neural Networks using Genetic Algorithms , 1989, ICGA.

[5]  John R. Koza,et al.  Genetic programming: a paradigm for genetically breeding populations of computer programs to solve problems , 1990 .

[6]  Garrison W. Cottrell,et al.  Extracting features from faces using compression networks: Face , 1990 .

[7]  Jeff Beddow,et al.  Shape coding of multidimensional data on a microcomputer display , 1990, Proceedings of the First IEEE Conference on Visualization: Visualization `90.

[8]  Frank L. Lewis,et al.  Applied Optimal Control and Estimation , 1992 .

[9]  Jude W. Shavlik,et al.  Visualizing Learning and Computation in Artificial Neural Networks , 1992, Int. J. Artif. Intell. Tools.

[10]  Dean A. Pomerleau,et al.  Knowledge-Based Training of Artificial Neural Networks for Autonomous Robot Driving , 1993 .

[11]  Hans-Paul Schwefel,et al.  Evolution and optimum seeking , 1995, Sixth-generation computer technology series.

[12]  Tzyy-Ping Jung,et al.  Using Feedforward Neural Networks to Monitor Alertness from Changes in EEG Correlation and Coherence , 1995, NIPS.

[13]  David B. Fogel,et al.  Evolutionary Computation: Towards a New Philosophy of Machine Intelligence , 1995 .

[14]  Rainer Müller,et al.  Engine Control using Neural Networks: A New Method in Engine Management Systems , 1997 .

[15]  Thomas Bäck,et al.  Evolutionary computation: Toward a new philosophy of machine intelligence , 1997, Complex..

[16]  D. Fogel.  Evolutionary algorithms in theory and practice , 1997, Complex..

[17]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[18]  David B. Fogel,et al.  Evolving neural networks to play checkers without relying on expert knowledge , 1999, IEEE Trans. Neural Networks.

[19]  Max Q.-H. Meng,et al.  An efficient neural network approach to dynamic robot motion planning , 2000, Neural Networks.