Novelty detection is a machine learning technique which identifies new or unknown information in data sets. We present our current work on the construction of a new novelty detector based on a dynamical version of predictive coding. We compare three evolutionary algorithms, a simple genetic algorithm, NEAT and FS-NEAT, for the task of optimising the structure of an illustrative dynamic predictive coding neural network to improve its performance over stimuli from a number of artificially generated visual environments. We find that NEAT performs more reliably than the other two algorithms in this task and evolves the netwo rk with the highest fitness. However, both NEAT and FS-NEAT fail to evolve a network with a significantly higher fitness than the best network evolved by the simple genetic algorithm. The best network evolved demonstrates a more consistent performance over a broader range of inputs than the original network. We also examine the robustness of this network to noise and find that it handles low levels reasonably well, but is outperformed by the illustrative network when the level of noise is increased.
[1]
J. Jiang,et al.
Image compression with neural networks - A survey
,
1999,
Signal Process. Image Commun..
[2]
Risto Miikkulainen,et al.
Automatic feature selection in neuroevolution
,
2005,
GECCO '05.
[3]
Stephen R. Marsland,et al.
A self-organising network that grows when required
,
2002,
Neural Networks.
[4]
Stephen R. Marsland,et al.
On-line novelty detection for autonomous mobile robots
,
2005,
Robotics Auton. Syst..
[5]
Sameer Singh,et al.
Novelty detection: a review - part 1: statistical approaches
,
2003,
Signal Process..
[6]
Sameer Singh,et al.
Novelty detection: a review - part 2: : neural network based approaches
,
2003,
Signal Process..
[7]
M. Meister,et al.
Dynamic predictive coding by the retina
,
2005,
Nature.