An adaptive algorithm for drifting environments is proposed and tested in simulated environments. Two powerful problem solving technologies namely Neural Networks and Genetic Algorithms are combined to produce intelligent agents that can adapt to changing environments. Online learning enables the intelligent agents to capture the dynamics of changing environments efficiently. The algorithm's efficiency is demonstrated using a mine sweeper application. The results demonstrate that online learning within the evolutionary process is the most significant factor for adaptation and is far superior to evolutionary algorithms alone. The evolution and learning work in a cooperating fashion to produce best results in short time. It is also demonstrated that online learning is self sufficient and can achieve results without any pre-training stage. When mine sweepers are able to learn online, their performance in the drifting environment is significantly improved. Offline learning is observed to increase the average fitness of the whole population.
[1]
Xin Yao,et al.
Evolving artificial neural networks
,
1999,
Proc. IEEE.
[2]
Nikola Kasabov,et al.
Evolving Connectionist Systems: Methods and Applications in Bioinformatics, Brain Study and Intelligent Machines
,
2002,
IEEE Transactions on Neural Networks.
[3]
Khosrow Kaikhah,et al.
Incremental Evolution of Trainable Neural Networks that are Backwards Compatible
,
2006,
Artificial Intelligence and Applications.
[4]
George D. Magoulas,et al.
Hybrid methods using evolutionary algorithms for on-line training
,
2001,
IJCNN'01. International Joint Conference on Neural Networks. Proceedings (Cat. No.01CH37222).
[5]
Risto Miikkulainen,et al.
Evolving Neural Networks through Augmenting Topologies
,
2002,
Evolutionary Computation.