Evolving Controllers for Simulated Car Racing Using Differential Evolution

This paper presents an initial approach for creating autonomous controllers for the car racing game using a hybrid technique. The Differential Evolution (DE) algorithm is combined with Feed-forward Artificial Neural Networks (FFANNs) to generate the required intelligent controllers in a well-known car racing game, namely The Open Racing Car Simulator (TORCS). TORCS is used as a platform in most of the IEEE conference competitions. The main objective of this research is to test the feasibility of the DE implementation in TORCS platform. The literature showed that the application of DE in Real Time Strategy game returned promising results in evolving the required strategy gaming controllers. Interestingly, there is still no study thus far that has been conducted in applying DE into TORCS game platform. This research result shows that DE performed well in TORCS even though a very simple fitness function was used. This indicates that DE has well-tuned the neural network weights to generate optimal and sub-optimal controllers in TORCS.

[1]  Julian Togelius,et al.  Evolving controllers for simulated car racing using object oriented genetic programming , 2007, GECCO '07.

[2]  Chin Kim On,et al.  Infinite Mario Bross AI using Genetic Algorithm , 2011, 2011 IEEE Conference on Sustainable Utilization and Development in Engineering and Technology (STUDENT).

[3]  Jouni Lampinen,et al.  A Fuzzy Adaptive Differential Evolution Algorithm , 2005, Soft Comput..

[4]  Julian Togelius,et al.  Evolving controllers for simulated car racing , 2005, 2005 IEEE Congress on Evolutionary Computation.

[5]  Joni-Kristian Kämäräinen,et al.  Differential Evolution Training Algorithm for Feed-Forward Neural Networks , 2003, Neural Processing Letters.

[6]  Araceli Sanchis,et al.  Multi-objective evolution for Car Setup Optimization , 2010, 2010 UK Workshop on Computational Intelligence (UKCI).

[7]  Chang Kee Tong,et al.  Automatic generation of real time strategy tournament units using differential evolution , 2011, 2011 IEEE Conference on Sustainable Utilization and Development in Engineering and Technology (STUDENT).

[8]  Pedro Isasi Viñuela,et al.  Evolving a fuzzy controller for a Car Racing Competition , 2009, 2009 IEEE Symposium on Computational Intelligence and Games.

[9]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[10]  Daniele Loiacono,et al.  Evolving competitive car controllers for racing games with neuroevolution , 2009, GECCO '09.

[11]  Chin Kim On,et al.  Evolution and analysis of self-synthesized minimalist neural controllers for collective robotics using Pareto multi-objective optimization , 2010, IEEE Congress on Evolutionary Computation.

[12]  Chin Kim On,et al.  Multi-objective artificial evolution of RF-localization behavior and neural structures in mobile robots , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[13]  Daniele Loiacono,et al.  Simulated Car Racing Championship: Competition Software Manual , 2013, ArXiv.

[14]  Chang Kee Tong,et al.  The Evolution of Gamebots for 3D First Person Shooter (FPS) , 2011, 2011 Sixth International Conference on Bio-Inspired Computing: Theories and Applications.

[15]  Chin Kim On,et al.  An Evolutionary Multi-objective Optimization Approach to Computer Go Controller Synthesis , 2012, PRICAI.