An evolutionary tuned driving system for virtual car racing games: The AUTOPIA driver

This work presents a driving system designed for virtual racing situations. It is based on a complete modular architecture capable of automatically driving a car along a track with or without opponents. The architecture is composed of intuitive modules, with each one being responsible for a basic aspect of car driving. Moreover, this modularity of the architecture will allow us to replace or add modules in the future as a way to enhance particular features of particular situations. In the present work, some of the modules are implemented by means of hand‐designed driving heuristics, whereas modules responsible for adapting the speed and direction of the vehicle to the track's shape, both critical aspects of driving a vehicle, are optimized by means of a genetic algorithm that evaluates the performance of the controller in four different tracks to obtain the best controller in a large number of situations; the algorithm also penalizes controllers that go out of the track, lose control, or get damaged. The evaluation of the performance is done in two ways. First, in runs with and without adversaries over several tracks. And second, the architecture was submitted as a participant to the 2010 Simulated Car Racing Competition, which in end won laurels. © 2012 Wiley Periodicals, Inc.

[1]  Julian Togelius,et al.  The 2009 Simulated Car Racing Championship , 2010, IEEE Transactions on Computational Intelligence and AI in Games.

[2]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[3]  Pedro Isasi Viñuela,et al.  Evolving a rule system controller for automatic driving in a car racing competition , 2008, 2008 IEEE Symposium On Computational Intelligence and Games.

[4]  Simon M. Lucas,et al.  Computational Intelligence and AI in Games: A New IEEE Transactions , 2009, IEEE Transactions on Computational Intelligence and AI in Games.

[5]  Lakhmi C. Jain,et al.  Advanced Intelligent Paradigms in Computer Games , 2007, Advanced Intelligent Paradigms in Computer Games.

[6]  Pedro Isasi Viñuela,et al.  Evolving a fuzzy controller for a Car Racing Competition , 2009, 2009 IEEE Symposium on Computational Intelligence and Games.

[7]  Stuart J. Russell,et al.  On Optimal Game-Tree Search using Rational Meta-Reasoning , 1989, IJCAI.

[8]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[9]  Julian Togelius,et al.  The 2007 IEEE CEC simulated car racing competition , 2008, Genetic Programming and Evolvable Machines.

[10]  Andrea Bonarini,et al.  Modeling enjoyment preference from physiological responses in a car racing game , 2010, Proceedings of the 2010 IEEE Conference on Computational Intelligence and Games.

[11]  Marc Ebner,et al.  Evolving driving controllers using Genetic Programming , 2009, 2009 IEEE Symposium on Computational Intelligence and Games.

[12]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[13]  Martin V. Butz,et al.  Optimized sensory-motor couplings plus strategy extensions for the TORCS car racing challenge , 2009, 2009 IEEE Symposium on Computational Intelligence and Games.

[14]  Daniele Loiacono,et al.  Learning to Drive in the Open Racing Car Simulator Using Online Neuroevolution , 2010, IEEE Transactions on Computational Intelligence and AI in Games.

[15]  Daniele Loiacono,et al.  Simulated Car Racing Championship: Competition Software Manual , 2013, ArXiv.

[16]  Oliver Kramer,et al.  Learning the track and planning ahead in a car racing controller , 2010, Proceedings of the 2010 IEEE Conference on Computational Intelligence and Games.

[17]  Goldberg,et al.  Genetic algorithms , 1993, Robust Control Systems with Genetic Algorithms.

[18]  Vicente Milanés Montero,et al.  A modular parametric architecture for the TORCS racing engine , 2009, 2009 IEEE Symposium on Computational Intelligence and Games.

[19]  Francisco Herrera,et al.  Tackling Real-Coded Genetic Algorithms: Operators and Tools for Behavioural Analysis , 1998, Artificial Intelligence Review.

[20]  Julian Togelius,et al.  The WCCI 2008 simulated car racing competition , 2008, 2008 IEEE Symposium On Computational Intelligence and Games.

[21]  Daniele Loiacono,et al.  Evolving competitive car controllers for racing games with neuroevolution , 2009, GECCO '09.

[22]  Araceli Sanchis,et al.  Controller for TORCS created by imitation , 2009, 2009 IEEE Symposium on Computational Intelligence and Games.

[23]  Simon M. Lucas.  Computational intelligence and games: Challenges and opportunities , 2008, Int. J. Autom. Comput..

[24]  Julian Togelius,et al.  Computational Intelligence in Racing Games , 2007, Advanced Intelligent Paradigms in Computer Games.

[25]  Araceli Sanchis,et al.  A human-like TORCS controller for the Simulated Car Racing Championship , 2010, Proceedings of the 2010 IEEE Conference on Computational Intelligence and Games.

[26]  Daniele Loiacono,et al.  Learning to overtake in TORCS using simple reinforcement learning , 2010, IEEE Congress on Evolutionary Computation.

[27]  Daniele Loiacono,et al.  Overtaking opponents with blocking strategies using fuzzy logic , 2010, Proceedings of the 2010 IEEE Conference on Computational Intelligence and Games.