Searching for the optimal racing line using genetic algorithms

Finding the racing line to follow on the track is at the root of the development of any controller in racing games. In commercial games this issue is usually addressed by using human-designed racing lines provided by domain experts and represents a rather time consuming process. In this paper we introduce a novel approach to compute the racing line without any human intervention. In the proposed approach, the track is decomposed into several segments where a genetic algorithm is applied to search for the best trade-off between the minimization of two conflicting objectives: the length and the curvature of the racing line. The fitness of the candidate solutions is computed through a simulation performed with The Open Racing Car Simulator (TORCS), an open source simulator used as testbed in this work. Finally, to test our approach we carried out an experimental analysis that involved 11 tracks provided with the TORCS distribution. In addition, we compared the performance of our approach to the one achieved by a related approach, previously introduced in the literature, and to the performance of the fastest controller available for TORCS. Our results are very promising and show that the presented approach is able to reach the best performance in almost all the tracks considered.

[1]  Araceli Sanchis,et al.  Controller for TORCS created by imitation , 2009, 2009 IEEE Symposium on Computational Intelligence and Games.

[2]  Yutaka Kanayama,et al.  Smooth local path planning for autonomous vehicles , 1989, Proceedings, 1989 International Conference on Robotics and Automation.

[3]  Stefano Lecchi.  Artificial intelligence in racing games , 2009, 2009 IEEE Symposium on Computational Intelligence and Games.

[4]  D. Casanova,et al.  On minimum time vehicle manoeuvring: the theoretical optimal lap , 2000 .

[5]  Vicente Milanés Montero,et al.  A modular parametric architecture for the TORCS racing engine , 2009, 2009 IEEE Symposium on Computational Intelligence and Games.

[6]  Katsushi Ikeuchi,et al.  Trajectory generation with curvature constraint based on energy minimization , 1991, Proceedings IROS '91:IEEE/RSJ International Workshop on Intelligent Robots and Systems '91.

[7]  Daniele Loiacono,et al.  On-line neuroevolution applied to The Open Racing Car Simulator , 2009, 2009 IEEE Congress on Evolutionary Computation.

[8]  Pedro Isasi Viñuela,et al.  Evolving a fuzzy controller for a Car Racing Competition , 2009, 2009 IEEE Symposium on Computational Intelligence and Games.

[9]  Daniele Loiacono,et al.  Learning drivers for TORCS through imitation using supervised methods , 2009, 2009 IEEE Symposium on Computational Intelligence and Games.

[10]  F. G. Pin,et al.  Autonomous Trajectory Generation for Mobile Robots with Non-Holonomic and Steering Angle Constraints , 1990, Proceedings of the IEEE International Workshop on Intelligent Motion Control.

[11]  Martin V. Butz,et al.  Optimized sensory-motor couplings plus strategy extensions for the TORCS car racing challenge , 2009, 2009 IEEE Symposium on Computational Intelligence and Games.

[12]  Yutaka Kanayama,et al.  Trajectory generation for mobile robots , 1984 .

[13]  Francesco Braghin,et al.  Race driver model , 2008 .

[14]  Christos Dimitrakakis,et al.  Online statistical estimation for vehicle control , 2006 .

[15]  Marc Ebner,et al.  Evolving driving controllers using Genetic Programming , 2009, 2009 IEEE Symposium on Computational Intelligence and Games.

[16]  Yutaka Kanayama,et al.  A locomotion control method for autonomous vehicles , 1988, Proceedings. 1988 IEEE International Conference on Robotics and Automation.

[17]  Kazuo Tanie,et al.  Trajectory Design and Control of a Wheel-type Mobile Robot Using B-spline Curve , 1989, Proceedings. IEEE/RSJ International Workshop on Intelligent Robots and Systems '. (IROS '89) 'The Autonomous Mobile Robots and Its Applications.

[18]  Mohammad Taghi Manzuri,et al.  Real-Time Trajectory Generation for Mobile Robots , 2007, AI*IA.

[19]  Julian Togelius,et al.  The WCCI 2008 simulated car racing competition , 2008, 2008 IEEE Symposium On Computational Intelligence and Games.

[20]  Daniele Loiacono,et al.  Evolving competitive car controllers for racing games with neuroevolution , 2009, GECCO '09.

[21]  Rémi Coulom,et al.  Reinforcement Learning Using Neural Networks, with Applications to Motor Control. (Apprentissage par renforcement utilisant des réseaux de neurones, avec des applications au contrôle moteur) , 2002 .

[22]  A. Kelly,et al.  TRAJECTORY GENERATION FOR CAR-LIKE ROBOTS USING CUBIC CURVATURE POLYNOMIALS , 2001 .

[23]  Julian Togelius,et al.  Robust player imitation using multiobjective evolution , 2009, 2009 IEEE Congress on Evolutionary Computation.