On human competitiveness of the evolved agent operating a scale model of a car

We present an approach for evolutionary design of the driving style of an agent, remotely operating a scale model of a car in a human competitive way. The agent perceives the environment from an overhead video camera and conveys its actions to the car via standard radio remote control transmitter. In order to cope with the video feed latency we propose an anticipatory modeling in which the agent considers its current actions based on the anticipated intrinsic (rather than currently available, outdated) state of the car and its surrounding. We formalized the notion of driving style by defining the key parameters, which describe it, and demonstrated the feasibility of applying genetic algorithms to evolve the optimal values of these parameters. The optimized driving style, employed by the agent, is human competitive in that it yields both faster and more consistent lap times than those of a human around a predefined circuit. Presented work can be viewed as a step towards the automated design of the control software of remotely operated vehicles capable to find an optimal solution to various tasks in a priori known environmental situations. Also, the results can be seen as a verification of the feasibility of developing a framework of adaptive racing games in which the human competes against a computerized opponent with matching capabilities, both operating physical, scale models of cars.

[1]  Colin Fyfe,et al.  Improving Artificial Intelligence In a Motocross Game , 2006, 2006 IEEE Symposium on Computational Intelligence and Games.

[2]  Nick Jakobi,et al.  Minimal simulations for evolutionary robotics , 1998 .

[3]  Ivan Tanev,et al.  Evolution of the driving styles of anticipatory agent remotely operating a scaled model of racing car , 2005, 2005 IEEE Congress on Evolutionary Computation.

[4]  David E. Goldberg,et al.  Genetic Algorithms, Tournament Selection, and the Effects of Noise , 1995, Complex Syst..

[5]  D. Powell,et al.  Land-vehicle navigation using GPS , 1999, Proc. IEEE.

[6]  John R. Koza,et al.  Human-Competitive Machine Intelligence by Means of Genetic Algorithms , 2004 .

[7]  Julian Togelius,et al.  Evolving controllers for simulated car racing , 2005, 2005 IEEE Congress on Evolutionary Computation.

[8]  Xiaoliang Ma,et al.  Estimation of Driver Reaction Time from Car-Following Data: Application in Evaluation of General Motor–Type Model , 2006 .

[9]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[10]  T D Gillespie,et al.  Fundamentals of Vehicle Dynamics , 1992 .

[11]  Dario Floreano,et al.  Active Vision for Neural Development and Landmark Navigation , 2006 .

[12]  Bruce A. Maxwell,et al.  Integrating robotics research with undergraduate education , 2000, IEEE Intelligent Systems and their Applications.

[13]  Kevin Kok Wai Wong,et al.  Artificial Intelligence for Computer Games , 2009, Int. J. Comput. Games Technol..

[14]  Deepak Kumar,et al.  TRENDS IN EVOLUTIONARY ROBOTICS , 1998 .

[15]  Ivan Tanev,et al.  Evolution and Adaptation of an Agent Driving a Scale Model of a Car with Obstacle Avoidance Capabilities , 2006, SAB.