Reinforcement learning to drive a car by pattern matching

In the paper the actual state of a system is presented that is aimed to learn driving autonomously different vehicles on different courses exclusively by visual input. The subsystem intelligent image processing allows, as required, to locate the road mark edges of each single image. A trained search algorithm allows optimal search speed and high recognition rate and consequently efficiently converts road mark edges into abstract complete situation descriptions (ACSDs) capturing in a storage limited way the current situation the vehicle is in. The subsystem pattern matching successfully retrieves similar situations to the current one based on a pattern matching algorithm. The pattern matching algorithm used in this subsystem is optimised for search speed on one hand and usage for road situations on the other hand. The subsystem reinforcement learning is still under implementation. However, a simple approach implemented so far allows already autonomous driving on a learning-by-knowledge-transfer basis promising further positive results in the area of autonomous driving based on pattern matching.

[1]  Reinhold Behringer,et al.  The seeing passenger car 'VaMoRs-P' , 1994, Proceedings of the Intelligent Vehicles '94 Symposium.

[2]  E D Dickmanns,et al.  AUTONOMOUS HIGH SPEED ROAD VEHICLE GUIDANCE BY COMPUTER VISION , 1987 .

[3]  D. Pomerleau,et al.  MANIAC : A Next Generation Neurally Based Autonomous Road Follower , 1993 .

[4]  Dean Pomerleau,et al.  Efficient Training of Artificial Neural Networks for Autonomous Navigation , 1991, Neural Computation.

[5]  Dean A. Pomerleau,et al.  Vision guided lane transition , 1995, Proceedings of the Intelligent Vehicles '95. Symposium.

[6]  Shumeet Baluja,et al.  Expectation-based selective attention for visual monitoring and control of a robot vehicle , 1997, Robotics Auton. Syst..

[7]  K.-D. Kuhnert,et al.  Towards a learning autonomous driver system , 2000, 2000 26th Annual Conference of the IEEE Industrial Electronics Society. IECON 2000. 2000 IEEE International Conference on Industrial Electronics, Control and Instrumentation. 21st Century Technologies.

[8]  Klaus-Dieter Kuhnert,et al.  A Vision System for Real Time Road and Object Recognition for Vehicle Guidance , 1987, Other Conferences.