Intelligent automatic overtaking system using vision for vehicle detection

Highlights? We have implemented an autonomous overtaking system in a commercial car. ? The system performs the maneuver as humans do, i.e., depending on the leading vehicle. ? Vision system is use to detect obstacles and to determine its length and width. ? Fuzzy logic was used as control technique to design lateral and longitudinal control. ? Real experiments show the ability of the system to manage any overtaking maneuver. There is clear evidence that investment in intelligent transportation system technologies brings major social and economic benefits. Technological advances in the area of automatic systems in particular are becoming vital for the reduction of road deaths. We here describe our approach to automation of one the riskiest autonomous man?uvres involving vehicles - overtaking. The approach is based on a stereo vision system responsible for detecting any preceding vehicle and triggering the autonomous overtaking man?uvre. To this end, a fuzzy-logic based controller was developed to emulate how humans overtake. Its input is information from the vision system and from a positioning-based system consisting of a differential global positioning system (DGPS) and an inertial measurement unit (IMU). Its output is the generation of action on the vehicle's actuators, i.e., the steering wheel and throttle and brake pedals. The system has been incorporated into a commercial Citroen car and tested on the private driving circuit at the facilities of our research center, CAR, with different preceding vehicles - a motorbike, car, and truck - with encouraging results.

[1]  Cheng-Jian Lin,et al.  Applying fuzzy method to vision-based lane detection and departure warning system , 2010, Expert Syst. Appl..

[2]  José Eugenio Naranjo,et al.  Electro-hydraulic braking system for autonomous vehicles , 2010 .

[3]  Teresa de Pedro,et al.  Lateral Power Controller for Unmanned Vehicles , 2010 .

[4]  Zehang Sun,et al.  On-road vehicle detection: a review , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Hong Cheng,et al.  Vehicle Detection and Tracking , 2011 .

[6]  David Fernández Llorca,et al.  Vision-Based Traffic Data Collection Sensor for Automotive Applications , 2010, Sensors.

[7]  Kees Wevers,et al.  ADAS applications for improving traffic safety , 2004, 2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583).

[8]  Tzila Shamir,et al.  How should an autonomous vehicle overtake a slower moving vehicle: design and analysis of an optimal trajectory , 2004, IEEE Transactions on Automatic Control.

[9]  Juan Zamorano,et al.  Argos: An Advanced In-Vehicle Data Recorder on a Massively Sensorized Vehicle for Car Driver Behavior Experimentation , 2010, IEEE Transactions on Intelligent Transportation Systems.

[10]  Javier Medina,et al.  An expert fuzzy system for predicting object collisions. Its application for avoiding pedestrian accidents , 2011, Expert Syst. Appl..

[11]  David Gerónimo Gómez,et al.  Survey of Pedestrian Detection for Advanced Driver Assistance Systems , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Dirk Helbing,et al.  Adaptive cruise control design for active congestion avoidance , 2008 .

[13]  George Bebis,et al.  Overtaking Vehicle Detection Using Dynamic and Quasi-Static Background Modeling , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[14]  José Eugenio Naranjo,et al.  Lane-Change Fuzzy Control in Autonomous Vehicles for the Overtaking Maneuver , 2008, IEEE Transactions on Intelligent Transportation Systems.

[15]  Jin Wang,et al.  Lane keeping based on location technology , 2005, IEEE Transactions on Intelligent Transportation Systems.

[16]  Anders Lindgren,et al.  Driver behaviour when using an integrated advisory warning display for advanced driver assistance systems , 2009 .

[17]  Dean A. Pomerleau,et al.  RALPH: rapidly adapting lateral position handler , 1995, Proceedings of the Intelligent Vehicles '95. Symposium.

[18]  Martial Hebert,et al.  Active laser radar for high-performance measurements , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[19]  Ignacio Parra,et al.  Error Analysis in a Stereo Vision-Based Pedestrian Detection Sensor for Collision Avoidance Applications , 2010, Sensors.

[20]  Chung-Ping Young,et al.  Intelligent data fusion system for predicting vehicle collision warning using vision/GPS sensing , 2010, Expert Syst. Appl..

[21]  Chieh-Chih Wang,et al.  LADAR-based detection and tracking of moving objects from a ground vehicle at high speeds , 2003, IEEE IV2003 Intelligent Vehicles Symposium. Proceedings (Cat. No.03TH8683).

[22]  Faraz Kunwar,et al.  Autonomous vehicle overtaking- an online solution , 2009, 2009 IEEE International Conference on Automation and Logistics.

[23]  Aurelio Piazzi,et al.  THE ARGO AUTONOMOUS VEHICLE'S VISION AND CONTROL SYSTEMS , 1999 .

[24]  Chris T. Kiranoudis,et al.  A background subtraction algorithm for detecting and tracking vehicles , 2011, Expert Syst. Appl..

[25]  Ya-Fu Peng Adaptive intelligent backstepping longitudinal control of vehicleplatoons using output recurrent cerebellar model articulation controller , 2010, Expert Syst. Appl..

[26]  Amnon Shashua,et al.  Vision-based ACC with a single camera: bounds on range and range rate accuracy , 2003, IEEE IV2003 Intelligent Vehicles Symposium. Proceedings (Cat. No.03TH8683).

[27]  C. Zhang,et al.  Forward position analysis of the Tricept robot based on Single-Opened-Chain , 2008, 2008 IEEE International Conference on Industrial Technology.

[28]  Wang Rongben,et al.  Research on lane changing and overtaking for Intelligent Vehicle based on vision navigation , 2008, 2008 IEEE International Conference on Industrial Technology.

[29]  Vicente Milanés Montero,et al.  An RFID-Based Intelligent Vehicle Speed Controller Using Active Traffic Signals , 2010, Sensors.

[30]  Ignacio Parra,et al.  An Experimental Study on Pitch Compensation in Pedestrian-Protection Systems for Collision Avoidance and Mitigation , 2009, IEEE Transactions on Intelligent Transportation Systems.

[31]  Vicente Milanés Montero,et al.  Autonomous vehicle based in cooperative GPS and inertial systems , 2008, Robotica.

[32]  John Lygeros,et al.  Longitudinal control of the lead car of a platoon , 1993 .

[33]  Teresa de Pedro,et al.  Adelantamiento con vehiculos autónomos en carreteras de doble sentido , 2010 .

[34]  Rama Chellappa,et al.  Vehicle detection and tracking using acoustic and video sensors , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[35]  Tae Yong Kim,et al.  A novel signal processing technique for vehicle detection radar , 2003, IEEE MTT-S International Microwave Symposium Digest, 2003.

[36]  Bing-Fei Wu,et al.  The Heterogeneous Systems Integration Design and Implementation for Lane Keeping on a Vehicle , 2008, IEEE Transactions on Intelligent Transportation Systems.

[37]  Vicente Milanés Montero,et al.  Throttle and brake pedals automation for populated areas , 2009, Robotica.

[38]  Ignacio Parra,et al.  Combination of Feature Extraction Methods for SVM Pedestrian Detection , 2007, IEEE Transactions on Intelligent Transportation Systems.

[39]  Ying Zhu,et al.  Reliable Detection of Overtaking Vehicles Using Robust Information Fusion , 2006, IEEE Transactions on Intelligent Transportation Systems.

[40]  ChangBao Rong,et al.  Intelligent data fusion system for predicting vehicle collision warning using vision/GPS sensing , 2010 .

[41]  Rodolfo E. Haber,et al.  Power-steering control architecture for automatic driving , 2005, IEEE Transactions on Intelligent Transportation Systems.

[42]  Ming Yang,et al.  Conflict-Probability-Estimation-Based Overtaking for Intelligent Vehicles , 2009, IEEE Transactions on Intelligent Transportation Systems.