Real-Time Lane and Vehicle Detection Based on A Single Camera Model

Abstract This paper presents a real-time lane detection algorithm and a fuzzy-based vehicle detection approach for autonomous vehicles. The fast adaptive lane detection algorithm is efficient and robust during the day and at night. Modified global lane models are proposed to increase the accuracy of the detection. Moreover, an automatic adjustment method is presented to adapt to the changes of lane width and the inclination of roads in different situations. The developed fuzzy-based vehicle detection method, contour size similarity (CSS), compares the projective sizes of vehicles with the estimated ones by fuzzy logic. Vehicle detection aims to detect the closest vehicle preceding the autonomous car in the same lane. Results of the experiments demonstrate that the proposed approach is effective in distance estimation and both lane and vehicle detection. Furthermore, the approach rapidly adjusts to changes of detection target when another car cuts in the lane of the autonomous vehicle. The obtained information supports the automatic driving of autonomous vehicles. This integrated algorithm of lane and vehicle detection was verified on the autonomous car, TAIWAN iTS-1, on express highways and in urban environments at velocities of 110 and 50 km/h , respectively.

[1]  Wang Rongben,et al.  Study on method of detecting preceding vehicle based on monocular camera , 2004, IEEE Intelligent Vehicles Symposium, 2004.

[2]  Zehang Sun,et al.  On-road vehicle detection using evolutionary Gabor filter optimization , 2005, IEEE Transactions on Intelligent Transportation Systems.

[3]  Massimo Bertozzi,et al.  Artificial vision in road vehicles , 2002, Proc. IEEE.

[4]  Bo Zhang,et al.  Color-based road detection in urban traffic scenes , 2004, IEEE Transactions on Intelligent Transportation Systems.

[5]  Massimo Bertozzi,et al.  Vision-Based Vehicle Guidance , 1997, Computer.

[6]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[7]  Teresa Orlowska-Kowalska,et al.  Performance Improvement of Industrial Drives With Mechanical Elasticity Using Nonlinear Adaptive Kalman Filter , 2008, IEEE Transactions on Industrial Electronics.

[8]  Massimo Bertozzi,et al.  GOLD: a parallel real-time stereo vision system for generic obstacle and lane detection , 1998, IEEE Trans. Image Process..

[9]  Sung-Uk Choi,et al.  A study on recognition of road lane and movement of vehicles using vision system , 2001, SICE 2001. Proceedings of the 40th SICE Annual Conference. International Session Papers (IEEE Cat. No.01TH8603).

[10]  Yoshiki Ninomiya,et al.  A robust lane detection using real-time voting processor , 1999, Proceedings 199 IEEE/IEEJ/JSAI International Conference on Intelligent Transportation Systems (Cat. No.99TH8383).

[11]  Aurelio Piazzi,et al.  Visual perception of obstacles and vehicles for platooning , 2000, IEEE Trans. Intell. Transp. Syst..

[12]  Volker Graefe,et al.  Applications of dynamic monocular machine vision , 1988, Machine Vision and Applications.

[13]  J. Goldbeck,et al.  Lane detection and tracking by video sensors , 1999, Proceedings 199 IEEE/IEEJ/JSAI International Conference on Intelligent Transportation Systems (Cat. No.99TH8383).

[14]  Bing-Fei Wu,et al.  A fast lane and vehicle detection approach for autonomous vehicles , 2005, SIP.

[15]  Mei Chen,et al.  AURORA: a vision-based roadway departure warning system , 1995, Proceedings 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human Robot Interaction and Cooperative Robots.

[16]  Hsu-Yung Cheng,et al.  Lane Detection With Moving Vehicles in the Traffic Scenes , 2006, IEEE Transactions on Intelligent Transportation Systems.

[17]  J. Boonaert,et al.  Obstacles detection from disparity properties in a particular stereo vision system configuration , 2003, Proceedings of the 2003 IEEE International Conference on Intelligent Transportation Systems.

[18]  Dinggang Shen,et al.  Lane detection using B-snake , 1999, Proceedings 1999 International Conference on Information Intelligence and Systems (Cat. No.PR00446).

[19]  Mutsumi Watanabe,et al.  A moving object recognition method by optical flow analysis , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[20]  Sridhar Lakshmanan,et al.  A deformable-template approach to lane detection , 1995, Proceedings of the Intelligent Vehicles '95. Symposium.

[21]  Bing-Fei Wu,et al.  Robust lane detection and tracking for driving assistance systems , 2007, 2007 IEEE International Conference on Systems, Man and Cybernetics.

[22]  Mohan M. Trivedi,et al.  Video-based lane estimation and tracking for driver assistance: survey, system, and evaluation , 2006, IEEE Transactions on Intelligent Transportation Systems.

[23]  R. Danescu,et al.  High accuracy stereo vision system for far distance obstacle detection , 2004, IEEE Intelligent Vehicles Symposium, 2004.

[24]  Dean A. Pomerleau,et al.  RALPH: rapidly adapting lateral position handler , 1995, Proceedings of the Intelligent Vehicles '95. Symposium.

[25]  Sanjay S. Joshi,et al.  Following Controller for Autonomous Mobile Robots Using Behavioral Cues , 2008, IEEE Transactions on Industrial Electronics.

[26]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[27]  Christopher M. Kreucher,et al.  LANA: a lane extraction algorithm that uses frequency domain features , 1999, IEEE Trans. Robotics Autom..

[28]  Bing-Fei Wu,et al.  A real-time robust lane detection approach for autonomous vehicle environment , 2004 .

[29]  Sergiu Nedevschi,et al.  Local Difference Probability (LDP)-Based Environment Adaptive Algorithm for Unmanned Ground Vehicle , 2006, IEEE Transactions on Intelligent Transportation Systems.

[30]  Volker Graefe,et al.  Dynamic monocular machine vision , 1988, Machine Vision and Applications.

[31]  Dean A. Pomerleau,et al.  Visibility estimation from a moving vehicle using the RALPH vision system , 1997, Proceedings of Conference on Intelligent Transportation Systems.

[32]  Zehang Sun,et al.  Monocular precrash vehicle detection: features and classifiers , 2006, IEEE Transactions on Image Processing.

[33]  Bing-Fei Wu,et al.  A fuzzy vehicle detection based on contour size similarity , 2005, IEEE Proceedings. Intelligent Vehicles Symposium, 2005..

[34]  S. Heinrich,et al.  Fast obstacle detection for urban traffic situations , 2002, IEEE Trans. Intell. Transp. Syst..

[35]  Uwe Franke,et al.  Real-time stereo vision for urban traffic scene understanding , 2000, Proceedings of the IEEE Intelligent Vehicles Symposium 2000 (Cat. No.00TH8511).

[36]  Ernst D. Dickmanns,et al.  Recursive 3-D Road and Relative Ego-State Recognition , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[37]  Gianni Conte,et al.  Obstacle and lane detection on ARGO , 1997, Proceedings of Conference on Intelligent Transportation Systems.