A REAL-TIME VIDEO PROCESSING BASED DRIVER ASSIST SYSTEM

This paper describes a novel Driver Assistant System based on real-time video to track lanes and road signs with minimal hardware and software requirements. The proposed system was designed to use low cost cameras and processing power of an on-board commodity laptop. The system model was developed using MATLAB®/Simulink blocksets. This was later converted into an optimized compiled code using the built-in code generation features for the Pentium and AMD processors. The lane tracking algorithm based on Hough Transform was implemented as embedded MATLAB® code. The signboards were detected by Blob Analysis Based Template Matching. Sum of Absolute Differences (SAD) as well as Scale Invariant Feature Transform (SIFT) followed by RANdom SAmple Consensus (RANSAC) based template matching methods. The above were implemented and compared for their performance. The developed system was tested on different drives varying from a high speed drive on a high way to a low speed drive on the city roads. The system was able to detect the lane markings under various lighting conditions and on many types of roads ranging from unmarked roads to multi-lane national highways. The road sign detection system was able to detect signboards as long as the background was not very cluttered. The implemented system has an overall success rate of over 97% for lane detection and more than 70% for the road sign detection.

[1]  Shigang Wang,et al.  Low-Level Image Processing for Lane Detection and Tracking , 2009, ArtsIT.

[2]  M. Bellino,et al.  Calibration of an embedded camera for driver-assistant systems , 2005, Proceedings. 2005 IEEE Intelligent Transportation Systems, 2005..

[3]  Yong Zhou,et al.  A robust lane detection and tracking method based on computer vision , 2006 .

[4]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[5]  Dana H. Ballard,et al.  Computer Vision , 1982 .

[6]  M.M. Trivedi,et al.  Performance evaluation of a vision based lane tracker designed for driver assistance systems , 2005, IEEE Proceedings. Intelligent Vehicles Symposium, 2005..

[7]  R Risack.  ROBUST LANE RECOGNITION EMBEDDED IN A REAL-TIME DRIVER ASSISTANCE SYSTEM , 1998 .

[8]  Fabien Moutarde,et al.  Modular Traffic Sign Recognition applied to on-vehicle real-time visual detection of American and European speed limit signs , 2009, ArXiv.

[9]  Christopher O. Jaynes.  Computer vision and artificial intelligence , 1996, CROS.

[10]  B. Lamprecht,et al.  Computer Vision and Artificial Intelligence On-Road , 2007 .

[11]  Kee-Eung Kim,et al.  Signboard Recognition by Consistency Checking of Local Features , 2007 .

[12]  Mohan M. Trivedi,et al.  Video-based lane estimation and tracking for driver assistance: survey, system, and evaluation , 2006, IEEE Transactions on Intelligent Transportation Systems.

[13]  Daniel J. Dailey,et al.  An algorithm to estimate mean traffic speed using uncalibrated cameras , 2000, IEEE Trans. Intell. Transp. Syst..

[14]  Xilin Chen,et al.  Incremental detection of text on road signs from video with application to a driving assistant system , 2004, MULTIMEDIA '04.

[15]  Dinggang Shen,et al.  Lane detection and tracking using B-Snake , 2004, Image Vis. Comput..

[16]  Hassan Basri,et al.  Real time road sign recognition system using artificial neural networks for bengali textual information box , 2008, 2008 International Symposium on Information Technology.

[17]  M.L. Eichner,et al.  Integrated speed limit detection and recognition from real-time video , 2008, 2008 IEEE Intelligent Vehicles Symposium.