An experimental study of a lane departure warning system based on the optical flow and Hough transform methods

The use of rumble strips on roads can provide drivers lane departure warning (LDW). However, rumble strips require an infrastructure and do not exist on a majority of roadways. Therefore, it is very desirable to have an effective in-vehicle LDW system to detect when the driver is in danger of departing the road and then triggers an alarm to warn the driver early enough to take corrective action. This paper presents the development of an image-based LDW system using the Lucas-Kanade (L-K) optical flow and the Hough transform methods. Our approach integrates both techniques to establish an operation algorithm to determine whether a warning signal should be issued based on the status of the vehicle deviating from its heading lane. The L-K optical flow tracking is used when the lane boundaries cannot be detected, while the lane detection technique is used when they become available. Even though both techniques are used in the system, only one method is activated at any given time because each technique has its own advantages and also disadvantages. The developed LDW system was road tested on several rural highways and also one section of the interstate I35 freeway. Overall, the system operates correctly as expected with a false alarm occurred only roughly about 1.18% of the operation time. This paper presents the system implementation together with our findings. Key-Words: Lane departure warning, Lucas-Kanade optical flow, Hough transform.

[1]  Jiann-Shiou Yang.  Application of the Kalman filter to the arterial Travel Time Prediction: a Special Event Case Study , 2007, Control. Intell. Syst..

[2]  Jiann-Shiou Yang.  Autoregressive Integrated Moving Average Modeling for Short-Term Arterial Travel Time Prediction , 2005, MSV.

[3]  Jiann-Shiou Yang.  Development of an Innovative Prototype Lane Departure Warning System , 2013 .

[4]  Hideo Saito,et al.  Vehicle Lateral Position Estimation Method Based on Matching of Top-View Images , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[5]  John C Hayward,et al.  NEAR-MISS DETERMINATION THROUGH USE OF A SCALE OF DANGER , 1972 .

[6]  Cejun Liu,et al.  Run-Off-Road Crashes: An On-Scene Perspective , 2011 .

[7]  Azriel Rosenfeld,et al.  Computer Vision , 1988, Adv. Comput..

[8]  Nassir Navab,et al.  Dense image registration through MRFs and efficient linear programming , 2008, Medical Image Anal..

[9]  Bing-Fei Wu,et al.  A DSP-based lane departure warning system , 2006 .

[10]  C.R. Jung,et al.  A lane departure warning system using lateral offset with uncalibrated camera , 2005, Proceedings. 2005 IEEE Intelligent Transportation Systems, 2005..

[11]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[12]  A.G. Ulsoy,et al.  CAPC: A Road-Departure Prevention System , 1996, IEEE Control Systems.

[13]  Richard O. Duda,et al.  Use of the Hough transformation to detect lines and curves in pictures , 1972, CACM.

[14]  C. Morandi,et al.  Registration of Translated and Rotated Images Using Finite Fourier Transforms , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Paul Milgram,et al.  The Development of a Time-Related Measure to Describe Driving Strategy , 1984 .

[16]  Jiann-Shiou Yang,et al.  A lane departure warning system based on the integration of the optical flow and hough transform methods , 2013, 2013 10th IEEE International Conference on Control and Automation (ICCA).

[17]  Dean A. Pomerleau,et al.  Driver-adaptive lane departure warning systems , 1999 .

[18]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[19]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[20]  Dana H. Ballard,et al.  Computer Vision , 1982 .

[21]  Iain E. G. Richardson,et al.  H.264 and MPEG-4 Video Compression: Video Coding for Next-Generation Multimedia , 2003 .

[22]  Alex Zelinsky,et al.  Learning OpenCV---Computer Vision with the OpenCV Library (Bradski, G.R. et al.; 2008)[On the Shelf] , 2009, IEEE Robotics & Automation Magazine.

[23]  A. Galip Ulsoy,et al.  Time to Lane Crossing calculation and Characterization of its associated Uncertainty , 1996, J. Intell. Transp. Syst..

[24]  Dean A. Pomerleau,et al.  RALPH: rapidly adapting lateral position handler , 1995, Proceedings of the Intelligent Vehicles '95. Symposium.

[25]  Hideo Saito,et al.  Estimation of FOE Without Optical Flow for ehicle Lateral Position Detection , 2005, MVA.

[26]  Jiann-Shiou Yang.  Estimation of Vehicle's Lateral Position via the Lucas-Kanade Optical Flow Method , 2012 .

[27]  K Perrillo.  THE EFFECTIVENESS AND USE OF CONTINUOUS SHOULDER RUMBLE STRIPS , 1998 .

[28]  Joseph Revelli,et al.  The Image Processing Handbook, 4th Edition , 2003, J. Electronic Imaging.

[29]  M. Gonzalez-Mendoza,et al.  A comparison of road departure warning systems on real driving conditions , 2004, Proceedings. The 7th International IEEE Conference on Intelligent Transportation Systems (IEEE Cat. No.04TH8749).

[30]  W. Leonhard,et al.  Vehicle control by computer vision , 1992, IEEE Trans. Ind. Electron..