Development of a vision-based lane detection system considering configuration aspects

Vision-based lane-sensing systems require accurate and robust sensing performance in lane detection. Besides, there exists trade-off between the computational burden and processor cost, which should be considered for implementing the systems in passenger cars. In this paper, a stereo vision-based lane detection system considering sensor configuration aspects such as field of view (FOV), span pixels, resolution, etc is developed. An inverse perspective mapping method is formulated based on the relative correspondence between the left and right cameras so that the 3D road geometry can be reconstructed in a robust manner. The selection rule of the sensor configuration and specifications is investigated for a standard highway. Based on the selected sensor configurations, it is shown that sensing region range on the camera image coordinate can be determined for the best lane-sensing performance. The proposed system is implemented on a passenger car and its real-time sensing performance is verified experimentally.

[1]  Christoph Stiller,et al.  Camera calibration for lane and obstacle detection , 1999, Proceedings 199 IEEE/IEEJ/JSAI International Conference on Intelligent Transportation Systems (Cat. No.99TH8383).

[2]  Jitendra Malik,et al.  A real-time approach to stereopsis and lane-finding , 1996, Proceedings of Conference on Intelligent Vehicles.

[3]  F. Chausse,et al.  A fast and robust vision based road following algorithm , 2000, Proceedings of the IEEE Intelligent Vehicles Symposium 2000 (Cat. No.00TH8511).

[4]  A. Gern,et al.  Vision-based lane recognition under adverse weather conditions using optical flow , 2002, Intelligent Vehicle Symposium, 2002. IEEE.

[5]  Janne Heikkilä,et al.  A four-step camera calibration procedure with implicit image correction , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[6]  Janne Heikkilä,et al.  Calibration procedure for short focal length off-the-shelf CCD cameras , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[7]  J. Goldbeck,et al.  Lane detection and tracking by video sensors , 1999, Proceedings 199 IEEE/IEEJ/JSAI International Conference on Intelligent Transportation Systems (Cat. No.99TH8383).

[8]  Ernst D. Dickmanns,et al.  Recursive 3-D Road and Relative Ego-State Recognition , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Massimo Bertozzi,et al.  GOLD: a parallel real-time stereo vision system for generic obstacle and lane detection , 1998, IEEE Trans. Image Process..

[10]  Dean A. Pomerleau,et al.  RALPH: rapidly adapting lateral position handler , 1995, Proceedings of the Intelligent Vehicles '95. Symposium.

[11]  S. K. Gehrig,et al.  Lane recognition on poorly structured roads-the bots dot problem in California , 2002, Proceedings. The IEEE 5th International Conference on Intelligent Transportation Systems.

[12]  A. Galip Ulsoy,et al.  Lane geometry reconstruction: Least square curve fit versus Kalman filter , 1995 .

[13]  Vito Cerone,et al.  Experimental results in vision-based lane keeping for highway vehicles , 2002, Proceedings of the 2002 American Control Conference (IEEE Cat. No.CH37301).

[14]  Mohinder S. Grewal,et al.  Kalman Filtering: Theory and Practice , 1993 .

[15]  Juan Pablo Gonzalez,et al.  Lane detection using histogram-based segmentation and decision trees , 2000, ITSC2000. 2000 IEEE Intelligent Transportation Systems. Proceedings (Cat. No.00TH8493).

[16]  Y. Ninomiya,et al.  Model-based lane recognition , 1996, Proceedings of Conference on Intelligent Vehicles.

[17]  Milan Sonka,et al.  Image Processing, Analysis and Machine Vision , 1993, Springer US.

[18]  Zhengyou Zhang,et al.  Flexible camera calibration by viewing a plane from unknown orientations , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.