Stabilization of Inverse Perspective Mapping Images based on Robust Vanishing Point Estimation

In this work, a new inverse perspective mapping (IPM) technique is proposed based on a robust estimation of the vanishing point, which provide bird-view images of the road, so that facilitating the tasks of road modeling and vehicle detection and tracking. This new approach has been design to cope with the instability that cameras mounted on a moving vehicle suffer. The estimation of the vanishing point relies on a novel and efficient feature extraction strategy, which segmentates the lane markings of the images by combining a histogram-based segmentation with temporal and frequency filtering. Then, the vanishing point of each image is stabilized by means of a temporal filtering along the estimates of previous images. In a last step, the IPM image is computed based on the stabilized vanishing point. Tests have been carried out on several long video sequences captured from cameras inside a vehicle being driven along highways and local roads, with different illumination and weather conditions, presence of shadows, occluding vehicles, and slope changes. Results have shown a significant improvement in terms of lane width constancy and parallelism between lane markings over non-stabilized IPM algorithms.

[1]  Massimo Bertozzi,et al.  Stereo inverse perspective mapping: theory and applications , 1998, Image Vis. Comput..

[2]  Roland Siegwart,et al.  A Lane Detection Vision Module for Driver Assistance , 2004 .

[3]  Pietro Cerri,et al.  Free Space Detection on Highways using Time Correlation between Stabilized Sub-pixel precision IPM Images , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[4]  T. Bucher Measurement of distance and height in images based on easy attainable calibration parameters , 2000, Proceedings of the IEEE Intelligent Vehicles Symposium 2000 (Cat. No.00TH8511).

[5]  William H. Press,et al.  The Art of Scientific Computing Second Edition , 1998 .

[6]  Steven S. Beauchemin,et al.  Generalizing inverse perspective , 2005, The 2nd Canadian Conference on Computer and Robot Vision (CRV'05).

[7]  Massimo Bertozzi,et al.  GOLD: a parallel real-time stereo vision system for generic obstacle and lane detection , 1998, IEEE Trans. Image Process..

[8]  Dinggang Shen,et al.  Lane detection and tracking using B-Snake , 2004, Image Vis. Comput..

[9]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[10]  Massimo Bertozzi,et al.  Self-calibration of a stereo vision system for automotive applications , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[11]  Sei-Wang Chen,et al.  Video stabilization for a camcorder mounted on a moving vehicle , 2004, IEEE Transactions on Vehicular Technology.

[12]  M. TrivediM.,et al.  Video-based lane estimation and tracking for driver assistance , 2006 .

[13]  G. Jiang,et al.  Lane and obstacle detection based on fast inverse perspective mapping algorithm , 2000, Smc 2000 conference proceedings. 2000 ieee international conference on systems, man and cybernetics. 'cybernetics evolving to systems, humans, organizations, and their complex interactions' (cat. no.0.

[14]  M. Clabian,et al.  Single camera lane detection and tracking , 2005, Proceedings. 2005 IEEE Intelligent Transportation Systems, 2005..

[15]  C. Corridori,et al.  High curvature two-clothoid road model estimation , 2004, Proceedings. The 7th International IEEE Conference on Intelligent Transportation Systems (IEEE Cat. No.04TH8749).

[16]  Juan Pablo Gonzalez,et al.  Lane detection using histogram-based segmentation and decision trees , 2000, ITSC2000. 2000 IEEE Intelligent Transportation Systems. Proceedings (Cat. No.00TH8493).

[17]  Mohan M. Trivedi,et al.  Video-based lane estimation and tracking for driver assistance: survey, system, and evaluation , 2006, IEEE Transactions on Intelligent Transportation Systems.

[18]  F. A. Seiler,et al.  Numerical Recipes in C: The Art of Scientific Computing , 1989 .