A stereovision based approach for detecting and tracking lane and forward obstacles on mobile devices

This paper presents SmartCoDrive, an Android application which performs driving assistance functions: 3D lane detection and tracking, forward obstacle detection, obstacle tracking. With this mobile application we wish to increase the adoption rate of driving assistance systems and to provide a viable and cheap solution for every driver, that will be able to use his own tablet or smartphone as a personal driving assistant. The mobile application is deployed on a tablet equipped with dual back-facing cameras. The visual information from the two cameras, along with the data received from the Controller Area Network bus of the vehicle enable a thorough understanding of the 3D environment. First, we develop the sparse 3D reconstruction algorithm. Then, using monocular vision we perform lane markings detection. Obstacle detection is done by combining the superpixel segmentation with 3D information and the tracking algorithm is based on the Kalman Filter. Since the processing capabilities of the mobile platforms are limited, different optimizations are carried out in order to obtain a real-time implementation. The Android application may be used in urban traffic that is characterized by low-speed and short-medium distances to obstacles.

[1]  R. Danescu,et al.  High accuracy stereo vision system for far distance obstacle detection , 2004, IEEE Intelligent Vehicles Symposium, 2004.

[2]  Sebastien Glaser,et al.  Stereovision-based 3D lane detection system: a model driven approach , 2008, 2008 11th International IEEE Conference on Intelligent Transportation Systems.

[3]  Young-Woo Seo,et al.  Utilizing instantaneous driving direction for enhancing lane-marking detection , 2014, 2014 IEEE Intelligent Vehicles Symposium Proceedings.

[4]  Dinggang Shen,et al.  Lane detection using B-snake , 1999, Proceedings 1999 International Conference on Information Intelligence and Systems (Cat. No.PR00446).

[5]  Pascal Fua,et al.  SLIC Superpixels Compared to State-of-the-Art Superpixel Methods , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Sergiu Nedevschi,et al.  Obstacle detection using stereovision for Android-based mobile devices , 2014, 2014 IEEE 10th International Conference on Intelligent Computer Communication and Processing (ICCP).

[7]  Mohamed Aly,et al.  Real time detection of lane markers in urban streets , 2008, 2008 IEEE Intelligent Vehicles Symposium.

[8]  Luis Salgado,et al.  Road environment modeling using robust perspective analysis and recursive Bayesian segmentation , 2011, Machine Vision and Applications.

[9]  Sergiu Nedevschi,et al.  Processing Dense Stereo Data Using Elevation Maps: Road Surface, Traffic Isle, and Obstacle Detection , 2010, IEEE Transactions on Vehicular Technology.

[10]  Mohan M. Trivedi,et al.  On Enhancing Lane Estimation Using Contextual Cues , 2015, IEEE Transactions on Circuits and Systems for Video Technology.

[11]  Massimo Bertozzi,et al.  GOLD: a parallel real-time stereo vision system for generic obstacle and lane detection , 1998, IEEE Trans. Image Process..

[12]  Luis Miguel Bergasa,et al.  DriveSafe: An app for alerting inattentive drivers and scoring driving behaviors , 2014, 2014 IEEE Intelligent Vehicles Symposium Proceedings.

[13]  Li-Chen Fu,et al.  A Portable Vision-Based Real-Time Lane Departure Warning System: Day and Night , 2009, IEEE Transactions on Vehicular Technology.

[14]  Uwe Franke,et al.  The Stixel World - A Compact Medium Level Representation of the 3D-World , 2009, DAGM-Symposium.

[15]  Jean-Philippe Tarel,et al.  Real time obstacle detection in stereovision on non flat road geometry through "v-disparity" representation , 2002, Intelligent Vehicle Symposium, 2002. IEEE.

[16]  Sheng-Fuu Lin,et al.  Lane detection using color-based segmentation , 2005, IEEE Proceedings. Intelligent Vehicles Symposium, 2005..

[17]  Seung-Woo Seo,et al.  Multi-lane detection based on accurate geometric lane estimation in highway scenarios , 2014, 2014 IEEE Intelligent Vehicles Symposium Proceedings.