Stixel optimization: Representing challenging on-road scenes

This paper presents a stereo-based method for robust vertical road profile detection. The aim is to ensure a very low false-detection rate for obstacles in challenging datasets. Basically, frames are segmented into ground manifold and obstacles. To robustly estimate a vertical road profile, our method applies cuts through a v-disparity matrix along columns to achieve a minimal cost specified by the matrix itself while maintaining a desired smoothness; the minimization is based on the Viterbi algorithm, a dynamic programming technique. Experiments illustrate the performance of the proposed method using available datasets. Results show that the proposed method outperforms two previously published methods on the used datasets. In particular, its performance is superior to the others in cases of challenging weather conditions.

[1]  Ondrej Miksik Rapid vanishing point estimation for general road detection , 2012, 2012 IEEE International Conference on Robotics and Automation.

[2]  Sergiu Nedevschi,et al.  UV disparity based obstacle detection and pedestrian classification in urban traffic scenarios , 2014, 2014 IEEE 10th International Conference on Intelligent Computer Communication and Processing (ICCP).

[3]  Reinhard Klette,et al.  Improved Stixel Estimation Based on Transitivity Analysis in Disparity Space , 2017, CAIP.

[4]  Van Nostrand,et al.  Error Bounds for Convolutional Codes and an Asymptotically Optimum Decoding Algorithm , 1967 .

[5]  Marc Pollefeys,et al.  Semantic Stixels: Depth is not enough , 2016, 2016 IEEE Intelligent Vehicles Symposium (IV).

[6]  Uwe Franke,et al.  The Stixel World - A Compact Medium Level Representation of the 3D-World , 2009, DAGM-Symposium.

[7]  Reinhard Klette,et al.  A comparative study of stereo-matching algorithms for road-modeling in the presence of windscreen wipers , 2011, 2011 IEEE Intelligent Vehicles Symposium (IV).

[8]  Peter H. N. de With,et al.  Color-Based Free-Space Segmentation Using Online Disparity-Supervised Learning , 2015, 2015 IEEE 18th International Conference on Intelligent Transportation Systems.

[9]  David Pfeiffer The Stixel World , 2012 .

[10]  Keyu Lu,et al.  A hierarchical approach for road detection , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[11]  Camille Couprie,et al.  Learning Hierarchical Features for Scene Labeling , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Ethan Fetaya,et al.  StixelNet: A Deep Convolutional Network for Obstacle Detection and Road Segmentation , 2015, BMVC.

[13]  Amaury Nègre,et al.  A Visibility-Based Approach for Occupancy Grid Computation in Disparity Space , 2012, IEEE Transactions on Intelligent Transportation Systems.

[14]  Jean-Philippe Tarel,et al.  Real time obstacle detection in stereovision on non flat road geometry through "v-disparity" representation , 2002, Intelligent Vehicle Symposium, 2002. IEEE.

[15]  Stefan K. Gehrig,et al.  Exploiting the Power of Stereo Confidences , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[16]  Ho Gi Jung,et al.  Dense Stereo-Based Robust Vertical Road Profile Estimation Using Hough Transform and Dynamic Programming , 2015, IEEE Transactions on Intelligent Transportation Systems.

[17]  Uwe Franke,et al.  Low-level fusion of color, texture and depth for robust road scene understanding , 2015, 2015 IEEE Intelligent Vehicles Symposium (IV).

[18]  Heiko Hirschmüller,et al.  Stereo Processing by Semiglobal Matching and Mutual Information , 2008, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  Jean Ponce,et al.  General Road Detection From a Single Image , 2010, IEEE Transactions on Image Processing.

[20]  Luc Van Gool,et al.  Fast Stixel Computation for Fast Pedestrian Detection , 2012, ECCV Workshops.

[21]  Martin Lauer,et al.  Grid Map based Free Space Estimation using Stereo Vision , 2015 .

[22]  Christophe Bobda,et al.  A hardware/software prototyping system for driving assistance investigations , 2016, Journal of Real-Time Image Processing.

[23]  Marc Pollefeys,et al.  The Stixel World: A medium-level representation of traffic scenes , 2017, Image Vis. Comput..

[24]  Pascal Vasseur,et al.  Analysis of low-altitude aerial sequences for road traffic diagnosis using graph partitioning and Markov hierarchical models , 2016, 2016 13th International Multi-Conference on Systems, Signals & Devices (SSD).

[25]  Tao Wu,et al.  Robust road detection from a single image using road shape prior , 2013, 2013 IEEE International Conference on Image Processing.

[26]  Stefan Roth,et al.  Stixmantics: A Medium-Level Model for Real-Time Semantic Scene Understanding , 2014, ECCV.

[27]  Bok-Suk Shin,et al.  Visual lane analysis and higher-order tasks: a concise review , 2014, Machine Vision and Applications.

[28]  Reinhard Klette,et al.  Accuracy of free-space detection: Monocular versus binocular vision , 2016, 2016 International Conference on Image and Vision Computing New Zealand (IVCNZ).

[29]  Benoit Vanholme,et al.  Free Space Detection: A Corner Stone of Automated Driving , 2015, 2015 IEEE 18th International Conference on Intelligent Transportation Systems.

[30]  Stefan Roth,et al.  Object-Level Priors for Stixel Generation , 2014, GCPR.

[31]  Pengpeng Zhao,et al.  A Comparative Study of SIFT and its Variants , 2013 .

[32]  Luc Van Gool,et al.  Stixels estimation without depth map computation , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[33]  Bo Zhang,et al.  Color-based road detection in urban traffic scenes , 2004, IEEE Transactions on Intelligent Transportation Systems.