Stix-Fusion: A Probabilistic Stixel Integration Technique

In summer 2013, a Mercedes S-Class drove completely autonomously for about 100 km from Mannheim to Pforzheim, Germany, using only close-to-production sensors. In this project, called Mercedes Benz Intelligent Drive, stereo vision was one of the main sensing components. For the representation of free space and obstacles we relied on the so called Stixel World, a generic 3D intermediate representation which is computed from dense disparity images. In spite of the high performance of the Stixel World in most common traffic scenes, the availability of this technique is limited. For instance under adverse weather, rain or even spray water on the windshield results in erroneous disparity images which generate false Stixel results. This can lead to undesired behavior of autonomous vehicles. Our goal is to use the Stixel World for a robust free space estimation and a reliable obstacle detection even during difficult weather conditions. In this paper, we meet this challenge and fuse the Stixels incrementally into a reference grid map. Our new approach is formulated in a Bayesian manner and is based on existence estimation methods. We evaluate our new technique on a manually labeled database with emphasis on bad weather scenarios. The number of structures which are detected mistakenly within free space areas is reduced by a factor of two whereas the detection rate of obstacles increases at the same time.

[1]  Uwe Franke,et al.  A Stereo-Vision Based Object Tracking Approach at Roundabouts , 2013, IEEE Intelligent Transportation Systems Magazine.

[2]  Akihiro Yamamoto,et al.  Visual Odometry by Multi-frame Feature Integration , 2013, 2013 IEEE International Conference on Computer Vision Workshops.

[3]  Uwe Franke,et al.  The Stixel World - A Compact Medium Level Representation of the 3D-World , 2009, DAGM-Symposium.

[4]  Uwe Franke,et al.  Towards a Global Optimal Multi-Layer Stixel Representation of Dense 3D Data , 2011, BMVC.

[5]  Horst Bischof,et al.  Fast and accurate environment modeling using three-dimensional occupancy grids , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[6]  Mathias Perrollaz,et al.  Using the disparity space to compute occupancy grids from stereo-vision , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[7]  Stefan K. Gehrig,et al.  A Real-Time Low-Power Stereo Vision Engine Using Semi-Global Matching , 2009, ICVS.

[8]  Jan-Michael Frahm,et al.  Efficient and Scalable Depthmap Fusion , 2012, BMVC.

[9]  U. Franke,et al.  An Incremental Map Building Approach via Static Stixel Integration , 2013 .

[10]  Véronique Berge-Cherfaoui,et al.  Moving Objects Detection by Conflict Analysis in Evidential Grids , 2011, 2011 IEEE Intelligent Vehicles Symposium (IV).

[11]  Ralf G. Herrtwich,et al.  Making Bertha See , 2013, 2013 IEEE International Conference on Computer Vision Workshops.

[12]  Joachim Weickert,et al.  Priors for Stereo Vision under Adverse Weather Conditions , 2013, 2013 IEEE International Conference on Computer Vision Workshops.

[13]  Wolfram Burgard,et al.  Probabilistic Robotics (Intelligent Robotics and Autonomous Agents) , 2005 .

[14]  Luc Van Gool,et al.  Stixels estimation without depth map computation , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[15]  Stefan K. Gehrig,et al.  Exploiting the Power of Stereo Confidences , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[16]  Stephan Matzka,et al.  A confidence measure for vehicle tracking based on a generalization of Bayes estimation , 2010, 2010 IEEE Intelligent Vehicles Symposium.

[17]  Rudolf Mester,et al.  Free Space Computation Using Stochastic Occupancy Grids and Dynamic Programming , 2008 .

[18]  Julius Ziegler,et al.  Team AnnieWAY's autonomous system for the 2007 DARPA Urban Challenge , 2008, J. Field Robotics.

[19]  Jan-Michael Frahm,et al.  3D Reconstruction Using an n-Layer Heightmap , 2010, DAGM-Symposium.

[20]  Peter C. Cheeseman,et al.  In Defense of Probability , 1985, IJCAI.

[21]  Viii Supervisor Sonar-Based Real-World Mapping and Navigation , 2001 .

[22]  Uwe Franke,et al.  Efficient representation of traffic scenes by means of dynamic stixels , 2010, 2010 IEEE Intelligent Vehicles Symposium.

[23]  Glenn Shafer,et al.  A Mathematical Theory of Evidence , 2020, A Mathematical Theory of Evidence.

[24]  Sebastian Thrun,et al.  Learning Occupancy Grid Maps with Forward Sensor Models , 2003, Auton. Robots.

[25]  Don Ray Murray,et al.  Using Real-Time Stereo Vision for Mobile Robot Navigation , 2000, Auton. Robots.