Stixels estimation through stereo matching of road scenes

Recently, Stixel-world, a medium level representation of road scene components has been introduced. The existing stixels estimation approaches are separated from a depth estimation process, or they directly make use of stereo images and only compute stixels without producing per-pixel depth information. For road scenes, however, many machine vision tasks require both per-pixel depth information and the higher-level representation of it. This paper presents a combined process of stixels estimation and stereo matching process. The proposed method generates per-pixel depth information and stixels for both the ground surface and obstacles, at the same time. We have modified a multi-path line-optimization process of the stereo matching algorithm to produce multiple stixels of the ground and obstacle segments for each image column. Experimental results show that the proposed algorithm estimates stixels more accurately than the existing algorithm, and it also produces high-quality dense depth information, at the same time.

[1]  Luc Van Gool,et al.  A mobile vision system for robust multi-person tracking , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  Luc Van Gool,et al.  Stixels Motion Estimation without Optical Flow Computation , 2012, ECCV.

[3]  Uwe Franke,et al.  Towards a Global Optimal Multi-Layer Stixel Representation of Dense 3D Data , 2011, BMVC.

[4]  Hiroshi Hattori,et al.  Stereo-based Pedestrian Detection using Multiple Patterns , 2009, BMVC.

[5]  Minh N. Do,et al.  Patch Match Filter: Efficient Edge-Aware Filtering Meets Randomized Search for Fast Correspondence Field Estimation , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Uwe Franke,et al.  Stixmentation - Probabilistic Stixel based Traffic Scene Labeling , 2012, BMVC.

[7]  Uwe Franke,et al.  The Stixel World - A Compact Medium Level Representation of the 3D-World , 2009, DAGM-Symposium.

[8]  Soon Ki Jung,et al.  Billboard sweep stereo for obstacle detection in road scenes , 2012 .

[9]  Ines Ernst,et al.  Mutual Information Based Semi-Global Stereo Matching on the GPU , 2008, ISVC.

[10]  Luc Van Gool,et al.  Stixels estimation without depth map computation , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[11]  Peter Pirsch,et al.  Real-time stereo vision system using semi-global matching disparity estimation: Architecture and FPGA-implementation , 2010, 2010 International Conference on Embedded Computer Systems: Architectures, Modeling and Simulation.

[12]  Carsten Rother,et al.  Fast cost-volume filtering for visual correspondence and beyond , 2011, CVPR 2011.

[13]  Luc Van Gool,et al.  Fast Stixel Computation for Fast Pedestrian Detection , 2012, ECCV Workshops.

[14]  Reinhard Klette,et al.  Iterative Semi-Global Matching for Robust Driver Assistance Systems , 2012, ACCV.