Performance Evaluation of Stereo and Motion Analysis on Rectified Image Sequences

This paper introduces into seven real-world road driving stereo sequences (provided by Daimler AG, Germany; now freely available for academic research); it also informs about their use for performance evaluation in some experiments using common stereo and motion analysis algorithms. Often, such algorithms are tested on a few frames only, or on synthetic sequences, but not on long real-world sequences. The provided sequences have 250 to 300 stereo pairs each; they have been used at Daimler AG for testing 6D vision, which fuses disparity and motion data (by using a Kalman filter). In this paper we introduce into those seven sequences (and inform about the download web site); we discuss a few approaches how to use those sequences for testing either stereo or motion algorithms, or both combined together. Certainly, those sequences do have many more potentials for future performance evaluations for stereo and motion analysis algorithms.

[1]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[2]  Monson H. Hayes,et al.  Statistical Digital Signal Processing and Modeling , 1996 .

[3]  Richard Szeliski,et al.  A Database and Evaluation Methodology for Optical Flow , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[4]  Simon Baker,et al.  Lucas-Kanade 20 Years On: A Unifying Framework , 2004, International Journal of Computer Vision.

[5]  Uwe Franke,et al.  6D-Vision: Fusion of Stereo and Motion for Robust Environment Perception , 2005, DAGM-Symposium.

[6]  Jens Klappstein,et al.  Detectability of Moving Objects Using Correspondences over Two and Three Frames , 2007, DAGM-Symposium.

[7]  Atsushi Imiya,et al.  Zooming Optical Flow Computation , 2007 .

[8]  Christoph Stiller,et al.  Fusing optical flow and stereo disparity for object tracking , 2002, Proceedings. The IEEE 5th International Conference on Intelligent Transportation Systems.

[9]  Dana H. Ballard,et al.  Computer Vision , 1982 .

[10]  Hernán Badino,et al.  A Robust Approach for Ego-Motion Estimation Using a Mobile Stereo Platform , 2004, IWCM.

[11]  Reinhard Klette,et al.  Belief-Propagation on Edge Images for Stereo Analysis of Image Sequences , 2008, RobVis.

[12]  Azriel Rosenfeld,et al.  Computer Vision , 1988, Adv. Comput..

[13]  J. L. Roux.  An Introduction to the Kalman Filter , 2003 .

[14]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[15]  Wolfgang Ponweiser,et al.  T ask and Context aware Performance Evaluation of Computer Vision Algorithms , 2007 .

[16]  D. Scharstein,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, Proceedings IEEE Workshop on Stereo and Multi-Baseline Vision (SMBV 2001).

[17]  Alfred Schmitt,et al.  Real-Time Stereo by using Dynamic Programming , 2003, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[18]  Filiberto Pla,et al.  Stereo Vision-Based Obstacle and Free Space Detection in Mobile Robotics , 1998, IEA/AIE.