Disparity Map Computation on a Cell Processor

This report describes an efficient implementation of dynamic programming and belief propagation algorithms on a cell processor that may be used to speed up stereo image analysis. Dynamic programming is a method for efficiently solving optimization problems by caching subproblem solutions rather than recomputing them again. It processes image data by scanline optimization; thus it is easily implemented on a cell processor; our results show that this algorithm runs very efficiently on the cell processor. Belief propagation differs from dynamic programming by having potentially the whole image area as an area of influence for every pixel; this global optimization scheme produces improved results, but requires more run time than the dynamic programming method on a normal PC. Besides the tests on synthetic data, we use real-world image sequences captured by a test vehicle (HAKA1); they are typically degraded by various types of noise, changes in lighting, differing exposures, and so on. We use two methods to process the original images: Sobel edge detection and residual image analysis. Our results show that a cell processor also reduces running time for these processes. Sobel and residual images can improve the stereo matching result compared to the use of original real-world images, however, due to the used block structure and cell architecture limitations, the accuracy is also degraded slightly.

[1]  C. Kambhamettu,et al.  GPU implementation of belief propagation using CUDA for cloud tracking and reconstruction , 2008, 2008 IAPR Workshop on Pattern Recognition in Remote Sensing (PRRS 2008).

[2]  Richard Szeliski,et al.  A Database and Evaluation Methodology for Optical Flow , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[3]  Shang-Hong Lai,et al.  Parallelization of belief propagation method on embedded multicore processors for stereo vision , 2008, 2008 IEEE/ACM/IFIP Workshop on Embedded Systems for Real-Time Multimedia.

[4]  Zhifeng Liu,et al.  Dynamic Programming Stereo on Real-World Sequences , 2008, ICONIP.

[5]  Steve Mann,et al.  Using graphics devices in reverse: GPU-based Image Processing and Computer Vision , 2008, 2008 IEEE International Conference on Multimedia and Expo.

[6]  Richard Szeliski,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, International Journal of Computer Vision.

[7]  Residual Images Remove Illumination Artifacts for Correspondence Algorithms ! , 2009 .

[8]  Reinhard Klette,et al.  Belief-Propagation on Edge Images for Stereo Analysis of Image Sequences , 2008, RobVis.

[9]  Takeo Kanade,et al.  Stereo by Two-Level Dynamic Programming , 1985, IJCAI.

[10]  Reinhard Klette,et al.  Belief Propagation for Stereo Analysis of Night-Vision Sequences , 2009, PSIVT.

[11]  Pedro F. Felzenszwalb,et al.  Efficient belief propagation for early vision , 2004, CVPR 2004.