A sliced synchronous iteration architecture for real-time global stereo matching

In this paper, we present a low memory-cost message iteration architecture for a fast belief propagation(BP) algorithm. To meet the real-time goal, our architecture basically follows multi-scale BP method and truncated linear smoothness cost model. We observe that the message iteration process in BP requires a huge intermediate buffer to store four directional messages of the whole node. Therefore, instead of updating all the node messages in each iteration sequence, we propose that individual node could be completed iteration process in ahead and consecutively execute it node by node. The key ideas in this paper focus on both maximizing architecture's parallelism and minimizing implementation cost overhead. Therefore, we first apply a pipelined architecture to each iteration stage that is executed independently. Note that pipelining makes it faster message throughput at a single iteration cycle rather than consuming whole iteration cycle time as previously. We also make multiple message update nodes as a minimal processing unit to maximize the parallelism. For the multi-scale BP method, the proposed parallel architecture does not cause additional execution time for processing the nodes in the down-scaled Markov Random Field(MRF). Considering VGA image size, 4 iterations per each scale and 64 disparity levels, our approach can reduce memory complexity by 99.7% and make it 340 times faster than the general multi-scale BP architecture.

[1]  Nanning Zheng,et al.  Stereo Matching Using Belief Propagation , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Richard Szeliski,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, International Journal of Computer Vision.

[3]  William T. Freeman,et al.  Comparison of graph cuts with belief propagation for stereo, using identical MRF parameters , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[4]  Tianli Yu,et al.  Efficient Message Representations for Belief Propagation , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[5]  Marc Pollefeys,et al.  Temporally Consistent Reconstruction from Multiple Video Streams Using Enhanced Belief Propagation , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[6]  LIVIC-INRETS Lcpc IN-VEHICLE OBSTACLES DETECTION AND CHARACTERIZATION BY STEREOVISION , 2003 .

[7]  Miao Liao,et al.  Real-time Global Stereo Matching Using Hierarchical Belief Propagation , 2006, BMVC.

[8]  Tian-Sheuan Chang,et al.  Low Memory Cost Block-Based Belief Propagation for Stereo Correspondence , 2007, 2007 IEEE International Conference on Multimedia and Expo.