RASCor: An associative hardware algorithm for real time stereo

Solving the stereo correspondence problem is an important step towards extraction of three dimensional structure of a scene from two or more images taken from distinct viewpoints. This paper presents a hardware solution to real time stereo matching problem using system of associative relations (SOAR) computational model. SOAR makes use of direction of derivatives for capturing pair-wise pixel interactions and uses pair-wise interactions to determine the underlying structure of associations. Pair-wise pixel interactions are defined over structures called Tokens. The hardware stereo matching solution developed in this study utilizes direction of derivatives to encode inter-pixel associations and implements a real time stereo matching solution. RASCor is realized on an FPGA platform and offers real time stereo matching using hardware parallelism and process pipelining. Real time stereo matching is achieved through hardware unit multiplicity and frequency scaling. The cost of hardware implementation is presented along with performance improvements from frequency scaling, unit multiplicity and search depth for stereo matching.

[1]  Luigi di Stefano,et al.  A fast area-based stereo matching algorithm , 2004, Image Vis. Comput..

[2]  Chris Murphy,et al.  Low-Cost Stereo Vision on an FPGA , 2007, 15th Annual IEEE Symposium on Field-Programmable Custom Computing Machines (FCCM 2007).

[3]  Geovany de Araújo Borges,et al.  VoC: a reconfigurable matrix for stereo vision processing , 2006, Proceedings 20th IEEE International Parallel & Distributed Processing Symposium.

[4]  Alonzo Kelly,et al.  Obstacle detection for unmanned ground vehicles: a progress report , 1995 .

[5]  Yusuf Öztürk,et al.  RASCor: Realtime Associative Stereo Correspondence , 2007, 2007 IEEE International Conference on Image Processing.

[6]  R. Porter,et al.  A generic implementation framework for FPGA based stereo matching , 1997, TENCON '97 Brisbane - Australia. Proceedings of IEEE TENCON '97. IEEE Region 10 Annual Conference. Speech and Image Technologies for Computing and Telecommunications (Cat. No.97CH36162).

[7]  W. James MacLean,et al.  Reconfigurable hardware implementation of a phase-correlation stereoalgorithm , 2006, Machine Vision and Applications.

[8]  John Iselin Woodfill,et al.  Tyzx DeepSea High Speed Stereo Vision System , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[9]  Reinhard Männer,et al.  Calculating Dense Disparity Maps from Color Stereo Images, an Efficient Implementation , 2004, International Journal of Computer Vision.

[10]  Laurent Moll,et al.  Real time correlation-based stereo: algorithm, implementations and applications , 1993 .

[11]  Olga Veksler,et al.  Stereo Correspondence with Compact Windows via Minimum Ratio Cycle , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Darius Burschka,et al.  Advances in Computational Stereo , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  M. Marchionni,et al.  A PC-based real-time stereo vision system , 2004 .

[14]  Hüseyin Abut,et al.  SOAR: System of associative relations , 2002, Signal Process. Image Commun..

[15]  Yasuhiro Kobayashi,et al.  FPGA implementation of a stereo matching processor based on window-parallel-and-pixel-parallel architecture , 2005, 48th Midwest Symposium on Circuits and Systems, 2005..

[16]  Takeo Kanade,et al.  CMU Video-Rate Stereo Machine , 1995 .

[17]  W. James MacLean,et al.  Video-rate stereo depth measurement on programmable hardware , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[18]  Mark L. Chang,et al.  Low-Cost Stereo Vision on an FPGA , 2007 .

[19]  Yusuf Öztürk,et al.  Fast model based stereo matching using SOAR , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[20]  Hüseyin Abut,et al.  A novel similarity measure for compression and classification , 1998, Proceedings of the 1998 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP '98 (Cat. No.98CH36181).