Architecture and Implementation of Real-Time Stereo Vision with Bilateral Background Subtraction

We describe the architecture and implementation of bilateral background subtraction for real-time stereo vision system. Pre-smoothing a signal and noise removal may help to improve the performance for many signal-processing algorithms such as compression, detection, enhancement, recognition, and more [2]. Bilateral filtering proposed by C. Tomasi and R. Manduchi can be used as an edge-preserving smoother, removing high-frequency components of an image without blurring its edges [1][3]. Recently, [3] showed enhanced real-time stereo through software implementation of bilateral filtering. In this paper, we show hardware implementation of bilateral background subtraction for real-time stereo and present its architecture as well as required hardware resources. Also, we provide experimental results with real data and present our future works.

[1]  John Woodfill,et al.  Real-time stereo vision on the PARTS reconfigurable computer , 1997, Proceedings. The 5th Annual IEEE Symposium on Field-Programmable Custom Computing Machines Cat. No.97TB100186).

[2]  Michael Elad.  Analysis of the bilateral filter , 2002, Conference Record of the Thirty-Sixth Asilomar Conference on Signals, Systems and Computers, 2002..

[3]  Guillermo Sapiro,et al.  Edges as Outliers: Anisotropic Smoothing Using Local Image Statistics , 1999, Scale-Space.

[4]  W. James MacLean,et al.  Video-rate stereo depth measurement on programmable hardware , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[5]  Joachim Weickert,et al.  Anisotropic diffusion in image processing , 1996 .

[6]  Jitendra Malik,et al.  Scale-Space and Edge Detection Using Anisotropic Diffusion , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  W. James MacLean,et al.  A Real-Time Large Disparity Range Stereo-System using FPGAs , 2006, Fourth IEEE International Conference on Computer Vision Systems (ICVS'06).

[8]  L. Matthies,et al.  Enhanced real-time stereo using bilateral filtering , 2004 .

[9]  W. James MacLean,et al.  Expanding Disparity Range in an FPGA Stereo System While Keeping Resource Utilization Low , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[10]  T. J. Dennis,et al.  Nonlinear smoothing of stereo disparity maps , 1994 .

[11]  Jürgen Teich,et al.  A Design Methodology for Hardware Acceleration of Adaptive Filter Algorithms in Image Processing , 2006, IEEE 17th International Conference on Application-specific Systems, Architectures and Processors (ASAP'06).

[12]  Reginald L. Lagendijk,et al.  Regularized iterative image restoration with ringing reduction , 1988, IEEE Trans. Acoust. Speech Signal Process..

[13]  Larry H. Matthies,et al.  Enhanced real-time stereo using bilateral filtering , 2004, Proceedings. 2nd International Symposium on 3D Data Processing, Visualization and Transmission, 2004. 3DPVT 2004..

[14]  Roberto Manduchi,et al.  Bilateral filtering for gray and color images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).