A 124 Mpixels/s VLSI Design for Histogram-Based Joint Bilateral Filtering

This paper presents an efficient and scalable design for histogram-based bilateral filtering (BF) and joint BF (JBF) by memory reduction methods and architecture design techniques to solve the problems of high memory cost, high computational complexity, high bandwidth, and large range table. The presented memory reduction methods exploit the progressive computing characteristics to reduce the memory cost to 0.003%-0.020%, as compared with the original approach. Furthermore, the architecture design techniques adopt range domain parallelism and take advantage of the computing order and the numerical properties to solve the complexity, bandwidth, and range-table problems. The example design with a 90-nm complementary metal-oxide-semiconductor process can deliver the throughput to 124 Mpixels/s with 356-K gate counts and 23-KB on-chip memory.

[1]  Frédo Durand,et al.  Bilateral Filtering: Theory and Applications: Series: Foundations and Trends® in Computer Graphics and Vision , 2009 .

[2]  F. Durand,et al.  Flash photography enhancement via intrinsic relighting , 2004, ACM Trans. Graph..

[3]  Fatih Porikli,et al.  Constant time O(1) bilateral filtering , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[4]  Frédo Durand,et al.  A Fast Approximation of the Bilateral Filter Using a Signal Processing Approach , 2006, International Journal of Computer Vision.

[5]  Fatih Murat Porikli,et al.  Integral histogram: a fast way to extract histograms in Cartesian spaces , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[6]  B. Barenbrug,et al.  Improved depth propagation for 2D to 3D video conversion using key-frames , 2007 .

[7]  Hang-Bong Kang,et al.  Constant Time Stereo Matching , 2009, 2009 13th International Machine Vision and Image Processing Conference.

[8]  Sang-Kyo Han.  An architecture for high-throughput and improved-quality stereo vision processor , 2010 .

[9]  Gauthier Lafruit,et al.  Stream-Centric Stereo Matching and View Synthesis: A High-Speed Approach on GPUs , 2009, IEEE Transactions on Circuits and Systems for Video Technology.

[10]  Yongwei Nie,et al.  Fast multi-scale joint bilateral texture upsampling , 2009, The Visual Computer.

[11]  Haixian Wang,et al.  Image Denoising Using Trivariate Shrinkage Filter in the Wavelet Domain and Joint Bilateral Filter in the Spatial Domain , 2009, IEEE Transactions on Image Processing.

[12]  Ben Weiss.  Fast median and bilateral filtering , 2006, SIGGRAPH 2006.

[13]  F. Sattar,et al.  FPGA design of a real-time implementation of dynamic range compression for improving television picture , 2007, 2007 6th International Conference on Information, Communications & Signal Processing.

[14]  Narendra Ahuja,et al.  Real-time O(1) bilateral filtering , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[15]  Tian-Sheuan Chang,et al.  Algorithm and Architecture of Disparity Estimation With Mini-Census Adaptive Support Weight , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[16]  Robert Weigel,et al.  A synchronous FPGA design of a bilateral filter for image processing , 2009, 2009 35th Annual Conference of IEEE Industrial Electronics.

[17]  In-So Kweon,et al.  Adaptive Support-Weight Approach for Correspondence Search , 2006, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  D. Nistér,et al.  Stereo Matching with Color-Weighted Correlation, Hierarchical Belief Propagation, and Occlusion Handling , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Leif Kobbelt,et al.  Character animation from 2D pictures and 3D motion data , 2007, TOGS.

[20]  Roberto Manduchi,et al.  Bilateral filtering for gray and color images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[21]  Frédo Durand,et al.  Flash photography enhancement via intrinsic relighting , 2004, SIGGRAPH 2004.

[22]  Lucas J. van Vliet,et al.  Separable bilateral filtering for fast video preprocessing , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[23]  Michael F. Cohen,et al.  Digital photography with flash and no-flash image pairs , 2004, ACM Trans. Graph..

[24]  Liang-Gee Chen,et al.  A block-based 2D-to-3D conversion system with bilateral filter , 2009, 2009 Digest of Technical Papers International Conference on Consumer Electronics.

[25]  Marc Levoy,et al.  Gaussian KD-trees for fast high-dimensional filtering , 2009, ACM Trans. Graph..

[26]  Jiawen Chen,et al.  Real-time edge-aware image processing with the bilateral grid , 2007, ACM Trans. Graph..

[27]  Alexei A. Efros,et al.  Fast bilateral filtering for the display of high-dynamic-range images , 2002 .

[28]  Yi-Nung Liu,et al.  Color filter array demosaicking using joint bilateral filter , 2009, 2009 IEEE International Conference on Multimedia and Expo.

[29]  Ruigang Yang,et al.  Spatial-Depth Super Resolution for Range Images , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[30]  Truong Quang Vinh,et al.  FPGA Implementation of Real-Time Edge-Preserving Filter for Video Noise Reduction , 2008, 2008 International Conference on Computer and Electrical Engineering.

[31]  Dani Lischinski,et al.  Joint bilateral upsampling , 2007, ACM Trans. Graph..

[32]  P.K. Rajan,et al.  Two-dimensional digital signal processing II: Transforms and median filters , 1982, Proceedings of the IEEE.

[33]  A. K. Riemens,et al.  Multistep joint bilateral depth upsampling , 2009, Electronic Imaging.