Constant Time Joint Bilateral Filtering Using Joint Integral Histograms

In this brief, we present a constant time method for the joint bilateral filtering. First, we propose an image data structure, coined as joint integral histograms (JIHs). Extending the classic integral images and the integral histograms, it represents the global information of two correlated images. In a JIH, the value at each bin indicates an integral determined by the two images. Then, the joint bilateral filtering is transformed to computation and manipulation of histograms. Utilizing the JIHs, we are capable of joint bilateral filtering in constant time. Its performance is validated in a digital photography approach using Flash–noFlash image pairs. Compared with the brute-force method, the proposed method achieves a speedup factor of 2–3 orders of magnitude while producing similar filtering results.

[1]  Yao Zhao,et al.  Two-Stage Diversity-Based Multiple Description Image Coding , 2008, IEEE Signal Processing Letters.

[2]  Dani Lischinski,et al.  Joint bilateral upsampling , 2007, ACM Trans. Graph..

[3]  Richard Szeliski,et al.  Digital photography with flash and no-flash image pairs , 2004, ACM Trans. Graph..

[4]  Jian Sun,et al.  Guided Image Filtering , 2010, ECCV.

[5]  Gabriella Olmo,et al.  A Flexible R-D-Based Multiple Description Scheme for JPEG 2000 , 2007, IEEE Signal Processing Letters.

[6]  Franklin C. Crow,et al.  Summed-area tables for texture mapping , 1984, SIGGRAPH.

[7]  Suhas N. Diggavi,et al.  Multiple Description Coding for Stationary Gaussian Sources , 2009, IEEE Transactions on Information Theory.

[8]  Fatih Murat Porikli,et al.  Integral histogram: a fast way to extract histograms in Cartesian spaces , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[9]  Roberto Manduchi,et al.  Bilateral filtering for gray and color images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[10]  Fatih Murat Porikli,et al.  Region Covariance: A Fast Descriptor for Detection and Classification , 2006, ECCV.

[11]  Alessandro Foi,et al.  Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering , 2007, IEEE Transactions on Image Processing.

[12]  Ram Zamir,et al.  Multiple description image/video compression using oversampling and noise shaping in the DCT-domain , 2010, 2010 IEEE 26-th Convention of Electrical and Electronics Engineers in Israel.

[13]  Michael F. Cohen,et al.  Digital photography with flash and no-flash image pairs , 2004, ACM Trans. Graph..

[14]  Ram Zamir,et al.  Multiple-Description Coding by Dithered , 2009 .

[15]  Jian Sun,et al.  Guided Image Filtering , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Rudy Lauwereins,et al.  Joint integral histograms and its application in stereo matching , 2010, 2010 IEEE International Conference on Image Processing.

[17]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Christopher Hunt,et al.  Notes on the OpenSURF Library , 2009 .

[19]  Chao Tian,et al.  Multiple Description Quantization Via Gram–Schmidt Orthogonalization , 2005, IEEE Transactions on Information Theory.

[20]  Feng Wu,et al.  Efficient Multiple-Description Image Coding Using Directional Lifting-Based Transform , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[21]  Antonio Ortega,et al.  Multiple description coding via polyphase transform and selective quantization , 1998, Electronic Imaging.

[22]  D K Smith,et al.  Numerical Optimization , 2001, J. Oper. Res. Soc..

[23]  Trac D. Tran,et al.  Lapped transform via time-domain pre- and post-filtering , 2003, IEEE Trans. Signal Process..

[24]  Chao Tian,et al.  A new class of multiple description scalar quantizer and its application to image coding , 2005, IEEE Signal Processing Letters.

[25]  Larry S. Davis,et al.  Kernel integral images: A framework for fast non-uniform filtering , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[26]  In-So Kweon,et al.  Adaptive Support-Weight Approach for Correspondence Search , 2006, IEEE Trans. Pattern Anal. Mach. Intell..

[27]  Narendra Ahuja,et al.  Real-time O(1) bilateral filtering , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[28]  Chao Tian,et al.  M-Channel Multiple Description Coding With , 2010 .

[29]  SIMON FRASER.  MULTIPLE DESCRIPTION CODING WITH PREDICTION COMPENSATION , 2009 .

[30]  Michael T. Orchard,et al.  Multiple description coding using pairwise correlating transforms , 2001, IEEE Trans. Image Process..

[31]  Gabriella Olmo,et al.  Multiple Description Image Coding Based on Lagrangian Rate Allocation , 2007, IEEE Transactions on Image Processing.

[32]  Michael T. Orchard,et al.  Novel sequential error-concealment techniques using orientation adaptive interpolation , 2001, IEEE Trans. Circuits Syst. Video Technol..

[33]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[34]  Yuval Kochman,et al.  Noise-Shaped Predictive Coding for Multiple Descriptions of a Colored Gaussian Source , 2008, Data Compression Conference (dcc 2008).

[35]  Luc Van Gool,et al.  SURF: Speeded Up Robust Features , 2006, ECCV.

[36]  Dani Lischinski,et al.  Joint bilateral upsampling , 2007, SIGGRAPH 2007.

[37]  Trac D. Tran,et al.  Context-based entropy coding of block transform coefficients for image compression , 2002, IEEE Trans. Image Process..

[38]  Hua Wang,et al.  Vector Gaussian Multiple Description With Individual and Central Receivers , 2005, IEEE Transactions on Information Theory.

[39]  Fatih Porikli,et al.  Constant time O(1) bilateral filtering , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[40]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..