An Efficient and Scalable Image Filtering Framework Using VIPS Fusion

Edge-preserving image filtering is a valuable tool for a variety of applications in image processing and computer vision. Motivated by a new simple but effective local Laplacian filter, we propose a scalable and efficient image filtering framework to extend this edge-preserving image filter and construct an uniform implementation in O (N) time. The proposed framework is built upon a practical global-to-local strategy. The input image is first remapped globally by a series of tentative remapping functions to generate a virtual candidate image sequence (Virtual Image Pyramid Sequence, VIPS). This sequence is then recombined locally to a single output image by a flexible edge-aware pixel-level fusion rule. To avoid halo artifacts, both the output image and the virtual candidate image sequence are transformed into multi-resolution pyramid representations. Four examples, single image dehazing, multi-exposure fusion, fast edge-preserving filtering and tone-mapping, are presented as the concrete applications of the proposed framework. Experiments on filtering effect and computational efficiency indicate that the proposed framework is able to build a wide range of fast image filtering that yields visually compelling results.

[1]  Manuel M. Oliveira,et al.  Domain transform for edge-aware image and video processing , 2011, SIGGRAPH 2011.

[2]  Michael Wimmer,et al.  Evaluation of HDR tone mapping methods using essential perceptual attributes , 2008, Comput. Graph..

[3]  Dani Lischinski,et al.  Gradient Domain High Dynamic Range Compression , 2023 .

[4]  Jan Kautz,et al.  Exposure Fusion , 2009, 15th Pacific Conference on Computer Graphics and Applications (PG'07).

[5]  Jules-Raymond Tapamo Multi-Scale Image Analysis by Pyramidal Algorithms , 2004, Journal of Mathematical Imaging and Vision.

[6]  Jian Sun,et al.  Guided Image Filtering , 2010, ECCV.

[7]  Ares Lagae,et al.  Filtering solid Gabor noise , 2011, SIGGRAPH 2011.

[8]  Jean-Michel Morel,et al.  The staircasing effect in neighborhood filters and its solution , 2006, IEEE Transactions on Image Processing.

[9]  Jiawen Chen,et al.  Real-time edge-aware image processing with the bilateral grid , 2007, SIGGRAPH 2007.

[10]  Dani Lischinski,et al.  Personalization of image enhancement , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[11]  Wojciech Matusik,et al.  Multi-scale image harmonization , 2010, SIGGRAPH 2010.

[12]  Bo Gu,et al.  Local Edge-Preserving Multiscale Decomposition for High Dynamic Range Image Tone Mapping , 2013, IEEE Transactions on Image Processing.

[13]  Jian Sun,et al.  A global sampling method for alpha matting , 2011, CVPR 2011.

[14]  Yasuo Kuniyoshi,et al.  Discriminative spatial pyramid , 2011, CVPR 2011.

[15]  Frédo Durand,et al.  Two-scale tone management for photographic look , 2006, SIGGRAPH 2006.

[16]  Codruta O. Ancuti,et al.  Enhancing underwater images and videos by fusion , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[17]  Raanan Fattal,et al.  Diffusion maps for edge-aware image editing , 2010, SIGGRAPH 2010.

[18]  Sabine Dippel,et al.  Multiscale contrast enhancement for radiographies: Laplacian pyramid versus fast wavelet transform , 2002, IEEE Transactions on Medical Imaging.

[19]  Yuan Cheng,et al.  Correcting over-exposure in photographs , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[20]  Jan Kautz,et al.  Local Laplacian filters: edge-aware image processing with a Laplacian pyramid , 2011, SIGGRAPH 2011.

[21]  Raanan Fattal Edge-avoiding wavelets and their applications , 2009, SIGGRAPH 2009.

[22]  Edward H. Adelson,et al.  The Laplacian Pyramid as a Compact Image Code , 1983, IEEE Trans. Commun..

[23]  Codruta O. Ancuti,et al.  Enhancing by saliency-guided decolorization , 2011, CVPR 2011.

[24]  Jian Sun,et al.  Single image haze removal using dark channel prior , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[25]  M. Kass,et al.  Smoothed local histogram filters , 2010, SIGGRAPH 2010.

[26]  Sandy Irani,et al.  Perception-based contrast enhancement of images , 2007, TAP.

[27]  Jean-Philippe Tarel,et al.  Fast visibility restoration from a single color or gray level image , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[28]  Holger Winnemöller,et al.  Real-time video abstraction , 2006, SIGGRAPH 2006.

[29]  Ashish Kapoor,et al.  Collaborative personalization of image enhancement , 2011, CVPR.

[30]  Zeev Farbman,et al.  Edge-preserving decompositions for multi-scale tone and detail manipulation , 2008, SIGGRAPH 2008.

[31]  Maneesh Agrawala,et al.  Edge-based image coarsening , 2009, TOGS.

[32]  Michael S. Brown,et al.  Globally Optimized Linear Windowed Tone Mapping , 2010, IEEE Transactions on Visualization and Computer Graphics.

[33]  Roberto Manduchi,et al.  Bilateral filtering for gray and color images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[34]  Frédo Durand,et al.  A Fast Approximation of the Bilateral Filter Using a Signal Processing Approach , 2006, International Journal of Computer Vision.

[35]  Edward H. Adelson,et al.  Compressing and companding high dynamic range images with subband architectures , 2005, SIGGRAPH 2005.

[36]  Michael F. Cohen,et al.  GradientShop: A gradient-domain optimization framework for image and video filtering , 2010, TOGS.