Tree Filtering: Efficient Structure-Preserving Smoothing With a Minimum Spanning Tree

We present a new efficient edge-preserving filter-“tree filter”-to achieve strong image smoothing. The proposed filter can smooth out high-contrast details while preserving major edges, which is not achievable for bilateral-filter-like techniques. Tree filter is a weighted-average filter, whose kernel is derived by viewing pixel affinity in a probabilistic framework simultaneously considering pixel spatial distance, color/intensity difference, as well as connectedness. Pixel connectedness is acquired by treating pixels as nodes in a minimum spanning tree (MST) extracted from the image. The fact that an MST makes all image pixels connected through the tree endues the filter with the power to smooth out high-contrast, fine-scale details while preserving major image structures, since pixels in small isolated region will be closely connected to surrounding majority pixels through the tree, while pixels inside large homogeneous region will be automatically dragged away from pixels outside the region. The tree filter can be separated into two other filters, both of which turn out to have fast algorithms. We also propose an efficient linear time MST extraction algorithm to further improve the whole filtering speed. The algorithms give tree filter a great advantage in low computational complexity (linear to number of image pixels) and fast speed: it can process a 1-megapixel 8-bit image at ~ 0.25 s on an Intel 3.4 GHz Core i7 CPU (including the construction of MST). The proposed tree filter is demonstrated on a variety of applications.

[1]  Daniel P. Huttenlocher,et al.  Efficient Graph-Based Image Segmentation , 2004, International Journal of Computer Vision.

[2]  Frédo Durand,et al.  Fast and Robust Pyramid-based Image Processing , 2011 .

[3]  Hans-Peter Seidel,et al.  MovieReshape: tracking and reshaping of humans in videos , 2010, SIGGRAPH 2010.

[4]  Raanan Fattal,et al.  Edge-avoiding wavelets and their applications , 2009, ACM Trans. Graph..

[5]  Roberto Manduchi,et al.  Bilateral filtering for gray and color images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[6]  Michael F. Cohen,et al.  Digital photography with flash and no-flash image pairs , 2004, ACM Trans. Graph..

[7]  Frederik Zilly,et al.  Adaptive cross-trilateral depth map filtering , 2010, 2010 3DTV-Conference: The True Vision - Capture, Transmission and Display of 3D Video.

[8]  Richard Szeliski,et al.  High-accuracy stereo depth maps using structured light , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[9]  Rahul Nair,et al.  Denoising Strategies for Time-of-Flight Data , 2013, Time-of-Flight and Depth Imaging.

[10]  Qingxiong Yang,et al.  Recursive Bilateral Filtering , 2012, ECCV.

[11]  Patrick Pérez,et al.  Geodesic image and video editing , 2010, TOGS.

[12]  Xin-She Yang,et al.  Introduction to Algorithms , 2021, Nature-Inspired Optimization Algorithms.

[13]  Thomas H. Cormen,et al.  Introduction to algorithms [2nd ed.] , 2001 .

[14]  M. Levoy,et al.  Gaussian KD-trees for fast high-dimensional filtering , 2009, SIGGRAPH 2009.

[15]  Jan Kautz,et al.  Local Laplacian filters , 2015, Commun. ACM.

[16]  Rynson W. H. Lau,et al.  A gradient-domain-based edge-preserving sharpen filter , 2011, The Visual Computer.

[17]  XuYi,et al.  Image smoothing via L0 gradient minimization , 2011 .

[18]  Qingxiong Yang,et al.  A non-local cost aggregation method for stereo matching , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[19]  M. Kass,et al.  Smoothed local histogram filters , 2010, SIGGRAPH 2010.

[20]  Frédo Durand,et al.  Edge-preserving multiscale image decomposition based on local extrema , 2009, ACM Trans. Graph..

[21]  Jean Stawiaski,et al.  Minimum spanning tree adaptive image filtering , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[22]  Zhen Ji,et al.  Edge-Preserving Texture Suppression Filter Based on Joint Filtering Schemes , 2013, IEEE Transactions on Multimedia.

[23]  Manuel M. Oliveira,et al.  Domain transform for edge-aware image and video processing , 2011, SIGGRAPH 2011.

[24]  Michael Felsberg,et al.  Channel smoothing: efficient robust smoothing of low-level signal features , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  Narendra Ahuja,et al.  Real-time O(1) bilateral filtering , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[26]  Manuel Menezes de Oliveira Neto,et al.  Adaptive manifolds for real-time high-dimensional filtering , 2012, ACM Trans. Graph..

[27]  Yll Haxhimusa,et al.  Segmentation Graph Hierarchies , 2004, SSPR/SPR.

[28]  Cewu Lu,et al.  Image smoothing via L0 gradient minimization , 2011, ACM Trans. Graph..

[29]  Jitendra Malik,et al.  A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[30]  Patrick Pérez,et al.  Geodesic Forests for Image Editing , 2011 .

[31]  Joost van de Weijer,et al.  Local Mode Filtering , 2001, CVPR.

[32]  Robert E. Tarjan,et al.  Fibonacci heaps and their uses in improved network optimization algorithms , 1984, JACM.

[33]  Alessandro Foi,et al.  Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering , 2007, IEEE Transactions on Image Processing.

[34]  Jitendra Malik,et al.  Scale-Space and Edge Detection Using Anisotropic Diffusion , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[35]  John Riedl,et al.  Item-based collaborative filtering recommendation algorithms , 2001, WWW '01.

[36]  Jian Sun,et al.  Guided Image Filtering , 2010, ECCV.

[37]  Jiawen Chen,et al.  Real-time edge-aware image processing with the bilateral grid , 2007, SIGGRAPH 2007.

[38]  Andrew Adams,et al.  Fast High‐Dimensional Filtering Using the Permutohedral Lattice , 2010, Comput. Graph. Forum.

[39]  Fatih Porikli,et al.  Constant time O(1) bilateral filtering , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[40]  Zeev Farbman,et al.  Edge-preserving decompositions for multi-scale tone and detail manipulation , 2008, SIGGRAPH 2008.

[41]  R. Prim Shortest connection networks and some generalizations , 1957 .

[42]  Frédo Durand,et al.  A Fast Approximation of the Bilateral Filter Using a Signal Processing Approach , 2006, ECCV.

[43]  Li Xu,et al.  Structure extraction from texture via relative total variation , 2012, ACM Trans. Graph..

[44]  Noriaki Suetake,et al.  Structural-context-preserving image abstraction by using space-filling curve based on minimum spanning tree , 2011, 2011 18th IEEE International Conference on Image Processing.

[45]  Jan Kautz,et al.  Local Laplacian filters: edge-aware image processing with a Laplacian pyramid , 2011, SIGGRAPH 2011.

[46]  Alexei A. Efros,et al.  Fast bilateral filtering for the display of high-dynamic-range images , 2002 .