Semantic image content filtering via edge-preserving scale-aware filter

In this paper, we highlight a new filtering concept and methodology, called the semantic image content filtering (SICF), which aims to remove insignificant small details from the image while preserving its main structure. Such image content separation is not possible to achieve by using any conventional linear filter as it is essentially designed to perform frequency separation. To realize an effective SICF, a novel image filtering algorithm, called the edge-preserving scale-aware filter (ESF), is proposed in this paper. Our proposed ESF yields a significant improvement over a recently-developed scale-aware filter, called the rolling guidance filter (RGF). The key success of our ESF lies in the developed adaptive relative total variation filter (ARTVF), which replaces the RGF's Gaussian filter for generating a much improved initial guidance image. Extensive simulation results obtained from various test images have clearly demonstrated that the proposed ESF outperforms other state-of-the-art methods on conducting SICF task. That is, the semantically-important large-scale image structure has been better preserved, while the insignificant small details have been removed more effectively.

[1]  Seungyong Lee,et al.  Bilateral texture filtering , 2014, ACM Trans. Graph..

[2]  Frédo Durand,et al.  Edge-preserving multiscale image decomposition based on local extrema , 2009, ACM Trans. Graph..

[3]  Manuel M. Oliveira,et al.  Domain transform for edge-aware image and video processing , 2011, SIGGRAPH 2011.

[4]  Michael F. Cohen,et al.  Digital photography with flash and no-flash image pairs , 2004, ACM Trans. Graph..

[5]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[6]  Gang Wang,et al.  Tree Filtering: Efficient Structure-Preserving Smoothing With a Minimum Spanning Tree , 2014, IEEE Transactions on Image Processing.

[7]  Shiming Xiang,et al.  Segment Graph Based Image Filtering: Fast Structure-Preserving Smoothing , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[8]  Minh N. Do,et al.  Cross-based local multipoint filtering , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  Zeev Farbman,et al.  Edge-preserving decompositions for multi-scale tone and detail manipulation , 2008, SIGGRAPH 2008.

[10]  Aykut Erdem,et al.  Structure-preserving image smoothing via region covariances , 2013, ACM Trans. Graph..

[11]  Li Xu,et al.  Structure extraction from texture via relative total variation , 2012, ACM Trans. Graph..

[12]  Qi Zhang,et al.  Rolling Guidance Filter , 2014, ECCV.

[13]  Roberto Manduchi,et al.  Bilateral filtering for gray and color images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[14]  Minh N. Do,et al.  Fast Global Image Smoothing Based on Weighted Least Squares , 2014, IEEE Transactions on Image Processing.

[15]  Cewu Lu,et al.  Image smoothing via L0 gradient minimization , 2011, ACM Trans. Graph..

[16]  Jitendra Malik,et al.  Scale-Space and Edge Detection Using Anisotropic Diffusion , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Jean Ponce,et al.  Robust image filtering using joint static and dynamic guidance , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Jian Sun,et al.  Guided Image Filtering , 2010, ECCV.

[19]  Wotao Yin,et al.  Iteratively reweighted algorithms for compressive sensing , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.