Two-stage image smoothing based on edge-patch histogram equalisation and patch decomposition

Part of important structural edges in the image is smoothed due to the small gradients, while the others are preserved with greater gradients. Therefore, the authors propose a two-stage image smoothing method based on edge-patch histogram equalisation and patch decomposition. The authors' purpose is to increase the gradient of important structural edges while reducing the gradient of the texture region. Therefore, they divide the image into edge-patches where the structural edges are concentrated or non-edge-patches where the texture details are concentrated by image segmentation. The edge-patch needs to be equalised by the histograms for increasing the gradient of the edge pixels. All patches are decomposed to extract the smooth component for reducing the gradient of pixels. The smooth component of each patch is smoothed via L 0 gradient minimisation. In order to ensure the continuity of the patch boundaries, the edge-patch is inversely equalised. Finally, the whole image is smoothed via L 0 gradient minimisation for removing residual textures and seams. Experimental results demonstrate that the proposed method is more competitive in maintaining important structural edges and removing texture details than the state-of-the-art approaches. The proposed method can be applied to many areas of image processing.

[1]  Gang Wang,et al.  Tree Filtering: Efficient Structure-Preserving Smoothing With a Minimum Spanning Tree , 2014, IEEE Transactions on Image Processing.

[2]  Mingli Zhang,et al.  Image Smoothing Based on Image Decomposition and Sparse High Frequency Gradient , 2018, Journal of Computer Science and Technology.

[3]  Hua Huang,et al.  Efficient Structure-Aware Image Smoothingby Local Extrema on Space-Filling Curve , 2014, IEEE Transactions on Visualization and Computer Graphics.

[4]  Junfeng Yang,et al.  A New Alternating Minimization Algorithm for Total Variation Image Reconstruction , 2008, SIAM J. Imaging Sci..

[5]  Noor Badshah,et al.  Model for smoothing and segmentation of texture images using L 0 norm , 2018, IET Image Process..

[6]  Lei Zhang,et al.  A Benchmark for Edge-Preserving Image Smoothing , 2019, IEEE Transactions on Image Processing.

[7]  Jan Kautz,et al.  Local Laplacian filters: edge-aware image processing with a Laplacian pyramid , 2011, SIGGRAPH 2011.

[8]  Minh N. Do,et al.  Fast Global Image Smoothing Based on Weighted Least Squares , 2014, IEEE Transactions on Image Processing.

[9]  S. Avidan,et al.  Seam carving for content-aware image resizing , 2007, SIGGRAPH 2007.

[10]  Christian Desrosiers,et al.  High-quality Image Restoration Using Low-Rank Patch Regularization and Global Structure Sparsity , 2019, IEEE Transactions on Image Processing.

[11]  Yiquan Wu,et al.  Adaptive patched L0 gradient minimisation model applied on image smoothing , 2018, IET Image Process..

[12]  Caiming Zhang,et al.  A nonlocal gradient concentration method for image smoothing , 2015, Computational Visual Media.

[13]  Ralph R. Martin,et al.  Mixed-Domain Edge-Aware Image Manipulation , 2013, IEEE Transactions on Image Processing.

[14]  Jian Sun,et al.  Guided Image Filtering , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Yao Zhao,et al.  Local activity-driven structural-preserving filtering for noise removal and image smoothing , 2019, Signal Process..

[16]  Kwanghoon Sohn,et al.  Fast Domain Decomposition for Global Image Smoothing , 2017, IEEE Transactions on Image Processing.

[17]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .