Image Enhancement by Gradient Distribution Specification

We propose to use gradient distribution specification for image enhancement. The specified gradient distribution is learned from natural-scene image datasets. This enhances image quality based on two facts: First, the specified distribution is independent of image content. Second, the distance between the learned distribution and the empirical distribution of a given image correlates with subjectively perceived image quality. Based on those two facts, remapping an image such that the distribution of its gradients (and therefore also Laplacians) matches the specified distribution is expected to improve the quality of that image. We call this process “image naturalization”. Our experiments confirm that naturalized images are more appealing to visual perception. Moreover, “naturalness” can be used as a measure of image quality when ground-truth is unknown.

[1]  Song-Chun Zhu,et al.  Prior Learning and Gibbs Reaction-Diffusion , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Rob Fergus,et al.  Fast Image Deconvolution using Hyper-Laplacian Priors , 2009, NIPS.

[3]  Bernhard Schölkopf,et al.  Fast removal of non-uniform camera shake , 2011, 2011 International Conference on Computer Vision.

[4]  David A. Forsyth,et al.  Generalizing motion edits with Gaussian processes , 2009, ACM Trans. Graph..

[5]  Xin Tong,et al.  AppWarp: retargeting measured materials by appearance-space warping , 2011, SA '11.

[6]  Richard Szeliski,et al.  Image Restoration by Matching Gradient Distributions , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Cewu Lu,et al.  Image smoothing via L0 gradient minimization , 2011, ACM Trans. Graph..

[8]  XuYi,et al.  Image smoothing via L0 gradient minimization , 2011 .

[9]  Michael J. Black,et al.  Fields of Experts , 2009, International Journal of Computer Vision.

[10]  Ankit Gupta,et al.  Single Image Deblurring Using Motion Density Functions , 2010, ECCV.

[11]  Dani Lischinski,et al.  Gradient Domain High Dynamic Range Compression , 2023 .

[12]  David Zhang,et al.  FSIM: A Feature Similarity Index for Image Quality Assessment , 2011, IEEE Transactions on Image Processing.

[13]  Gary E. Ford,et al.  Mean curvature evolution and surface area scaling in image filtering , 1997, IEEE Trans. Image Process..

[14]  Li Xu,et al.  Unnatural L0 Sparse Representation for Natural Image Deblurring , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[15]  Zeev Farbman,et al.  Edge-preserving decompositions for multi-scale tone and detail manipulation , 2008, ACM Trans. Graph..

[16]  Jian Sun,et al.  Guided Image Filtering , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Hua Yang,et al.  Sparse Feature Fidelity for Perceptual Image Quality Assessment , 2013, IEEE Transactions on Image Processing.

[18]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[19]  Suk-Ho Lee,et al.  Noise removal with Gauss curvature-driven diffusion , 2005, IEEE Transactions on Image Processing.

[20]  Ivo F. Sbalzarini,et al.  Coupled signed-distance functions for implicit surface reconstruction , 2012, 2012 9th IEEE International Symposium on Biomedical Imaging (ISBI).

[21]  Manuel Menezes de Oliveira Neto,et al.  Domain transform for edge-aware image and video processing , 2011, ACM Trans. Graph..

[22]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[23]  Raanan Fattal,et al.  Edge-avoiding wavelets and their applications , 2009, ACM Trans. Graph..

[24]  Dinu Coltuc,et al.  Exact histogram specification , 2006, IEEE Transactions on Image Processing.

[25]  Jiaya Jia,et al.  High-quality motion deblurring from a single image , 2008, ACM Trans. Graph..

[26]  Manuel Menezes de Oliveira Neto,et al.  Adaptive manifolds for real-time high-dimensional filtering , 2012, ACM Trans. Graph..

[27]  Ivo F. Sbalzarini,et al.  Local weighted Gaussian curvature for image processing , 2013, 2013 IEEE International Conference on Image Processing.

[28]  Zeev Farbman,et al.  Convolution pyramids , 2011, ACM Trans. Graph..

[29]  Li Xu,et al.  Structure extraction from texture via relative total variation , 2012, ACM Trans. Graph..