Spatially guided local Laplacian filter for nature image detail enhancement

Nature images make up a significant proportion of the ever growing volume of social media. In this context, automatic and rapid image enhancement is always among the favorable techniques for photographers. Among the image representation models, the Gaussian and Laplacian image pyramids based on isotropic Gaussian kernels were once considered to be inappropriate for image enhancement tasks. The recently proposed Local Laplacian Filter (LLF) updates this view by designing a point-wise intensity remapping process. However, this model filters an image with a consistent strength instead of a dynamical way which takes image contents into account. In this paper, we propose a spatially guided LLF by extending the single-value key parameter into a multi-value matrix that dynamically assigns filtering strengths according to image contents. Since it is still very challenging to recognize arbitrary image contents with machine learning methods, we propose a simple but effective technique, which only approximates the richness of image details instead of specific contents. This trade-off between concrete semantics and algorithm efficiency enables filtering strengths to be spatially guided in the LLF process with little extra computational cost. Experimental results validate our method in terms of visual effects and a conditionally faster LLF implementation.

[1]  Jean-Michel Morel,et al.  The staircasing effect in neighborhood filters and its solution , 2006, IEEE Transactions on Image Processing.

[2]  Frédo Durand,et al.  Bilateral Filtering: Theory and Applications , 2009, Found. Trends Comput. Graph. Vis..

[3]  Xian-Sheng Hua,et al.  Towards a Relevant and Diverse Search of Social Images , 2010, IEEE Transactions on Multimedia.

[4]  Michael F. Cohen,et al.  GradientShop: A gradient-domain optimization framework for image and video filtering , 2010, TOGS.

[5]  Meng Wang,et al.  Video accessibility enhancement for hearing-impaired users , 2011, TOMCCAP.

[6]  Qi Tian,et al.  Less is More: Efficient 3-D Object Retrieval With Query View Selection , 2011, IEEE Transactions on Multimedia.

[7]  Xindong Wu,et al.  3-D Object Retrieval With Hausdorff Distance Learning , 2014, IEEE Transactions on Industrial Electronics.

[8]  Jian Sun,et al.  Guided Image Filtering , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Jan Kautz,et al.  Local Laplacian filters: edge-aware image processing with a Laplacian pyramid , 2011, ACM Trans. Graph..

[10]  Hans-Peter Seidel,et al.  MovieReshape: tracking and reshaping of humans in videos , 2010, SIGGRAPH 2010.

[11]  Haojie Li,et al.  Capturing a great photo via learning from community-contributed photo collections , 2011, MM '11.

[12]  Bingbing Ni,et al.  Learning to Photograph: A Compositional Perspective , 2013, IEEE Transactions on Multimedia.

[13]  Yongdong Zhang,et al.  Automatic Detection and Analysis of Player Action in Moving Background Sports Video Sequences , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[14]  Meng Wang,et al.  Tag Tagging: Towards More Descriptive Keywords of Image Content , 2011, IEEE Transactions on Multimedia.

[15]  Gaofeng Meng,et al.  Image Guided Tone Mapping with Locally Nonlinear Model , 2012, ECCV.

[16]  Pierre Kornprobst,et al.  Bilateral Filtering , 2009 .

[17]  Szymon Rusinkiewicz,et al.  Multiscale shape and detail enhancement from multi-light image collections , 2007, ACM Trans. Graph..

[18]  Yue Gao,et al.  3-D Object Retrieval and Recognition With Hypergraph Analysis , 2012, IEEE Transactions on Image Processing.

[19]  Meng Wang,et al.  Active learning in multimedia annotation and retrieval: A survey , 2011, TIST.

[20]  Xun Wang,et al.  Adaptive tone-preserved image detail enhancement , 2012, The Visual Computer.

[21]  Bingbing Ni,et al.  Assistive tagging: A survey of multimedia tagging with human-computer joint exploration , 2012, CSUR.

[22]  Jitendra Malik,et al.  Scale-Space and Edge Detection Using Anisotropic Diffusion , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  Claudio Carpineto,et al.  A Survey of Automatic Query Expansion in Information Retrieval , 2012, CSUR.

[24]  Meng Wang,et al.  Unified Video Annotation via Multigraph Learning , 2009, IEEE Transactions on Circuits and Systems for Video Technology.

[25]  Xuelong Li,et al.  Visual-Textual Joint Relevance Learning for Tag-Based Social Image Search , 2013, IEEE Transactions on Image Processing.