Wavelet-based hybrid natural image modeling using generalized Gaussian and α-stable distributions

Natural image presents leptokurtic and heavy-tailed distribution in wavelet domain.GGD or stable modeling cannot capture the non-Gaussian properties simultaneously.A hybrid model can take the superiorities of GGD and stable densities into account.A smart fusion of GGD and stable is given based on a weighted optimization problem.A closed form of KLD is devised for model performance evaluation and application. Natural image is characterized by its highly kurtotic and heavy-tailed distribution in wavelet domain. These typical non-Gaussian statistics are commonly described by generalized Gaussian density (GGD) or α-stable distribution. However, each of the two models has its own deficiency to capture the variety and complexity of real world scenes. Considering the statistical properties of GGD and α-stable distributions respectively, in this paper we propose a hybrid statistical model of natural image's wavelet coefficients which is better in describing the leptokurtosis and heavy tails simultaneously. Based on a clever fusion of GGD and α-stable functions, we establish the optimal parametric hybrid model, and a close-formed Kullback-Leibler divergence of the hybrid model is derived for evaluating model accuracy. Experiment results and comparative studies demonstrate that the proposed hybrid model is closer to the true distribution of natural image's wavelet coefficients than the single modeling using GGD or α-stable, while is beneficial for applications such as image comparison.

[1]  J. H. Hateren,et al.  Independent component filters of natural images compared with simple cells in primary visual cortex , 1998 .

[2]  Eero P. Simoncelli,et al.  On Advances in Statistical Modeling of Natural Images , 2004, Journal of Mathematical Imaging and Vision.

[3]  Ramón M. Rodríguez-Dagnino,et al.  Efficiency of the Approximated Shape Parameter Estimator in the Generalized Gaussian Distribution , 2009, IEEE Transactions on Vehicular Technology.

[4]  Daniel L. Ruderman,et al.  Origins of scaling in natural images , 1996, Vision Research.

[5]  Michael J. Black,et al.  Fields of Experts: a framework for learning image priors , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[6]  Eero P. Simoncelli Modeling the joint statistics of images in the wavelet domain , 1999, Optics & Photonics.

[7]  Wenjun Zhang,et al.  MDL context modeling of images with application to denoising , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[8]  S Kullback,et al.  LETTER TO THE EDITOR: THE KULLBACK-LEIBLER DISTANCE , 1987 .

[9]  Cedric Nishan Canagarajah,et al.  Statistical Multiscale Image Segmentation via Alpha-Stable Modeling , 2007, 2007 IEEE International Conference on Image Processing.

[10]  Josiane Zerubia,et al.  Skewed alpha-stable distributions for modelling textures , 2003, Pattern Recognit. Lett..

[11]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[12]  Alin Achim,et al.  Image denoising using bivariate α-stable distributions in the complex wavelet domain , 2005, IEEE Signal Processing Letters.

[13]  Ian Burns,et al.  Measuring texture classification algorithms , 1997, Pattern Recognit. Lett..

[14]  Yair Weiss,et al.  "Natural Images, Gaussian Mixtures and Dead Leaves" , 2012, NIPS.

[15]  Joseph W. Goodman,et al.  A mathematical analysis of the DCT coefficient distributions for images , 2000, IEEE Trans. Image Process..

[16]  Yuan Yan Tang,et al.  Multiview Hessian discriminative sparse coding for image annotation , 2013, Comput. Vis. Image Underst..

[17]  Ioannis A. Koutrouvelis,et al.  Regression-Type Estimation of the Parameters of Stable Laws , 1980 .

[18]  Yair Weiss,et al.  Scale invariance and noise in natural images , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[19]  Alan C. Bovik,et al.  A Statistical Evaluation of Recent Full Reference Image Quality Assessment Algorithms , 2006, IEEE Transactions on Image Processing.

[20]  F. Muller Distribution shape of two-dimensional DCT coefficients of natural images , 1993 .

[21]  Yong Huang,et al.  Texture decomposition by harmonics extraction from higher order statistics , 2004, IEEE Trans. Image Process..

[22]  Jiebo Luo,et al.  Modeling of subband coefficients for clustering-based adaptive quantization with spatial constraints , 2003, J. Vis. Commun. Image Represent..

[23]  Qolamreza R. Razlighi,et al.  Bilateral Markov mesh random field and its application to image restoration , 2012, J. Vis. Commun. Image Represent..

[24]  Minh N. Do,et al.  Wavelet-based texture retrieval using generalized Gaussian density and Kullback-Leibler distance , 2002, IEEE Trans. Image Process..

[25]  Stéphane Mallat,et al.  A Theory for Multiresolution Signal Decomposition: The Wavelet Representation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  I. A. Koutrouvelis An iterative procedure for the estimation of the parameters of stable laws , 1981 .

[27]  William Bialek,et al.  Statistics of Natural Images: Scaling in the Woods , 1993, NIPS.

[28]  Song-Chun Zhu,et al.  Prior Learning and Gibbs Reaction-Diffusion , 1997, IEEE Trans. Pattern Anal. Mach. Intell..