Towards a Closed Form Second-Order Natural Scene Statistics Model

Previous work on natural scene statistics (NSS)-based image models has focused primarily on characterizing the univariate bandpass statistics of single pixels. These models have proven to be powerful tools driving a variety of computer vision and image/video processing applications, including depth estimation, image quality assessment, and image denoising, among others. Multivariate NSS models descriptive of the joint distributions of spatially separated bandpass image samples have, however, received relatively little attention. Here, we develop a closed form bivariate spatial correlation model of bandpass and normalized image samples that completes an existing 2D joint generalized Gaussian distribution model of adjacent bandpass pixels. Our model is built using a set of diverse, high-quality naturalistic photographs, and as a control, we study the model properties on white noise. We also study the way the model fits are affected when the images are modified by common distortions.

[1]  D. Tolhurst,et al.  Amplitude spectra of natural images , 1992 .

[2]  Alan C. Bovik,et al.  Oriented Correlation Models of Distorted Natural Images With Application to Natural Stereopair Quality Evaluation , 2015, IEEE Transactions on Image Processing.

[3]  J. Johnson.  Thermal Agitation of Electricity in Conductors , 1927, Nature.

[4]  A.H. Tewfik,et al.  Correlation structure of the discrete wavelet coefficients of fractional Brownian motion , 1992, IEEE Trans. Inf. Theory.

[5]  J. E. Cohen,et al.  A novel experimental apparatus to study the impact of white noise and 1/f noise on animal populations , 1998, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[6]  Che-Chun Su,et al.  Bayesian depth estimation from monocular natural images. , 2017, Journal of vision.

[7]  B. Mandelbrot,et al.  Fractional Brownian Motions, Fractional Noises and Applications , 1968 .

[8]  Nicholas G. Paulter,et al.  Tasking on Natural Statistics of Infrared Images , 2016, IEEE Transactions on Image Processing.

[9]  Bernhard Schölkopf,et al.  New Support Vector Algorithms , 2000, Neural Computation.

[10]  Anthony D D'Antona,et al.  Humans make efficient use of natural image statistics when performing spatial interpolation. , 2013, Journal of vision.

[11]  Alan C. Bovik,et al.  Generalizing a closed-form correlation model of oriented bandpass natural images , 2015, 2015 IEEE Global Conference on Signal and Information Processing (GlobalSIP).

[12]  Alan C. Bovik,et al.  Blind Image Quality Assessment: From Natural Scene Statistics to Perceptual Quality , 2011, IEEE Transactions on Image Processing.

[13]  David J. Field,et al.  Emergence of simple-cell receptive field properties by learning a sparse code for natural images , 1996, Nature.

[14]  M. Do,et al.  Directional multiscale modeling of images using the contourlet transform , 2003, IEEE Workshop on Statistical Signal Processing, 2003.

[15]  M. S. Keshner.  1/f noise , 1982, Proceedings of the IEEE.

[16]  Honglak Lee,et al.  Sparse deep belief net model for visual area V2 , 2007, NIPS.

[17]  Alan C. Bovik,et al.  A Statistical Evaluation of Recent Full Reference Image Quality Assessment Algorithms , 2006, IEEE Transactions on Image Processing.

[18]  Alan C. Bovik,et al.  Bivariate statistical modeling of color and range in natural scenes , 2014, Electronic Imaging.

[19]  D L Gilden,et al.  1/f noise in human cognition. , 1995, Science.

[20]  D. Mumford,et al.  Stochastic models for generic images , 2001 .

[21]  Edward H. Adelson,et al.  The Design and Use of Steerable Filters , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  Eero P. Simoncelli,et al.  Natural image statistics and neural representation. , 2001, Annual review of neuroscience.

[23]  Alan C. Bovik,et al.  On the Natural Statistics of Chromatic Images , 2018, 2018 IEEE Southwest Symposium on Image Analysis and Interpretation (SSIAI).

[24]  R. Voss,et al.  ’’1/f noise’’ in music: Music from 1/f noise , 1978 .

[25]  D J Field,et al.  Relations between the statistics of natural images and the response properties of cortical cells. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[26]  J. Movshon,et al.  Linearity and Normalization in Simple Cells of the Macaque Primary Visual Cortex , 1997, The Journal of Neuroscience.

[27]  Alan C. Bovik,et al.  No-Reference Image Quality Assessment in the Spatial Domain , 2012, IEEE Transactions on Image Processing.

[28]  Alan C. Bovik,et al.  Automatic Prediction of Perceptual Image and Video Quality , 2013, Proceedings of the IEEE.

[29]  I. Good,et al.  Fractals: Form, Chance and Dimension , 1978 .

[30]  Richard T. Baillie,et al.  Long memory processes and fractional integration in econometrics , 1996 .

[31]  Eero P. Simoncelli,et al.  Random Cascades on Wavelet Trees and Their Use in Analyzing and Modeling Natural Images , 2001 .

[32]  Jean-Yves Tourneret,et al.  Parameter Estimation For Multivariate Generalized Gaussian Distributions , 2013, IEEE Transactions on Signal Processing.

[33]  Alan C. Bovik,et al.  Making a “Completely Blind” Image Quality Analyzer , 2013, IEEE Signal Processing Letters.

[34]  William Bialek,et al.  Statistics of Natural Images: Scaling in the Woods , 1993, NIPS.

[35]  Eero P. Simoncelli.  Modeling the joint statistics of images in the wavelet domain , 1999, Optics & Photonics.

[36]  Alan C. Bovik,et al.  Closed-Form Correlation Model of Oriented Bandpass Natural Images , 2015, IEEE Signal Process. Lett..

[37]  Ann B. Lee.  Occlusion Models for Natural Images : A Statistical Study of a Scale-Invariant Dead Leaves Model , 2001 .

[38]  Alan C. Bovik,et al.  Experiments in segmenting texton patterns using localized spatial filters , 1989, Pattern Recognit..

[39]  M. Fisz.  The limiting distribution of a function of two independent random variables and its statistical application , 1955 .

[40]  William T. Freeman,et al.  Presented at: 2nd Annual IEEE International Conference on Image , 1995 .

[41]  P. Gill,et al.  Quasi-Newton Methods for Unconstrained Optimization , 1972 .

[42]  Levent Sendur,et al.  Bivariate shrinkage functions for wavelet-based denoising exploiting interscale dependency , 2002, IEEE Trans. Signal Process..

[43]  J. Halley.  Ecology, evolution and 1 f -noise. , 1996, Trends in ecology & evolution.

[44]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[45]  Praful Gupta,et al.  Studying the Statistics of Natural X-ray Pictures , 2018 .

[46]  Alan C. Bovik,et al.  Relating spatial and spectral models of oriented bandpass natural images , 2016, 2016 IEEE Southwest Symposium on Image Analysis and Interpretation (SSIAI).

[47]  Constantine Caramanis,et al.  Second Order Natural Scene Statistics Model of Blind Image Quality Assessment , 2018, 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[48]  Alan C. Bovik,et al.  Color and Depth Priors in Natural Images , 2013, IEEE Transactions on Image Processing.

[49]  G. Nason,et al.  A Haar-Fisz Algorithm for Poisson Intensity Estimation , 2004 .

[50]  Nikolay N. Ponomarenko,et al.  Image database TID2013: Peculiarities, results and perspectives , 2015, Signal Process. Image Commun..

[51]  Pierre Moulin,et al.  Information-theoretic analysis of interscale and intrascale dependencies between image wavelet coefficients , 2001, IEEE Trans. Image Process..

[52]  J. Johnson.  Thermal Agitation of Electricity in Conductors , 1928 .

[53]  David J. Field,et al.  How Close Are We to Understanding V1? , 2005, Neural Computation.

[54]  Eero P. Simoncelli,et al.  A Parametric Texture Model Based on Joint Statistics of Complex Wavelet Coefficients , 2000, International Journal of Computer Vision.