Local Phase Coherence and the Perception of Blur

Humans are able to detect blurring of visual images, but the mechanism by which they do so is not clear. A traditional view is that a blurred image looks "unnatural" because of the reduction in energy (either globally or locally) at high frequencies. In this paper, we propose that the disruption of local phase can provide an alternative explanation for blur perception. We show that precisely localized features such as step edges result in strong local phase coherence structures across scale and space in the complex wavelet transform domain, and blurring causes loss of such phase coherence. We propose a technique for coarse-to-fine phase prediction of wavelet coefficients, and observe that (1) such predictions are highly effective in natural images, (2) phase coherence increases with the strength of image features, and (3) blurring disrupts the phase coherence relationship in images. We thus lay the groundwork for a new theory of perceptual blur estimation, as well as a variety of algorithms for restoration and manipulation of photographic images.

[1]  E H Adelson,et al.  Spatiotemporal energy models for the perception of motion. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[2]  D. Field,et al.  Visual sensitivity, blur and the sources of variability in the amplitude spectra of natural scenes , 1997, Vision Research.

[3]  Eero P. Simoncelli.  Statistical models for images: compression, restoration and synthesis , 1997, Conference Record of the Thirty-First Asilomar Conference on Signals, Systems and Computers (Cat. No.97CB36136).

[4]  E. Kretzmer.  Statistics of television signals , 1952 .

[5]  William Bialek,et al.  Seeing Beyond the Nyquist Limit , 1999, Neural Computation.

[6]  D J Field,et al.  Relations between the statistics of natural images and the response properties of cortical cells. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[7]  D. Tolhurst,et al.  Discrimination of changes in the second-order statistics of natural and synthetic images , 1994, Vision Research.

[8]  Eero P. Simoncelli,et al.  A Parametric Texture Model Based on Joint Statistics of Complex Wavelet Coefficients , 2000, International Journal of Computer Vision.

[9]  Svetha Venkatesh,et al.  An energy feature detection scheme , 1989 .

[10]  D. Ruderman.  The statistics of natural images , 1994 .

[11]  David J. Fleet,et al.  Computation of component image velocity from local phase information , 1990, International Journal of Computer Vision.

[12]  D. Heeger.  Half-squaring in responses of cat striate cells , 1992, Visual Neuroscience.

[13]  M. Thomson,et al.  Visual coding and the phase structure of natural scenes. , 1999, Network.

[14]  S. McKee,et al.  Spatial configurations for visual hyperacuity , 1977, Vision Research.

[15]  N. Wiener,et al.  Nonlinear Problems in Random Theory , 1964 .

[16]  Eero P. Simoncelli,et al.  Natural signal statistics and sensory gain control , 2001, Nature Neuroscience.

[17]  W S Geisler,et al.  Physical limits of acuity and hyperacuity. , 1984, Journal of the Optical Society of America. A, Optics and image science.

[18]  Robyn A. Owens,et al.  Feature detection from local energy , 1987, Pattern Recognit. Lett..

[19]  P Kovesi,et al.  Phase congruency: A low-level image invariant , 2000, Psychological research.

[20]  Edward H. Adelson,et al.  Shiftable multiscale transforms , 1992, IEEE Trans. Inf. Theory.

[21]  N. Graham.  Visual Pattern Analyzers , 1989 .

[22]  Jitendra Malik,et al.  Detecting and localizing edges composed of steps, peaks and roofs , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[23]  E. Adelson,et al.  Early vision and texture perception , 1988, Nature.

[24]  David J. Fleet,et al.  Phase-based disparity measurement , 1991, CVGIP Image Underst..

[25]  D. Burr,et al.  Feature detection in human vision: a phase-dependent energy model , 1988, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[26]  A.V. Oppenheim,et al.  The importance of phase in signals , 1980, Proceedings of the IEEE.

[27]  Michael A. Webster,et al.  Neural adjustments to image blur , 2002, Nature Neuroscience.

[28]  John Daugman,et al.  Statistical Richness of Visual Phase Information: Update on Recognizing Persons by Iris Patterns , 2001, International Journal of Computer Vision.

[29]  D. Heeger.  Normalization of cell responses in cat striate cortex , 1992, Visual Neuroscience.

[30]  D. Pollen,et al.  Phase relationships between adjacent simple cells in the visual cortex. , 1981, Science.