Human perception of subresolution fineness of dense textures based on image intensity statistics.

We are surrounded by many textures with fine dense structures, such as human hair and fabrics, whose individual elements are often finer than the spatial resolution limit of the visual system or that of a digitized image. Here we show that human observers have an ability to visually estimate subresolution fineness of those textures. We carried out a psychophysical experiment to show that observers could correctly discriminate differences in the fineness of hair-like dense line textures even when the thinnest line element was much finer than the resolution limit of the eye or that of the display. The physical image analysis of the textures, along with a theoretical analysis based on the central limit theorem, indicates that as the fineness of texture increases and the number of texture elements per resolvable unit increases, the intensity contrast of the texture decreases and the intensity histogram approaches a Gaussian shape. Subsequent psychophysical experiments showed that these image features indeed play critical roles in fineness perception; i.e., lowering the contrast made artificial and natural textures look finer, and this effect was most evident for textures with unimodal Gaussian-like intensity distributions. These findings indicate that the human visual system is able to estimate subresolution texture fineness on the basis of diagnostic image features correlated with subresolution fineness, such as the intensity contrast and the shape of the intensity histogram.

[1]  Naokazu Goda,et al.  Neural Selectivity and Representation of Gloss in the Monkey Inferior Temporal Cortex , 2012, The Journal of Neuroscience.

[2]  Takeo Kanade,et al.  Limits on Super-Resolution and How to Break Them , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Eero P. Simoncelli,et al.  Metamers of the ventral stream , 2011, Nature Neuroscience.

[4]  Heinrich H. Bülthoff,et al.  Low-Level Image Cues in the Perception of Translucent Materials , 2005, TAP.

[5]  P.-J. Hsieh,et al.  Feature mixing rather than feature replacement during perceptual filling-in , 2009, Vision Research.

[6]  Gouki Okazawa,et al.  Representation of the Material Properties of Objects in the Visual Cortex of Nonhuman Primates , 2014, The Journal of Neuroscience.

[7]  Qasim Zaidi,et al.  Frequency-based heuristics for material perception. , 2013, Journal of vision.

[8]  J. DiCarlo,et al.  Using goal-driven deep learning models to understand sensory cortex , 2016, Nature Neuroscience.

[9]  I. Motoyoshi Highlight-shading relationship as a cue for the perception of translucent and transparent materials. , 2010, Journal of vision.

[10]  D. Kersten,et al.  Responses to Lightness Variations in Early Human Visual Cortex , 2007, Current Biology.

[11]  D G Pelli,et al.  The VideoToolbox software for visual psychophysics: transforming numbers into movies. , 1997, Spatial vision.

[12]  A. T. Smith,et al.  Sharpening of drifting, blurred images , 1995, Vision Research.

[13]  S. Nishida,et al.  Perceptual transparency from image deformation , 2015, Proceedings of the National Academy of Sciences.

[14]  Roland W Fleming,et al.  Real-world illumination and the perception of surface reflectance properties. , 2003, Journal of vision.

[15]  A. Torralba,et al.  The role of context in object recognition , 2007, Trends in Cognitive Sciences.

[16]  Naokazu Goda,et al.  Transformation from image-based to perceptual representation of materials along the human ventral visual pathway , 2011, NeuroImage.

[17]  Steve Marschner,et al.  Rendering glints on high-resolution normal-mapped specular surfaces , 2014, ACM Trans. Graph..

[18]  Robert M. Boynton,et al.  16 – Ten Years of Research with the Minimally Distinct Border1 , 1978 .

[19]  Laurence T Maloney,et al.  Maximum likelihood difference scaling. , 2003, Journal of vision.

[20]  David R. Badcock,et al.  A comparison of stereo and vernier acuity within spatial channels as a function of distance from fixation , 1985, Vision Research.

[21]  M. Georgeson,et al.  Apparent spatial frequency and contrast of gratings: Separate effects of contrast and duration , 1985, Vision Research.

[22]  E. Adelson,et al.  Image statistics and the perception of surface qualities , 2007, Nature.

[23]  H. Komatsu The neural mechanisms of perceptual filling-in , 2006, Nature Reviews Neuroscience.

[24]  Donovan G. Govan,et al.  Sharpness overconstancy in peripheral vision , 1997, Vision Research.

[25]  Kenneth Knoblauch,et al.  MLDS: Maximum Likelihood Difference Scaling in R , 2008 .

[26]  Shuang Zhao,et al.  Modular flux transfer , 2013, ACM Trans. Graph..

[27]  Kei Iwasaki,et al.  A Simplified Plane-Parallel Scattering Model and Its Application to Hair Rendering , 2010, 2010 18th Pacific Conference on Computer Graphics and Applications.

[28]  Shree K. Nayar,et al.  Reflectance and texture of real-world surfaces , 1999, TOGS.

[29]  Masataka Sawayama,et al.  Stain on texture: Perception of a dark spot having a blurred edge on textured backgrounds , 2015, Vision Research.

[30]  Kazushi Maruya,et al.  Seeing liquids from visual motion , 2015, Vision Research.

[31]  S. McKee,et al.  Spatial configurations for visual hyperacuity , 1977, Vision Research.

[32]  Steve Marschner,et al.  Matching Real Fabrics with Micro-Appearance Models , 2015, ACM Trans. Graph..

[33]  Robert W. Kentridge,et al.  Separate processing of texture and form in the ventral stream: evidence from FMRI and visual agnosia. , 2010, Cerebral cortex.

[34]  Steve Marschner,et al.  Building volumetric appearance models of fabric using micro CT imaging , 2011, Commun. ACM.

[35]  Jonathan S. Cant,et al.  Cerebral Cortex Advance Access published April 28, 2006 Attention to Form or Surface Properties Modulates Different Regions of Human , 2022 .

[36]  Eero P. Simoncelli,et al.  A functional and perceptual signature of the second visual area in primates , 2013, Nature Neuroscience.

[37]  Steve Marschner,et al.  Structure-aware synthesis for predictive woven fabric appearance , 2012, ACM Trans. Graph..

[38]  K. Nakayama Differential motion hyperacuity under conditions of common image motion , 1981, Vision Research.

[39]  D C Van Essen,et al.  Shifter circuits: a computational strategy for dynamic aspects of visual processing. , 1987, Proceedings of the National Academy of Sciences of the United States of America.

[40]  Bruce Walter,et al.  Looking against the light: how perception of translucency depends on lighting direction. , 2014, Journal of vision.

[41]  S. Nishida,et al.  Use of image-based information in judgments of surface-reflectance properties. , 1998, Journal of the Optical Society of America. A, Optics, image science, and vision.

[42]  Phillip J. Marlow,et al.  The Perception and Misperception of Specular Surface Reflectance , 2012, Current Biology.

[43]  H. Komatsu,et al.  Image statistics underlying natural texture selectivity of neurons in macaque V4 , 2014, Proceedings of the National Academy of Sciences.

[44]  Eero P. Simoncelli,et al.  A Parametric Texture Model Based on Joint Statistics of Complex Wavelet Coefficients , 2000, International Journal of Computer Vision.

[45]  Roland W Fleming,et al.  Influence of optical material properties on the perception of liquids. , 2016, Journal of vision.

[46]  Thomas Müller,et al.  Efficient rendering of heterogeneous polydisperse granular media , 2016, ACM Trans. Graph..

[47]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[48]  Shuang Zhao,et al.  Fitting procedural yarn models for realistic cloth rendering , 2016, ACM Trans. Graph..

[49]  Steve Marschner,et al.  Multi-scale modeling and rendering of granular materials , 2015, ACM Trans. Graph..