Human vision and electronic imaging

Abstract. The field of electronic imaging has made incrediblestrides over the past decade producing systems with higher signalquality, complex data formats, sophisticated operations for analyz-ing and visualizing information, advanced interfaces, and richer im-age environments. Since electronic imaging systems and applica-tions are designed for human users, the success of these systemsdepends on the degree to which they match the features of humanvision and cognition. This paper reviews the interplay between hu-man vision and electronic imaging, describing how the methods,models and experiments in human vision have influenced the devel-opment of imaging systems, and how imaging technologies and ap-plications have raised new research questions for the vision com-munity. Using the past decade of papers from the IS&T/SPIEConference on Human Vision and Electronic Imaging as a lens, wetrace a path up the ‘‘perceptual food chain,’’ showing how researchin low-level vision has influenced image quality metrics, image com-pression algorithms, rendering techniques and display design, howresearch in attention and pattern recognition have influenced thedevelopment of image analysis, visualization, and digital librariessystems, and how research in higher-level functions is involved inthe design of emotional, aesthetic, and virtual systems.

[1]  A. Watson,et al.  Quest: A Bayesian adaptive psychometric method , 1983, Perception & psychophysics.

[2]  John J. McCann,et al.  Color imaging systems and color theory: past, present, and future , 1998, Electronic Imaging.

[3]  Jianying Hu,et al.  Retrieval of color patterns based on perceptual dimensions of texture and human similiarity rules , 1999, Electronic Imaging.

[4]  Edward M. Granger,et al.  Uniform color space as a function of spatial frequency , 1993, Electronic Imaging.

[5]  Jeffrey B. Mulligan,et al.  Design and performance of a digital video quality metric , 1999, Electronic Imaging.

[6]  Albert J. Ahumada,et al.  Improved detection model for DCT coefficient quantization , 1993, Electronic Imaging.

[7]  Bernice E. Rogowitz,et al.  Data visualization: the end of the rainbow , 1998 .

[8]  Matthew Brand.  Computer vision for a robot sculptor , 1997, Electronic Imaging.

[9]  Jan P. Allebach,et al.  Model-based halftoning using direct binary search , 1992, Electronic Imaging.

[10]  Philip J. Corriveau,et al.  VQEG evaluation of objective methods of video quality assessment , 1999 .

[11]  Harry L. Snyder.  Image Quality and Observer Performance , 1973 .

[12]  Eugenio Martinez-Uriegas,et al.  Spatiochromatic multiplexing: a color image representation for digital processing and compression , 1996, Electronic Imaging.

[13]  Wenjun Zeng,et al.  Digital image watermarking using visual models , 1997, Electronic Imaging.

[14]  Jan P. Allebach,et al.  Visual Model-Based Algorithms For Halftoning Images , 1981, Optics & Photonics.

[15]  David J. Field,et al.  Wavelets, blur, and the sources of variability in the amplitude spectra of natural scenes , 1996, Electronic Imaging.

[16]  Don E. Pearson,et al.  Viewer response to time-varying video quality , 1998, Electronic Imaging.

[17]  V. Barnett,et al.  Applied Linear Statistical Models , 1975 .

[18]  J. Robson,et al.  Application of fourier analysis to the visibility of gratings , 1968, The Journal of physiology.

[19]  Olivier Verscheure,et al.  Perceptual quality measure using a spatiotemporal model of the human visual system , 1996, Electronic Imaging.

[20]  D. Amnon Silverstein,et al.  The relationship between image fidelity and image quality , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[21]  William T. Freeman,et al.  Bayesian method for recovering surface and illuminant properties from photosensor responses , 1994, Electronic Imaging.

[22]  Michael A. Webster,et al.  Visual search and natural color distributions , 1998, Electronic Imaging.

[23]  Andrew P. Bradley,et al.  Perceptual quality metrics applied to still image compression , 1998, Signal Process..

[24]  Albert J. Ahumada,et al.  Principled halftoning based on human vision models , 1992, Electronic Imaging.

[25]  Philip J. Corriveau,et al.  Video quality experts group: the quest for valid objective methods , 2000, Electronic Imaging.

[26]  Lewis E. Hitchner,et al.  Psychophysical Rating Of Image Compression Techniques , 1989, Photonics West - Lasers and Applications in Science and Engineering.

[27]  David J. Field,et al.  What The Statistics Of Natural Images Tell Us About Visual Coding , 1989, Photonics West - Lasers and Applications in Science and Engineering.

[28]  David J. Field,et al.  Learning efficient linear codes for natural images: the roles of sparseness, overcompleteness, and statistical independence , 1996, Electronic Imaging.

[29]  James O. Larimer,et al.  Error diffusion using the web-safe colors: how good is it across platforms? , 1998, Electronic Imaging.

[30]  Hideo Kusaka.  Apparent depth and size of stereoscopically viewed images , 1992, Electronic Imaging.

[31]  D. Amnon Silverstein,et al.  DCT image fidelity metric and its application to a text-based scheme for image display , 1993, Electronic Imaging.

[32]  Michael A. Webster,et al.  Visual adaptation and the perception of distortions in natural images , 1998, Electronic Imaging.

[33]  Huib de Ridder,et al.  Naturalness and image quality: chroma and hue variation in color images of natural scenes , 1995, Electronic Imaging.

[34]  Miguel P. Eckstein,et al.  Development of an image/threshold database for designing and testing human vision models , 1999, Electronic Imaging.

[35]  Bela Julesz,et al.  AI And Early Vision - Part II , 1989, Photonics West - Lasers and Applications in Science and Engineering.

[36]  Christopher W. Tyler,et al.  Eye placement principles in portraits and figure studies over the past two millennia , 1998, Electronic Imaging.

[37]  Robert M. Boynton,et al.  Eleven Colors That Are Almost Never Confused , 1989, Photonics West - Lasers and Applications in Science and Engineering.

[38]  O. Schade.  Optical and photoelectric analog of the eye. , 1956, Journal of the Optical Society of America.

[39]  D J Field,et al.  Relations between the statistics of natural images and the response properties of cortical cells. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[40]  Miguel P. Eckstein,et al.  Image discrimination models predict signal detection in natural medical image backgrounds , 1997, Electronic Imaging.

[41]  Scott J. Daly,et al.  Visible differences predictor: an algorithm for the assessment of image fidelity , 1992, Electronic Imaging.

[42]  A. Treisman,et al.  A feature-integration theory of attention , 1980, Cognitive Psychology.

[43]  R. Almond.  The therapeutic community. , 1971, Scientific American.

[44]  Xin Tong,et al.  Video quality evaluation using ST-CIELAB , 1999, Electronic Imaging.

[45]  Bernice E. Rogowitz,et al.  Visual cues for data mining , 1996, Electronic Imaging.

[46]  Rodney L. Miller,et al.  Design of minimum visual modulation halftone patterns , 1991, IEEE Trans. Syst. Man Cybern..

[47]  Ingemar J. Cox,et al.  Review of watermarking and the importance of perceptual modeling , 1997, Electronic Imaging.

[48]  Bernice E. Rogowitz.  A Suprathreshold Ferry-Porter Law: Implications for the Measurement of Display Flicker , 1989, Photonics West - Lasers and Applications in Science and Engineering.

[49]  John C. Dalton,et al.  Image similarity models and the perception of artistic representations of natural images , 1997, Electronic Imaging.

[50]  L. Stark,et al.  Scanpaths in saccadic eye movements while viewing and recognizing patterns. , 1971, Vision research.

[51]  N. Graham,et al.  Detection of grating patterns containing two spatial frequencies: a comparison of single-channel and multiple-channels models. , 1971, Vision research.

[52]  Andrew B. Watson,et al.  Toward a perceptual video-quality metric , 1998, Electronic Imaging.

[53]  Jan P. Allebach,et al.  Least-squares model-based video halftoning , 1994, Electronic Imaging.

[54]  S. Lee Guth,et al.  Unified Model For Human Color Perception And Visual Adaptation , 1989, Photonics West - Lasers and Applications in Science and Engineering.

[55]  Bernice E. Rogowitz,et al.  The Psychophysics Of Spatial Sampling , 1988, Photonics West - Lasers and Applications in Science and Engineering.

[56]  Jeffrey Lubin,et al.  A VISUAL DISCRIMINATION MODEL FOR IMAGING SYSTEM DESIGN AND EVALUATION , 1995 .

[57]  Gregory K. Tharp,et al.  Depth cue interaction in telepresence and simulated telemanipulation , 1992, Electronic Imaging.

[58]  Jacques A. J. Roufs,et al.  Methods for evaluating the perceptual quality of VDUs , 1990, Other Conferences.

[59]  Jan P. Allebach,et al.  Methodology for designing image similarity metrics based on human visual system models , 1997, Electronic Imaging.

[60]  Jan P. Allebach,et al.  Model-based color image sequence quantization , 1994, Electronic Imaging.

[61]  Carl-Eric Hedin,et al.  Palette: a color-selection aid for VDU images , 1990, Electronic Imaging.

[62]  D.L. Neuhoff,et al.  Model-based Halftoning , 1991, Proceedings of the Seventh Workshop on Multidimensional Signal Processing.

[63]  B. Julesz.  Textons, the elements of texture perception, and their interactions , 1981, Nature.

[64]  David L. Neuhoff,et al.  Least-squares model-based halftoning , 1992, Electronic Imaging.

[65]  Jean-Bernard Martens,et al.  Quality asessment of coded images using numerical category scaling , 1995, Other Conferences.

[66]  Wilson S. Geisler,et al.  Real-time foveated multiresolution system for low-bandwidth video communication , 1998, Electronic Imaging.

[67]  N. S. Jayant,et al.  On Transparent Quality Image Coding Using Visual Models , 1989, Photonics West - Lasers and Applications in Science and Engineering.

[68]  Gunilla Derefeldt,et al.  How to identify up to 30 colors without training: color concept retrieval by free color naming , 1994, Electronic Imaging.

[69]  Jan P. Allebach,et al.  Model-based color image quantization , 1993, Electronic Imaging.

[70]  Gregory K. Tharp,et al.  Timing considerations of helmet-mounted display performance , 1992, Electronic Imaging.

[71]  Graham D. Finlayson,et al.  Color constancy and a changing illumination , 1994, Electronic Imaging.

[72]  Yves Burnod,et al.  CUBICORT: simulation of the visual cortical system for 3D image analysis, synthesis, and hypercompression for digital TV, HDTV, and multimedia , 1994, Electronic Imaging.

[73]  Gregory K. Tharp,et al.  Visual search in virtual environments , 1992, Electronic Imaging.

[74]  John M. Libert,et al.  Mosquito noise in MPEG-compressed video: test patterns and metrics , 2000, Electronic Imaging.

[75]  D. Amnon Silverstein,et al.  Quantifying Perceptual Image Quality , 1998, PICS.

[76]  R. J. Safranek,et al.  A perceptually tuned sub-band image coder with image dependent quantization and post-quantization data compression , 1989, International Conference on Acoustics, Speech, and Signal Processing,.

[77]  Andrew B. Watson,et al.  DCT quantization matrices visually optimized for individual images , 1993, Electronic Imaging.

[78]  Jan P. Allebach,et al.  Building bridges between human vision and electronic imaging: a ten-year retrospective , 1998, Electronic Imaging.

[79]  Walter Bender,et al.  Quantifying the experience of color , 1993, Electronic Imaging.

[80]  Eugenio Martinez-Uriegas,et al.  Compression of digital color images based on the model of spatiochromatic multiplexing of human vision , 1994, Electronic Imaging.

[81]  Jeffrey B. Mulligan.  Digital halftoning methods for selectively partitioning error into achromatic and chromatic channels , 1990, Other Conferences.

[82]  Dragutin Petkovic,et al.  Query by Image and Video Content: The QBIC System , 1995, Computer.

[83]  Huib de Ridder,et al.  Percentage scaling: a new method for evaluating multiply impaired images , 2000, Electronic Imaging.

[84]  Charles Fenimore,et al.  Test patterns and quality metrics for digital video compression , 1997, Electronic Imaging.

[85]  Huib de Ridder,et al.  Numerical category scaling: an efficient method for assessing digital image coding impairments , 1990, Other Conferences.

[86]  David K. Fibush.  Overview of standardization activities related to digital television , 2000, Electronic Imaging.

[87]  Laurence T. Maloney,et al.  Photoreceptor spectral sensitivities and color correction , 1990, Electronic Imaging.

[88]  Charles A. Bouman,et al.  Perceptual image similarity experiments , 1998, Electronic Imaging.

[89]  Michael S. Landy,et al.  Influence function for visual interpolation , 1997, Electronic Imaging.

[90]  Bernice E. Rogowitz,et al.  Shape perception and low-dimension fractal boundary contours , 1990, Other Conferences.

[91]  Wa James Tam,et al.  Processing image sequences based on eye movements , 1994, Electronic Imaging.

[92]  Christoph Zetzsche,et al.  Image surface predicates and the neural encoding of two-dimensional signal variations , 1990, Other Conferences.

[93]  Michael Kubovy.  Gestalt laws of grouping revisited and quantified , 1997, Electronic Imaging.

[94]  Edward Burton,et al.  Seeing and scribbling: a computer representation of the relationship between perception and action in young children's drawing , 1997, Electronic Imaging.

[95]  Scott J. Daly,et al.  Application of a Noise Adaptive Contrast Sensitivity Function to Image Data Compression , 1989, Photonics West - Lasers and Applications in Science and Engineering.