Application of a visual model to the design of an ultra-high definition upscaler

A Visual Model (VM) is used to aid in the design of an Ultra-high Definition (UHD) upscaling algorithm that renders High Definition legacy content on a UHD display. The costly development of such algorithms is due, in part, to the time spent subjectively evaluating the adjustment of algorithm structural variations and parameters. The VM provides an image map that gives feedback to the design engineer about visual differences between algorithm variations, or about whether a costly algorithm improvement will be visible at expected viewing distances. Such visual feedback reduces the need for subjective evaluation. This paper presents the results of experimentally verifying the VM against subjective tests of visibility improvement versus viewing distance for three upscaling algorithms. Observers evaluated image differences for upscaled versions of high-resolution stills and HD (Blu-ray) images, viewing a reference and test image, and controlled a linear blending weight to determine the image discrimination threshold. The required thresholds vs. viewing distance varied as expected, with larger amounts of the test image required at further distances. We verify the VM by comparison of predicted discrimination thresholds versus the subjective data. After verification, VM visible difference maps are presented to illustrate the practical use of the VM during design.

[1]  R. Watt,et al.  The recognition and representation of edge blur: Evidence for spatial primitives in human vision , 1983, Vision Research.

[2]  Andrew B. Watson,et al.  DCTune: A TECHNIQUE FOR VISUAL OPTIMIZATION OF DCT QUANTIZATION MATRICES FOR INDIVIDUAL IMAGES. , 1993 .

[3]  Albert J. Ahumada,et al.  Computational image quality metrics: A review , 1993 .

[4]  Xiao-Fan Feng,et al.  Vision-based strategy to reduce the perceived color misregistration of image-capturing devices , 2002 .

[5]  W N Charman,et al.  A simple parametric model of the human ocular modulation transfer function , 1991, Ophthalmic & physiological optics : the journal of the British College of Ophthalmic Opticians.

[6]  Wenjun Zeng,et al.  An overview of the visual optimization tools in JPEG 2000 , 2002, Signal Process. Image Commun..

[7]  S. Daly,et al.  The role of the visual system's orientation mechanisms in the perception of spatial aliasing , 2003, The Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, 2003.

[8]  V. Kayargadde,et al.  Perceptual characterization of images degraded by blur and noise: model. , 1996, Journal of the Optical Society of America. A, Optics, image science, and vision.

[9]  Donald P. Greenberg,et al.  A model of visual masking for computer graphics , 1997, SIGGRAPH.

[10]  B. Wandell,et al.  Matching color images: the effects of axial chromatic aberration , 1994 .

[11]  Scott J. Daly,et al.  Visible differences predictor: an algorithm for the assessment of image fidelity , 1992, Electronic Imaging.

[12]  Albert J. Ahumada,et al.  Using Vision Modeling to Define Occupational Vision Standards , 2003 .

[13]  Zygmunt Pizlo,et al.  An investigation of perceived sharpness and sharpness metrics , 2005, IS&T/SPIE Electronic Imaging.

[14]  Miguel P. Eckstein,et al.  Development of an image/threshold database for designing and testing human vision models , 1999, Electronic Imaging.

[15]  Andrew B. Watson,et al.  The cortex transform: rapid computation of simulated neural images , 1987 .

[16]  Brian A. Wandell,et al.  A spatial extension of CIELAB for digital color‐image reproduction , 1997 .

[17]  Mark D. Fairchild,et al.  Sharpness Rules , 2000, Color Imaging Conference.

[18]  Michael J. Vrhel,et al.  Color image resolution conversion , 2005, IEEE Transactions on Image Processing.

[19]  Albert J. Ahumada,et al.  Image quality: a multidimensional problem , 1993 .

[20]  V Kayargadde,et al.  Perceptual characterization of images degraded by blur and noise: experiments. , 1996, Journal of the Optical Society of America. A, Optics, image science, and vision.

[21]  Ingrid Heynderickx,et al.  17.1: Design of a Tool to Benchmark Scaling Algorithms on LCD Monitors , 2002 .

[22]  Lei Zhang,et al.  Image demosaicing: a systematic survey , 2008, Electronic Imaging.

[23]  Peter G. J. Barten,et al.  Contrast sensitivity of the human eye and its e ects on image quality , 1999 .

[24]  A. Watson,et al.  A standard model for foveal detection of spatial contrast. , 2005, Journal of vision.

[25]  J. Rovamo,et al.  Foveal optical modulation transfer function of the human eye at various pupil sizes. , 1998, Journal of the Optical Society of America. A, Optics, image science, and vision.

[26]  S. Wuerger,et al.  Blur tolerance for luminance and chromatic stimuli. , 2001, Journal of the Optical Society of America. A, Optics, image science, and vision.

[27]  Xiao-Fan Feng,et al.  Halftone Quality Evaluation Using Color Visual Models , 2002, PICS.

[28]  P Artal,et al.  Average optical performance of the human eye as a function of age in a normal population. , 1999, Investigative ophthalmology & visual science.

[29]  A. M. Rohaly,et al.  Object detection in natural backgrounds predicted by discrimination performance and models , 1997, Vision Research.

[30]  Jeffrey Lubin,et al.  The use of psychophysical data and models in the analysis of display system performance , 1993 .

[31]  A. Watson,et al.  Predicting visual acuity from wavefront aberrations. , 2008, Journal of vision.

[32]  Peter B. Delahunt,et al.  Perceptual assessment of demosaicing algorithm performance , 2002, Proc. IEEE.

[33]  Avi C. Naiman,et al.  Jagged edges: when is filtering needed? , 1998, TOGS.

[34]  D. Brainard,et al.  Double-pass and interferometric measures of the optical quality of the eye. , 1994, Journal of the Optical Society of America. A, Optics, image science, and vision.

[35]  Wencheng Wu,et al.  Perception-based line quality measurement , 2005, IS&T/SPIE Electronic Imaging.

[36]  Robert M. Springer,et al.  Raggedness of edges , 1981 .