Asymmetric Foveated Just-Noticeable-Difference Model for Images With Visual Field Inhomogeneities

Just noticeable difference (JND) models reveal visibility limitation of human visual system (HVS) and exploit perceptual redundancy in the visual signal. Conventional just noticeable difference (JND) model supposes the visual acuity is homogeneous with or without considerations on the isoeccentric locations. Recent research on vision science indicates that the effect of eccentricity on visual sensitivity is not homogeneous across the visual field (VF). Relevant studies have found visual acuity at the isoeccentric locations is better along the horizontal meridian than along the vertical meridian, i.e., horizontal-vertical anisotropy (HVA). Along the vertical meridian, better performance has been reported for the inferior meridian compared to the superior meridian, i.e., vertical-meridian asymmetry (VMA). These properties of HVS should be taken into account to yield a better JND estimation, for better exploiting the perceptual redundancy. In this paper, we use two hemi-ellipses to represent the iso-acuity contour, which can better express the HVA and VMA effects. Moreover, we design psychophysical experiments under different test conditions, where the results show the hemi-ellipse model performs better when compared to the circular model. Finally, we build an asymmetric foveated JND model using two hemi-ellipses for approximation. When comparing with traditional JND models, experimental results demonstrate the effectiveness of the proposed model.

[1]  Wen Gao,et al.  Just Noticeable Difference Estimation for Screen Content Images , 2016, IEEE Transactions on Image Processing.

[2]  Xuelong Li,et al.  Image Quality Assessment Based on Multiscale Geometric Analysis , 2009, IEEE Transactions on Image Processing.

[3]  Manoranjan Paul,et al.  Just Noticeable Difference for Images With Decomposition Model for Separating Edge and Textured Regions , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[4]  Munchurl Kim,et al.  A Novel Generalized DCT-Based JND Profile Based on an Elaborate CM-JND Model for Variable Block-Sized Transforms in Monochrome Images , 2014, IEEE Transactions on Image Processing.

[5]  Zhou Wang,et al.  Embedded foveation image coding , 2001, IEEE Trans. Image Process..

[6]  Hongyi Liu,et al.  Perceptually-lossless image coding based on foveated-JND and H.265/HEVC , 2016, J. Vis. Commun. Image Represent..

[7]  Tim K Marks,et al.  SUN: A Bayesian framework for saliency using natural statistics. , 2008, Journal of vision.

[8]  A. Hendrickson,et al.  Distribution of cones in human and monkey retina: individual variability and radial asymmetry. , 1987, Science.

[9]  Kuo-Cheng Liu,et al.  A Perceptually Tuned Watermarking Scheme for Color Images , 2010, IEEE Transactions on Image Processing.

[10]  Munchurl Kim,et al.  A DCT-Based Total JND Profile for Spatiotemporal and Foveated Masking Effects , 2017, IEEE Transactions on Circuits and Systems for Video Technology.

[11]  Marlene C. Richter,et al.  Retinotopic Organization and Functional Subdivisions of the Human Lateral Geniculate Nucleus: A High-Resolution Functional Magnetic Resonance Imaging Study , 2004, The Journal of Neuroscience.

[12]  C. Curcio,et al.  Topography of ganglion cells in human retina , 1990, The Journal of comparative neurology.

[13]  Weisi Lin,et al.  Improved estimation for just-noticeable visual distortion , 2005, Signal Process..

[14]  Scott Daly,et al.  Engineering observations from spatiovelocity and spatiotemporal visual models , 1998, Electronic Imaging.

[15]  Christine Guillemot,et al.  Perceptually-Friendly H.264/AVC Video Coding Based on Foveated Just-Noticeable-Distortion Model , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[16]  Hongyi Liu,et al.  JND modeling: Approaches and applications , 2014, 2014 19th International Conference on Digital Signal Processing.

[17]  J. Rabin,et al.  Visual Perception: A Clinical Orientation (4th ed.) , 2010 .

[18]  D. H. Kelly Motion and vision. II. Stabilized spatio-temporal threshold surface. , 1979, Journal of the Optical Society of America.

[19]  A. Watson A formula for human retinal ganglion cell receptive field density as a function of visual field location. , 2014, Journal of vision.

[20]  Alan C. Bovik,et al.  A Statistical Evaluation of Recent Full Reference Image Quality Assessment Algorithms , 2006, IEEE Transactions on Image Processing.

[21]  Guangming Shi,et al.  Enhanced Just Noticeable Difference Model for Images With Pattern Complexity , 2017, IEEE Transactions on Image Processing.

[22]  Muhammad Uzair,et al.  Estimating just-noticeable distortion for images/videos in pixel domain , 2017, IET Image Process..

[23]  C.-C. Jay Kuo,et al.  Deep Learning-Based Picture-Wise Just Noticeable Distortion Prediction Model for Image Compression , 2020, IEEE Transactions on Image Processing.

[24]  Weisi Lin,et al.  Motion-compensated residue preprocessing in video coding based on just-noticeable-distortion profile , 2005, IEEE Trans. Circuits Syst. Video Technol..

[25]  Munchurl Kim,et al.  Learning-Based Just-Noticeable-Quantization- Distortion Modeling for Perceptual Video Coding , 2018, IEEE Transactions on Image Processing.

[26]  D. V. van Essen,et al.  The representation of the visual field in parvicellular and magnocellular layers of the lateral geniculate nucleus in the macaque monkey , 1984, The Journal of comparative neurology.

[27]  Heidi A. Peterson,et al.  Luminance-model-based DCT quantization for color image compression , 1992, Electronic Imaging.

[28]  E. Switkes,et al.  Functional anatomy of macaque striate cortex. II. Retinotopic organization , 1988, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[29]  Steven H. Schwartz,et al.  Visual Perception: A Clinical Orientation , 1998 .

[30]  A. Hendrickson,et al.  Human photoreceptor topography , 1990, The Journal of comparative neurology.

[31]  Weisi Lin,et al.  Perceptual Visual Signal Compression and Transmission , 2013, Proceedings of the IEEE.

[32]  N. Drasdo,et al.  The length of Henle fibers in the human retina and a model of ganglion receptive field density in the visual field , 2007, Vision Research.

[33]  Weisi Lin,et al.  Just Noticeable Difference for natural images using RMS contrast and feed-back mechanism , 2018, Neurocomputing.

[34]  M. Carrasco,et al.  Isoeccentric locations are not equivalent: The extent of the vertical meridian asymmetry , 2012, Vision Research.

[35]  Weisi Lin,et al.  Estimating Just-Noticeable Distortion for Video , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[36]  John H. R. Maunsell,et al.  The visual field representation in striate cortex of the macaque monkey: Asymmetries, anisotropies, and individual variability , 1984, Vision Research.

[37]  Pietro Perona,et al.  Graph-Based Visual Saliency , 2006, NIPS.

[38]  A. Bradley,et al.  Neural bandwidth of veridical perception across the visual field , 2016, Journal of vision.

[39]  W. Geisler,et al.  Retina-V1 model of detectability across the visual field. , 2014, Journal of vision.

[40]  King Ngi Ngan,et al.  Spatio-Temporal Just Noticeable Distortion Profile for Grey Scale Image/Video in DCT Domain , 2009, IEEE Transactions on Circuits and Systems for Video Technology.

[41]  Andrew B. Watson,et al.  DCTune: A TECHNIQUE FOR VISUAL OPTIMIZATION OF DCT QUANTIZATION MATRICES FOR INDIVIDUAL IMAGES. , 1993 .

[42]  John H. R. Maunsell,et al.  How parallel are the primate visual pathways? , 1993, Annual review of neuroscience.

[43]  Susu Yao,et al.  Just noticeable distortion model and its applications in video coding , 2005, Signal Process. Image Commun..

[44]  Marisa Carrasco,et al.  Neural correlates of the visual vertical meridian asymmetry. , 2006, Journal of vision.

[45]  L. Thibos,et al.  Retinal limits to the detection and resolution of gratings. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[46]  Sugato Chakravarty,et al.  Methodology for the subjective assessment of the quality of television pictures , 1995 .

[47]  John H. R. Maunsell,et al.  Topographic organization of the middle temporal visual area in the macaque monkey: Representational biases and the relationship to callosal connections and myeloarchitectonic boundaries , 1987, The Journal of comparative neurology.

[48]  Robert J. Safranek,et al.  Signal compression based on models of human perception , 1993, Proc. IEEE.

[49]  L. Itti,et al.  Quantifying center bias of observers in free viewing of dynamic natural scenes. , 2009, Journal of vision.

[50]  Chun-Hsien Chou,et al.  A perceptually tuned subband image coder based on the measure of just-noticeable-distortion profile , 1995, IEEE Trans. Circuits Syst. Video Technol..

[51]  Guangming Shi,et al.  Just Noticeable Difference Estimation for Images With Free-Energy Principle , 2013, IEEE Transactions on Multimedia.

[52]  Karol Myszkowski,et al.  3D unsharp masking for scene coherent enhancement , 2008, SIGGRAPH 2008.