Joint foveation-depth just-noticeable-difference model for virtual reality environment

Abstract In this paper, we develop a joint foveation-depth just-noticeable-difference (FD-JND) model to quantify the perceptual redundancy of image in the VR display environment. The proposed FD-JND model is developed with considerations on the effects of both foveation and depth. More specifically, experiments for the VR environment on synthesized stimuli are conducted based on luminance masking and contrast masking and the FD-JND model is developed accordingly. Subjective quality discrimination experiments between the noise contaminated images and original ones validate favorableness of the proposed FD-JND model.

[1]  Manoranjan Paul,et al.  Just Noticeable Difference for Images With Decomposition Model for Separating Edge and Textured Regions , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[2]  Benjamin B. Bederson,et al.  Space variant image processing , 1994, International Journal of Computer Vision.

[3]  Zhenzhong Chen,et al.  Binocular Just-Noticeable-Difference Model for Stereoscopic Images , 2011, IEEE Signal Processing Letters.

[4]  Guangming Shi,et al.  Pattern Masking Estimation in Image With Structural Uncertainty , 2013, IEEE Transactions on Image Processing.

[5]  M. Georgeson,et al.  Sensitivity to modulations of luminance and contrast in visual white noise: separate mechanisms with similar behaviour , 1999, Vision Research.

[6]  Guangming Shi,et al.  Just Noticeable Difference Estimation for Images With Free-Energy Principle , 2013, IEEE Transactions on Multimedia.

[7]  Kuo-Cheng Liu,et al.  A Perceptually Tuned Watermarking Scheme for Color Images , 2010, IEEE Transactions on Image Processing.

[8]  Junle Wang,et al.  Study of depth bias of observers in free viewing of still stereoscopic synthetic stimuli , 2012 .

[9]  J. Alfonso,et al.  Prospective study of the Acri.LISA bifocal intraocular lens , 2007, Journal of cataract and refractive surgery.

[10]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[11]  Wen-Huang Cheng,et al.  A practical foveation-based rate-shaping mechanism for MPEG videos , 2005, IEEE Trans. Circuits Syst. Video Technol..

[12]  Weisi Lin,et al.  Perceptual Visual Signal Compression and Transmission , 2013, Proceedings of the IEEE.

[13]  Weisi Lin,et al.  Estimating Just-Noticeable Distortion for Video , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[14]  J. M. Foley,et al.  Contrast masking in human vision. , 1980, Journal of the Optical Society of America.

[15]  Wilson S. Geisler,et al.  IEEE TRANSACTIONS ON SYSTEMS , MAN , AND CYBERNETICS — PART A : SYSTEMS AND HUMANS , 2009 .

[16]  Seung-Won Jung,et al.  A Modified Model of the Just Noticeable Depth Difference and Its Application to Depth Sensation Enhancement , 2013, IEEE Transactions on Image Processing.

[17]  Hongyi Liu,et al.  Perceptually-lossless image coding based on foveated-JND and H.265/HEVC , 2016, J. Vis. Commun. Image Represent..

[18]  Ahmet M. Kondoz,et al.  Sensitivity Analysis of the Human Visual System for Depth Cues in Stereoscopic 3-D Displays , 2011, IEEE Transactions on Multimedia.

[19]  Susu Yao,et al.  Just noticeable distortion model and its applications in video coding , 2005, Signal Process. Image Commun..

[20]  Robert J. Safranek,et al.  Signal compression based on models of human perception , 1993, Proc. IEEE.

[21]  Hiroshi Ban,et al.  Brightness masking is modulated by disparity structure , 2015, Vision Research.

[22]  Guangming Shi,et al.  Enhanced Just Noticeable Difference Model for Images With Pattern Complexity , 2017, IEEE Transactions on Image Processing.

[23]  Ee-Leng Tan,et al.  Computational Models for Just-Noticeable Differences , 2015 .

[24]  Wen Gao,et al.  Just Noticeable Difference Estimation for Screen Content Images , 2016, IEEE Transactions on Image Processing.

[25]  Peter König,et al.  Influence of disparity on fixation and saccades in free viewing of natural scenes. , 2009, Journal of vision.

[26]  Zhou Wang,et al.  Embedded foveation image coding , 2001, IEEE Trans. Image Process..

[27]  Chun-Hsien Chou,et al.  A perceptually optimized 3-D subband codec for video communication over wireless channels , 1996, IEEE Trans. Circuits Syst. Video Technol..

[28]  David Alais,et al.  Breaking camouflage: binocular disparity reduces contrast masking in natural images. , 2010, Journal of vision.

[29]  Ja-Ling Wu,et al.  A Foveation-Based Rate Shaping Mechanism for MPEG Videos , 2002, IEEE Pacific Rim Conference on Multimedia.

[30]  King Ngi Ngan,et al.  Dynamic Bit Allocation for Multiple Video Object Coding , 2006, IEEE Transactions on Multimedia.

[31]  Junle Wang,et al.  Computational Model of Stereoscopic 3D Visual Saliency , 2013, IEEE Transactions on Image Processing.

[32]  Sung-Jea Ko,et al.  Depth Sensation Enhancement Using the Just Noticeable Depth Difference , 2012, IEEE Transactions on Image Processing.

[33]  Zhou Wang,et al.  Foveation scalable video coding with automatic fixation selection , 2003, IEEE Trans. Image Process..

[34]  Chun-Hsien Chou,et al.  A perceptually tuned subband image coder based on the measure of just-noticeable-distortion profile , 1995, IEEE Trans. Circuits Syst. Video Technol..

[35]  Weisi Lin,et al.  Improved estimation for just-noticeable visual distortion , 2005, Signal Process..