Just Noticeable Distortion Profile for Flat-Shaded 3D Mesh Surfaces

It is common that a 3D mesh undergoes some lossy operations (e.g., compression, watermarking and transmission through noisy channels), which can introduce geometric distortions as a change in vertex position. In most cases the end users of 3D meshes are human beings; therefore, it is important to evaluate the visibility of introduced vertex displacement. In this paper we present a model for computing a Just Noticeable Distortion (JND) profile for flat-shaded 3D meshes. The proposed model is based on an experimental study of the properties of the human visual system while observing a flat-shaded 3D mesh surface, in particular the contrast sensitivity function and contrast masking. We first define appropriate local perceptual properties on 3D meshes. We then detail the results of a series of psychophysical experiments where we have measured the threshold needed for a human observer to detect the change in vertex position. These results allow us to compute the JND profile for flat-shaded 3D meshes. The proposed JND model has been evaluated via a subjective experiment, and applied to guide 3D mesh simplification as well as to determine the optimal vertex coordinates quantization level for a 3D model.

[1]  Weisi Lin,et al.  Perceptual visual quality metrics: A survey , 2011, J. Vis. Commun. Image Represent..

[2]  Guillaume Lavoué,et al.  A Multiscale Metric for 3D Mesh Visual Quality Assessment , 2011, Comput. Graph. Forum.

[3]  Zhen Liu,et al.  JPEG2000 encoding with perceptual distortion control , 2006, IEEE Transactions on Image Processing.

[4]  Guillaume Lavoué,et al.  A local roughness measure for 3D meshes and its application to visual masking , 2009, TAP.

[5]  T. Ebrahimi,et al.  Watermarked 3-D Mesh Quality Assessment , 2007, IEEE Transactions on Multimedia.

[6]  Guangming Shi,et al.  Just Noticeable Difference Estimation for Images With Free-Energy Principle , 2013, IEEE Transactions on Multimedia.

[7]  Sugato Chakravarty,et al.  Methodology for the subjective assessment of the quality of television pictures , 1995 .

[8]  Xing-Dong Yang,et al.  Perceptual Analysis of Level-of-Detail: The JND Approach , 2006, Eighth IEEE International Symposium on Multimedia (ISM'06).

[9]  Weisi Lin,et al.  Objective visual quality assessment for 3D meshes , 2014, 2014 Sixth International Workshop on Quality of Multimedia Experience (QoMEX).

[10]  Karl J. Friston.  The free-energy principle: a unified brain theory? , 2010, Nature Reviews Neuroscience.

[11]  Kai Wang,et al.  A fast roughness-based approach to the assessment of 3D mesh visual quality , 2012, Comput. Graph..

[12]  Ligang Liu,et al.  Mesh saliency with global rarity , 2013, Graph. Model..

[13]  Scott J. Daly,et al.  Visible differences predictor: an algorithm for the assessment of image fidelity , 1992, Electronic Imaging.

[14]  C Blakemore,et al.  On the existence of neurones in the human visual system selectively sensitive to the orientation and size of retinal images , 1969, The Journal of physiology.

[15]  David W. Jacobs,et al.  Mesh saliency , 2005, ACM Trans. Graph..

[16]  Bruce Walter,et al.  Visual equivalence: towards a new standard for image fidelity , 2007, ACM Trans. Graph..

[17]  King Ngi Ngan,et al.  Spatio-Temporal Just Noticeable Distortion Profile for Grey Scale Image/Video in DCT Domain , 2009, IEEE Transactions on Circuits and Systems for Video Technology.

[18]  Jessika Weiss,et al.  Vision Science Photons To Phenomenology , 2016 .

[19]  D. Pelli,et al.  Measuring contrast sensitivity , 2013, Vision Research.

[20]  A. Watson,et al.  Quest: A Bayesian adaptive psychometric method , 1983, Perception & psychophysics.

[21]  Libor Vása,et al.  Perception-driven adaptive compression of static triangle meshes , 2015, Comput. Aided Des..

[22]  Weisi Lin.  Computational Models for Just-Noticeable Difference , 2005 .

[23]  A. Watson,et al.  A standard model for foveal detection of spatial contrast. , 2005, Journal of vision.

[24]  Li Dong,et al.  Visual distortion gauge based on discrimination of noticeable contrast changes , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[25]  Peter Lindstrom,et al.  Fast and memory efficient polygonal simplification , 1998, Proceedings Visualization '98 (Cat. No.98CB36276).

[26]  Kai Wang,et al.  Perceptual quality assessment of 3D dynamic meshes: Subjective and objective studies , 2015, Signal Process. Image Commun..

[27]  Thomas A. Funkhouser,et al.  Schelling points on 3D surface meshes , 2012, ACM Trans. Graph..

[28]  Massimiliano Corsini,et al.  A Comparison of Perceptually-Based Metrics for Objective Evaluation of Geometry Processing , 2010, IEEE Transactions on Multimedia.

[29]  Frank Tong,et al.  Foundations of Vision , 2018 .

[30]  Jonathan D. Cohen,et al.  Perceptually guided simplification of lit, textured meshes , 2003, I3D '03.

[31]  Manoranjan Paul,et al.  Just Noticeable Difference for Images With Decomposition Model for Separating Edge and Textured Regions , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[32]  Gary W. Meyer,et al.  Perceptually Guided Polygon Reduction , 2008, IEEE Transactions on Visualization and Computer Graphics.

[33]  Zhenzhong Chen,et al.  Binocular Just-Noticeable-Difference Model for Stereoscopic Images , 2011, IEEE Signal Processing Letters.

[34]  J. M. Foley,et al.  Contrast masking in human vision. , 1980, Journal of the Optical Society of America.

[35]  Irene Cheng,et al.  A 3D Perceptual Metric using Just-Noticeable-Difference , 2005, Eurographics.

[36]  Ralph R. Martin,et al.  Mesh saliency via spectral processing , 2014, ACM Trans. Graph..

[37]  Václav Skala,et al.  A Perception Correlated Comparison Method for Dynamic Meshes , 2011, IEEE Transactions on Visualization and Computer Graphics.

[38]  Weisi Lin,et al.  Exploiting entropy masking in perceptual graphic rendering , 2015, Signal Process. Image Commun..

[39]  Donald P. Greenberg,et al.  A perceptually based physical error metric for realistic image synthesis , 1999, SIGGRAPH.

[40]  Paolo Cignoni,et al.  Metro: Measuring Error on Simplified Surfaces , 1998, Comput. Graph. Forum.

[41]  Touradj Ebrahimi,et al.  MESH: measuring errors between surfaces using the Hausdorff distance , 2002, Proceedings. IEEE International Conference on Multimedia and Expo.

[42]  John Hart,et al.  ACM Transactions on Graphics , 2004, SIGGRAPH 2004.

[43]  Libor Vása,et al.  Perceptual Metrics for Static and Dynamic Triangle Meshes , 2013, Eurographics.

[44]  Chun-Hsien Chou,et al.  A perceptually tuned subband image coder based on the measure of just-noticeable-distortion profile , 1995, IEEE Trans. Circuits Syst. Video Technol..

[45]  Wolfgang Heidrich,et al.  HDR-VDP-2: a calibrated visual metric for visibility and quality predictions in all luminance conditions , 2011, ACM Trans. Graph..

[46]  Azeddine Beghdadi,et al.  A survey of perceptual image processing methods , 2013, Signal Process. Image Commun..

[47]  J. Todd.  Review TRENDS in Cognitive Sciences Vol.8 No.3 March 2004 The visual perception of 3D shape q , 2022 .

[48]  Michael Guthe,et al.  Towards Perceptual Simplification of Models with Arbitrary Materials , 2010, Comput. Graph. Forum.

[49]  Ying Yang,et al.  Linear Correlations between Spatial and Normal Noise in Triangle Meshes , 2013, IEEE Transactions on Visualization and Computer Graphics.

[50]  Jean-Marc Chassery,et al.  A Curvature-Tensor-Based Perceptual Quality Metric for 3D Triangular Meshes , 2012, Machine Graphics and Vision.

[51]  M. Mayer,et al.  Invariance of the slope of the psychometric function with spatial summation. , 1986, Journal of the Optical Society of America. A, Optics and image science.

[52]  David J. Sakrison,et al.  The effects of a visual fidelity criterion of the encoding of images , 1974, IEEE Trans. Inf. Theory.

[53]  Libor Vása,et al.  Dihedral Angle Mesh Error: a fast perception correlated distortion measure for fixed connectivity triangle meshes , 2012, Comput. Graph. Forum.