A Comparison of Perceptually-Based Metrics for Objective Evaluation of Geometry Processing

Recent advances in 3-D graphics technologies have led to an increasing use of processing techniques on 3-D meshes, such as filtering, compression, watermarking, simplification, deformation, and so forth. Since these processes may modify the visual appearance of the 3-D objects, several metrics have been introduced to properly drive or evaluate them, from classic geometric ones such as Hausdorff distance, to more complex perceptually-based measures. This paper presents a survey on existing perceptually-based metrics for visual impairment of 3-D objects and provides an extensive comparison between them. In particular, different scenarios which correspond to different perceptual and cognitive mechanisms are analyzed. The objective is twofold: 1) catching the behavior of existing measures to help Perception researchers for designing new 3-D metrics and 2) providing a comparison between them to inform and help computer graphics researchers for choosing the most accurate tool for the design and the evaluation of their mesh processing algorithms.

[1]  Elisa Drelie Gelasca,et al.  Full-reference objective quality metrics for video watermarking, video segmentation and 3D model watermarking , 2005 .

[2]  Shi-Min Hu,et al.  An effective feature-preserving mesh simplification scheme based on face constriction , 2001, Proceedings Ninth Pacific Conference on Computer Graphics and Applications. Pacific Graphics 2001.

[3]  Irene Cheng,et al.  Quality metric for approximating subjective evaluation of 3-D objects , 2005, IEEE Transactions on Multimedia.

[4]  Gary W. Meyer,et al.  A perceptually based adaptive sampling algorithm , 1998, SIGGRAPH.

[5]  Carol O'Sullivan,et al.  An experimental approach to predicting saliency for simplified polygonal models , 2004, APGV '04.

[6]  Touradj Ebrahimi,et al.  Perceptually driven 3D distance metrics with application to watermarking , 2006, SPIE Optics + Photonics.

[7]  Shi-Min Hu,et al.  Comparing Small Visual Differences between Conforming Meshes , 2008, GMP.

[8]  Gary W. Meyer,et al.  Perceptually Guided Polygon Reduction , 2008, IEEE Transactions on Visualization and Computer Graphics.

[9]  J. Fleiss,et al.  Intraclass correlations: uses in assessing rater reliability. , 1979, Psychological bulletin.

[10]  T. Ebrahimi,et al.  Watermarked 3-D Mesh Quality Assessment , 2007, IEEE Transactions on Multimedia.

[11]  Zhou Wang,et al.  Image Quality Assessment: From Error Measurement to Structural Similarity , 2004 .

[12]  Andrew P. Bradley,et al.  Perceptual quality metrics applied to still image compression , 1998, Signal Process..

[13]  Greg Turk,et al.  Image-driven simplification , 2000, TOGS.

[14]  Konrad Polthier,et al.  Anisotropic Filtering of Non‐Linear Surface Features , 2004, Comput. Graph. Forum.

[15]  Rémy Prost,et al.  An Oblivious Watermarking for 3-D Polygonal Meshes Using Distribution of Vertex Norms , 2007, IEEE Transactions on Signal Processing.

[16]  Beverly J. Volicer,et al.  Biostatistics: A Foundation for Analysis in the Health Sciences , 1979 .

[17]  Jonathan D. Cohen,et al.  Perceptually guided simplification of lit, textured meshes , 2003, I3D '03.

[18]  Touradj Ebrahimi,et al.  Objective evaluation of the perceptual quality of 3D watermarking , 2005, IEEE International Conference on Image Processing 2005.

[19]  Martin Reddy,et al.  Perceptually modulated level of detail for virtual environments , 1997 .

[20]  Paolo Cignoni,et al.  Metro: Measuring Error on Simplified Surfaces , 1998, Comput. Graph. Forum.

[21]  Atilla Baskurt,et al.  Hierarchical Watermarking of Semiregular Meshes Based on Wavelet Transform , 2008, IEEE Transactions on Information Forensics and Security.

[22]  Zhou Wang,et al.  Modern Image Quality Assessment , 2006, Modern Image Quality Assessment.

[23]  Wayne W. Daniel,et al.  Biostatistics: A Foundation for Analysis in the Health Sciences , 1974 .

[24]  Karol Myszkowski,et al.  Perception-based global illumination, rendering, and animation techniques , 2002, SCCG '02.

[25]  Bruce Walter,et al.  Visual equivalence: towards a new standard for image fidelity , 2007, SIGGRAPH 2007.

[26]  Jeffrey Lubin,et al.  A VISUAL DISCRIMINATION MODEL FOR IMAGING SYSTEM DESIGN AND EVALUATION , 1995 .

[27]  A. Baskurt,et al.  Hierarchical Watermarking of Semi-regular Meshes Based on Wavelet Transform , 2008 .

[28]  David W. Jacobs,et al.  Mesh saliency , 2005, SIGGRAPH 2005.

[29]  Bruce Walter,et al.  Visual Equivalence: an Object-based Approach to Image Quality , 2008, Color Imaging Conference.

[30]  Bruno Lévy,et al.  Spectral Geometry Processing with Manifold Harmonics , 2008, Comput. Graph. Forum.

[31]  Gabriel Taubin,et al.  A signal processing approach to fair surface design , 1995, SIGGRAPH.

[32]  Scott J. Daly,et al.  Visible differences predictor: an algorithm for the assessment of image fidelity , 1992, Electronic Imaging.

[33]  Donald P. Greenberg,et al.  A perceptually based physical error metric for realistic image synthesis , 1999, SIGGRAPH.

[34]  Ralph R. Martin,et al.  Evaluation for Small Visual Difference Between Conforming Meshes on Strain Field , 2009, Journal of Computer Science and Technology.

[35]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[36]  Touradj Ebrahimi,et al.  A Multi-Scale Roughness Metric for 3D Watermarking Quality Assessment , 2005 .

[37]  Donald P. Greenberg,et al.  Spatiotemporal sensitivity and visual attention for efficient rendering of dynamic environments , 2005, TOGS.

[38]  Donald P. Greenberg,et al.  A model of visual masking for computer graphics , 1997, SIGGRAPH.

[39]  Guillaume Lavoué,et al.  A local roughness measure for 3D meshes and its application to visual masking , 2009, TAP.

[40]  Michael Garland,et al.  Surface simplification using quadric error metrics , 1997, SIGGRAPH.

[41]  Fabio Pellacini,et al.  Perceptually-driven decision theory for interactive realistic rendering , 2003, TOGS.

[42]  Sivan Toledo,et al.  High-Pass Quantization for Mesh Encoding , 2003, Symposium on Geometry Processing.

[43]  Sun-Jeong Kim,et al.  Discrete differential error metric for surface simplification , 2002, 10th Pacific Conference on Computer Graphics and Applications, 2002. Proceedings..

[44]  Ryutarou Ohbuchi,et al.  A Frequency‐Domain Approach to Watermarking 3D Shapes , 2002, Comput. Graph. Forum.

[45]  Craig Gotsman,et al.  Spectral compression of mesh geometry , 2000, EuroCG.

[46]  Stefan Winkler,et al.  Perceptual blur and ringing metrics: application to JPEG2000 , 2004, Signal Process. Image Commun..

[47]  Dennis E. Grawoig,et al.  Statistics, a foundation for analysis , 1972, The Mathematical Gazette.

[48]  Bernice E. Rogowitz,et al.  Are image quality metrics adequate to evaluate the quality of geometric objects? , 2001, IS&T/SPIE Electronic Imaging.