PCQM: A Full-Reference Quality Metric for Colored 3D Point Clouds

3D point clouds constitute an emerging multimedia content, now used in a wide range of applications. The main drawback of this representation is the size of the data since typical point clouds may contain millions of points, usually associated with both geometry and color information. Consequently, a significant amount of work has been devoted to the efficient compression of this representation. Lossy compression leads to a degradation of the data and thus impacts the visual quality of the displayed content. In that context, predicting perceived visual quality computationally is essential for the optimization and evaluation of compression algorithms. In this paper, we introduce PCQM, a full-reference objective metric for visual quality assessment of 3D point clouds. The metric is an optimally-weighted linear combination of geometry-based and color-based features. We evaluate its performance on an open subjective dataset of colored point clouds compressed by several algorithms; the proposed quality assessment approach outperforms all previous metrics in terms of correlation with mean opinion scores.

[1]  Touradj Ebrahimi,et al.  Point cloud quality evaluation: Towards a definition for test conditions , 2019, 2019 Eleventh International Conference on Quality of Multimedia Experience (QoMEX).

[2]  Pascal Frossard,et al.  Graph-Based Compression of Dynamic 3D Point Cloud Sequences , 2015, IEEE Transactions on Image Processing.

[3]  Ingmar Lissner,et al.  Toward a Unified Color Space for Perception-Based Image Processing , 2012, IEEE Transactions on Image Processing.

[4]  Wolfgang Heidrich,et al.  HDR-VDP-2: a calibrated visual metric for visibility and quality predictions in all luminance conditions , 2011, SIGGRAPH 2011.

[5]  Pan Gao,et al.  Subjective and Objective Quality Assessment for Volumetric Video Compression , 2019, IQSP.

[6]  Libor Vása,et al.  On the Efficiency of Image Metrics for Evaluating the Visual Quality of 3D Models , 2016, IEEE Transactions on Visualization and Computer Graphics.

[7]  David Zhang,et al.  FSIM: A Feature Similarity Index for Image Quality Assessment , 2011, IEEE Transactions on Image Processing.

[8]  T. Ebrahimi,et al.  Watermarked 3-D Mesh Quality Assessment , 2007, IEEE Transactions on Multimedia.

[9]  Adam Finkelstein,et al.  A no-reference metric for evaluating the quality of motion deblurring , 2013, ACM Trans. Graph..

[10]  Rufael Mekuria,et al.  Emerging MPEG Standards for Point Cloud Compression , 2019, IEEE Journal on Emerging and Selected Topics in Circuits and Systems.

[11]  Ricardo L. de Queiroz,et al.  A comprehensive study of the rate-distortion performance in MPEG point cloud compression , 2019, APSIPA Transactions on Signal and Information Processing.

[12]  Ingmar Lissner,et al.  Image-Difference Prediction: From Grayscale to Color , 2013, IEEE Transactions on Image Processing.

[13]  Philip A. Chou,et al.  Transform Coding for Point Clouds Using a Gaussian Process Model , 2017, IEEE Transactions on Image Processing.

[14]  Weisi Lin,et al.  SVD-Based Quality Metric for Image and Video Using Machine Learning , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[15]  Libor Vása,et al.  Dihedral Angle Mesh Error: a fast perception correlated distortion measure for fixed connectivity triangle meshes , 2012, Comput. Graph. Forum.

[16]  Irene Cheng,et al.  Subjective and Objective Visual Quality Assessment of Textured 3D Meshes , 2016, ACM Trans. Appl. Percept..

[17]  Meenakshisundaram Gopi,et al.  A Generic Scheme for Progressive Point Cloud Coding , 2008, IEEE Transactions on Visualization and Computer Graphics.

[18]  Alan C. Bovik,et al.  Image information and visual quality , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[19]  Sebastian Bosse,et al.  Deep Neural Networks for No-Reference and Full-Reference Image Quality Assessment , 2016, IEEE Transactions on Image Processing.

[20]  Touradj Ebrahimi,et al.  On the performance of metrics to predict quality in point cloud representations , 2017, Optical Engineering + Applications.

[21]  Scott J. Daly,et al.  Visible differences predictor: an algorithm for the assessment of image fidelity , 1992, Electronic Imaging.

[22]  Rufael Mekuria,et al.  Design, Implementation, and Evaluation of a Point Cloud Codec for Tele-Immersive Video , 2017, IEEE Transactions on Circuits and Systems for Video Technology.

[23]  Catarina Brites,et al.  Point Cloud Rendering After Coding: Impacts on Subjective and Objective Quality , 2019, IEEE Transactions on Multimedia.

[24]  Philipp Urban,et al.  Color-Image Quality Assessment: From Prediction to Optimization , 2014, IEEE Transactions on Image Processing.

[25]  Dong Tian,et al.  Geometric distortion metrics for point cloud compression , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[26]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[27]  Zhou Wang,et al.  Objective Quality Assessment of Tone-Mapped Images , 2013, IEEE Transactions on Image Processing.

[28]  HeidrichWolfgang,et al.  HDR-VDP-2 , 2011 .

[29]  Guillaume Lavoué,et al.  PC-MSDM: A quality metric for 3D point clouds , 2019, 2019 Eleventh International Conference on Quality of Multimedia Experience (QoMEX).

[30]  Touradj Ebrahimi,et al.  Point Cloud Quality Assessment Metric Based on Angular Similarity , 2018, 2018 IEEE International Conference on Multimedia and Expo (ICME).

[31]  Guillaume Lavoué,et al.  A Multiscale Metric for 3D Mesh Visual Quality Assessment , 2011, Comput. Graph. Forum.

[32]  Xuelong Li,et al.  Learning to Rank for Blind Image Quality Assessment , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[33]  Touradj Ebrahimi,et al.  Exploiting user interactivity in quality assessment of point cloud imaging , 2019, 2019 Eleventh International Conference on Quality of Multimedia Experience (QoMEX).

[34]  Jeffrey Lubin,et al.  The use of psychophysical data and models in the analysis of display system performance , 1993 .