Subjective evaluation and objective measures for point clouds — State of the art

This paper presents a state of the art on subjective evaluation and existing objective quality measures for point cloud representations. A brief review on subjective evaluation protocols for 2D and 3D video quality assessment will be given, and its adaptation for point cloud evaluation described together with a description of existing point cloud objective quality measures. Afterwards, specific problems with subjective experiments and objective measures for point clouds will be discussed. Challenges and future research directions regarding point clouds quality assessment will be discussed.

[1]  Marc Levoy,et al.  Zippered polygon meshes from range images , 1994, SIGGRAPH.

[2]  Paolo Cignoni,et al.  Metro: Measuring Error on Simplified Surfaces , 1998, Comput. Graph. Forum.

[3]  Margaret H. Pinson,et al.  A new standardized method for objectively measuring video quality , 2004, IEEE Transactions on Broadcasting.

[4]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[5]  S. Grgic,et al.  Testing picture quality in HDTV systems , 2008, 2008 50th International Symposium ELMAR.

[6]  Zhou Wang,et al.  Visual Perception and Quality Assessment , 2011 .

[7]  Radu Bogdan Rusu,et al.  3D is here: Point Cloud Library (PCL) , 2011, 2011 IEEE International Conference on Robotics and Automation.

[8]  S. Grgic,et al.  Reduced video quality measure based on 3D steerable wavelet transform and modified structural similarity index , 2013, Proceedings ELMAR-2013.

[9]  Michael M. Kazhdan,et al.  Screened poisson surface reconstruction , 2013, TOGS.

[10]  Rajiv Soundararajan,et al.  Video Quality Assessment by Reduced Reference Spatio-Temporal Entropic Differencing , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[11]  D. Lague,et al.  Accurate 3D comparison of complex topography with terrestrial laser scanner: Application to the Rangitikei canyon (N-Z) , 2013, 1302.1183.

[12]  Gabriel Taubin,et al.  A benchmark for surface reconstruction , 2013, TOGS.

[13]  Alan C. Bovik,et al.  Subjective evaluation of stereoscopic image quality , 2013, Signal Process. Image Commun..

[14]  Emil Dumic,et al.  Benchmark of state of the art objective measures for 3D stereoscopic video quality assessment on the Nantes database , 2014, Proceedings ELMAR-2014.

[15]  Jenq-Neng Hwang,et al.  A subjective quality evaluation for 3D point cloud models , 2014, 2014 International Conference on Audio, Language and Image Processing.

[16]  Patrick Le Callet,et al.  Objective image quality assessment of 3D synthesized views , 2015, Signal Process. Image Commun..

[17]  Touradj Ebrahimi,et al.  JPEG Pleno: Toward an Efficient Representation of Visual Reality , 2016, IEEE MultiMedia.

[18]  Rufael Mekuria,et al.  Evaluation criteria for PCC (Point Cloud Compression) , 2016 .

[19]  Touradj Ebrahimi,et al.  On subjective and objective quality evaluation of point cloud geometry , 2017, 2017 Ninth International Conference on Quality of Multimedia Experience (QoMEX).

[20]  Pierre Alliez,et al.  A Survey of Surface Reconstruction from Point Clouds , 2017, Comput. Graph. Forum.

[21]  Rufael Mekuria,et al.  Design, Implementation, and Evaluation of a Point Cloud Codec for Tele-Immersive Video , 2017, IEEE Transactions on Circuits and Systems for Video Technology.

[22]  Catarina Brites,et al.  Subjective and objective quality evaluation of 3D point cloud denoising algorithms , 2017, 2017 IEEE International Conference on Multimedia & Expo Workshops (ICMEW).

[23]  Dong Tian,et al.  Geometric distortion metrics for point cloud compression , 2017, 2017 IEEE International Conference on Image Processing (ICIP).