Funque: Fusion of Unified Quality Evaluators

Fusion-based quality assessment has emerged as a powerful method for developing high-performance quality models from quality models that individually achieve lower performances. A prominent example of such an algorithm is VMAF, which has been widely adopted as an industry standard for video quality prediction along with SSIM. In addition to advancing the state-of-the-art, it is imperative to alleviate the computational burden presented by the use of a heterogeneous set of quality models. In this paper, we unify "atom" quality models by computing them on a common transform domain that accounts for the Human Visual System, and we propose FUNQUE, a quality model that fuses unified quality evaluators. We demonstrate that in comparison to the state-of-the-art, FUNQUE offers significant improvements in both correlation against subjective scores and efficiency, due to computation sharing.

[1]  Angeliki V. Katsenou,et al.  Enhancing VMAF through New Feature Integration and Model Combination , 2021, 2021 Picture Coding Symposium (PCS).

[2]  Abhinau K. Venkataramanan,et al.  A Hitchhiker’s Guide to Structural Similarity , 2021, IEEE Access.

[3]  Alan C. Bovik,et al.  Perceptual Video Quality Prediction Emphasizing Chroma Distortions , 2020, IEEE Transactions on Image Processing.

[4]  Angeliki V. Katsenou,et al.  Comparing VVC, HEVC and AV1 using Objective and Subjective Assessments , 2020 .

[5]  Angeliki V. Katsenou,et al.  A Subjective Comparison of AV1 and HEVC for Adaptive Video Streaming , 2019, 2019 IEEE International Conference on Image Processing (ICIP).

[6]  Vasileios Giotsas,et al.  Deep Video Precoding , 2019, IEEE Transactions on Circuits and Systems for Video Technology.

[7]  Alan C. Bovik,et al.  Spatiotemporal Feature Integration and Model Fusion for Full Reference Video Quality Assessment , 2018, IEEE Transactions on Circuits and Systems for Video Technology.

[8]  Fan Zhang,et al.  BVI-HD: A Video Quality Database for HEVC Compressed and Texture Synthesized Content , 2018, IEEE Transactions on Multimedia.

[9]  C.-C. Jay Kuo,et al.  MCL-V: A streaming video quality assessment database , 2015, J. Vis. Commun. Image Represent..

[10]  Stéphane Coulombe,et al.  A novel discrete wavelet transform framework for full reference image quality assessment , 2013, Signal Image Video Process..

[11]  Fan Zhang,et al.  Image Quality Assessment by Separately Evaluating Detail Losses and Additive Impairments , 2011, IEEE Transactions on Multimedia.

[12]  Alan C. Bovik,et al.  Image information and visual quality , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[13]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[14]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[15]  John D. Villasenor,et al.  Visibility of wavelet quantization noise , 1997, IEEE Transactions on Image Processing.

[16]  William T. Freeman,et al.  Presented at: 2nd Annual IEEE International Conference on Image , 1995 .

[17]  King Ngi Ngan,et al.  Adaptive cosine transform coding of images in perceptual domain , 1989, IEEE Trans. Acoust. Speech Signal Process..