Perceptual Quality Driven Adaptive Video Coding Using JND Estimation

We introduce a perceptual video quality driven video encoding solution for optimized adaptive streaming. By using multiple bitrate/resolution encoding like MPEG-DASH, video streaming services can deliver the best video stream to a client, under the conditions of the client's available bandwidth and viewing device capability. However, conventional fixed encoding recipes (i.e., resolution-bitrate pairs) suffer from many problems, such as improper resolution selection and stream redundancy. To avoid these problems, we propose a novel video coding method, which generates multiple representations with constant JustNoticeable Difference (JND) interval. For this purpose, we developed a JND scale estimator using Support Vector Regression (SVR), and designed a pre-encoder which outputs an encoding recipe with constant JND interval in an adaptive manner to input video.

[1]  G. Bjontegaard,et al.  Calculation of Average PSNR Differences between RD-curves , 2001 .

[2]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[3]  Alan C. Bovik,et al.  Image information and visual quality , 2006, IEEE Trans. Image Process..

[4]  Stephen Wolf,et al.  Video Quality Model for Variable Frame Delay (VQM_VFD) , 2011 .

[5]  Fan Zhang,et al.  Image Quality Assessment by Separately Evaluating Detail Losses and Additive Impairments , 2011, IEEE Transactions on Multimedia.

[6]  C.-C. Jay Kuo,et al.  Experimental design and analysis of JND test on coded image/video , 2015, SPIE Optical Engineering + Applications.

[7]  Jan De Cock,et al.  Complexity-based consistent-quality encoding in the cloud , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[8]  Takanori Hayashi,et al.  Parametric Quality-Estimation Model for Adaptive-Bitrate-Streaming Services , 2017, IEEE Transactions on Multimedia.

[9]  Xin Jin,et al.  VideoSet: A large-scale compressed video quality dataset based on JND measurement , 2017, J. Vis. Commun. Image Represent..