Influence of spatial and temporal activity of upscaled video on its perceived quality

High network resources costs led to the increasingly usage of scalable video coding in video transmission over the network. Prior to displaying on user device, the transmitted video should be spatial and/or temporal upscaled in order to ensure the acceptable perceived quality level. In this work the relationship between the spatio-temporal activity of upscaled sequence and its perceived quality is examined. The experiments are performed for videos presented on PC and on smartphone, while three different activity measures are analyzed. It is shown that the newly-introduced spatio-temporal activity measure, called SITImean, achieves a high level of correlation with subjective quality scores. Therefore it could be used as an indicator of upscaled video quality, replacing the expensive subjective quality evaluation tests.

[1]  Kenneth E. Barner,et al.  A Computationally Efficient Super-Resolution Algorithm for Video Processing Using Partition Filters , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[2]  Russell C. Hardie,et al.  A Fast Image Super-Resolution Algorithm Using an Adaptive Wiener Filter , 2007, IEEE Transactions on Image Processing.

[3]  Truong Q. Nguyen,et al.  A Multistage Motion Vector Processing Method for Motion-Compensated Frame Interpolation , 2008, IEEE Transactions on Image Processing.

[4]  Peyman Milanfar,et al.  Spatiotemporal Video Upscaling Using Motion-Assisted Steering Kernel (MASK) Regression , 2010 .

[5]  Michael Elad,et al.  Super-Resolution Without Explicit Subpixel Motion Estimation , 2009, IEEE Transactions on Image Processing.

[6]  Chang-Su Kim,et al.  Motion-Compensated Frame Interpolation Using Bilateral Motion Estimation and Adaptive Overlapped Block Motion Compensation , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[7]  Liangpei Zhang,et al.  A MAP Approach for Joint Motion Estimation, Segmentation, and Super Resolution , 2007, IEEE Transactions on Image Processing.

[8]  Michael Elad,et al.  Super Resolution With Probabilistic Motion Estimation , 2009, IEEE Transactions on Image Processing.

[9]  Michael Elad,et al.  Generalizing the Nonlocal-Means to Super-Resolution Reconstruction , 2009, IEEE Transactions on Image Processing.

[10]  Snjezana Rimac-Drlje,et al.  Spatial upscaling of scalable coded video for mobile applications , 2013, Proceedings ELMAR-2013.

[11]  Sungjoo Yoo,et al.  Dual Motion Estimation for Frame Rate Up-Conversion , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[12]  Peyman Milanfar,et al.  Kernel Regression for Image Processing and Reconstruction , 2007, IEEE Transactions on Image Processing.

[13]  Peyman Milanfar,et al.  Spatio-temporal video interpolation and denoising using motion-assisted steering kernel (MASK) regression , 2008, 2008 15th IEEE International Conference on Image Processing.