YouTube UGC Dataset for Video Compression Research

Non-professional video, commonly known as User Generated Content (UGC) has become very popular in today's video sharing applications. However, traditional metrics used in compression and quality assessment, like BD-Rate and PSNR, are designed for pristine originals. Thus, their accuracy drops significantly when being applied on non-pristine originals (the majority of UGC). Understanding difficulties for compression and quality assessment in the scenario of UGC is important, but there are few public UGC datasets available for research. This paper introduces a large scale UGC dataset (1500 20 sec video clips) sampled from millions of YouTube videos. The dataset covers popular categories like Gaming, Sports, and new features like High Dynamic Range (HDR). Besides a novel sampling method based on features extracted from encoding, challenges for UGC compression and quality evaluation are also discussed. Shortcomings of traditional reference-based metrics on UGC are addressed. We demonstrate a promising way to evaluate UGC quality by no-reference objective quality metrics, and evaluate the current dataset with three no-reference metrics (Noise, Banding, and SLEEQ).

[1]  Alan C. Bovik,et al.  Large Scale Subjective Video Quality Study , 2018, 2018 25th IEEE International Conference on Image Processing (ICIP).

[2]  Anil C. Kokaram,et al.  A no-reference video quality predictor for compression and scaling artifacts , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[3]  Anil C. Kokaram,et al.  Optimized Transcoding for Large Scale Adaptive Streaming Using Playback Statistics , 2018, 2018 25th IEEE International Conference on Image Processing (ICIP).

[4]  Dietmar Saupe,et al.  The Konstanz natural video database (KoNViD-1k) , 2017, 2017 Ninth International Conference on Quality of Multimedia Experience (QoMEX).

[5]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[6]  Abhishek Verma,et al.  Large-scale cluster management at Google with Borg , 2015, EuroSys.

[7]  Rajiv Soundararajan,et al.  Study of Subjective and Objective Quality Assessment of Video , 2010, IEEE Transactions on Image Processing.

[8]  Cordelia Schmid,et al.  AVA: A Video Dataset of Spatio-Temporally Localized Atomic Visual Actions , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[9]  Chao Chen,et al.  A No-reference Perceptual Quality Metric for Videos Distorted by Spatially Correlated noise , 2016 .

[10]  Anil C. Kokaram,et al.  A perceptual visibility metric for banding artifacts , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[11]  Apostol Natsev,et al.  YouTube-8M: A Large-Scale Video Classification Benchmark , 2016, ArXiv.

[12]  Stefan Winkler,et al.  Analysis of Public Image and Video Databases for Quality Assessment , 2012, IEEE Journal of Selected Topics in Signal Processing.