Mobile Video Quality Assessment Database

We introduce a new research tool – the LIVE Mobile Video Quality Assessment (VQA) database. The database consists of pristine reference and distorted videos, along with human/subjective opinion scores of the associated video quality. The database was designed towards improving our understanding of human judgements of time-varying video quality in heavilytrafficked wireless networks. A byproduct of a better understanding could be quantitative models useful for the development of perceptually-aware algorithms for resource allocation and rate adaptation for video streaming. The database consists of 200 distorted videos created from 10 RAW HD videos acquired using a RED ONE digital cinematographic camera. It includes static distortions such as compression and wireless packet loss, as well as dynamically varying distortions. We describe the creation of the database, simulated distortions and the human study that we conducted to obtain 5,300 time-sampled subjective traces of quality and summary subjective scores. We analyze the results obtained for certain subclasses of distortions from this large database of interest in context of wireless video delivery. The LIVE Mobile VQA database, including the human subjective scores, will be made available to researchers in the field at no cost in order to aid the development of novel strategies for videoaware resource allocation.

[1]  Markus Rupp,et al.  Performance evaluation of mobile video quality estimators , 2007, 2007 15th European Signal Processing Conference.

[2]  Gustavo de Veciana,et al.  Video Quality Assessment on Mobile Devices: Subjective, Behavioral and Objective Studies , 2012, IEEE Journal of Selected Topics in Signal Processing.

[3]  Satu Jumisko-Pyykkö,et al.  Evaluation of subjective video quality of mobile devices , 2005, MULTIMEDIA '05.

[4]  Stefan Winkler,et al.  Video quality evaluation for mobile streaming applications , 2003, Visual Communications and Image Processing.

[5]  Margaret H. Pinson,et al.  Comparing subjective video quality testing methodologies , 2003, Visual Communications and Image Processing.

[6]  M. Angela Sasse,et al.  Can small be beautiful?: assessing image resolution requirements for mobile TV , 2005, MULTIMEDIA '05.

[7]  B. Wandell Foundations of vision , 1995 .

[8]  Sugato Chakravarty,et al.  Methodology for the subjective assessment of the quality of television pictures , 1995 .

[9]  Rajiv Soundararajan,et al.  Study of Subjective and Objective Quality Assessment of Video , 2010, IEEE Transactions on Image Processing.

[10]  Alan C. Bovik,et al.  Wireless Video Quality Assessment: A Study of Subjective Scores and Objective Algorithms , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[11]  Miska M. Hannuksela,et al.  Does context matter in quality evaluation of mobile television? , 2008, Mobile HCI.

[12]  Alexander Eichhorn,et al.  Pick Your Layers Wisely - A Quality Assessment of H.264 Scalable Video Coding for Mobile Devices , 2009, 2009 IEEE International Conference on Communications.