Cognitive no-reference video quality assessment for mobile streaming services

The evaluation of mobile streaming services, particularly in terms of delivered Quality of Experience (QoE), entails the use of automated methods (which excludes subjective QoE) that can be executed in real-time (i.e. without delaying the streaming process). This calls for lightweight algorithms that provide accurate results under considerable constraints. Starting from a low complexity no-reference objective algorithm for still images, in this work we contribute a new version that not only works for videos but, is general enough to adjust to a diverse range of video types while not significantly increasing the computational complexity. To achieve the necessary level of flexibility and computational efficiency, our method relies merely on information available at the client side and is equipped with a lightweight Artificial Neural Network which makes the algorithm independent from type of network or video. Its resource efficiency and generality make our method fit to be used in mobile streaming services. To prove the viability of our approach, we show a high level of correlation with the well-known full-reference method SSIM.

[1]  Antonio Liotta,et al.  Quality of experience management in mobile content delivery systems , 2009, Telecommun. Syst..

[2]  Giancarlo Fortino,et al.  Cognitive streaming on android devices , 2015, 2015 IFIP/IEEE International Symposium on Integrated Network Management (IM).

[3]  Haitham Bou-Ammar,et al.  Reduced reference image quality assessment via Boltzmann Machines , 2015, 2015 IFIP/IEEE International Symposium on Integrated Network Management (IM).

[4]  A. Liotta The cognitive NET is coming , 2013, IEEE Spectrum.

[5]  Christian Keimel,et al.  Hybrid no-reference video quality metric based on multiway PLSR , 2012, 2012 Proceedings of the 20th European Signal Processing Conference (EUSIPCO).

[6]  Antonio Liotta,et al.  Quality of Experience Models for Multimedia Streaming , 2010, Int. J. Mob. Comput. Multim. Commun..

[7]  Muhammad Shahid,et al.  A reduced complexity no-reference artificial neural network based video quality predictor , 2011, 2011 4th International Congress on Image and Signal Processing.

[8]  Antonio Liotta,et al.  Instantaneous Video Quality Assessment for lightweight devices , 2013, MoMM '13.

[9]  Tamer Shanableh,et al.  Prediction of Structural Similarity Index of Compressed Video at a Macroblock Level , 2011, IEEE Signal Processing Letters.

[10]  Hans-Jürgen Zepernick,et al.  No-reference image and video quality assessment: a classification and review of recent approaches , 2014, EURASIP Journal on Image and Video Processing.

[11]  Jae Wook Jeon,et al.  No-Reference Image Quality Assessment using Blur and Noise , 2009 .

[12]  Decebal Constantin DEEP LEARNING FOR OBJECTIVE QUALITY ASSESSMENT OF 3D IMAGES , 2014 .

[13]  Christian Keimel,et al.  Rule-Based No-Reference Video Quality Evaluation Using Additionally Coded Videos , 2009, IEEE Journal of Selected Topics in Signal Processing.

[14]  Stefano Tubaro,et al.  No-Reference Pixel Video Quality Monitoring of Channel-Induced Distortion , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[15]  Antonio Liotta,et al.  Machine Learning Approach for Quality of Experience Aware Networks , 2010, 2010 International Conference on Intelligent Networking and Collaborative Systems.

[16]  Antonio Liotta,et al.  When does lower bitrate give higher quality in modern video services? , 2014, 2014 IEEE Network Operations and Management Symposium (NOMS).

[17]  Antonio Liotta,et al.  End-to-end performance evaluation in high-speed wireless networks , 2014, 10th International Conference on Network and Service Management (CNSM) and Workshop.

[18]  Frank Rosenblatt,et al.  PRINCIPLES OF NEURODYNAMICS. PERCEPTRONS AND THE THEORY OF BRAIN MECHANISMS , 1963 .

[19]  Rajiv Soundararajan,et al.  Study of Subjective and Objective Quality Assessment of Video , 2010, IEEE Transactions on Image Processing.

[20]  Peter Schelkens,et al.  Qualinet White Paper on Definitions of Quality of Experience , 2013 .

[21]  Stefan Winkler,et al.  The Evolution of Video Quality Measurement: From PSNR to Hybrid Metrics , 2008, IEEE Transactions on Broadcasting.

[22]  Antonio Liotta,et al.  Tackling the Sheer Scale of Subjective QoE , 2011, MobiMedia.

[23]  Oliver Hohlfeld,et al.  Impact of frame rate and resolution on objective QoE metrics , 2010, 2010 Second International Workshop on Quality of Multimedia Experience (QoMEX).

[24]  Daniel Schlosser,et al.  Quantifying the Influence of Network Conditions on the Service Quality Experienced by a Thin Client User , 2008, MMB.

[25]  Antonio Liotta Farewell to deterministic networks , 2012, 2012 19th IEEE Symposium on Communications and Vehicular Technology in the Benelux (SCVT).

[26]  A. Reibman,et al.  ANALYZING THE SPATIAL QUALITY OF INTERNET STREAMING VIDEO , .

[27]  Tiago Rosa Maria Paula Queluz,et al.  No-Reference Quality Assessment of H.264/AVC Encoded Video , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[28]  Antonio Liotta,et al.  The Value of Relative Quality in Video Delivery , 2011, J. Mobile Multimedia.