Audiovisual Quality Estimation for Video Calls in Wireless Applications

Mobile/wireless multimedia applications (e.g., video calls and IPTV) have gained great momentum in recent years. An important issue is to monitor/predict overall audiovisual quality, instead of audio-only or video-only quality, non-intrusively for technical or commercial reasons. Previous audiovisual modeling research mainly considered application parameters (e.g., codec and send bit rate). Little attention has been paid to how network parameters, e.g., Packet Error Rate (PER) affect audiovisual quality. The aim of this paper is to explore methods to predict audiovisual quality objectively for video calls in wireless applications. The contributions of the paper are twofold. Firstly, we present subjective test results on how audio and video contribute to overall audiovisual quality and develop models to reflect this relationship. Secondly, we investigated how network parameters (e.g., PER) and application parameters, e.g., video Frame Rate (FR) affect overall audiovisual quality. We developed a regression model to predict audiovisual quality from PER and FR which can be used to monitor/predict audiovisual quality non-intrusively. We also explore the possibility to predict audiovisual quality from full-reference voice and video quality metrics (i.e., PESQ and PSNR) and from combined PESQ/PSNR and network/application parameters. The different predication accuracy obtained from these models (accuracy from 84% to 93%) indicates the complex attributes in audiovisual quality prediction. An extended Evalvid/NS-2 platform is developed to support simulation of video calls over wireless networks.

[1]  METHODS FOR SUBJECTIVE DETERMINATION OF TRANSMISSION QUALITY Summary , 2022 .

[2]  Lingfen Sun,et al.  Content-Based Video Quality Prediction for MPEG4 Video Streaming over Wireless Networks , 2009, J. Multim..

[3]  Chih-Heng Ke,et al.  MyEvalvid_RTP: A New Simulation Tool-set Toward More Realistic Simulation , 2007, Future Generation Communication and Networking (FGCN 2007).

[4]  Adam Wolisz,et al.  EvalVid - A Framework for Video Transmission and Quality Evaluation , 2003, Computer Performance Evaluation / TOOLS.

[5]  D. S. Hands,et al.  A basic multimedia quality model , 2004, IEEE Transactions on Multimedia.

[6]  Norihisa Doi,et al.  Effects of IP packet loss and picture frame reduction on MPEG1 subjective quality , 1999, 1999 IEEE Third Workshop on Multimedia Signal Processing (Cat. No.99TH8451).

[7]  Christof Faller,et al.  MAXIMIZING AUDIOVISUAL QUALITY AT LOW BITRATES , 2005 .

[8]  C. Jones,et al.  Development of opinion-based audiovisual quality models for desktop video-teleconferencing , 1998, 1998 Sixth International Workshop on Quality of Service (IWQoS'98) (Cat. No.98EX136).

[9]  Stefan Winkler,et al.  Perceived Audiovisual Quality of Low-Bitrate Multimedia Content , 2006, IEEE Transactions on Multimedia.

[10]  V. Michael Bove,et al.  Television Sound and Viewer Perceptions , 1991 .

[11]  E. O. Elliott A model of the switched telephone network for data communications , 1965 .

[12]  Valentin S. Kisimov,et al.  Video Acceptability and Frame Rate , 1995, IEEE Multim..

[13]  R. Puglia,et al.  Audiovisual quality estimation for mobile streaming services , 2005, 2005 2nd International Symposium on Wireless Communication Systems.

[14]  ITU-T Rec. P.910 (04/2008) Subjective video quality assessment methods for multimedia applications , 2009 .

[15]  John G. Beerends,et al.  The Influence of Video Quality on Perceived Audio Quality and Vice Versa , 1999 .