Subjective Assessment of Region of Interest-Aware Adaptive Multimedia Streaming Quality

Adaptive multimedia streaming relies on adjusting the video content's bit-rate meet network conditions in the quest to reduce packet loss and resulting video quality degradations. Current multimedia adaptation schemes uniformly adjust the compression over the entire image area. However, research has shown that user attention is focused mostly on certain image areas, denoted areas of maximum user interest (AMUI), and their interest decreases with the increase in distance to the AMUI. The region of interest-based adaptive multimedia streaming scheme (ROIAS) is introduced to perform bit-rate adaptation to network conditions by adjusting video quality relative to the AMUI location. This paper also extends ROIAS to support multiple areas of maximum user interest within the same video frame. This paper presents the performance analysis of ROIAS in terms of the impact on user perceived video quality measured using subjective video quality assessment techniques based on human subjects. The tests use a wide range of video clips, which differ in terms of spatial and temporal complexity and region of interest location and variation. A comparative evaluation of both subjective and objective video quality test results is performed and demonstrate the benefit of using ROIAS for adaptive video quality delivery.

[1]  TianYun Huang.  Region of interest extraction and adaptation in scalable video coding , 2010, 2010 Seventh International Conference on Fuzzy Systems and Knowledge Discovery.

[2]  Deborah Estrin,et al.  RAP: An end-to-end rate-based congestion control mechanism for realtime streams in the Internet , 1999, IEEE INFOCOM '99. Conference on Computer Communications. Proceedings. Eighteenth Annual Joint Conference of the IEEE Computer and Communications Societies. The Future is Now (Cat. No.99CH36320).

[3]  Pascal Frossard,et al.  User-Oriented QoS Analysis in MPEG-2 Video Delivery , 1999, Real Time Imaging.

[4]  Sanjoy Paul,et al.  2PASCD: An Efficient 2-Pass Abrupt Scene Change Detection Algorithm , 2010, 2010 International Conference on Multimedia Information Networking and Security.

[5]  Magda El Zarki,et al.  Network QoS Needs of Advanced Internet Applications A Survey , 2003 .

[6]  Pascal Frossard,et al.  Adaptive systems for improved media streaming experience , 2007, IEEE Communications Magazine.

[7]  Rajiv Soundararajan,et al.  Study of Subjective and Objective Quality Assessment of Video , 2010, IEEE Transactions on Image Processing.

[8]  Neil W. Bergmann,et al.  Perceptually based quantization technique for MPEG encoding , 1998, Electronic Imaging.

[9]  Cedric Nishan Canagarajah,et al.  Towards efficient context-specific video coding based on gaze-tracking analysis , 2007, TOMCCAP.

[10]  Kyung-Ae Cha.  Content complexity adaptation for MPEG-4 audio-visual scene , 2004, IEEE Trans. Consumer Electron..

[11]  Gabriel-Miro Muntean,et al.  Region of Interest-Based Adaptive Multimedia Streaming Scheme , 2008, IEEE Transactions on Broadcasting.

[12]  Gabriel-Miro Muntean,et al.  Resource Efficient Quality-Oriented Wireless Broadcasting of Adaptive Multimedia Content , 2007, IEEE Transactions on Broadcasting.

[13]  Mihaela van der Schaar,et al.  Adaptive motion-compensation fine-granular-scalability (AMC-FGS) for wireless video , 2002, IEEE Trans. Circuits Syst. Video Technol..

[14]  Wen-Nung Lie,et al.  Region-of-interest based rate control scheme with flexible quality on demand , 2010, 2010 IEEE International Conference on Multimedia and Expo.

[15]  Stephen R. Gulliver,et al.  The Perceptual and Attentive Impact of Delay and Jitter in Multimedia Delivery , 2007, IEEE Transactions on Broadcasting.

[16]  Gunnar Karlsson,et al.  User-oriented QoS in packet video delivery , 1998, IEEE Netw..

[17]  Min Qin,et al.  An Adaptive Strategy for Mobile Ad Hoc Media Streaming , 2010, IEEE Transactions on Multimedia.

[18]  Djemel Ziou,et al.  Image Quality Metrics: PSNR vs. SSIM , 2010, 2010 20th International Conference on Pattern Recognition.

[19]  Pierre Bretillon,et al.  Objective quality monitoring issues in digital broadcasting networks , 2005, IEEE Transactions on Broadcasting.

[20]  Zhou Wang,et al.  Why is image quality assessment so difficult? , 2002, 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[21]  Mihaela van der Schaar,et al.  Providing adaptive QoS to layered video over wireless local area networks through real-time retry limit adaptation , 2004, IEEE Transactions on Multimedia.

[22]  Frank H. P. Fitzek,et al.  A prefetching protocol for continuous media streaming in wireless environments , 2001, IEEE J. Sel. Areas Commun..

[23]  Matthias Baldauf,et al.  A survey on context-aware systems , 2007, Int. J. Ad Hoc Ubiquitous Comput..

[24]  Liam Murphy,et al.  Subjective assessment of the quality-oriented adaptive scheme , 2005, IEEE Transactions on Broadcasting.

[25]  Benjamin Watson,et al.  Managing level of detail through peripheral degradation: effects on search performance with a head-mounted display , 1997, TCHI.

[26]  Tuna Tugcu,et al.  A survey on emerging broadband wireless access technologies , 2007, Comput. Networks.

[27]  Stephen R. Gulliver,et al.  Stars in their eyes: what eye-tracking reveals about multimedia perceptual quality , 2004, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[28]  Stephen Wolf,et al.  Application of the NTIA General Video Quality Metric (VQM) to HDTV Quality Monitoring , 2007 .

[29]  Liam Murphy,et al.  Objective and subjective evaluation of QOAS video streaming over broadband networks , 2005, IEEE Transactions on Network and Service Management.

[30]  Ludwik Kurz,et al.  Analysis of Variance in Statistical Image Processing , 1997 .

[31]  Martin Reisslein,et al.  Objective Video Quality Assessment Methods: A Classification, Review, and Performance Comparison , 2011, IEEE Transactions on Broadcasting.

[32]  Baoxin Li,et al.  On implementing motion-based Region of Interest detection on multi-core CELL , 2010, Comput. Vis. Image Underst..

[33]  Bo Li,et al.  Adaptive Video Multicast over the Internet , 2003, IEEE Multim..

[34]  Lester C. Loschky,et al.  User performance with gaze contingent multiresolutional displays , 2000, ETRA.

[35]  A. Murat Tekalp,et al.  Optimization of encoding configuration in scalable multiple description coding for rate-adaptive P2P video multicasting , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[36]  Anthony J. Maeder,et al.  Automatic identification of perceptually important regions in an image , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[37]  Liam Murphy,et al.  Optimum adaptation trajectories for streamed multimedia , 2005, Multimedia Systems.

[38]  Klara Nahrstedt,et al.  Dynamic Bandwidth Management for Single-Hop Ad Hoc Wireless Networks , 2003, PerCom.

[39]  D. Malah,et al.  Region-of-interest based adaptation of video to mobile devices , 2010, 2010 4th International Symposium on Communications, Control and Signal Processing (ISCCSP).

[40]  Heonshik Shin,et al.  Design of a mobile video streaming system using adaptive spatial resolution control , 2009, IEEE Transactions on Consumer Electronics.

[41]  Deborah Estrin,et al.  Layered quality adaptation for Internet video streaming , 2000, IEEE Journal on Selected Areas in Communications.

[42]  Margaret H. Pinson,et al.  A new standardized method for objectively measuring video quality , 2004, IEEE Transactions on Broadcasting.

[43]  Liam Murphy,et al.  A new adaptive multimedia streaming system for all-IP multi-service networks , 2004, IEEE Transactions on Broadcasting.

[44]  Raouf Boutaba,et al.  Adaptive packet video streaming over IP networks: a cross-layer approach , 2005, IEEE Journal on Selected Areas in Communications.

[45]  Klara Nahrstedt,et al.  Dynamic Bandwidth Management in Single-Hop Ad Hoc Wireless Networks , 2003, Proceedings of the First IEEE International Conference on Pervasive Computing and Communications, 2003. (PerCom 2003)..

[46]  Dimitrios Miras,et al.  A Survey of Network QoS Needs of Advanced Internet Applications — Working Document — , 2002 .

[47]  Jon M. Peha,et al.  Streaming video over the Internet: approaches and directions , 2001, IEEE Trans. Circuits Syst. Video Technol..

[48]  S. Shioiri,et al.  Useful Resolution for Picture Perception as a Function of Eccentricity , 1989, Perception.

[49]  Lester C. Loschky,et al.  Reduced saliency of peripheral targets in gaze-contingent multi-resolutional displays: blended versus sharp boundary windows , 2002, ETRA.

[50]  Liam Murphy,et al.  Adaptive pre-recorded multimedia streaming , 2002, Global Telecommunications Conference, 2002. GLOBECOM '02. IEEE.

[51]  Mihaela van der Schaar,et al.  Cross-layer wireless multimedia transmission: challenges, principles, and new paradigms , 2005, IEEE Wirel. Commun..

[52]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[53]  Lester C. Loschky,et al.  How late can you update gaze-contingent multiresolutional displays without detection? , 2007, TOMCCAP.

[54]  Gabriel-Miro Muntean,et al.  Battery and Stream-Aware Adaptive Multimedia Delivery for wireless devices , 2010, IEEE Local Computer Network Conference.

[55]  Sheila S. Hemami,et al.  No-reference image and video quality estimation: Applications and human-motivated design , 2010, Signal Process. Image Commun..

[56]  Olivier Verscheure,et al.  Perceptual quality measure using a spatiotemporal model of the human visual system , 1996, Electronic Imaging.