Region of Interest-Based Adaptive Multimedia Streaming Scheme

Adaptive multimedia streaming aims at adjusting the transmitted content based on the available bandwidth such as losses that often severely affect the end-user perceived quality are minimized and consequently the transmission quality increases. Current solutions affect equally the whole viewing area of the multimedia frames, despite research showing that there are regions on which the viewers are more interested in than on others. This paper presents a novel region of interest-based adaptive scheme (ROIAS) for multimedia streaming that when performing transmission-related quality adjustments, selectively affects the quality of those regions of the image the viewers are the least interested in. As the quality of the regions the viewers are the most interested in will not change (or will involve little change), the proposed scheme provides higher overall end-user perceived quality than any of the existing adaptive solutions.

[1]  Lester C. Loschky,et al.  Reduced saliency of peripheral targets in gaze-contingent multi-resolutional displays: blended versus sharp boundary windows , 2002, ETRA.

[2]  D. Sisalem,et al.  LDA + TCP-Friendly Adaptation : A Measurement and Comparison Study , 2000 .

[3]  Liam Murphy,et al.  A new adaptive multimedia streaming system for all-IP multi-service networks , 2004, IEEE Transactions on Broadcasting.

[4]  ITU-T Rec. P.910 (04/2008) Subjective video quality assessment methods for multimedia applications , 2009 .

[5]  Stephen R. Gulliver,et al.  Stars in their eyes: what eye-tracking reveals about multimedia perceptual quality , 2004, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[6]  Injong Rhee,et al.  TEAR: TCP emulation at receivers – flow control for multimedia streaming , 2000 .

[7]  Arzu Çöltekin,et al.  Foveated gaze-contingent displays for peripheral LOD management, 3D visualization, and stereo imaging , 2007, TOMCCAP.

[8]  Xiaodong Gu,et al.  A region based multiple frame-rate tradeoff of video streaming , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[9]  Yu-Kwong Kwok,et al.  On a region-of-interest based approach to robust wireless video transmission , 2004, 7th International Symposium on Parallel Architectures, Algorithms and Networks, 2004. Proceedings..

[10]  Steven McCanne,et al.  Low-Complexity Video Coding for Receiver-Driven Layered Multicast , 1997, IEEE J. Sel. Areas Commun..

[11]  Liam Murphy,et al.  Content-Based Adaptation of Streamed Multimedia , 2004, MMNS.

[12]  Liam Murphy,et al.  Subjective assessment of the quality-oriented adaptive scheme , 2005, IEEE Transactions on Broadcasting.

[13]  Anthony J. Maeder,et al.  Automatic identification of perceptually important regions in an image , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[14]  Lester C. Loschky,et al.  How late can you update gaze-contingent multiresolutional displays without detection? , 2007, TOMCCAP.

[15]  Wei-Ying Ma,et al.  A content-based bit allocation model for video streaming , 2004, 2004 IEEE International Conference on Multimedia and Expo (ICME) (IEEE Cat. No.04TH8763).

[16]  David Hutchison,et al.  Filters: QoS Support Mechanisms for Multipeer Communications , 1996, IEEE J. Sel. Areas Commun..

[17]  Jon Crowcroft,et al.  TCP-like congestion control for layered multicast data transfer , 1998, Proceedings. IEEE INFOCOM '98, the Conference on Computer Communications. Seventeenth Annual Joint Conference of the IEEE Computer and Communications Societies. Gateway to the 21st Century (Cat. No.98.

[18]  Deborah Estrin,et al.  RAP: An end-to-end rate-based congestion control mechanism for realtime streams in the Internet , 1999, IEEE INFOCOM '99. Conference on Computer Communications. Proceedings. Eighteenth Annual Joint Conference of the IEEE Computer and Communications Societies. The Future is Now (Cat. No.99CH36320).

[19]  Sanjiv Nanda,et al.  Broadband access over cable for next-generation services: a distributed switch architecture , 2002 .

[20]  Pascal Frossard,et al.  User-Oriented QoS Analysis in MPEG-2 Video Delivery , 1999, Real Time Imaging.

[21]  Jon M. Peha,et al.  Streaming video over the Internet: approaches and directions , 2001, IEEE Trans. Circuits Syst. Video Technol..

[22]  S. Shioiri,et al.  Useful Resolution for Picture Perception as a Function of Eccentricity , 1989, Perception.

[23]  Steven McCanne,et al.  Receiver-driven layered multicast , 2001 .

[24]  Deborah Estrin,et al.  Layered quality adaptation for Internet video streaming , 2000, IEEE Journal on Selected Areas in Communications.

[25]  George Ghinea,et al.  QoS impact on user perception and understanding of multimedia video clips , 1998, MULTIMEDIA '98.

[26]  Ajay Luthra,et al.  Rate control for MPEG transcoders , 2001, IEEE Trans. Circuits Syst. Video Technol..

[27]  Lester C. Loschky,et al.  User performance with gaze contingent multiresolutional displays , 2000, ETRA.

[28]  Henning Schulzrinne,et al.  The Loss-Delay Based Adjustment Algorithm: A TCP-Friendly Adaptation Scheme , 1998 .