QoS and resource management in distributed interactive multimedia environments

Quality of Service (QoS) is becoming an integral part of current ubiquitous Distributed Interactive Multimedia Environments (DIMEs) because of their high resource and real-time interactivity demands. It is highly influenced by the management techniques of available resources in these cyber-physical environments. We consider QoS and resource management influenced by two most important resources; the computing (CPU) and networking resources. In this paper, we survey existing DIME-relevant QoS and resource management techniques for these two resources, present their taxonomy, compare them, and show their impacts on DIMEs. Finally, we discuss appropriateness of those techniques in a sample DIME scenario.

[1]  Siome Goldenstein,et al.  Time warping of audio signals , 1999, 1999 Proceedings Computer Graphics International.

[2]  Jason Nieh,et al.  A SMART scheduler for multimedia applications , 2003, TOCS.

[3]  Klara Nahrstedt,et al.  A Study of Visual Context Representation and Control for Remote Sport Learning Tasks , 2008 .

[4]  Bernd Girod,et al.  Adaptive playout scheduling and loss concealment for voice communication over IP networks , 2003, IEEE Trans. Multim..

[5]  James H. Anderson,et al.  Proportional share scheduling of operating system services for real-time applications , 1998, Proceedings 19th IEEE Real-Time Systems Symposium (Cat. No.98CB36279).

[6]  Stephen E. Deering,et al.  Multicast routing in internetworks and extended LANs , 1988, SIGCOMM '88.

[7]  Liam Murphy,et al.  Adaptive VoIP playout scheduling: assessing user satisfaction , 2005, IEEE Internet Computing.

[8]  Muppuri Siva Goutham,et al.  Resource Reservation Protocol , 2012 .

[9]  Henning Schulzrinne,et al.  Adaptive playout mechanisms for packetized audio applications in wide-area networks , 1994, Proceedings of INFOCOM '94 Conference on Computer Communications.

[10]  Pierpaolo Baccichet,et al.  Frame concealment for H.264/AVC decoders , 2005, IEEE Transactions on Consumer Electronics.

[11]  Lurng-Kuo Liu,et al.  A block-based gradient descent search algorithm for block motion estimation in video coding , 1996, IEEE Trans. Circuits Syst. Video Technol..

[12]  Miguel Castro,et al.  SplitStream: high-bandwidth multicast in cooperative environments , 2003, SOSP '03.

[13]  Magda El Zarki,et al.  An adaptive delay and synchronization control scheme for Wi-Fi based audio/video conferencing , 2006, Wirel. Networks.

[14]  Soung Chang Liew,et al.  Multiplexing video traffic using frame-skipping aggregation technique , 1997, Proceedings of International Conference on Image Processing.

[15]  Thomas D. C. Little.  A framework for synchronous delivery of time-dependent multimedia data , 2005, Multimedia Systems.

[16]  Benjamin W. Wah,et al.  The Design of a Multi-party VoIP Conferencing System over the Internet , 2007, Ninth IEEE International Symposium on Multimedia (ISM 2007).

[17]  Hyogun Lee,et al.  A proportional-share scheduler for multimedia applications , 1997, Proceedings of IEEE International Conference on Multimedia Computing and Systems.

[18]  Ralf Steinmetz,et al.  Human Perception of Jitter and Media Synchronization , 1996, IEEE J. Sel. Areas Commun..

[19]  Amin Vahdat,et al.  Bullet: high bandwidth data dissemination using an overlay mesh , 2003, SOSP '03.

[20]  Carl A. Waldspurger,et al.  Lottery and stride scheduling: flexible proportional-share resource management , 1995 .

[21]  Zixia Huang.  The Design of A Multi-party VoIP Conferencing System , 2007, ISM 2007.

[22]  Ya-Qin Zhang,et al.  A fast hierarchical motion-compensation scheme for video coding using block feature matching , 1996, IEEE Trans. Circuits Syst. Video Technol..

[23]  Insup Lee,et al.  Periodic resource model for compositional real-time guarantees , 2003, RTSS 2003. 24th IEEE Real-Time Systems Symposium, 2003.

[24]  Jean-Yves Le Boudec,et al.  Adaptive joint playout buffer and FEC adjustment for Internet telephony , 2003, IEEE INFOCOM 2003. Twenty-second Annual Joint Conference of the IEEE Computer and Communications Societies (IEEE Cat. No.03CH37428).

[25]  R. Rejaie,et al.  Adaptive Multi-Source Streaming in Heterogeneous Peer-to-Peer Networks , 2005 .

[26]  Nicolas D. Georganas,et al.  Design of a multi-sender 3D videoconferencing application over an end system multicast protocol , 2003, ACM Multimedia.

[27]  Reza Rejaie,et al.  Adaptive multisource streaming in heterogeneous peer-to-peer networks , 2005, IS&T/SPIE Electronic Imaging.

[28]  Michael B. Jones,et al.  Modular real-time resource management in the Rialto operating system , 1995, Proceedings 5th Workshop on Hot Topics in Operating Systems (HotOS-V).

[29]  Klara Nahrstedt,et al.  Implementing a Distributed Tele-immersive System , 2008, 2008 Tenth IEEE International Symposium on Multimedia.

[30]  Ion Stoica,et al.  Earliest Eligible Virtual Deadline First : A Flexible and Accurate Mechanism for Proportional Share Resource Allocation , 1995 .

[31]  Benjamin W. Wah,et al.  Transformation-Based Reconstruction for Real-Time Voice Transmissions over the Internet , 1999, IEEE Trans. Multim..

[32]  Klara Nahrstedt,et al.  Quality of experience in distributed interactive multimedia environments: toward a theoretical framework , 2009, ACM Multimedia.

[33]  Tatsuya Suda,et al.  Source-adaptive multilayered multicast algorithms for real-time video distribution , 2000, TNET.

[34]  Lixia Zhang,et al.  Resource ReSerVation Protocol (RSVP) - Version 1 Functional Specification , 1997, RFC.

[35]  Klara Nahrstedt,et al.  TSync: a new synchronization framework for multi-site 3D tele-immersion , 2010, NOSSDAV '10.

[36]  Ruzena Bajcsy,et al.  A multi-stream adaptation framework for bandwidth management in 3D tele-immersion , 2006, NOSSDAV '06.

[37]  Stefan Savage,et al.  Sting: A TCP-based Network Measurement Tool , 1999, USENIX Symposium on Internet Technologies and Systems.

[38]  Ruzena Bajcsy,et al.  TEEVE: the next generation architecture for tele-immersive environments , 2005, Seventh IEEE International Symposium on Multimedia (ISM'05).

[39]  Ruzena Bajcsy,et al.  A Framework for Collaborative Real-Time 3D Teleimmersion in a Geographically Distributed Environment , 2008, 2008 Tenth IEEE International Symposium on Multimedia.

[40]  Tiecheng Liu,et al.  Real-time content analysis and adaptive transmission of lecture videos for mobile applications , 2004, MULTIMEDIA '04.

[41]  ChuHao-hua,et al.  QoS-aware resource management for distributed multimedia applications , 1998 .

[42]  Manish Jain,et al.  Pathload: A Measurement Tool for End-to-End Available Bandwidth , 2002 .

[43]  Scott A. Brandt,et al.  BEST scheduler for integrated processing of best-effort and soft real-time processes , 2001, IS&T/SPIE Electronic Imaging.

[44]  Klara Nahrstedt,et al.  Advancing interactive collaborative mediums through tele-immersive dance (TED): a symbiotic creativity and design environment for art and computer science , 2008, ACM Multimedia.

[45]  Jo Yew Tham,et al.  A novel unrestricted center-biased diamond search algorithm for block motion estimation , 1998, IEEE Trans. Circuits Syst. Video Technol..

[46]  H. Hakimzadeh,et al.  Part 1 , 2011 .

[47]  David L. Black,et al.  Definition of the Differentiated Services Field (DS Field) in the IPv4 and IPv6 Headers , 1998, RFC.

[48]  Anthony Vetro,et al.  Efficient Macroblock Coding-Mode Decision for H.264/AVC Video Coding , 2004 .

[49]  Demetres Antoniades,et al.  Available bandwidth measurement as simple as running wget , 2006 .

[50]  Bernd Hamann,et al.  A methodology for remote virtual interaction in teleimmersive environments , 2010, MMSys '10.

[51]  Panos M. Pardalos,et al.  Steiner Tree Problems , 2009, Encyclopedia of Optimization.

[52]  Zhisheng Niu,et al.  An adaptive receiver buffer adjust algorithm for VoIP applications considering voice characters , 2004, APCC/MDMC '04. The 2004 Joint Conference of the 10th Asia-Pacific Conference on Communications and the 5th International Symposium on Multi-Dimensional Mobile Communications Proceeding.

[53]  Manish Jain,et al.  End-to-end available bandwidth: measurement methodology, dynamics, and relation with TCP throughput , 2003, TNET.

[54]  Tiecheng Liu,et al.  Disruption-tolerant content-aware video streaming , 2004, MULTIMEDIA '04.

[55]  Scott A. Brandt,et al.  Dynamic integrated scheduling of hard real-time, soft real-time, and non-real-time processes , 2003, RTSS 2003. 24th IEEE Real-Time Systems Symposium, 2003.

[56]  George C. Polyzos,et al.  Multicast routing for multimedia communication , 1993, TNET.

[57]  Klara Nahrstedt,et al.  Janus: a cross-layer soft real-time architecture for virtualization , 2010, HPDC '10.

[58]  Miguel Castro,et al.  Scribe: a large-scale and decentralized application-level multicast infrastructure , 2002, IEEE J. Sel. Areas Commun..

[59]  Xiaohua Jia,et al.  A distributed algorithm of delay-bounded multicast routing for multimedia applications in wide area networks , 1998, TNET.

[60]  Chung-Ming Huang,et al.  An SVC-MDC video coding scheme using the multi-core parallel programming paradigm for P2P video streaming , 2009, 2009 IEEE/ACS International Conference on Computer Systems and Applications.

[61]  Pedro Cuenca,et al.  Speeding-Up the Macroblock Partition Mode Decision in MPEG-2/H.264 Transcoding , 2006, 2006 International Conference on Image Processing.

[62]  Klara Nahrstedt,et al.  Resource Management in Networked Multimedia Systems , 1995, Computer.

[63]  Klara Nahrstedt,et al.  iDSRT: Integrated Dynamic Soft Real-time Architecture for Critical Infrastructure Data Delivery over WLAN , 2009, Mob. Networks Appl..

[64]  Shuichi Oikawa,et al.  Resource kernels: a resource-centric approach to real-time and multimedia systems , 2001, Electronic Imaging.

[65]  Srinivasan Seshan,et al.  A case for end system multicast , 2002, IEEE J. Sel. Areas Commun..

[66]  Ja-Ling Wu,et al.  Scalable computation for spatially scalable video coding using NVIDIA CUDA and multi-core CPU , 2009, MM '09.

[67]  Krishna P. Gummadi,et al.  Sprobe: A fast technique for measuring bottleneck bandwidth in uncooperative environments , 2002, INFOCOM 2002.

[68]  Thomas Malzbender,et al.  Understanding performance in coliseum, an immersive videoconferencing system , 2005, TOMCCAP.

[69]  1588-Precise Time Synchronization as the Basis for Real Time Applications in Automation , 2003 .

[70]  Kostas Daniilidis,et al.  Towards the Holodeck : An Initial Testbed for Real-Time 3 D-Teleimmersion , 2007 .

[71]  Hui Zhang,et al.  A case for end system multicast (keynote address) , 2000, SIGMETRICS '00.

[72]  James W. Layland,et al.  Scheduling Algorithms for Multiprogramming in a Hard-Real-Time Environment , 1989, JACM.

[73]  Joseph L. Hellerstein,et al.  Achieving Service Rate Objectives with Decay Usage Scheduling , 1993, IEEE Trans. Software Eng..

[74]  Klara Nahrstedt,et al.  CPU service classes for multimedia applications , 1999, Proceedings IEEE International Conference on Multimedia Computing and Systems.

[75]  Christophe Diot,et al.  Design and evaluation of MiMaze a multi-player game on the Internet , 1998, Proceedings. IEEE International Conference on Multimedia Computing and Systems (Cat. No.98TB100241).

[76]  Qing Zhu,et al.  A source-based algorithm for delay-constrained minimum-cost multicasting , 1995, Proceedings of INFOCOM'95.

[77]  Shih-Fu Chang,et al.  Real-time content-based adaptive streaming of sports videos , 2001, Proceedings IEEE Workshop on Content-Based Access of Image and Video Libraries (CBAIVL 2001).