Adjusting forward error correction with temporal scaling for TCP-friendly streaming MPEG

New TCP-friendly constraints require multimedia flows to reduce their data rates under packet loss to that of a conformant TCP flow. To reduce data rates while preserving real-time playout, temporal scaling can be used to discard the encoded multimedia frames that have the least impact on perceived video quality. To limit the impact of lost packets, Forward Error Correction (FEC) can be used to repair frames damaged by packet loss. However, adding FEC requires further reduction of multimedia data, making the decision of how much FEC to use of critical importance. Current approaches use either inflexible FEC patterns or adapt to packet loss on the network without regard to TCP-friendly data rate constraints. In this article, we analytically model the playable frame rate of a TCP-friendly MPEG stream with FEC and temporal scaling, capturing the impact of distributing FEC within MPEG frame types with interframe dependencies. For a given network condition and MPEG video encoding, we use our model to exhaustively search for the optimal combination of FEC and temporal scaling that yields the highest playable frame rate within TCP-friendly constraints. Analytic experiments over a range of network and application conditions indicate that adjustable FEC with temporal scaling can provide a significant performance improvement over current approaches. Extensive simulation experiments based on Internet traces show that our model can be effective as part of a streaming protocol that chooses FEC and temporal scaling patterns that meet dynamically-changing application and network conditions.

[1]  Donald F. Towsley,et al.  Adaptive FEC-based error control for Internet telephony , 1999, IEEE INFOCOM '99. Conference on Computer Communications. Proceedings. Eighteenth Annual Joint Conference of the IEEE Computer and Communications Societies. The Future is Now (Cat. No.99CH36320).

[2]  Injong Rhee,et al.  Error control techniques for interactive low-bit rate video transmission over the Internet , 1998, SIGCOMM '98.

[3]  I. Reed,et al.  Polynomial Codes Over Certain Finite Fields , 1960 .

[4]  Soam Acharya,et al.  Experiment to characterize videos stored on the Web , 1997, Electronic Imaging.

[5]  Olivier Verscheure,et al.  Perceptual quality measure using a spatiotemporal model of the human visual system , 1996, Electronic Imaging.

[6]  Mark Handley,et al.  Equation-based congestion control for unicast applications , 2000, SIGCOMM 2000.

[7]  Mark Claypool,et al.  Using redundancy to repair video damaged by network data loss , 1999, Electronic Imaging.

[8]  Walter Willinger,et al.  Analysis, modeling and generation of self-similar VBR video traffic , 1994, SIGCOMM.

[9]  Wei Wang,et al.  QoS-sensitive transport of real-time MPEG video using adaptive forward error correction , 1999, Proceedings IEEE International Conference on Multimedia Computing and Systems.

[10]  Mark Handley,et al.  Equation-based congestion control for unicast applications , 2000, SIGCOMM.

[11]  Christophe Diot,et al.  Impact of link failures on VoIP performance , 2002, NOSSDAV '02.

[12]  Deborah Estrin,et al.  RAP: An end-to-end rate-based congestion control mechanism for realtime streams in the Internet , 1999, IEEE INFOCOM '99. Conference on Computer Communications. Proceedings. Eighteenth Annual Joint Conference of the IEEE Computer and Communications Societies. The Future is Now (Cat. No.99CH36320).

[13]  Ketan Mayer-Patel,et al.  An MPEG performance model and its application to adaptive forward error correction , 2002, MULTIMEDIA '02.

[14]  Nick Feamster,et al.  Packet Loss Recovery for Streaming Video , 2002 .

[15]  Thinh Nguyen,et al.  Distributed Video Streaming with Forward Error Correction , 2003 .

[16]  Mark Claypool,et al.  An empirical study of realvideo performance across the internet , 2001, IMW '01.

[17]  Mark Handley,et al.  Reliable Audio for Use over the Internet , 2006 .

[18]  Kenneth J. Christensen,et al.  A new adaptive FEC loss control algorithm for voice over IP applications , 2000, Conference Proceedings of the 2000 IEEE International Performance, Computing, and Communications Conference (Cat. No.00CH37086).

[19]  Joan L. Mitchell,et al.  MPEG Video: Compression Standard , 1996 .

[20]  Mark Claypool,et al.  Improving Multimedia Streaming with Content-Aware Video Scaling , 2002, JCIS.

[21]  Yali Zhu,et al.  MEASUREMENT OF THE CONGESTION RESPONSIVENESS OF REALPLAYER STREAMING VIDEO OVER UDP , 2003 .

[22]  A. Mena,et al.  An empirical study of real audio traffic , 2000, Proceedings IEEE INFOCOM 2000. Conference on Computer Communications. Nineteenth Annual Joint Conference of the IEEE Computer and Communications Societies (Cat. No.00CH37064).

[23]  Harsha Sirisena,et al.  Hybrid error control mechanism for video transmission in the wireless IP networks , 1999, 10th IEEE Workshop on Local and Metropolitan Area Networks. Selected Papers (IEEE Cat. No.99EX512).

[24]  Oliver Rose,et al.  Statistical properties of MPEG video traffic and their impact on traffic modeling in ATM systems , 1995, Proceedings of 20th Conference on Local Computer Networks.

[25]  Didier J. Le Gall,et al.  The MPEG video compression standard , 1991, Compcon.

[26]  Vern Paxson.  End-to-end internet packet dynamics , 1999, TNET.

[27]  Mark Claypool,et al.  A model for MPEG with forward error correction and TCP-friendly bandwidth , 2003, NOSSDAV '03.

[28]  Sally Floyd,et al.  Promoting the use of end-to-end congestion control in the Internet , 1999, TNET.

[29]  Andrew T. Campbell,et al.  Utility-based Network Adaptation for MPEG-4 Systems , 1999 .

[30]  Luigi Rizzo,et al.  On the feasibility of software FEC , 1997 .

[31]  Donald F. Towsley,et al.  Inferring TCP connection characteristics through passive measurements , 2004, IEEE INFOCOM 2004.

[32]  Madhu Sudan,et al.  Priority encoding transmission , 1994, Proceedings 35th Annual Symposium on Foundations of Computer Science.

[33]  Hayder Radha,et al.  Measurement study of low-bitrate internet video streaming , 2001, IMW '01.

[34]  Donald F. Towsley,et al.  Modeling TCP throughput: a simple model and its empirical validation , 1998, SIGCOMM '98.

[35]  Margaret H. Pinson,et al.  A new standardized method for objectively measuring video quality , 2004, IEEE Transactions on Broadcasting.

[36]  Srinivasan Seshan,et al.  An integrated congestion management architecture for Internet hosts , 1999, SIGCOMM '99.

[37]  Deborah Estrin,et al.  Recommendations on Queue Management and Congestion Avoidance in the Internet , 1998, RFC.

[38]  M. Hemy.  MPEG System Streams in Best-Effort Networks , 1999 .

[39]  Ratul Mahajan,et al.  Controlling high-bandwidth flows at the congested router , 2001, Proceedings Ninth International Conference on Network Protocols. ICNP 2001.

[40]  Sally Floyd,et al.  TCP and explicit congestion notification , 1994, CCRV.

[41]  Madhu Sudan,et al.  Priority encoding transmission , 1996, IEEE Trans. Inf. Theory.

[42]  Mark W. Garrett,et al.  Modeling and generation of self-similar vbr video traffic , 1994, SIGCOMM 1994.

[43]  Marwan Krunz,et al.  Statistical characteristics and multiplexing of MPEG streams , 1995, Proceedings of INFOCOM'95.

[44]  Jill M. Boyce,et al.  Packet loss effects on MPEG video sent over the public Internet , 1998, MULTIMEDIA '98.

[45]  Vern Paxson,et al.  End-to-end Internet packet dynamics , 1997, SIGCOMM '97.